== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 04:49:37 (1786438177)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.57 seconds: 17.57 ops/second
 - mkdir 109 (time 1786438202.08 total 10.04 last 10.85)
 - mkdir 221 (time 1786438212.09 total 20.05 last 11.19)
 - mkdir 345 (time 1786438222.13 total 30.10 last 12.34)
 - mkdir 473 (time 1786438232.19 total 40.15 last 12.73)
 - mkdir 571 (time 1786438242.22 total 50.18 last 9.77)
 - mkdir 683 (time 1786438252.26 total 60.22 last 11.15)
 - mkdir 789 (time 1786438262.33 total 70.29 last 10.53)
 - mkdir 912 (time 1786438272.38 total 80.34 last 12.23)
total: 1000 mkdir in 87.44 seconds: 11.44 ops/second
 - mkdir 115 (time 1786438202.94 total 10.02 last 11.48)
 - mkdir 223 (time 1786438212.99 total 20.07 last 10.74)
 - mkdir 350 (time 1786438223.04 total 30.12 last 12.64)
 - mkdir 474 (time 1786438233.04 total 40.12 last 12.39)
 - mkdir 579 (time 1786438243.06 total 50.14 last 10.48)
 - mkdir 688 (time 1786438253.09 total 60.17 last 10.88)
 - mkdir 797 (time 1786438263.11 total 70.19 last 10.88)
 - mkdir 916 (time 1786438273.13 total 80.21 last 11.87)
total: 1000 mkdir in 87.44 seconds: 11.44 ops/second
 - mkdir 112 (time 1786438202.39 total 10.08 last 11.11)
 - mkdir 221 (time 1786438212.53 total 20.22 last 10.76)
 - mkdir 342 (time 1786438222.60 total 30.29 last 12.01)
 - mkdir 468 (time 1786438232.67 total 40.36 last 12.51)
 - mkdir 567 (time 1786438242.74 total 50.43 last 9.83)
 - mkdir 674 (time 1786438252.75 total 60.44 last 10.69)
 - mkdir 789 (time 1786438262.80 total 70.48 last 11.45)
 - mkdir 910 (time 1786438272.87 total 80.56 last 12.01)
total: 1000 mkdir in 88.31 seconds: 11.32 ops/second
 - mkdir 111 (time 1786438202.59 total 10.02 last 11.07)
 - mkdir 217 (time 1786438212.62 total 20.05 last 10.58)
 - mkdir 338 (time 1786438222.62 total 30.06 last 12.09)
 - mkdir 466 (time 1786438232.67 total 40.11 last 12.74)
 - mkdir 567 (time 1786438242.70 total 50.13 last 10.07)
 - mkdir 676 (time 1786438252.77 total 60.20 last 10.83)
 - mkdir 787 (time 1786438262.80 total 70.23 last 11.06)
 - mkdir 909 (time 1786438272.86 total 80.29 last 12.13)
total: 1000 mkdir in 88.26 seconds: 11.33 ops/second
 - mkdir 120 (time 1786438202.81 total 10.07 last 11.92)
 - mkdir 232 (time 1786438212.89 total 20.15 last 11.11)
 - mkdir 350 (time 1786438222.89 total 30.15 last 11.79)
 - mkdir 472 (time 1786438233.04 total 40.30 last 12.02)
 - mkdir 576 (time 1786438243.08 total 50.33 last 10.36)
 - mkdir 681 (time 1786438253.17 total 60.42 last 10.40)
 - mkdir 793 (time 1786438263.17 total 70.43 last 11.20)
 - mkdir 912 (time 1786438273.23 total 80.48 last 11.83)
total: 1000 mkdir in 88.86 seconds: 11.25 ops/second
 - mkdir 117 (time 1786438203.03 total 10.05 last 11.64)
 - mkdir 220 (time 1786438213.06 total 20.08 last 10.27)
 - mkdir 345 (time 1786438223.15 total 30.17 last 12.39)
 - mkdir 468 (time 1786438233.20 total 40.22 last 12.24)
 - mkdir 576 (time 1786438243.32 total 50.34 last 10.67)
 - mkdir 677 (time 1786438253.33 total 60.35 last 10.09)
 - mkdir 788 (time 1786438263.36 total 70.38 last 11.07)
 - mkdir 909 (time 1786438273.40 total 80.42 last 12.05)
total: 1000 mkdir in 89.43 seconds: 11.18 ops/second
 - mkdir 113 (time 1786438202.29 total 10.04 last 11.25)
 - mkdir 220 (time 1786438212.53 total 20.28 last 10.45)
 - mkdir 343 (time 1786438222.63 total 30.38 last 12.18)
 - mkdir 467 (time 1786438232.66 total 40.41 last 12.36)
 - mkdir 564 (time 1786438242.67 total 50.42 last 9.69)
 - mkdir 669 (time 1786438252.81 total 60.56 last 10.35)
 - mkdir 783 (time 1786438262.86 total 70.61 last 11.34)
 - mkdir 900 (time 1786438272.91 total 80.66 last 11.64)
total: 1000 mkdir in 90.59 seconds: 11.04 ops/second
 - mkdir 109 (time 1786438202.02 total 10.14 last 10.75)
 - mkdir 219 (time 1786438212.09 total 20.21 last 10.92)
 - mkdir 340 (time 1786438222.13 total 30.25 last 12.05)
 - mkdir 462 (time 1786438232.38 total 40.50 last 11.91)
 - mkdir 560 (time 1786438242.41 total 50.53 last 9.77)
 - mkdir 666 (time 1786438252.73 total 60.85 last 10.27)
 - mkdir 777 (time 1786438262.82 total 70.94 last 11.00)
 - mkdir 896 (time 1786438272.88 total 81.01 last 11.83)
 - mkdir 995 (time 1786438282.96 total 91.08 last 9.83)
total: 1000 mkdir in 91.96 seconds: 10.87 ops/second
 - mkdir 101 (time 1786438199.58 total 10.00 last 10.10)
 - mkdir 204 (time 1786438209.60 total 20.02 last 10.29)
 - mkdir 317 (time 1786438219.69 total 30.11 last 11.20)
 - mkdir 432 (time 1786438229.73 total 40.15 last 11.45)
 - mkdir 537 (time 1786438239.78 total 50.20 last 10.45)
 - mkdir 628 (time 1786438249.95 total 60.37 last 8.95)
 - mkdir 731 (time 1786438259.99 total 70.41 last 10.27)
 - mkdir 856 (time 1786438270.02 total 80.43 last 12.46)
 - mkdir 977 (time 1786438280.11 total 90.53 last 11.99)
total: 1000 mkdir in 94.31 seconds: 10.60 ops/second
 - mkdir 114 (time 1786438202.86 total 10.02 last 11.37)
 - mkdir 218 (time 1786438212.89 total 20.05 last 10.37)
 - mkdir 333 (time 1786438222.91 total 30.07 last 11.47)
 - mkdir 453 (time 1786438232.92 total 40.08 last 11.99)
 - mkdir 554 (time 1786438242.94 total 50.11 last 10.07)
 - mkdir 658 (time 1786438253.03 total 60.19 last 10.31)
 - mkdir 770 (time 1786438263.03 total 70.20 last 11.20)
 - mkdir 891 (time 1786438273.06 total 80.22 last 12.07)
 - mkdir 989 (time 1786438283.07 total 90.23 last 9.79)
total: 1000 mkdir in 92.07 seconds: 10.86 ops/second
Time for file creation 105 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.62 seconds: 16.14 ops/second
 - mkdir 107 (time 1786438881.56 total 10.00 last 10.70)
 - mkdir 222 (time 1786438891.61 total 20.05 last 11.45)
 - mkdir 337 (time 1786438901.70 total 30.14 last 11.40)
 - mkdir 456 (time 1786438911.90 total 40.34 last 11.66)
 - mkdir 584 (time 1786438921.90 total 50.34 last 12.79)
 - mkdir 681 (time 1786438931.90 total 60.34 last 9.70)
 - mkdir 789 (time 1786438941.93 total 70.37 last 10.77)
 - mkdir 908 (time 1786438952.02 total 80.45 last 11.80)
total: 1000 mkdir in 88.53 seconds: 11.30 ops/second
 - mkdir 99 (time 1786438880.42 total 10.07 last 9.84)
 - mkdir 216 (time 1786438890.46 total 20.10 last 11.66)
 - mkdir 328 (time 1786438900.69 total 30.34 last 10.94)
 - mkdir 443 (time 1786438910.70 total 40.35 last 11.49)
 - mkdir 573 (time 1786438920.73 total 50.38 last 12.97)
 - mkdir 671 (time 1786438930.75 total 60.39 last 9.78)
 - mkdir 772 (time 1786438940.80 total 70.45 last 10.05)
 - mkdir 887 (time 1786438950.85 total 80.49 last 11.45)
total: 1000 mkdir in 90.12 seconds: 11.10 ops/second
 - mkdir 100 (time 1786438880.54 total 10.24 last 9.77)
 - mkdir 213 (time 1786438890.58 total 20.28 last 11.25)
 - mkdir 326 (time 1786438900.68 total 30.38 last 11.19)
 - mkdir 445 (time 1786438910.71 total 40.41 last 11.87)
 - mkdir 572 (time 1786438920.74 total 50.44 last 12.66)
 - mkdir 671 (time 1786438930.77 total 60.47 last 9.87)
 - mkdir 775 (time 1786438940.79 total 70.48 last 10.39)
 - mkdir 890 (time 1786438950.85 total 80.55 last 11.43)
total: 1000 mkdir in 90.25 seconds: 11.08 ops/second
 - mkdir 116 (time 1786438882.46 total 10.00 last 11.60)
 - mkdir 230 (time 1786438892.55 total 20.09 last 11.31)
 - mkdir 342 (time 1786438902.57 total 30.11 last 11.17)
 - mkdir 463 (time 1786438912.83 total 40.37 last 11.80)
 - mkdir 594 (time 1786438922.89 total 50.44 last 13.01)
 - mkdir 687 (time 1786438932.99 total 60.53 last 9.21)
 - mkdir 802 (time 1786438943.14 total 70.68 last 11.34)
 - mkdir 915 (time 1786438953.16 total 80.70 last 11.28)
total: 1000 mkdir in 88.71 seconds: 11.27 ops/second
 - mkdir 116 (time 1786438882.44 total 10.07 last 11.52)
 - mkdir 226 (time 1786438892.47 total 20.09 last 10.97)
 - mkdir 339 (time 1786438902.56 total 30.18 last 11.20)
 - mkdir 457 (time 1786438912.79 total 40.42 last 11.53)
 - mkdir 589 (time 1786438922.82 total 50.44 last 13.16)
 - mkdir 684 (time 1786438932.86 total 60.48 last 9.46)
 - mkdir 792 (time 1786438942.90 total 70.52 last 10.76)
 - mkdir 904 (time 1786438952.97 total 80.59 last 11.12)
total: 1000 mkdir in 89.97 seconds: 11.11 ops/second
 - mkdir 113 (time 1786438881.96 total 10.05 last 11.24)
 - mkdir 232 (time 1786438892.01 total 20.10 last 11.84)
 - mkdir 344 (time 1786438902.03 total 30.12 last 11.18)
 - mkdir 464 (time 1786438912.09 total 40.19 last 11.93)
 - mkdir 594 (time 1786438922.16 total 50.25 last 12.92)
 - mkdir 687 (time 1786438932.19 total 60.28 last 9.27)
 - mkdir 788 (time 1786438942.21 total 70.30 last 10.08)
 - mkdir 897 (time 1786438952.22 total 80.31 last 10.89)
 - mkdir 997 (time 1786438962.31 total 90.40 last 9.91)
total: 1000 mkdir in 90.91 seconds: 11.00 ops/second
 - mkdir 113 (time 1786438882.18 total 10.04 last 11.26)
 - mkdir 227 (time 1786438892.20 total 20.06 last 11.37)
 - mkdir 339 (time 1786438902.21 total 30.07 last 11.19)
 - mkdir 460 (time 1786438912.26 total 40.12 last 12.05)
 - mkdir 589 (time 1786438922.38 total 50.24 last 12.75)
 - mkdir 684 (time 1786438932.44 total 60.30 last 9.44)
 - mkdir 787 (time 1786438942.53 total 70.39 last 10.21)
 - mkdir 896 (time 1786438952.55 total 80.41 last 10.88)
 - mkdir 994 (time 1786438962.74 total 90.60 last 9.61)
total: 1000 mkdir in 91.34 seconds: 10.95 ops/second
 - mkdir 98 (time 1786438880.54 total 10.08 last 9.73)
 - mkdir 209 (time 1786438890.58 total 20.11 last 11.06)
 - mkdir 319 (time 1786438900.69 total 30.22 last 10.88)
 - mkdir 437 (time 1786438910.72 total 40.25 last 11.77)
 - mkdir 568 (time 1786438920.82 total 50.35 last 12.97)
 - mkdir 665 (time 1786438930.87 total 60.40 last 9.65)
 - mkdir 767 (time 1786438940.95 total 70.48 last 10.12)
 - mkdir 876 (time 1786438950.99 total 80.52 last 10.86)
 - mkdir 983 (time 1786438961.10 total 90.63 last 10.59)
total: 1000 mkdir in 93.43 seconds: 10.70 ops/second
 - mkdir 111 (time 1786438882.46 total 10.00 last 11.10)
 - mkdir 223 (time 1786438892.53 total 20.08 last 11.12)
 - mkdir 334 (time 1786438902.58 total 30.13 last 11.05)
 - mkdir 452 (time 1786438912.58 total 40.13 last 11.80)
 - mkdir 579 (time 1786438922.64 total 50.18 last 12.63)
 - mkdir 673 (time 1786438932.67 total 60.21 last 9.37)
 - mkdir 777 (time 1786438942.74 total 70.29 last 10.33)
 - mkdir 884 (time 1786438952.75 total 80.29 last 10.70)
 - mkdir 984 (time 1786438962.75 total 90.29 last 10.00)
total: 1000 mkdir in 93.02 seconds: 10.75 ops/second
 - mkdir 97 (time 1786438881.59 total 10.09 last 9.61)
 - mkdir 203 (time 1786438891.60 total 20.10 last 10.59)
 - mkdir 307 (time 1786438901.67 total 30.17 last 10.33)
 - mkdir 419 (time 1786438911.74 total 40.25 last 11.12)
 - mkdir 550 (time 1786438921.78 total 50.28 last 13.05)
 - mkdir 647 (time 1786438931.82 total 60.33 last 9.66)
 - mkdir 746 (time 1786438941.86 total 70.37 last 9.86)
 - mkdir 849 (time 1786438951.91 total 80.42 last 10.25)
 - mkdir 947 (time 1786438961.96 total 90.47 last 9.75)
total: 1000 mkdir in 96.98 seconds: 10.31 ops/second
Time for file creation 111 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786438975 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1786438977 ; total 0 ; last 0)
total: 1000 unlinks in 45 seconds: 22.222221 unlinks/second
 - unlinked 0 (time 1786438977 ; total 0 ; last 0)
total: 1000 unlinks in 46 seconds: 21.739130 unlinks/second
 - unlinked 0 (time 1786438977 ; total 0 ; last 0)
total: 1000 unlinks in 46 seconds: 21.739130 unlinks/second
 - unlinked 0 (time 1786438978 ; total 0 ; last 0)
total: 1000 unlinks in 46 seconds: 21.739130 unlinks/second
 - unlinked 0 (time 1786438977 ; total 0 ; last 0)
total: 1000 unlinks in 47 seconds: 21.276596 unlinks/second
 - unlinked 0 (time 1786438977 ; total 0 ; last 0)
total: 1000 unlinks in 48 seconds: 20.833334 unlinks/second
 - unlinked 0 (time 1786438977 ; total 0 ; last 0)
total: 1000 unlinks in 48 seconds: 20.833334 unlinks/second
 - unlinked 0 (time 1786438977 ; total 0 ; last 0)
total: 1000 unlinks in 48 seconds: 20.833334 unlinks/second
 - unlinked 0 (time 1786438978 ; total 0 ; last 0)
total: 1000 unlinks in 48 seconds: 20.833334 unlinks/second
Time for file removal 63 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8