== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 20:50:55 (1789087855)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.57 seconds: 17.68 ops/second
 - mkdir 148 (time 1789087877.79 total 10.05 last 14.72)
 - mkdir 298 (time 1789087887.84 total 20.11 last 14.92)
 - mkdir 459 (time 1789087897.87 total 30.13 last 16.05)
 - mkdir 641 (time 1789087907.90 total 40.16 last 18.15)
 - mkdir 802 (time 1789087917.96 total 50.22 last 16.01)
 - mkdir 971 (time 1789087927.98 total 60.24 last 16.86)
total: 1000 mkdir in 61.82 seconds: 16.18 ops/second
 - mkdir 143 (time 1789087878.11 total 10.04 last 14.24)
 - mkdir 289 (time 1789087888.12 total 20.06 last 14.58)
 - mkdir 449 (time 1789087898.15 total 30.08 last 15.96)
 - mkdir 628 (time 1789087908.17 total 40.10 last 17.87)
 - mkdir 787 (time 1789087918.23 total 50.16 last 15.80)
 - mkdir 952 (time 1789087928.27 total 60.21 last 16.43)
total: 1000 mkdir in 64.24 seconds: 15.57 ops/second
 - mkdir 139 (time 1789087877.29 total 10.01 last 13.89)
 - mkdir 281 (time 1789087887.34 total 20.05 last 14.14)
 - mkdir 439 (time 1789087897.39 total 30.11 last 15.71)
 - mkdir 610 (time 1789087907.40 total 40.12 last 17.09)
 - mkdir 778 (time 1789087917.51 total 50.23 last 16.62)
 - mkdir 940 (time 1789087927.56 total 60.27 last 16.12)
total: 1000 mkdir in 65.14 seconds: 15.35 ops/second
 - mkdir 128 (time 1789087875.07 total 10.01 last 12.79)
 - mkdir 274 (time 1789087885.11 total 20.05 last 14.54)
 - mkdir 413 (time 1789087895.13 total 30.08 last 13.87)
 - mkdir 581 (time 1789087905.19 total 40.13 last 16.71)
 - mkdir 743 (time 1789087915.21 total 50.16 last 16.16)
 - mkdir 906 (time 1789087925.25 total 60.19 last 16.24)
total: 1000 mkdir in 67.94 seconds: 14.72 ops/second
 - mkdir 139 (time 1789087878.00 total 10.03 last 13.86)
 - mkdir 288 (time 1789087888.02 total 20.05 last 14.87)
 - mkdir 445 (time 1789087898.04 total 30.06 last 15.68)
 - mkdir 616 (time 1789087908.05 total 40.07 last 17.08)
 - mkdir 782 (time 1789087918.08 total 50.11 last 16.54)
 - mkdir 944 (time 1789087928.10 total 60.12 last 16.18)
total: 1000 mkdir in 65.05 seconds: 15.37 ops/second
 - mkdir 140 (time 1789087877.61 total 10.04 last 13.95)
 - mkdir 287 (time 1789087887.62 total 20.04 last 14.69)
 - mkdir 442 (time 1789087897.64 total 30.06 last 15.46)
 - mkdir 615 (time 1789087907.64 total 40.06 last 17.30)
 - mkdir 776 (time 1789087917.66 total 50.08 last 16.08)
 - mkdir 937 (time 1789087927.68 total 60.11 last 16.06)
total: 1000 mkdir in 65.70 seconds: 15.22 ops/second
 - mkdir 141 (time 1789087878.06 total 10.05 last 14.03)
 - mkdir 291 (time 1789087888.15 total 20.13 last 14.87)
 - mkdir 448 (time 1789087898.15 total 30.14 last 15.69)
 - mkdir 621 (time 1789087908.20 total 40.19 last 17.22)
 - mkdir 778 (time 1789087918.21 total 50.20 last 15.68)
 - mkdir 937 (time 1789087928.24 total 60.23 last 15.86)
total: 1000 mkdir in 66.22 seconds: 15.10 ops/second
 - mkdir 137 (time 1789087878.21 total 10.02 last 13.67)
 - mkdir 284 (time 1789087888.23 total 20.04 last 14.67)
 - mkdir 442 (time 1789087898.26 total 30.07 last 15.75)
 - mkdir 614 (time 1789087908.28 total 40.09 last 17.17)
 - mkdir 772 (time 1789087918.29 total 50.10 last 15.78)
 - mkdir 933 (time 1789087928.32 total 60.13 last 16.05)
total: 1000 mkdir in 67.49 seconds: 14.82 ops/second
 - mkdir 132 (time 1789087876.69 total 10.11 last 13.06)
 - mkdir 272 (time 1789087886.71 total 20.13 last 13.97)
 - mkdir 421 (time 1789087896.71 total 30.13 last 14.90)
 - mkdir 592 (time 1789087906.74 total 40.15 last 17.06)
 - mkdir 745 (time 1789087916.75 total 50.17 last 15.27)
 - mkdir 902 (time 1789087926.77 total 60.18 last 15.68)
total: 1000 mkdir in 69.30 seconds: 14.43 ops/second
 - mkdir 128 (time 1789087877.15 total 10.07 last 12.71)
 - mkdir 269 (time 1789087887.21 total 20.12 last 14.03)
 - mkdir 414 (time 1789087897.24 total 30.15 last 14.46)
 - mkdir 580 (time 1789087907.25 total 40.16 last 16.58)
 - mkdir 738 (time 1789087917.33 total 50.24 last 15.67)
 - mkdir 889 (time 1789087927.36 total 60.27 last 15.06)
 - mkdir 988 (time 1789087937.36 total 70.27 last 9.90)
total: 1000 mkdir in 71.06 seconds: 14.07 ops/second
Time for file creation 81 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.72 seconds: 13.82 ops/second
 - mkdir 148 (time 1789088491.03 total 10.04 last 14.75)
 - mkdir 325 (time 1789088501.06 total 20.06 last 17.66)
 - mkdir 481 (time 1789088511.16 total 30.16 last 15.44)
 - mkdir 644 (time 1789088521.17 total 40.18 last 16.28)
 - mkdir 822 (time 1789088531.23 total 50.23 last 17.70)
 - mkdir 996 (time 1789088541.26 total 60.26 last 17.35)
total: 1000 mkdir in 60.44 seconds: 16.54 ops/second
 - mkdir 168 (time 1789088494.05 total 10.02 last 16.76)
 - mkdir 339 (time 1789088504.11 total 20.08 last 17.00)
 - mkdir 498 (time 1789088514.12 total 30.09 last 15.89)
 - mkdir 667 (time 1789088524.13 total 40.10 last 16.88)
 - mkdir 850 (time 1789088534.13 total 50.10 last 18.29)
 - mkdir 998 (time 1789088544.24 total 60.21 last 14.65)
total: 1000 mkdir in 60.32 seconds: 16.58 ops/second
 - mkdir 151 (time 1789088493.08 total 10.04 last 15.04)
 - mkdir 319 (time 1789088503.13 total 20.09 last 16.72)
 - mkdir 471 (time 1789088513.14 total 30.10 last 15.19)
 - mkdir 643 (time 1789088523.18 total 40.14 last 17.13)
 - mkdir 822 (time 1789088533.19 total 50.14 last 17.89)
 - mkdir 977 (time 1789088543.24 total 60.19 last 15.42)
total: 1000 mkdir in 62.94 seconds: 15.89 ops/second
 - mkdir 159 (time 1789088494.27 total 10.03 last 15.86)
 - mkdir 323 (time 1789088504.34 total 20.10 last 16.28)
 - mkdir 478 (time 1789088514.38 total 30.14 last 15.43)
 - mkdir 646 (time 1789088524.44 total 40.21 last 16.70)
 - mkdir 832 (time 1789088534.48 total 50.24 last 18.53)
 - mkdir 981 (time 1789088544.67 total 60.43 last 14.63)
total: 1000 mkdir in 62.89 seconds: 15.90 ops/second
 - mkdir 157 (time 1789088493.41 total 10.01 last 15.69)
 - mkdir 323 (time 1789088503.45 total 20.05 last 16.53)
 - mkdir 471 (time 1789088513.45 total 30.05 last 14.79)
 - mkdir 636 (time 1789088523.54 total 40.14 last 16.36)
 - mkdir 818 (time 1789088533.55 total 50.15 last 18.18)
 - mkdir 969 (time 1789088543.66 total 60.26 last 14.94)
total: 1000 mkdir in 64.39 seconds: 15.53 ops/second
 - mkdir 155 (time 1789088493.50 total 10.06 last 15.41)
 - mkdir 315 (time 1789088503.51 total 20.07 last 15.99)
 - mkdir 465 (time 1789088513.56 total 30.12 last 14.93)
 - mkdir 632 (time 1789088523.61 total 40.16 last 16.62)
 - mkdir 815 (time 1789088533.61 total 50.17 last 18.29)
 - mkdir 964 (time 1789088543.62 total 60.18 last 14.89)
total: 1000 mkdir in 65.21 seconds: 15.34 ops/second
 - mkdir 160 (time 1789088494.03 total 10.04 last 15.94)
 - mkdir 319 (time 1789088504.08 total 20.09 last 15.81)
 - mkdir 474 (time 1789088514.12 total 30.13 last 15.44)
 - mkdir 636 (time 1789088524.13 total 40.15 last 16.18)
 - mkdir 818 (time 1789088534.14 total 50.15 last 18.19)
 - mkdir 964 (time 1789088544.14 total 60.16 last 14.60)
total: 1000 mkdir in 64.92 seconds: 15.40 ops/second
 - mkdir 149 (time 1789088493.32 total 10.03 last 14.85)
 - mkdir 309 (time 1789088503.39 total 20.10 last 15.89)
 - mkdir 453 (time 1789088513.42 total 30.14 last 14.35)
 - mkdir 611 (time 1789088523.44 total 40.15 last 15.78)
 - mkdir 790 (time 1789088533.46 total 50.17 last 17.86)
 - mkdir 938 (time 1789088543.53 total 60.24 last 14.70)
total: 1000 mkdir in 66.91 seconds: 14.95 ops/second
 - mkdir 160 (time 1789088494.23 total 10.02 last 15.97)
 - mkdir 318 (time 1789088504.23 total 20.02 last 15.80)
 - mkdir 468 (time 1789088514.29 total 30.08 last 14.92)
 - mkdir 626 (time 1789088524.35 total 40.14 last 15.70)
 - mkdir 810 (time 1789088534.38 total 50.17 last 18.35)
 - mkdir 949 (time 1789088544.48 total 60.27 last 13.75)
total: 1000 mkdir in 66.23 seconds: 15.10 ops/second
 - mkdir 149 (time 1789088494.15 total 10.06 last 14.81)
 - mkdir 300 (time 1789088504.21 total 20.11 last 15.02)
 - mkdir 448 (time 1789088514.21 total 30.12 last 14.80)
 - mkdir 602 (time 1789088524.29 total 40.20 last 15.28)
 - mkdir 776 (time 1789088534.36 total 50.27 last 17.29)
 - mkdir 910 (time 1789088544.36 total 60.27 last 13.40)
total: 1000 mkdir in 68.37 seconds: 14.63 ops/second
Time for file creation 82 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789088559 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1789088559 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789088561 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1789088560 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789088561 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789088561 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789088561 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789088561 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1789088561 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789088561 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8