== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 19:26:13 (1780010773)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.78 seconds: 12.87 ops/second
 - mkdir 150 (time 1780010796.23 total 10.03 last 14.96)
 - mkdir 311 (time 1780010806.30 total 20.10 last 15.98)
 - mkdir 496 (time 1780010816.39 total 30.19 last 18.33)
 - mkdir 673 (time 1780010826.45 total 40.25 last 17.61)
 - mkdir 853 (time 1780010836.49 total 50.29 last 17.92)
total: 1000 mkdir in 57.65 seconds: 17.35 ops/second
 - mkdir 150 (time 1780010796.16 total 10.11 last 14.83)
 - mkdir 310 (time 1780010806.24 total 20.19 last 15.88)
 - mkdir 498 (time 1780010816.33 total 30.28 last 18.62)
 - mkdir 676 (time 1780010826.38 total 40.33 last 17.72)
 - mkdir 851 (time 1780010836.41 total 50.36 last 17.44)
total: 1000 mkdir in 58.01 seconds: 17.24 ops/second
 - mkdir 165 (time 1780010797.52 total 10.08 last 16.37)
 - mkdir 327 (time 1780010807.52 total 20.08 last 16.20)
 - mkdir 520 (time 1780010817.54 total 30.10 last 19.27)
 - mkdir 698 (time 1780010827.56 total 40.12 last 17.77)
 - mkdir 867 (time 1780010837.57 total 50.13 last 16.87)
total: 1000 mkdir in 57.07 seconds: 17.52 ops/second
 - mkdir 149 (time 1780010797.06 total 10.04 last 14.84)
 - mkdir 311 (time 1780010807.07 total 20.05 last 16.18)
 - mkdir 499 (time 1780010817.08 total 30.06 last 18.79)
 - mkdir 675 (time 1780010827.13 total 40.11 last 17.50)
 - mkdir 849 (time 1780010837.18 total 50.16 last 17.32)
total: 1000 mkdir in 58.46 seconds: 17.11 ops/second
 - mkdir 152 (time 1780010796.98 total 10.03 last 15.15)
 - mkdir 315 (time 1780010806.98 total 20.04 last 16.29)
 - mkdir 502 (time 1780010816.99 total 30.05 last 18.69)
 - mkdir 673 (time 1780010827.04 total 40.10 last 17.01)
 - mkdir 851 (time 1780010837.10 total 50.16 last 17.70)
total: 1000 mkdir in 58.66 seconds: 17.05 ops/second
 - mkdir 155 (time 1780010797.18 total 10.08 last 15.38)
 - mkdir 312 (time 1780010807.25 total 20.14 last 15.60)
 - mkdir 509 (time 1780010817.26 total 30.16 last 19.68)
 - mkdir 678 (time 1780010827.26 total 40.16 last 16.90)
 - mkdir 848 (time 1780010837.28 total 50.18 last 16.96)
total: 1000 mkdir in 58.57 seconds: 17.07 ops/second
 - mkdir 156 (time 1780010797.47 total 10.11 last 15.43)
 - mkdir 321 (time 1780010807.47 total 20.11 last 16.49)
 - mkdir 507 (time 1780010817.48 total 30.12 last 18.59)
 - mkdir 677 (time 1780010827.51 total 40.15 last 16.94)
 - mkdir 852 (time 1780010837.61 total 50.25 last 17.33)
total: 1000 mkdir in 58.72 seconds: 17.03 ops/second
 - mkdir 152 (time 1780010797.99 total 10.03 last 15.15)
 - mkdir 330 (time 1780010808.02 total 20.06 last 17.76)
 - mkdir 508 (time 1780010818.03 total 30.07 last 17.78)
 - mkdir 678 (time 1780010828.04 total 40.08 last 16.98)
 - mkdir 849 (time 1780010838.07 total 50.11 last 17.05)
total: 1000 mkdir in 59.51 seconds: 16.81 ops/second
 - mkdir 147 (time 1780010797.56 total 10.04 last 14.65)
 - mkdir 304 (time 1780010807.60 total 20.07 last 15.65)
 - mkdir 488 (time 1780010817.64 total 30.11 last 18.32)
 - mkdir 660 (time 1780010827.66 total 40.13 last 17.17)
 - mkdir 832 (time 1780010837.71 total 50.18 last 17.11)
 - mkdir 996 (time 1780010847.76 total 60.23 last 16.33)
total: 1000 mkdir in 60.49 seconds: 16.53 ops/second
 - mkdir 140 (time 1780010797.73 total 10.05 last 13.92)
 - mkdir 302 (time 1780010807.75 total 20.08 last 16.16)
 - mkdir 473 (time 1780010817.79 total 30.12 last 17.03)
 - mkdir 644 (time 1780010827.86 total 40.19 last 16.98)
 - mkdir 815 (time 1780010837.89 total 50.22 last 17.04)
 - mkdir 978 (time 1780010847.94 total 60.27 last 16.21)
total: 1000 mkdir in 61.99 seconds: 16.13 ops/second
Time for file creation 74 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.94 seconds: 10.63 ops/second
 - mkdir 125 (time 1780011384.65 total 10.01 last 12.49)
 - mkdir 260 (time 1780011394.73 total 20.09 last 13.39)
 - mkdir 402 (time 1780011404.73 total 30.09 last 14.20)
 - mkdir 543 (time 1780011414.81 total 40.17 last 14.00)
 - mkdir 706 (time 1780011424.83 total 50.19 last 16.27)
 - mkdir 860 (time 1780011434.84 total 60.20 last 15.38)
total: 1000 mkdir in 69.21 seconds: 14.45 ops/second
 - mkdir 132 (time 1780011386.13 total 10.12 last 13.05)
 - mkdir 271 (time 1780011396.20 total 20.19 last 13.80)
 - mkdir 418 (time 1780011406.24 total 30.23 last 14.64)
 - mkdir 579 (time 1780011416.25 total 40.24 last 16.07)
 - mkdir 727 (time 1780011426.27 total 50.26 last 14.78)
 - mkdir 878 (time 1780011436.29 total 60.27 last 15.07)
total: 1000 mkdir in 68.92 seconds: 14.51 ops/second
 - mkdir 145 (time 1780011387.80 total 10.13 last 14.31)
 - mkdir 284 (time 1780011397.80 total 20.14 last 13.89)
 - mkdir 428 (time 1780011407.81 total 30.15 last 14.38)
 - mkdir 588 (time 1780011417.85 total 40.18 last 15.94)
 - mkdir 738 (time 1780011427.91 total 50.24 last 14.91)
 - mkdir 893 (time 1780011437.93 total 60.26 last 15.46)
total: 1000 mkdir in 67.77 seconds: 14.76 ops/second
 - mkdir 134 (time 1780011387.76 total 10.07 last 13.30)
 - mkdir 273 (time 1780011397.78 total 20.09 last 13.88)
 - mkdir 413 (time 1780011407.78 total 30.09 last 13.99)
 - mkdir 577 (time 1780011417.79 total 40.10 last 16.39)
 - mkdir 721 (time 1780011427.81 total 50.12 last 14.37)
 - mkdir 877 (time 1780011437.87 total 60.18 last 15.50)
total: 1000 mkdir in 69.68 seconds: 14.35 ops/second
 - mkdir 134 (time 1780011387.81 total 10.13 last 13.23)
 - mkdir 275 (time 1780011397.84 total 20.15 last 14.07)
 - mkdir 413 (time 1780011407.93 total 30.25 last 13.67)
 - mkdir 574 (time 1780011417.97 total 40.28 last 16.04)
 - mkdir 721 (time 1780011427.99 total 50.30 last 14.67)
 - mkdir 881 (time 1780011438.02 total 60.34 last 15.95)
total: 1000 mkdir in 69.81 seconds: 14.33 ops/second
 - mkdir 130 (time 1780011387.31 total 10.05 last 12.94)
 - mkdir 265 (time 1780011397.36 total 20.10 last 13.43)
 - mkdir 409 (time 1780011407.42 total 30.16 last 14.32)
 - mkdir 573 (time 1780011417.44 total 40.17 last 16.38)
 - mkdir 717 (time 1780011427.44 total 50.17 last 14.40)
 - mkdir 872 (time 1780011437.50 total 60.23 last 15.41)
 - mkdir 994 (time 1780011447.59 total 70.32 last 12.09)
total: 1000 mkdir in 71.02 seconds: 14.08 ops/second
 - mkdir 124 (time 1780011386.33 total 10.03 last 12.36)
 - mkdir 257 (time 1780011396.41 total 20.11 last 13.20)
 - mkdir 400 (time 1780011406.47 total 30.17 last 14.22)
 - mkdir 561 (time 1780011416.55 total 40.25 last 15.97)
 - mkdir 697 (time 1780011426.57 total 50.27 last 13.57)
 - mkdir 853 (time 1780011436.60 total 60.30 last 15.55)
 - mkdir 988 (time 1780011446.68 total 70.38 last 13.39)
total: 1000 mkdir in 72.01 seconds: 13.89 ops/second
 - mkdir 125 (time 1780011387.14 total 10.05 last 12.44)
 - mkdir 256 (time 1780011397.14 total 20.05 last 13.10)
 - mkdir 398 (time 1780011407.16 total 30.07 last 14.17)
 - mkdir 555 (time 1780011417.16 total 40.07 last 15.70)
 - mkdir 692 (time 1780011427.17 total 50.08 last 13.69)
 - mkdir 849 (time 1780011437.30 total 60.21 last 15.50)
 - mkdir 976 (time 1780011447.36 total 70.27 last 12.62)
total: 1000 mkdir in 73.37 seconds: 13.63 ops/second
 - mkdir 119 (time 1780011386.91 total 10.05 last 11.84)
 - mkdir 248 (time 1780011396.99 total 20.13 last 12.80)
 - mkdir 386 (time 1780011407.00 total 30.14 last 13.79)
 - mkdir 543 (time 1780011417.04 total 40.17 last 15.64)
 - mkdir 685 (time 1780011427.11 total 50.25 last 14.10)
 - mkdir 839 (time 1780011437.20 total 60.34 last 15.27)
 - mkdir 970 (time 1780011447.28 total 70.41 last 13.00)
total: 1000 mkdir in 74.00 seconds: 13.51 ops/second
 - mkdir 127 (time 1780011387.45 total 10.03 last 12.66)
 - mkdir 250 (time 1780011397.45 total 20.03 last 12.30)
 - mkdir 383 (time 1780011407.55 total 30.13 last 13.18)
 - mkdir 540 (time 1780011417.63 total 40.21 last 15.57)
 - mkdir 678 (time 1780011427.67 total 50.25 last 13.75)
 - mkdir 820 (time 1780011437.76 total 60.34 last 14.08)
 - mkdir 947 (time 1780011447.88 total 70.46 last 12.55)
total: 1000 mkdir in 75.56 seconds: 13.23 ops/second
Time for file creation 89 sec for 1 RPC sent at a time
 - unlinked 0 (time 1780011463 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1780011463 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1780011464 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1780011464 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1780011464 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1780011464 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1780011465 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1780011464 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1780011465 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1780011464 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8