== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 21:26:42 (1788485202)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.63 seconds: 15.94 ops/second
 - mkdir 145 (time 1788485224.91 total 10.01 last 14.49)
 - mkdir 319 (time 1788485234.96 total 20.06 last 17.31)
 - mkdir 543 (time 1788485244.97 total 30.07 last 22.38)
 - mkdir 720 (time 1788485254.98 total 40.08 last 17.68)
 - mkdir 912 (time 1788485265.01 total 50.11 last 19.14)
total: 1000 mkdir in 55.32 seconds: 18.08 ops/second
 - mkdir 140 (time 1788485224.52 total 10.03 last 13.96)
 - mkdir 312 (time 1788485234.54 total 20.05 last 17.16)
 - mkdir 539 (time 1788485244.57 total 30.08 last 22.63)
 - mkdir 711 (time 1788485254.60 total 40.11 last 17.15)
 - mkdir 903 (time 1788485264.64 total 50.15 last 19.11)
total: 1000 mkdir in 55.95 seconds: 17.87 ops/second
 - mkdir 136 (time 1788485225.18 total 10.03 last 13.56)
 - mkdir 313 (time 1788485235.18 total 20.03 last 17.70)
 - mkdir 543 (time 1788485245.18 total 30.03 last 23.00)
 - mkdir 718 (time 1788485255.20 total 40.04 last 17.48)
 - mkdir 909 (time 1788485265.23 total 50.08 last 19.04)
total: 1000 mkdir in 56.05 seconds: 17.84 ops/second
 - mkdir 141 (time 1788485225.46 total 10.02 last 14.08)
 - mkdir 316 (time 1788485235.49 total 20.05 last 17.44)
 - mkdir 541 (time 1788485245.50 total 30.05 last 22.50)
 - mkdir 715 (time 1788485255.53 total 40.08 last 17.34)
 - mkdir 902 (time 1788485265.54 total 50.09 last 18.68)
total: 1000 mkdir in 57.18 seconds: 17.49 ops/second
 - mkdir 140 (time 1788485225.52 total 10.03 last 13.96)
 - mkdir 316 (time 1788485235.57 total 20.08 last 17.51)
 - mkdir 537 (time 1788485245.58 total 30.08 last 22.09)
 - mkdir 707 (time 1788485255.58 total 40.08 last 17.00)
 - mkdir 893 (time 1788485265.60 total 50.10 last 18.56)
total: 1000 mkdir in 57.94 seconds: 17.26 ops/second
 - mkdir 142 (time 1788485225.93 total 10.09 last 14.07)
 - mkdir 318 (time 1788485235.94 total 20.10 last 17.59)
 - mkdir 543 (time 1788485245.96 total 30.12 last 22.45)
 - mkdir 716 (time 1788485256.01 total 40.17 last 17.22)
 - mkdir 901 (time 1788485266.02 total 50.18 last 18.48)
total: 1000 mkdir in 57.90 seconds: 17.27 ops/second
 - mkdir 143 (time 1788485225.86 total 10.06 last 14.22)
 - mkdir 313 (time 1788485235.92 total 20.12 last 16.90)
 - mkdir 544 (time 1788485245.93 total 30.13 last 23.07)
 - mkdir 719 (time 1788485255.95 total 40.15 last 17.46)
 - mkdir 900 (time 1788485265.95 total 50.15 last 18.09)
total: 1000 mkdir in 58.12 seconds: 17.20 ops/second
 - mkdir 139 (time 1788485226.13 total 10.05 last 13.84)
 - mkdir 316 (time 1788485236.15 total 20.06 last 17.67)
 - mkdir 539 (time 1788485246.20 total 30.11 last 22.20)
 - mkdir 716 (time 1788485256.21 total 40.12 last 17.68)
 - mkdir 903 (time 1788485266.22 total 50.14 last 18.68)
total: 1000 mkdir in 57.99 seconds: 17.25 ops/second
 - mkdir 142 (time 1788485225.86 total 10.10 last 14.06)
 - mkdir 318 (time 1788485235.88 total 20.12 last 17.56)
 - mkdir 540 (time 1788485245.90 total 30.14 last 22.16)
 - mkdir 713 (time 1788485255.92 total 40.16 last 17.26)
 - mkdir 891 (time 1788485265.96 total 50.21 last 17.72)
total: 1000 mkdir in 58.79 seconds: 17.01 ops/second
 - mkdir 140 (time 1788485226.08 total 10.00 last 14.00)
 - mkdir 314 (time 1788485236.08 total 20.01 last 17.39)
 - mkdir 537 (time 1788485246.10 total 30.03 last 22.25)
 - mkdir 711 (time 1788485256.14 total 40.07 last 17.33)
 - mkdir 892 (time 1788485266.17 total 50.10 last 18.05)
total: 1000 mkdir in 59.00 seconds: 16.95 ops/second
Time for file creation 72 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.41 seconds: 24.12 ops/second
 - mkdir 174 (time 1788485789.57 total 10.01 last 17.38)
 - mkdir 370 (time 1788485799.63 total 20.07 last 19.49)
 - mkdir 560 (time 1788485809.66 total 30.10 last 18.94)
 - mkdir 744 (time 1788485819.68 total 40.12 last 18.35)
 - mkdir 926 (time 1788485829.72 total 50.16 last 18.14)
total: 1000 mkdir in 54.37 seconds: 18.39 ops/second
 - mkdir 167 (time 1788485789.64 total 10.05 last 16.61)
 - mkdir 362 (time 1788485799.66 total 20.07 last 19.47)
 - mkdir 552 (time 1788485809.67 total 30.08 last 18.98)
 - mkdir 736 (time 1788485819.69 total 40.10 last 18.37)
 - mkdir 920 (time 1788485829.72 total 50.13 last 18.34)
total: 1000 mkdir in 54.66 seconds: 18.29 ops/second
 - mkdir 178 (time 1788485790.89 total 10.04 last 17.72)
 - mkdir 367 (time 1788485800.93 total 20.08 last 18.83)
 - mkdir 553 (time 1788485810.96 total 30.11 last 18.56)
 - mkdir 754 (time 1788485820.97 total 40.12 last 20.07)
 - mkdir 935 (time 1788485830.99 total 50.14 last 18.06)
total: 1000 mkdir in 54.67 seconds: 18.29 ops/second
 - mkdir 165 (time 1788485789.75 total 10.08 last 16.37)
 - mkdir 353 (time 1788485799.84 total 20.17 last 18.63)
 - mkdir 537 (time 1788485809.86 total 30.19 last 18.36)
 - mkdir 725 (time 1788485819.87 total 40.20 last 18.79)
 - mkdir 908 (time 1788485829.92 total 50.25 last 18.20)
total: 1000 mkdir in 56.73 seconds: 17.63 ops/second
 - mkdir 176 (time 1788485791.39 total 10.10 last 17.43)
 - mkdir 365 (time 1788485801.45 total 20.16 last 18.78)
 - mkdir 549 (time 1788485811.51 total 30.22 last 18.30)
 - mkdir 756 (time 1788485821.54 total 40.25 last 20.64)
 - mkdir 933 (time 1788485831.63 total 50.34 last 17.54)
total: 1000 mkdir in 55.63 seconds: 17.98 ops/second
 - mkdir 182 (time 1788485791.08 total 10.01 last 18.18)
 - mkdir 371 (time 1788485801.13 total 20.07 last 18.79)
 - mkdir 548 (time 1788485811.26 total 30.19 last 17.48)
 - mkdir 748 (time 1788485821.27 total 40.21 last 19.97)
 - mkdir 922 (time 1788485831.27 total 50.21 last 17.40)
total: 1000 mkdir in 56.51 seconds: 17.70 ops/second
 - mkdir 174 (time 1788485790.62 total 10.03 last 17.35)
 - mkdir 358 (time 1788485800.65 total 20.06 last 18.35)
 - mkdir 540 (time 1788485810.72 total 30.12 last 18.08)
 - mkdir 732 (time 1788485820.77 total 40.18 last 19.10)
 - mkdir 910 (time 1788485830.80 total 50.21 last 17.75)
total: 1000 mkdir in 57.42 seconds: 17.42 ops/second
 - mkdir 174 (time 1788485791.16 total 10.01 last 17.38)
 - mkdir 360 (time 1788485801.19 total 20.04 last 18.54)
 - mkdir 533 (time 1788485811.25 total 30.11 last 17.20)
 - mkdir 734 (time 1788485821.25 total 40.11 last 20.10)
 - mkdir 907 (time 1788485831.30 total 50.15 last 17.22)
total: 1000 mkdir in 58.81 seconds: 17.00 ops/second
 - mkdir 174 (time 1788485790.89 total 10.03 last 17.35)
 - mkdir 351 (time 1788485800.90 total 20.03 last 17.69)
 - mkdir 524 (time 1788485810.96 total 30.09 last 17.20)
 - mkdir 715 (time 1788485821.02 total 40.16 last 18.98)
 - mkdir 888 (time 1788485831.06 total 50.20 last 17.22)
 - mkdir 993 (time 1788485841.11 total 60.24 last 10.46)
total: 1000 mkdir in 60.77 seconds: 16.46 ops/second
 - mkdir 169 (time 1788485791.65 total 10.05 last 16.82)
 - mkdir 342 (time 1788485801.69 total 20.08 last 17.24)
 - mkdir 512 (time 1788485811.74 total 30.13 last 16.92)
 - mkdir 708 (time 1788485821.77 total 40.17 last 19.53)
 - mkdir 881 (time 1788485831.81 total 50.20 last 17.23)
 - mkdir 987 (time 1788485841.82 total 60.22 last 10.59)
total: 1000 mkdir in 60.97 seconds: 16.40 ops/second
Time for file creation 73 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788485851 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1788485853 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1788485854 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1788485855 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1788485856 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1788485856 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1788485855 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1788485856 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1788485856 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1788485856 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
Time for file removal 59 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8