== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 10:43:01 (1789137781)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.43 seconds: 23.10 ops/second
 - mkdir 179 (time 1789137800.27 total 10.04 last 17.83)
 - mkdir 353 (time 1789137810.38 total 20.16 last 17.20)
 - mkdir 539 (time 1789137820.41 total 30.19 last 18.54)
 - mkdir 740 (time 1789137830.44 total 40.22 last 20.03)
 - mkdir 915 (time 1789137840.49 total 50.27 last 17.42)
total: 1000 mkdir in 55.78 seconds: 17.93 ops/second
 - mkdir 179 (time 1789137801.68 total 10.01 last 17.89)
 - mkdir 356 (time 1789137811.72 total 20.04 last 17.64)
 - mkdir 550 (time 1789137821.76 total 30.09 last 19.31)
 - mkdir 748 (time 1789137831.83 total 40.15 last 19.67)
 - mkdir 924 (time 1789137841.83 total 50.16 last 17.59)
total: 1000 mkdir in 55.71 seconds: 17.95 ops/second
 - mkdir 184 (time 1789137802.48 total 10.04 last 18.33)
 - mkdir 352 (time 1789137812.56 total 20.12 last 16.67)
 - mkdir 551 (time 1789137822.60 total 30.16 last 19.82)
 - mkdir 742 (time 1789137832.61 total 40.16 last 19.08)
 - mkdir 926 (time 1789137842.64 total 50.20 last 18.33)
total: 1000 mkdir in 55.78 seconds: 17.93 ops/second
 - mkdir 172 (time 1789137800.56 total 10.06 last 17.10)
 - mkdir 337 (time 1789137810.58 total 20.08 last 16.46)
 - mkdir 520 (time 1789137820.61 total 30.11 last 18.25)
 - mkdir 714 (time 1789137830.62 total 40.12 last 19.38)
 - mkdir 892 (time 1789137840.67 total 50.17 last 17.72)
total: 1000 mkdir in 58.16 seconds: 17.19 ops/second
 - mkdir 175 (time 1789137801.91 total 10.00 last 17.49)
 - mkdir 344 (time 1789137811.94 total 20.03 last 16.85)
 - mkdir 536 (time 1789137821.95 total 30.04 last 19.18)
 - mkdir 730 (time 1789137831.97 total 40.07 last 19.35)
 - mkdir 909 (time 1789137841.98 total 50.08 last 17.88)
total: 1000 mkdir in 57.31 seconds: 17.45 ops/second
 - mkdir 173 (time 1789137801.45 total 10.02 last 17.26)
 - mkdir 338 (time 1789137811.49 total 20.06 last 16.44)
 - mkdir 526 (time 1789137821.52 total 30.09 last 18.74)
 - mkdir 720 (time 1789137831.57 total 40.15 last 19.30)
 - mkdir 901 (time 1789137841.60 total 50.18 last 18.04)
total: 1000 mkdir in 58.01 seconds: 17.24 ops/second
 - mkdir 174 (time 1789137802.22 total 10.01 last 17.38)
 - mkdir 344 (time 1789137812.26 total 20.05 last 16.92)
 - mkdir 540 (time 1789137822.28 total 30.07 last 19.56)
 - mkdir 731 (time 1789137832.40 total 40.19 last 18.87)
 - mkdir 911 (time 1789137842.42 total 50.21 last 17.97)
total: 1000 mkdir in 57.24 seconds: 17.47 ops/second
 - mkdir 171 (time 1789137801.77 total 10.06 last 17.00)
 - mkdir 343 (time 1789137811.79 total 20.08 last 17.17)
 - mkdir 535 (time 1789137821.79 total 30.08 last 19.20)
 - mkdir 722 (time 1789137831.80 total 40.08 last 18.69)
 - mkdir 897 (time 1789137841.82 total 50.11 last 17.45)
total: 1000 mkdir in 58.54 seconds: 17.08 ops/second
 - mkdir 173 (time 1789137802.43 total 10.04 last 17.24)
 - mkdir 334 (time 1789137812.53 total 20.13 last 15.95)
 - mkdir 524 (time 1789137822.53 total 30.14 last 18.99)
 - mkdir 712 (time 1789137832.57 total 40.17 last 18.73)
 - mkdir 893 (time 1789137842.60 total 50.20 last 18.04)
total: 1000 mkdir in 58.91 seconds: 16.97 ops/second
 - mkdir 165 (time 1789137802.43 total 10.00 last 16.50)
 - mkdir 323 (time 1789137812.49 total 20.06 last 15.71)
 - mkdir 506 (time 1789137822.52 total 30.09 last 18.25)
 - mkdir 699 (time 1789137832.59 total 40.16 last 19.17)
 - mkdir 872 (time 1789137842.62 total 50.19 last 17.25)
total: 1000 mkdir in 59.93 seconds: 16.69 ops/second
Time for file creation 68 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.43 seconds: 23.02 ops/second
 - mkdir 184 (time 1789138331.45 total 10.01 last 18.39)
 - mkdir 400 (time 1789138341.50 total 20.06 last 21.49)
 - mkdir 586 (time 1789138351.51 total 30.07 last 18.58)
 - mkdir 803 (time 1789138361.53 total 40.09 last 21.65)
 - mkdir 975 (time 1789138371.58 total 50.14 last 17.13)
total: 1000 mkdir in 51.79 seconds: 19.31 ops/second
 - mkdir 195 (time 1789138333.23 total 10.00 last 19.50)
 - mkdir 402 (time 1789138343.26 total 20.03 last 20.64)
 - mkdir 594 (time 1789138353.27 total 30.04 last 19.18)
 - mkdir 803 (time 1789138363.32 total 40.09 last 20.79)
 - mkdir 970 (time 1789138373.34 total 50.11 last 16.67)
total: 1000 mkdir in 53.62 seconds: 18.65 ops/second
 - mkdir 194 (time 1789138332.62 total 10.01 last 19.39)
 - mkdir 399 (time 1789138342.65 total 20.04 last 20.43)
 - mkdir 586 (time 1789138352.69 total 30.07 last 18.64)
 - mkdir 795 (time 1789138362.75 total 40.13 last 20.77)
 - mkdir 962 (time 1789138372.78 total 50.17 last 16.64)
total: 1000 mkdir in 54.25 seconds: 18.43 ops/second
 - mkdir 186 (time 1789138333.07 total 10.03 last 18.54)
 - mkdir 388 (time 1789138343.11 total 20.07 last 20.12)
 - mkdir 577 (time 1789138353.11 total 30.08 last 18.89)
 - mkdir 777 (time 1789138363.14 total 40.11 last 19.94)
 - mkdir 944 (time 1789138373.20 total 50.16 last 16.61)
total: 1000 mkdir in 57.52 seconds: 17.38 ops/second
 - mkdir 188 (time 1789138333.70 total 10.04 last 18.73)
 - mkdir 385 (time 1789138343.75 total 20.09 last 19.60)
 - mkdir 579 (time 1789138353.78 total 30.11 last 19.36)
 - mkdir 776 (time 1789138363.85 total 40.18 last 19.56)
 - mkdir 942 (time 1789138373.87 total 50.20 last 16.56)
total: 1000 mkdir in 57.76 seconds: 17.31 ops/second
 - mkdir 187 (time 1789138333.90 total 10.02 last 18.66)
 - mkdir 381 (time 1789138343.92 total 20.04 last 19.37)
 - mkdir 574 (time 1789138353.93 total 30.05 last 19.27)
 - mkdir 773 (time 1789138363.96 total 40.09 last 19.83)
 - mkdir 940 (time 1789138374.00 total 50.12 last 16.64)
total: 1000 mkdir in 57.69 seconds: 17.33 ops/second
 - mkdir 193 (time 1789138333.82 total 10.02 last 19.27)
 - mkdir 383 (time 1789138343.84 total 20.03 last 18.97)
 - mkdir 577 (time 1789138353.89 total 30.08 last 19.31)
 - mkdir 775 (time 1789138363.94 total 40.13 last 19.70)
 - mkdir 939 (time 1789138374.04 total 50.23 last 16.24)
total: 1000 mkdir in 57.95 seconds: 17.26 ops/second
 - mkdir 184 (time 1789138333.39 total 10.03 last 18.35)
 - mkdir 381 (time 1789138343.44 total 20.08 last 19.61)
 - mkdir 566 (time 1789138353.46 total 30.09 last 18.47)
 - mkdir 764 (time 1789138363.46 total 40.10 last 19.79)
 - mkdir 930 (time 1789138373.50 total 50.14 last 16.54)
total: 1000 mkdir in 58.93 seconds: 16.97 ops/second
 - mkdir 185 (time 1789138333.66 total 10.04 last 18.43)
 - mkdir 378 (time 1789138343.76 total 20.14 last 19.11)
 - mkdir 564 (time 1789138353.79 total 30.17 last 18.54)
 - mkdir 765 (time 1789138363.85 total 40.23 last 19.98)
 - mkdir 930 (time 1789138373.97 total 50.35 last 16.30)
total: 1000 mkdir in 59.04 seconds: 16.94 ops/second
 - mkdir 181 (time 1789138333.50 total 10.02 last 18.06)
 - mkdir 369 (time 1789138343.51 total 20.03 last 18.79)
 - mkdir 548 (time 1789138353.53 total 30.05 last 17.85)
 - mkdir 748 (time 1789138363.57 total 40.09 last 19.93)
 - mkdir 916 (time 1789138373.66 total 50.18 last 16.65)
total: 1000 mkdir in 59.96 seconds: 16.68 ops/second
Time for file creation 70 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789138392 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789138391 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789138393 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789138392 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789138392 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789138392 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789138392 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789138393 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789138393 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789138393 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 44 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8