== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 06:16:19 (1786961779)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.44 seconds: 22.90 ops/second
 - mkdir 173 (time 1786961799.83 total 10.04 last 17.22)
 - mkdir 320 (time 1786961809.87 total 20.08 last 14.65)
 - mkdir 495 (time 1786961819.88 total 30.10 last 17.47)
 - mkdir 655 (time 1786961829.93 total 40.14 last 15.93)
 - mkdir 851 (time 1786961839.96 total 50.17 last 19.54)
total: 1000 mkdir in 58.73 seconds: 17.03 ops/second
 - mkdir 173 (time 1786961802.30 total 10.21 last 16.95)
 - mkdir 338 (time 1786961812.33 total 20.24 last 16.45)
 - mkdir 522 (time 1786961822.36 total 30.26 last 18.35)
 - mkdir 692 (time 1786961832.36 total 40.27 last 16.99)
 - mkdir 893 (time 1786961842.38 total 50.29 last 20.06)
total: 1000 mkdir in 56.97 seconds: 17.55 ops/second
 - mkdir 169 (time 1786961802.30 total 10.13 last 16.68)
 - mkdir 331 (time 1786961812.33 total 20.17 last 16.14)
 - mkdir 512 (time 1786961822.43 total 30.27 last 17.93)
 - mkdir 675 (time 1786961832.48 total 40.32 last 16.21)
 - mkdir 879 (time 1786961842.52 total 50.36 last 20.33)
total: 1000 mkdir in 58.65 seconds: 17.05 ops/second
 - mkdir 166 (time 1786961801.25 total 10.02 last 16.57)
 - mkdir 315 (time 1786961811.30 total 20.07 last 14.82)
 - mkdir 486 (time 1786961821.33 total 30.10 last 17.05)
 - mkdir 650 (time 1786961831.37 total 40.14 last 16.34)
 - mkdir 856 (time 1786961841.46 total 50.23 last 20.41)
total: 1000 mkdir in 59.93 seconds: 16.69 ops/second
 - mkdir 168 (time 1786961801.66 total 10.07 last 16.68)
 - mkdir 322 (time 1786961811.68 total 20.09 last 15.38)
 - mkdir 494 (time 1786961821.75 total 30.16 last 17.07)
 - mkdir 659 (time 1786961831.77 total 40.19 last 16.46)
 - mkdir 861 (time 1786961841.79 total 50.20 last 20.18)
total: 1000 mkdir in 59.69 seconds: 16.75 ops/second
 - mkdir 163 (time 1786961801.46 total 10.03 last 16.25)
 - mkdir 318 (time 1786961811.49 total 20.07 last 15.44)
 - mkdir 495 (time 1786961821.57 total 30.15 last 17.56)
 - mkdir 659 (time 1786961831.57 total 40.15 last 16.40)
 - mkdir 860 (time 1786961841.63 total 50.21 last 19.98)
total: 1000 mkdir in 60.00 seconds: 16.67 ops/second
 - mkdir 165 (time 1786961801.88 total 10.03 last 16.45)
 - mkdir 321 (time 1786961811.89 total 20.04 last 15.59)
 - mkdir 494 (time 1786961821.91 total 30.06 last 17.26)
 - mkdir 654 (time 1786961831.95 total 40.10 last 15.93)
 - mkdir 855 (time 1786961841.97 total 50.13 last 20.05)
total: 1000 mkdir in 60.01 seconds: 16.67 ops/second
 - mkdir 159 (time 1786961801.89 total 10.04 last 15.84)
 - mkdir 317 (time 1786961811.95 total 20.10 last 15.70)
 - mkdir 488 (time 1786961821.96 total 30.11 last 17.08)
 - mkdir 652 (time 1786961831.97 total 40.12 last 16.39)
 - mkdir 856 (time 1786961842.00 total 50.16 last 20.32)
 - mkdir 995 (time 1786961852.11 total 60.26 last 13.75)
total: 1000 mkdir in 60.85 seconds: 16.43 ops/second
 - mkdir 158 (time 1786961800.84 total 10.08 last 15.68)
 - mkdir 306 (time 1786961810.91 total 20.14 last 14.71)
 - mkdir 470 (time 1786961820.92 total 30.15 last 16.38)
 - mkdir 631 (time 1786961830.93 total 40.16 last 16.09)
 - mkdir 832 (time 1786961840.95 total 50.18 last 20.05)
 - mkdir 982 (time 1786961850.97 total 60.20 last 14.97)
total: 1000 mkdir in 62.29 seconds: 16.06 ops/second
 - mkdir 152 (time 1786961802.02 total 10.09 last 15.07)
 - mkdir 301 (time 1786961812.07 total 20.14 last 14.82)
 - mkdir 470 (time 1786961822.11 total 30.18 last 16.83)
 - mkdir 640 (time 1786961832.12 total 40.19 last 16.99)
 - mkdir 841 (time 1786961842.13 total 50.20 last 20.07)
 - mkdir 983 (time 1786961852.19 total 60.26 last 14.12)
total: 1000 mkdir in 62.40 seconds: 16.03 ops/second
Time for file creation 73 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 17 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.53 seconds: 18.94 ops/second
 - mkdir 165 (time 1786962399.00 total 10.11 last 16.32)
 - mkdir 312 (time 1786962409.01 total 20.12 last 14.69)
 - mkdir 445 (time 1786962419.10 total 30.21 last 13.18)
 - mkdir 629 (time 1786962429.16 total 40.27 last 18.29)
 - mkdir 810 (time 1786962439.21 total 50.32 last 18.01)
 - mkdir 988 (time 1786962449.28 total 60.39 last 17.68)
total: 1000 mkdir in 60.84 seconds: 16.44 ops/second
 - mkdir 153 (time 1786962397.22 total 10.04 last 15.24)
 - mkdir 297 (time 1786962407.24 total 20.06 last 14.37)
 - mkdir 420 (time 1786962417.31 total 30.13 last 12.22)
 - mkdir 596 (time 1786962427.40 total 40.22 last 17.45)
 - mkdir 774 (time 1786962437.44 total 50.26 last 17.73)
 - mkdir 955 (time 1786962447.49 total 60.31 last 18.01)
total: 1000 mkdir in 62.76 seconds: 15.93 ops/second
 - mkdir 145 (time 1786962397.23 total 10.04 last 14.44)
 - mkdir 284 (time 1786962407.23 total 20.04 last 13.89)
 - mkdir 404 (time 1786962417.25 total 30.07 last 11.97)
 - mkdir 578 (time 1786962427.30 total 40.11 last 17.32)
 - mkdir 753 (time 1786962437.33 total 50.14 last 17.45)
 - mkdir 932 (time 1786962447.34 total 60.16 last 17.88)
total: 1000 mkdir in 65.02 seconds: 15.38 ops/second
 - mkdir 155 (time 1786962398.33 total 10.04 last 15.44)
 - mkdir 293 (time 1786962408.42 total 20.13 last 13.68)
 - mkdir 419 (time 1786962418.47 total 30.18 last 12.54)
 - mkdir 599 (time 1786962428.49 total 40.19 last 17.97)
 - mkdir 775 (time 1786962438.52 total 50.22 last 17.55)
 - mkdir 948 (time 1786962448.57 total 60.27 last 17.22)
total: 1000 mkdir in 64.57 seconds: 15.49 ops/second
 - mkdir 146 (time 1786962398.44 total 10.03 last 14.56)
 - mkdir 284 (time 1786962408.45 total 20.04 last 13.79)
 - mkdir 410 (time 1786962418.47 total 30.06 last 12.57)
 - mkdir 591 (time 1786962428.51 total 40.10 last 18.03)
 - mkdir 771 (time 1786962438.52 total 50.11 last 17.98)
 - mkdir 948 (time 1786962448.52 total 60.11 last 17.70)
total: 1000 mkdir in 64.61 seconds: 15.48 ops/second
 - mkdir 151 (time 1786962398.51 total 10.12 last 14.92)
 - mkdir 296 (time 1786962408.62 total 20.24 last 14.33)
 - mkdir 423 (time 1786962418.70 total 30.32 last 12.60)
 - mkdir 605 (time 1786962428.73 total 40.35 last 18.14)
 - mkdir 782 (time 1786962438.76 total 50.38 last 17.64)
 - mkdir 953 (time 1786962448.80 total 60.42 last 17.04)
total: 1000 mkdir in 64.74 seconds: 15.45 ops/second
 - mkdir 149 (time 1786962398.53 total 10.00 last 14.90)
 - mkdir 293 (time 1786962408.57 total 20.04 last 14.35)
 - mkdir 418 (time 1786962418.68 total 30.16 last 12.36)
 - mkdir 599 (time 1786962428.69 total 40.17 last 18.08)
 - mkdir 775 (time 1786962438.75 total 50.23 last 17.49)
 - mkdir 951 (time 1786962448.78 total 60.26 last 17.55)
total: 1000 mkdir in 64.62 seconds: 15.47 ops/second
 - mkdir 156 (time 1786962398.67 total 10.04 last 15.54)
 - mkdir 295 (time 1786962408.74 total 20.12 last 13.79)
 - mkdir 419 (time 1786962418.83 total 30.20 last 12.30)
 - mkdir 601 (time 1786962428.85 total 40.22 last 18.16)
 - mkdir 777 (time 1786962438.87 total 50.24 last 17.57)
 - mkdir 952 (time 1786962448.88 total 60.26 last 17.47)
total: 1000 mkdir in 64.57 seconds: 15.49 ops/second
 - mkdir 155 (time 1786962398.78 total 10.06 last 15.40)
 - mkdir 291 (time 1786962408.78 total 20.07 last 13.59)
 - mkdir 421 (time 1786962418.89 total 30.17 last 12.87)
 - mkdir 603 (time 1786962428.94 total 40.23 last 18.10)
 - mkdir 779 (time 1786962438.97 total 50.26 last 17.54)
 - mkdir 956 (time 1786962448.98 total 60.27 last 17.68)
total: 1000 mkdir in 64.54 seconds: 15.50 ops/second
 - mkdir 142 (time 1786962397.40 total 10.02 last 14.17)
 - mkdir 283 (time 1786962407.46 total 20.08 last 14.02)
 - mkdir 401 (time 1786962417.50 total 30.12 last 11.75)
 - mkdir 574 (time 1786962427.51 total 40.13 last 17.29)
 - mkdir 747 (time 1786962437.53 total 50.15 last 17.27)
 - mkdir 926 (time 1786962447.60 total 60.22 last 17.77)
total: 1000 mkdir in 66.00 seconds: 15.15 ops/second
Time for file creation 79 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786962463 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1786962467 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786962467 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1786962468 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786962468 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1786962468 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1786962468 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1786962468 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1786962469 ; total 1 ; last 1)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1786962468 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
Time for file removal 50 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8