== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 15:28:56 (1789154936)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.62 seconds: 16.11 ops/second
 - mkdir 203 (time 1789154958.11 total 10.07 last 20.15)
 - mkdir 381 (time 1789154968.16 total 20.11 last 17.72)
 - mkdir 509 (time 1789154978.17 total 30.13 last 12.78)
 - mkdir 675 (time 1789154988.18 total 40.14 last 16.58)
 - mkdir 853 (time 1789154998.22 total 50.18 last 17.74)
total: 1000 mkdir in 57.08 seconds: 17.52 ops/second
 - mkdir 203 (time 1789154957.78 total 10.02 last 20.27)
 - mkdir 372 (time 1789154967.79 total 20.03 last 16.88)
 - mkdir 500 (time 1789154977.81 total 30.05 last 12.77)
 - mkdir 658 (time 1789154987.82 total 40.05 last 15.79)
 - mkdir 852 (time 1789154997.87 total 50.10 last 19.30)
total: 1000 mkdir in 57.42 seconds: 17.42 ops/second
 - mkdir 199 (time 1789154957.42 total 10.01 last 19.88)
 - mkdir 361 (time 1789154967.43 total 20.02 last 16.18)
 - mkdir 493 (time 1789154977.44 total 30.03 last 13.19)
 - mkdir 645 (time 1789154987.46 total 40.05 last 15.17)
 - mkdir 841 (time 1789154997.51 total 50.10 last 19.51)
total: 1000 mkdir in 58.55 seconds: 17.08 ops/second
 - mkdir 199 (time 1789154957.07 total 10.05 last 19.81)
 - mkdir 360 (time 1789154967.09 total 20.06 last 16.07)
 - mkdir 490 (time 1789154977.21 total 30.19 last 12.84)
 - mkdir 634 (time 1789154987.23 total 40.21 last 14.36)
 - mkdir 837 (time 1789154997.28 total 50.26 last 20.21)
total: 1000 mkdir in 59.03 seconds: 16.94 ops/second
 - mkdir 195 (time 1789154958.53 total 10.04 last 19.43)
 - mkdir 367 (time 1789154968.56 total 20.07 last 17.15)
 - mkdir 505 (time 1789154978.57 total 30.08 last 13.78)
 - mkdir 675 (time 1789154988.58 total 40.09 last 16.98)
 - mkdir 855 (time 1789154998.62 total 50.13 last 17.94)
total: 1000 mkdir in 57.69 seconds: 17.33 ops/second
 - mkdir 192 (time 1789154958.15 total 10.02 last 19.15)
 - mkdir 366 (time 1789154968.16 total 20.03 last 17.38)
 - mkdir 496 (time 1789154978.17 total 30.04 last 13.00)
 - mkdir 657 (time 1789154988.17 total 40.04 last 16.09)
 - mkdir 843 (time 1789154998.25 total 50.12 last 18.46)
total: 1000 mkdir in 58.10 seconds: 17.21 ops/second
 - mkdir 198 (time 1789154958.67 total 10.03 last 19.75)
 - mkdir 366 (time 1789154968.68 total 20.03 last 16.78)
 - mkdir 493 (time 1789154978.73 total 30.09 last 12.63)
 - mkdir 669 (time 1789154988.76 total 40.12 last 17.55)
 - mkdir 849 (time 1789154998.77 total 50.12 last 17.99)
total: 1000 mkdir in 57.63 seconds: 17.35 ops/second
 - mkdir 194 (time 1789154958.30 total 10.01 last 19.38)
 - mkdir 364 (time 1789154968.34 total 20.05 last 16.94)
 - mkdir 490 (time 1789154978.37 total 30.07 last 12.56)
 - mkdir 656 (time 1789154988.38 total 40.08 last 16.59)
 - mkdir 841 (time 1789154998.39 total 50.10 last 18.47)
total: 1000 mkdir in 58.05 seconds: 17.23 ops/second
 - mkdir 192 (time 1789154958.21 total 10.01 last 19.19)
 - mkdir 365 (time 1789154968.23 total 20.02 last 17.27)
 - mkdir 496 (time 1789154978.28 total 30.08 last 13.03)
 - mkdir 659 (time 1789154988.29 total 40.08 last 16.30)
 - mkdir 838 (time 1789154998.33 total 50.13 last 17.82)
total: 1000 mkdir in 58.49 seconds: 17.10 ops/second
 - mkdir 189 (time 1789154957.94 total 10.08 last 18.74)
 - mkdir 342 (time 1789154967.98 total 20.13 last 15.23)
 - mkdir 470 (time 1789154978.06 total 30.21 last 12.70)
 - mkdir 631 (time 1789154988.06 total 40.21 last 16.10)
 - mkdir 815 (time 1789154998.08 total 50.23 last 18.37)
total: 1000 mkdir in 60.05 seconds: 16.65 ops/second
Time for file creation 71 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 19.85 ops/second
 - mkdir 183 (time 1789155508.31 total 10.02 last 18.26)
 - mkdir 391 (time 1789155518.33 total 20.04 last 20.76)
 - mkdir 572 (time 1789155528.36 total 30.07 last 18.05)
 - mkdir 776 (time 1789155538.38 total 40.10 last 20.34)
 - mkdir 930 (time 1789155548.43 total 50.15 last 15.33)
total: 1000 mkdir in 54.97 seconds: 18.19 ops/second
 - mkdir 184 (time 1789155508.98 total 10.01 last 18.37)
 - mkdir 394 (time 1789155518.99 total 20.03 last 20.97)
 - mkdir 577 (time 1789155528.99 total 30.03 last 18.30)
 - mkdir 785 (time 1789155539.00 total 40.04 last 20.79)
 - mkdir 933 (time 1789155549.05 total 50.09 last 14.72)
total: 1000 mkdir in 54.77 seconds: 18.26 ops/second
 - mkdir 183 (time 1789155509.01 total 10.02 last 18.27)
 - mkdir 397 (time 1789155519.02 total 20.02 last 21.39)
 - mkdir 573 (time 1789155529.02 total 30.03 last 17.59)
 - mkdir 776 (time 1789155539.03 total 40.03 last 20.29)
 - mkdir 926 (time 1789155549.04 total 50.05 last 14.97)
total: 1000 mkdir in 55.44 seconds: 18.04 ops/second
 - mkdir 187 (time 1789155509.57 total 10.04 last 18.63)
 - mkdir 405 (time 1789155519.60 total 20.07 last 21.73)
 - mkdir 594 (time 1789155529.62 total 30.08 last 18.87)
 - mkdir 788 (time 1789155539.67 total 40.13 last 19.31)
 - mkdir 936 (time 1789155549.72 total 50.18 last 14.73)
total: 1000 mkdir in 55.44 seconds: 18.04 ops/second
 - mkdir 181 (time 1789155509.47 total 10.03 last 18.05)
 - mkdir 394 (time 1789155519.49 total 20.05 last 21.26)
 - mkdir 582 (time 1789155529.51 total 30.07 last 18.76)
 - mkdir 781 (time 1789155539.65 total 40.21 last 19.63)
 - mkdir 932 (time 1789155549.67 total 50.23 last 15.07)
total: 1000 mkdir in 55.90 seconds: 17.89 ops/second
 - mkdir 185 (time 1789155509.52 total 10.02 last 18.46)
 - mkdir 399 (time 1789155519.55 total 20.05 last 21.35)
 - mkdir 586 (time 1789155529.56 total 30.06 last 18.68)
 - mkdir 787 (time 1789155539.64 total 40.14 last 19.94)
 - mkdir 932 (time 1789155549.66 total 50.16 last 14.48)
total: 1000 mkdir in 56.11 seconds: 17.82 ops/second
 - mkdir 182 (time 1789155509.67 total 10.04 last 18.13)
 - mkdir 398 (time 1789155519.70 total 20.07 last 21.54)
 - mkdir 587 (time 1789155529.75 total 30.12 last 18.80)
 - mkdir 782 (time 1789155539.76 total 40.13 last 19.48)
 - mkdir 930 (time 1789155549.80 total 50.16 last 14.75)
total: 1000 mkdir in 56.10 seconds: 17.83 ops/second
 - mkdir 176 (time 1789155509.18 total 10.00 last 17.59)
 - mkdir 384 (time 1789155519.21 total 20.04 last 20.73)
 - mkdir 561 (time 1789155529.22 total 30.05 last 17.68)
 - mkdir 765 (time 1789155539.24 total 40.07 last 20.35)
 - mkdir 912 (time 1789155549.25 total 50.07 last 14.70)
total: 1000 mkdir in 57.63 seconds: 17.35 ops/second
 - mkdir 176 (time 1789155509.40 total 10.01 last 17.59)
 - mkdir 387 (time 1789155519.42 total 20.03 last 21.05)
 - mkdir 564 (time 1789155529.44 total 30.05 last 17.66)
 - mkdir 763 (time 1789155539.50 total 40.11 last 19.80)
 - mkdir 913 (time 1789155549.53 total 50.14 last 14.95)
total: 1000 mkdir in 57.83 seconds: 17.29 ops/second
 - mkdir 167 (time 1789155508.93 total 10.00 last 16.70)
 - mkdir 368 (time 1789155518.95 total 20.01 last 20.07)
 - mkdir 543 (time 1789155528.99 total 30.05 last 17.43)
 - mkdir 745 (time 1789155539.03 total 40.09 last 20.12)
 - mkdir 896 (time 1789155549.06 total 50.12 last 15.05)
total: 1000 mkdir in 59.39 seconds: 16.84 ops/second
Time for file creation 70 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789155569 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789155570 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789155570 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789155571 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789155572 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789155571 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789155572 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789155572 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789155572 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789155572 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8