== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 13:16:30 (1787850990)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.46 seconds: 21.94 ops/second
 - mkdir 145 (time 1787851012.29 total 10.04 last 14.44)
 - mkdir 313 (time 1787851022.32 total 20.06 last 16.76)
 - mkdir 492 (time 1787851032.35 total 30.10 last 17.84)
 - mkdir 667 (time 1787851042.37 total 40.11 last 17.47)
 - mkdir 855 (time 1787851052.39 total 50.13 last 18.76)
total: 1000 mkdir in 58.29 seconds: 17.16 ops/second
 - mkdir 144 (time 1787851012.61 total 10.01 last 14.38)
 - mkdir 314 (time 1787851022.62 total 20.03 last 16.98)
 - mkdir 491 (time 1787851032.67 total 30.07 last 17.62)
 - mkdir 670 (time 1787851042.67 total 40.08 last 17.89)
 - mkdir 852 (time 1787851052.74 total 50.14 last 18.09)
total: 1000 mkdir in 59.42 seconds: 16.83 ops/second
 - mkdir 148 (time 1787851013.01 total 10.08 last 14.68)
 - mkdir 318 (time 1787851023.08 total 20.15 last 16.89)
 - mkdir 492 (time 1787851033.10 total 30.17 last 17.37)
 - mkdir 667 (time 1787851043.10 total 40.17 last 17.50)
 - mkdir 855 (time 1787851053.12 total 50.19 last 18.76)
total: 1000 mkdir in 59.69 seconds: 16.75 ops/second
 - mkdir 142 (time 1787851012.53 total 10.00 last 14.19)
 - mkdir 311 (time 1787851022.53 total 20.01 last 16.89)
 - mkdir 480 (time 1787851032.60 total 30.08 last 16.79)
 - mkdir 657 (time 1787851042.62 total 40.10 last 17.65)
 - mkdir 842 (time 1787851052.64 total 50.12 last 18.46)
 - mkdir 997 (time 1787851062.68 total 60.16 last 15.44)
total: 1000 mkdir in 60.34 seconds: 16.57 ops/second
 - mkdir 143 (time 1787851012.59 total 10.01 last 14.29)
 - mkdir 305 (time 1787851022.61 total 20.02 last 16.18)
 - mkdir 477 (time 1787851032.67 total 30.08 last 17.10)
 - mkdir 654 (time 1787851042.68 total 40.09 last 17.68)
 - mkdir 841 (time 1787851052.72 total 50.13 last 18.62)
 - mkdir 997 (time 1787851062.72 total 60.14 last 15.60)
total: 1000 mkdir in 60.34 seconds: 16.57 ops/second
 - mkdir 149 (time 1787851013.41 total 10.03 last 14.85)
 - mkdir 325 (time 1787851023.45 total 20.07 last 17.53)
 - mkdir 495 (time 1787851033.53 total 30.15 last 16.87)
 - mkdir 670 (time 1787851043.54 total 40.16 last 17.48)
 - mkdir 854 (time 1787851053.58 total 50.21 last 18.31)
total: 1000 mkdir in 59.84 seconds: 16.71 ops/second
 - mkdir 145 (time 1787851013.25 total 10.03 last 14.46)
 - mkdir 323 (time 1787851023.30 total 20.07 last 17.72)
 - mkdir 488 (time 1787851033.33 total 30.11 last 16.44)
 - mkdir 666 (time 1787851043.38 total 40.16 last 17.71)
 - mkdir 850 (time 1787851053.43 total 50.21 last 18.31)
 - mkdir 999 (time 1787851063.53 total 60.30 last 14.76)
total: 1000 mkdir in 60.30 seconds: 16.58 ops/second
 - mkdir 148 (time 1787851013.42 total 10.05 last 14.72)
 - mkdir 319 (time 1787851023.45 total 20.08 last 17.06)
 - mkdir 488 (time 1787851033.47 total 30.10 last 16.86)
 - mkdir 670 (time 1787851043.50 total 40.13 last 18.14)
 - mkdir 854 (time 1787851053.57 total 50.19 last 18.29)
total: 1000 mkdir in 60.16 seconds: 16.62 ops/second
 - mkdir 139 (time 1787851011.97 total 10.19 last 13.64)
 - mkdir 302 (time 1787851022.02 total 20.24 last 16.23)
 - mkdir 462 (time 1787851032.07 total 30.29 last 15.92)
 - mkdir 633 (time 1787851042.12 total 40.34 last 17.01)
 - mkdir 815 (time 1787851052.15 total 50.38 last 18.14)
 - mkdir 981 (time 1787851062.28 total 60.51 last 16.39)
total: 1000 mkdir in 62.25 seconds: 16.06 ops/second
 - mkdir 139 (time 1787851013.06 total 10.06 last 13.82)
 - mkdir 311 (time 1787851023.08 total 20.08 last 17.16)
 - mkdir 477 (time 1787851033.08 total 30.08 last 16.59)
 - mkdir 652 (time 1787851043.10 total 40.10 last 17.48)
 - mkdir 837 (time 1787851053.12 total 50.12 last 18.46)
 - mkdir 987 (time 1787851063.12 total 60.12 last 15.00)
total: 1000 mkdir in 61.21 seconds: 16.34 ops/second
Time for file creation 72 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.70 seconds: 14.23 ops/second
 - mkdir 140 (time 1787851616.78 total 10.05 last 13.94)
 - mkdir 262 (time 1787851626.84 total 20.11 last 12.12)
 - mkdir 371 (time 1787851636.88 total 30.15 last 10.85)
 - mkdir 504 (time 1787851646.90 total 40.17 last 13.28)
 - mkdir 663 (time 1787851656.95 total 50.21 last 15.82)
 - mkdir 821 (time 1787851666.97 total 60.24 last 15.76)
 - mkdir 957 (time 1787851676.99 total 70.26 last 13.57)
total: 1000 mkdir in 73.11 seconds: 13.68 ops/second
 - mkdir 139 (time 1787851618.11 total 10.04 last 13.85)
 - mkdir 261 (time 1787851628.13 total 20.06 last 12.18)
 - mkdir 372 (time 1787851638.22 total 30.15 last 11.00)
 - mkdir 514 (time 1787851648.27 total 40.19 last 14.14)
 - mkdir 678 (time 1787851658.31 total 50.24 last 16.32)
 - mkdir 833 (time 1787851668.32 total 60.24 last 15.49)
 - mkdir 967 (time 1787851678.32 total 70.25 last 13.40)
total: 1000 mkdir in 72.74 seconds: 13.75 ops/second
 - mkdir 138 (time 1787851617.34 total 10.01 last 13.78)
 - mkdir 256 (time 1787851627.40 total 20.07 last 11.73)
 - mkdir 369 (time 1787851637.42 total 30.10 last 11.27)
 - mkdir 500 (time 1787851647.43 total 40.11 last 13.09)
 - mkdir 660 (time 1787851657.48 total 50.15 last 15.93)
 - mkdir 815 (time 1787851667.51 total 60.19 last 15.45)
 - mkdir 953 (time 1787851677.57 total 70.25 last 13.72)
total: 1000 mkdir in 73.53 seconds: 13.60 ops/second
 - mkdir 139 (time 1787851618.96 total 10.05 last 13.83)
 - mkdir 260 (time 1787851628.98 total 20.07 last 12.07)
 - mkdir 378 (time 1787851639.00 total 30.09 last 11.78)
 - mkdir 524 (time 1787851649.04 total 40.13 last 14.54)
 - mkdir 679 (time 1787851659.13 total 50.22 last 15.36)
 - mkdir 834 (time 1787851669.17 total 60.26 last 15.45)
 - mkdir 973 (time 1787851679.17 total 70.26 last 13.89)
total: 1000 mkdir in 72.86 seconds: 13.72 ops/second
 - mkdir 135 (time 1787851617.16 total 10.05 last 13.43)
 - mkdir 247 (time 1787851627.20 total 20.08 last 11.16)
 - mkdir 354 (time 1787851637.21 total 30.09 last 10.69)
 - mkdir 484 (time 1787851647.21 total 40.10 last 13.00)
 - mkdir 649 (time 1787851657.21 total 50.10 last 16.49)
 - mkdir 811 (time 1787851667.25 total 60.14 last 16.14)
 - mkdir 943 (time 1787851677.31 total 70.20 last 13.12)
total: 1000 mkdir in 74.91 seconds: 13.35 ops/second
 - mkdir 131 (time 1787851617.56 total 10.00 last 13.10)
 - mkdir 243 (time 1787851627.63 total 20.08 last 11.11)
 - mkdir 356 (time 1787851637.72 total 30.17 last 11.20)
 - mkdir 488 (time 1787851647.74 total 40.18 last 13.18)
 - mkdir 649 (time 1787851657.75 total 50.20 last 16.07)
 - mkdir 805 (time 1787851667.82 total 60.27 last 15.49)
 - mkdir 942 (time 1787851677.85 total 70.30 last 13.66)
total: 1000 mkdir in 75.42 seconds: 13.26 ops/second
 - mkdir 133 (time 1787851618.87 total 10.11 last 13.16)
 - mkdir 251 (time 1787851628.96 total 20.20 last 11.70)
 - mkdir 366 (time 1787851639.00 total 30.24 last 11.46)
 - mkdir 504 (time 1787851649.01 total 40.25 last 13.78)
 - mkdir 664 (time 1787851659.04 total 50.28 last 15.95)
 - mkdir 818 (time 1787851669.05 total 60.29 last 15.39)
 - mkdir 958 (time 1787851679.08 total 70.32 last 13.96)
total: 1000 mkdir in 74.41 seconds: 13.44 ops/second
 - mkdir 134 (time 1787851617.84 total 10.01 last 13.39)
 - mkdir 248 (time 1787851627.88 total 20.05 last 11.35)
 - mkdir 357 (time 1787851637.89 total 30.05 last 10.89)
 - mkdir 493 (time 1787851647.92 total 40.08 last 13.56)
 - mkdir 655 (time 1787851658.00 total 50.17 last 16.06)
 - mkdir 808 (time 1787851668.04 total 60.20 last 15.25)
 - mkdir 938 (time 1787851678.06 total 70.22 last 12.97)
total: 1000 mkdir in 75.60 seconds: 13.23 ops/second
 - mkdir 140 (time 1787851619.06 total 10.12 last 13.84)
 - mkdir 252 (time 1787851629.09 total 20.15 last 11.16)
 - mkdir 368 (time 1787851639.13 total 30.19 last 11.55)
 - mkdir 513 (time 1787851649.16 total 40.22 last 14.46)
 - mkdir 670 (time 1787851659.19 total 50.25 last 15.66)
 - mkdir 825 (time 1787851669.25 total 60.31 last 15.40)
 - mkdir 957 (time 1787851679.29 total 70.35 last 13.16)
total: 1000 mkdir in 74.65 seconds: 13.40 ops/second
 - mkdir 132 (time 1787851618.47 total 10.03 last 13.17)
 - mkdir 240 (time 1787851628.48 total 20.04 last 10.79)
 - mkdir 342 (time 1787851638.51 total 30.07 last 10.17)
 - mkdir 477 (time 1787851648.52 total 40.08 last 13.48)
 - mkdir 640 (time 1787851658.55 total 50.11 last 16.26)
 - mkdir 795 (time 1787851668.62 total 60.18 last 15.39)
 - mkdir 926 (time 1787851678.66 total 70.22 last 13.05)
total: 1000 mkdir in 77.25 seconds: 12.94 ops/second
Time for file creation 88 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787851695 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787851695 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787851695 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787851696 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787851696 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787851696 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787851696 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787851696 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787851696 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787851696 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
Time for file removal 50 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8