== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:20:59 (1786652459)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.62 seconds: 16.24 ops/second
 - mkdir 134 (time 1786652483.73 total 10.00 last 13.40)
 - mkdir 290 (time 1786652493.79 total 20.06 last 15.52)
 - mkdir 406 (time 1786652503.80 total 30.07 last 11.58)
 - mkdir 515 (time 1786652513.83 total 40.10 last 10.87)
 - mkdir 651 (time 1786652523.91 total 50.18 last 13.50)
 - mkdir 804 (time 1786652533.95 total 60.21 last 15.25)
 - mkdir 966 (time 1786652543.99 total 70.26 last 16.13)
total: 1000 mkdir in 73.13 seconds: 13.67 ops/second
 - mkdir 140 (time 1786652482.23 total 10.09 last 13.88)
 - mkdir 285 (time 1786652492.24 total 20.09 last 14.49)
 - mkdir 406 (time 1786652502.39 total 30.24 last 11.92)
 - mkdir 501 (time 1786652512.46 total 40.32 last 9.43)
 - mkdir 635 (time 1786652522.52 total 50.38 last 13.32)
 - mkdir 782 (time 1786652532.57 total 60.42 last 14.63)
 - mkdir 943 (time 1786652542.57 total 70.42 last 16.09)
total: 1000 mkdir in 75.42 seconds: 13.26 ops/second
 - mkdir 133 (time 1786652483.92 total 10.10 last 13.17)
 - mkdir 287 (time 1786652493.98 total 20.16 last 15.31)
 - mkdir 398 (time 1786652504.07 total 30.24 last 11.00)
 - mkdir 509 (time 1786652514.14 total 40.32 last 11.02)
 - mkdir 646 (time 1786652524.18 total 50.36 last 13.65)
 - mkdir 797 (time 1786652534.23 total 60.40 last 15.03)
 - mkdir 964 (time 1786652544.32 total 70.50 last 16.54)
total: 1000 mkdir in 74.14 seconds: 13.49 ops/second
 - mkdir 131 (time 1786652483.92 total 10.07 last 13.01)
 - mkdir 286 (time 1786652493.99 total 20.13 last 15.39)
 - mkdir 402 (time 1786652504.09 total 30.24 last 11.48)
 - mkdir 513 (time 1786652514.17 total 40.32 last 11.02)
 - mkdir 648 (time 1786652524.18 total 50.33 last 13.49)
 - mkdir 796 (time 1786652534.23 total 60.37 last 14.73)
 - mkdir 964 (time 1786652544.34 total 70.49 last 16.61)
total: 1000 mkdir in 74.15 seconds: 13.49 ops/second
 - mkdir 135 (time 1786652483.74 total 10.14 last 13.31)
 - mkdir 289 (time 1786652493.76 total 20.17 last 15.36)
 - mkdir 403 (time 1786652503.87 total 30.27 last 11.28)
 - mkdir 508 (time 1786652513.88 total 40.29 last 10.49)
 - mkdir 641 (time 1786652523.97 total 50.37 last 13.19)
 - mkdir 794 (time 1786652534.03 total 60.43 last 15.21)
 - mkdir 957 (time 1786652544.03 total 70.44 last 16.30)
total: 1000 mkdir in 74.81 seconds: 13.37 ops/second
 - mkdir 135 (time 1786652484.05 total 10.02 last 13.48)
 - mkdir 290 (time 1786652494.08 total 20.05 last 15.45)
 - mkdir 401 (time 1786652504.10 total 30.07 last 11.08)
 - mkdir 505 (time 1786652514.14 total 40.11 last 10.36)
 - mkdir 640 (time 1786652524.17 total 50.14 last 13.46)
 - mkdir 791 (time 1786652534.19 total 60.16 last 15.07)
 - mkdir 952 (time 1786652544.22 total 70.19 last 16.05)
total: 1000 mkdir in 74.85 seconds: 13.36 ops/second
 - mkdir 129 (time 1786652482.46 total 10.16 last 12.70)
 - mkdir 269 (time 1786652492.47 total 20.17 last 13.99)
 - mkdir 385 (time 1786652502.53 total 30.22 last 11.53)
 - mkdir 481 (time 1786652512.59 total 40.28 last 9.54)
 - mkdir 620 (time 1786652522.68 total 50.37 last 13.78)
 - mkdir 770 (time 1786652532.72 total 60.41 last 14.94)
 - mkdir 929 (time 1786652542.74 total 70.43 last 15.87)
total: 1000 mkdir in 77.16 seconds: 12.96 ops/second
 - mkdir 130 (time 1786652483.17 total 10.04 last 12.95)
 - mkdir 280 (time 1786652493.22 total 20.08 last 14.93)
 - mkdir 386 (time 1786652503.29 total 30.15 last 10.53)
 - mkdir 489 (time 1786652513.33 total 40.20 last 10.26)
 - mkdir 628 (time 1786652523.38 total 50.25 last 13.83)
 - mkdir 778 (time 1786652533.40 total 60.27 last 14.97)
 - mkdir 931 (time 1786652543.41 total 70.28 last 15.28)
total: 1000 mkdir in 77.02 seconds: 12.98 ops/second
 - mkdir 127 (time 1786652483.36 total 10.04 last 12.65)
 - mkdir 278 (time 1786652493.47 total 20.14 last 14.95)
 - mkdir 387 (time 1786652503.53 total 30.21 last 10.83)
 - mkdir 490 (time 1786652513.54 total 40.22 last 10.29)
 - mkdir 628 (time 1786652523.59 total 50.26 last 13.74)
 - mkdir 778 (time 1786652533.61 total 60.28 last 14.96)
 - mkdir 933 (time 1786652543.62 total 70.29 last 15.49)
total: 1000 mkdir in 76.96 seconds: 12.99 ops/second
 - mkdir 128 (time 1786652484.22 total 10.03 last 12.76)
 - mkdir 279 (time 1786652494.29 total 20.11 last 14.99)
 - mkdir 392 (time 1786652504.37 total 30.19 last 11.21)
 - mkdir 501 (time 1786652514.38 total 40.19 last 10.89)
 - mkdir 636 (time 1786652524.42 total 50.24 last 13.44)
 - mkdir 787 (time 1786652534.43 total 60.24 last 15.10)
 - mkdir 942 (time 1786652544.50 total 70.31 last 15.40)
total: 1000 mkdir in 76.83 seconds: 13.02 ops/second
Time for file creation 90 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 17 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.61 seconds: 16.51 ops/second
 - mkdir 150 (time 1786653069.69 total 10.07 last 14.90)
 - mkdir 264 (time 1786653079.78 total 20.15 last 11.31)
 - mkdir 396 (time 1786653089.79 total 30.16 last 13.18)
 - mkdir 575 (time 1786653099.81 total 40.18 last 17.87)
 - mkdir 763 (time 1786653109.84 total 50.21 last 18.75)
 - mkdir 927 (time 1786653119.87 total 60.24 last 16.35)
total: 1000 mkdir in 65.80 seconds: 15.20 ops/second
 - mkdir 143 (time 1786653070.68 total 10.06 last 14.21)
 - mkdir 265 (time 1786653080.68 total 20.07 last 12.19)
 - mkdir 399 (time 1786653090.71 total 30.10 last 13.37)
 - mkdir 587 (time 1786653100.71 total 40.10 last 18.79)
 - mkdir 763 (time 1786653110.76 total 50.15 last 17.52)
 - mkdir 923 (time 1786653120.78 total 60.17 last 15.96)
total: 1000 mkdir in 66.40 seconds: 15.06 ops/second
 - mkdir 154 (time 1786653073.08 total 10.03 last 15.35)
 - mkdir 277 (time 1786653083.12 total 20.08 last 12.25)
 - mkdir 428 (time 1786653093.18 total 30.14 last 15.01)
 - mkdir 634 (time 1786653103.21 total 40.17 last 20.54)
 - mkdir 799 (time 1786653113.24 total 50.20 last 16.45)
 - mkdir 949 (time 1786653123.27 total 60.23 last 14.95)
total: 1000 mkdir in 64.81 seconds: 15.43 ops/second
 - mkdir 146 (time 1786653071.95 total 10.03 last 14.56)
 - mkdir 269 (time 1786653082.00 total 20.08 last 12.24)
 - mkdir 409 (time 1786653092.00 total 30.09 last 13.99)
 - mkdir 598 (time 1786653102.01 total 40.09 last 18.89)
 - mkdir 773 (time 1786653112.05 total 50.14 last 17.43)
 - mkdir 931 (time 1786653122.06 total 60.15 last 15.78)
total: 1000 mkdir in 67.03 seconds: 14.92 ops/second
 - mkdir 151 (time 1786653072.46 total 10.01 last 15.09)
 - mkdir 272 (time 1786653082.50 total 20.05 last 12.04)
 - mkdir 411 (time 1786653092.51 total 30.06 last 13.90)
 - mkdir 601 (time 1786653102.51 total 40.06 last 18.99)
 - mkdir 771 (time 1786653112.57 total 50.11 last 16.91)
 - mkdir 927 (time 1786653122.62 total 60.17 last 15.51)
total: 1000 mkdir in 67.49 seconds: 14.82 ops/second
 - mkdir 151 (time 1786653072.99 total 10.04 last 15.04)
 - mkdir 276 (time 1786653083.06 total 20.11 last 12.41)
 - mkdir 419 (time 1786653093.06 total 30.12 last 14.29)
 - mkdir 615 (time 1786653103.07 total 40.12 last 19.58)
 - mkdir 780 (time 1786653113.08 total 50.13 last 16.49)
 - mkdir 931 (time 1786653123.19 total 60.25 last 14.93)
total: 1000 mkdir in 67.15 seconds: 14.89 ops/second
 - mkdir 149 (time 1786653072.97 total 10.01 last 14.89)
 - mkdir 276 (time 1786653083.02 total 20.06 last 12.63)
 - mkdir 418 (time 1786653093.03 total 30.07 last 14.18)
 - mkdir 616 (time 1786653103.05 total 40.09 last 19.76)
 - mkdir 784 (time 1786653113.08 total 50.12 last 16.75)
 - mkdir 929 (time 1786653123.19 total 60.24 last 14.34)
total: 1000 mkdir in 67.63 seconds: 14.79 ops/second
 - mkdir 149 (time 1786653072.97 total 10.04 last 14.83)
 - mkdir 266 (time 1786653083.02 total 20.10 last 11.64)
 - mkdir 408 (time 1786653093.03 total 30.11 last 14.19)
 - mkdir 609 (time 1786653103.04 total 40.12 last 20.08)
 - mkdir 774 (time 1786653113.11 total 50.19 last 16.39)
 - mkdir 924 (time 1786653123.24 total 60.32 last 14.80)
total: 1000 mkdir in 68.42 seconds: 14.62 ops/second
 - mkdir 143 (time 1786653071.70 total 10.02 last 14.27)
 - mkdir 261 (time 1786653081.73 total 20.05 last 11.76)
 - mkdir 394 (time 1786653091.79 total 30.11 last 13.22)
 - mkdir 582 (time 1786653101.83 total 40.15 last 18.72)
 - mkdir 758 (time 1786653111.88 total 50.20 last 17.52)
 - mkdir 911 (time 1786653121.94 total 60.26 last 15.20)
total: 1000 mkdir in 69.73 seconds: 14.34 ops/second
 - mkdir 144 (time 1786653072.99 total 10.04 last 14.34)
 - mkdir 261 (time 1786653083.02 total 20.07 last 11.66)
 - mkdir 392 (time 1786653093.06 total 30.11 last 13.04)
 - mkdir 594 (time 1786653103.07 total 40.12 last 20.18)
 - mkdir 760 (time 1786653113.12 total 50.17 last 16.53)
 - mkdir 913 (time 1786653123.20 total 60.25 last 15.17)
total: 1000 mkdir in 69.62 seconds: 14.36 ops/second
Time for file creation 81 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786653142 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786653142 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786653143 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786653143 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786653144 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786653143 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786653143 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786653144 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786653144 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786653144 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 46 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8