== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 18:25:34 (1790893534)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.60 seconds: 16.60 ops/second
 - mkdir 143 (time 1790893555.52 total 10.02 last 14.26)
 - mkdir 316 (time 1790893565.60 total 20.11 last 17.16)
 - mkdir 457 (time 1790893575.63 total 30.14 last 14.05)
 - mkdir 620 (time 1790893585.64 total 40.14 last 16.30)
 - mkdir 800 (time 1790893595.69 total 50.19 last 17.91)
 - mkdir 991 (time 1790893605.69 total 60.20 last 19.09)
total: 1000 mkdir in 60.79 seconds: 16.45 ops/second
 - mkdir 155 (time 1790893556.91 total 10.04 last 15.43)
 - mkdir 312 (time 1790893566.99 total 20.12 last 15.58)
 - mkdir 458 (time 1790893577.06 total 30.19 last 14.51)
 - mkdir 627 (time 1790893587.08 total 40.21 last 16.85)
 - mkdir 816 (time 1790893597.11 total 50.24 last 18.85)
total: 1000 mkdir in 60.19 seconds: 16.61 ops/second
 - mkdir 154 (time 1790893556.31 total 10.02 last 15.37)
 - mkdir 322 (time 1790893566.33 total 20.04 last 16.77)
 - mkdir 460 (time 1790893576.45 total 30.16 last 13.63)
 - mkdir 625 (time 1790893586.49 total 40.20 last 16.44)
 - mkdir 808 (time 1790893596.53 total 50.24 last 18.22)
 - mkdir 993 (time 1790893606.61 total 60.32 last 18.36)
total: 1000 mkdir in 60.85 seconds: 16.43 ops/second
 - mkdir 154 (time 1790893557.66 total 10.00 last 15.39)
 - mkdir 324 (time 1790893567.69 total 20.03 last 16.96)
 - mkdir 468 (time 1790893577.70 total 30.04 last 14.39)
 - mkdir 641 (time 1790893587.71 total 40.05 last 17.27)
 - mkdir 819 (time 1790893597.82 total 50.16 last 17.61)
 - mkdir 995 (time 1790893607.83 total 60.17 last 17.59)
total: 1000 mkdir in 60.49 seconds: 16.53 ops/second
 - mkdir 164 (time 1790893558.72 total 10.03 last 16.36)
 - mkdir 329 (time 1790893568.73 total 20.04 last 16.47)
 - mkdir 474 (time 1790893578.79 total 30.10 last 14.41)
 - mkdir 649 (time 1790893588.79 total 40.10 last 17.50)
 - mkdir 831 (time 1790893598.81 total 50.12 last 18.17)
total: 1000 mkdir in 59.65 seconds: 16.77 ops/second
 - mkdir 160 (time 1790893558.13 total 10.03 last 15.96)
 - mkdir 322 (time 1790893568.17 total 20.06 last 16.14)
 - mkdir 463 (time 1790893578.20 total 30.09 last 14.06)
 - mkdir 641 (time 1790893588.31 total 40.21 last 17.60)
 - mkdir 817 (time 1790893598.32 total 50.22 last 17.58)
 - mkdir 993 (time 1790893608.34 total 60.24 last 17.57)
total: 1000 mkdir in 60.94 seconds: 16.41 ops/second
 - mkdir 158 (time 1790893558.17 total 10.02 last 15.76)
 - mkdir 318 (time 1790893568.20 total 20.05 last 15.95)
 - mkdir 458 (time 1790893578.23 total 30.08 last 13.97)
 - mkdir 628 (time 1790893588.26 total 40.11 last 16.95)
 - mkdir 800 (time 1790893598.26 total 50.11 last 17.19)
 - mkdir 978 (time 1790893608.35 total 60.20 last 17.65)
total: 1000 mkdir in 62.39 seconds: 16.03 ops/second
 - mkdir 152 (time 1790893557.85 total 10.02 last 15.18)
 - mkdir 314 (time 1790893567.88 total 20.05 last 16.15)
 - mkdir 454 (time 1790893577.89 total 30.06 last 13.98)
 - mkdir 623 (time 1790893587.92 total 40.09 last 16.85)
 - mkdir 797 (time 1790893597.97 total 50.14 last 17.32)
 - mkdir 973 (time 1790893608.08 total 60.25 last 17.41)
total: 1000 mkdir in 62.76 seconds: 15.93 ops/second
 - mkdir 157 (time 1790893558.68 total 10.03 last 15.66)
 - mkdir 310 (time 1790893568.80 total 20.14 last 15.13)
 - mkdir 443 (time 1790893578.84 total 30.19 last 13.24)
 - mkdir 611 (time 1790893588.85 total 40.19 last 16.79)
 - mkdir 784 (time 1790893598.85 total 50.19 last 17.30)
 - mkdir 946 (time 1790893608.88 total 60.22 last 16.15)
total: 1000 mkdir in 64.08 seconds: 15.60 ops/second
 - mkdir 145 (time 1790893557.88 total 10.04 last 14.44)
 - mkdir 303 (time 1790893567.94 total 20.10 last 15.71)
 - mkdir 437 (time 1790893578.03 total 30.19 last 13.28)
 - mkdir 597 (time 1790893588.07 total 40.23 last 15.93)
 - mkdir 756 (time 1790893598.09 total 50.25 last 15.87)
 - mkdir 927 (time 1790893608.22 total 60.38 last 16.89)
total: 1000 mkdir in 65.53 seconds: 15.26 ops/second
Time for file creation 76 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.61 seconds: 16.42 ops/second
 - mkdir 157 (time 1790894089.11 total 10.01 last 15.68)
 - mkdir 332 (time 1790894099.16 total 20.06 last 17.42)
 - mkdir 517 (time 1790894109.19 total 30.08 last 18.45)
 - mkdir 732 (time 1790894119.21 total 40.10 last 21.46)
 - mkdir 901 (time 1790894129.22 total 50.12 last 16.88)
total: 1000 mkdir in 56.98 seconds: 17.55 ops/second
 - mkdir 156 (time 1790894089.93 total 10.01 last 15.58)
 - mkdir 337 (time 1790894100.00 total 20.08 last 17.98)
 - mkdir 534 (time 1790894110.01 total 30.09 last 19.67)
 - mkdir 743 (time 1790894120.18 total 40.26 last 20.56)
 - mkdir 911 (time 1790894130.19 total 50.27 last 16.78)
total: 1000 mkdir in 56.36 seconds: 17.74 ops/second
 - mkdir 159 (time 1790894090.40 total 10.09 last 15.76)
 - mkdir 333 (time 1790894100.50 total 20.18 last 17.24)
 - mkdir 533 (time 1790894110.52 total 30.20 last 19.95)
 - mkdir 736 (time 1790894120.54 total 40.22 last 20.26)
 - mkdir 900 (time 1790894130.58 total 50.26 last 16.34)
total: 1000 mkdir in 57.75 seconds: 17.32 ops/second
 - mkdir 159 (time 1790894090.49 total 10.05 last 15.82)
 - mkdir 329 (time 1790894100.50 total 20.06 last 16.98)
 - mkdir 533 (time 1790894110.55 total 30.10 last 20.31)
 - mkdir 733 (time 1790894120.57 total 40.13 last 19.95)
 - mkdir 899 (time 1790894130.62 total 50.18 last 16.52)
total: 1000 mkdir in 58.39 seconds: 17.13 ops/second
 - mkdir 166 (time 1790894090.75 total 10.04 last 16.54)
 - mkdir 343 (time 1790894100.76 total 20.04 last 17.70)
 - mkdir 541 (time 1790894110.77 total 30.06 last 19.77)
 - mkdir 735 (time 1790894120.79 total 40.07 last 19.37)
 - mkdir 903 (time 1790894130.80 total 50.09 last 16.77)
total: 1000 mkdir in 58.14 seconds: 17.20 ops/second
 - mkdir 161 (time 1790894090.83 total 10.02 last 16.07)
 - mkdir 342 (time 1790894100.88 total 20.07 last 18.01)
 - mkdir 547 (time 1790894110.90 total 30.09 last 20.46)
 - mkdir 741 (time 1790894120.93 total 40.12 last 19.33)
 - mkdir 909 (time 1790894131.04 total 50.23 last 16.62)
total: 1000 mkdir in 58.47 seconds: 17.10 ops/second
 - mkdir 156 (time 1790894091.06 total 10.04 last 15.53)
 - mkdir 328 (time 1790894101.08 total 20.06 last 17.17)
 - mkdir 539 (time 1790894111.08 total 30.07 last 21.09)
 - mkdir 737 (time 1790894121.11 total 40.10 last 19.73)
 - mkdir 905 (time 1790894131.11 total 50.10 last 16.80)
total: 1000 mkdir in 58.92 seconds: 16.97 ops/second
 - mkdir 162 (time 1790894091.03 total 10.05 last 16.12)
 - mkdir 333 (time 1790894101.05 total 20.07 last 17.07)
 - mkdir 541 (time 1790894111.05 total 30.07 last 20.80)
 - mkdir 735 (time 1790894121.09 total 40.11 last 19.32)
 - mkdir 901 (time 1790894131.11 total 50.13 last 16.57)
total: 1000 mkdir in 59.83 seconds: 16.71 ops/second
 - mkdir 152 (time 1790894090.41 total 10.07 last 15.10)
 - mkdir 323 (time 1790894100.42 total 20.08 last 17.08)
 - mkdir 519 (time 1790894110.46 total 30.12 last 19.52)
 - mkdir 715 (time 1790894120.50 total 40.16 last 19.51)
 - mkdir 882 (time 1790894130.56 total 50.22 last 16.60)
 - mkdir 992 (time 1790894140.75 total 60.41 last 10.80)
total: 1000 mkdir in 61.19 seconds: 16.34 ops/second
 - mkdir 154 (time 1790894091.10 total 10.03 last 15.36)
 - mkdir 323 (time 1790894101.11 total 20.03 last 16.89)
 - mkdir 519 (time 1790894111.13 total 30.05 last 19.55)
 - mkdir 711 (time 1790894121.18 total 40.11 last 19.10)
 - mkdir 876 (time 1790894131.20 total 50.12 last 16.48)
 - mkdir 981 (time 1790894141.28 total 60.20 last 10.41)
total: 1000 mkdir in 62.34 seconds: 16.04 ops/second
Time for file creation 76 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790894151 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1790894153 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894154 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894153 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894154 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894154 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894154 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894154 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894155 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790894155 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 44 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8