== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 21:46:39 (1786326399)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.40 seconds: 25.18 ops/second
 - mkdir 129 (time 1786326420.06 total 10.02 last 12.88)
 - mkdir 247 (time 1786326430.24 total 20.20 last 11.59)
 - mkdir 359 (time 1786326440.31 total 30.27 last 11.13)
 - mkdir 485 (time 1786326450.45 total 40.41 last 12.42)
 - mkdir 587 (time 1786326460.50 total 50.46 last 10.15)
 - mkdir 745 (time 1786326470.55 total 60.51 last 15.72)
 - mkdir 926 (time 1786326480.57 total 70.53 last 18.07)
total: 1000 mkdir in 74.19 seconds: 13.48 ops/second
 - mkdir 123 (time 1786326419.50 total 10.12 last 12.15)
 - mkdir 238 (time 1786326429.50 total 20.12 last 11.50)
 - mkdir 355 (time 1786326439.62 total 30.24 last 11.57)
 - mkdir 480 (time 1786326449.72 total 40.34 last 12.37)
 - mkdir 580 (time 1786326459.75 total 50.37 last 9.97)
 - mkdir 741 (time 1786326469.76 total 60.38 last 16.08)
 - mkdir 913 (time 1786326479.86 total 70.48 last 17.03)
total: 1000 mkdir in 75.30 seconds: 13.28 ops/second
 - mkdir 124 (time 1786326420.82 total 10.02 last 12.38)
 - mkdir 243 (time 1786326430.87 total 20.06 last 11.84)
 - mkdir 359 (time 1786326440.94 total 30.14 last 11.51)
 - mkdir 487 (time 1786326451.04 total 40.24 last 12.67)
 - mkdir 594 (time 1786326461.10 total 50.30 last 10.64)
 - mkdir 750 (time 1786326471.13 total 60.33 last 15.55)
 - mkdir 935 (time 1786326481.19 total 70.39 last 18.40)
total: 1000 mkdir in 74.41 seconds: 13.44 ops/second
 - mkdir 127 (time 1786326420.65 total 10.11 last 12.56)
 - mkdir 244 (time 1786326430.72 total 20.18 last 11.61)
 - mkdir 357 (time 1786326440.79 total 30.25 last 11.22)
 - mkdir 485 (time 1786326450.86 total 40.33 last 12.71)
 - mkdir 589 (time 1786326460.88 total 50.35 last 10.38)
 - mkdir 745 (time 1786326470.92 total 60.38 last 15.55)
 - mkdir 923 (time 1786326480.94 total 70.40 last 17.76)
total: 1000 mkdir in 74.93 seconds: 13.35 ops/second
 - mkdir 125 (time 1786326420.34 total 10.03 last 12.46)
 - mkdir 245 (time 1786326430.44 total 20.13 last 11.88)
 - mkdir 350 (time 1786326440.56 total 30.26 last 10.37)
 - mkdir 477 (time 1786326450.60 total 40.30 last 12.65)
 - mkdir 582 (time 1786326460.67 total 50.36 last 10.43)
 - mkdir 742 (time 1786326470.76 total 60.45 last 15.85)
 - mkdir 917 (time 1786326480.78 total 70.47 last 17.47)
total: 1000 mkdir in 75.34 seconds: 13.27 ops/second
 - mkdir 124 (time 1786326419.49 total 10.09 last 12.29)
 - mkdir 239 (time 1786326429.57 total 20.17 last 11.41)
 - mkdir 348 (time 1786326439.59 total 30.20 last 10.87)
 - mkdir 473 (time 1786326449.62 total 40.22 last 12.47)
 - mkdir 566 (time 1786326459.66 total 50.26 last 9.26)
 - mkdir 725 (time 1786326469.70 total 60.31 last 15.82)
 - mkdir 899 (time 1786326479.74 total 70.34 last 17.34)
total: 1000 mkdir in 76.34 seconds: 13.10 ops/second
 - mkdir 128 (time 1786326420.73 total 10.08 last 12.70)
 - mkdir 241 (time 1786326430.78 total 20.13 last 11.25)
 - mkdir 354 (time 1786326440.86 total 30.21 last 11.21)
 - mkdir 485 (time 1786326451.00 total 40.35 last 12.92)
 - mkdir 588 (time 1786326461.04 total 50.39 last 10.26)
 - mkdir 744 (time 1786326471.08 total 60.43 last 15.54)
 - mkdir 922 (time 1786326481.08 total 70.43 last 17.79)
total: 1000 mkdir in 75.23 seconds: 13.29 ops/second
 - mkdir 125 (time 1786326421.26 total 10.07 last 12.41)
 - mkdir 244 (time 1786326431.29 total 20.09 last 11.87)
 - mkdir 356 (time 1786326441.33 total 30.14 last 11.15)
 - mkdir 482 (time 1786326451.37 total 40.18 last 12.55)
 - mkdir 592 (time 1786326461.38 total 50.19 last 10.99)
 - mkdir 748 (time 1786326471.43 total 60.24 last 15.52)
 - mkdir 925 (time 1786326481.44 total 70.25 last 17.69)
total: 1000 mkdir in 74.78 seconds: 13.37 ops/second
 - mkdir 118 (time 1786326419.92 total 10.01 last 11.79)
 - mkdir 229 (time 1786326430.02 total 20.11 last 10.99)
 - mkdir 335 (time 1786326440.05 total 30.14 last 10.57)
 - mkdir 460 (time 1786326450.15 total 40.24 last 12.37)
 - mkdir 560 (time 1786326460.17 total 50.26 last 9.99)
 - mkdir 719 (time 1786326470.18 total 60.27 last 15.87)
 - mkdir 889 (time 1786326480.22 total 70.31 last 16.94)
total: 1000 mkdir in 77.17 seconds: 12.96 ops/second
 - mkdir 117 (time 1786326421.19 total 10.09 last 11.60)
 - mkdir 228 (time 1786326431.19 total 20.09 last 11.10)
 - mkdir 333 (time 1786326441.21 total 30.11 last 10.48)
 - mkdir 456 (time 1786326451.26 total 40.16 last 12.24)
 - mkdir 562 (time 1786326461.29 total 50.19 last 10.56)
 - mkdir 714 (time 1786326471.38 total 60.28 last 15.07)
 - mkdir 885 (time 1786326481.39 total 70.29 last 17.07)
total: 1000 mkdir in 78.40 seconds: 12.75 ops/second
Time for file creation 88 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.49 seconds: 20.61 ops/second
 - mkdir 210 (time 1786327020.45 total 10.03 last 20.94)
 - mkdir 469 (time 1786327030.49 total 20.07 last 25.80)
 - mkdir 708 (time 1786327040.51 total 30.09 last 23.85)
 - mkdir 887 (time 1786327050.54 total 40.12 last 17.84)
total: 1000 mkdir in 45.88 seconds: 21.79 ops/second
 - mkdir 240 (time 1786327022.34 total 10.02 last 23.95)
 - mkdir 485 (time 1786327032.40 total 20.07 last 24.37)
 - mkdir 727 (time 1786327042.40 total 30.08 last 24.18)
 - mkdir 908 (time 1786327052.42 total 40.10 last 18.08)
total: 1000 mkdir in 45.76 seconds: 21.85 ops/second
 - mkdir 254 (time 1786327023.38 total 10.02 last 25.35)
 - mkdir 500 (time 1786327033.39 total 20.03 last 24.58)
 - mkdir 735 (time 1786327043.42 total 30.06 last 23.43)
 - mkdir 921 (time 1786327053.44 total 40.08 last 18.57)
total: 1000 mkdir in 44.81 seconds: 22.32 ops/second
 - mkdir 229 (time 1786327022.52 total 10.01 last 22.87)
 - mkdir 470 (time 1786327032.54 total 20.03 last 24.06)
 - mkdir 713 (time 1786327042.57 total 30.06 last 24.22)
 - mkdir 905 (time 1786327052.62 total 40.11 last 19.11)
total: 1000 mkdir in 46.14 seconds: 21.67 ops/second
 - mkdir 259 (time 1786327023.92 total 10.03 last 25.82)
 - mkdir 517 (time 1786327033.93 total 20.04 last 25.78)
 - mkdir 735 (time 1786327043.96 total 30.07 last 21.74)
 - mkdir 924 (time 1786327053.99 total 40.09 last 18.85)
total: 1000 mkdir in 45.19 seconds: 22.13 ops/second
 - mkdir 247 (time 1786327023.49 total 10.03 last 24.64)
 - mkdir 499 (time 1786327033.49 total 20.03 last 25.20)
 - mkdir 729 (time 1786327043.50 total 30.03 last 22.99)
 - mkdir 912 (time 1786327053.50 total 40.03 last 18.30)
total: 1000 mkdir in 46.70 seconds: 21.41 ops/second
 - mkdir 258 (time 1786327024.10 total 10.08 last 25.59)
 - mkdir 518 (time 1786327034.12 total 20.10 last 25.96)
 - mkdir 733 (time 1786327044.12 total 30.10 last 21.49)
 - mkdir 915 (time 1786327054.14 total 40.12 last 18.17)
total: 1000 mkdir in 46.99 seconds: 21.28 ops/second
 - mkdir 249 (time 1786327023.51 total 10.06 last 24.76)
 - mkdir 496 (time 1786327033.53 total 20.08 last 24.63)
 - mkdir 723 (time 1786327043.62 total 30.17 last 22.50)
 - mkdir 905 (time 1786327053.63 total 40.18 last 18.19)
total: 1000 mkdir in 47.68 seconds: 20.97 ops/second
 - mkdir 254 (time 1786327024.11 total 10.06 last 25.25)
 - mkdir 517 (time 1786327034.12 total 20.07 last 26.28)
 - mkdir 727 (time 1786327044.14 total 30.09 last 20.95)
 - mkdir 900 (time 1786327054.21 total 40.16 last 17.19)
total: 1000 mkdir in 48.45 seconds: 20.64 ops/second
 - mkdir 251 (time 1786327024.28 total 10.10 last 24.85)
 - mkdir 515 (time 1786327034.28 total 20.10 last 26.40)
 - mkdir 715 (time 1786327044.31 total 30.14 last 19.93)
 - mkdir 885 (time 1786327054.35 total 40.17 last 16.94)
total: 1000 mkdir in 49.70 seconds: 20.12 ops/second
Time for file creation 60 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786327072 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786327072 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786327073 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8