== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 04:21:00 (1787386860)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.45 seconds: 22.12 ops/second
 - mkdir 174 (time 1787386882.08 total 10.07 last 17.28)
 - mkdir 341 (time 1787386892.09 total 20.07 last 16.69)
 - mkdir 509 (time 1787386902.12 total 30.10 last 16.75)
 - mkdir 700 (time 1787386912.14 total 40.13 last 19.05)
 - mkdir 893 (time 1787386922.15 total 50.14 last 19.28)
total: 1000 mkdir in 55.87 seconds: 17.90 ops/second
 - mkdir 175 (time 1787386880.46 total 10.01 last 17.48)
 - mkdir 315 (time 1787386890.47 total 20.02 last 13.99)
 - mkdir 479 (time 1787386900.48 total 30.03 last 16.38)
 - mkdir 660 (time 1787386910.49 total 40.04 last 18.09)
 - mkdir 853 (time 1787386920.50 total 50.05 last 19.27)
total: 1000 mkdir in 58.02 seconds: 17.24 ops/second
 - mkdir 170 (time 1787386881.70 total 10.09 last 16.85)
 - mkdir 332 (time 1787386891.70 total 20.09 last 16.19)
 - mkdir 491 (time 1787386901.75 total 30.14 last 15.83)
 - mkdir 682 (time 1787386911.78 total 40.17 last 19.04)
 - mkdir 879 (time 1787386921.79 total 50.18 last 19.67)
total: 1000 mkdir in 56.90 seconds: 17.58 ops/second
 - mkdir 176 (time 1787386882.09 total 10.06 last 17.50)
 - mkdir 332 (time 1787386892.10 total 20.07 last 15.59)
 - mkdir 492 (time 1787386902.12 total 30.09 last 15.97)
 - mkdir 684 (time 1787386912.12 total 40.09 last 19.20)
 - mkdir 881 (time 1787386922.17 total 50.14 last 19.61)
total: 1000 mkdir in 56.99 seconds: 17.55 ops/second
 - mkdir 175 (time 1787386881.27 total 10.04 last 17.43)
 - mkdir 329 (time 1787386891.32 total 20.08 last 15.34)
 - mkdir 487 (time 1787386901.35 total 30.12 last 15.75)
 - mkdir 672 (time 1787386911.38 total 40.15 last 18.45)
 - mkdir 865 (time 1787386921.41 total 50.18 last 19.25)
total: 1000 mkdir in 58.14 seconds: 17.20 ops/second
 - mkdir 169 (time 1787386882.21 total 10.12 last 16.69)
 - mkdir 328 (time 1787386892.26 total 20.17 last 15.82)
 - mkdir 487 (time 1787386902.26 total 30.17 last 15.90)
 - mkdir 679 (time 1787386912.30 total 40.21 last 19.13)
 - mkdir 871 (time 1787386922.32 total 50.23 last 19.16)
total: 1000 mkdir in 57.98 seconds: 17.25 ops/second
 - mkdir 170 (time 1787386881.67 total 10.02 last 16.96)
 - mkdir 323 (time 1787386891.70 total 20.05 last 15.26)
 - mkdir 480 (time 1787386901.73 total 30.08 last 15.66)
 - mkdir 667 (time 1787386911.78 total 40.13 last 18.60)
 - mkdir 862 (time 1787386921.82 total 50.18 last 19.42)
total: 1000 mkdir in 58.60 seconds: 17.06 ops/second
 - mkdir 169 (time 1787386882.31 total 10.08 last 16.76)
 - mkdir 326 (time 1787386892.33 total 20.11 last 15.66)
 - mkdir 482 (time 1787386902.42 total 30.20 last 15.46)
 - mkdir 676 (time 1787386912.44 total 40.21 last 19.37)
 - mkdir 867 (time 1787386922.45 total 50.23 last 19.07)
total: 1000 mkdir in 58.62 seconds: 17.06 ops/second
 - mkdir 167 (time 1787386881.58 total 10.08 last 16.56)
 - mkdir 318 (time 1787386891.59 total 20.09 last 15.09)
 - mkdir 465 (time 1787386901.65 total 30.15 last 14.61)
 - mkdir 649 (time 1787386911.66 total 40.16 last 18.39)
 - mkdir 852 (time 1787386921.68 total 50.19 last 20.24)
total: 1000 mkdir in 59.51 seconds: 16.80 ops/second
 - mkdir 170 (time 1787386881.70 total 10.01 last 16.99)
 - mkdir 319 (time 1787386891.72 total 20.03 last 14.87)
 - mkdir 468 (time 1787386901.76 total 30.07 last 14.84)
 - mkdir 658 (time 1787386911.77 total 40.07 last 18.98)
 - mkdir 852 (time 1787386921.80 total 50.10 last 19.34)
total: 1000 mkdir in 60.05 seconds: 16.65 ops/second
Time for file creation 70 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.57 seconds: 17.52 ops/second
 - mkdir 210 (time 1787387481.32 total 10.07 last 20.86)
 - mkdir 433 (time 1787387491.37 total 20.11 last 22.20)
 - mkdir 638 (time 1787387501.41 total 30.15 last 20.42)
 - mkdir 843 (time 1787387511.44 total 40.18 last 20.44)
total: 1000 mkdir in 49.63 seconds: 20.15 ops/second
 - mkdir 201 (time 1787387479.90 total 10.03 last 20.03)
 - mkdir 419 (time 1787387489.93 total 20.07 last 21.73)
 - mkdir 622 (time 1787387499.95 total 30.08 last 20.28)
 - mkdir 822 (time 1787387509.99 total 40.12 last 19.92)
 - mkdir 978 (time 1787387520.02 total 50.15 last 15.54)
total: 1000 mkdir in 51.39 seconds: 19.46 ops/second
 - mkdir 193 (time 1787387479.83 total 10.01 last 19.28)
 - mkdir 412 (time 1787387489.86 total 20.04 last 21.84)
 - mkdir 611 (time 1787387499.88 total 30.06 last 19.85)
 - mkdir 808 (time 1787387509.91 total 40.09 last 19.65)
 - mkdir 970 (time 1787387519.93 total 50.10 last 16.17)
total: 1000 mkdir in 52.11 seconds: 19.19 ops/second
 - mkdir 188 (time 1787387479.52 total 10.03 last 18.74)
 - mkdir 404 (time 1787387489.52 total 20.04 last 21.58)
 - mkdir 601 (time 1787387499.56 total 30.08 last 19.62)
 - mkdir 805 (time 1787387509.58 total 40.10 last 20.37)
 - mkdir 964 (time 1787387519.61 total 50.13 last 15.85)
total: 1000 mkdir in 52.58 seconds: 19.02 ops/second
 - mkdir 204 (time 1787387480.97 total 10.03 last 20.35)
 - mkdir 429 (time 1787387490.98 total 20.04 last 22.46)
 - mkdir 629 (time 1787387501.02 total 30.07 last 19.94)
 - mkdir 831 (time 1787387511.06 total 40.11 last 20.12)
 - mkdir 991 (time 1787387521.15 total 50.21 last 15.85)
total: 1000 mkdir in 51.22 seconds: 19.52 ops/second
 - mkdir 206 (time 1787387481.03 total 10.00 last 20.59)
 - mkdir 423 (time 1787387491.08 total 20.05 last 21.61)
 - mkdir 625 (time 1787387501.08 total 30.06 last 20.18)
 - mkdir 825 (time 1787387511.12 total 40.09 last 19.93)
 - mkdir 986 (time 1787387521.22 total 50.19 last 15.94)
total: 1000 mkdir in 51.73 seconds: 19.33 ops/second
 - mkdir 205 (time 1787387481.08 total 10.01 last 20.47)
 - mkdir 420 (time 1787387491.08 total 20.01 last 21.50)
 - mkdir 624 (time 1787387501.10 total 30.04 last 20.36)
 - mkdir 823 (time 1787387511.16 total 40.10 last 19.78)
 - mkdir 980 (time 1787387521.22 total 50.16 last 15.61)
total: 1000 mkdir in 52.30 seconds: 19.12 ops/second
 - mkdir 206 (time 1787387481.33 total 10.03 last 20.54)
 - mkdir 423 (time 1787387491.34 total 20.04 last 21.68)
 - mkdir 620 (time 1787387501.36 total 30.06 last 19.67)
 - mkdir 821 (time 1787387511.39 total 40.09 last 20.04)
 - mkdir 981 (time 1787387521.41 total 50.11 last 15.97)
total: 1000 mkdir in 52.28 seconds: 19.13 ops/second
 - mkdir 205 (time 1787387481.03 total 10.04 last 20.41)
 - mkdir 419 (time 1787387491.04 total 20.06 last 21.37)
 - mkdir 622 (time 1787387501.08 total 30.09 last 20.23)
 - mkdir 821 (time 1787387511.14 total 40.15 last 19.77)
 - mkdir 977 (time 1787387521.19 total 50.21 last 15.52)
total: 1000 mkdir in 52.71 seconds: 18.97 ops/second
 - mkdir 190 (time 1787387480.71 total 10.01 last 18.98)
 - mkdir 392 (time 1787387490.73 total 20.03 last 20.16)
 - mkdir 579 (time 1787387500.76 total 30.07 last 18.63)
 - mkdir 774 (time 1787387510.80 total 40.10 last 19.43)
 - mkdir 932 (time 1787387520.82 total 50.13 last 15.76)
total: 1000 mkdir in 56.68 seconds: 17.64 ops/second
Time for file creation 65 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787387536 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787387536 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787387536 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787387536 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787387536 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787387537 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787387537 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787387536 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787387537 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787387537 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
Time for file removal 49 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8