== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 08:33:43 (1786970023)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.55 seconds: 18.20 ops/second
 - mkdir 162 (time 1786970046.41 total 10.00 last 16.20)
 - mkdir 332 (time 1786970056.42 total 20.01 last 16.98)
 - mkdir 499 (time 1786970066.43 total 30.02 last 16.69)
 - mkdir 673 (time 1786970076.49 total 40.08 last 17.30)
 - mkdir 871 (time 1786970086.50 total 50.09 last 19.78)
total: 1000 mkdir in 55.85 seconds: 17.90 ops/second
 - mkdir 165 (time 1786970047.71 total 10.03 last 16.46)
 - mkdir 345 (time 1786970057.73 total 20.05 last 17.96)
 - mkdir 521 (time 1786970067.79 total 30.10 last 17.50)
 - mkdir 691 (time 1786970077.81 total 40.13 last 16.95)
 - mkdir 894 (time 1786970087.86 total 50.17 last 20.22)
total: 1000 mkdir in 55.28 seconds: 18.09 ops/second
 - mkdir 156 (time 1786970046.63 total 10.00 last 15.60)
 - mkdir 317 (time 1786970056.68 total 20.06 last 16.01)
 - mkdir 493 (time 1786970066.70 total 30.07 last 17.58)
 - mkdir 667 (time 1786970076.73 total 40.11 last 17.34)
 - mkdir 870 (time 1786970086.77 total 50.15 last 20.21)
total: 1000 mkdir in 56.59 seconds: 17.67 ops/second
 - mkdir 147 (time 1786970046.12 total 10.04 last 14.64)
 - mkdir 307 (time 1786970056.15 total 20.07 last 15.95)
 - mkdir 474 (time 1786970066.15 total 30.08 last 16.69)
 - mkdir 647 (time 1786970076.19 total 40.11 last 17.24)
 - mkdir 842 (time 1786970086.20 total 50.12 last 19.48)
total: 1000 mkdir in 58.02 seconds: 17.24 ops/second
 - mkdir 158 (time 1786970046.97 total 10.03 last 15.75)
 - mkdir 326 (time 1786970057.02 total 20.08 last 16.72)
 - mkdir 498 (time 1786970067.05 total 30.11 last 17.15)
 - mkdir 667 (time 1786970077.05 total 40.11 last 16.90)
 - mkdir 859 (time 1786970087.06 total 50.12 last 19.19)
total: 1000 mkdir in 57.45 seconds: 17.41 ops/second
 - mkdir 158 (time 1786970047.54 total 10.00 last 15.80)
 - mkdir 330 (time 1786970057.56 total 20.02 last 17.17)
 - mkdir 498 (time 1786970067.56 total 30.02 last 16.80)
 - mkdir 671 (time 1786970077.59 total 40.06 last 17.24)
 - mkdir 872 (time 1786970087.62 total 50.09 last 20.03)
total: 1000 mkdir in 56.94 seconds: 17.56 ops/second
 - mkdir 165 (time 1786970047.51 total 10.07 last 16.38)
 - mkdir 336 (time 1786970057.54 total 20.11 last 17.04)
 - mkdir 508 (time 1786970067.56 total 30.12 last 17.18)
 - mkdir 678 (time 1786970077.58 total 40.14 last 16.96)
 - mkdir 875 (time 1786970087.62 total 50.18 last 19.63)
total: 1000 mkdir in 57.05 seconds: 17.53 ops/second
 - mkdir 147 (time 1786970046.65 total 10.02 last 14.67)
 - mkdir 315 (time 1786970056.66 total 20.03 last 16.78)
 - mkdir 482 (time 1786970066.68 total 30.05 last 16.67)
 - mkdir 650 (time 1786970076.71 total 40.08 last 16.75)
 - mkdir 848 (time 1786970086.71 total 50.08 last 19.79)
total: 1000 mkdir in 58.13 seconds: 17.20 ops/second
 - mkdir 156 (time 1786970047.12 total 10.02 last 15.57)
 - mkdir 323 (time 1786970057.12 total 20.02 last 16.69)
 - mkdir 491 (time 1786970067.16 total 30.06 last 16.74)
 - mkdir 661 (time 1786970077.18 total 40.08 last 16.97)
 - mkdir 858 (time 1786970087.18 total 50.08 last 19.70)
total: 1000 mkdir in 58.14 seconds: 17.20 ops/second
 - mkdir 157 (time 1786970047.55 total 10.03 last 15.65)
 - mkdir 322 (time 1786970057.62 total 20.11 last 16.37)
 - mkdir 493 (time 1786970067.70 total 30.19 last 16.97)
 - mkdir 665 (time 1786970077.71 total 40.19 last 17.19)
 - mkdir 861 (time 1786970087.74 total 50.23 last 19.53)
total: 1000 mkdir in 58.17 seconds: 17.19 ops/second
Time for file creation 70 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 10 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.61 seconds: 16.48 ops/second
 - mkdir 162 (time 1786970672.63 total 10.01 last 16.19)
 - mkdir 341 (time 1786970682.69 total 20.06 last 17.81)
 - mkdir 510 (time 1786970692.75 total 30.13 last 16.79)
 - mkdir 675 (time 1786970702.77 total 40.15 last 16.46)
 - mkdir 831 (time 1786970712.81 total 50.19 last 15.54)
 - mkdir 971 (time 1786970722.86 total 60.23 last 13.93)
total: 1000 mkdir in 62.54 seconds: 15.99 ops/second
 - mkdir 148 (time 1786970671.69 total 10.04 last 14.74)
 - mkdir 326 (time 1786970681.75 total 20.10 last 17.69)
 - mkdir 489 (time 1786970691.75 total 30.10 last 16.29)
 - mkdir 647 (time 1786970701.79 total 40.14 last 15.75)
 - mkdir 814 (time 1786970711.82 total 50.17 last 16.64)
 - mkdir 958 (time 1786970721.88 total 60.23 last 14.32)
total: 1000 mkdir in 64.05 seconds: 15.61 ops/second
 - mkdir 170 (time 1786970673.55 total 10.02 last 16.96)
 - mkdir 349 (time 1786970683.59 total 20.06 last 17.84)
 - mkdir 517 (time 1786970693.64 total 30.11 last 16.71)
 - mkdir 677 (time 1786970703.70 total 40.17 last 15.90)
 - mkdir 837 (time 1786970713.75 total 50.22 last 15.92)
 - mkdir 972 (time 1786970723.76 total 60.23 last 13.48)
total: 1000 mkdir in 63.18 seconds: 15.83 ops/second
 - mkdir 170 (time 1786970673.29 total 10.03 last 16.96)
 - mkdir 348 (time 1786970683.30 total 20.04 last 17.78)
 - mkdir 512 (time 1786970693.35 total 30.09 last 16.31)
 - mkdir 674 (time 1786970703.39 total 40.12 last 16.15)
 - mkdir 830 (time 1786970713.39 total 50.12 last 15.60)
 - mkdir 963 (time 1786970723.43 total 60.17 last 13.24)
total: 1000 mkdir in 64.00 seconds: 15.62 ops/second
 - mkdir 166 (time 1786970673.80 total 10.05 last 16.51)
 - mkdir 347 (time 1786970683.80 total 20.06 last 18.10)
 - mkdir 509 (time 1786970693.85 total 30.11 last 16.12)
 - mkdir 673 (time 1786970703.91 total 40.17 last 16.30)
 - mkdir 833 (time 1786970713.96 total 50.22 last 15.92)
 - mkdir 964 (time 1786970723.99 total 60.25 last 13.06)
total: 1000 mkdir in 64.30 seconds: 15.55 ops/second
 - mkdir 162 (time 1786970673.47 total 10.04 last 16.13)
 - mkdir 337 (time 1786970683.48 total 20.06 last 17.48)
 - mkdir 494 (time 1786970693.51 total 30.09 last 15.65)
 - mkdir 659 (time 1786970703.61 total 40.19 last 16.33)
 - mkdir 823 (time 1786970713.63 total 50.21 last 16.38)
 - mkdir 959 (time 1786970723.64 total 60.22 last 13.58)
total: 1000 mkdir in 65.04 seconds: 15.38 ops/second
 - mkdir 149 (time 1786970671.90 total 10.06 last 14.81)
 - mkdir 316 (time 1786970681.90 total 20.07 last 16.69)
 - mkdir 474 (time 1786970691.94 total 30.10 last 15.75)
 - mkdir 635 (time 1786970701.94 total 40.11 last 16.09)
 - mkdir 797 (time 1786970711.98 total 50.15 last 16.14)
 - mkdir 940 (time 1786970722.07 total 60.23 last 14.18)
total: 1000 mkdir in 66.86 seconds: 14.96 ops/second
 - mkdir 163 (time 1786970673.69 total 10.08 last 16.17)
 - mkdir 342 (time 1786970683.73 total 20.12 last 17.83)
 - mkdir 499 (time 1786970693.76 total 30.15 last 15.66)
 - mkdir 660 (time 1786970703.80 total 40.18 last 16.04)
 - mkdir 820 (time 1786970713.85 total 50.24 last 15.91)
 - mkdir 956 (time 1786970723.88 total 60.27 last 13.56)
total: 1000 mkdir in 65.79 seconds: 15.20 ops/second
 - mkdir 164 (time 1786970673.97 total 10.04 last 16.34)
 - mkdir 343 (time 1786970683.97 total 20.04 last 17.89)
 - mkdir 500 (time 1786970694.01 total 30.08 last 15.63)
 - mkdir 664 (time 1786970704.10 total 40.17 last 16.26)
 - mkdir 826 (time 1786970714.12 total 50.19 last 16.16)
 - mkdir 956 (time 1786970724.25 total 60.32 last 12.84)
total: 1000 mkdir in 66.50 seconds: 15.04 ops/second
 - mkdir 158 (time 1786970673.87 total 10.05 last 15.72)
 - mkdir 335 (time 1786970683.88 total 20.05 last 17.69)
 - mkdir 481 (time 1786970693.95 total 30.13 last 14.50)
 - mkdir 642 (time 1786970703.96 total 40.14 last 16.08)
 - mkdir 805 (time 1786970713.97 total 50.14 last 16.29)
 - mkdir 940 (time 1786970723.97 total 60.14 last 13.50)
total: 1000 mkdir in 68.18 seconds: 14.67 ops/second
Time for file creation 79 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786970740 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786970741 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786970741 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786970741 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786970741 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786970741 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1786970742 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786970741 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1786970742 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1786970742 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8