== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:20:16 (1789158016)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.54 seconds: 18.67 ops/second
 - mkdir 196 (time 1789158037.83 total 10.04 last 19.51)
 - mkdir 375 (time 1789158047.85 total 20.07 last 17.86)
 - mkdir 568 (time 1789158057.96 total 30.17 last 19.11)
 - mkdir 713 (time 1789158067.99 total 40.21 last 14.45)
 - mkdir 854 (time 1789158078.06 total 50.28 last 14.00)
total: 1000 mkdir in 59.08 seconds: 16.93 ops/second
 - mkdir 188 (time 1789158036.64 total 10.04 last 18.72)
 - mkdir 362 (time 1789158046.66 total 20.06 last 17.37)
 - mkdir 548 (time 1789158056.70 total 30.10 last 18.52)
 - mkdir 689 (time 1789158066.77 total 40.17 last 14.01)
 - mkdir 826 (time 1789158076.82 total 50.22 last 13.63)
 - mkdir 994 (time 1789158086.85 total 60.25 last 16.76)
total: 1000 mkdir in 60.75 seconds: 16.46 ops/second
 - mkdir 188 (time 1789158036.28 total 10.03 last 18.74)
 - mkdir 361 (time 1789158046.31 total 20.06 last 17.25)
 - mkdir 541 (time 1789158056.35 total 30.10 last 17.93)
 - mkdir 684 (time 1789158066.38 total 40.14 last 14.25)
 - mkdir 823 (time 1789158076.44 total 50.19 last 13.83)
 - mkdir 989 (time 1789158086.50 total 60.26 last 16.49)
total: 1000 mkdir in 61.15 seconds: 16.35 ops/second
 - mkdir 191 (time 1789158037.15 total 10.10 last 18.91)
 - mkdir 363 (time 1789158047.17 total 20.12 last 17.17)
 - mkdir 545 (time 1789158057.19 total 30.14 last 18.17)
 - mkdir 682 (time 1789158067.21 total 40.16 last 13.67)
 - mkdir 817 (time 1789158077.23 total 50.18 last 13.47)
 - mkdir 986 (time 1789158087.27 total 60.22 last 16.83)
total: 1000 mkdir in 61.75 seconds: 16.20 ops/second
 - mkdir 185 (time 1789158037.50 total 10.03 last 18.45)
 - mkdir 362 (time 1789158047.52 total 20.05 last 17.66)
 - mkdir 544 (time 1789158057.54 total 30.07 last 18.17)
 - mkdir 684 (time 1789158067.56 total 40.09 last 13.97)
 - mkdir 827 (time 1789158077.60 total 50.13 last 14.24)
 - mkdir 986 (time 1789158087.62 total 60.15 last 15.86)
total: 1000 mkdir in 61.75 seconds: 16.19 ops/second
 - mkdir 187 (time 1789158037.92 total 10.02 last 18.67)
 - mkdir 358 (time 1789158047.97 total 20.06 last 17.02)
 - mkdir 540 (time 1789158058.00 total 30.09 last 18.14)
 - mkdir 685 (time 1789158068.04 total 40.13 last 14.45)
 - mkdir 827 (time 1789158078.08 total 50.18 last 14.13)
 - mkdir 984 (time 1789158088.18 total 60.28 last 15.54)
total: 1000 mkdir in 62.15 seconds: 16.09 ops/second
 - mkdir 185 (time 1789158037.64 total 10.03 last 18.44)
 - mkdir 357 (time 1789158047.65 total 20.04 last 17.19)
 - mkdir 537 (time 1789158057.69 total 30.08 last 17.93)
 - mkdir 680 (time 1789158067.76 total 40.15 last 14.20)
 - mkdir 822 (time 1789158077.77 total 50.16 last 14.19)
 - mkdir 979 (time 1789158087.85 total 60.24 last 15.57)
total: 1000 mkdir in 63.29 seconds: 15.80 ops/second
 - mkdir 178 (time 1789158037.07 total 10.02 last 17.77)
 - mkdir 343 (time 1789158047.09 total 20.04 last 16.47)
 - mkdir 516 (time 1789158057.09 total 30.04 last 17.30)
 - mkdir 657 (time 1789158067.14 total 40.09 last 14.03)
 - mkdir 794 (time 1789158077.16 total 50.11 last 13.68)
 - mkdir 963 (time 1789158087.28 total 60.23 last 16.70)
total: 1000 mkdir in 65.01 seconds: 15.38 ops/second
 - mkdir 174 (time 1789158036.93 total 10.03 last 17.34)
 - mkdir 338 (time 1789158046.95 total 20.05 last 16.37)
 - mkdir 518 (time 1789158057.00 total 30.10 last 17.90)
 - mkdir 661 (time 1789158067.06 total 40.16 last 14.21)
 - mkdir 798 (time 1789158077.09 total 50.20 last 13.66)
 - mkdir 958 (time 1789158087.12 total 60.22 last 15.96)
total: 1000 mkdir in 65.68 seconds: 15.23 ops/second
 - mkdir 176 (time 1789158037.47 total 10.04 last 17.53)
 - mkdir 340 (time 1789158047.52 total 20.09 last 16.32)
 - mkdir 510 (time 1789158057.60 total 30.17 last 16.87)
 - mkdir 654 (time 1789158067.69 total 40.26 last 14.27)
 - mkdir 794 (time 1789158077.72 total 50.29 last 13.96)
 - mkdir 958 (time 1789158087.84 total 60.41 last 16.21)
total: 1000 mkdir in 65.83 seconds: 15.19 ops/second
Time for file creation 75 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.82 seconds: 12.20 ops/second
 - mkdir 166 (time 1789158627.47 total 10.07 last 16.48)
 - mkdir 415 (time 1789158637.48 total 20.07 last 24.89)
 - mkdir 693 (time 1789158647.55 total 30.15 last 27.59)
 - mkdir 883 (time 1789158657.58 total 40.18 last 18.95)
total: 1000 mkdir in 46.54 seconds: 21.49 ops/second
 - mkdir 161 (time 1789158625.93 total 10.05 last 16.01)
 - mkdir 384 (time 1789158635.94 total 20.06 last 22.28)
 - mkdir 676 (time 1789158645.96 total 30.09 last 29.12)
 - mkdir 855 (time 1789158655.98 total 40.10 last 17.87)
total: 1000 mkdir in 48.88 seconds: 20.46 ops/second
 - mkdir 166 (time 1789158627.45 total 10.08 last 16.47)
 - mkdir 410 (time 1789158637.46 total 20.09 last 24.38)
 - mkdir 694 (time 1789158647.52 total 30.15 last 28.23)
 - mkdir 871 (time 1789158657.54 total 40.17 last 17.67)
total: 1000 mkdir in 48.01 seconds: 20.83 ops/second
 - mkdir 159 (time 1789158627.02 total 10.02 last 15.87)
 - mkdir 394 (time 1789158637.04 total 20.04 last 23.46)
 - mkdir 684 (time 1789158647.06 total 30.06 last 28.93)
 - mkdir 865 (time 1789158657.10 total 40.11 last 18.02)
total: 1000 mkdir in 48.53 seconds: 20.61 ops/second
 - mkdir 169 (time 1789158627.82 total 10.02 last 16.87)
 - mkdir 425 (time 1789158637.83 total 20.03 last 25.56)
 - mkdir 694 (time 1789158647.90 total 30.10 last 26.72)
 - mkdir 872 (time 1789158657.94 total 40.14 last 17.73)
total: 1000 mkdir in 47.79 seconds: 20.92 ops/second
 - mkdir 163 (time 1789158627.68 total 10.04 last 16.23)
 - mkdir 419 (time 1789158637.71 total 20.07 last 25.52)
 - mkdir 693 (time 1789158647.79 total 30.15 last 27.19)
 - mkdir 868 (time 1789158657.80 total 40.16 last 17.49)
total: 1000 mkdir in 48.26 seconds: 20.72 ops/second
 - mkdir 155 (time 1789158626.46 total 10.08 last 15.38)
 - mkdir 376 (time 1789158636.47 total 20.09 last 22.08)
 - mkdir 666 (time 1789158646.50 total 30.12 last 28.90)
 - mkdir 845 (time 1789158656.54 total 40.16 last 17.83)
 - mkdir 995 (time 1789158666.59 total 50.21 last 14.92)
total: 1000 mkdir in 50.66 seconds: 19.74 ops/second
 - mkdir 155 (time 1789158627.03 total 10.04 last 15.44)
 - mkdir 395 (time 1789158637.04 total 20.05 last 23.97)
 - mkdir 680 (time 1789158647.06 total 30.07 last 28.45)
 - mkdir 851 (time 1789158657.14 total 40.14 last 16.97)
 - mkdir 999 (time 1789158667.22 total 50.23 last 14.67)
total: 1000 mkdir in 50.23 seconds: 19.91 ops/second
 - mkdir 160 (time 1789158627.40 total 10.05 last 15.91)
 - mkdir 402 (time 1789158637.43 total 20.08 last 24.13)
 - mkdir 672 (time 1789158647.47 total 30.13 last 26.88)
 - mkdir 847 (time 1789158657.50 total 40.16 last 17.45)
 - mkdir 991 (time 1789158667.60 total 50.25 last 14.27)
total: 1000 mkdir in 51.13 seconds: 19.56 ops/second
 - mkdir 145 (time 1789158626.55 total 10.07 last 14.40)
 - mkdir 367 (time 1789158636.58 total 20.09 last 22.14)
 - mkdir 652 (time 1789158646.61 total 30.13 last 28.41)
 - mkdir 823 (time 1789158656.66 total 40.18 last 17.02)
 - mkdir 971 (time 1789158666.79 total 50.30 last 14.61)
total: 1000 mkdir in 53.00 seconds: 18.87 ops/second
Time for file creation 65 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789158678 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789158678 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789158678 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789158678 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789158678 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789158679 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789158679 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789158679 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789158679 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789158679 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8