== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 19:58:50 (1787875130)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.58 seconds: 17.39 ops/second
 - mkdir 150 (time 1787875150.64 total 10.00 last 14.99)
 - mkdir 287 (time 1787875160.68 total 20.05 last 13.64)
 - mkdir 436 (time 1787875170.70 total 30.06 last 14.88)
 - mkdir 628 (time 1787875180.74 total 40.10 last 19.12)
 - mkdir 833 (time 1787875190.78 total 50.14 last 20.42)
total: 1000 mkdir in 59.40 seconds: 16.84 ops/second
 - mkdir 151 (time 1787875150.82 total 10.04 last 15.04)
 - mkdir 282 (time 1787875160.98 total 20.20 last 12.89)
 - mkdir 438 (time 1787875171.04 total 30.26 last 15.51)
 - mkdir 628 (time 1787875181.08 total 40.30 last 18.92)
 - mkdir 830 (time 1787875191.09 total 50.31 last 20.17)
total: 1000 mkdir in 59.98 seconds: 16.67 ops/second
 - mkdir 150 (time 1787875149.97 total 10.00 last 15.00)
 - mkdir 274 (time 1787875160.02 total 20.05 last 12.34)
 - mkdir 418 (time 1787875170.05 total 30.08 last 14.37)
 - mkdir 610 (time 1787875180.06 total 40.09 last 19.17)
 - mkdir 811 (time 1787875190.11 total 50.14 last 19.99)
 - mkdir 992 (time 1787875200.19 total 60.22 last 17.97)
total: 1000 mkdir in 60.88 seconds: 16.43 ops/second
 - mkdir 152 (time 1787875151.10 total 10.06 last 15.10)
 - mkdir 282 (time 1787875161.11 total 20.08 last 12.98)
 - mkdir 442 (time 1787875171.17 total 30.13 last 15.91)
 - mkdir 626 (time 1787875181.22 total 40.18 last 18.31)
 - mkdir 829 (time 1787875191.25 total 50.21 last 20.24)
total: 1000 mkdir in 60.21 seconds: 16.61 ops/second
 - mkdir 149 (time 1787875151.41 total 10.03 last 14.85)
 - mkdir 279 (time 1787875161.43 total 20.05 last 12.98)
 - mkdir 437 (time 1787875171.45 total 30.07 last 15.76)
 - mkdir 626 (time 1787875181.46 total 40.08 last 18.89)
 - mkdir 827 (time 1787875191.49 total 50.11 last 20.05)
total: 1000 mkdir in 59.93 seconds: 16.69 ops/second
 - mkdir 150 (time 1787875151.07 total 10.00 last 15.00)
 - mkdir 276 (time 1787875161.11 total 20.05 last 12.54)
 - mkdir 432 (time 1787875171.15 total 30.09 last 15.54)
 - mkdir 620 (time 1787875181.19 total 40.12 last 18.73)
 - mkdir 820 (time 1787875191.23 total 50.16 last 19.92)
 - mkdir 997 (time 1787875201.31 total 60.24 last 17.56)
total: 1000 mkdir in 60.50 seconds: 16.53 ops/second
 - mkdir 145 (time 1787875150.10 total 10.11 last 14.34)
 - mkdir 262 (time 1787875160.13 total 20.14 last 11.66)
 - mkdir 404 (time 1787875170.15 total 30.17 last 14.17)
 - mkdir 600 (time 1787875180.19 total 40.20 last 19.53)
 - mkdir 800 (time 1787875190.19 total 50.21 last 19.99)
 - mkdir 985 (time 1787875200.25 total 60.27 last 18.39)
total: 1000 mkdir in 61.70 seconds: 16.21 ops/second
 - mkdir 147 (time 1787875151.17 total 10.03 last 14.66)
 - mkdir 276 (time 1787875161.18 total 20.04 last 12.88)
 - mkdir 431 (time 1787875171.20 total 30.06 last 15.48)
 - mkdir 617 (time 1787875181.24 total 40.10 last 18.53)
 - mkdir 824 (time 1787875191.25 total 50.11 last 20.68)
 - mkdir 995 (time 1787875201.27 total 60.13 last 17.06)
total: 1000 mkdir in 60.59 seconds: 16.51 ops/second
 - mkdir 142 (time 1787875150.32 total 10.13 last 14.02)
 - mkdir 267 (time 1787875160.34 total 20.15 last 12.48)
 - mkdir 409 (time 1787875170.36 total 30.17 last 14.16)
 - mkdir 602 (time 1787875180.41 total 40.22 last 19.21)
 - mkdir 802 (time 1787875190.45 total 50.26 last 19.93)
 - mkdir 985 (time 1787875200.48 total 60.29 last 18.25)
total: 1000 mkdir in 61.58 seconds: 16.24 ops/second
 - mkdir 147 (time 1787875151.22 total 10.07 last 14.60)
 - mkdir 276 (time 1787875161.23 total 20.08 last 12.89)
 - mkdir 432 (time 1787875171.28 total 30.12 last 15.53)
 - mkdir 620 (time 1787875181.31 total 40.15 last 18.74)
 - mkdir 822 (time 1787875191.35 total 50.20 last 20.11)
 - mkdir 989 (time 1787875201.40 total 60.24 last 16.62)
total: 1000 mkdir in 60.94 seconds: 16.41 ops/second
Time for file creation 72 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.45 seconds: 22.34 ops/second
 - mkdir 173 (time 1787875699.77 total 10.04 last 17.22)
 - mkdir 384 (time 1787875709.79 total 20.06 last 21.06)
 - mkdir 593 (time 1787875719.80 total 30.07 last 20.88)
 - mkdir 786 (time 1787875729.81 total 40.08 last 19.28)
total: 1000 mkdir in 49.92 seconds: 20.03 ops/second
 - mkdir 150 (time 1787875698.08 total 10.01 last 14.98)
 - mkdir 346 (time 1787875708.14 total 20.07 last 19.48)
 - mkdir 550 (time 1787875718.17 total 30.10 last 20.35)
 - mkdir 747 (time 1787875728.19 total 40.12 last 19.66)
 - mkdir 958 (time 1787875738.19 total 50.12 last 21.10)
total: 1000 mkdir in 52.24 seconds: 19.14 ops/second
 - mkdir 158 (time 1787875698.81 total 10.03 last 15.75)
 - mkdir 357 (time 1787875708.82 total 20.04 last 19.88)
 - mkdir 568 (time 1787875718.84 total 30.06 last 21.06)
 - mkdir 762 (time 1787875728.85 total 40.07 last 19.38)
 - mkdir 974 (time 1787875738.86 total 50.07 last 21.18)
total: 1000 mkdir in 51.63 seconds: 19.37 ops/second
 - mkdir 171 (time 1787875699.99 total 10.01 last 17.08)
 - mkdir 381 (time 1787875710.00 total 20.02 last 20.98)
 - mkdir 585 (time 1787875720.06 total 30.08 last 20.27)
 - mkdir 785 (time 1787875730.09 total 40.11 last 19.95)
 - mkdir 995 (time 1787875740.15 total 50.17 last 20.88)
total: 1000 mkdir in 50.47 seconds: 19.81 ops/second
 - mkdir 160 (time 1787875699.44 total 10.02 last 15.97)
 - mkdir 364 (time 1787875709.48 total 20.05 last 20.33)
 - mkdir 572 (time 1787875719.52 total 30.09 last 20.71)
 - mkdir 765 (time 1787875729.56 total 40.13 last 19.23)
 - mkdir 984 (time 1787875739.58 total 50.15 last 21.86)
total: 1000 mkdir in 51.24 seconds: 19.52 ops/second
 - mkdir 165 (time 1787875699.78 total 10.06 last 16.41)
 - mkdir 375 (time 1787875709.80 total 20.07 last 20.96)
 - mkdir 583 (time 1787875719.83 total 30.11 last 20.73)
 - mkdir 775 (time 1787875729.86 total 40.13 last 19.15)
 - mkdir 987 (time 1787875739.90 total 50.17 last 21.12)
total: 1000 mkdir in 51.09 seconds: 19.57 ops/second
 - mkdir 171 (time 1787875699.90 total 10.02 last 17.07)
 - mkdir 375 (time 1787875709.92 total 20.03 last 20.37)
 - mkdir 579 (time 1787875719.95 total 30.06 last 20.33)
 - mkdir 781 (time 1787875729.99 total 40.10 last 20.12)
 - mkdir 988 (time 1787875740.06 total 50.17 last 20.55)
total: 1000 mkdir in 51.00 seconds: 19.61 ops/second
 - mkdir 170 (time 1787875700.17 total 10.03 last 16.95)
 - mkdir 377 (time 1787875710.22 total 20.08 last 20.61)
 - mkdir 579 (time 1787875720.28 total 30.14 last 20.07)
 - mkdir 778 (time 1787875730.32 total 40.18 last 19.83)
 - mkdir 987 (time 1787875740.34 total 50.20 last 20.86)
total: 1000 mkdir in 51.11 seconds: 19.57 ops/second
 - mkdir 168 (time 1787875700.14 total 10.03 last 16.75)
 - mkdir 380 (time 1787875710.15 total 20.03 last 21.20)
 - mkdir 582 (time 1787875720.18 total 30.07 last 20.13)
 - mkdir 779 (time 1787875730.18 total 40.07 last 19.70)
 - mkdir 984 (time 1787875740.26 total 50.14 last 20.35)
total: 1000 mkdir in 51.15 seconds: 19.55 ops/second
 - mkdir 149 (time 1787875699.25 total 10.01 last 14.88)
 - mkdir 348 (time 1787875709.28 total 20.04 last 19.84)
 - mkdir 554 (time 1787875719.30 total 30.06 last 20.55)
 - mkdir 753 (time 1787875729.34 total 40.10 last 19.83)
 - mkdir 962 (time 1787875739.35 total 50.12 last 20.87)
total: 1000 mkdir in 52.35 seconds: 19.10 ops/second
Time for file creation 62 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787875750 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1787875750 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875750 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875750 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875751 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875751 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875751 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875751 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875751 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1787875751 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
Time for file removal 35 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8