== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 19:18:10 (1789600690)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.69 seconds: 14.58 ops/second
 - mkdir 141 (time 1789600712.64 total 10.04 last 14.05)
 - mkdir 306 (time 1789600722.75 total 20.14 last 16.32)
 - mkdir 489 (time 1789600732.76 total 30.15 last 18.30)
 - mkdir 665 (time 1789600742.81 total 40.20 last 17.50)
 - mkdir 846 (time 1789600752.86 total 50.25 last 18.01)
total: 1000 mkdir in 59.90 seconds: 16.70 ops/second
 - mkdir 143 (time 1789600713.48 total 10.00 last 14.30)
 - mkdir 307 (time 1789600723.49 total 20.01 last 16.38)
 - mkdir 486 (time 1789600733.51 total 30.03 last 17.88)
 - mkdir 666 (time 1789600743.54 total 40.06 last 17.94)
 - mkdir 842 (time 1789600753.58 total 50.10 last 17.53)
total: 1000 mkdir in 60.05 seconds: 16.65 ops/second
 - mkdir 134 (time 1789600712.92 total 10.01 last 13.39)
 - mkdir 298 (time 1789600722.94 total 20.03 last 16.37)
 - mkdir 485 (time 1789600732.96 total 30.05 last 18.66)
 - mkdir 655 (time 1789600742.99 total 40.08 last 16.94)
 - mkdir 832 (time 1789600753.01 total 50.10 last 17.67)
 - mkdir 988 (time 1789600763.16 total 60.24 last 15.38)
total: 1000 mkdir in 61.56 seconds: 16.24 ops/second
 - mkdir 134 (time 1789600712.82 total 10.08 last 13.29)
 - mkdir 294 (time 1789600722.87 total 20.13 last 15.92)
 - mkdir 481 (time 1789600732.89 total 30.15 last 18.66)
 - mkdir 654 (time 1789600742.91 total 40.17 last 17.27)
 - mkdir 828 (time 1789600752.91 total 50.17 last 17.40)
 - mkdir 983 (time 1789600763.01 total 60.27 last 15.35)
total: 1000 mkdir in 62.19 seconds: 16.08 ops/second
 - mkdir 146 (time 1789600714.18 total 10.02 last 14.57)
 - mkdir 313 (time 1789600724.18 total 20.03 last 16.69)
 - mkdir 485 (time 1789600734.23 total 30.07 last 17.12)
 - mkdir 663 (time 1789600744.25 total 40.09 last 17.77)
 - mkdir 839 (time 1789600754.29 total 50.14 last 17.52)
 - mkdir 987 (time 1789600764.29 total 60.14 last 14.80)
total: 1000 mkdir in 62.04 seconds: 16.12 ops/second
 - mkdir 136 (time 1789600713.83 total 10.10 last 13.46)
 - mkdir 302 (time 1789600723.84 total 20.11 last 16.59)
 - mkdir 473 (time 1789600733.85 total 30.12 last 17.08)
 - mkdir 649 (time 1789600743.87 total 40.14 last 17.56)
 - mkdir 826 (time 1789600753.90 total 50.17 last 17.64)
 - mkdir 978 (time 1789600764.01 total 60.27 last 15.04)
total: 1000 mkdir in 63.52 seconds: 15.74 ops/second
 - mkdir 142 (time 1789600713.77 total 10.08 last 14.09)
 - mkdir 309 (time 1789600723.78 total 20.09 last 16.68)
 - mkdir 486 (time 1789600733.82 total 30.12 last 17.64)
 - mkdir 653 (time 1789600743.83 total 40.14 last 16.67)
 - mkdir 825 (time 1789600753.84 total 50.14 last 17.19)
 - mkdir 977 (time 1789600763.90 total 60.21 last 15.10)
total: 1000 mkdir in 63.58 seconds: 15.73 ops/second
 - mkdir 134 (time 1789600713.28 total 10.01 last 13.38)
 - mkdir 288 (time 1789600723.30 total 20.03 last 15.36)
 - mkdir 463 (time 1789600733.34 total 30.08 last 17.43)
 - mkdir 637 (time 1789600743.39 total 40.12 last 17.32)
 - mkdir 813 (time 1789600753.47 total 50.20 last 17.46)
 - mkdir 969 (time 1789600763.55 total 60.29 last 15.47)
total: 1000 mkdir in 64.61 seconds: 15.48 ops/second
 - mkdir 137 (time 1789600713.82 total 10.01 last 13.68)
 - mkdir 299 (time 1789600723.88 total 20.07 last 16.11)
 - mkdir 468 (time 1789600733.92 total 30.11 last 16.83)
 - mkdir 639 (time 1789600744.01 total 40.21 last 16.94)
 - mkdir 810 (time 1789600754.03 total 50.22 last 17.08)
 - mkdir 955 (time 1789600764.06 total 60.25 last 14.45)
total: 1000 mkdir in 65.88 seconds: 15.18 ops/second
 - mkdir 133 (time 1789600713.97 total 10.03 last 13.26)
 - mkdir 289 (time 1789600723.98 total 20.04 last 15.59)
 - mkdir 446 (time 1789600733.98 total 30.04 last 15.70)
 - mkdir 611 (time 1789600744.01 total 40.07 last 16.45)
 - mkdir 777 (time 1789600754.02 total 50.08 last 16.58)
 - mkdir 924 (time 1789600764.03 total 60.09 last 14.69)
total: 1000 mkdir in 67.15 seconds: 14.89 ops/second
Time for file creation 79 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 17 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 20.17 ops/second
 - mkdir 169 (time 1789601303.83 total 10.04 last 16.83)
 - mkdir 355 (time 1789601313.92 total 20.13 last 18.43)
 - mkdir 557 (time 1789601323.94 total 30.16 last 20.15)
 - mkdir 760 (time 1789601333.96 total 40.18 last 20.25)
 - mkdir 944 (time 1789601343.98 total 50.20 last 18.37)
total: 1000 mkdir in 53.52 seconds: 18.69 ops/second
 - mkdir 169 (time 1789601303.52 total 10.05 last 16.81)
 - mkdir 352 (time 1789601313.56 total 20.09 last 18.23)
 - mkdir 547 (time 1789601323.59 total 30.12 last 19.44)
 - mkdir 754 (time 1789601333.61 total 40.14 last 20.66)
 - mkdir 936 (time 1789601343.64 total 50.17 last 18.15)
total: 1000 mkdir in 54.53 seconds: 18.34 ops/second
 - mkdir 167 (time 1789601303.28 total 10.04 last 16.64)
 - mkdir 354 (time 1789601313.28 total 20.04 last 18.70)
 - mkdir 550 (time 1789601323.34 total 30.10 last 19.48)
 - mkdir 759 (time 1789601333.35 total 40.11 last 20.89)
 - mkdir 935 (time 1789601343.40 total 50.16 last 17.51)
total: 1000 mkdir in 55.06 seconds: 18.16 ops/second
 - mkdir 160 (time 1789601302.55 total 10.03 last 15.95)
 - mkdir 335 (time 1789601312.56 total 20.05 last 17.47)
 - mkdir 533 (time 1789601322.58 total 30.06 last 19.78)
 - mkdir 735 (time 1789601332.64 total 40.12 last 20.07)
 - mkdir 918 (time 1789601342.69 total 50.17 last 18.21)
total: 1000 mkdir in 55.84 seconds: 17.91 ops/second
 - mkdir 169 (time 1789601303.55 total 10.02 last 16.87)
 - mkdir 351 (time 1789601313.56 total 20.02 last 18.19)
 - mkdir 544 (time 1789601323.57 total 30.04 last 19.27)
 - mkdir 752 (time 1789601333.61 total 40.07 last 20.73)
 - mkdir 932 (time 1789601343.67 total 50.13 last 17.90)
total: 1000 mkdir in 55.30 seconds: 18.08 ops/second
 - mkdir 160 (time 1789601301.44 total 10.01 last 15.99)
 - mkdir 327 (time 1789601311.49 total 20.05 last 16.62)
 - mkdir 528 (time 1789601321.61 total 30.17 last 19.86)
 - mkdir 721 (time 1789601331.61 total 40.18 last 19.29)
 - mkdir 901 (time 1789601341.70 total 50.27 last 17.84)
total: 1000 mkdir in 57.96 seconds: 17.25 ops/second
 - mkdir 166 (time 1789601303.73 total 10.04 last 16.53)
 - mkdir 343 (time 1789601313.82 total 20.13 last 17.54)
 - mkdir 537 (time 1789601323.83 total 30.14 last 19.38)
 - mkdir 744 (time 1789601333.97 total 40.28 last 20.43)
 - mkdir 926 (time 1789601343.97 total 50.28 last 18.19)
total: 1000 mkdir in 55.83 seconds: 17.91 ops/second
 - mkdir 163 (time 1789601303.10 total 10.06 last 16.21)
 - mkdir 336 (time 1789601313.10 total 20.06 last 17.29)
 - mkdir 529 (time 1789601323.13 total 30.09 last 19.25)
 - mkdir 731 (time 1789601333.19 total 40.15 last 20.07)
 - mkdir 914 (time 1789601343.25 total 50.21 last 18.20)
total: 1000 mkdir in 56.50 seconds: 17.70 ops/second
 - mkdir 165 (time 1789601303.08 total 10.04 last 16.43)
 - mkdir 342 (time 1789601313.14 total 20.10 last 17.60)
 - mkdir 533 (time 1789601323.18 total 30.13 last 19.03)
 - mkdir 734 (time 1789601333.23 total 40.19 last 19.99)
 - mkdir 912 (time 1789601343.29 total 50.25 last 17.70)
total: 1000 mkdir in 56.67 seconds: 17.65 ops/second
 - mkdir 153 (time 1789601302.20 total 10.04 last 15.24)
 - mkdir 316 (time 1789601312.22 total 20.05 last 16.28)
 - mkdir 512 (time 1789601322.34 total 30.17 last 19.36)
 - mkdir 708 (time 1789601332.34 total 40.18 last 19.59)
 - mkdir 883 (time 1789601342.36 total 50.19 last 17.48)
total: 1000 mkdir in 59.80 seconds: 16.72 ops/second
Time for file creation 70 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789601359 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789601359 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789601362 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789601362 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789601362 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789601362 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789601362 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1789601362 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1789601362 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1789601363 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8