== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:51:56 (1786819916)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.60 seconds: 16.69 ops/second
 - mkdir 146 (time 1786819935.71 total 10.05 last 14.52)
 - mkdir 352 (time 1786819945.75 total 20.09 last 20.52)
 - mkdir 560 (time 1786819955.80 total 30.15 last 20.69)
 - mkdir 761 (time 1786819965.82 total 40.17 last 20.06)
 - mkdir 978 (time 1786819975.82 total 50.17 last 21.69)
total: 1000 mkdir in 51.28 seconds: 19.50 ops/second
 - mkdir 175 (time 1786819938.94 total 10.04 last 17.44)
 - mkdir 386 (time 1786819948.96 total 20.05 last 21.07)
 - mkdir 615 (time 1786819959.00 total 30.09 last 22.81)
 - mkdir 820 (time 1786819969.04 total 40.13 last 20.42)
total: 1000 mkdir in 49.22 seconds: 20.32 ops/second
 - mkdir 160 (time 1786819938.22 total 10.01 last 15.98)
 - mkdir 371 (time 1786819948.24 total 20.03 last 21.06)
 - mkdir 590 (time 1786819958.26 total 30.05 last 21.87)
 - mkdir 800 (time 1786819968.27 total 40.06 last 20.97)
 - mkdir 991 (time 1786819978.31 total 50.10 last 19.04)
total: 1000 mkdir in 50.74 seconds: 19.71 ops/second
 - mkdir 153 (time 1786819937.53 total 10.00 last 15.30)
 - mkdir 363 (time 1786819947.58 total 20.05 last 20.90)
 - mkdir 573 (time 1786819957.61 total 30.08 last 20.93)
 - mkdir 786 (time 1786819967.63 total 40.10 last 21.27)
 - mkdir 983 (time 1786819977.65 total 50.12 last 19.65)
total: 1000 mkdir in 51.44 seconds: 19.44 ops/second
 - mkdir 175 (time 1786819938.88 total 10.01 last 17.48)
 - mkdir 380 (time 1786819948.95 total 20.08 last 20.36)
 - mkdir 609 (time 1786819959.00 total 30.13 last 22.78)
 - mkdir 811 (time 1786819969.02 total 40.15 last 20.17)
 - mkdir 999 (time 1786819979.07 total 50.20 last 18.71)
total: 1000 mkdir in 50.20 seconds: 19.92 ops/second
 - mkdir 154 (time 1786819938.07 total 10.03 last 15.35)
 - mkdir 367 (time 1786819948.09 total 20.05 last 21.25)
 - mkdir 580 (time 1786819958.10 total 30.06 last 21.29)
 - mkdir 789 (time 1786819968.10 total 40.07 last 20.88)
 - mkdir 984 (time 1786819978.14 total 50.10 last 19.43)
total: 1000 mkdir in 51.39 seconds: 19.46 ops/second
 - mkdir 165 (time 1786819938.80 total 10.02 last 16.46)
 - mkdir 374 (time 1786819948.86 total 20.09 last 20.77)
 - mkdir 601 (time 1786819958.90 total 30.12 last 22.61)
 - mkdir 804 (time 1786819968.95 total 40.18 last 20.19)
 - mkdir 993 (time 1786819979.00 total 50.23 last 18.81)
total: 1000 mkdir in 50.88 seconds: 19.65 ops/second
 - mkdir 165 (time 1786819938.78 total 10.00 last 16.49)
 - mkdir 380 (time 1786819948.78 total 20.01 last 21.49)
 - mkdir 603 (time 1786819958.79 total 30.01 last 22.29)
 - mkdir 804 (time 1786819968.80 total 40.02 last 20.08)
 - mkdir 991 (time 1786819978.88 total 50.10 last 18.55)
total: 1000 mkdir in 50.90 seconds: 19.65 ops/second
 - mkdir 170 (time 1786819938.82 total 10.00 last 17.00)
 - mkdir 382 (time 1786819948.87 total 20.05 last 21.09)
 - mkdir 600 (time 1786819958.88 total 30.06 last 21.78)
 - mkdir 799 (time 1786819968.91 total 40.09 last 19.84)
 - mkdir 989 (time 1786819978.95 total 50.13 last 18.94)
total: 1000 mkdir in 51.05 seconds: 19.59 ops/second
 - mkdir 165 (time 1786819938.82 total 10.06 last 16.40)
 - mkdir 370 (time 1786819948.85 total 20.10 last 20.43)
 - mkdir 590 (time 1786819958.87 total 30.11 last 21.97)
 - mkdir 794 (time 1786819968.87 total 40.11 last 20.40)
 - mkdir 988 (time 1786819978.93 total 50.18 last 19.27)
total: 1000 mkdir in 51.25 seconds: 19.51 ops/second
Time for file creation 62 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 10 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.52 seconds: 19.40 ops/second
 - mkdir 89 (time 1786820495.98 total 10.03 last 8.87)
 - mkdir 264 (time 1786820505.99 total 20.04 last 17.49)
 - mkdir 456 (time 1786820516.00 total 30.05 last 19.19)
 - mkdir 623 (time 1786820526.01 total 40.06 last 16.68)
 - mkdir 787 (time 1786820536.03 total 50.08 last 16.36)
 - mkdir 973 (time 1786820546.05 total 60.10 last 18.56)
total: 1000 mkdir in 61.72 seconds: 16.20 ops/second
 - mkdir 94 (time 1786820496.83 total 10.02 last 9.38)
 - mkdir 258 (time 1786820506.86 total 20.06 last 16.34)
 - mkdir 448 (time 1786820516.88 total 30.08 last 18.96)
 - mkdir 614 (time 1786820526.90 total 40.09 last 16.57)
 - mkdir 777 (time 1786820536.93 total 50.13 last 16.25)
 - mkdir 967 (time 1786820546.99 total 60.19 last 18.89)
total: 1000 mkdir in 63.17 seconds: 15.83 ops/second
 - mkdir 146 (time 1786820501.74 total 10.02 last 14.57)
 - mkdir 342 (time 1786820511.80 total 20.08 last 19.49)
 - mkdir 510 (time 1786820521.90 total 30.18 last 16.64)
 - mkdir 678 (time 1786820531.91 total 40.19 last 16.77)
 - mkdir 860 (time 1786820541.91 total 50.19 last 18.19)
 - mkdir 999 (time 1786820552.00 total 60.28 last 13.78)
total: 1000 mkdir in 60.28 seconds: 16.59 ops/second
 - mkdir 140 (time 1786820501.52 total 10.05 last 13.93)
 - mkdir 331 (time 1786820511.52 total 20.05 last 19.10)
 - mkdir 504 (time 1786820521.54 total 30.07 last 17.27)
 - mkdir 673 (time 1786820531.58 total 40.10 last 16.84)
 - mkdir 851 (time 1786820541.60 total 50.13 last 17.76)
 - mkdir 990 (time 1786820551.65 total 60.17 last 13.84)
total: 1000 mkdir in 61.12 seconds: 16.36 ops/second
 - mkdir 141 (time 1786820501.88 total 10.02 last 14.07)
 - mkdir 335 (time 1786820511.89 total 20.03 last 19.37)
 - mkdir 504 (time 1786820521.91 total 30.05 last 16.87)
 - mkdir 672 (time 1786820531.92 total 40.06 last 16.79)
 - mkdir 849 (time 1786820541.93 total 50.07 last 17.67)
 - mkdir 985 (time 1786820551.98 total 60.12 last 13.54)
total: 1000 mkdir in 61.82 seconds: 16.18 ops/second
 - mkdir 145 (time 1786820502.10 total 10.02 last 14.47)
 - mkdir 337 (time 1786820512.18 total 20.10 last 19.06)
 - mkdir 497 (time 1786820522.20 total 30.12 last 15.96)
 - mkdir 667 (time 1786820532.21 total 40.13 last 16.98)
 - mkdir 853 (time 1786820542.22 total 50.14 last 18.59)
 - mkdir 985 (time 1786820552.31 total 60.23 last 13.09)
total: 1000 mkdir in 62.09 seconds: 16.10 ops/second
 - mkdir 153 (time 1786820502.45 total 10.09 last 15.17)
 - mkdir 343 (time 1786820512.49 total 20.12 last 18.94)
 - mkdir 505 (time 1786820522.55 total 30.19 last 16.09)
 - mkdir 672 (time 1786820532.56 total 40.19 last 16.69)
 - mkdir 860 (time 1786820542.62 total 50.25 last 18.69)
 - mkdir 987 (time 1786820552.67 total 60.30 last 12.64)
total: 1000 mkdir in 61.86 seconds: 16.17 ops/second
 - mkdir 130 (time 1786820501.10 total 10.03 last 12.96)
 - mkdir 315 (time 1786820511.10 total 20.03 last 18.49)
 - mkdir 480 (time 1786820521.13 total 30.06 last 16.45)
 - mkdir 649 (time 1786820531.16 total 40.09 last 16.85)
 - mkdir 830 (time 1786820541.21 total 50.14 last 18.01)
 - mkdir 977 (time 1786820551.21 total 60.15 last 14.69)
total: 1000 mkdir in 63.17 seconds: 15.83 ops/second
 - mkdir 151 (time 1786820502.68 total 10.06 last 15.02)
 - mkdir 343 (time 1786820512.76 total 20.13 last 19.06)
 - mkdir 506 (time 1786820522.81 total 30.19 last 16.21)
 - mkdir 673 (time 1786820532.90 total 40.27 last 16.56)
 - mkdir 865 (time 1786820542.93 total 50.30 last 19.15)
 - mkdir 988 (time 1786820553.00 total 60.37 last 12.21)
total: 1000 mkdir in 61.74 seconds: 16.20 ops/second
 - mkdir 136 (time 1786820501.42 total 10.00 last 13.60)
 - mkdir 314 (time 1786820511.42 total 20.00 last 17.80)
 - mkdir 475 (time 1786820521.47 total 30.05 last 16.02)
 - mkdir 641 (time 1786820531.50 total 40.09 last 16.54)
 - mkdir 819 (time 1786820541.54 total 50.13 last 17.73)
 - mkdir 956 (time 1786820551.64 total 60.22 last 13.57)
total: 1000 mkdir in 64.55 seconds: 15.49 ops/second
Time for file creation 79 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786820564 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1786820564 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786820564 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786820565 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1786820565 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1786820565 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
 - unlinked 0 (time 1786820566 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1786820566 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1786820566 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1786820565 ; total 0 ; last 0)
total: 1000 unlinks in 26 seconds: 38.461540 unlinks/second
Time for file removal 37 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8