== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 23:38:32 (1787801912)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.48 seconds: 20.62 ops/second
 - mkdir 164 (time 1787801934.06 total 10.11 last 16.22)
 - mkdir 344 (time 1787801944.08 total 20.13 last 17.96)
 - mkdir 532 (time 1787801954.12 total 30.18 last 18.72)
 - mkdir 735 (time 1787801964.14 total 40.19 last 20.27)
 - mkdir 912 (time 1787801974.16 total 50.22 last 17.65)
total: 1000 mkdir in 56.25 seconds: 17.78 ops/second
 - mkdir 157 (time 1787801934.92 total 10.06 last 15.61)
 - mkdir 333 (time 1787801944.92 total 20.06 last 17.60)
 - mkdir 535 (time 1787801954.93 total 30.07 last 20.18)
 - mkdir 748 (time 1787801964.98 total 40.12 last 21.19)
 - mkdir 917 (time 1787801974.99 total 50.14 last 16.87)
total: 1000 mkdir in 55.70 seconds: 17.95 ops/second
 - mkdir 168 (time 1787801935.91 total 10.05 last 16.72)
 - mkdir 347 (time 1787801945.95 total 20.09 last 17.83)
 - mkdir 547 (time 1787801955.99 total 30.13 last 19.91)
 - mkdir 750 (time 1787801966.04 total 40.18 last 20.20)
 - mkdir 921 (time 1787801976.07 total 50.20 last 17.06)
total: 1000 mkdir in 55.64 seconds: 17.97 ops/second
 - mkdir 166 (time 1787801935.34 total 10.04 last 16.53)
 - mkdir 339 (time 1787801945.39 total 20.09 last 17.22)
 - mkdir 545 (time 1787801955.42 total 30.12 last 20.54)
 - mkdir 741 (time 1787801965.46 total 40.16 last 19.52)
 - mkdir 909 (time 1787801975.49 total 50.19 last 16.75)
total: 1000 mkdir in 56.62 seconds: 17.66 ops/second
 - mkdir 159 (time 1787801935.61 total 10.05 last 15.82)
 - mkdir 334 (time 1787801945.66 total 20.10 last 17.40)
 - mkdir 538 (time 1787801955.70 total 30.14 last 20.32)
 - mkdir 739 (time 1787801965.71 total 40.15 last 20.09)
 - mkdir 908 (time 1787801975.76 total 50.20 last 16.82)
total: 1000 mkdir in 57.21 seconds: 17.48 ops/second
 - mkdir 155 (time 1787801935.67 total 10.01 last 15.49)
 - mkdir 328 (time 1787801945.70 total 20.04 last 17.25)
 - mkdir 534 (time 1787801955.75 total 30.09 last 20.49)
 - mkdir 734 (time 1787801965.77 total 40.11 last 19.96)
 - mkdir 902 (time 1787801975.81 total 50.15 last 16.74)
total: 1000 mkdir in 57.91 seconds: 17.27 ops/second
 - mkdir 152 (time 1787801935.64 total 10.02 last 15.18)
 - mkdir 324 (time 1787801945.65 total 20.02 last 17.19)
 - mkdir 526 (time 1787801955.70 total 30.08 last 20.08)
 - mkdir 728 (time 1787801965.71 total 40.08 last 20.20)
 - mkdir 899 (time 1787801975.77 total 50.15 last 17.00)
total: 1000 mkdir in 58.08 seconds: 17.22 ops/second
 - mkdir 169 (time 1787801936.32 total 10.01 last 16.89)
 - mkdir 338 (time 1787801946.35 total 20.03 last 16.86)
 - mkdir 537 (time 1787801956.35 total 30.03 last 19.89)
 - mkdir 735 (time 1787801966.41 total 40.09 last 19.69)
 - mkdir 906 (time 1787801976.41 total 50.10 last 17.09)
total: 1000 mkdir in 58.36 seconds: 17.14 ops/second
 - mkdir 154 (time 1787801935.67 total 10.01 last 15.38)
 - mkdir 322 (time 1787801945.70 total 20.04 last 16.75)
 - mkdir 522 (time 1787801955.72 total 30.06 last 19.96)
 - mkdir 721 (time 1787801965.76 total 40.10 last 19.83)
 - mkdir 894 (time 1787801975.83 total 50.17 last 17.17)
total: 1000 mkdir in 59.13 seconds: 16.91 ops/second
 - mkdir 165 (time 1787801936.54 total 10.04 last 16.43)
 - mkdir 326 (time 1787801946.56 total 20.06 last 16.07)
 - mkdir 520 (time 1787801956.57 total 30.07 last 19.38)
 - mkdir 719 (time 1787801966.57 total 40.08 last 19.89)
 - mkdir 892 (time 1787801976.59 total 50.09 last 17.28)
total: 1000 mkdir in 59.81 seconds: 16.72 ops/second
Time for file creation 71 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 20 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.48 seconds: 20.95 ops/second
 - mkdir 170 (time 1787802544.66 total 10.04 last 16.93)
 - mkdir 316 (time 1787802554.66 total 20.05 last 14.60)
 - mkdir 483 (time 1787802564.67 total 30.06 last 16.68)
 - mkdir 602 (time 1787802574.70 total 40.09 last 11.87)
 - mkdir 718 (time 1787802584.74 total 50.13 last 11.55)
 - mkdir 913 (time 1787802594.79 total 60.17 last 19.41)
total: 1000 mkdir in 66.14 seconds: 15.12 ops/second
 - mkdir 182 (time 1787802547.05 total 10.01 last 18.17)
 - mkdir 336 (time 1787802557.07 total 20.04 last 15.37)
 - mkdir 490 (time 1787802567.08 total 30.05 last 15.38)
 - mkdir 612 (time 1787802577.11 total 40.08 last 12.17)
 - mkdir 751 (time 1787802587.14 total 50.11 last 13.85)
 - mkdir 945 (time 1787802597.16 total 60.13 last 19.35)
total: 1000 mkdir in 64.54 seconds: 15.50 ops/second
 - mkdir 177 (time 1787802545.21 total 10.03 last 17.66)
 - mkdir 323 (time 1787802555.23 total 20.04 last 14.58)
 - mkdir 486 (time 1787802565.31 total 30.12 last 16.17)
 - mkdir 600 (time 1787802575.35 total 40.16 last 11.35)
 - mkdir 718 (time 1787802585.36 total 50.18 last 11.78)
 - mkdir 908 (time 1787802595.38 total 60.19 last 18.97)
total: 1000 mkdir in 67.60 seconds: 14.79 ops/second
 - mkdir 177 (time 1787802546.75 total 10.02 last 17.67)
 - mkdir 318 (time 1787802556.76 total 20.02 last 14.09)
 - mkdir 474 (time 1787802566.82 total 30.09 last 15.50)
 - mkdir 599 (time 1787802576.92 total 40.19 last 12.37)
 - mkdir 737 (time 1787802586.96 total 50.23 last 13.75)
 - mkdir 927 (time 1787802596.99 total 60.26 last 18.94)
total: 1000 mkdir in 66.87 seconds: 14.95 ops/second
 - mkdir 173 (time 1787802546.17 total 10.05 last 17.21)
 - mkdir 313 (time 1787802556.18 total 20.06 last 13.99)
 - mkdir 472 (time 1787802566.31 total 30.19 last 15.70)
 - mkdir 592 (time 1787802576.41 total 40.29 last 11.88)
 - mkdir 720 (time 1787802586.43 total 50.31 last 12.78)
 - mkdir 909 (time 1787802596.45 total 60.33 last 18.86)
total: 1000 mkdir in 68.72 seconds: 14.55 ops/second
 - mkdir 172 (time 1787802546.58 total 10.05 last 17.11)
 - mkdir 315 (time 1787802556.60 total 20.07 last 14.28)
 - mkdir 475 (time 1787802566.71 total 30.17 last 15.83)
 - mkdir 589 (time 1787802576.78 total 40.25 last 11.31)
 - mkdir 726 (time 1787802586.85 total 50.32 last 13.61)
 - mkdir 913 (time 1787802596.85 total 60.32 last 18.70)
total: 1000 mkdir in 68.97 seconds: 14.50 ops/second
 - mkdir 173 (time 1787802546.28 total 10.02 last 17.26)
 - mkdir 313 (time 1787802556.33 total 20.07 last 13.93)
 - mkdir 467 (time 1787802566.36 total 30.10 last 15.35)
 - mkdir 587 (time 1787802576.41 total 40.15 last 11.94)
 - mkdir 718 (time 1787802586.43 total 50.17 last 13.07)
 - mkdir 903 (time 1787802596.46 total 60.20 last 18.45)
total: 1000 mkdir in 69.93 seconds: 14.30 ops/second
 - mkdir 159 (time 1787802544.81 total 10.02 last 15.87)
 - mkdir 295 (time 1787802554.83 total 20.04 last 13.58)
 - mkdir 450 (time 1787802564.93 total 30.14 last 15.34)
 - mkdir 566 (time 1787802575.02 total 40.23 last 11.50)
 - mkdir 685 (time 1787802585.10 total 50.31 last 11.81)
 - mkdir 883 (time 1787802595.10 total 60.31 last 19.80)
 - mkdir 993 (time 1787802605.20 total 70.41 last 10.90)
total: 1000 mkdir in 71.44 seconds: 14.00 ops/second
 - mkdir 168 (time 1787802546.50 total 10.02 last 16.76)
 - mkdir 310 (time 1787802556.50 total 20.02 last 14.20)
 - mkdir 459 (time 1787802566.51 total 30.03 last 14.89)
 - mkdir 579 (time 1787802576.65 total 40.17 last 11.84)
 - mkdir 714 (time 1787802586.71 total 50.23 last 13.42)
 - mkdir 905 (time 1787802596.78 total 60.29 last 18.97)
total: 1000 mkdir in 69.81 seconds: 14.32 ops/second
 - mkdir 173 (time 1787802546.30 total 10.10 last 17.13)
 - mkdir 315 (time 1787802556.34 total 20.14 last 14.13)
 - mkdir 473 (time 1787802566.39 total 30.19 last 15.72)
 - mkdir 592 (time 1787802576.44 total 40.24 last 11.85)
 - mkdir 721 (time 1787802586.46 total 50.26 last 12.88)
 - mkdir 903 (time 1787802596.48 total 60.28 last 18.16)
total: 1000 mkdir in 70.25 seconds: 14.24 ops/second
Time for file creation 84 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787802619 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1787802620 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787802621 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787802620 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1787802621 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787802621 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787802620 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
 - unlinked 0 (time 1787802621 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787802621 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1787802622 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
Time for file removal 58 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8