== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 07:00:01 (1790679601)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.31 ops/second
 - mkdir 170 (time 1790679620.14 total 10.00 last 17.00)
 - mkdir 357 (time 1790679630.19 total 20.05 last 18.62)
 - mkdir 485 (time 1790679640.22 total 30.08 last 12.76)
 - mkdir 664 (time 1790679650.27 total 40.13 last 17.81)
 - mkdir 840 (time 1790679660.32 total 50.18 last 17.51)
 - mkdir 972 (time 1790679670.39 total 60.25 last 13.11)
total: 1000 mkdir in 62.12 seconds: 16.10 ops/second
 - mkdir 199 (time 1790679623.24 total 10.02 last 19.85)
 - mkdir 350 (time 1790679633.26 total 20.05 last 15.06)
 - mkdir 504 (time 1790679643.29 total 30.08 last 15.35)
 - mkdir 691 (time 1790679653.33 total 40.12 last 18.62)
 - mkdir 856 (time 1790679663.36 total 50.14 last 16.46)
 - mkdir 982 (time 1790679673.49 total 60.28 last 12.43)
total: 1000 mkdir in 63.00 seconds: 15.87 ops/second
 - mkdir 178 (time 1790679621.57 total 10.06 last 17.69)
 - mkdir 334 (time 1790679631.61 total 20.10 last 15.54)
 - mkdir 468 (time 1790679641.62 total 30.11 last 13.38)
 - mkdir 643 (time 1790679651.64 total 40.13 last 17.47)
 - mkdir 809 (time 1790679661.71 total 50.20 last 16.48)
 - mkdir 942 (time 1790679671.75 total 60.24 last 13.25)
total: 1000 mkdir in 68.19 seconds: 14.67 ops/second
 - mkdir 200 (time 1790679624.08 total 10.04 last 19.92)
 - mkdir 336 (time 1790679634.17 total 20.14 last 13.47)
 - mkdir 496 (time 1790679644.21 total 30.17 last 15.94)
 - mkdir 676 (time 1790679654.25 total 40.21 last 17.93)
 - mkdir 831 (time 1790679664.27 total 50.24 last 15.46)
 - mkdir 950 (time 1790679674.33 total 60.30 last 11.83)
total: 1000 mkdir in 67.41 seconds: 14.83 ops/second
 - mkdir 188 (time 1790679623.26 total 10.03 last 18.73)
 - mkdir 336 (time 1790679633.28 total 20.06 last 14.77)
 - mkdir 482 (time 1790679643.34 total 30.12 last 14.51)
 - mkdir 660 (time 1790679653.38 total 40.15 last 17.74)
 - mkdir 819 (time 1790679663.41 total 50.19 last 15.85)
 - mkdir 944 (time 1790679673.47 total 60.24 last 12.43)
total: 1000 mkdir in 68.51 seconds: 14.60 ops/second
 - mkdir 208 (time 1790679624.78 total 10.01 last 20.78)
 - mkdir 343 (time 1790679634.89 total 20.12 last 13.35)
 - mkdir 504 (time 1790679644.93 total 30.15 last 16.05)
 - mkdir 695 (time 1790679654.93 total 40.16 last 19.09)
 - mkdir 842 (time 1790679664.98 total 50.20 last 14.64)
 - mkdir 952 (time 1790679675.12 total 60.35 last 10.84)
total: 1000 mkdir in 67.21 seconds: 14.88 ops/second
 - mkdir 199 (time 1790679623.92 total 10.03 last 19.83)
 - mkdir 334 (time 1790679633.95 total 20.06 last 13.46)
 - mkdir 490 (time 1790679643.96 total 30.08 last 15.58)
 - mkdir 666 (time 1790679653.97 total 40.09 last 17.58)
 - mkdir 820 (time 1790679664.01 total 50.13 last 15.33)
 - mkdir 940 (time 1790679674.17 total 60.29 last 11.81)
total: 1000 mkdir in 68.27 seconds: 14.65 ops/second
 - mkdir 193 (time 1790679624.17 total 10.03 last 19.25)
 - mkdir 332 (time 1790679634.25 total 20.11 last 13.79)
 - mkdir 490 (time 1790679644.34 total 30.20 last 15.65)
 - mkdir 673 (time 1790679654.36 total 40.21 last 18.28)
 - mkdir 826 (time 1790679664.40 total 50.26 last 15.23)
 - mkdir 938 (time 1790679674.40 total 60.26 last 11.20)
total: 1000 mkdir in 68.86 seconds: 14.52 ops/second
 - mkdir 192 (time 1790679623.92 total 10.03 last 19.15)
 - mkdir 333 (time 1790679633.94 total 20.04 last 14.07)
 - mkdir 486 (time 1790679643.96 total 30.07 last 15.26)
 - mkdir 664 (time 1790679653.99 total 40.10 last 17.74)
 - mkdir 811 (time 1790679664.01 total 50.11 last 14.68)
 - mkdir 933 (time 1790679674.08 total 60.19 last 12.11)
total: 1000 mkdir in 69.22 seconds: 14.45 ops/second
 - mkdir 189 (time 1790679624.37 total 10.02 last 18.86)
 - mkdir 324 (time 1790679634.50 total 20.15 last 13.33)
 - mkdir 479 (time 1790679644.53 total 30.18 last 15.46)
 - mkdir 665 (time 1790679654.57 total 40.22 last 18.52)
 - mkdir 811 (time 1790679664.66 total 50.30 last 14.48)
 - mkdir 922 (time 1790679674.81 total 60.46 last 10.93)
 - mkdir 998 (time 1790679684.81 total 70.46 last 7.60)
total: 1000 mkdir in 70.58 seconds: 14.17 ops/second
Time for file creation 82 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.75 seconds: 13.41 ops/second
 - mkdir 137 (time 1790680248.56 total 10.05 last 13.63)
 - mkdir 330 (time 1790680258.59 total 20.08 last 19.24)
 - mkdir 485 (time 1790680268.62 total 30.11 last 15.45)
 - mkdir 629 (time 1790680278.65 total 40.14 last 14.36)
 - mkdir 787 (time 1790680288.67 total 50.16 last 15.77)
 - mkdir 958 (time 1790680298.72 total 60.21 last 17.02)
total: 1000 mkdir in 62.69 seconds: 15.95 ops/second
 - mkdir 136 (time 1790680248.44 total 10.09 last 13.48)
 - mkdir 331 (time 1790680258.45 total 20.11 last 19.46)
 - mkdir 485 (time 1790680268.53 total 30.18 last 15.29)
 - mkdir 629 (time 1790680278.55 total 40.21 last 14.36)
 - mkdir 787 (time 1790680288.65 total 50.31 last 15.64)
 - mkdir 954 (time 1790680298.67 total 60.32 last 16.68)
total: 1000 mkdir in 63.47 seconds: 15.75 ops/second
 - mkdir 145 (time 1790680249.31 total 10.01 last 14.49)
 - mkdir 332 (time 1790680259.34 total 20.04 last 18.64)
 - mkdir 483 (time 1790680269.35 total 30.05 last 15.09)
 - mkdir 633 (time 1790680279.38 total 40.08 last 14.96)
 - mkdir 799 (time 1790680289.39 total 50.09 last 16.57)
 - mkdir 966 (time 1790680299.42 total 60.12 last 16.65)
total: 1000 mkdir in 62.97 seconds: 15.88 ops/second
 - mkdir 138 (time 1790680248.96 total 10.03 last 13.76)
 - mkdir 336 (time 1790680259.02 total 20.08 last 19.70)
 - mkdir 484 (time 1790680269.14 total 30.21 last 14.62)
 - mkdir 634 (time 1790680279.24 total 40.30 last 14.86)
 - mkdir 794 (time 1790680289.24 total 50.31 last 15.99)
 - mkdir 958 (time 1790680299.27 total 60.34 last 16.35)
total: 1000 mkdir in 63.58 seconds: 15.73 ops/second
 - mkdir 146 (time 1790680249.25 total 10.01 last 14.59)
 - mkdir 332 (time 1790680259.26 total 20.02 last 18.58)
 - mkdir 482 (time 1790680269.31 total 30.06 last 14.93)
 - mkdir 635 (time 1790680279.33 total 40.08 last 15.27)
 - mkdir 797 (time 1790680289.37 total 50.12 last 16.13)
 - mkdir 960 (time 1790680299.39 total 60.15 last 16.26)
total: 1000 mkdir in 63.27 seconds: 15.81 ops/second
 - mkdir 146 (time 1790680249.34 total 10.02 last 14.57)
 - mkdir 329 (time 1790680259.42 total 20.10 last 18.15)
 - mkdir 481 (time 1790680269.45 total 30.13 last 15.15)
 - mkdir 630 (time 1790680279.46 total 40.14 last 14.88)
 - mkdir 793 (time 1790680289.47 total 50.15 last 16.29)
 - mkdir 960 (time 1790680299.48 total 60.16 last 16.68)
total: 1000 mkdir in 63.65 seconds: 15.71 ops/second
 - mkdir 132 (time 1790680248.79 total 10.01 last 13.19)
 - mkdir 327 (time 1790680258.81 total 20.02 last 19.47)
 - mkdir 476 (time 1790680269.00 total 30.21 last 14.62)
 - mkdir 625 (time 1790680279.08 total 40.29 last 14.78)
 - mkdir 782 (time 1790680289.10 total 50.31 last 15.67)
 - mkdir 950 (time 1790680299.15 total 60.37 last 16.70)
total: 1000 mkdir in 64.26 seconds: 15.56 ops/second
 - mkdir 151 (time 1790680249.53 total 10.01 last 15.09)
 - mkdir 333 (time 1790680259.55 total 20.02 last 18.17)
 - mkdir 486 (time 1790680269.55 total 30.03 last 15.30)
 - mkdir 634 (time 1790680279.57 total 40.05 last 14.77)
 - mkdir 792 (time 1790680289.58 total 50.05 last 15.79)
 - mkdir 958 (time 1790680299.63 total 60.11 last 16.51)
total: 1000 mkdir in 64.04 seconds: 15.62 ops/second
 - mkdir 142 (time 1790680249.24 total 10.02 last 14.17)
 - mkdir 328 (time 1790680259.34 total 20.13 last 18.40)
 - mkdir 476 (time 1790680269.36 total 30.14 last 14.78)
 - mkdir 627 (time 1790680279.38 total 40.16 last 15.07)
 - mkdir 790 (time 1790680289.39 total 50.18 last 16.27)
 - mkdir 952 (time 1790680299.42 total 60.21 last 16.15)
total: 1000 mkdir in 64.36 seconds: 15.54 ops/second
 - mkdir 149 (time 1790680249.72 total 10.00 last 14.89)
 - mkdir 333 (time 1790680259.75 total 20.03 last 18.36)
 - mkdir 482 (time 1790680269.76 total 30.04 last 14.88)
 - mkdir 638 (time 1790680279.77 total 40.05 last 15.58)
 - mkdir 797 (time 1790680289.80 total 50.08 last 15.86)
 - mkdir 960 (time 1790680299.83 total 60.11 last 16.24)
total: 1000 mkdir in 64.05 seconds: 15.61 ops/second
Time for file creation 78 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790680316 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1790680316 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1790680317 ; total 0 ; last 0)
total: 1000 unlinks in 42 seconds: 23.809525 unlinks/second
 - unlinked 0 (time 1790680317 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1790680317 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1790680318 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1790680318 ; total 1 ; last 1)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
 - unlinked 0 (time 1790680318 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1790680318 ; total 1 ; last 1)
total: 1000 unlinks in 45 seconds: 22.222221 unlinks/second
 - unlinked 0 (time 1790680318 ; total 0 ; last 0)
total: 1000 unlinks in 44 seconds: 22.727272 unlinks/second
Time for file removal 57 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8