== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 04:28:15 (1787387295)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.67 seconds: 14.99 ops/second
 - mkdir 105 (time 1787387322.11 total 10.05 last 10.45)
 - mkdir 231 (time 1787387332.19 total 20.13 last 12.50)
 - mkdir 357 (time 1787387342.21 total 30.15 last 12.58)
 - mkdir 497 (time 1787387352.28 total 40.22 last 13.90)
 - mkdir 644 (time 1787387362.33 total 50.27 last 14.63)
 - mkdir 803 (time 1787387372.39 total 60.33 last 15.80)
 - mkdir 950 (time 1787387382.42 total 70.36 last 14.66)
total: 1000 mkdir in 73.95 seconds: 13.52 ops/second
 - mkdir 112 (time 1787387323.00 total 10.00 last 11.20)
 - mkdir 230 (time 1787387333.08 total 20.08 last 11.71)
 - mkdir 358 (time 1787387343.08 total 30.08 last 12.79)
 - mkdir 503 (time 1787387353.14 total 40.14 last 14.42)
 - mkdir 653 (time 1787387363.21 total 50.21 last 14.90)
 - mkdir 813 (time 1787387373.21 total 60.21 last 15.99)
 - mkdir 948 (time 1787387383.25 total 70.25 last 13.45)
total: 1000 mkdir in 74.39 seconds: 13.44 ops/second
 - mkdir 127 (time 1787387324.66 total 10.00 last 12.70)
 - mkdir 251 (time 1787387334.69 total 20.03 last 12.36)
 - mkdir 378 (time 1787387344.71 total 30.05 last 12.68)
 - mkdir 527 (time 1787387354.72 total 40.06 last 14.89)
 - mkdir 674 (time 1787387364.72 total 50.06 last 14.70)
 - mkdir 834 (time 1787387374.75 total 60.09 last 15.95)
 - mkdir 970 (time 1787387384.79 total 70.13 last 13.54)
total: 1000 mkdir in 73.04 seconds: 13.69 ops/second
 - mkdir 117 (time 1787387324.28 total 10.07 last 11.62)
 - mkdir 237 (time 1787387334.42 total 20.20 last 11.84)
 - mkdir 365 (time 1787387344.49 total 30.27 last 12.71)
 - mkdir 512 (time 1787387354.57 total 40.35 last 14.58)
 - mkdir 658 (time 1787387364.57 total 50.36 last 14.60)
 - mkdir 821 (time 1787387374.60 total 60.38 last 16.25)
 - mkdir 954 (time 1787387384.60 total 70.39 last 13.29)
total: 1000 mkdir in 75.02 seconds: 13.33 ops/second
 - mkdir 117 (time 1787387323.43 total 10.04 last 11.66)
 - mkdir 235 (time 1787387333.47 total 20.07 last 11.76)
 - mkdir 354 (time 1787387343.57 total 30.17 last 11.78)
 - mkdir 502 (time 1787387353.61 total 40.21 last 14.75)
 - mkdir 647 (time 1787387363.67 total 50.27 last 14.42)
 - mkdir 807 (time 1787387373.68 total 60.28 last 15.99)
 - mkdir 946 (time 1787387383.73 total 70.33 last 13.83)
total: 1000 mkdir in 76.14 seconds: 13.13 ops/second
 - mkdir 127 (time 1787387325.45 total 10.01 last 12.69)
 - mkdir 245 (time 1787387335.58 total 20.13 last 11.65)
 - mkdir 372 (time 1787387345.61 total 30.17 last 12.66)
 - mkdir 521 (time 1787387355.65 total 40.21 last 14.83)
 - mkdir 672 (time 1787387365.66 total 50.21 last 15.10)
 - mkdir 833 (time 1787387375.66 total 60.21 last 16.10)
 - mkdir 968 (time 1787387385.66 total 70.22 last 13.49)
total: 1000 mkdir in 74.21 seconds: 13.47 ops/second
 - mkdir 129 (time 1787387326.09 total 10.12 last 12.75)
 - mkdir 252 (time 1787387336.09 total 20.12 last 12.30)
 - mkdir 375 (time 1787387346.10 total 30.13 last 12.29)
 - mkdir 516 (time 1787387356.15 total 40.17 last 14.04)
 - mkdir 672 (time 1787387366.16 total 50.19 last 15.58)
 - mkdir 834 (time 1787387376.21 total 60.23 last 16.13)
 - mkdir 963 (time 1787387386.29 total 70.32 last 12.79)
total: 1000 mkdir in 75.12 seconds: 13.31 ops/second
 - mkdir 128 (time 1787387326.25 total 10.03 last 12.76)
 - mkdir 248 (time 1787387336.35 total 20.13 last 11.88)
 - mkdir 374 (time 1787387346.40 total 30.18 last 12.54)
 - mkdir 520 (time 1787387356.42 total 40.21 last 14.56)
 - mkdir 676 (time 1787387366.43 total 50.21 last 15.60)
 - mkdir 836 (time 1787387376.43 total 60.21 last 16.00)
 - mkdir 961 (time 1787387386.48 total 70.26 last 12.43)
total: 1000 mkdir in 75.60 seconds: 13.23 ops/second
 - mkdir 118 (time 1787387324.93 total 10.08 last 11.71)
 - mkdir 238 (time 1787387334.97 total 20.12 last 11.95)
 - mkdir 354 (time 1787387345.00 total 30.15 last 11.56)
 - mkdir 502 (time 1787387355.01 total 40.16 last 14.78)
 - mkdir 654 (time 1787387365.04 total 50.19 last 15.16)
 - mkdir 816 (time 1787387375.06 total 60.21 last 16.17)
 - mkdir 940 (time 1787387385.18 total 70.33 last 12.25)
total: 1000 mkdir in 77.44 seconds: 12.91 ops/second
 - mkdir 112 (time 1787387325.18 total 10.00 last 11.20)
 - mkdir 222 (time 1787387335.18 total 20.01 last 10.99)
 - mkdir 342 (time 1787387345.21 total 30.03 last 11.97)
 - mkdir 487 (time 1787387355.27 total 40.10 last 14.41)
 - mkdir 638 (time 1787387365.30 total 50.13 last 15.06)
 - mkdir 803 (time 1787387375.32 total 60.15 last 16.46)
 - mkdir 928 (time 1787387385.36 total 70.18 last 12.46)
total: 1000 mkdir in 78.66 seconds: 12.71 ops/second
Time for file creation 95 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.55 seconds: 18.04 ops/second
 - mkdir 139 (time 1787387978.37 total 10.02 last 13.87)
 - mkdir 290 (time 1787387988.39 total 20.03 last 15.08)
 - mkdir 454 (time 1787387998.45 total 30.09 last 16.30)
 - mkdir 612 (time 1787388008.55 total 40.19 last 15.64)
 - mkdir 754 (time 1787388018.55 total 50.20 last 14.20)
 - mkdir 914 (time 1787388028.58 total 60.23 last 15.95)
total: 1000 mkdir in 65.06 seconds: 15.37 ops/second
 - mkdir 135 (time 1787387978.16 total 10.02 last 13.48)
 - mkdir 283 (time 1787387988.21 total 20.07 last 14.72)
 - mkdir 443 (time 1787387998.25 total 30.11 last 15.94)
 - mkdir 596 (time 1787388008.28 total 40.14 last 15.25)
 - mkdir 734 (time 1787388018.35 total 50.21 last 13.70)
 - mkdir 889 (time 1787388028.36 total 60.22 last 15.48)
total: 1000 mkdir in 67.21 seconds: 14.88 ops/second
 - mkdir 140 (time 1787387979.38 total 10.00 last 13.99)
 - mkdir 287 (time 1787387989.38 total 20.01 last 14.70)
 - mkdir 454 (time 1787387999.43 total 30.05 last 16.62)
 - mkdir 601 (time 1787388009.43 total 40.06 last 14.70)
 - mkdir 739 (time 1787388019.50 total 50.13 last 13.71)
 - mkdir 901 (time 1787388029.55 total 60.17 last 16.12)
total: 1000 mkdir in 67.68 seconds: 14.77 ops/second
 - mkdir 137 (time 1787387979.25 total 10.03 last 13.66)
 - mkdir 277 (time 1787387989.33 total 20.11 last 13.89)
 - mkdir 445 (time 1787387999.36 total 30.15 last 16.75)
 - mkdir 592 (time 1787388009.38 total 40.16 last 14.68)
 - mkdir 732 (time 1787388019.40 total 50.18 last 13.97)
 - mkdir 891 (time 1787388029.40 total 60.18 last 15.90)
total: 1000 mkdir in 69.02 seconds: 14.49 ops/second
 - mkdir 142 (time 1787387979.20 total 10.03 last 14.16)
 - mkdir 287 (time 1787387989.22 total 20.05 last 14.46)
 - mkdir 451 (time 1787387999.30 total 30.13 last 16.27)
 - mkdir 593 (time 1787388009.31 total 40.14 last 14.20)
 - mkdir 724 (time 1787388019.32 total 50.15 last 13.08)
 - mkdir 884 (time 1787388029.34 total 60.17 last 15.97)
total: 1000 mkdir in 69.24 seconds: 14.44 ops/second
 - mkdir 139 (time 1787387979.49 total 10.04 last 13.84)
 - mkdir 285 (time 1787387989.58 total 20.14 last 14.46)
 - mkdir 449 (time 1787387999.59 total 30.15 last 16.38)
 - mkdir 591 (time 1787388009.64 total 40.20 last 14.13)
 - mkdir 726 (time 1787388019.71 total 50.26 last 13.41)
 - mkdir 882 (time 1787388029.79 total 60.34 last 15.47)
 - mkdir 997 (time 1787388039.85 total 70.41 last 11.43)
total: 1000 mkdir in 70.72 seconds: 14.14 ops/second
 - mkdir 137 (time 1787387979.34 total 10.02 last 13.67)
 - mkdir 280 (time 1787387989.38 total 20.06 last 14.24)
 - mkdir 446 (time 1787387999.42 total 30.10 last 16.54)
 - mkdir 586 (time 1787388009.45 total 40.13 last 13.97)
 - mkdir 718 (time 1787388019.49 total 50.17 last 13.14)
 - mkdir 878 (time 1787388029.51 total 60.19 last 15.98)
 - mkdir 994 (time 1787388039.60 total 70.28 last 11.49)
total: 1000 mkdir in 70.93 seconds: 14.10 ops/second
 - mkdir 141 (time 1787387980.18 total 10.08 last 13.99)
 - mkdir 284 (time 1787387990.23 total 20.13 last 14.23)
 - mkdir 446 (time 1787388000.24 total 30.14 last 16.19)
 - mkdir 583 (time 1787388010.30 total 40.20 last 13.61)
 - mkdir 726 (time 1787388020.31 total 50.21 last 14.29)
 - mkdir 881 (time 1787388030.35 total 60.25 last 15.43)
 - mkdir 992 (time 1787388040.43 total 70.33 last 11.02)
total: 1000 mkdir in 71.03 seconds: 14.08 ops/second
 - mkdir 127 (time 1787387978.33 total 10.07 last 12.61)
 - mkdir 265 (time 1787387988.35 total 20.09 last 13.77)
 - mkdir 418 (time 1787387998.45 total 30.18 last 15.16)
 - mkdir 560 (time 1787388008.55 total 40.28 last 14.06)
 - mkdir 689 (time 1787388018.60 total 50.33 last 12.83)
 - mkdir 837 (time 1787388028.64 total 60.37 last 14.74)
 - mkdir 966 (time 1787388038.71 total 70.44 last 12.81)
total: 1000 mkdir in 74.01 seconds: 13.51 ops/second
 - mkdir 133 (time 1787387979.37 total 10.03 last 13.26)
 - mkdir 272 (time 1787387989.39 total 20.05 last 13.87)
 - mkdir 429 (time 1787387999.41 total 30.07 last 15.67)
 - mkdir 565 (time 1787388009.46 total 40.12 last 13.54)
 - mkdir 699 (time 1787388019.49 total 50.15 last 13.36)
 - mkdir 850 (time 1787388029.56 total 60.22 last 14.99)
 - mkdir 969 (time 1787388039.60 total 70.26 last 11.86)
total: 1000 mkdir in 73.13 seconds: 13.67 ops/second
Time for file creation 82 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787388049 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787388050 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787388050 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787388051 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787388051 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787388051 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787388051 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787388052 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787388051 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1787388051 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8