== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 11:32:04 (1789399924)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.55 seconds: 18.03 ops/second
 - mkdir 131 (time 1789399945.94 total 10.02 last 13.07)
 - mkdir 268 (time 1789399955.97 total 20.05 last 13.66)
 - mkdir 410 (time 1789399966.03 total 30.11 last 14.11)
 - mkdir 547 (time 1789399976.10 total 40.18 last 13.61)
 - mkdir 697 (time 1789399986.16 total 50.24 last 14.91)
 - mkdir 872 (time 1789399996.19 total 60.27 last 17.45)
total: 1000 mkdir in 67.10 seconds: 14.90 ops/second
 - mkdir 152 (time 1789399949.82 total 10.05 last 15.13)
 - mkdir 285 (time 1789399959.86 total 20.09 last 13.24)
 - mkdir 438 (time 1789399969.94 total 30.17 last 15.18)
 - mkdir 574 (time 1789399979.95 total 40.18 last 13.59)
 - mkdir 740 (time 1789399990.01 total 50.24 last 16.50)
 - mkdir 933 (time 1789400000.03 total 60.26 last 19.26)
total: 1000 mkdir in 64.14 seconds: 15.59 ops/second
 - mkdir 152 (time 1789399950.84 total 10.08 last 15.08)
 - mkdir 285 (time 1789399960.85 total 20.09 last 13.28)
 - mkdir 438 (time 1789399970.86 total 30.10 last 15.29)
 - mkdir 580 (time 1789399980.89 total 40.13 last 14.16)
 - mkdir 740 (time 1789399990.91 total 50.16 last 15.96)
 - mkdir 943 (time 1789400000.95 total 60.19 last 20.23)
total: 1000 mkdir in 63.85 seconds: 15.66 ops/second
 - mkdir 143 (time 1789399950.42 total 10.01 last 14.29)
 - mkdir 279 (time 1789399960.51 total 20.11 last 13.47)
 - mkdir 425 (time 1789399970.57 total 30.17 last 14.51)
 - mkdir 559 (time 1789399980.61 total 40.20 last 13.36)
 - mkdir 731 (time 1789399990.62 total 50.22 last 17.17)
 - mkdir 928 (time 1789400000.67 total 60.26 last 19.60)
total: 1000 mkdir in 64.72 seconds: 15.45 ops/second
 - mkdir 149 (time 1789399951.14 total 10.07 last 14.79)
 - mkdir 287 (time 1789399961.17 total 20.10 last 13.76)
 - mkdir 434 (time 1789399971.22 total 30.15 last 14.62)
 - mkdir 578 (time 1789399981.29 total 40.22 last 14.30)
 - mkdir 747 (time 1789399991.34 total 50.27 last 16.81)
 - mkdir 938 (time 1789400001.43 total 60.36 last 18.94)
total: 1000 mkdir in 64.67 seconds: 15.46 ops/second
 - mkdir 152 (time 1789399951.18 total 10.09 last 15.07)
 - mkdir 286 (time 1789399961.19 total 20.10 last 13.38)
 - mkdir 428 (time 1789399971.27 total 30.19 last 14.08)
 - mkdir 568 (time 1789399981.29 total 40.20 last 13.98)
 - mkdir 737 (time 1789399991.32 total 50.24 last 16.84)
 - mkdir 933 (time 1789400001.39 total 60.30 last 19.47)
total: 1000 mkdir in 65.54 seconds: 15.26 ops/second
 - mkdir 145 (time 1789399951.32 total 10.00 last 14.50)
 - mkdir 286 (time 1789399961.33 total 20.01 last 14.08)
 - mkdir 428 (time 1789399971.38 total 30.06 last 14.14)
 - mkdir 567 (time 1789399981.40 total 40.08 last 13.87)
 - mkdir 731 (time 1789399991.44 total 50.12 last 16.33)
 - mkdir 924 (time 1789400001.46 total 60.14 last 19.26)
total: 1000 mkdir in 66.09 seconds: 15.13 ops/second
 - mkdir 144 (time 1789399950.81 total 10.03 last 14.36)
 - mkdir 276 (time 1789399960.88 total 20.10 last 13.11)
 - mkdir 417 (time 1789399970.91 total 30.12 last 14.07)
 - mkdir 550 (time 1789399980.96 total 40.18 last 13.23)
 - mkdir 709 (time 1789399990.98 total 50.20 last 15.86)
 - mkdir 909 (time 1789400001.04 total 60.26 last 19.88)
total: 1000 mkdir in 67.22 seconds: 14.88 ops/second
 - mkdir 147 (time 1789399951.59 total 10.10 last 14.56)
 - mkdir 281 (time 1789399961.62 total 20.12 last 13.37)
 - mkdir 427 (time 1789399971.62 total 30.12 last 14.59)
 - mkdir 566 (time 1789399981.62 total 40.13 last 13.90)
 - mkdir 732 (time 1789399991.62 total 50.13 last 16.60)
 - mkdir 922 (time 1789400001.63 total 60.13 last 18.98)
total: 1000 mkdir in 66.59 seconds: 15.02 ops/second
 - mkdir 135 (time 1789399950.89 total 10.01 last 13.48)
 - mkdir 263 (time 1789399960.89 total 20.01 last 12.80)
 - mkdir 399 (time 1789399970.90 total 30.02 last 13.60)
 - mkdir 529 (time 1789399980.94 total 40.06 last 12.95)
 - mkdir 683 (time 1789399990.97 total 50.09 last 15.35)
 - mkdir 876 (time 1789400001.01 total 60.13 last 19.22)
total: 1000 mkdir in 69.24 seconds: 14.44 ops/second
Time for file creation 82 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.51 seconds: 19.67 ops/second
 - mkdir 160 (time 1789400547.39 total 10.01 last 15.99)
 - mkdir 341 (time 1789400557.50 total 20.12 last 17.90)
 - mkdir 521 (time 1789400567.52 total 30.13 last 17.98)
 - mkdir 677 (time 1789400577.54 total 40.15 last 15.56)
 - mkdir 834 (time 1789400587.62 total 50.23 last 15.59)
 - mkdir 974 (time 1789400597.67 total 60.28 last 13.92)
total: 1000 mkdir in 62.91 seconds: 15.89 ops/second
 - mkdir 156 (time 1789400547.35 total 10.01 last 15.58)
 - mkdir 339 (time 1789400557.37 total 20.03 last 18.27)
 - mkdir 516 (time 1789400567.39 total 30.05 last 17.65)
 - mkdir 668 (time 1789400577.43 total 40.09 last 15.15)
 - mkdir 831 (time 1789400587.44 total 50.11 last 16.27)
 - mkdir 964 (time 1789400597.45 total 60.12 last 13.29)
total: 1000 mkdir in 64.34 seconds: 15.54 ops/second
 - mkdir 163 (time 1789400547.93 total 10.04 last 16.24)
 - mkdir 344 (time 1789400557.98 total 20.09 last 18.01)
 - mkdir 526 (time 1789400567.99 total 30.10 last 18.17)
 - mkdir 680 (time 1789400578.00 total 40.11 last 15.38)
 - mkdir 837 (time 1789400588.02 total 50.13 last 15.67)
 - mkdir 966 (time 1789400598.02 total 60.14 last 12.89)
total: 1000 mkdir in 64.27 seconds: 15.56 ops/second
 - mkdir 159 (time 1789400547.76 total 10.04 last 15.83)
 - mkdir 338 (time 1789400557.77 total 20.05 last 17.89)
 - mkdir 518 (time 1789400567.83 total 30.12 last 17.88)
 - mkdir 670 (time 1789400577.90 total 40.19 last 15.10)
 - mkdir 833 (time 1789400587.92 total 50.20 last 16.27)
 - mkdir 967 (time 1789400598.08 total 60.37 last 13.18)
total: 1000 mkdir in 64.62 seconds: 15.47 ops/second
 - mkdir 159 (time 1789400548.43 total 10.08 last 15.77)
 - mkdir 333 (time 1789400558.51 total 20.16 last 17.26)
 - mkdir 517 (time 1789400568.53 total 30.19 last 18.36)
 - mkdir 672 (time 1789400578.54 total 40.19 last 15.49)
 - mkdir 833 (time 1789400588.55 total 50.21 last 16.08)
 - mkdir 965 (time 1789400598.67 total 60.33 last 13.04)
total: 1000 mkdir in 64.82 seconds: 15.43 ops/second
 - mkdir 159 (time 1789400548.14 total 10.01 last 15.88)
 - mkdir 338 (time 1789400558.18 total 20.05 last 17.83)
 - mkdir 518 (time 1789400568.22 total 30.09 last 17.93)
 - mkdir 669 (time 1789400578.22 total 40.09 last 15.10)
 - mkdir 829 (time 1789400588.25 total 50.13 last 15.94)
 - mkdir 959 (time 1789400598.35 total 60.22 last 12.88)
total: 1000 mkdir in 65.61 seconds: 15.24 ops/second
 - mkdir 153 (time 1789400548.01 total 10.01 last 15.28)
 - mkdir 323 (time 1789400558.02 total 20.03 last 16.97)
 - mkdir 498 (time 1789400568.05 total 30.06 last 17.45)
 - mkdir 650 (time 1789400578.06 total 40.07 last 15.19)
 - mkdir 815 (time 1789400588.09 total 50.10 last 16.45)
 - mkdir 946 (time 1789400598.15 total 60.16 last 13.03)
total: 1000 mkdir in 67.41 seconds: 14.83 ops/second
 - mkdir 151 (time 1789400547.46 total 10.07 last 15.00)
 - mkdir 327 (time 1789400557.51 total 20.12 last 17.51)
 - mkdir 501 (time 1789400567.52 total 30.13 last 17.37)
 - mkdir 653 (time 1789400577.59 total 40.21 last 15.09)
 - mkdir 807 (time 1789400587.65 total 50.26 last 15.32)
 - mkdir 945 (time 1789400597.68 total 60.29 last 13.76)
total: 1000 mkdir in 68.21 seconds: 14.66 ops/second
 - mkdir 157 (time 1789400548.59 total 10.11 last 15.52)
 - mkdir 335 (time 1789400558.63 total 20.15 last 17.73)
 - mkdir 513 (time 1789400568.64 total 30.16 last 17.78)
 - mkdir 666 (time 1789400578.65 total 40.17 last 15.29)
 - mkdir 820 (time 1789400588.66 total 50.18 last 15.38)
 - mkdir 947 (time 1789400598.79 total 60.31 last 12.54)
total: 1000 mkdir in 67.49 seconds: 14.82 ops/second
 - mkdir 152 (time 1789400548.82 total 10.00 last 15.20)
 - mkdir 321 (time 1789400558.85 total 20.03 last 16.86)
 - mkdir 489 (time 1789400568.93 total 30.11 last 16.66)
 - mkdir 647 (time 1789400578.98 total 40.17 last 15.72)
 - mkdir 806 (time 1789400589.02 total 50.20 last 15.85)
 - mkdir 928 (time 1789400599.12 total 60.30 last 12.08)
total: 1000 mkdir in 70.06 seconds: 14.27 ops/second
Time for file creation 81 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789400619 ; total 1 ; last 1)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1789400619 ; total 1 ; last 1)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789400619 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789400620 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1789400620 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789400621 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1789400621 ; total 1 ; last 1)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1789400621 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1789400621 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1789400621 ; total 0 ; last 0)
total: 1000 unlinks in 41 seconds: 24.390244 unlinks/second
Time for file removal 55 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8