== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 01:13:03 (1789103583)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.65 seconds: 15.28 ops/second
 - mkdir 180 (time 1789103607.40 total 10.00 last 18.00)
 - mkdir 354 (time 1789103617.45 total 20.05 last 17.32)
 - mkdir 542 (time 1789103627.49 total 30.09 last 18.72)
 - mkdir 706 (time 1789103637.50 total 40.10 last 16.38)
 - mkdir 832 (time 1789103647.51 total 50.11 last 12.59)
total: 1000 mkdir in 59.28 seconds: 16.87 ops/second
 - mkdir 181 (time 1789103607.03 total 10.05 last 18.00)
 - mkdir 357 (time 1789103617.13 total 20.15 last 17.43)
 - mkdir 539 (time 1789103627.16 total 30.18 last 18.15)
 - mkdir 697 (time 1789103637.17 total 40.20 last 15.77)
 - mkdir 822 (time 1789103647.17 total 50.20 last 12.50)
 - mkdir 999 (time 1789103657.19 total 60.21 last 17.68)
total: 1000 mkdir in 60.21 seconds: 16.61 ops/second
 - mkdir 159 (time 1789103606.46 total 10.05 last 15.82)
 - mkdir 330 (time 1789103616.48 total 20.08 last 17.05)
 - mkdir 505 (time 1789103626.53 total 30.13 last 17.41)
 - mkdir 666 (time 1789103636.58 total 40.18 last 16.02)
 - mkdir 794 (time 1789103646.62 total 50.22 last 12.75)
 - mkdir 977 (time 1789103656.64 total 60.23 last 18.28)
total: 1000 mkdir in 62.12 seconds: 16.10 ops/second
 - mkdir 184 (time 1789103608.25 total 10.04 last 18.33)
 - mkdir 354 (time 1789103618.29 total 20.08 last 16.94)
 - mkdir 537 (time 1789103628.35 total 30.14 last 18.18)
 - mkdir 697 (time 1789103638.37 total 40.16 last 15.96)
 - mkdir 823 (time 1789103648.39 total 50.17 last 12.58)
 - mkdir 995 (time 1789103658.39 total 60.18 last 17.20)
total: 1000 mkdir in 60.48 seconds: 16.53 ops/second
 - mkdir 181 (time 1789103607.45 total 10.03 last 18.04)
 - mkdir 344 (time 1789103617.46 total 20.04 last 16.28)
 - mkdir 523 (time 1789103627.49 total 30.07 last 17.85)
 - mkdir 684 (time 1789103637.49 total 40.07 last 16.10)
 - mkdir 806 (time 1789103647.51 total 50.09 last 12.18)
 - mkdir 986 (time 1789103657.56 total 60.14 last 17.90)
total: 1000 mkdir in 61.45 seconds: 16.27 ops/second
 - mkdir 149 (time 1789103605.16 total 10.08 last 14.79)
 - mkdir 306 (time 1789103615.17 total 20.09 last 15.68)
 - mkdir 476 (time 1789103625.20 total 30.12 last 16.95)
 - mkdir 649 (time 1789103635.22 total 40.14 last 17.25)
 - mkdir 779 (time 1789103645.25 total 50.17 last 12.96)
 - mkdir 949 (time 1789103655.38 total 60.29 last 16.79)
total: 1000 mkdir in 64.21 seconds: 15.57 ops/second
 - mkdir 173 (time 1789103607.59 total 10.04 last 17.23)
 - mkdir 338 (time 1789103617.61 total 20.07 last 16.46)
 - mkdir 519 (time 1789103627.63 total 30.08 last 18.07)
 - mkdir 680 (time 1789103637.70 total 40.16 last 15.98)
 - mkdir 807 (time 1789103647.72 total 50.18 last 12.68)
 - mkdir 984 (time 1789103657.77 total 60.23 last 17.61)
total: 1000 mkdir in 61.87 seconds: 16.16 ops/second
 - mkdir 184 (time 1789103608.50 total 10.08 last 18.25)
 - mkdir 350 (time 1789103618.51 total 20.09 last 16.59)
 - mkdir 530 (time 1789103628.51 total 30.09 last 17.99)
 - mkdir 693 (time 1789103638.55 total 40.14 last 16.23)
 - mkdir 817 (time 1789103648.57 total 50.15 last 12.38)
 - mkdir 988 (time 1789103658.68 total 60.26 last 16.92)
total: 1000 mkdir in 61.62 seconds: 16.23 ops/second
 - mkdir 175 (time 1789103608.09 total 10.01 last 17.48)
 - mkdir 341 (time 1789103618.15 total 20.07 last 16.51)
 - mkdir 522 (time 1789103628.21 total 30.13 last 18.00)
 - mkdir 683 (time 1789103638.22 total 40.14 last 16.07)
 - mkdir 811 (time 1789103648.25 total 50.18 last 12.76)
 - mkdir 983 (time 1789103658.30 total 60.22 last 17.12)
total: 1000 mkdir in 62.09 seconds: 16.10 ops/second
 - mkdir 171 (time 1789103608.32 total 10.01 last 17.08)
 - mkdir 331 (time 1789103618.35 total 20.04 last 15.95)
 - mkdir 511 (time 1789103628.41 total 30.10 last 17.90)
 - mkdir 672 (time 1789103638.46 total 40.15 last 16.02)
 - mkdir 801 (time 1789103648.46 total 50.16 last 12.89)
 - mkdir 968 (time 1789103658.47 total 60.16 last 16.70)
total: 1000 mkdir in 63.90 seconds: 15.65 ops/second
Time for file creation 77 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 20.20 ops/second
 - mkdir 156 (time 1789104176.58 total 10.05 last 15.53)
 - mkdir 304 (time 1789104186.66 total 20.13 last 14.68)
 - mkdir 468 (time 1789104196.67 total 30.14 last 16.38)
 - mkdir 626 (time 1789104206.69 total 40.16 last 15.77)
 - mkdir 797 (time 1789104216.73 total 50.20 last 17.04)
 - mkdir 960 (time 1789104226.75 total 60.22 last 16.27)
total: 1000 mkdir in 62.60 seconds: 15.97 ops/second
 - mkdir 161 (time 1789104177.37 total 10.05 last 16.03)
 - mkdir 310 (time 1789104187.46 total 20.13 last 14.77)
 - mkdir 483 (time 1789104197.49 total 30.16 last 17.25)
 - mkdir 640 (time 1789104207.50 total 40.17 last 15.68)
 - mkdir 814 (time 1789104217.55 total 50.22 last 17.31)
 - mkdir 976 (time 1789104227.57 total 60.25 last 16.16)
total: 1000 mkdir in 61.96 seconds: 16.14 ops/second
 - mkdir 151 (time 1789104177.27 total 10.09 last 14.97)
 - mkdir 303 (time 1789104187.28 total 20.10 last 15.18)
 - mkdir 471 (time 1789104197.32 total 30.14 last 16.73)
 - mkdir 632 (time 1789104207.37 total 40.19 last 16.03)
 - mkdir 800 (time 1789104217.40 total 50.22 last 16.75)
 - mkdir 964 (time 1789104227.40 total 60.22 last 16.39)
total: 1000 mkdir in 62.72 seconds: 15.94 ops/second
 - mkdir 147 (time 1789104176.25 total 10.02 last 14.67)
 - mkdir 290 (time 1789104186.28 total 20.04 last 14.27)
 - mkdir 446 (time 1789104196.30 total 30.06 last 15.57)
 - mkdir 613 (time 1789104206.32 total 40.09 last 16.65)
 - mkdir 784 (time 1789104216.33 total 50.10 last 17.09)
 - mkdir 945 (time 1789104226.34 total 60.10 last 16.09)
total: 1000 mkdir in 63.68 seconds: 15.70 ops/second
 - mkdir 158 (time 1789104177.69 total 10.01 last 15.78)
 - mkdir 306 (time 1789104187.79 total 20.11 last 14.66)
 - mkdir 471 (time 1789104197.85 total 30.17 last 16.39)
 - mkdir 636 (time 1789104207.90 total 40.22 last 16.43)
 - mkdir 803 (time 1789104217.92 total 50.23 last 16.67)
 - mkdir 972 (time 1789104227.97 total 60.28 last 16.81)
total: 1000 mkdir in 62.51 seconds: 16.00 ops/second
 - mkdir 151 (time 1789104177.04 total 10.04 last 15.04)
 - mkdir 298 (time 1789104187.11 total 20.10 last 14.60)
 - mkdir 462 (time 1789104197.13 total 30.12 last 16.37)
 - mkdir 622 (time 1789104207.18 total 40.17 last 15.92)
 - mkdir 792 (time 1789104217.22 total 50.21 last 16.94)
 - mkdir 960 (time 1789104227.24 total 60.24 last 16.76)
total: 1000 mkdir in 63.25 seconds: 15.81 ops/second
 - mkdir 156 (time 1789104178.37 total 10.01 last 15.59)
 - mkdir 301 (time 1789104188.37 total 20.01 last 14.50)
 - mkdir 470 (time 1789104198.41 total 30.05 last 16.84)
 - mkdir 629 (time 1789104208.41 total 40.05 last 15.90)
 - mkdir 797 (time 1789104218.46 total 50.10 last 16.72)
 - mkdir 966 (time 1789104228.57 total 60.21 last 16.71)
total: 1000 mkdir in 63.51 seconds: 15.75 ops/second
 - mkdir 155 (time 1789104178.40 total 10.07 last 15.39)
 - mkdir 300 (time 1789104188.43 total 20.10 last 14.46)
 - mkdir 465 (time 1789104198.46 total 30.14 last 16.44)
 - mkdir 624 (time 1789104208.48 total 40.15 last 15.88)
 - mkdir 792 (time 1789104218.49 total 50.16 last 16.78)
 - mkdir 960 (time 1789104228.52 total 60.19 last 16.75)
total: 1000 mkdir in 64.20 seconds: 15.58 ops/second
 - mkdir 154 (time 1789104177.89 total 10.05 last 15.32)
 - mkdir 298 (time 1789104188.02 total 20.18 last 14.22)
 - mkdir 462 (time 1789104198.07 total 30.23 last 16.31)
 - mkdir 621 (time 1789104208.09 total 40.25 last 15.88)
 - mkdir 786 (time 1789104218.14 total 50.30 last 16.42)
 - mkdir 951 (time 1789104228.18 total 60.34 last 16.43)
total: 1000 mkdir in 65.11 seconds: 15.36 ops/second
 - mkdir 145 (time 1789104178.01 total 10.03 last 14.45)
 - mkdir 285 (time 1789104188.04 total 20.06 last 13.96)
 - mkdir 439 (time 1789104198.08 total 30.10 last 15.34)
 - mkdir 602 (time 1789104208.11 total 40.13 last 16.25)
 - mkdir 776 (time 1789104218.17 total 50.19 last 17.30)
 - mkdir 945 (time 1789104228.18 total 60.21 last 16.87)
total: 1000 mkdir in 65.59 seconds: 15.25 ops/second
Time for file creation 77 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789104240 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1789104242 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1789104242 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1789104242 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1789104243 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1789104242 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1789104243 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1789104243 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1789104242 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1789104243 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
Time for file removal 49 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8