== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 15:25:44 (1788549944)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.47 seconds: 21.35 ops/second
 - mkdir 169 (time 1788549964.49 total 10.03 last 16.84)
 - mkdir 341 (time 1788549974.49 total 20.04 last 17.19)
 - mkdir 501 (time 1788549984.51 total 30.06 last 15.97)
 - mkdir 668 (time 1788549994.57 total 40.12 last 16.60)
 - mkdir 821 (time 1788550004.58 total 50.12 last 15.30)
 - mkdir 988 (time 1788550014.60 total 60.15 last 16.66)
total: 1000 mkdir in 60.82 seconds: 16.44 ops/second
 - mkdir 164 (time 1788549966.66 total 10.05 last 16.33)
 - mkdir 338 (time 1788549976.70 total 20.09 last 17.33)
 - mkdir 503 (time 1788549986.73 total 30.12 last 16.45)
 - mkdir 659 (time 1788549996.81 total 40.20 last 15.47)
 - mkdir 820 (time 1788550006.83 total 50.22 last 16.08)
 - mkdir 981 (time 1788550016.88 total 60.27 last 16.01)
total: 1000 mkdir in 62.13 seconds: 16.10 ops/second
 - mkdir 161 (time 1788549965.80 total 10.03 last 16.06)
 - mkdir 335 (time 1788549975.86 total 20.08 last 17.30)
 - mkdir 491 (time 1788549985.91 total 30.13 last 15.53)
 - mkdir 651 (time 1788549995.91 total 40.14 last 15.99)
 - mkdir 798 (time 1788550005.95 total 50.17 last 14.65)
 - mkdir 967 (time 1788550015.98 total 60.20 last 16.84)
total: 1000 mkdir in 63.84 seconds: 15.66 ops/second
 - mkdir 158 (time 1788549966.45 total 10.02 last 15.77)
 - mkdir 331 (time 1788549976.57 total 20.14 last 17.09)
 - mkdir 494 (time 1788549986.60 total 30.16 last 16.26)
 - mkdir 651 (time 1788549996.63 total 40.19 last 15.65)
 - mkdir 806 (time 1788550006.67 total 50.24 last 15.43)
 - mkdir 968 (time 1788550016.77 total 60.33 last 16.04)
total: 1000 mkdir in 63.88 seconds: 15.65 ops/second
 - mkdir 165 (time 1788549967.15 total 10.02 last 16.47)
 - mkdir 336 (time 1788549977.18 total 20.05 last 17.05)
 - mkdir 505 (time 1788549987.27 total 30.13 last 16.76)
 - mkdir 660 (time 1788549997.33 total 40.20 last 15.40)
 - mkdir 818 (time 1788550007.38 total 50.24 last 15.73)
 - mkdir 973 (time 1788550017.48 total 60.34 last 15.35)
total: 1000 mkdir in 63.49 seconds: 15.75 ops/second
 - mkdir 167 (time 1788549966.70 total 10.01 last 16.69)
 - mkdir 343 (time 1788549976.79 total 20.10 last 17.45)
 - mkdir 505 (time 1788549986.81 total 30.11 last 16.17)
 - mkdir 657 (time 1788549996.81 total 40.12 last 15.19)
 - mkdir 812 (time 1788550006.84 total 50.14 last 15.46)
 - mkdir 967 (time 1788550016.86 total 60.16 last 15.47)
total: 1000 mkdir in 64.41 seconds: 15.53 ops/second
 - mkdir 160 (time 1788549966.56 total 10.03 last 15.95)
 - mkdir 337 (time 1788549976.60 total 20.07 last 17.63)
 - mkdir 496 (time 1788549986.66 total 30.13 last 15.80)
 - mkdir 646 (time 1788549996.66 total 40.13 last 15.00)
 - mkdir 795 (time 1788550006.69 total 50.16 last 14.86)
 - mkdir 954 (time 1788550016.76 total 60.23 last 15.78)
total: 1000 mkdir in 65.58 seconds: 15.25 ops/second
 - mkdir 154 (time 1788549966.40 total 10.01 last 15.38)
 - mkdir 325 (time 1788549976.43 total 20.04 last 17.05)
 - mkdir 483 (time 1788549986.43 total 30.05 last 15.79)
 - mkdir 639 (time 1788549996.46 total 40.08 last 15.56)
 - mkdir 792 (time 1788550006.48 total 50.09 last 15.27)
 - mkdir 948 (time 1788550016.55 total 60.16 last 15.50)
total: 1000 mkdir in 66.05 seconds: 15.14 ops/second
 - mkdir 157 (time 1788549966.19 total 10.06 last 15.61)
 - mkdir 327 (time 1788549976.24 total 20.11 last 16.92)
 - mkdir 478 (time 1788549986.27 total 30.14 last 15.06)
 - mkdir 637 (time 1788549996.32 total 40.19 last 15.82)
 - mkdir 788 (time 1788550006.33 total 50.19 last 15.09)
 - mkdir 943 (time 1788550016.41 total 60.28 last 15.37)
total: 1000 mkdir in 66.39 seconds: 15.06 ops/second
 - mkdir 149 (time 1788549965.76 total 10.04 last 14.85)
 - mkdir 316 (time 1788549975.77 total 20.04 last 16.68)
 - mkdir 461 (time 1788549985.82 total 30.10 last 14.42)
 - mkdir 611 (time 1788549995.83 total 40.10 last 14.99)
 - mkdir 758 (time 1788550005.86 total 50.14 last 14.65)
 - mkdir 913 (time 1788550015.86 total 60.14 last 15.50)
total: 1000 mkdir in 68.72 seconds: 14.55 ops/second
Time for file creation 77 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.50 seconds: 19.89 ops/second
 - mkdir 157 (time 1788550563.25 total 10.06 last 15.61)
 - mkdir 311 (time 1788550573.26 total 20.07 last 15.39)
 - mkdir 469 (time 1788550583.29 total 30.10 last 15.75)
 - mkdir 656 (time 1788550593.30 total 40.11 last 18.68)
 - mkdir 791 (time 1788550603.35 total 50.16 last 13.43)
 - mkdir 939 (time 1788550613.40 total 60.21 last 14.73)
total: 1000 mkdir in 64.23 seconds: 15.57 ops/second
 - mkdir 151 (time 1788550564.58 total 10.05 last 15.03)
 - mkdir 306 (time 1788550574.62 total 20.09 last 15.44)
 - mkdir 454 (time 1788550584.71 total 30.17 last 14.68)
 - mkdir 653 (time 1788550594.74 total 40.20 last 19.85)
 - mkdir 793 (time 1788550604.82 total 50.28 last 13.88)
 - mkdir 941 (time 1788550614.86 total 60.33 last 14.74)
total: 1000 mkdir in 64.98 seconds: 15.39 ops/second
 - mkdir 153 (time 1788550563.72 total 10.02 last 15.27)
 - mkdir 305 (time 1788550573.72 total 20.02 last 15.20)
 - mkdir 461 (time 1788550583.72 total 30.02 last 15.60)
 - mkdir 644 (time 1788550593.75 total 40.05 last 18.25)
 - mkdir 777 (time 1788550603.77 total 50.07 last 13.27)
 - mkdir 928 (time 1788550613.77 total 60.07 last 15.10)
total: 1000 mkdir in 66.00 seconds: 15.15 ops/second
 - mkdir 151 (time 1788550563.84 total 10.03 last 15.06)
 - mkdir 306 (time 1788550573.87 total 20.06 last 15.44)
 - mkdir 462 (time 1788550583.95 total 30.14 last 15.48)
 - mkdir 648 (time 1788550593.99 total 40.18 last 18.52)
 - mkdir 788 (time 1788550604.00 total 50.19 last 13.99)
 - mkdir 931 (time 1788550614.05 total 60.24 last 14.23)
total: 1000 mkdir in 65.92 seconds: 15.17 ops/second
 - mkdir 157 (time 1788550564.49 total 10.10 last 15.54)
 - mkdir 314 (time 1788550574.53 total 20.14 last 15.64)
 - mkdir 467 (time 1788550584.56 total 30.17 last 15.25)
 - mkdir 654 (time 1788550594.57 total 40.18 last 18.68)
 - mkdir 790 (time 1788550604.61 total 50.23 last 13.54)
 - mkdir 929 (time 1788550614.66 total 60.27 last 13.84)
total: 1000 mkdir in 66.34 seconds: 15.07 ops/second
 - mkdir 150 (time 1788550563.38 total 10.01 last 14.98)
 - mkdir 298 (time 1788550573.49 total 20.12 last 14.64)
 - mkdir 452 (time 1788550583.54 total 30.18 last 15.32)
 - mkdir 634 (time 1788550593.58 total 40.21 last 18.14)
 - mkdir 771 (time 1788550603.64 total 50.27 last 13.61)
 - mkdir 914 (time 1788550613.68 total 60.31 last 14.24)
total: 1000 mkdir in 67.37 seconds: 14.84 ops/second
 - mkdir 154 (time 1788550564.61 total 10.04 last 15.34)
 - mkdir 305 (time 1788550574.68 total 20.11 last 15.00)
 - mkdir 452 (time 1788550584.70 total 30.13 last 14.66)
 - mkdir 640 (time 1788550594.72 total 40.15 last 18.77)
 - mkdir 779 (time 1788550604.77 total 50.20 last 13.83)
 - mkdir 921 (time 1788550614.82 total 60.25 last 14.13)
total: 1000 mkdir in 66.56 seconds: 15.02 ops/second
 - mkdir 150 (time 1788550564.12 total 10.01 last 14.98)
 - mkdir 298 (time 1788550574.13 total 20.02 last 14.79)
 - mkdir 445 (time 1788550584.13 total 30.02 last 14.70)
 - mkdir 632 (time 1788550594.15 total 40.04 last 18.67)
 - mkdir 767 (time 1788550604.17 total 50.06 last 13.47)
 - mkdir 908 (time 1788550614.25 total 60.14 last 13.99)
total: 1000 mkdir in 67.89 seconds: 14.73 ops/second
 - mkdir 145 (time 1788550564.29 total 10.03 last 14.45)
 - mkdir 295 (time 1788550574.33 total 20.08 last 14.93)
 - mkdir 443 (time 1788550584.50 total 30.24 last 14.56)
 - mkdir 630 (time 1788550594.50 total 40.25 last 18.69)
 - mkdir 765 (time 1788550604.57 total 50.31 last 13.42)
 - mkdir 901 (time 1788550614.65 total 60.39 last 13.49)
total: 1000 mkdir in 69.20 seconds: 14.45 ops/second
 - mkdir 146 (time 1788550564.03 total 10.11 last 14.44)
 - mkdir 285 (time 1788550574.08 total 20.16 last 13.83)
 - mkdir 430 (time 1788550584.15 total 30.23 last 14.41)
 - mkdir 608 (time 1788550594.17 total 40.25 last 17.77)
 - mkdir 744 (time 1788550604.21 total 50.29 last 13.54)
 - mkdir 884 (time 1788550614.26 total 60.34 last 13.93)
 - mkdir 997 (time 1788550624.30 total 70.38 last 11.25)
total: 1000 mkdir in 70.49 seconds: 14.19 ops/second
Time for file creation 80 sec for 1 RPC sent at a time
 - unlinked 0 (time 1788550631 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1788550631 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1788550632 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8