== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 21:42:53 (1790732573)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.46 seconds: 21.51 ops/second
 - mkdir 146 (time 1790732595.59 total 10.04 last 14.55)
 - mkdir 311 (time 1790732605.60 total 20.04 last 16.49)
 - mkdir 473 (time 1790732615.69 total 30.14 last 16.05)
 - mkdir 620 (time 1790732625.71 total 40.15 last 14.67)
 - mkdir 769 (time 1790732635.71 total 50.16 last 14.89)
 - mkdir 942 (time 1790732645.72 total 60.16 last 17.29)
total: 1000 mkdir in 64.59 seconds: 15.48 ops/second
 - mkdir 151 (time 1790732595.94 total 10.01 last 15.08)
 - mkdir 323 (time 1790732606.03 total 20.10 last 17.05)
 - mkdir 481 (time 1790732616.04 total 30.11 last 15.79)
 - mkdir 623 (time 1790732626.04 total 40.11 last 14.19)
 - mkdir 779 (time 1790732636.10 total 50.17 last 15.52)
 - mkdir 943 (time 1790732646.10 total 60.17 last 16.39)
total: 1000 mkdir in 64.45 seconds: 15.52 ops/second
 - mkdir 144 (time 1790732594.44 total 10.04 last 14.34)
 - mkdir 304 (time 1790732604.48 total 20.08 last 15.94)
 - mkdir 467 (time 1790732614.60 total 30.21 last 16.10)
 - mkdir 608 (time 1790732624.63 total 40.23 last 14.07)
 - mkdir 760 (time 1790732634.69 total 50.30 last 15.10)
 - mkdir 922 (time 1790732644.73 total 60.33 last 16.14)
total: 1000 mkdir in 66.53 seconds: 15.03 ops/second
 - mkdir 144 (time 1790732595.17 total 10.03 last 14.35)
 - mkdir 304 (time 1790732605.24 total 20.10 last 15.89)
 - mkdir 467 (time 1790732615.28 total 30.14 last 16.23)
 - mkdir 619 (time 1790732625.40 total 40.27 last 15.02)
 - mkdir 762 (time 1790732635.47 total 50.33 last 14.20)
 - mkdir 929 (time 1790732645.50 total 60.36 last 16.65)
total: 1000 mkdir in 65.95 seconds: 15.16 ops/second
 - mkdir 150 (time 1790732596.07 total 10.00 last 15.00)
 - mkdir 319 (time 1790732606.08 total 20.01 last 16.89)
 - mkdir 479 (time 1790732616.09 total 30.02 last 15.98)
 - mkdir 622 (time 1790732626.12 total 40.05 last 14.26)
 - mkdir 770 (time 1790732636.17 total 50.10 last 14.73)
 - mkdir 933 (time 1790732646.21 total 60.14 last 16.23)
total: 1000 mkdir in 65.53 seconds: 15.26 ops/second
 - mkdir 139 (time 1790732595.59 total 10.01 last 13.89)
 - mkdir 302 (time 1790732605.60 total 20.01 last 16.29)
 - mkdir 460 (time 1790732615.68 total 30.10 last 15.67)
 - mkdir 605 (time 1790732625.70 total 40.12 last 14.47)
 - mkdir 756 (time 1790732635.72 total 50.14 last 15.07)
 - mkdir 920 (time 1790732645.79 total 60.21 last 16.28)
total: 1000 mkdir in 66.89 seconds: 14.95 ops/second
 - mkdir 153 (time 1790732596.42 total 10.00 last 15.29)
 - mkdir 322 (time 1790732606.42 total 20.00 last 16.90)
 - mkdir 475 (time 1790732616.47 total 30.05 last 15.23)
 - mkdir 620 (time 1790732626.57 total 40.15 last 14.36)
 - mkdir 771 (time 1790732636.60 total 50.18 last 15.06)
 - mkdir 933 (time 1790732646.64 total 60.22 last 16.14)
total: 1000 mkdir in 66.27 seconds: 15.09 ops/second
 - mkdir 148 (time 1790732596.22 total 10.04 last 14.74)
 - mkdir 316 (time 1790732606.26 total 20.08 last 16.73)
 - mkdir 467 (time 1790732616.26 total 30.09 last 15.09)
 - mkdir 607 (time 1790732626.41 total 40.23 last 13.80)
 - mkdir 758 (time 1790732636.45 total 50.27 last 15.04)
 - mkdir 923 (time 1790732646.49 total 60.31 last 16.43)
total: 1000 mkdir in 67.38 seconds: 14.84 ops/second
 - mkdir 137 (time 1790732595.07 total 10.05 last 13.63)
 - mkdir 289 (time 1790732605.09 total 20.07 last 15.17)
 - mkdir 451 (time 1790732615.22 total 30.20 last 15.99)
 - mkdir 593 (time 1790732625.27 total 40.26 last 14.12)
 - mkdir 736 (time 1790732635.31 total 50.30 last 14.25)
 - mkdir 905 (time 1790732645.38 total 60.37 last 16.78)
total: 1000 mkdir in 69.16 seconds: 14.46 ops/second
 - mkdir 133 (time 1790732595.59 total 10.07 last 13.21)
 - mkdir 290 (time 1790732605.59 total 20.07 last 15.70)
 - mkdir 435 (time 1790732615.60 total 30.08 last 14.48)
 - mkdir 566 (time 1790732625.65 total 40.13 last 13.04)
 - mkdir 708 (time 1790732635.67 total 50.15 last 14.18)
 - mkdir 863 (time 1790732645.69 total 60.17 last 15.47)
 - mkdir 968 (time 1790732655.79 total 70.27 last 10.39)
total: 1000 mkdir in 71.86 seconds: 13.92 ops/second
Time for file creation 81 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
Time for file removal 18 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.56 seconds: 17.79 ops/second
 - mkdir 142 (time 1790733191.13 total 10.04 last 14.14)
 - mkdir 301 (time 1790733201.20 total 20.11 last 15.79)
 - mkdir 456 (time 1790733211.25 total 30.17 last 15.42)
 - mkdir 607 (time 1790733221.26 total 40.18 last 15.08)
 - mkdir 773 (time 1790733231.31 total 50.22 last 16.53)
 - mkdir 931 (time 1790733241.32 total 60.23 last 15.79)
total: 1000 mkdir in 63.90 seconds: 15.65 ops/second
 - mkdir 150 (time 1790733191.12 total 10.04 last 14.93)
 - mkdir 301 (time 1790733201.19 total 20.11 last 15.00)
 - mkdir 454 (time 1790733211.30 total 30.22 last 15.13)
 - mkdir 601 (time 1790733221.33 total 40.25 last 14.67)
 - mkdir 766 (time 1790733231.36 total 50.28 last 16.44)
 - mkdir 922 (time 1790733241.37 total 60.30 last 15.58)
total: 1000 mkdir in 64.34 seconds: 15.54 ops/second
 - mkdir 135 (time 1790733190.07 total 10.04 last 13.44)
 - mkdir 291 (time 1790733200.17 total 20.15 last 15.44)
 - mkdir 427 (time 1790733210.19 total 30.16 last 13.58)
 - mkdir 579 (time 1790733220.21 total 40.19 last 15.16)
 - mkdir 747 (time 1790733230.23 total 50.20 last 16.77)
 - mkdir 906 (time 1790733240.29 total 60.26 last 15.80)
total: 1000 mkdir in 65.42 seconds: 15.29 ops/second
 - mkdir 132 (time 1790733189.75 total 10.05 last 13.13)
 - mkdir 289 (time 1790733199.76 total 20.06 last 15.69)
 - mkdir 433 (time 1790733209.78 total 30.08 last 14.38)
 - mkdir 585 (time 1790733219.79 total 40.09 last 15.19)
 - mkdir 750 (time 1790733229.90 total 50.20 last 16.31)
 - mkdir 899 (time 1790733239.91 total 60.21 last 14.89)
total: 1000 mkdir in 65.83 seconds: 15.19 ops/second
 - mkdir 148 (time 1790733191.66 total 10.06 last 14.71)
 - mkdir 304 (time 1790733201.67 total 20.07 last 15.58)
 - mkdir 452 (time 1790733211.74 total 30.15 last 14.70)
 - mkdir 604 (time 1790733221.79 total 40.20 last 15.12)
 - mkdir 765 (time 1790733231.80 total 50.20 last 16.09)
 - mkdir 919 (time 1790733241.87 total 60.27 last 15.29)
total: 1000 mkdir in 64.89 seconds: 15.41 ops/second
 - mkdir 151 (time 1790733191.65 total 10.00 last 15.10)
 - mkdir 299 (time 1790733201.69 total 20.04 last 14.75)
 - mkdir 452 (time 1790733211.74 total 30.09 last 15.23)
 - mkdir 601 (time 1790733221.80 total 40.14 last 14.82)
 - mkdir 760 (time 1790733231.84 total 50.18 last 15.84)
 - mkdir 918 (time 1790733241.88 total 60.23 last 15.73)
total: 1000 mkdir in 65.02 seconds: 15.38 ops/second
 - mkdir 139 (time 1790733190.57 total 10.02 last 13.87)
 - mkdir 292 (time 1790733200.61 total 20.06 last 15.24)
 - mkdir 436 (time 1790733210.62 total 30.07 last 14.39)
 - mkdir 584 (time 1790733220.62 total 40.07 last 14.79)
 - mkdir 746 (time 1790733230.67 total 50.12 last 16.13)
 - mkdir 896 (time 1790733240.69 total 60.14 last 14.98)
total: 1000 mkdir in 66.49 seconds: 15.04 ops/second
 - mkdir 145 (time 1790733191.54 total 10.00 last 14.50)
 - mkdir 296 (time 1790733201.60 total 20.06 last 15.01)
 - mkdir 445 (time 1790733211.61 total 30.07 last 14.88)
 - mkdir 595 (time 1790733221.63 total 40.09 last 14.98)
 - mkdir 757 (time 1790733231.66 total 50.11 last 16.15)
 - mkdir 910 (time 1790733241.67 total 60.13 last 15.27)
total: 1000 mkdir in 65.68 seconds: 15.23 ops/second
 - mkdir 124 (time 1790733188.90 total 10.01 last 12.39)
 - mkdir 283 (time 1790733198.99 total 20.10 last 15.76)
 - mkdir 419 (time 1790733209.00 total 30.11 last 13.58)
 - mkdir 563 (time 1790733219.02 total 40.13 last 14.38)
 - mkdir 727 (time 1790733229.12 total 50.23 last 16.23)
 - mkdir 872 (time 1790733239.12 total 60.23 last 14.49)
total: 1000 mkdir in 68.38 seconds: 14.62 ops/second
 - mkdir 141 (time 1790733192.05 total 10.03 last 14.06)
 - mkdir 283 (time 1790733202.06 total 20.04 last 14.18)
 - mkdir 427 (time 1790733212.07 total 30.05 last 14.39)
 - mkdir 574 (time 1790733222.12 total 40.10 last 14.62)
 - mkdir 725 (time 1790733232.14 total 50.12 last 15.07)
 - mkdir 874 (time 1790733242.21 total 60.19 last 14.79)
total: 1000 mkdir in 69.19 seconds: 14.45 ops/second
Time for file creation 82 sec for 1 RPC sent at a time
 - unlinked 0 (time 1790733261 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790733261 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790733262 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790733261 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790733262 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790733262 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1790733262 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790733262 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790733262 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1790733262 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8