== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 19:14:16 (1787872456)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.44 seconds: 22.75 ops/second
 - mkdir 161 (time 1787872476.40 total 10.03 last 16.05)
 - mkdir 292 (time 1787872486.49 total 20.13 last 12.98)
 - mkdir 441 (time 1787872496.54 total 30.17 last 14.83)
 - mkdir 579 (time 1787872506.58 total 40.22 last 13.74)
 - mkdir 706 (time 1787872516.60 total 50.24 last 12.67)
 - mkdir 856 (time 1787872526.61 total 60.24 last 15.00)
 - mkdir 997 (time 1787872536.61 total 70.24 last 14.10)
total: 1000 mkdir in 70.31 seconds: 14.22 ops/second
 - mkdir 158 (time 1787872480.06 total 10.05 last 15.72)
 - mkdir 297 (time 1787872490.11 total 20.10 last 13.83)
 - mkdir 450 (time 1787872500.18 total 30.18 last 15.18)
 - mkdir 593 (time 1787872510.35 total 40.34 last 14.07)
 - mkdir 730 (time 1787872520.35 total 50.34 last 13.69)
 - mkdir 882 (time 1787872530.38 total 60.37 last 15.16)
total: 1000 mkdir in 70.03 seconds: 14.28 ops/second
 - mkdir 164 (time 1787872479.30 total 10.02 last 16.37)
 - mkdir 300 (time 1787872489.34 total 20.05 last 13.56)
 - mkdir 446 (time 1787872499.42 total 30.13 last 14.48)
 - mkdir 591 (time 1787872509.47 total 40.19 last 14.42)
 - mkdir 724 (time 1787872519.51 total 50.22 last 13.26)
 - mkdir 875 (time 1787872529.52 total 60.23 last 15.08)
 - mkdir 995 (time 1787872539.53 total 70.25 last 11.99)
total: 1000 mkdir in 70.78 seconds: 14.13 ops/second
 - mkdir 160 (time 1787872479.78 total 10.01 last 15.99)
 - mkdir 297 (time 1787872489.79 total 20.02 last 13.68)
 - mkdir 448 (time 1787872499.86 total 30.08 last 15.01)
 - mkdir 588 (time 1787872509.88 total 40.10 last 13.97)
 - mkdir 723 (time 1787872519.91 total 50.13 last 13.46)
 - mkdir 872 (time 1787872529.92 total 60.15 last 14.88)
 - mkdir 992 (time 1787872540.03 total 70.25 last 11.88)
total: 1000 mkdir in 71.31 seconds: 14.02 ops/second
 - mkdir 157 (time 1787872479.41 total 10.02 last 15.67)
 - mkdir 291 (time 1787872489.47 total 20.08 last 13.32)
 - mkdir 444 (time 1787872499.52 total 30.13 last 15.22)
 - mkdir 580 (time 1787872509.58 total 40.19 last 13.52)
 - mkdir 710 (time 1787872519.62 total 50.22 last 12.96)
 - mkdir 861 (time 1787872529.62 total 60.22 last 15.10)
 - mkdir 984 (time 1787872539.67 total 70.28 last 12.23)
total: 1000 mkdir in 72.65 seconds: 13.76 ops/second
 - mkdir 159 (time 1787872479.57 total 10.07 last 15.79)
 - mkdir 289 (time 1787872489.57 total 20.07 last 13.00)
 - mkdir 436 (time 1787872499.62 total 30.12 last 14.63)
 - mkdir 578 (time 1787872509.63 total 40.13 last 14.18)
 - mkdir 709 (time 1787872519.66 total 50.16 last 13.07)
 - mkdir 862 (time 1787872529.70 total 60.20 last 15.24)
 - mkdir 984 (time 1787872539.72 total 70.23 last 12.17)
total: 1000 mkdir in 72.72 seconds: 13.75 ops/second
 - mkdir 157 (time 1787872480.18 total 10.01 last 15.68)
 - mkdir 295 (time 1787872490.21 total 20.04 last 13.76)
 - mkdir 438 (time 1787872500.32 total 30.15 last 14.15)
 - mkdir 582 (time 1787872510.34 total 40.17 last 14.37)
 - mkdir 716 (time 1787872520.35 total 50.18 last 13.39)
 - mkdir 864 (time 1787872530.38 total 60.21 last 14.76)
 - mkdir 980 (time 1787872540.44 total 70.27 last 11.52)
total: 1000 mkdir in 73.59 seconds: 13.59 ops/second
 - mkdir 157 (time 1787872479.75 total 10.04 last 15.64)
 - mkdir 287 (time 1787872489.77 total 20.06 last 12.97)
 - mkdir 434 (time 1787872499.82 total 30.11 last 14.63)
 - mkdir 574 (time 1787872509.85 total 40.14 last 13.96)
 - mkdir 708 (time 1787872519.87 total 50.16 last 13.37)
 - mkdir 856 (time 1787872529.90 total 60.19 last 14.76)
 - mkdir 973 (time 1787872540.04 total 70.33 last 11.54)
total: 1000 mkdir in 74.81 seconds: 13.37 ops/second
 - mkdir 155 (time 1787872480.07 total 10.09 last 15.36)
 - mkdir 283 (time 1787872490.10 total 20.12 last 12.76)
 - mkdir 427 (time 1787872500.21 total 30.22 last 14.26)
 - mkdir 568 (time 1787872510.21 total 40.23 last 14.09)
 - mkdir 704 (time 1787872520.22 total 50.23 last 13.60)
 - mkdir 849 (time 1787872530.22 total 60.24 last 14.49)
 - mkdir 967 (time 1787872540.24 total 70.26 last 11.78)
total: 1000 mkdir in 75.19 seconds: 13.30 ops/second
 - mkdir 149 (time 1787872479.60 total 10.01 last 14.88)
 - mkdir 274 (time 1787872489.63 total 20.04 last 12.47)
 - mkdir 412 (time 1787872499.70 total 30.11 last 13.70)
 - mkdir 550 (time 1787872509.72 total 40.13 last 13.78)
 - mkdir 686 (time 1787872519.76 total 50.17 last 13.54)
 - mkdir 839 (time 1787872529.83 total 60.24 last 15.20)
 - mkdir 961 (time 1787872539.91 total 70.32 last 12.10)
total: 1000 mkdir in 76.02 seconds: 13.15 ops/second
Time for file creation 87 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.56 seconds: 17.99 ops/second
 - mkdir 186 (time 1787873071.03 total 10.06 last 18.50)
 - mkdir 363 (time 1787873081.11 total 20.13 last 17.56)
 - mkdir 518 (time 1787873091.16 total 30.19 last 15.42)
 - mkdir 674 (time 1787873101.23 total 40.25 last 15.50)
 - mkdir 851 (time 1787873111.24 total 50.26 last 17.68)
 - mkdir 990 (time 1787873121.28 total 60.30 last 13.84)
total: 1000 mkdir in 61.26 seconds: 16.32 ops/second
 - mkdir 197 (time 1787873072.16 total 10.10 last 19.50)
 - mkdir 373 (time 1787873082.21 total 20.15 last 17.51)
 - mkdir 536 (time 1787873092.23 total 30.17 last 16.27)
 - mkdir 683 (time 1787873102.26 total 40.20 last 14.66)
 - mkdir 859 (time 1787873112.30 total 50.24 last 17.53)
 - mkdir 996 (time 1787873122.31 total 60.26 last 13.68)
total: 1000 mkdir in 60.52 seconds: 16.52 ops/second
 - mkdir 177 (time 1787873070.16 total 10.04 last 17.62)
 - mkdir 349 (time 1787873080.18 total 20.07 last 17.16)
 - mkdir 495 (time 1787873090.23 total 30.12 last 14.53)
 - mkdir 653 (time 1787873100.25 total 40.14 last 15.77)
 - mkdir 829 (time 1787873110.28 total 50.16 last 17.56)
 - mkdir 974 (time 1787873120.33 total 60.21 last 14.42)
total: 1000 mkdir in 62.56 seconds: 15.98 ops/second
 - mkdir 190 (time 1787873071.69 total 10.02 last 18.97)
 - mkdir 359 (time 1787873081.74 total 20.07 last 16.81)
 - mkdir 517 (time 1787873091.77 total 30.10 last 15.76)
 - mkdir 670 (time 1787873101.78 total 40.11 last 15.28)
 - mkdir 848 (time 1787873111.85 total 50.17 last 17.68)
 - mkdir 986 (time 1787873121.85 total 60.17 last 13.80)
total: 1000 mkdir in 61.56 seconds: 16.25 ops/second
 - mkdir 188 (time 1787873071.12 total 10.01 last 18.78)
 - mkdir 358 (time 1787873081.18 total 20.07 last 16.90)
 - mkdir 510 (time 1787873091.23 total 30.12 last 15.12)
 - mkdir 671 (time 1787873101.26 total 40.15 last 16.06)
 - mkdir 844 (time 1787873111.30 total 50.19 last 17.22)
 - mkdir 982 (time 1787873121.35 total 60.24 last 13.73)
total: 1000 mkdir in 62.14 seconds: 16.09 ops/second
 - mkdir 182 (time 1787873071.34 total 10.05 last 18.10)
 - mkdir 353 (time 1787873081.41 total 20.12 last 16.99)
 - mkdir 506 (time 1787873091.43 total 30.15 last 15.26)
 - mkdir 656 (time 1787873101.51 total 40.22 last 14.89)
 - mkdir 837 (time 1787873111.54 total 50.25 last 18.05)
 - mkdir 977 (time 1787873121.55 total 60.27 last 13.98)
total: 1000 mkdir in 62.83 seconds: 15.92 ops/second
 - mkdir 188 (time 1787873072.33 total 10.04 last 18.72)
 - mkdir 355 (time 1787873082.41 total 20.12 last 16.57)
 - mkdir 520 (time 1787873092.41 total 30.12 last 16.50)
 - mkdir 668 (time 1787873102.47 total 40.18 last 14.72)
 - mkdir 846 (time 1787873112.52 total 50.23 last 17.70)
 - mkdir 981 (time 1787873122.53 total 60.25 last 13.48)
total: 1000 mkdir in 62.43 seconds: 16.02 ops/second
 - mkdir 191 (time 1787873072.52 total 10.13 last 18.86)
 - mkdir 359 (time 1787873082.57 total 20.18 last 16.72)
 - mkdir 522 (time 1787873092.57 total 30.18 last 16.30)
 - mkdir 670 (time 1787873102.59 total 40.20 last 14.77)
 - mkdir 838 (time 1787873112.59 total 50.20 last 16.80)
 - mkdir 974 (time 1787873122.61 total 60.22 last 13.57)
total: 1000 mkdir in 63.25 seconds: 15.81 ops/second
 - mkdir 182 (time 1787873072.05 total 10.11 last 18.01)
 - mkdir 351 (time 1787873082.09 total 20.15 last 16.83)
 - mkdir 501 (time 1787873092.10 total 30.16 last 14.98)
 - mkdir 647 (time 1787873102.16 total 40.21 last 14.52)
 - mkdir 823 (time 1787873112.18 total 50.24 last 17.56)
 - mkdir 962 (time 1787873122.21 total 60.27 last 13.85)
total: 1000 mkdir in 64.53 seconds: 15.50 ops/second
 - mkdir 172 (time 1787873071.49 total 10.00 last 17.19)
 - mkdir 335 (time 1787873081.61 total 20.13 last 16.10)
 - mkdir 477 (time 1787873091.62 total 30.13 last 14.19)
 - mkdir 629 (time 1787873101.63 total 40.15 last 15.18)
 - mkdir 809 (time 1787873111.63 total 50.15 last 18.00)
 - mkdir 949 (time 1787873121.64 total 60.15 last 14.00)
total: 1000 mkdir in 65.67 seconds: 15.23 ops/second
Time for file creation 78 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787873136 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873137 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787873137 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873137 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873138 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873138 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873138 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873138 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873138 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787873139 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8