== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 12:02:25 (1789142545)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.46 seconds: 21.61 ops/second
 - mkdir 164 (time 1789142565.51 total 10.05 last 16.32)
 - mkdir 335 (time 1789142575.59 total 20.13 last 16.96)
 - mkdir 508 (time 1789142585.67 total 30.21 last 17.18)
 - mkdir 669 (time 1789142595.67 total 40.21 last 16.09)
 - mkdir 828 (time 1789142605.69 total 50.23 last 15.86)
total: 1000 mkdir in 59.24 seconds: 16.88 ops/second
 - mkdir 163 (time 1789142564.00 total 10.01 last 16.29)
 - mkdir 320 (time 1789142574.04 total 20.05 last 15.63)
 - mkdir 478 (time 1789142584.09 total 30.10 last 15.72)
 - mkdir 626 (time 1789142594.09 total 40.10 last 14.79)
 - mkdir 792 (time 1789142604.13 total 50.14 last 16.55)
 - mkdir 978 (time 1789142614.16 total 60.17 last 18.54)
total: 1000 mkdir in 61.42 seconds: 16.28 ops/second
 - mkdir 168 (time 1789142567.25 total 10.08 last 16.67)
 - mkdir 347 (time 1789142577.29 total 20.12 last 17.83)
 - mkdir 508 (time 1789142587.32 total 30.15 last 16.05)
 - mkdir 676 (time 1789142597.33 total 40.16 last 16.78)
 - mkdir 838 (time 1789142607.34 total 50.17 last 16.18)
total: 1000 mkdir in 59.03 seconds: 16.94 ops/second
 - mkdir 163 (time 1789142566.09 total 10.04 last 16.23)
 - mkdir 328 (time 1789142576.12 total 20.06 last 16.46)
 - mkdir 492 (time 1789142586.20 total 30.15 last 16.27)
 - mkdir 655 (time 1789142596.20 total 40.15 last 16.29)
 - mkdir 813 (time 1789142606.26 total 50.21 last 15.71)
 - mkdir 995 (time 1789142616.31 total 60.26 last 18.11)
total: 1000 mkdir in 60.58 seconds: 16.51 ops/second
 - mkdir 160 (time 1789142567.02 total 10.01 last 15.98)
 - mkdir 335 (time 1789142577.04 total 20.03 last 17.46)
 - mkdir 495 (time 1789142587.12 total 30.10 last 15.89)
 - mkdir 665 (time 1789142597.18 total 40.16 last 16.90)
 - mkdir 824 (time 1789142607.20 total 50.19 last 15.87)
total: 1000 mkdir in 59.84 seconds: 16.71 ops/second
 - mkdir 167 (time 1789142567.40 total 10.03 last 16.65)
 - mkdir 341 (time 1789142577.43 total 20.06 last 17.34)
 - mkdir 506 (time 1789142587.49 total 30.12 last 16.40)
 - mkdir 675 (time 1789142597.55 total 40.17 last 16.81)
 - mkdir 834 (time 1789142607.56 total 50.19 last 15.87)
total: 1000 mkdir in 60.00 seconds: 16.67 ops/second
 - mkdir 160 (time 1789142566.58 total 10.03 last 15.95)
 - mkdir 334 (time 1789142576.63 total 20.08 last 17.32)
 - mkdir 494 (time 1789142586.64 total 30.09 last 15.99)
 - mkdir 660 (time 1789142596.68 total 40.13 last 16.54)
 - mkdir 818 (time 1789142606.69 total 50.14 last 15.78)
 - mkdir 992 (time 1789142616.71 total 60.16 last 17.37)
total: 1000 mkdir in 60.90 seconds: 16.42 ops/second
 - mkdir 161 (time 1789142566.75 total 10.02 last 16.07)
 - mkdir 330 (time 1789142576.81 total 20.09 last 16.78)
 - mkdir 491 (time 1789142586.92 total 30.19 last 15.94)
 - mkdir 661 (time 1789142596.94 total 40.22 last 16.96)
 - mkdir 814 (time 1789142607.00 total 50.27 last 15.21)
 - mkdir 991 (time 1789142617.09 total 60.36 last 17.54)
total: 1000 mkdir in 61.34 seconds: 16.30 ops/second
 - mkdir 160 (time 1789142567.34 total 10.01 last 15.98)
 - mkdir 333 (time 1789142577.40 total 20.06 last 17.21)
 - mkdir 493 (time 1789142587.40 total 30.07 last 15.99)
 - mkdir 663 (time 1789142597.43 total 40.10 last 16.95)
 - mkdir 821 (time 1789142607.43 total 50.10 last 15.80)
 - mkdir 988 (time 1789142617.47 total 60.14 last 16.64)
total: 1000 mkdir in 61.45 seconds: 16.27 ops/second
 - mkdir 159 (time 1789142566.78 total 10.08 last 15.77)
 - mkdir 328 (time 1789142576.79 total 20.09 last 16.89)
 - mkdir 485 (time 1789142586.79 total 30.09 last 15.70)
 - mkdir 646 (time 1789142596.83 total 40.13 last 16.04)
 - mkdir 802 (time 1789142606.91 total 50.20 last 15.48)
 - mkdir 978 (time 1789142617.01 total 60.30 last 17.43)
total: 1000 mkdir in 62.46 seconds: 16.01 ops/second
Time for file creation 71 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.57 seconds: 17.68 ops/second
 - mkdir 142 (time 1789143114.14 total 10.01 last 14.19)
 - mkdir 304 (time 1789143124.17 total 20.04 last 16.15)
 - mkdir 455 (time 1789143134.20 total 30.07 last 15.06)
 - mkdir 634 (time 1789143144.27 total 40.14 last 17.78)
 - mkdir 803 (time 1789143154.33 total 50.20 last 16.79)
 - mkdir 978 (time 1789143164.35 total 60.22 last 17.47)
total: 1000 mkdir in 61.88 seconds: 16.16 ops/second
 - mkdir 149 (time 1789143115.44 total 10.02 last 14.87)
 - mkdir 322 (time 1789143125.48 total 20.06 last 17.24)
 - mkdir 476 (time 1789143135.55 total 30.13 last 15.28)
 - mkdir 654 (time 1789143145.69 total 40.27 last 17.55)
 - mkdir 821 (time 1789143155.73 total 50.31 last 16.63)
 - mkdir 993 (time 1789143165.74 total 60.32 last 17.20)
total: 1000 mkdir in 60.88 seconds: 16.43 ops/second
 - mkdir 146 (time 1789143115.44 total 10.01 last 14.58)
 - mkdir 313 (time 1789143125.46 total 20.03 last 16.66)
 - mkdir 463 (time 1789143135.52 total 30.09 last 14.92)
 - mkdir 642 (time 1789143145.55 total 40.12 last 17.84)
 - mkdir 807 (time 1789143155.62 total 50.19 last 16.39)
 - mkdir 983 (time 1789143165.63 total 60.19 last 17.58)
total: 1000 mkdir in 61.74 seconds: 16.20 ops/second
 - mkdir 149 (time 1789143115.31 total 10.09 last 14.76)
 - mkdir 311 (time 1789143125.38 total 20.16 last 16.09)
 - mkdir 461 (time 1789143135.49 total 30.27 last 14.83)
 - mkdir 642 (time 1789143145.56 total 40.34 last 17.97)
 - mkdir 812 (time 1789143155.62 total 50.41 last 16.89)
 - mkdir 984 (time 1789143165.70 total 60.49 last 17.06)
total: 1000 mkdir in 61.98 seconds: 16.13 ops/second
 - mkdir 139 (time 1789143114.46 total 10.04 last 13.85)
 - mkdir 304 (time 1789143124.52 total 20.10 last 16.40)
 - mkdir 452 (time 1789143134.55 total 30.12 last 14.76)
 - mkdir 627 (time 1789143144.59 total 40.17 last 17.42)
 - mkdir 792 (time 1789143154.60 total 50.17 last 16.49)
 - mkdir 969 (time 1789143164.63 total 60.20 last 17.65)
total: 1000 mkdir in 62.79 seconds: 15.93 ops/second
 - mkdir 143 (time 1789143115.66 total 10.06 last 14.22)
 - mkdir 313 (time 1789143125.69 total 20.09 last 16.94)
 - mkdir 457 (time 1789143135.78 total 30.18 last 14.28)
 - mkdir 636 (time 1789143145.81 total 40.21 last 17.85)
 - mkdir 802 (time 1789143155.81 total 50.21 last 16.60)
 - mkdir 979 (time 1789143165.84 total 60.24 last 17.65)
total: 1000 mkdir in 62.26 seconds: 16.06 ops/second
 - mkdir 142 (time 1789143115.32 total 10.04 last 14.14)
 - mkdir 307 (time 1789143125.36 total 20.08 last 16.44)
 - mkdir 457 (time 1789143135.38 total 30.10 last 14.97)
 - mkdir 632 (time 1789143145.40 total 40.12 last 17.47)
 - mkdir 796 (time 1789143155.49 total 50.21 last 16.26)
 - mkdir 973 (time 1789143165.49 total 60.22 last 17.69)
total: 1000 mkdir in 62.65 seconds: 15.96 ops/second
 - mkdir 132 (time 1789143114.21 total 10.06 last 13.12)
 - mkdir 293 (time 1789143124.23 total 20.08 last 16.06)
 - mkdir 442 (time 1789143134.24 total 30.09 last 14.89)
 - mkdir 615 (time 1789143144.25 total 40.10 last 17.28)
 - mkdir 778 (time 1789143154.26 total 50.11 last 16.29)
 - mkdir 955 (time 1789143164.27 total 60.12 last 17.67)
total: 1000 mkdir in 63.88 seconds: 15.65 ops/second
 - mkdir 132 (time 1789143114.21 total 10.04 last 13.14)
 - mkdir 293 (time 1789143124.25 total 20.08 last 16.04)
 - mkdir 436 (time 1789143134.27 total 30.10 last 14.28)
 - mkdir 611 (time 1789143144.27 total 40.10 last 17.49)
 - mkdir 775 (time 1789143154.35 total 50.18 last 16.27)
 - mkdir 953 (time 1789143164.36 total 60.19 last 17.79)
total: 1000 mkdir in 64.06 seconds: 15.61 ops/second
 - mkdir 132 (time 1789143114.60 total 10.05 last 13.14)
 - mkdir 286 (time 1789143124.64 total 20.09 last 15.33)
 - mkdir 431 (time 1789143134.70 total 30.15 last 14.41)
 - mkdir 605 (time 1789143144.77 total 40.22 last 17.27)
 - mkdir 773 (time 1789143154.80 total 50.25 last 16.75)
 - mkdir 952 (time 1789143164.91 total 60.36 last 17.70)
total: 1000 mkdir in 64.28 seconds: 15.56 ops/second
Time for file creation 76 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789143176 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789143178 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789143178 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789143178 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789143179 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789143179 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789143179 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789143179 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789143179 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789143179 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8