== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 11:16:14 (1787584574)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.44 seconds: 22.95 ops/second
 - mkdir 167 (time 1787584594.97 total 10.06 last 16.61)
 - mkdir 300 (time 1787584604.99 total 20.07 last 13.28)
 - mkdir 458 (time 1787584615.02 total 30.11 last 15.74)
 - mkdir 628 (time 1787584625.06 total 40.15 last 16.94)
 - mkdir 817 (time 1787584635.09 total 50.18 last 18.84)
total: 1000 mkdir in 60.17 seconds: 16.62 ops/second
 - mkdir 158 (time 1787584596.18 total 10.11 last 15.63)
 - mkdir 295 (time 1787584606.21 total 20.14 last 13.66)
 - mkdir 453 (time 1787584616.22 total 30.14 last 15.80)
 - mkdir 637 (time 1787584626.24 total 40.17 last 18.35)
 - mkdir 822 (time 1787584636.35 total 50.28 last 18.30)
 - mkdir 992 (time 1787584646.38 total 60.31 last 16.94)
total: 1000 mkdir in 61.02 seconds: 16.39 ops/second
 - mkdir 162 (time 1787584595.81 total 10.13 last 16.00)
 - mkdir 296 (time 1787584605.87 total 20.19 last 13.31)
 - mkdir 450 (time 1787584615.91 total 30.23 last 15.34)
 - mkdir 622 (time 1787584625.92 total 40.23 last 17.19)
 - mkdir 809 (time 1787584635.97 total 50.29 last 18.60)
 - mkdir 986 (time 1787584646.01 total 60.33 last 17.63)
total: 1000 mkdir in 61.63 seconds: 16.22 ops/second
 - mkdir 158 (time 1787584594.71 total 10.01 last 15.78)
 - mkdir 282 (time 1787584604.72 total 20.02 last 12.40)
 - mkdir 439 (time 1787584614.76 total 30.06 last 15.63)
 - mkdir 608 (time 1787584624.80 total 40.10 last 16.84)
 - mkdir 795 (time 1787584634.88 total 50.18 last 18.55)
 - mkdir 978 (time 1787584644.91 total 60.21 last 18.25)
total: 1000 mkdir in 62.81 seconds: 15.92 ops/second
 - mkdir 156 (time 1787584595.59 total 10.05 last 15.52)
 - mkdir 289 (time 1787584605.59 total 20.05 last 13.30)
 - mkdir 444 (time 1787584615.67 total 30.13 last 15.38)
 - mkdir 618 (time 1787584625.69 total 40.15 last 17.36)
 - mkdir 803 (time 1787584635.73 total 50.19 last 18.43)
 - mkdir 981 (time 1787584645.77 total 60.23 last 17.73)
total: 1000 mkdir in 62.12 seconds: 16.10 ops/second
 - mkdir 153 (time 1787584596.04 total 10.01 last 15.29)
 - mkdir 283 (time 1787584606.07 total 20.03 last 12.97)
 - mkdir 439 (time 1787584616.09 total 30.06 last 15.56)
 - mkdir 619 (time 1787584626.10 total 40.06 last 17.99)
 - mkdir 804 (time 1787584636.10 total 50.06 last 18.50)
 - mkdir 978 (time 1787584646.22 total 60.19 last 17.19)
total: 1000 mkdir in 62.13 seconds: 16.09 ops/second
 - mkdir 155 (time 1787584596.06 total 10.05 last 15.43)
 - mkdir 288 (time 1787584606.13 total 20.11 last 13.21)
 - mkdir 439 (time 1787584616.16 total 30.15 last 15.05)
 - mkdir 609 (time 1787584626.21 total 40.20 last 16.92)
 - mkdir 800 (time 1787584636.23 total 50.22 last 19.06)
 - mkdir 980 (time 1787584646.35 total 60.34 last 17.78)
total: 1000 mkdir in 62.17 seconds: 16.09 ops/second
 - mkdir 151 (time 1787584595.83 total 10.01 last 15.08)
 - mkdir 283 (time 1787584605.92 total 20.10 last 13.08)
 - mkdir 429 (time 1787584616.04 total 30.22 last 14.44)
 - mkdir 604 (time 1787584626.08 total 40.26 last 17.42)
 - mkdir 786 (time 1787584636.11 total 50.29 last 18.14)
 - mkdir 958 (time 1787584646.14 total 60.32 last 17.15)
total: 1000 mkdir in 64.13 seconds: 15.59 ops/second
 - mkdir 155 (time 1787584594.85 total 10.06 last 15.40)
 - mkdir 279 (time 1787584604.89 total 20.11 last 12.35)
 - mkdir 427 (time 1787584614.93 total 30.14 last 14.75)
 - mkdir 588 (time 1787584624.94 total 40.15 last 16.08)
 - mkdir 767 (time 1787584635.01 total 50.23 last 17.77)
 - mkdir 944 (time 1787584645.02 total 60.23 last 17.69)
total: 1000 mkdir in 65.61 seconds: 15.24 ops/second
 - mkdir 148 (time 1787584596.18 total 10.07 last 14.70)
 - mkdir 278 (time 1787584606.18 total 20.07 last 13.00)
 - mkdir 424 (time 1787584616.22 total 30.11 last 14.54)
 - mkdir 595 (time 1787584626.24 total 40.13 last 17.07)
 - mkdir 776 (time 1787584636.33 total 50.22 last 17.94)
 - mkdir 948 (time 1787584646.54 total 60.42 last 16.85)
total: 1000 mkdir in 64.72 seconds: 15.45 ops/second
Time for file creation 75 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.56 seconds: 17.86 ops/second
 - mkdir 176 (time 1787585167.90 total 10.01 last 17.59)
 - mkdir 360 (time 1787585177.98 total 20.09 last 18.25)
 - mkdir 562 (time 1787585188.01 total 30.11 last 20.16)
 - mkdir 734 (time 1787585198.10 total 40.21 last 17.03)
 - mkdir 907 (time 1787585208.14 total 50.25 last 17.24)
total: 1000 mkdir in 55.33 seconds: 18.07 ops/second
 - mkdir 171 (time 1787585167.15 total 10.09 last 16.95)
 - mkdir 341 (time 1787585177.17 total 20.11 last 16.97)
 - mkdir 544 (time 1787585187.24 total 30.17 last 20.17)
 - mkdir 721 (time 1787585197.25 total 40.18 last 17.68)
 - mkdir 890 (time 1787585207.29 total 50.23 last 16.82)
total: 1000 mkdir in 56.51 seconds: 17.70 ops/second
 - mkdir 165 (time 1787585166.85 total 10.03 last 16.45)
 - mkdir 338 (time 1787585176.90 total 20.08 last 17.21)
 - mkdir 538 (time 1787585186.91 total 30.09 last 19.99)
 - mkdir 707 (time 1787585196.95 total 40.12 last 16.84)
 - mkdir 878 (time 1787585206.97 total 50.15 last 17.06)
total: 1000 mkdir in 57.08 seconds: 17.52 ops/second
 - mkdir 169 (time 1787585167.67 total 10.05 last 16.81)
 - mkdir 346 (time 1787585177.69 total 20.07 last 17.67)
 - mkdir 546 (time 1787585187.70 total 30.08 last 19.98)
 - mkdir 714 (time 1787585197.76 total 40.14 last 16.71)
 - mkdir 887 (time 1787585207.77 total 50.15 last 17.28)
total: 1000 mkdir in 57.12 seconds: 17.51 ops/second
 - mkdir 172 (time 1787585167.62 total 10.01 last 17.19)
 - mkdir 347 (time 1787585177.65 total 20.04 last 17.44)
 - mkdir 549 (time 1787585187.68 total 30.07 last 20.14)
 - mkdir 715 (time 1787585197.68 total 40.07 last 16.60)
 - mkdir 880 (time 1787585207.71 total 50.10 last 16.46)
total: 1000 mkdir in 57.47 seconds: 17.40 ops/second
 - mkdir 166 (time 1787585167.23 total 10.06 last 16.50)
 - mkdir 337 (time 1787585177.24 total 20.07 last 17.09)
 - mkdir 537 (time 1787585187.26 total 30.09 last 19.96)
 - mkdir 707 (time 1787585197.27 total 40.10 last 16.98)
 - mkdir 873 (time 1787585207.28 total 50.11 last 16.58)
total: 1000 mkdir in 57.97 seconds: 17.25 ops/second
 - mkdir 168 (time 1787585168.15 total 10.16 last 16.54)
 - mkdir 342 (time 1787585178.15 total 20.16 last 17.40)
 - mkdir 543 (time 1787585188.18 total 30.19 last 20.04)
 - mkdir 709 (time 1787585198.20 total 40.21 last 16.57)
 - mkdir 881 (time 1787585208.28 total 50.28 last 17.07)
total: 1000 mkdir in 57.64 seconds: 17.35 ops/second
 - mkdir 167 (time 1787585168.42 total 10.05 last 16.62)
 - mkdir 346 (time 1787585178.44 total 20.07 last 17.86)
 - mkdir 546 (time 1787585188.48 total 30.12 last 19.91)
 - mkdir 706 (time 1787585198.52 total 40.16 last 15.94)
 - mkdir 871 (time 1787585208.56 total 50.20 last 16.44)
total: 1000 mkdir in 58.42 seconds: 17.12 ops/second
 - mkdir 165 (time 1787585167.94 total 10.02 last 16.46)
 - mkdir 335 (time 1787585177.99 total 20.07 last 16.92)
 - mkdir 529 (time 1787585188.04 total 30.12 last 19.30)
 - mkdir 690 (time 1787585198.08 total 40.16 last 16.03)
 - mkdir 854 (time 1787585208.11 total 50.19 last 16.36)
total: 1000 mkdir in 59.72 seconds: 16.74 ops/second
 - mkdir 162 (time 1787585167.49 total 10.01 last 16.19)
 - mkdir 327 (time 1787585177.50 total 20.02 last 16.48)
 - mkdir 525 (time 1787585187.52 total 30.04 last 19.76)
 - mkdir 690 (time 1787585197.54 total 40.05 last 16.47)
 - mkdir 851 (time 1787585207.54 total 50.06 last 16.10)
 - mkdir 997 (time 1787585217.60 total 60.11 last 14.52)
total: 1000 mkdir in 60.27 seconds: 16.59 ops/second
Time for file creation 69 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787585225 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787585225 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787585226 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787585226 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787585225 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787585226 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787585226 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787585226 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787585226 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787585226 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8