== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 22:50:42 (1781232642)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.61 seconds: 16.39 ops/second
 - mkdir 158 (time 1781232663.93 total 10.11 last 15.64)
 - mkdir 301 (time 1781232673.94 total 20.11 last 14.29)
 - mkdir 474 (time 1781232684.01 total 30.18 last 17.19)
 - mkdir 650 (time 1781232694.04 total 40.22 last 17.54)
 - mkdir 809 (time 1781232704.05 total 50.22 last 15.89)
 - mkdir 952 (time 1781232714.09 total 60.26 last 14.24)
total: 1000 mkdir in 63.57 seconds: 15.73 ops/second
 - mkdir 147 (time 1781232664.49 total 10.01 last 14.68)
 - mkdir 288 (time 1781232674.55 total 20.08 last 14.01)
 - mkdir 455 (time 1781232684.56 total 30.09 last 16.68)
 - mkdir 630 (time 1781232694.57 total 40.10 last 17.49)
 - mkdir 792 (time 1781232704.64 total 50.16 last 16.10)
 - mkdir 939 (time 1781232714.67 total 60.20 last 14.65)
total: 1000 mkdir in 64.71 seconds: 15.45 ops/second
 - mkdir 153 (time 1781232663.90 total 10.08 last 15.19)
 - mkdir 292 (time 1781232673.93 total 20.10 last 13.86)
 - mkdir 462 (time 1781232683.93 total 30.11 last 16.99)
 - mkdir 625 (time 1781232693.95 total 40.12 last 16.27)
 - mkdir 786 (time 1781232703.96 total 50.14 last 16.08)
 - mkdir 931 (time 1781232714.04 total 60.22 last 14.38)
total: 1000 mkdir in 65.68 seconds: 15.23 ops/second
 - mkdir 152 (time 1781232663.53 total 10.07 last 15.10)
 - mkdir 285 (time 1781232673.56 total 20.10 last 13.25)
 - mkdir 445 (time 1781232683.60 total 30.14 last 15.95)
 - mkdir 607 (time 1781232693.68 total 40.22 last 16.06)
 - mkdir 773 (time 1781232703.73 total 50.27 last 16.52)
 - mkdir 920 (time 1781232713.74 total 60.28 last 14.69)
total: 1000 mkdir in 66.31 seconds: 15.08 ops/second
 - mkdir 150 (time 1781232664.12 total 10.04 last 14.94)
 - mkdir 287 (time 1781232674.17 total 20.09 last 13.63)
 - mkdir 452 (time 1781232684.23 total 30.16 last 16.39)
 - mkdir 624 (time 1781232694.24 total 40.16 last 17.19)
 - mkdir 783 (time 1781232704.27 total 50.19 last 15.85)
 - mkdir 929 (time 1781232714.27 total 60.20 last 14.59)
total: 1000 mkdir in 65.91 seconds: 15.17 ops/second
 - mkdir 146 (time 1781232663.23 total 10.02 last 14.57)
 - mkdir 278 (time 1781232673.30 total 20.09 last 13.10)
 - mkdir 435 (time 1781232683.32 total 30.11 last 15.67)
 - mkdir 599 (time 1781232693.36 total 40.15 last 16.33)
 - mkdir 762 (time 1781232703.43 total 50.22 last 16.19)
 - mkdir 905 (time 1781232713.51 total 60.29 last 14.19)
total: 1000 mkdir in 68.25 seconds: 14.65 ops/second
 - mkdir 148 (time 1781232663.62 total 10.00 last 14.79)
 - mkdir 278 (time 1781232673.65 total 20.03 last 12.96)
 - mkdir 443 (time 1781232683.68 total 30.06 last 16.45)
 - mkdir 611 (time 1781232693.68 total 40.07 last 16.79)
 - mkdir 761 (time 1781232703.73 total 50.12 last 14.93)
 - mkdir 907 (time 1781232713.76 total 60.14 last 14.56)
total: 1000 mkdir in 67.88 seconds: 14.73 ops/second
 - mkdir 146 (time 1781232664.43 total 10.06 last 14.51)
 - mkdir 282 (time 1781232674.45 total 20.08 last 13.57)
 - mkdir 448 (time 1781232684.51 total 30.14 last 16.50)
 - mkdir 617 (time 1781232694.57 total 40.20 last 16.81)
 - mkdir 772 (time 1781232704.63 total 50.26 last 15.39)
 - mkdir 918 (time 1781232714.65 total 60.28 last 14.57)
total: 1000 mkdir in 67.38 seconds: 14.84 ops/second
 - mkdir 147 (time 1781232664.65 total 10.12 last 14.52)
 - mkdir 289 (time 1781232674.66 total 20.14 last 14.17)
 - mkdir 454 (time 1781232684.68 total 30.16 last 16.47)
 - mkdir 625 (time 1781232694.74 total 40.21 last 17.01)
 - mkdir 777 (time 1781232704.74 total 50.22 last 15.19)
 - mkdir 921 (time 1781232714.81 total 60.29 last 14.30)
total: 1000 mkdir in 67.46 seconds: 14.82 ops/second
 - mkdir 142 (time 1781232663.72 total 10.02 last 14.17)
 - mkdir 265 (time 1781232673.73 total 20.03 last 12.29)
 - mkdir 418 (time 1781232683.74 total 30.04 last 15.29)
 - mkdir 576 (time 1781232693.74 total 40.04 last 15.79)
 - mkdir 732 (time 1781232703.74 total 50.04 last 15.60)
 - mkdir 874 (time 1781232713.77 total 60.08 last 14.16)
 - mkdir 989 (time 1781232723.79 total 70.09 last 11.48)
total: 1000 mkdir in 70.76 seconds: 14.13 ops/second
Time for file creation 80 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.51 seconds: 19.59 ops/second
 - mkdir 145 (time 1781233263.77 total 10.04 last 14.45)
 - mkdir 308 (time 1781233273.79 total 20.05 last 16.27)
 - mkdir 474 (time 1781233283.80 total 30.07 last 16.58)
 - mkdir 638 (time 1781233293.83 total 40.10 last 16.35)
 - mkdir 814 (time 1781233303.88 total 50.14 last 17.51)
 - mkdir 984 (time 1781233313.88 total 60.15 last 17.00)
total: 1000 mkdir in 60.88 seconds: 16.43 ops/second
 - mkdir 156 (time 1781233264.87 total 10.09 last 15.47)
 - mkdir 322 (time 1781233274.92 total 20.14 last 16.51)
 - mkdir 485 (time 1781233285.02 total 30.24 last 16.14)
 - mkdir 655 (time 1781233295.06 total 40.28 last 16.93)
 - mkdir 827 (time 1781233305.11 total 50.33 last 17.13)
total: 1000 mkdir in 60.13 seconds: 16.63 ops/second
 - mkdir 147 (time 1781233262.79 total 10.03 last 14.66)
 - mkdir 304 (time 1781233272.81 total 20.05 last 15.67)
 - mkdir 462 (time 1781233282.84 total 30.08 last 15.76)
 - mkdir 623 (time 1781233292.85 total 40.09 last 16.08)
 - mkdir 796 (time 1781233302.87 total 50.11 last 17.27)
 - mkdir 961 (time 1781233312.91 total 60.15 last 16.44)
total: 1000 mkdir in 62.23 seconds: 16.07 ops/second
 - mkdir 150 (time 1781233264.08 total 10.06 last 14.92)
 - mkdir 314 (time 1781233274.09 total 20.07 last 16.37)
 - mkdir 476 (time 1781233284.16 total 30.15 last 16.08)
 - mkdir 642 (time 1781233294.17 total 40.15 last 16.60)
 - mkdir 814 (time 1781233304.21 total 50.19 last 17.12)
 - mkdir 983 (time 1781233314.21 total 60.20 last 16.90)
total: 1000 mkdir in 61.31 seconds: 16.31 ops/second
 - mkdir 152 (time 1781233264.28 total 10.04 last 15.13)
 - mkdir 314 (time 1781233274.29 total 20.05 last 16.19)
 - mkdir 476 (time 1781233284.34 total 30.09 last 16.13)
 - mkdir 640 (time 1781233294.35 total 40.11 last 16.38)
 - mkdir 812 (time 1781233304.35 total 50.11 last 17.20)
 - mkdir 983 (time 1781233314.37 total 60.13 last 17.06)
total: 1000 mkdir in 61.53 seconds: 16.25 ops/second
 - mkdir 156 (time 1781233264.88 total 10.07 last 15.48)
 - mkdir 323 (time 1781233274.96 total 20.15 last 16.58)
 - mkdir 481 (time 1781233285.02 total 30.21 last 15.70)
 - mkdir 648 (time 1781233295.03 total 40.22 last 16.69)
 - mkdir 821 (time 1781233305.03 total 50.22 last 17.29)
 - mkdir 990 (time 1781233315.05 total 60.24 last 16.87)
total: 1000 mkdir in 61.29 seconds: 16.32 ops/second
 - mkdir 157 (time 1781233264.91 total 10.08 last 15.58)
 - mkdir 317 (time 1781233274.93 total 20.10 last 15.96)
 - mkdir 473 (time 1781233284.94 total 30.10 last 15.60)
 - mkdir 635 (time 1781233295.03 total 40.19 last 16.05)
 - mkdir 802 (time 1781233305.07 total 50.23 last 16.63)
 - mkdir 978 (time 1781233315.12 total 60.28 last 17.51)
total: 1000 mkdir in 62.27 seconds: 16.06 ops/second
 - mkdir 140 (time 1781233263.10 total 10.08 last 13.88)
 - mkdir 289 (time 1781233273.13 total 20.11 last 14.86)
 - mkdir 449 (time 1781233283.16 total 30.15 last 15.94)
 - mkdir 605 (time 1781233293.17 total 40.15 last 15.59)
 - mkdir 779 (time 1781233303.21 total 50.20 last 17.33)
 - mkdir 949 (time 1781233313.25 total 60.23 last 16.95)
total: 1000 mkdir in 64.20 seconds: 15.58 ops/second
 - mkdir 152 (time 1781233265.02 total 10.04 last 15.14)
 - mkdir 309 (time 1781233275.06 total 20.08 last 15.64)
 - mkdir 465 (time 1781233285.09 total 30.11 last 15.55)
 - mkdir 628 (time 1781233295.11 total 40.13 last 16.27)
 - mkdir 795 (time 1781233305.15 total 50.17 last 16.63)
 - mkdir 968 (time 1781233315.17 total 60.19 last 17.27)
total: 1000 mkdir in 63.52 seconds: 15.74 ops/second
 - mkdir 147 (time 1781233264.70 total 10.05 last 14.63)
 - mkdir 304 (time 1781233274.71 total 20.07 last 15.67)
 - mkdir 456 (time 1781233284.78 total 30.13 last 15.10)
 - mkdir 621 (time 1781233294.84 total 40.19 last 16.40)
 - mkdir 793 (time 1781233304.88 total 50.23 last 17.12)
 - mkdir 967 (time 1781233314.94 total 60.29 last 17.31)
total: 1000 mkdir in 64.03 seconds: 15.62 ops/second
Time for file creation 75 sec for 1 RPC sent at a time
 - unlinked 0 (time 1781233327 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1781233328 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1781233328 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233329 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233329 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233329 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233329 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233329 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233329 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233329 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8