== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 00:14:43 (1787717683)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.46 seconds: 21.61 ops/second
 - mkdir 138 (time 1787717702.88 total 10.06 last 13.72)
 - mkdir 276 (time 1787717712.89 total 20.07 last 13.78)
 - mkdir 428 (time 1787717722.93 total 30.11 last 15.14)
 - mkdir 598 (time 1787717732.96 total 40.14 last 16.96)
 - mkdir 759 (time 1787717743.00 total 50.18 last 16.04)
 - mkdir 922 (time 1787717753.03 total 60.21 last 16.25)
total: 1000 mkdir in 64.40 seconds: 15.53 ops/second
 - mkdir 139 (time 1787717706.54 total 10.01 last 13.88)
 - mkdir 290 (time 1787717716.56 total 20.04 last 15.06)
 - mkdir 464 (time 1787717726.57 total 30.04 last 17.39)
 - mkdir 640 (time 1787717736.58 total 40.06 last 17.58)
 - mkdir 798 (time 1787717746.61 total 50.08 last 15.76)
 - mkdir 968 (time 1787717756.62 total 60.09 last 16.98)
total: 1000 mkdir in 62.47 seconds: 16.01 ops/second
 - mkdir 140 (time 1787717705.96 total 10.03 last 13.96)
 - mkdir 289 (time 1787717715.99 total 20.06 last 14.85)
 - mkdir 452 (time 1787717726.02 total 30.09 last 16.25)
 - mkdir 627 (time 1787717736.03 total 40.10 last 17.48)
 - mkdir 786 (time 1787717746.06 total 50.13 last 15.85)
 - mkdir 958 (time 1787717756.14 total 60.20 last 17.07)
total: 1000 mkdir in 63.40 seconds: 15.77 ops/second
 - mkdir 142 (time 1787717706.42 total 10.05 last 14.13)
 - mkdir 289 (time 1787717716.43 total 20.06 last 14.68)
 - mkdir 458 (time 1787717726.47 total 30.10 last 16.83)
 - mkdir 630 (time 1787717736.52 total 40.14 last 17.12)
 - mkdir 790 (time 1787717746.54 total 50.16 last 15.97)
 - mkdir 961 (time 1787717756.56 total 60.19 last 17.06)
total: 1000 mkdir in 63.34 seconds: 15.79 ops/second
 - mkdir 135 (time 1787717706.01 total 10.09 last 13.39)
 - mkdir 281 (time 1787717716.03 total 20.10 last 14.58)
 - mkdir 448 (time 1787717726.04 total 30.12 last 16.67)
 - mkdir 624 (time 1787717736.07 total 40.14 last 17.55)
 - mkdir 782 (time 1787717746.08 total 50.15 last 15.78)
 - mkdir 953 (time 1787717756.14 total 60.21 last 17.01)
total: 1000 mkdir in 64.13 seconds: 15.59 ops/second
 - mkdir 135 (time 1787717706.36 total 10.01 last 13.49)
 - mkdir 280 (time 1787717716.41 total 20.05 last 14.43)
 - mkdir 444 (time 1787717726.44 total 30.08 last 16.36)
 - mkdir 613 (time 1787717736.49 total 40.13 last 16.81)
 - mkdir 771 (time 1787717746.56 total 50.20 last 15.69)
 - mkdir 943 (time 1787717756.61 total 60.25 last 17.11)
total: 1000 mkdir in 65.61 seconds: 15.24 ops/second
 - mkdir 134 (time 1787717707.30 total 10.07 last 13.30)
 - mkdir 277 (time 1787717717.36 total 20.13 last 14.22)
 - mkdir 450 (time 1787717727.39 total 30.16 last 17.24)
 - mkdir 617 (time 1787717737.39 total 40.16 last 16.70)
 - mkdir 779 (time 1787717747.45 total 50.23 last 16.10)
 - mkdir 955 (time 1787717757.52 total 60.29 last 17.49)
total: 1000 mkdir in 65.52 seconds: 15.26 ops/second
 - mkdir 130 (time 1787717706.74 total 10.07 last 12.91)
 - mkdir 276 (time 1787717716.76 total 20.10 last 14.56)
 - mkdir 441 (time 1787717726.80 total 30.13 last 16.45)
 - mkdir 612 (time 1787717736.80 total 40.14 last 17.09)
 - mkdir 768 (time 1787717746.80 total 50.14 last 15.60)
 - mkdir 941 (time 1787717756.82 total 60.15 last 17.27)
total: 1000 mkdir in 66.25 seconds: 15.09 ops/second
 - mkdir 133 (time 1787717707.13 total 10.01 last 13.29)
 - mkdir 279 (time 1787717717.18 total 20.06 last 14.53)
 - mkdir 452 (time 1787717727.20 total 30.08 last 17.26)
 - mkdir 618 (time 1787717737.23 total 40.11 last 16.56)
 - mkdir 778 (time 1787717747.25 total 50.13 last 15.97)
 - mkdir 952 (time 1787717757.25 total 60.13 last 17.40)
total: 1000 mkdir in 65.83 seconds: 15.19 ops/second
 - mkdir 125 (time 1787717706.83 total 10.02 last 12.48)
 - mkdir 263 (time 1787717716.84 total 20.03 last 13.79)
 - mkdir 421 (time 1787717726.86 total 30.04 last 15.78)
 - mkdir 591 (time 1787717736.87 total 40.05 last 16.98)
 - mkdir 747 (time 1787717746.92 total 50.10 last 15.52)
 - mkdir 921 (time 1787717756.95 total 60.14 last 17.34)
total: 1000 mkdir in 67.75 seconds: 14.76 ops/second
Time for file creation 79 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.52 seconds: 19.17 ops/second
 - mkdir 154 (time 1787718333.89 total 10.03 last 15.35)
 - mkdir 300 (time 1787718343.93 total 20.07 last 14.55)
 - mkdir 451 (time 1787718354.05 total 30.19 last 14.91)
 - mkdir 640 (time 1787718364.11 total 40.25 last 18.79)
 - mkdir 790 (time 1787718374.14 total 50.28 last 14.95)
 - mkdir 904 (time 1787718384.16 total 60.31 last 11.37)
total: 1000 mkdir in 67.00 seconds: 14.92 ops/second
 - mkdir 148 (time 1787718334.39 total 10.03 last 14.75)
 - mkdir 300 (time 1787718344.39 total 20.04 last 15.19)
 - mkdir 453 (time 1787718354.50 total 30.15 last 15.13)
 - mkdir 649 (time 1787718364.52 total 40.17 last 19.55)
 - mkdir 799 (time 1787718374.67 total 50.32 last 14.78)
 - mkdir 914 (time 1787718384.70 total 60.35 last 11.47)
total: 1000 mkdir in 66.69 seconds: 14.99 ops/second
 - mkdir 132 (time 1787718332.51 total 10.01 last 13.19)
 - mkdir 278 (time 1787718342.55 total 20.05 last 14.53)
 - mkdir 434 (time 1787718352.62 total 30.12 last 15.49)
 - mkdir 600 (time 1787718362.65 total 40.16 last 16.55)
 - mkdir 754 (time 1787718372.68 total 50.18 last 15.36)
 - mkdir 882 (time 1787718382.72 total 60.23 last 12.75)
total: 1000 mkdir in 69.56 seconds: 14.38 ops/second
 - mkdir 145 (time 1787718334.21 total 10.07 last 14.40)
 - mkdir 291 (time 1787718344.21 total 20.07 last 14.59)
 - mkdir 438 (time 1787718354.29 total 30.16 last 14.58)
 - mkdir 628 (time 1787718364.31 total 40.18 last 18.97)
 - mkdir 781 (time 1787718374.31 total 50.18 last 15.30)
 - mkdir 894 (time 1787718384.32 total 60.19 last 11.29)
total: 1000 mkdir in 68.39 seconds: 14.62 ops/second
 - mkdir 146 (time 1787718334.45 total 10.01 last 14.59)
 - mkdir 290 (time 1787718344.52 total 20.08 last 14.30)
 - mkdir 433 (time 1787718354.58 total 30.14 last 14.22)
 - mkdir 629 (time 1787718364.60 total 40.16 last 19.56)
 - mkdir 777 (time 1787718374.72 total 50.28 last 14.62)
 - mkdir 889 (time 1787718384.74 total 60.30 last 11.18)
total: 1000 mkdir in 69.12 seconds: 14.47 ops/second
 - mkdir 150 (time 1787718334.69 total 10.04 last 14.94)
 - mkdir 295 (time 1787718344.77 total 20.12 last 14.38)
 - mkdir 439 (time 1787718354.82 total 30.17 last 14.33)
 - mkdir 634 (time 1787718364.85 total 40.20 last 19.45)
 - mkdir 780 (time 1787718374.90 total 50.24 last 14.53)
 - mkdir 889 (time 1787718384.96 total 60.30 last 10.84)
total: 1000 mkdir in 69.40 seconds: 14.41 ops/second
 - mkdir 145 (time 1787718334.53 total 10.02 last 14.48)
 - mkdir 293 (time 1787718344.59 total 20.08 last 14.71)
 - mkdir 435 (time 1787718354.63 total 30.11 last 14.15)
 - mkdir 631 (time 1787718364.63 total 40.12 last 19.59)
 - mkdir 777 (time 1787718374.65 total 50.14 last 14.57)
 - mkdir 886 (time 1787718384.69 total 60.18 last 10.86)
total: 1000 mkdir in 69.68 seconds: 14.35 ops/second
 - mkdir 147 (time 1787718334.60 total 10.07 last 14.60)
 - mkdir 298 (time 1787718344.65 total 20.12 last 15.03)
 - mkdir 439 (time 1787718354.71 total 30.18 last 14.01)
 - mkdir 635 (time 1787718364.77 total 40.24 last 19.49)
 - mkdir 777 (time 1787718374.78 total 50.25 last 14.18)
 - mkdir 888 (time 1787718384.79 total 60.26 last 11.09)
total: 1000 mkdir in 69.73 seconds: 14.34 ops/second
 - mkdir 119 (time 1787718331.03 total 10.07 last 11.82)
 - mkdir 251 (time 1787718341.06 total 20.10 last 13.16)
 - mkdir 408 (time 1787718351.10 total 30.14 last 15.64)
 - mkdir 571 (time 1787718361.16 total 40.20 last 16.20)
 - mkdir 716 (time 1787718371.19 total 50.23 last 14.46)
 - mkdir 837 (time 1787718381.26 total 60.30 last 12.02)
 - mkdir 960 (time 1787718391.27 total 70.31 last 12.28)
total: 1000 mkdir in 74.97 seconds: 13.34 ops/second
 - mkdir 146 (time 1787718333.77 total 10.00 last 14.59)
 - mkdir 286 (time 1787718343.81 total 20.04 last 13.95)
 - mkdir 433 (time 1787718353.86 total 30.09 last 14.63)
 - mkdir 613 (time 1787718363.90 total 40.13 last 17.93)
 - mkdir 756 (time 1787718373.95 total 50.18 last 14.23)
 - mkdir 863 (time 1787718383.99 total 60.22 last 10.66)
 - mkdir 983 (time 1787718394.08 total 70.32 last 11.88)
total: 1000 mkdir in 72.21 seconds: 13.85 ops/second
Time for file creation 84 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787718407 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787718407 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787718408 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787718408 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787718408 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787718408 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787718408 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787718409 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787718408 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787718409 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
Time for file removal 50 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8