== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:12:34 (1786428754)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.48 seconds: 20.98 ops/second
 - mkdir 137 (time 1786428777.13 total 10.02 last 13.68)
 - mkdir 283 (time 1786428787.17 total 20.05 last 14.55)
 - mkdir 440 (time 1786428797.17 total 30.06 last 15.69)
 - mkdir 610 (time 1786428807.21 total 40.09 last 16.94)
 - mkdir 752 (time 1786428817.26 total 50.14 last 14.13)
 - mkdir 888 (time 1786428827.30 total 60.18 last 13.55)
total: 1000 mkdir in 68.36 seconds: 14.63 ops/second
 - mkdir 131 (time 1786428776.52 total 10.02 last 13.07)
 - mkdir 282 (time 1786428786.58 total 20.08 last 15.01)
 - mkdir 439 (time 1786428796.66 total 30.16 last 15.57)
 - mkdir 606 (time 1786428806.67 total 40.17 last 16.69)
 - mkdir 744 (time 1786428816.80 total 50.29 last 13.63)
 - mkdir 872 (time 1786428826.81 total 60.31 last 12.78)
total: 1000 mkdir in 69.97 seconds: 14.29 ops/second
 - mkdir 136 (time 1786428777.79 total 10.07 last 13.51)
 - mkdir 276 (time 1786428787.84 total 20.12 last 13.93)
 - mkdir 434 (time 1786428797.88 total 30.16 last 15.74)
 - mkdir 599 (time 1786428807.98 total 40.26 last 16.33)
 - mkdir 741 (time 1786428818.07 total 50.35 last 14.08)
 - mkdir 879 (time 1786428828.08 total 60.36 last 13.78)
total: 1000 mkdir in 70.31 seconds: 14.22 ops/second
 - mkdir 128 (time 1786428776.24 total 10.02 last 12.77)
 - mkdir 274 (time 1786428786.31 total 20.09 last 14.50)
 - mkdir 417 (time 1786428796.35 total 30.13 last 14.25)
 - mkdir 584 (time 1786428806.37 total 40.15 last 16.66)
 - mkdir 727 (time 1786428816.44 total 50.22 last 14.20)
 - mkdir 859 (time 1786428826.51 total 60.29 last 13.11)
 - mkdir 989 (time 1786428836.54 total 70.32 last 12.96)
total: 1000 mkdir in 72.03 seconds: 13.88 ops/second
 - mkdir 145 (time 1786428778.33 total 10.04 last 14.45)
 - mkdir 278 (time 1786428788.33 total 20.04 last 13.29)
 - mkdir 440 (time 1786428798.42 total 30.13 last 16.06)
 - mkdir 594 (time 1786428808.44 total 40.15 last 15.36)
 - mkdir 736 (time 1786428818.52 total 50.23 last 14.09)
 - mkdir 870 (time 1786428828.52 total 60.24 last 13.39)
 - mkdir 988 (time 1786428838.91 total 70.62 last 11.36)
total: 1000 mkdir in 73.09 seconds: 13.68 ops/second
 - mkdir 128 (time 1786428777.04 total 10.05 last 12.73)
 - mkdir 272 (time 1786428787.09 total 20.11 last 14.33)
 - mkdir 424 (time 1786428797.09 total 30.11 last 15.20)
 - mkdir 590 (time 1786428807.13 total 40.14 last 16.54)
 - mkdir 722 (time 1786428817.28 total 50.29 last 13.00)
 - mkdir 851 (time 1786428827.30 total 60.31 last 12.88)
 - mkdir 975 (time 1786428837.37 total 70.38 last 12.31)
total: 1000 mkdir in 75.77 seconds: 13.20 ops/second
 - mkdir 113 (time 1786428775.76 total 10.02 last 11.28)
 - mkdir 256 (time 1786428785.79 total 20.05 last 14.25)
 - mkdir 393 (time 1786428795.81 total 30.07 last 13.67)
 - mkdir 554 (time 1786428805.85 total 40.11 last 16.04)
 - mkdir 697 (time 1786428815.87 total 50.13 last 14.27)
 - mkdir 823 (time 1786428826.09 total 60.35 last 12.33)
 - mkdir 958 (time 1786428836.29 total 70.55 last 13.23)
total: 1000 mkdir in 77.99 seconds: 12.82 ops/second
 - mkdir 102 (time 1786428772.94 total 10.03 last 10.16)
 - mkdir 241 (time 1786428783.00 total 20.10 last 13.81)
 - mkdir 366 (time 1786428793.17 total 30.26 last 12.30)
 - mkdir 524 (time 1786428803.19 total 40.29 last 15.75)
 - mkdir 664 (time 1786428813.21 total 50.31 last 13.97)
 - mkdir 792 (time 1786428823.23 total 60.32 last 12.78)
 - mkdir 911 (time 1786428833.24 total 70.34 last 11.89)
 - mkdir 993 (time 1786428843.32 total 80.41 last 8.14)
total: 1000 mkdir in 81.31 seconds: 12.30 ops/second
 - mkdir 128 (time 1786428777.12 total 10.04 last 12.75)
 - mkdir 267 (time 1786428787.19 total 20.10 last 13.81)
 - mkdir 417 (time 1786428797.22 total 30.13 last 14.95)
 - mkdir 579 (time 1786428807.34 total 40.25 last 16.01)
 - mkdir 711 (time 1786428817.41 total 50.32 last 13.11)
 - mkdir 848 (time 1786428827.42 total 60.34 last 13.68)
 - mkdir 970 (time 1786428837.58 total 70.50 last 12.01)
total: 1000 mkdir in 77.14 seconds: 12.96 ops/second
 - mkdir 130 (time 1786428777.40 total 10.08 last 12.90)
 - mkdir 270 (time 1786428787.44 total 20.13 last 13.93)
 - mkdir 420 (time 1786428797.50 total 30.19 last 14.91)
 - mkdir 577 (time 1786428807.70 total 40.39 last 15.40)
 - mkdir 716 (time 1786428817.73 total 50.42 last 13.85)
 - mkdir 847 (time 1786428827.81 total 60.49 last 13.01)
 - mkdir 967 (time 1786428838.03 total 70.71 last 11.74)
total: 1000 mkdir in 76.95 seconds: 13.00 ops/second
Time for file creation 92 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 19 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.46 seconds: 21.72 ops/second
 - mkdir 86 (time 1786429332.58 total 10.05 last 8.56)
 - mkdir 217 (time 1786429342.60 total 20.07 last 13.07)
 - mkdir 366 (time 1786429352.61 total 30.07 last 14.90)
 - mkdir 486 (time 1786429362.64 total 40.11 last 11.96)
 - mkdir 629 (time 1786429372.72 total 50.19 last 14.18)
 - mkdir 752 (time 1786429382.84 total 60.30 last 12.16)
 - mkdir 884 (time 1786429392.84 total 70.31 last 13.19)
total: 1000 mkdir in 78.97 seconds: 12.66 ops/second
 - mkdir 76 (time 1786429332.00 total 10.18 last 7.46)
 - mkdir 210 (time 1786429342.06 total 20.24 last 13.33)
 - mkdir 354 (time 1786429352.07 total 30.25 last 14.38)
 - mkdir 468 (time 1786429362.10 total 40.28 last 11.37)
 - mkdir 606 (time 1786429372.10 total 50.28 last 13.80)
 - mkdir 725 (time 1786429382.27 total 60.46 last 11.69)
 - mkdir 852 (time 1786429392.34 total 70.52 last 12.62)
 - mkdir 970 (time 1786429402.45 total 80.63 last 11.67)
total: 1000 mkdir in 89.46 seconds: 11.18 ops/second
 - mkdir 111 (time 1786429335.33 total 10.08 last 11.01)
 - mkdir 241 (time 1786429345.44 total 20.19 last 12.86)
 - mkdir 390 (time 1786429355.44 total 30.19 last 14.90)
 - mkdir 502 (time 1786429365.44 total 40.19 last 11.20)
 - mkdir 647 (time 1786429375.46 total 50.22 last 14.46)
 - mkdir 759 (time 1786429385.48 total 60.23 last 11.18)
 - mkdir 882 (time 1786429395.50 total 70.26 last 12.27)
 - mkdir 970 (time 1786429406.01 total 80.76 last 8.38)
 - mkdir 998 (time 1786429416.10 total 90.85 last 2.78)
total: 1000 mkdir in 91.20 seconds: 10.96 ops/second
 - mkdir 117 (time 1786429336.27 total 10.04 last 11.65)
 - mkdir 253 (time 1786429346.28 total 20.05 last 13.59)
 - mkdir 402 (time 1786429356.33 total 30.10 last 14.84)
 - mkdir 512 (time 1786429366.35 total 40.12 last 10.97)
 - mkdir 650 (time 1786429376.38 total 50.15 last 13.77)
 - mkdir 766 (time 1786429386.42 total 60.19 last 11.55)
 - mkdir 896 (time 1786429396.47 total 70.25 last 12.93)
 - mkdir 968 (time 1786429406.88 total 80.65 last 6.92)
 - mkdir 996 (time 1786429416.99 total 90.76 last 2.77)
total: 1000 mkdir in 91.35 seconds: 10.95 ops/second
 - mkdir 92 (time 1786429333.17 total 10.01 last 9.19)
 - mkdir 218 (time 1786429343.23 total 20.08 last 12.52)
 - mkdir 361 (time 1786429353.29 total 30.14 last 14.21)
 - mkdir 473 (time 1786429363.32 total 40.16 last 11.18)
 - mkdir 613 (time 1786429373.32 total 50.16 last 13.99)
 - mkdir 726 (time 1786429383.40 total 60.25 last 11.21)
 - mkdir 853 (time 1786429393.41 total 70.26 last 12.69)
 - mkdir 958 (time 1786429403.55 total 80.39 last 10.36)
 - mkdir 987 (time 1786429413.79 total 90.64 last 2.83)
total: 1000 mkdir in 94.75 seconds: 10.55 ops/second
 - mkdir 107 (time 1786429335.93 total 10.13 last 10.56)
 - mkdir 239 (time 1786429345.94 total 20.14 last 13.19)
 - mkdir 387 (time 1786429355.94 total 30.14 last 14.79)
 - mkdir 494 (time 1786429365.96 total 40.17 last 10.67)
 - mkdir 642 (time 1786429376.05 total 50.25 last 14.67)
 - mkdir 752 (time 1786429386.12 total 60.32 last 10.93)
 - mkdir 876 (time 1786429396.12 total 70.32 last 12.39)
 - mkdir 958 (time 1786429406.24 total 80.44 last 8.10)
 - mkdir 985 (time 1786429416.41 total 90.62 last 2.65)
total: 1000 mkdir in 93.92 seconds: 10.65 ops/second
 - mkdir 125 (time 1786429337.09 total 10.05 last 12.43)
 - mkdir 259 (time 1786429347.19 total 20.15 last 13.27)
 - mkdir 405 (time 1786429357.31 total 30.27 last 14.43)
 - mkdir 520 (time 1786429367.32 total 40.28 last 11.48)
 - mkdir 657 (time 1786429377.42 total 50.38 last 13.57)
 - mkdir 772 (time 1786429387.43 total 60.39 last 11.48)
 - mkdir 902 (time 1786429397.46 total 70.42 last 12.96)
 - mkdir 959 (time 1786429408.25 total 81.21 last 5.28)
 - mkdir 989 (time 1786429418.30 total 91.26 last 2.99)
total: 1000 mkdir in 93.68 seconds: 10.67 ops/second
 - mkdir 114 (time 1786429336.19 total 10.05 last 11.35)
 - mkdir 243 (time 1786429346.23 total 20.09 last 12.84)
 - mkdir 377 (time 1786429356.31 total 30.17 last 13.30)
 - mkdir 485 (time 1786429366.35 total 40.20 last 10.76)
 - mkdir 623 (time 1786429376.35 total 50.21 last 13.80)
 - mkdir 732 (time 1786429386.35 total 60.21 last 10.90)
 - mkdir 861 (time 1786429396.41 total 70.27 last 12.83)
 - mkdir 934 (time 1786429407.10 total 80.96 last 6.82)
 - mkdir 966 (time 1786429417.14 total 91.00 last 3.19)
total: 1000 mkdir in 97.95 seconds: 10.21 ops/second
 - mkdir 110 (time 1786429336.16 total 10.01 last 10.99)
 - mkdir 239 (time 1786429346.23 total 20.08 last 12.81)
 - mkdir 375 (time 1786429356.24 total 30.09 last 13.59)
 - mkdir 481 (time 1786429366.27 total 40.12 last 10.56)
 - mkdir 618 (time 1786429376.30 total 50.15 last 13.65)
 - mkdir 727 (time 1786429386.40 total 60.25 last 10.80)
 - mkdir 856 (time 1786429396.43 total 70.28 last 12.86)
 - mkdir 929 (time 1786429406.85 total 80.70 last 7.01)
 - mkdir 956 (time 1786429416.87 total 90.72 last 2.69)
total: 1000 mkdir in 98.26 seconds: 10.18 ops/second
 - mkdir 105 (time 1786429335.53 total 10.02 last 10.48)
 - mkdir 224 (time 1786429345.59 total 20.08 last 11.83)
 - mkdir 365 (time 1786429355.61 total 30.10 last 14.07)
 - mkdir 470 (time 1786429365.67 total 40.15 last 10.45)
 - mkdir 613 (time 1786429375.73 total 50.22 last 14.20)
 - mkdir 719 (time 1786429385.77 total 60.25 last 10.57)
 - mkdir 840 (time 1786429395.82 total 70.31 last 12.03)
 - mkdir 921 (time 1786429405.94 total 80.42 last 8.01)
 - mkdir 949 (time 1786429415.99 total 90.48 last 2.79)
total: 1000 mkdir in 99.28 seconds: 10.07 ops/second
Time for file creation 117 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786429435 ; total 1 ; last 1)
total: 1000 unlinks in 45 seconds: 22.222221 unlinks/second
 - unlinked 0 (time 1786429435 ; total 1 ; last 1)
total: 1000 unlinks in 47 seconds: 21.276596 unlinks/second
 - unlinked 0 (time 1786429440 ; total 0 ; last 0)
total: 1000 unlinks in 43 seconds: 23.255814 unlinks/second
 - unlinked 0 (time 1786429443 ; total 0 ; last 0)
total: 1000 unlinks in 45 seconds: 22.222221 unlinks/second
 - unlinked 0 (time 1786429442 ; total 0 ; last 0)
total: 1000 unlinks in 46 seconds: 21.739130 unlinks/second
 - unlinked 0 (time 1786429443 ; total 1 ; last 1)
total: 1000 unlinks in 46 seconds: 21.739130 unlinks/second
 - unlinked 0 (time 1786429443 ; total 0 ; last 0)
total: 1000 unlinks in 46 seconds: 21.739130 unlinks/second
 - unlinked 0 (time 1786429443 ; total 0 ; last 0)
total: 1000 unlinks in 46 seconds: 21.739130 unlinks/second
 - unlinked 0 (time 1786429442 ; total 0 ; last 0)
total: 1000 unlinks in 48 seconds: 20.833334 unlinks/second
 - unlinked 0 (time 1786429442 ; total 1 ; last 1)
total: 1000 unlinks in 50 seconds: 20.000000 unlinks/second
Time for file removal 68 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8