== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 22:30:05 (1787625005)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.88 seconds: 11.40 ops/second
 - mkdir 121 (time 1787625030.91 total 10.02 last 12.08)
 - mkdir 264 (time 1787625040.92 total 20.03 last 14.28)
 - mkdir 412 (time 1787625050.99 total 30.10 last 14.70)
 - mkdir 561 (time 1787625060.99 total 40.10 last 14.89)
 - mkdir 714 (time 1787625071.00 total 50.11 last 15.29)
 - mkdir 861 (time 1787625081.03 total 60.14 last 14.65)
total: 1000 mkdir in 68.35 seconds: 14.63 ops/second
 - mkdir 126 (time 1787625032.03 total 10.03 last 12.57)
 - mkdir 281 (time 1787625042.09 total 20.09 last 15.40)
 - mkdir 432 (time 1787625052.12 total 30.11 last 15.06)
 - mkdir 587 (time 1787625062.13 total 40.13 last 15.47)
 - mkdir 732 (time 1787625072.13 total 50.13 last 14.50)
 - mkdir 876 (time 1787625082.18 total 60.18 last 14.33)
total: 1000 mkdir in 67.47 seconds: 14.82 ops/second
 - mkdir 125 (time 1787625031.72 total 10.04 last 12.45)
 - mkdir 272 (time 1787625041.74 total 20.06 last 14.67)
 - mkdir 418 (time 1787625051.78 total 30.10 last 14.54)
 - mkdir 578 (time 1787625061.81 total 40.13 last 15.95)
 - mkdir 726 (time 1787625071.85 total 50.16 last 14.75)
 - mkdir 873 (time 1787625081.90 total 60.21 last 14.62)
total: 1000 mkdir in 67.80 seconds: 14.75 ops/second
 - mkdir 126 (time 1787625032.02 total 10.05 last 12.54)
 - mkdir 274 (time 1787625042.07 total 20.09 last 14.74)
 - mkdir 423 (time 1787625052.07 total 30.10 last 14.89)
 - mkdir 578 (time 1787625062.09 total 40.11 last 15.47)
 - mkdir 727 (time 1787625072.16 total 50.18 last 14.80)
 - mkdir 873 (time 1787625082.20 total 60.22 last 14.54)
total: 1000 mkdir in 67.78 seconds: 14.75 ops/second
 - mkdir 125 (time 1787625030.93 total 10.01 last 12.49)
 - mkdir 266 (time 1787625041.00 total 20.08 last 13.99)
 - mkdir 420 (time 1787625051.11 total 30.19 last 15.23)
 - mkdir 566 (time 1787625061.13 total 40.21 last 14.58)
 - mkdir 715 (time 1787625071.14 total 50.23 last 14.87)
 - mkdir 855 (time 1787625081.19 total 60.28 last 13.93)
total: 1000 mkdir in 68.89 seconds: 14.52 ops/second
 - mkdir 126 (time 1787625031.89 total 10.04 last 12.55)
 - mkdir 270 (time 1787625041.90 total 20.05 last 14.39)
 - mkdir 413 (time 1787625051.94 total 30.09 last 14.24)
 - mkdir 570 (time 1787625061.96 total 40.11 last 15.67)
 - mkdir 719 (time 1787625071.98 total 50.13 last 14.87)
 - mkdir 868 (time 1787625082.00 total 60.15 last 14.87)
total: 1000 mkdir in 68.19 seconds: 14.66 ops/second
 - mkdir 131 (time 1787625032.31 total 10.06 last 13.02)
 - mkdir 278 (time 1787625042.37 total 20.12 last 14.61)
 - mkdir 425 (time 1787625052.40 total 30.16 last 14.65)
 - mkdir 580 (time 1787625062.45 total 40.21 last 15.42)
 - mkdir 729 (time 1787625072.49 total 50.25 last 14.85)
 - mkdir 870 (time 1787625082.52 total 60.27 last 14.06)
total: 1000 mkdir in 67.91 seconds: 14.73 ops/second
 - mkdir 120 (time 1787625031.46 total 10.03 last 11.96)
 - mkdir 265 (time 1787625041.52 total 20.09 last 14.41)
 - mkdir 412 (time 1787625051.57 total 30.14 last 14.63)
 - mkdir 561 (time 1787625061.60 total 40.18 last 14.85)
 - mkdir 710 (time 1787625071.66 total 50.23 last 14.82)
 - mkdir 858 (time 1787625081.71 total 60.28 last 14.72)
total: 1000 mkdir in 69.05 seconds: 14.48 ops/second
 - mkdir 113 (time 1787625030.54 total 10.02 last 11.28)
 - mkdir 257 (time 1787625040.60 total 20.07 last 14.32)
 - mkdir 400 (time 1787625050.63 total 30.11 last 14.25)
 - mkdir 551 (time 1787625060.65 total 40.13 last 15.08)
 - mkdir 700 (time 1787625070.69 total 50.16 last 14.84)
 - mkdir 842 (time 1787625080.73 total 60.21 last 14.14)
total: 1000 mkdir in 70.17 seconds: 14.25 ops/second
 - mkdir 124 (time 1787625032.23 total 10.03 last 12.36)
 - mkdir 264 (time 1787625042.27 total 20.07 last 13.94)
 - mkdir 404 (time 1787625052.28 total 30.07 last 13.99)
 - mkdir 562 (time 1787625062.29 total 40.09 last 15.78)
 - mkdir 708 (time 1787625072.31 total 50.11 last 14.57)
 - mkdir 852 (time 1787625082.38 total 60.18 last 14.29)
total: 1000 mkdir in 69.38 seconds: 14.41 ops/second
Time for file creation 85 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.56 seconds: 17.76 ops/second
 - mkdir 155 (time 1787625711.30 total 10.00 last 15.49)
 - mkdir 295 (time 1787625721.34 total 20.05 last 13.94)
 - mkdir 443 (time 1787625731.36 total 30.07 last 14.77)
 - mkdir 574 (time 1787625741.42 total 40.13 last 13.02)
 - mkdir 725 (time 1787625751.49 total 50.20 last 15.00)
 - mkdir 908 (time 1787625761.52 total 60.23 last 18.24)
total: 1000 mkdir in 66.11 seconds: 15.13 ops/second
 - mkdir 156 (time 1787625711.86 total 10.02 last 15.57)
 - mkdir 293 (time 1787625721.87 total 20.03 last 13.68)
 - mkdir 443 (time 1787625731.97 total 30.13 last 14.85)
 - mkdir 569 (time 1787625741.97 total 40.13 last 12.60)
 - mkdir 722 (time 1787625752.03 total 50.19 last 15.22)
 - mkdir 904 (time 1787625762.06 total 60.22 last 18.15)
total: 1000 mkdir in 67.16 seconds: 14.89 ops/second
 - mkdir 154 (time 1787625712.33 total 10.01 last 15.39)
 - mkdir 297 (time 1787625722.38 total 20.06 last 14.22)
 - mkdir 441 (time 1787625732.44 total 30.11 last 14.32)
 - mkdir 569 (time 1787625742.46 total 40.13 last 12.78)
 - mkdir 719 (time 1787625752.48 total 50.16 last 14.96)
 - mkdir 905 (time 1787625762.51 total 60.19 last 18.54)
total: 1000 mkdir in 67.12 seconds: 14.90 ops/second
 - mkdir 158 (time 1787625712.34 total 10.05 last 15.72)
 - mkdir 301 (time 1787625722.40 total 20.11 last 14.22)
 - mkdir 448 (time 1787625732.45 total 30.16 last 14.62)
 - mkdir 572 (time 1787625742.46 total 40.17 last 12.40)
 - mkdir 718 (time 1787625752.47 total 50.18 last 14.58)
 - mkdir 904 (time 1787625762.51 total 60.22 last 18.52)
total: 1000 mkdir in 67.45 seconds: 14.83 ops/second
 - mkdir 158 (time 1787625712.55 total 10.01 last 15.78)
 - mkdir 299 (time 1787625722.62 total 20.08 last 14.00)
 - mkdir 440 (time 1787625732.67 total 30.13 last 14.03)
 - mkdir 567 (time 1787625742.70 total 40.15 last 12.67)
 - mkdir 723 (time 1787625752.73 total 50.18 last 15.55)
 - mkdir 906 (time 1787625762.87 total 60.32 last 18.05)
total: 1000 mkdir in 67.35 seconds: 14.85 ops/second
 - mkdir 150 (time 1787625712.15 total 10.02 last 14.96)
 - mkdir 289 (time 1787625722.20 total 20.08 last 13.82)
 - mkdir 434 (time 1787625732.27 total 30.15 last 14.40)
 - mkdir 562 (time 1787625742.34 total 40.22 last 12.71)
 - mkdir 718 (time 1787625752.39 total 50.27 last 15.53)
 - mkdir 901 (time 1787625762.44 total 60.32 last 18.21)
total: 1000 mkdir in 67.92 seconds: 14.72 ops/second
 - mkdir 151 (time 1787625712.90 total 10.10 last 14.96)
 - mkdir 291 (time 1787625722.99 total 20.19 last 13.87)
 - mkdir 436 (time 1787625733.10 total 30.29 last 14.35)
 - mkdir 568 (time 1787625743.14 total 40.33 last 13.14)
 - mkdir 721 (time 1787625753.18 total 50.37 last 15.25)
 - mkdir 910 (time 1787625763.18 total 60.37 last 18.90)
total: 1000 mkdir in 67.69 seconds: 14.77 ops/second
 - mkdir 154 (time 1787625712.15 total 10.01 last 15.39)
 - mkdir 291 (time 1787625722.16 total 20.01 last 13.70)
 - mkdir 431 (time 1787625732.21 total 30.07 last 13.92)
 - mkdir 559 (time 1787625742.30 total 40.16 last 12.68)
 - mkdir 710 (time 1787625752.34 total 50.19 last 15.05)
 - mkdir 893 (time 1787625762.37 total 60.23 last 18.24)
total: 1000 mkdir in 68.55 seconds: 14.59 ops/second
 - mkdir 155 (time 1787625712.97 total 10.01 last 15.48)
 - mkdir 295 (time 1787625723.03 total 20.07 last 13.92)
 - mkdir 436 (time 1787625733.15 total 30.19 last 13.93)
 - mkdir 566 (time 1787625743.17 total 40.21 last 12.98)
 - mkdir 725 (time 1787625753.21 total 50.25 last 15.83)
 - mkdir 911 (time 1787625763.25 total 60.29 last 18.53)
total: 1000 mkdir in 67.89 seconds: 14.73 ops/second
 - mkdir 152 (time 1787625712.82 total 10.05 last 15.13)
 - mkdir 288 (time 1787625722.87 total 20.10 last 13.53)
 - mkdir 431 (time 1787625732.96 total 30.19 last 14.17)
 - mkdir 557 (time 1787625742.99 total 40.22 last 12.56)
 - mkdir 711 (time 1787625753.03 total 50.27 last 15.33)
 - mkdir 890 (time 1787625763.04 total 60.27 last 17.89)
total: 1000 mkdir in 69.45 seconds: 14.40 ops/second
Time for file creation 83 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787625781 ; total 0 ; last 0)
total: 1000 unlinks in 51 seconds: 19.607843 unlinks/second
 - unlinked 0 (time 1787625782 ; total 0 ; last 0)
total: 1000 unlinks in 54 seconds: 18.518518 unlinks/second
 - unlinked 0 (time 1787625783 ; total 0 ; last 0)
total: 1000 unlinks in 54 seconds: 18.518518 unlinks/second
 - unlinked 0 (time 1787625783 ; total 0 ; last 0)
total: 1000 unlinks in 54 seconds: 18.518518 unlinks/second
 - unlinked 0 (time 1787625783 ; total 0 ; last 0)
total: 1000 unlinks in 55 seconds: 18.181818 unlinks/second
 - unlinked 0 (time 1787625784 ; total 0 ; last 0)
total: 1000 unlinks in 54 seconds: 18.518518 unlinks/second
 - unlinked 0 (time 1787625783 ; total 0 ; last 0)
total: 1000 unlinks in 55 seconds: 18.181818 unlinks/second
 - unlinked 0 (time 1787625784 ; total 0 ; last 0)
total: 1000 unlinks in 54 seconds: 18.518518 unlinks/second
 - unlinked 0 (time 1787625783 ; total 0 ; last 0)
total: 1000 unlinks in 57 seconds: 17.543859 unlinks/second
 - unlinked 0 (time 1787625784 ; total 0 ; last 0)
total: 1000 unlinks in 56 seconds: 17.857143 unlinks/second
Time for file removal 68 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8