== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 23:24:48 (1787887488)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.48 seconds: 20.96 ops/second
 - mkdir 203 (time 1787887511.16 total 10.04 last 20.22)
 - mkdir 399 (time 1787887521.19 total 20.07 last 19.54)
 - mkdir 615 (time 1787887531.26 total 30.13 last 21.46)
 - mkdir 875 (time 1787887541.31 total 40.19 last 25.86)
total: 1000 mkdir in 45.42 seconds: 22.02 ops/second
 - mkdir 197 (time 1787887510.45 total 10.03 last 19.64)
 - mkdir 387 (time 1787887520.49 total 20.06 last 18.94)
 - mkdir 601 (time 1787887530.56 total 30.14 last 21.24)
 - mkdir 848 (time 1787887540.58 total 40.15 last 24.67)
total: 1000 mkdir in 46.31 seconds: 21.59 ops/second
 - mkdir 204 (time 1787887511.90 total 10.03 last 20.35)
 - mkdir 406 (time 1787887521.92 total 20.05 last 20.15)
 - mkdir 617 (time 1787887531.96 total 30.08 last 21.03)
 - mkdir 887 (time 1787887541.97 total 40.10 last 26.96)
total: 1000 mkdir in 45.29 seconds: 22.08 ops/second
 - mkdir 202 (time 1787887510.88 total 10.06 last 20.08)
 - mkdir 393 (time 1787887520.89 total 20.06 last 19.09)
 - mkdir 610 (time 1787887530.89 total 30.06 last 21.70)
 - mkdir 857 (time 1787887540.91 total 40.08 last 24.65)
total: 1000 mkdir in 46.37 seconds: 21.57 ops/second
 - mkdir 193 (time 1787887511.56 total 10.03 last 19.25)
 - mkdir 389 (time 1787887521.60 total 20.07 last 19.51)
 - mkdir 601 (time 1787887531.60 total 30.07 last 21.20)
 - mkdir 865 (time 1787887541.62 total 40.09 last 26.34)
total: 1000 mkdir in 46.41 seconds: 21.55 ops/second
 - mkdir 196 (time 1787887511.65 total 10.02 last 19.57)
 - mkdir 390 (time 1787887521.67 total 20.03 last 19.37)
 - mkdir 601 (time 1787887531.68 total 30.05 last 21.06)
 - mkdir 865 (time 1787887541.70 total 40.06 last 26.36)
total: 1000 mkdir in 47.00 seconds: 21.28 ops/second
 - mkdir 194 (time 1787887510.75 total 10.01 last 19.39)
 - mkdir 376 (time 1787887520.78 total 20.04 last 18.15)
 - mkdir 592 (time 1787887530.83 total 30.09 last 21.48)
 - mkdir 836 (time 1787887540.85 total 40.11 last 24.36)
total: 1000 mkdir in 48.25 seconds: 20.72 ops/second
 - mkdir 194 (time 1787887511.84 total 10.03 last 19.34)
 - mkdir 385 (time 1787887521.85 total 20.04 last 19.08)
 - mkdir 596 (time 1787887531.89 total 30.08 last 21.02)
 - mkdir 864 (time 1787887541.90 total 40.09 last 26.78)
total: 1000 mkdir in 47.40 seconds: 21.10 ops/second
 - mkdir 192 (time 1787887511.41 total 10.02 last 19.16)
 - mkdir 383 (time 1787887521.44 total 20.05 last 19.05)
 - mkdir 595 (time 1787887531.51 total 30.12 last 21.06)
 - mkdir 853 (time 1787887541.54 total 40.15 last 25.72)
total: 1000 mkdir in 48.17 seconds: 20.76 ops/second
 - mkdir 183 (time 1787887511.38 total 10.00 last 18.29)
 - mkdir 369 (time 1787887521.40 total 20.03 last 18.56)
 - mkdir 573 (time 1787887531.42 total 30.05 last 20.36)
 - mkdir 822 (time 1787887541.46 total 40.08 last 24.81)
 - mkdir 983 (time 1787887551.48 total 50.10 last 16.07)
total: 1000 mkdir in 51.00 seconds: 19.61 ops/second
Time for file creation 62 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.68 seconds: 14.76 ops/second
 - mkdir 172 (time 1787888088.39 total 10.05 last 17.12)
 - mkdir 397 (time 1787888098.41 total 20.07 last 22.45)
 - mkdir 587 (time 1787888108.49 total 30.15 last 18.84)
 - mkdir 798 (time 1787888118.53 total 40.19 last 21.03)
 - mkdir 964 (time 1787888128.54 total 50.20 last 16.58)
total: 1000 mkdir in 51.77 seconds: 19.31 ops/second
 - mkdir 161 (time 1787888087.82 total 10.04 last 16.04)
 - mkdir 390 (time 1787888097.84 total 20.07 last 22.83)
 - mkdir 569 (time 1787888107.92 total 30.14 last 17.77)
 - mkdir 776 (time 1787888117.94 total 40.17 last 20.64)
 - mkdir 932 (time 1787888127.96 total 50.18 last 15.58)
total: 1000 mkdir in 54.35 seconds: 18.40 ops/second
 - mkdir 160 (time 1787888087.24 total 10.06 last 15.91)
 - mkdir 377 (time 1787888097.27 total 20.09 last 21.63)
 - mkdir 557 (time 1787888107.29 total 30.12 last 17.95)
 - mkdir 763 (time 1787888117.30 total 40.12 last 20.59)
 - mkdir 928 (time 1787888127.37 total 50.19 last 16.39)
total: 1000 mkdir in 55.00 seconds: 18.18 ops/second
 - mkdir 162 (time 1787888088.13 total 10.01 last 16.18)
 - mkdir 381 (time 1787888098.14 total 20.02 last 21.88)
 - mkdir 562 (time 1787888108.16 total 30.04 last 18.07)
 - mkdir 768 (time 1787888118.18 total 40.06 last 20.55)
 - mkdir 929 (time 1787888128.25 total 50.13 last 16.00)
total: 1000 mkdir in 56.50 seconds: 17.70 ops/second
 - mkdir 167 (time 1787888088.42 total 10.04 last 16.64)
 - mkdir 386 (time 1787888098.44 total 20.06 last 21.85)
 - mkdir 569 (time 1787888108.47 total 30.09 last 18.24)
 - mkdir 773 (time 1787888118.49 total 40.11 last 20.37)
 - mkdir 930 (time 1787888128.51 total 50.13 last 15.67)
total: 1000 mkdir in 56.35 seconds: 17.75 ops/second
 - mkdir 159 (time 1787888087.87 total 10.03 last 15.85)
 - mkdir 375 (time 1787888097.91 total 20.07 last 21.52)
 - mkdir 557 (time 1787888107.92 total 30.08 last 18.17)
 - mkdir 765 (time 1787888117.96 total 40.12 last 20.73)
 - mkdir 918 (time 1787888128.00 total 50.16 last 15.24)
total: 1000 mkdir in 57.54 seconds: 17.38 ops/second
 - mkdir 164 (time 1787888088.67 total 10.03 last 16.35)
 - mkdir 388 (time 1787888098.69 total 20.05 last 22.37)
 - mkdir 569 (time 1787888108.70 total 30.06 last 18.08)
 - mkdir 773 (time 1787888118.71 total 40.06 last 20.38)
 - mkdir 926 (time 1787888128.71 total 50.07 last 15.29)
total: 1000 mkdir in 57.01 seconds: 17.54 ops/second
 - mkdir 164 (time 1787888088.19 total 10.02 last 16.36)
 - mkdir 381 (time 1787888098.21 total 20.05 last 21.65)
 - mkdir 563 (time 1787888108.22 total 30.05 last 18.19)
 - mkdir 763 (time 1787888118.25 total 40.08 last 19.93)
 - mkdir 919 (time 1787888128.30 total 50.14 last 15.52)
total: 1000 mkdir in 57.56 seconds: 17.37 ops/second
 - mkdir 155 (time 1787888087.42 total 10.04 last 15.44)
 - mkdir 369 (time 1787888097.43 total 20.05 last 21.38)
 - mkdir 543 (time 1787888107.43 total 30.05 last 17.40)
 - mkdir 748 (time 1787888117.44 total 40.06 last 20.48)
 - mkdir 905 (time 1787888127.47 total 50.08 last 15.66)
total: 1000 mkdir in 58.43 seconds: 17.12 ops/second
 - mkdir 153 (time 1787888088.61 total 10.04 last 15.24)
 - mkdir 370 (time 1787888098.63 total 20.07 last 21.64)
 - mkdir 544 (time 1787888108.64 total 30.07 last 17.39)
 - mkdir 739 (time 1787888118.65 total 40.09 last 19.47)
 - mkdir 889 (time 1787888128.67 total 50.10 last 14.98)
 - mkdir 997 (time 1787888138.68 total 60.12 last 10.78)
total: 1000 mkdir in 60.32 seconds: 16.58 ops/second
Time for file creation 75 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787888146 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787888148 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787888149 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8