== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 22:49:55 (1781232595)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.52 seconds: 19.07 ops/second
 - mkdir 191 (time 1781232613.86 total 10.01 last 19.08)
 - mkdir 415 (time 1781232623.87 total 20.02 last 22.38)
 - mkdir 684 (time 1781232633.89 total 30.04 last 26.85)
 - mkdir 897 (time 1781232643.90 total 40.05 last 21.27)
total: 1000 mkdir in 45.33 seconds: 22.06 ops/second
 - mkdir 200 (time 1781232615.76 total 10.02 last 19.95)
 - mkdir 445 (time 1781232625.78 total 20.04 last 24.46)
 - mkdir 703 (time 1781232635.80 total 30.06 last 25.74)
 - mkdir 927 (time 1781232645.82 total 40.08 last 22.36)
total: 1000 mkdir in 43.95 seconds: 22.75 ops/second
 - mkdir 208 (time 1781232617.07 total 10.00 last 20.79)
 - mkdir 449 (time 1781232627.10 total 20.03 last 24.04)
 - mkdir 719 (time 1781232637.12 total 30.05 last 26.94)
 - mkdir 922 (time 1781232647.16 total 40.09 last 20.21)
total: 1000 mkdir in 46.41 seconds: 21.55 ops/second
 - mkdir 211 (time 1781232617.47 total 10.01 last 21.08)
 - mkdir 459 (time 1781232627.47 total 20.02 last 24.79)
 - mkdir 716 (time 1781232637.51 total 30.05 last 25.62)
 - mkdir 921 (time 1781232647.53 total 40.07 last 20.45)
total: 1000 mkdir in 47.33 seconds: 21.13 ops/second
 - mkdir 201 (time 1781232616.95 total 10.02 last 20.05)
 - mkdir 440 (time 1781232626.96 total 20.03 last 23.88)
 - mkdir 700 (time 1781232636.96 total 30.04 last 25.99)
 - mkdir 904 (time 1781232646.98 total 40.05 last 20.37)
total: 1000 mkdir in 48.43 seconds: 20.65 ops/second
 - mkdir 206 (time 1781232618.07 total 10.08 last 20.44)
 - mkdir 459 (time 1781232628.09 total 20.10 last 25.26)
 - mkdir 725 (time 1781232638.09 total 30.10 last 26.60)
 - mkdir 925 (time 1781232648.11 total 40.12 last 19.96)
total: 1000 mkdir in 47.61 seconds: 21.00 ops/second
 - mkdir 209 (time 1781232618.03 total 10.01 last 20.87)
 - mkdir 460 (time 1781232628.06 total 20.04 last 25.03)
 - mkdir 728 (time 1781232638.08 total 30.06 last 26.74)
 - mkdir 928 (time 1781232648.11 total 40.09 last 19.95)
total: 1000 mkdir in 47.71 seconds: 20.96 ops/second
 - mkdir 208 (time 1781232618.05 total 10.07 last 20.66)
 - mkdir 454 (time 1781232628.07 total 20.08 last 24.57)
 - mkdir 720 (time 1781232638.13 total 30.15 last 26.43)
 - mkdir 920 (time 1781232648.17 total 40.19 last 19.92)
total: 1000 mkdir in 48.55 seconds: 20.60 ops/second
 - mkdir 204 (time 1781232617.91 total 10.05 last 20.30)
 - mkdir 449 (time 1781232627.92 total 20.06 last 24.47)
 - mkdir 705 (time 1781232637.93 total 30.08 last 25.56)
 - mkdir 906 (time 1781232647.96 total 40.11 last 20.04)
total: 1000 mkdir in 48.79 seconds: 20.50 ops/second
 - mkdir 200 (time 1781232617.43 total 10.04 last 19.92)
 - mkdir 430 (time 1781232627.45 total 20.07 last 22.94)
 - mkdir 688 (time 1781232637.47 total 30.09 last 25.74)
 - mkdir 886 (time 1781232647.49 total 40.11 last 19.77)
 - mkdir 993 (time 1781232657.52 total 50.14 last 10.66)
total: 1000 mkdir in 50.55 seconds: 19.78 ops/second
Time for file creation 61 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.49 seconds: 20.60 ops/second
 - mkdir 203 (time 1781233159.37 total 10.00 last 20.30)
 - mkdir 403 (time 1781233169.38 total 20.02 last 19.97)
 - mkdir 671 (time 1781233179.39 total 30.03 last 26.77)
 - mkdir 923 (time 1781233189.42 total 40.05 last 25.13)
total: 1000 mkdir in 42.85 seconds: 23.34 ops/second
 - mkdir 188 (time 1781233158.54 total 10.04 last 18.73)
 - mkdir 390 (time 1781233168.56 total 20.06 last 20.16)
 - mkdir 648 (time 1781233178.60 total 30.10 last 25.68)
 - mkdir 902 (time 1781233188.64 total 40.14 last 25.30)
total: 1000 mkdir in 44.39 seconds: 22.53 ops/second
 - mkdir 200 (time 1781233160.14 total 10.01 last 19.97)
 - mkdir 392 (time 1781233170.16 total 20.03 last 19.17)
 - mkdir 656 (time 1781233180.18 total 30.05 last 26.34)
 - mkdir 917 (time 1781233190.20 total 40.07 last 26.06)
total: 1000 mkdir in 44.74 seconds: 22.35 ops/second
 - mkdir 202 (time 1781233160.12 total 10.01 last 20.17)
 - mkdir 394 (time 1781233170.14 total 20.04 last 19.16)
 - mkdir 656 (time 1781233180.15 total 30.05 last 26.17)
 - mkdir 915 (time 1781233190.19 total 40.08 last 25.82)
total: 1000 mkdir in 44.84 seconds: 22.30 ops/second
 - mkdir 203 (time 1781233160.27 total 10.03 last 20.24)
 - mkdir 389 (time 1781233170.28 total 20.04 last 18.59)
 - mkdir 654 (time 1781233180.30 total 30.05 last 26.45)
 - mkdir 921 (time 1781233190.31 total 40.07 last 26.65)
total: 1000 mkdir in 44.74 seconds: 22.35 ops/second
 - mkdir 200 (time 1781233159.81 total 10.02 last 19.96)
 - mkdir 389 (time 1781233169.85 total 20.07 last 18.81)
 - mkdir 650 (time 1781233179.86 total 30.08 last 26.08)
 - mkdir 908 (time 1781233189.87 total 40.08 last 25.78)
total: 1000 mkdir in 45.40 seconds: 22.03 ops/second
 - mkdir 207 (time 1781233160.48 total 10.00 last 20.69)
 - mkdir 392 (time 1781233170.53 total 20.05 last 18.41)
 - mkdir 661 (time 1781233180.55 total 30.07 last 26.85)
 - mkdir 923 (time 1781233190.58 total 40.10 last 26.12)
total: 1000 mkdir in 45.13 seconds: 22.16 ops/second
 - mkdir 208 (time 1781233160.44 total 10.02 last 20.76)
 - mkdir 395 (time 1781233170.49 total 20.07 last 18.61)
 - mkdir 665 (time 1781233180.51 total 30.08 last 26.95)
 - mkdir 918 (time 1781233190.55 total 40.12 last 25.20)
total: 1000 mkdir in 45.87 seconds: 21.80 ops/second
 - mkdir 199 (time 1781233160.14 total 10.03 last 19.83)
 - mkdir 390 (time 1781233170.15 total 20.04 last 19.10)
 - mkdir 653 (time 1781233180.17 total 30.06 last 26.25)
 - mkdir 907 (time 1781233190.17 total 40.06 last 25.39)
total: 1000 mkdir in 46.33 seconds: 21.59 ops/second
 - mkdir 187 (time 1781233159.80 total 10.03 last 18.64)
 - mkdir 373 (time 1781233169.83 total 20.05 last 18.56)
 - mkdir 626 (time 1781233179.85 total 30.08 last 25.24)
 - mkdir 885 (time 1781233189.87 total 40.09 last 25.86)
total: 1000 mkdir in 47.79 seconds: 20.92 ops/second
Time for file creation 58 sec for 1 RPC sent at a time
 - unlinked 0 (time 1781233209 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1781233208 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1781233208 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233209 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233210 ; total 1 ; last 1)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233210 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1781233210 ; total 1 ; last 1)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233210 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233210 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781233209 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 44 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8