== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 03:56:44 (1789459004)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.48 seconds: 20.96 ops/second
 - mkdir 208 (time 1789459025.07 total 10.00 last 20.79)
 - mkdir 413 (time 1789459035.07 total 20.00 last 20.50)
 - mkdir 611 (time 1789459045.09 total 30.02 last 19.76)
 - mkdir 780 (time 1789459055.14 total 40.08 last 16.81)
 - mkdir 966 (time 1789459065.15 total 50.08 last 18.59)
total: 1000 mkdir in 52.11 seconds: 19.19 ops/second
 - mkdir 203 (time 1789459025.86 total 10.03 last 20.24)
 - mkdir 403 (time 1789459035.89 total 20.05 last 19.95)
 - mkdir 603 (time 1789459045.90 total 30.07 last 19.97)
 - mkdir 768 (time 1789459055.92 total 40.08 last 16.48)
 - mkdir 959 (time 1789459065.92 total 50.08 last 19.10)
total: 1000 mkdir in 53.15 seconds: 18.81 ops/second
 - mkdir 201 (time 1789459025.57 total 10.07 last 19.96)
 - mkdir 400 (time 1789459035.59 total 20.09 last 19.86)
 - mkdir 596 (time 1789459045.61 total 30.12 last 19.55)
 - mkdir 764 (time 1789459055.70 total 40.20 last 16.65)
 - mkdir 953 (time 1789459065.77 total 50.27 last 18.78)
total: 1000 mkdir in 53.67 seconds: 18.63 ops/second
 - mkdir 199 (time 1789459025.31 total 10.03 last 19.83)
 - mkdir 400 (time 1789459035.36 total 20.09 last 20.00)
 - mkdir 592 (time 1789459045.39 total 30.11 last 19.14)
 - mkdir 757 (time 1789459055.42 total 40.14 last 16.45)
 - mkdir 950 (time 1789459065.54 total 50.26 last 19.08)
total: 1000 mkdir in 54.02 seconds: 18.51 ops/second
 - mkdir 204 (time 1789459025.79 total 10.05 last 20.29)
 - mkdir 397 (time 1789459035.79 total 20.06 last 19.29)
 - mkdir 595 (time 1789459045.82 total 30.08 last 19.75)
 - mkdir 765 (time 1789459055.86 total 40.13 last 16.92)
 - mkdir 953 (time 1789459065.87 total 50.14 last 18.79)
total: 1000 mkdir in 53.90 seconds: 18.55 ops/second
 - mkdir 201 (time 1789459025.73 total 10.00 last 20.09)
 - mkdir 398 (time 1789459035.80 total 20.08 last 19.56)
 - mkdir 594 (time 1789459045.82 total 30.10 last 19.55)
 - mkdir 758 (time 1789459055.87 total 40.15 last 16.32)
 - mkdir 948 (time 1789459065.87 total 50.15 last 18.99)
total: 1000 mkdir in 54.63 seconds: 18.30 ops/second
 - mkdir 193 (time 1789459024.67 total 10.05 last 19.21)
 - mkdir 384 (time 1789459034.67 total 20.06 last 19.08)
 - mkdir 567 (time 1789459044.69 total 30.07 last 18.27)
 - mkdir 733 (time 1789459054.74 total 40.12 last 16.52)
 - mkdir 927 (time 1789459064.79 total 50.18 last 19.29)
total: 1000 mkdir in 55.77 seconds: 17.93 ops/second
 - mkdir 199 (time 1789459025.20 total 10.01 last 19.88)
 - mkdir 388 (time 1789459035.21 total 20.02 last 18.88)
 - mkdir 580 (time 1789459045.23 total 30.04 last 19.16)
 - mkdir 747 (time 1789459055.24 total 40.05 last 16.69)
 - mkdir 935 (time 1789459065.26 total 50.07 last 18.76)
total: 1000 mkdir in 55.30 seconds: 18.08 ops/second
 - mkdir 206 (time 1789459025.74 total 10.04 last 20.52)
 - mkdir 396 (time 1789459035.75 total 20.04 last 18.98)
 - mkdir 594 (time 1789459045.82 total 30.12 last 19.66)
 - mkdir 757 (time 1789459055.84 total 40.14 last 16.27)
 - mkdir 943 (time 1789459065.85 total 50.14 last 18.58)
total: 1000 mkdir in 55.16 seconds: 18.13 ops/second
 - mkdir 199 (time 1789459025.00 total 10.01 last 19.88)
 - mkdir 387 (time 1789459035.06 total 20.07 last 18.69)
 - mkdir 575 (time 1789459045.12 total 30.14 last 18.67)
 - mkdir 742 (time 1789459055.17 total 40.18 last 16.62)
 - mkdir 927 (time 1789459065.18 total 50.19 last 18.49)
total: 1000 mkdir in 56.26 seconds: 17.78 ops/second
Time for file creation 66 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.44 seconds: 22.49 ops/second
 - mkdir 196 (time 1789459554.22 total 10.03 last 19.54)
 - mkdir 376 (time 1789459564.23 total 20.04 last 17.98)
 - mkdir 546 (time 1789459574.25 total 30.06 last 16.96)
 - mkdir 726 (time 1789459584.27 total 40.09 last 17.96)
 - mkdir 913 (time 1789459594.28 total 50.09 last 18.69)
total: 1000 mkdir in 54.94 seconds: 18.20 ops/second
 - mkdir 184 (time 1789459554.65 total 10.04 last 18.33)
 - mkdir 358 (time 1789459564.71 total 20.10 last 17.30)
 - mkdir 521 (time 1789459574.80 total 30.18 last 16.16)
 - mkdir 703 (time 1789459584.84 total 40.23 last 18.12)
 - mkdir 893 (time 1789459594.91 total 50.30 last 18.87)
total: 1000 mkdir in 57.71 seconds: 17.33 ops/second
 - mkdir 179 (time 1789459554.96 total 10.03 last 17.85)
 - mkdir 358 (time 1789459565.01 total 20.08 last 17.81)
 - mkdir 523 (time 1789459575.04 total 30.11 last 16.46)
 - mkdir 707 (time 1789459585.05 total 40.12 last 18.37)
 - mkdir 891 (time 1789459595.11 total 50.18 last 18.29)
total: 1000 mkdir in 57.65 seconds: 17.35 ops/second
 - mkdir 187 (time 1789459555.36 total 10.03 last 18.64)
 - mkdir 369 (time 1789459565.37 total 20.04 last 18.19)
 - mkdir 530 (time 1789459575.42 total 30.09 last 16.02)
 - mkdir 712 (time 1789459585.43 total 40.09 last 18.19)
 - mkdir 897 (time 1789459595.50 total 50.16 last 18.37)
total: 1000 mkdir in 57.26 seconds: 17.47 ops/second
 - mkdir 183 (time 1789459555.26 total 10.05 last 18.21)
 - mkdir 365 (time 1789459565.29 total 20.08 last 18.16)
 - mkdir 525 (time 1789459575.35 total 30.14 last 15.90)
 - mkdir 704 (time 1789459585.39 total 40.17 last 17.83)
 - mkdir 890 (time 1789459595.45 total 50.23 last 18.49)
total: 1000 mkdir in 58.07 seconds: 17.22 ops/second
 - mkdir 187 (time 1789459555.75 total 10.05 last 18.61)
 - mkdir 369 (time 1789459565.83 total 20.13 last 18.06)
 - mkdir 536 (time 1789459575.90 total 30.19 last 16.59)
 - mkdir 717 (time 1789459585.93 total 40.22 last 18.05)
 - mkdir 894 (time 1789459596.00 total 50.30 last 17.56)
total: 1000 mkdir in 57.91 seconds: 17.27 ops/second
 - mkdir 183 (time 1789459555.42 total 10.01 last 18.27)
 - mkdir 360 (time 1789459565.44 total 20.04 last 17.65)
 - mkdir 521 (time 1789459575.46 total 30.06 last 16.07)
 - mkdir 701 (time 1789459585.46 total 40.06 last 18.00)
 - mkdir 886 (time 1789459595.49 total 50.09 last 18.44)
total: 1000 mkdir in 58.29 seconds: 17.15 ops/second
 - mkdir 189 (time 1789459555.87 total 10.01 last 18.89)
 - mkdir 369 (time 1789459565.90 total 20.05 last 17.93)
 - mkdir 531 (time 1789459575.91 total 30.05 last 16.19)
 - mkdir 712 (time 1789459585.93 total 40.07 last 18.07)
 - mkdir 891 (time 1789459596.00 total 50.14 last 17.77)
total: 1000 mkdir in 58.35 seconds: 17.14 ops/second
 - mkdir 182 (time 1789459555.66 total 10.03 last 18.15)
 - mkdir 354 (time 1789459565.75 total 20.12 last 17.04)
 - mkdir 515 (time 1789459575.76 total 30.13 last 16.09)
 - mkdir 695 (time 1789459585.78 total 40.15 last 17.96)
 - mkdir 877 (time 1789459595.79 total 50.16 last 18.18)
total: 1000 mkdir in 59.15 seconds: 16.91 ops/second
 - mkdir 186 (time 1789459555.67 total 10.02 last 18.56)
 - mkdir 357 (time 1789459565.68 total 20.03 last 17.09)
 - mkdir 512 (time 1789459575.69 total 30.05 last 15.48)
 - mkdir 696 (time 1789459585.71 total 40.07 last 18.36)
 - mkdir 881 (time 1789459595.76 total 50.11 last 18.42)
total: 1000 mkdir in 59.23 seconds: 16.88 ops/second
Time for file creation 69 sec for 1 RPC sent at a time
 - unlinked 0 (time 1789459611 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789459612 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789459612 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789459612 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789459613 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1789459613 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1789459612 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789459612 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789459613 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1789459612 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 41 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8