== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 01:31:14 (1772433074)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.67 seconds: 14.95 ops/second
 - mkdir 210 (time 1772433095.12 total 10.01 last 20.97)
 - mkdir 451 (time 1772433105.21 total 20.11 last 23.87)
 - mkdir 705 (time 1772433115.23 total 30.13 last 25.36)
 - mkdir 954 (time 1772433125.29 total 40.19 last 24.75)
total: 1000 mkdir in 41.79 seconds: 23.93 ops/second
 - mkdir 198 (time 1772433093.63 total 10.02 last 19.77)
 - mkdir 430 (time 1772433103.68 total 20.07 last 23.09)
 - mkdir 677 (time 1772433113.71 total 30.10 last 24.61)
 - mkdir 925 (time 1772433123.79 total 40.17 last 24.62)
total: 1000 mkdir in 43.67 seconds: 22.90 ops/second
 - mkdir 197 (time 1772433094.39 total 10.00 last 19.70)
 - mkdir 435 (time 1772433104.41 total 20.01 last 23.77)
 - mkdir 688 (time 1772433114.42 total 30.03 last 25.26)
 - mkdir 933 (time 1772433124.44 total 40.05 last 24.44)
total: 1000 mkdir in 43.55 seconds: 22.96 ops/second
 - mkdir 198 (time 1772433094.69 total 10.04 last 19.73)
 - mkdir 444 (time 1772433104.71 total 20.06 last 24.54)
 - mkdir 691 (time 1772433114.74 total 30.09 last 24.63)
 - mkdir 929 (time 1772433124.77 total 40.12 last 23.73)
total: 1000 mkdir in 44.05 seconds: 22.70 ops/second
 - mkdir 203 (time 1772433095.03 total 10.01 last 20.28)
 - mkdir 437 (time 1772433105.08 total 20.06 last 23.29)
 - mkdir 692 (time 1772433115.11 total 30.09 last 25.42)
 - mkdir 932 (time 1772433125.17 total 40.14 last 23.86)
total: 1000 mkdir in 44.00 seconds: 22.73 ops/second
 - mkdir 202 (time 1772433095.20 total 10.00 last 20.20)
 - mkdir 442 (time 1772433105.27 total 20.07 last 23.84)
 - mkdir 692 (time 1772433115.27 total 30.07 last 25.00)
 - mkdir 937 (time 1772433125.33 total 40.13 last 24.35)
total: 1000 mkdir in 43.84 seconds: 22.81 ops/second
 - mkdir 199 (time 1772433095.02 total 10.06 last 19.77)
 - mkdir 435 (time 1772433105.08 total 20.13 last 23.45)
 - mkdir 684 (time 1772433115.09 total 30.13 last 24.90)
 - mkdir 929 (time 1772433125.13 total 40.18 last 24.39)
total: 1000 mkdir in 44.16 seconds: 22.64 ops/second
 - mkdir 185 (time 1772433094.15 total 10.02 last 18.46)
 - mkdir 417 (time 1772433104.15 total 20.02 last 23.20)
 - mkdir 673 (time 1772433114.18 total 30.06 last 25.51)
 - mkdir 914 (time 1772433124.22 total 40.10 last 24.01)
total: 1000 mkdir in 45.21 seconds: 22.12 ops/second
 - mkdir 199 (time 1772433094.93 total 10.00 last 19.89)
 - mkdir 437 (time 1772433104.96 total 20.04 last 23.71)
 - mkdir 684 (time 1772433115.05 total 30.13 last 24.48)
 - mkdir 926 (time 1772433125.06 total 40.13 last 24.19)
total: 1000 mkdir in 44.86 seconds: 22.29 ops/second
 - mkdir 191 (time 1772433095.48 total 10.06 last 18.99)
 - mkdir 421 (time 1772433105.50 total 20.08 last 22.95)
 - mkdir 672 (time 1772433115.51 total 30.09 last 25.08)
 - mkdir 899 (time 1772433125.56 total 40.13 last 22.59)
total: 1000 mkdir in 46.51 seconds: 21.50 ops/second
Time for file creation 56 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 10 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.45 seconds: 22.31 ops/second
 - mkdir 232 (time 1772433585.91 total 10.04 last 23.11)
 - mkdir 418 (time 1772433595.94 total 20.07 last 18.55)
 - mkdir 715 (time 1772433605.96 total 30.09 last 29.63)
 - mkdir 954 (time 1772433615.99 total 40.12 last 23.84)
total: 1000 mkdir in 42.07 seconds: 23.77 ops/second
 - mkdir 220 (time 1772433585.01 total 10.04 last 21.92)
 - mkdir 398 (time 1772433595.03 total 20.05 last 17.78)
 - mkdir 682 (time 1772433605.03 total 30.05 last 28.38)
 - mkdir 912 (time 1772433615.06 total 40.08 last 22.95)
total: 1000 mkdir in 44.53 seconds: 22.46 ops/second
 - mkdir 232 (time 1772433585.28 total 10.04 last 23.11)
 - mkdir 406 (time 1772433595.32 total 20.08 last 17.33)
 - mkdir 686 (time 1772433605.34 total 30.09 last 27.96)
 - mkdir 918 (time 1772433615.34 total 40.10 last 23.19)
total: 1000 mkdir in 44.32 seconds: 22.56 ops/second
 - mkdir 228 (time 1772433585.50 total 10.02 last 22.75)
 - mkdir 402 (time 1772433595.53 total 20.05 last 17.36)
 - mkdir 689 (time 1772433605.53 total 30.05 last 28.70)
 - mkdir 926 (time 1772433615.54 total 40.06 last 23.66)
total: 1000 mkdir in 44.33 seconds: 22.56 ops/second
 - mkdir 226 (time 1772433584.70 total 10.01 last 22.58)
 - mkdir 399 (time 1772433594.73 total 20.04 last 17.24)
 - mkdir 677 (time 1772433604.74 total 30.05 last 27.77)
 - mkdir 899 (time 1772433614.76 total 40.07 last 22.15)
total: 1000 mkdir in 45.57 seconds: 21.95 ops/second
 - mkdir 225 (time 1772433585.41 total 10.07 last 22.34)
 - mkdir 404 (time 1772433595.49 total 20.15 last 17.76)
 - mkdir 689 (time 1772433605.50 total 30.16 last 28.48)
 - mkdir 919 (time 1772433615.51 total 40.17 last 22.96)
total: 1000 mkdir in 45.03 seconds: 22.21 ops/second
 - mkdir 221 (time 1772433585.17 total 10.03 last 22.04)
 - mkdir 398 (time 1772433595.20 total 20.05 last 17.65)
 - mkdir 670 (time 1772433605.23 total 30.08 last 27.12)
 - mkdir 903 (time 1772433615.23 total 40.09 last 23.29)
total: 1000 mkdir in 45.55 seconds: 21.95 ops/second
 - mkdir 222 (time 1772433585.67 total 10.04 last 22.10)
 - mkdir 388 (time 1772433595.68 total 20.05 last 16.58)
 - mkdir 672 (time 1772433605.69 total 30.07 last 28.35)
 - mkdir 903 (time 1772433615.72 total 40.09 last 23.05)
total: 1000 mkdir in 48.11 seconds: 20.79 ops/second
 - mkdir 217 (time 1772433585.55 total 10.05 last 21.58)
 - mkdir 382 (time 1772433595.57 total 20.07 last 16.47)
 - mkdir 662 (time 1772433605.60 total 30.10 last 27.92)
 - mkdir 890 (time 1772433615.62 total 40.13 last 22.75)
total: 1000 mkdir in 48.84 seconds: 20.48 ops/second
 - mkdir 219 (time 1772433585.63 total 10.02 last 21.85)
 - mkdir 383 (time 1772433595.63 total 20.03 last 16.40)
 - mkdir 666 (time 1772433605.65 total 30.05 last 28.24)
 - mkdir 893 (time 1772433615.69 total 40.09 last 22.60)
total: 1000 mkdir in 48.87 seconds: 20.46 ops/second
Time for file creation 58 sec for 1 RPC sent at a time
 - unlinked 0 (time 1772433637 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1772433638 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1772433638 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1772433638 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1772433640 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1772433639 ; total 0 ; last 0)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1772433639 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1772433639 ; total 0 ; last 0)
total: 1000 unlinks in 39 seconds: 25.641026 unlinks/second
 - unlinked 0 (time 1772433640 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
 - unlinked 0 (time 1772433640 ; total 0 ; last 0)
total: 1000 unlinks in 40 seconds: 25.000000 unlinks/second
Time for file removal 57 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8