== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 22:23:43 (1781231023)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.42 seconds: 23.77 ops/second
 - mkdir 215 (time 1781231043.95 total 10.00 last 21.49)
 - mkdir 454 (time 1781231053.96 total 20.02 last 23.87)
 - mkdir 683 (time 1781231063.98 total 30.03 last 22.86)
 - mkdir 915 (time 1781231074.00 total 40.06 last 23.14)
total: 1000 mkdir in 43.42 seconds: 23.03 ops/second
 - mkdir 245 (time 1781231044.79 total 10.01 last 24.48)
 - mkdir 480 (time 1781231054.84 total 20.07 last 23.36)
 - mkdir 707 (time 1781231064.85 total 30.07 last 22.69)
 - mkdir 937 (time 1781231074.86 total 40.08 last 22.97)
total: 1000 mkdir in 42.80 seconds: 23.36 ops/second
 - mkdir 246 (time 1781231045.08 total 10.03 last 24.52)
 - mkdir 469 (time 1781231055.11 total 20.07 last 22.22)
 - mkdir 703 (time 1781231065.13 total 30.08 last 23.37)
 - mkdir 937 (time 1781231075.13 total 40.08 last 23.40)
total: 1000 mkdir in 43.44 seconds: 23.02 ops/second
 - mkdir 256 (time 1781231045.86 total 10.01 last 25.57)
 - mkdir 481 (time 1781231055.89 total 20.05 last 22.42)
 - mkdir 722 (time 1781231065.91 total 30.07 last 24.05)
 - mkdir 958 (time 1781231075.95 total 40.10 last 23.52)
total: 1000 mkdir in 42.78 seconds: 23.37 ops/second
 - mkdir 242 (time 1781231045.09 total 10.01 last 24.18)
 - mkdir 462 (time 1781231055.12 total 20.03 last 21.95)
 - mkdir 692 (time 1781231065.13 total 30.04 last 22.98)
 - mkdir 928 (time 1781231075.14 total 40.05 last 23.58)
total: 1000 mkdir in 44.59 seconds: 22.43 ops/second
 - mkdir 254 (time 1781231045.70 total 10.04 last 25.29)
 - mkdir 479 (time 1781231055.73 total 20.08 last 22.42)
 - mkdir 717 (time 1781231065.74 total 30.09 last 23.78)
 - mkdir 945 (time 1781231075.77 total 40.12 last 22.73)
total: 1000 mkdir in 44.05 seconds: 22.70 ops/second
 - mkdir 253 (time 1781231045.62 total 10.03 last 25.22)
 - mkdir 471 (time 1781231055.63 total 20.04 last 21.78)
 - mkdir 708 (time 1781231065.67 total 30.08 last 23.61)
 - mkdir 940 (time 1781231075.72 total 40.14 last 23.08)
total: 1000 mkdir in 44.17 seconds: 22.64 ops/second
 - mkdir 258 (time 1781231045.89 total 10.00 last 25.79)
 - mkdir 482 (time 1781231055.94 total 20.05 last 22.30)
 - mkdir 718 (time 1781231065.97 total 30.08 last 23.53)
 - mkdir 946 (time 1781231075.98 total 40.09 last 22.78)
total: 1000 mkdir in 44.40 seconds: 22.52 ops/second
 - mkdir 251 (time 1781231045.43 total 10.06 last 24.96)
 - mkdir 469 (time 1781231055.51 total 20.13 last 21.64)
 - mkdir 696 (time 1781231065.54 total 30.16 last 22.63)
 - mkdir 933 (time 1781231075.54 total 40.17 last 23.69)
total: 1000 mkdir in 44.94 seconds: 22.25 ops/second
 - mkdir 232 (time 1781231044.85 total 10.02 last 23.15)
 - mkdir 451 (time 1781231054.85 total 20.02 last 21.90)
 - mkdir 669 (time 1781231064.87 total 30.04 last 21.76)
 - mkdir 903 (time 1781231074.88 total 40.06 last 23.37)
total: 1000 mkdir in 46.64 seconds: 21.44 ops/second
Time for file creation 57 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.69 seconds: 14.40 ops/second
 - mkdir 213 (time 1781231563.84 total 10.00 last 21.29)
 - mkdir 457 (time 1781231573.86 total 20.02 last 24.35)
 - mkdir 667 (time 1781231583.87 total 30.03 last 20.99)
 - mkdir 885 (time 1781231593.90 total 40.06 last 21.73)
total: 1000 mkdir in 44.08 seconds: 22.69 ops/second
 - mkdir 231 (time 1781231565.04 total 10.01 last 23.07)
 - mkdir 459 (time 1781231575.05 total 20.02 last 22.79)
 - mkdir 682 (time 1781231585.06 total 30.03 last 22.28)
 - mkdir 903 (time 1781231595.06 total 40.03 last 22.09)
total: 1000 mkdir in 44.05 seconds: 22.70 ops/second
 - mkdir 264 (time 1781231566.49 total 10.02 last 26.35)
 - mkdir 478 (time 1781231576.51 total 20.03 last 21.38)
 - mkdir 705 (time 1781231586.51 total 30.03 last 22.70)
 - mkdir 929 (time 1781231596.52 total 40.04 last 22.37)
total: 1000 mkdir in 44.43 seconds: 22.51 ops/second
 - mkdir 249 (time 1781231566.08 total 10.02 last 24.84)
 - mkdir 462 (time 1781231576.13 total 20.08 last 21.17)
 - mkdir 690 (time 1781231586.14 total 30.08 last 22.80)
 - mkdir 913 (time 1781231596.14 total 40.08 last 22.30)
total: 1000 mkdir in 45.50 seconds: 21.98 ops/second
 - mkdir 231 (time 1781231565.33 total 10.04 last 23.02)
 - mkdir 458 (time 1781231575.35 total 20.06 last 22.64)
 - mkdir 665 (time 1781231585.38 total 30.09 last 20.65)
 - mkdir 887 (time 1781231595.40 total 40.11 last 22.16)
total: 1000 mkdir in 46.83 seconds: 21.36 ops/second
 - mkdir 251 (time 1781231566.15 total 10.00 last 25.10)
 - mkdir 464 (time 1781231576.21 total 20.06 last 21.17)
 - mkdir 691 (time 1781231586.24 total 30.09 last 22.63)
 - mkdir 912 (time 1781231596.25 total 40.10 last 22.08)
total: 1000 mkdir in 46.05 seconds: 21.71 ops/second
 - mkdir 249 (time 1781231566.15 total 10.01 last 24.88)
 - mkdir 459 (time 1781231576.20 total 20.06 last 20.89)
 - mkdir 681 (time 1781231586.23 total 30.08 last 22.15)
 - mkdir 903 (time 1781231596.25 total 40.10 last 22.16)
total: 1000 mkdir in 46.97 seconds: 21.29 ops/second
 - mkdir 246 (time 1781231566.08 total 10.02 last 24.56)
 - mkdir 455 (time 1781231576.10 total 20.04 last 20.84)
 - mkdir 671 (time 1781231586.11 total 30.05 last 21.58)
 - mkdir 897 (time 1781231596.12 total 40.06 last 22.59)
total: 1000 mkdir in 47.35 seconds: 21.12 ops/second
 - mkdir 239 (time 1781231565.92 total 10.00 last 23.90)
 - mkdir 448 (time 1781231575.97 total 20.05 last 20.80)
 - mkdir 666 (time 1781231585.98 total 30.06 last 21.78)
 - mkdir 888 (time 1781231595.98 total 40.07 last 22.19)
total: 1000 mkdir in 48.10 seconds: 20.79 ops/second
 - mkdir 242 (time 1781231566.51 total 10.00 last 24.19)
 - mkdir 442 (time 1781231576.53 total 20.02 last 19.96)
 - mkdir 661 (time 1781231586.55 total 30.04 last 21.87)
 - mkdir 875 (time 1781231596.58 total 40.07 last 21.34)
total: 1000 mkdir in 49.33 seconds: 20.27 ops/second
Time for file creation 61 sec for 1 RPC sent at a time
 - unlinked 0 (time 1781231614 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781231614 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1781231616 ; total 1 ; last 1)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781231615 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1781231616 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781231615 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1781231615 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1781231616 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781231616 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1781231616 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8