== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 09:11:58 (1743513118)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.24 seconds: 41.09 ops/second
 - mkdir 178 (time 1743513155.14 total 10.03 last 17.75)
 - mkdir 429 (time 1743513165.14 total 20.03 last 25.08)
 - mkdir 663 (time 1743513175.16 total 30.05 last 23.36)
 - mkdir 900 (time 1743513185.18 total 40.07 last 23.66)
total: 1000 mkdir in 43.98 seconds: 22.74 ops/second
 - mkdir 185 (time 1743513155.36 total 10.06 last 18.38)
 - mkdir 437 (time 1743513165.38 total 20.08 last 25.16)
 - mkdir 669 (time 1743513175.42 total 30.12 last 23.10)
 - mkdir 904 (time 1743513185.43 total 40.13 last 23.49)
total: 1000 mkdir in 44.11 seconds: 22.67 ops/second
 - mkdir 184 (time 1743513155.91 total 10.01 last 18.39)
 - mkdir 435 (time 1743513165.93 total 20.03 last 25.04)
 - mkdir 670 (time 1743513175.94 total 30.04 last 23.48)
 - mkdir 912 (time 1743513185.99 total 40.08 last 24.10)
total: 1000 mkdir in 43.57 seconds: 22.95 ops/second
 - mkdir 183 (time 1743513155.95 total 10.00 last 18.30)
 - mkdir 434 (time 1743513165.97 total 20.02 last 25.06)
 - mkdir 667 (time 1743513175.99 total 30.04 last 23.25)
 - mkdir 909 (time 1743513186.02 total 40.08 last 24.11)
total: 1000 mkdir in 44.31 seconds: 22.57 ops/second
 - mkdir 198 (time 1743513158.87 total 10.04 last 19.72)
 - mkdir 460 (time 1743513168.90 total 20.07 last 26.12)
 - mkdir 696 (time 1743513178.90 total 30.08 last 23.59)
 - mkdir 943 (time 1743513188.94 total 40.11 last 24.62)
total: 1000 mkdir in 47.57 seconds: 21.02 ops/second
 - mkdir 217 (time 1743513160.42 total 10.02 last 21.66)
 - mkdir 482 (time 1743513170.46 total 20.06 last 26.37)
 - mkdir 721 (time 1743513180.48 total 30.08 last 23.86)
 - mkdir 953 (time 1743513190.54 total 40.14 last 23.06)
total: 1000 mkdir in 47.14 seconds: 21.21 ops/second
 - mkdir 205 (time 1743513159.52 total 10.03 last 20.44)
 - mkdir 470 (time 1743513169.55 total 20.05 last 26.43)
 - mkdir 705 (time 1743513179.57 total 30.08 last 23.44)
 - mkdir 945 (time 1743513189.59 total 40.09 last 23.96)
total: 1000 mkdir in 48.52 seconds: 20.61 ops/second
 - mkdir 211 (time 1743513160.14 total 10.02 last 21.06)
 - mkdir 477 (time 1743513170.15 total 20.02 last 26.59)
 - mkdir 710 (time 1743513180.16 total 30.04 last 23.27)
 - mkdir 943 (time 1743513190.28 total 40.16 last 23.01)
total: 1000 mkdir in 48.09 seconds: 20.79 ops/second
 - mkdir 214 (time 1743513160.49 total 10.03 last 21.34)
 - mkdir 480 (time 1743513170.50 total 20.04 last 26.56)
 - mkdir 714 (time 1743513180.56 total 30.10 last 23.27)
 - mkdir 943 (time 1743513190.80 total 40.34 last 22.37)
total: 1000 mkdir in 48.13 seconds: 20.78 ops/second
 - mkdir 208 (time 1743513160.64 total 10.02 last 20.75)
 - mkdir 467 (time 1743513170.68 total 20.06 last 25.80)
 - mkdir 697 (time 1743513180.72 total 30.10 last 22.92)
 - mkdir 921 (time 1743513190.84 total 40.22 last 22.13)
total: 1000 mkdir in 49.85 seconds: 20.06 ops/second
Time for file creation 86 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 43 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.22 seconds: 44.73 ops/second
 - mkdir 247 (time 1743513536.09 total 10.04 last 24.61)
 - mkdir 464 (time 1743513546.13 total 20.08 last 21.61)
 - mkdir 674 (time 1743513556.15 total 30.10 last 20.96)
 - mkdir 890 (time 1743513566.19 total 40.14 last 21.51)
total: 1000 mkdir in 45.27 seconds: 22.09 ops/second
 - mkdir 243 (time 1743513538.48 total 10.03 last 24.23)
 - mkdir 468 (time 1743513548.48 total 20.03 last 22.49)
 - mkdir 689 (time 1743513558.51 total 30.06 last 22.04)
 - mkdir 912 (time 1743513568.54 total 40.10 last 22.22)
total: 1000 mkdir in 46.83 seconds: 21.35 ops/second
 - mkdir 246 (time 1743513537.81 total 10.05 last 24.49)
 - mkdir 460 (time 1743513547.86 total 20.09 last 21.30)
 - mkdir 673 (time 1743513557.89 total 30.13 last 21.23)
 - mkdir 898 (time 1743513567.92 total 40.16 last 22.44)
total: 1000 mkdir in 47.77 seconds: 20.93 ops/second
 - mkdir 251 (time 1743513536.85 total 10.01 last 25.08)
 - mkdir 455 (time 1743513546.87 total 20.03 last 20.35)
 - mkdir 666 (time 1743513556.90 total 30.06 last 21.03)
 - mkdir 875 (time 1743513566.95 total 40.11 last 20.80)
total: 1000 mkdir in 49.11 seconds: 20.36 ops/second
 - mkdir 241 (time 1743513538.76 total 10.04 last 24.01)
 - mkdir 457 (time 1743513548.81 total 20.09 last 21.49)
 - mkdir 675 (time 1743513558.82 total 30.10 last 21.78)
 - mkdir 891 (time 1743513568.83 total 40.11 last 21.58)
total: 1000 mkdir in 50.10 seconds: 19.96 ops/second
 - mkdir 250 (time 1743513539.18 total 10.00 last 24.99)
 - mkdir 470 (time 1743513549.19 total 20.01 last 21.98)
 - mkdir 687 (time 1743513559.23 total 30.05 last 21.62)
 - mkdir 902 (time 1743513569.26 total 40.09 last 21.42)
total: 1000 mkdir in 49.68 seconds: 20.13 ops/second
 - mkdir 248 (time 1743513539.11 total 10.02 last 24.75)
 - mkdir 465 (time 1743513549.15 total 20.06 last 21.62)
 - mkdir 687 (time 1743513559.15 total 30.06 last 22.19)
 - mkdir 902 (time 1743513569.17 total 40.07 last 21.47)
total: 1000 mkdir in 49.85 seconds: 20.06 ops/second
 - mkdir 238 (time 1743513538.50 total 10.00 last 23.79)
 - mkdir 454 (time 1743513548.54 total 20.04 last 21.52)
 - mkdir 667 (time 1743513558.56 total 30.06 last 21.25)
 - mkdir 882 (time 1743513568.57 total 40.07 last 21.48)
 - mkdir 992 (time 1743513578.63 total 50.13 last 10.94)
total: 1000 mkdir in 51.10 seconds: 19.57 ops/second
 - mkdir 234 (time 1743513538.45 total 10.03 last 23.33)
 - mkdir 446 (time 1743513548.51 total 20.08 last 21.09)
 - mkdir 660 (time 1743513558.53 total 30.11 last 21.35)
 - mkdir 873 (time 1743513568.53 total 40.11 last 21.29)
 - mkdir 982 (time 1743513578.60 total 50.18 last 10.82)
total: 1000 mkdir in 52.37 seconds: 19.09 ops/second
 - mkdir 240 (time 1743513538.91 total 10.01 last 23.98)
 - mkdir 450 (time 1743513548.93 total 20.02 last 20.97)
 - mkdir 667 (time 1743513558.96 total 30.06 last 21.63)
 - mkdir 875 (time 1743513568.98 total 40.07 last 20.77)
 - mkdir 983 (time 1743513579.07 total 50.17 last 10.70)
total: 1000 mkdir in 52.03 seconds: 19.22 ops/second
Time for file creation 76 sec for 1 RPC sent at a time
 - unlinked 0 (time 1743513598 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1743513599 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1743513599 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1743513599 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1743513601 ; total 0 ; last 0)
total: 1000 unlinks in 23 seconds: 43.478260 unlinks/second
 - unlinked 0 (time 1743513601 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1743513601 ; total 0 ; last 0)
total: 1000 unlinks in 24 seconds: 41.666668 unlinks/second
 - unlinked 0 (time 1743513601 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1743513601 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
 - unlinked 0 (time 1743513601 ; total 0 ; last 0)
total: 1000 unlinks in 25 seconds: 40.000000 unlinks/second
Time for file removal 52 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8