== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 14:21:59 (1787595719)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.53 seconds: 18.99 ops/second
 - mkdir 131 (time 1787595743.28 total 10.09 last 12.99)
 - mkdir 254 (time 1787595753.31 total 20.12 last 12.26)
 - mkdir 389 (time 1787595763.38 total 30.18 last 13.42)
 - mkdir 550 (time 1787595773.40 total 40.21 last 16.06)
 - mkdir 728 (time 1787595783.42 total 50.22 last 17.78)
 - mkdir 903 (time 1787595793.43 total 60.24 last 17.48)
total: 1000 mkdir in 65.97 seconds: 15.16 ops/second
 - mkdir 133 (time 1787595744.11 total 10.02 last 13.28)
 - mkdir 253 (time 1787595754.12 total 20.02 last 11.99)
 - mkdir 397 (time 1787595764.18 total 30.08 last 14.32)
 - mkdir 559 (time 1787595774.20 total 40.10 last 16.16)
 - mkdir 732 (time 1787595784.22 total 50.12 last 17.27)
 - mkdir 906 (time 1787595794.27 total 60.17 last 17.31)
total: 1000 mkdir in 66.74 seconds: 14.98 ops/second
 - mkdir 117 (time 1787595741.11 total 10.03 last 11.67)
 - mkdir 225 (time 1787595751.12 total 20.04 last 10.78)
 - mkdir 365 (time 1787595761.14 total 30.06 last 13.98)
 - mkdir 515 (time 1787595771.22 total 40.14 last 14.88)
 - mkdir 688 (time 1787595781.22 total 50.14 last 17.30)
 - mkdir 866 (time 1787595791.23 total 60.15 last 17.78)
total: 1000 mkdir in 70.11 seconds: 14.26 ops/second
 - mkdir 131 (time 1787595744.11 total 10.01 last 13.08)
 - mkdir 252 (time 1787595754.12 total 20.03 last 12.08)
 - mkdir 386 (time 1787595764.19 total 30.09 last 13.31)
 - mkdir 549 (time 1787595774.23 total 40.13 last 16.25)
 - mkdir 725 (time 1787595784.24 total 50.14 last 17.58)
 - mkdir 899 (time 1787595794.26 total 60.16 last 17.36)
total: 1000 mkdir in 67.46 seconds: 14.82 ops/second
 - mkdir 124 (time 1787595743.36 total 10.08 last 12.31)
 - mkdir 239 (time 1787595753.39 total 20.10 last 11.47)
 - mkdir 378 (time 1787595763.48 total 30.20 last 13.77)
 - mkdir 545 (time 1787595773.55 total 40.26 last 16.60)
 - mkdir 718 (time 1787595783.58 total 50.29 last 17.24)
 - mkdir 890 (time 1787595793.63 total 60.34 last 17.12)
total: 1000 mkdir in 69.09 seconds: 14.47 ops/second
 - mkdir 131 (time 1787595744.88 total 10.01 last 13.09)
 - mkdir 261 (time 1787595754.93 total 20.06 last 12.93)
 - mkdir 402 (time 1787595764.95 total 30.08 last 14.07)
 - mkdir 563 (time 1787595774.97 total 40.10 last 16.07)
 - mkdir 737 (time 1787595784.98 total 50.11 last 17.38)
 - mkdir 904 (time 1787595794.99 total 60.12 last 16.68)
total: 1000 mkdir in 67.99 seconds: 14.71 ops/second
 - mkdir 116 (time 1787595741.47 total 10.03 last 11.56)
 - mkdir 221 (time 1787595751.49 total 20.05 last 10.49)
 - mkdir 357 (time 1787595761.49 total 30.05 last 13.59)
 - mkdir 507 (time 1787595771.52 total 40.08 last 14.96)
 - mkdir 678 (time 1787595781.56 total 50.12 last 17.02)
 - mkdir 857 (time 1787595791.58 total 60.14 last 17.87)
 - mkdir 990 (time 1787595801.64 total 70.20 last 13.22)
total: 1000 mkdir in 71.60 seconds: 13.97 ops/second
 - mkdir 126 (time 1787595743.87 total 10.03 last 12.56)
 - mkdir 244 (time 1787595753.89 total 20.05 last 11.77)
 - mkdir 383 (time 1787595763.93 total 30.09 last 13.85)
 - mkdir 543 (time 1787595773.96 total 40.13 last 15.94)
 - mkdir 714 (time 1787595784.01 total 50.17 last 17.02)
 - mkdir 887 (time 1787595794.02 total 60.18 last 17.29)
total: 1000 mkdir in 69.33 seconds: 14.42 ops/second
 - mkdir 130 (time 1787595744.43 total 10.01 last 12.99)
 - mkdir 247 (time 1787595754.44 total 20.02 last 11.69)
 - mkdir 387 (time 1787595764.48 total 30.06 last 13.94)
 - mkdir 547 (time 1787595774.49 total 40.07 last 15.99)
 - mkdir 719 (time 1787595784.52 total 50.10 last 17.14)
 - mkdir 894 (time 1787595794.57 total 60.15 last 17.41)
total: 1000 mkdir in 69.36 seconds: 14.42 ops/second
 - mkdir 126 (time 1787595744.13 total 10.05 last 12.54)
 - mkdir 247 (time 1787595754.15 total 20.07 last 12.08)
 - mkdir 383 (time 1787595764.18 total 30.10 last 13.55)
 - mkdir 540 (time 1787595774.26 total 40.18 last 15.59)
 - mkdir 712 (time 1787595784.30 total 50.22 last 17.12)
 - mkdir 879 (time 1787595794.32 total 60.23 last 16.68)
 - mkdir 993 (time 1787595804.34 total 70.26 last 11.38)
total: 1000 mkdir in 70.95 seconds: 14.10 ops/second
Time for file creation 83 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.58 seconds: 17.25 ops/second
 - mkdir 180 (time 1787596316.81 total 10.03 last 17.94)
 - mkdir 349 (time 1787596326.83 total 20.05 last 16.87)
 - mkdir 509 (time 1787596336.89 total 30.11 last 15.90)
 - mkdir 674 (time 1787596346.96 total 40.18 last 16.39)
 - mkdir 858 (time 1787596357.00 total 50.22 last 18.33)
total: 1000 mkdir in 58.42 seconds: 17.12 ops/second
 - mkdir 176 (time 1787596316.26 total 10.07 last 17.47)
 - mkdir 338 (time 1787596326.26 total 20.08 last 16.20)
 - mkdir 490 (time 1787596336.32 total 30.13 last 15.12)
 - mkdir 661 (time 1787596346.40 total 40.21 last 16.96)
 - mkdir 839 (time 1787596356.44 total 50.25 last 17.73)
total: 1000 mkdir in 59.52 seconds: 16.80 ops/second
 - mkdir 174 (time 1787596316.65 total 10.02 last 17.37)
 - mkdir 335 (time 1787596326.71 total 20.08 last 16.00)
 - mkdir 493 (time 1787596336.72 total 30.09 last 15.78)
 - mkdir 662 (time 1787596346.80 total 40.17 last 16.77)
 - mkdir 843 (time 1787596356.84 total 50.21 last 18.03)
total: 1000 mkdir in 59.52 seconds: 16.80 ops/second
 - mkdir 175 (time 1787596316.85 total 10.03 last 17.46)
 - mkdir 334 (time 1787596326.94 total 20.12 last 15.75)
 - mkdir 493 (time 1787596336.94 total 30.12 last 15.90)
 - mkdir 661 (time 1787596346.95 total 40.13 last 16.79)
 - mkdir 842 (time 1787596356.95 total 50.13 last 18.10)
total: 1000 mkdir in 59.87 seconds: 16.70 ops/second
 - mkdir 179 (time 1787596317.39 total 10.09 last 17.74)
 - mkdir 340 (time 1787596327.43 total 20.13 last 16.04)
 - mkdir 504 (time 1787596337.44 total 30.14 last 16.38)
 - mkdir 668 (time 1787596347.48 total 40.17 last 16.34)
 - mkdir 852 (time 1787596357.50 total 50.20 last 18.36)
total: 1000 mkdir in 59.56 seconds: 16.79 ops/second
 - mkdir 176 (time 1787596316.65 total 10.02 last 17.57)
 - mkdir 330 (time 1787596326.73 total 20.10 last 15.28)
 - mkdir 485 (time 1787596336.77 total 30.14 last 15.44)
 - mkdir 655 (time 1787596346.84 total 40.21 last 16.88)
 - mkdir 835 (time 1787596356.87 total 50.24 last 17.94)
 - mkdir 996 (time 1787596366.94 total 60.31 last 16.00)
total: 1000 mkdir in 60.50 seconds: 16.53 ops/second
 - mkdir 181 (time 1787596316.34 total 10.01 last 18.08)
 - mkdir 338 (time 1787596326.40 total 20.07 last 15.61)
 - mkdir 486 (time 1787596336.40 total 30.07 last 14.80)
 - mkdir 652 (time 1787596346.47 total 40.15 last 16.47)
 - mkdir 829 (time 1787596356.49 total 50.17 last 17.67)
 - mkdir 990 (time 1787596366.53 total 60.21 last 16.04)
total: 1000 mkdir in 61.00 seconds: 16.39 ops/second
 - mkdir 172 (time 1787596316.75 total 10.08 last 17.07)
 - mkdir 324 (time 1787596326.80 total 20.13 last 15.12)
 - mkdir 481 (time 1787596336.86 total 30.19 last 15.61)
 - mkdir 648 (time 1787596346.91 total 40.24 last 16.62)
 - mkdir 831 (time 1787596356.91 total 50.24 last 18.30)
 - mkdir 991 (time 1787596366.97 total 60.30 last 15.90)
total: 1000 mkdir in 60.93 seconds: 16.41 ops/second
 - mkdir 167 (time 1787596315.69 total 10.02 last 16.67)
 - mkdir 320 (time 1787596325.73 total 20.06 last 15.24)
 - mkdir 464 (time 1787596335.82 total 30.14 last 14.28)
 - mkdir 633 (time 1787596345.84 total 40.16 last 16.87)
 - mkdir 805 (time 1787596355.87 total 50.19 last 17.14)
 - mkdir 980 (time 1787596365.88 total 60.21 last 17.48)
total: 1000 mkdir in 61.93 seconds: 16.15 ops/second
 - mkdir 165 (time 1787596316.47 total 10.00 last 16.50)
 - mkdir 326 (time 1787596326.47 total 20.00 last 16.10)
 - mkdir 473 (time 1787596336.50 total 30.03 last 14.66)
 - mkdir 644 (time 1787596346.51 total 40.04 last 17.08)
 - mkdir 821 (time 1787596356.55 total 50.08 last 17.63)
 - mkdir 982 (time 1787596366.57 total 60.10 last 16.07)
total: 1000 mkdir in 61.42 seconds: 16.28 ops/second
Time for file creation 72 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787596377 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787596376 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787596376 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787596378 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787596377 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787596378 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787596378 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787596378 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787596378 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787596378 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8