== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:11:56 (1786428716)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.51 seconds: 19.79 ops/second
 - mkdir 193 (time 1786428738.83 total 10.00 last 19.30)
 - mkdir 336 (time 1786428748.88 total 20.05 last 14.23)
 - mkdir 470 (time 1786428758.89 total 30.06 last 13.38)
 - mkdir 609 (time 1786428768.90 total 40.07 last 13.89)
 - mkdir 765 (time 1786428778.94 total 50.12 last 15.53)
 - mkdir 954 (time 1786428788.98 total 60.15 last 18.84)
total: 1000 mkdir in 62.76 seconds: 15.93 ops/second
 - mkdir 189 (time 1786428737.80 total 10.09 last 18.74)
 - mkdir 328 (time 1786428747.81 total 20.10 last 13.88)
 - mkdir 455 (time 1786428757.83 total 30.12 last 12.68)
 - mkdir 588 (time 1786428767.88 total 40.17 last 13.23)
 - mkdir 745 (time 1786428777.89 total 50.18 last 15.69)
 - mkdir 925 (time 1786428787.90 total 60.18 last 17.99)
total: 1000 mkdir in 64.30 seconds: 15.55 ops/second
 - mkdir 186 (time 1786428738.43 total 10.09 last 18.43)
 - mkdir 332 (time 1786428748.50 total 20.16 last 14.50)
 - mkdir 462 (time 1786428758.56 total 30.22 last 12.93)
 - mkdir 597 (time 1786428768.60 total 40.26 last 13.44)
 - mkdir 742 (time 1786428778.64 total 50.30 last 14.44)
 - mkdir 934 (time 1786428788.66 total 60.32 last 19.16)
total: 1000 mkdir in 65.02 seconds: 15.38 ops/second
 - mkdir 186 (time 1786428738.34 total 10.03 last 18.55)
 - mkdir 331 (time 1786428748.38 total 20.07 last 14.45)
 - mkdir 456 (time 1786428758.41 total 30.10 last 12.46)
 - mkdir 593 (time 1786428768.47 total 40.16 last 13.62)
 - mkdir 744 (time 1786428778.52 total 50.20 last 15.03)
 - mkdir 929 (time 1786428788.63 total 60.31 last 18.30)
total: 1000 mkdir in 65.23 seconds: 15.33 ops/second
 - mkdir 192 (time 1786428739.19 total 10.00 last 19.20)
 - mkdir 323 (time 1786428749.24 total 20.05 last 13.03)
 - mkdir 456 (time 1786428759.30 total 30.11 last 13.23)
 - mkdir 593 (time 1786428769.31 total 40.12 last 13.68)
 - mkdir 746 (time 1786428779.35 total 50.16 last 15.25)
 - mkdir 942 (time 1786428789.36 total 60.17 last 19.58)
total: 1000 mkdir in 64.60 seconds: 15.48 ops/second
 - mkdir 189 (time 1786428738.77 total 10.01 last 18.87)
 - mkdir 330 (time 1786428748.79 total 20.03 last 14.08)
 - mkdir 458 (time 1786428758.86 total 30.10 last 12.71)
 - mkdir 589 (time 1786428768.88 total 40.13 last 13.07)
 - mkdir 738 (time 1786428778.90 total 50.14 last 14.88)
 - mkdir 932 (time 1786428788.90 total 60.14 last 19.39)
total: 1000 mkdir in 65.36 seconds: 15.30 ops/second
 - mkdir 188 (time 1786428738.74 total 10.07 last 18.68)
 - mkdir 329 (time 1786428748.76 total 20.09 last 14.07)
 - mkdir 457 (time 1786428758.89 total 30.21 last 12.64)
 - mkdir 588 (time 1786428768.94 total 40.26 last 13.04)
 - mkdir 735 (time 1786428779.10 total 50.42 last 14.47)
 - mkdir 925 (time 1786428789.14 total 60.46 last 18.92)
total: 1000 mkdir in 66.76 seconds: 14.98 ops/second
 - mkdir 187 (time 1786428738.62 total 10.04 last 18.63)
 - mkdir 323 (time 1786428748.66 total 20.08 last 13.54)
 - mkdir 442 (time 1786428758.69 total 30.10 last 11.87)
 - mkdir 568 (time 1786428768.69 total 40.11 last 12.59)
 - mkdir 713 (time 1786428778.71 total 50.12 last 14.48)
 - mkdir 903 (time 1786428788.74 total 60.16 last 18.93)
total: 1000 mkdir in 68.33 seconds: 14.63 ops/second
 - mkdir 186 (time 1786428738.96 total 10.03 last 18.54)
 - mkdir 313 (time 1786428749.08 total 20.15 last 12.55)
 - mkdir 438 (time 1786428759.16 total 30.23 last 12.40)
 - mkdir 575 (time 1786428769.18 total 40.25 last 13.67)
 - mkdir 721 (time 1786428779.20 total 50.27 last 14.57)
 - mkdir 909 (time 1786428789.25 total 60.32 last 18.71)
total: 1000 mkdir in 68.12 seconds: 14.68 ops/second
 - mkdir 183 (time 1786428738.21 total 10.13 last 18.06)
 - mkdir 321 (time 1786428748.36 total 20.28 last 13.60)
 - mkdir 441 (time 1786428758.41 total 30.33 last 11.94)
 - mkdir 565 (time 1786428768.45 total 40.36 last 12.36)
 - mkdir 712 (time 1786428778.49 total 50.41 last 14.64)
 - mkdir 894 (time 1786428788.51 total 60.42 last 18.17)
total: 1000 mkdir in 69.41 seconds: 14.41 ops/second
Time for file creation 78 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 14 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.51 seconds: 19.54 ops/second
 - mkdir 188 (time 1786429326.71 total 10.01 last 18.77)
 - mkdir 351 (time 1786429336.72 total 20.02 last 16.29)
 - mkdir 510 (time 1786429346.75 total 30.06 last 15.84)
 - mkdir 629 (time 1786429356.82 total 40.13 last 11.82)
 - mkdir 788 (time 1786429366.84 total 50.14 last 15.88)
 - mkdir 958 (time 1786429376.88 total 60.19 last 16.92)
total: 1000 mkdir in 62.49 seconds: 16.00 ops/second
 - mkdir 185 (time 1786429328.30 total 10.05 last 18.40)
 - mkdir 358 (time 1786429338.31 total 20.07 last 17.28)
 - mkdir 506 (time 1786429348.37 total 30.12 last 14.72)
 - mkdir 628 (time 1786429358.38 total 40.13 last 12.19)
 - mkdir 826 (time 1786429368.38 total 50.13 last 19.79)
 - mkdir 973 (time 1786429378.41 total 60.16 last 14.66)
total: 1000 mkdir in 62.91 seconds: 15.89 ops/second
 - mkdir 187 (time 1786429329.03 total 10.01 last 18.68)
 - mkdir 358 (time 1786429339.10 total 20.08 last 16.98)
 - mkdir 505 (time 1786429349.12 total 30.11 last 14.67)
 - mkdir 635 (time 1786429359.15 total 40.13 last 12.97)
 - mkdir 846 (time 1786429369.18 total 50.16 last 21.03)
 - mkdir 981 (time 1786429379.24 total 60.22 last 13.41)
total: 1000 mkdir in 62.50 seconds: 16.00 ops/second
 - mkdir 183 (time 1786429328.40 total 10.09 last 18.14)
 - mkdir 355 (time 1786429338.45 total 20.14 last 17.11)
 - mkdir 504 (time 1786429348.58 total 30.27 last 14.71)
 - mkdir 628 (time 1786429358.60 total 40.29 last 12.38)
 - mkdir 823 (time 1786429368.61 total 50.30 last 19.48)
 - mkdir 970 (time 1786429378.68 total 60.36 last 14.61)
total: 1000 mkdir in 63.66 seconds: 15.71 ops/second
 - mkdir 182 (time 1786429328.26 total 10.03 last 18.15)
 - mkdir 353 (time 1786429338.28 total 20.05 last 17.06)
 - mkdir 498 (time 1786429348.33 total 30.10 last 14.43)
 - mkdir 617 (time 1786429358.36 total 40.13 last 11.87)
 - mkdir 816 (time 1786429368.37 total 50.14 last 19.88)
 - mkdir 961 (time 1786429378.39 total 60.16 last 14.47)
total: 1000 mkdir in 64.03 seconds: 15.62 ops/second
 - mkdir 185 (time 1786429329.00 total 10.01 last 18.49)
 - mkdir 356 (time 1786429339.02 total 20.03 last 17.06)
 - mkdir 502 (time 1786429349.02 total 30.03 last 14.59)
 - mkdir 621 (time 1786429359.09 total 40.10 last 11.82)
 - mkdir 825 (time 1786429369.10 total 50.11 last 20.38)
 - mkdir 970 (time 1786429379.15 total 60.16 last 14.42)
total: 1000 mkdir in 63.90 seconds: 15.65 ops/second
 - mkdir 181 (time 1786429328.52 total 10.06 last 17.99)
 - mkdir 354 (time 1786429338.53 total 20.07 last 17.29)
 - mkdir 505 (time 1786429348.56 total 30.10 last 15.05)
 - mkdir 623 (time 1786429358.59 total 40.13 last 11.77)
 - mkdir 818 (time 1786429368.62 total 50.16 last 19.45)
 - mkdir 963 (time 1786429378.66 total 60.20 last 14.44)
total: 1000 mkdir in 64.52 seconds: 15.50 ops/second
 - mkdir 180 (time 1786429328.79 total 10.01 last 17.99)
 - mkdir 348 (time 1786429338.84 total 20.05 last 16.72)
 - mkdir 491 (time 1786429348.87 total 30.09 last 14.26)
 - mkdir 608 (time 1786429358.90 total 40.12 last 11.66)
 - mkdir 810 (time 1786429368.92 total 50.14 last 20.17)
 - mkdir 946 (time 1786429378.94 total 60.16 last 13.56)
total: 1000 mkdir in 66.27 seconds: 15.09 ops/second
 - mkdir 180 (time 1786429328.03 total 10.01 last 17.98)
 - mkdir 342 (time 1786429338.04 total 20.01 last 16.20)
 - mkdir 489 (time 1786429348.08 total 30.06 last 14.64)
 - mkdir 605 (time 1786429358.10 total 40.08 last 11.57)
 - mkdir 788 (time 1786429368.11 total 50.09 last 18.28)
 - mkdir 932 (time 1786429378.13 total 60.11 last 14.37)
total: 1000 mkdir in 67.28 seconds: 14.86 ops/second
 - mkdir 173 (time 1786429327.98 total 10.02 last 17.26)
 - mkdir 331 (time 1786429338.02 total 20.06 last 15.73)
 - mkdir 475 (time 1786429348.09 total 30.13 last 14.30)
 - mkdir 586 (time 1786429358.11 total 40.16 last 11.07)
 - mkdir 768 (time 1786429368.14 total 50.19 last 18.15)
 - mkdir 911 (time 1786429378.16 total 60.21 last 14.27)
total: 1000 mkdir in 69.46 seconds: 14.40 ops/second
Time for file creation 80 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786429396 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786429396 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786429396 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786429397 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786429398 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786429398 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786429398 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786429398 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786429397 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786429397 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 46 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8