== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:06:49 (1786774009)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.51 seconds: 19.49 ops/second
 - mkdir 151 (time 1786774029.65 total 10.07 last 14.99)
 - mkdir 295 (time 1786774039.67 total 20.09 last 14.37)
 - mkdir 439 (time 1786774049.73 total 30.15 last 14.32)
 - mkdir 581 (time 1786774059.73 total 40.16 last 14.19)
 - mkdir 731 (time 1786774069.75 total 50.17 last 14.98)
 - mkdir 905 (time 1786774079.78 total 60.20 last 17.35)
total: 1000 mkdir in 65.59 seconds: 15.25 ops/second
 - mkdir 151 (time 1786774031.19 total 10.08 last 14.97)
 - mkdir 298 (time 1786774041.25 total 20.14 last 14.61)
 - mkdir 433 (time 1786774051.27 total 30.16 last 13.47)
 - mkdir 584 (time 1786774061.29 total 40.19 last 15.06)
 - mkdir 734 (time 1786774071.32 total 50.21 last 14.97)
 - mkdir 906 (time 1786774081.37 total 60.27 last 17.10)
total: 1000 mkdir in 66.28 seconds: 15.09 ops/second
 - mkdir 144 (time 1786774030.57 total 10.03 last 14.35)
 - mkdir 288 (time 1786774040.60 total 20.07 last 14.36)
 - mkdir 429 (time 1786774050.61 total 30.08 last 14.08)
 - mkdir 574 (time 1786774060.67 total 40.13 last 14.42)
 - mkdir 720 (time 1786774070.74 total 50.20 last 14.50)
 - mkdir 892 (time 1786774080.80 total 60.26 last 17.10)
total: 1000 mkdir in 67.27 seconds: 14.86 ops/second
 - mkdir 147 (time 1786774032.60 total 10.08 last 14.58)
 - mkdir 294 (time 1786774042.66 total 20.14 last 14.61)
 - mkdir 435 (time 1786774052.70 total 30.19 last 14.04)
 - mkdir 585 (time 1786774062.73 total 40.22 last 14.96)
 - mkdir 741 (time 1786774072.77 total 50.25 last 15.55)
 - mkdir 912 (time 1786774082.86 total 60.35 last 16.94)
total: 1000 mkdir in 66.27 seconds: 15.09 ops/second
 - mkdir 145 (time 1786774031.94 total 10.01 last 14.49)
 - mkdir 295 (time 1786774041.96 total 20.03 last 14.97)
 - mkdir 439 (time 1786774051.98 total 30.05 last 14.37)
 - mkdir 585 (time 1786774061.99 total 40.06 last 14.59)
 - mkdir 730 (time 1786774072.01 total 50.08 last 14.47)
 - mkdir 902 (time 1786774082.07 total 60.13 last 17.11)
total: 1000 mkdir in 66.89 seconds: 14.95 ops/second
 - mkdir 151 (time 1786774031.94 total 10.05 last 15.03)
 - mkdir 294 (time 1786774042.01 total 20.11 last 14.20)
 - mkdir 431 (time 1786774052.06 total 30.17 last 13.62)
 - mkdir 582 (time 1786774062.16 total 40.27 last 14.95)
 - mkdir 727 (time 1786774072.19 total 50.30 last 14.46)
 - mkdir 902 (time 1786774082.21 total 60.32 last 17.46)
total: 1000 mkdir in 67.05 seconds: 14.91 ops/second
 - mkdir 147 (time 1786774032.19 total 10.06 last 14.61)
 - mkdir 297 (time 1786774042.19 total 20.07 last 14.99)
 - mkdir 434 (time 1786774052.26 total 30.13 last 13.61)
 - mkdir 583 (time 1786774062.38 total 40.26 last 14.72)
 - mkdir 733 (time 1786774072.43 total 50.30 last 14.93)
 - mkdir 909 (time 1786774082.45 total 60.32 last 17.57)
total: 1000 mkdir in 66.90 seconds: 14.95 ops/second
 - mkdir 145 (time 1786774032.41 total 10.06 last 14.41)
 - mkdir 292 (time 1786774042.49 total 20.14 last 14.58)
 - mkdir 425 (time 1786774052.51 total 30.16 last 13.28)
 - mkdir 573 (time 1786774062.54 total 40.19 last 14.76)
 - mkdir 727 (time 1786774072.58 total 50.23 last 15.33)
 - mkdir 895 (time 1786774082.66 total 60.31 last 16.68)
total: 1000 mkdir in 68.14 seconds: 14.68 ops/second
 - mkdir 143 (time 1786774032.34 total 10.03 last 14.26)
 - mkdir 290 (time 1786774042.34 total 20.03 last 14.70)
 - mkdir 425 (time 1786774052.38 total 30.06 last 13.45)
 - mkdir 571 (time 1786774062.38 total 40.06 last 14.60)
 - mkdir 716 (time 1786774072.43 total 50.11 last 14.43)
 - mkdir 886 (time 1786774082.48 total 60.16 last 16.92)
total: 1000 mkdir in 68.96 seconds: 14.50 ops/second
 - mkdir 145 (time 1786774032.51 total 10.13 last 14.31)
 - mkdir 287 (time 1786774042.52 total 20.15 last 14.18)
 - mkdir 414 (time 1786774052.52 total 30.15 last 12.70)
 - mkdir 559 (time 1786774062.57 total 40.20 last 14.43)
 - mkdir 703 (time 1786774072.59 total 50.22 last 14.37)
 - mkdir 868 (time 1786774082.63 total 60.26 last 16.43)
total: 1000 mkdir in 69.96 seconds: 14.29 ops/second
Time for file creation 80 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.45 seconds: 22.32 ops/second
 - mkdir 166 (time 1786774653.90 total 10.09 last 16.46)
 - mkdir 323 (time 1786774663.96 total 20.15 last 15.60)
 - mkdir 504 (time 1786774674.04 total 30.23 last 17.96)
 - mkdir 661 (time 1786774684.06 total 40.25 last 15.68)
 - mkdir 876 (time 1786774694.11 total 50.29 last 21.40)
total: 1000 mkdir in 58.28 seconds: 17.16 ops/second
 - mkdir 173 (time 1786774653.24 total 10.07 last 17.18)
 - mkdir 333 (time 1786774663.25 total 20.08 last 15.98)
 - mkdir 501 (time 1786774673.30 total 30.14 last 16.71)
 - mkdir 659 (time 1786774683.35 total 40.18 last 15.73)
 - mkdir 857 (time 1786774693.37 total 50.20 last 19.76)
total: 1000 mkdir in 59.57 seconds: 16.79 ops/second
 - mkdir 169 (time 1786774652.91 total 10.06 last 16.80)
 - mkdir 320 (time 1786774662.96 total 20.11 last 15.02)
 - mkdir 488 (time 1786774672.99 total 30.14 last 16.76)
 - mkdir 646 (time 1786774683.01 total 40.16 last 15.77)
 - mkdir 853 (time 1786774693.04 total 50.18 last 20.64)
 - mkdir 998 (time 1786774703.10 total 60.25 last 14.40)
total: 1000 mkdir in 60.35 seconds: 16.57 ops/second
 - mkdir 169 (time 1786774653.25 total 10.01 last 16.88)
 - mkdir 320 (time 1786774663.36 total 20.12 last 14.94)
 - mkdir 492 (time 1786774673.40 total 30.16 last 17.13)
 - mkdir 652 (time 1786774683.44 total 40.21 last 15.93)
 - mkdir 859 (time 1786774693.48 total 50.24 last 20.63)
total: 1000 mkdir in 60.10 seconds: 16.64 ops/second
 - mkdir 167 (time 1786774653.15 total 10.02 last 16.66)
 - mkdir 318 (time 1786774663.18 total 20.05 last 15.05)
 - mkdir 484 (time 1786774673.20 total 30.08 last 16.56)
 - mkdir 642 (time 1786774683.23 total 40.10 last 15.76)
 - mkdir 849 (time 1786774693.26 total 50.13 last 20.64)
 - mkdir 996 (time 1786774703.36 total 60.24 last 14.55)
total: 1000 mkdir in 60.57 seconds: 16.51 ops/second
 - mkdir 167 (time 1786774653.66 total 10.05 last 16.62)
 - mkdir 323 (time 1786774663.70 total 20.10 last 15.53)
 - mkdir 496 (time 1786774673.74 total 30.14 last 17.23)
 - mkdir 657 (time 1786774683.78 total 40.17 last 16.04)
 - mkdir 858 (time 1786774693.80 total 50.20 last 20.05)
 - mkdir 994 (time 1786774703.85 total 60.24 last 13.53)
total: 1000 mkdir in 60.63 seconds: 16.49 ops/second
 - mkdir 163 (time 1786774653.44 total 10.05 last 16.22)
 - mkdir 315 (time 1786774663.47 total 20.08 last 15.15)
 - mkdir 482 (time 1786774673.48 total 30.09 last 16.69)
 - mkdir 641 (time 1786774683.51 total 40.11 last 15.86)
 - mkdir 844 (time 1786774693.53 total 50.13 last 20.26)
 - mkdir 986 (time 1786774703.62 total 60.23 last 14.07)
total: 1000 mkdir in 61.40 seconds: 16.29 ops/second
 - mkdir 165 (time 1786774653.34 total 10.01 last 16.48)
 - mkdir 311 (time 1786774663.37 total 20.03 last 14.56)
 - mkdir 478 (time 1786774673.39 total 30.06 last 16.66)
 - mkdir 636 (time 1786774683.43 total 40.09 last 15.74)
 - mkdir 843 (time 1786774693.44 total 50.11 last 20.67)
 - mkdir 985 (time 1786774703.47 total 60.14 last 14.16)
total: 1000 mkdir in 61.56 seconds: 16.24 ops/second
 - mkdir 164 (time 1786774653.42 total 10.01 last 16.39)
 - mkdir 313 (time 1786774663.46 total 20.05 last 14.84)
 - mkdir 483 (time 1786774673.49 total 30.08 last 16.95)
 - mkdir 639 (time 1786774683.53 total 40.12 last 15.54)
 - mkdir 841 (time 1786774693.54 total 50.13 last 20.17)
 - mkdir 980 (time 1786774703.60 total 60.19 last 13.82)
total: 1000 mkdir in 62.25 seconds: 16.06 ops/second
 - mkdir 158 (time 1786774652.26 total 10.03 last 15.76)
 - mkdir 310 (time 1786774662.32 total 20.09 last 15.11)
 - mkdir 469 (time 1786774672.35 total 30.12 last 15.85)
 - mkdir 623 (time 1786774682.37 total 40.15 last 15.36)
 - mkdir 817 (time 1786774692.41 total 50.18 last 19.33)
 - mkdir 961 (time 1786774702.65 total 60.42 last 14.07)
total: 1000 mkdir in 64.23 seconds: 15.57 ops/second
Time for file creation 73 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786774713 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1786774713 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786774714 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786774714 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786774714 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786774714 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786774714 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786774715 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786774715 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786774715 ; total 1 ; last 1)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8