== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 20:21:44 (1786753304)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.50 ops/second
 - mkdir 165 (time 1786753323.55 total 10.14 last 16.28)
 - mkdir 319 (time 1786753333.59 total 20.17 last 15.34)
 - mkdir 499 (time 1786753343.64 total 30.22 last 17.91)
 - mkdir 673 (time 1786753353.69 total 40.27 last 17.32)
 - mkdir 829 (time 1786753363.72 total 50.31 last 15.54)
total: 1000 mkdir in 59.06 seconds: 16.93 ops/second
 - mkdir 164 (time 1786753323.62 total 10.01 last 16.38)
 - mkdir 319 (time 1786753333.64 total 20.03 last 15.48)
 - mkdir 492 (time 1786753343.65 total 30.04 last 17.28)
 - mkdir 656 (time 1786753353.78 total 40.17 last 16.18)
 - mkdir 811 (time 1786753363.80 total 50.19 last 15.47)
 - mkdir 985 (time 1786753373.80 total 60.19 last 17.40)
total: 1000 mkdir in 61.66 seconds: 16.22 ops/second
 - mkdir 158 (time 1786753324.15 total 10.02 last 15.77)
 - mkdir 315 (time 1786753334.16 total 20.03 last 15.68)
 - mkdir 488 (time 1786753344.17 total 30.04 last 17.28)
 - mkdir 659 (time 1786753354.33 total 40.21 last 16.82)
 - mkdir 820 (time 1786753364.38 total 50.26 last 16.02)
 - mkdir 990 (time 1786753374.39 total 60.27 last 16.98)
total: 1000 mkdir in 61.16 seconds: 16.35 ops/second
 - mkdir 155 (time 1786753324.08 total 10.04 last 15.43)
 - mkdir 311 (time 1786753334.09 total 20.04 last 15.60)
 - mkdir 481 (time 1786753344.21 total 30.16 last 16.80)
 - mkdir 654 (time 1786753354.22 total 40.18 last 17.28)
 - mkdir 815 (time 1786753364.30 total 50.26 last 15.97)
 - mkdir 989 (time 1786753374.39 total 60.35 last 17.23)
total: 1000 mkdir in 61.70 seconds: 16.21 ops/second
 - mkdir 154 (time 1786753323.31 total 10.02 last 15.36)
 - mkdir 299 (time 1786753333.37 total 20.08 last 14.42)
 - mkdir 478 (time 1786753343.43 total 30.15 last 17.78)
 - mkdir 639 (time 1786753353.44 total 40.16 last 16.08)
 - mkdir 788 (time 1786753363.46 total 50.18 last 14.87)
 - mkdir 974 (time 1786753373.48 total 60.20 last 18.56)
total: 1000 mkdir in 63.64 seconds: 15.71 ops/second
 - mkdir 158 (time 1786753324.15 total 10.06 last 15.71)
 - mkdir 314 (time 1786753334.15 total 20.06 last 15.60)
 - mkdir 481 (time 1786753344.17 total 30.08 last 16.67)
 - mkdir 650 (time 1786753354.20 total 40.11 last 16.85)
 - mkdir 810 (time 1786753364.25 total 50.17 last 15.91)
 - mkdir 977 (time 1786753374.31 total 60.23 last 16.60)
total: 1000 mkdir in 63.07 seconds: 15.86 ops/second
 - mkdir 153 (time 1786753323.64 total 10.01 last 15.29)
 - mkdir 302 (time 1786753333.64 total 20.01 last 14.90)
 - mkdir 473 (time 1786753343.64 total 30.01 last 17.10)
 - mkdir 635 (time 1786753353.79 total 40.16 last 15.97)
 - mkdir 789 (time 1786753363.84 total 50.20 last 15.33)
 - mkdir 964 (time 1786753373.93 total 60.30 last 17.34)
total: 1000 mkdir in 64.63 seconds: 15.47 ops/second
 - mkdir 155 (time 1786753323.59 total 10.03 last 15.45)
 - mkdir 306 (time 1786753333.61 total 20.05 last 15.07)
 - mkdir 476 (time 1786753343.68 total 30.12 last 16.87)
 - mkdir 637 (time 1786753353.81 total 40.25 last 15.89)
 - mkdir 778 (time 1786753363.84 total 50.28 last 14.07)
 - mkdir 953 (time 1786753373.87 total 60.31 last 17.44)
total: 1000 mkdir in 65.74 seconds: 15.21 ops/second
 - mkdir 151 (time 1786753324.04 total 10.00 last 15.09)
 - mkdir 303 (time 1786753334.04 total 20.01 last 15.19)
 - mkdir 469 (time 1786753344.10 total 30.07 last 16.51)
 - mkdir 637 (time 1786753354.12 total 40.09 last 16.76)
 - mkdir 789 (time 1786753364.16 total 50.13 last 15.14)
 - mkdir 955 (time 1786753374.18 total 60.15 last 16.57)
total: 1000 mkdir in 65.32 seconds: 15.31 ops/second
 - mkdir 143 (time 1786753324.22 total 10.02 last 14.28)
 - mkdir 292 (time 1786753334.25 total 20.04 last 14.86)
 - mkdir 452 (time 1786753344.30 total 30.09 last 15.92)
 - mkdir 612 (time 1786753354.36 total 40.16 last 15.90)
 - mkdir 759 (time 1786753364.36 total 50.16 last 14.70)
 - mkdir 919 (time 1786753374.36 total 60.16 last 16.00)
total: 1000 mkdir in 66.92 seconds: 14.94 ops/second
Time for file creation 75 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.47 seconds: 21.31 ops/second
 - mkdir 177 (time 1786753904.99 total 10.03 last 17.65)
 - mkdir 324 (time 1786753915.06 total 20.10 last 14.59)
 - mkdir 491 (time 1786753925.10 total 30.13 last 16.64)
 - mkdir 659 (time 1786753935.14 total 40.17 last 16.73)
 - mkdir 815 (time 1786753945.16 total 50.20 last 15.56)
 - mkdir 974 (time 1786753955.20 total 60.24 last 15.84)
total: 1000 mkdir in 61.90 seconds: 16.16 ops/second
 - mkdir 173 (time 1786753904.86 total 10.01 last 17.29)
 - mkdir 321 (time 1786753914.88 total 20.03 last 14.76)
 - mkdir 480 (time 1786753924.91 total 30.06 last 15.86)
 - mkdir 646 (time 1786753934.96 total 40.11 last 16.52)
 - mkdir 805 (time 1786753945.00 total 50.15 last 15.84)
 - mkdir 970 (time 1786753955.03 total 60.18 last 16.44)
total: 1000 mkdir in 62.24 seconds: 16.07 ops/second
 - mkdir 176 (time 1786753905.28 total 10.01 last 17.58)
 - mkdir 324 (time 1786753915.29 total 20.02 last 14.79)
 - mkdir 493 (time 1786753925.34 total 30.07 last 16.81)
 - mkdir 657 (time 1786753935.36 total 40.10 last 16.36)
 - mkdir 811 (time 1786753945.43 total 50.16 last 15.30)
 - mkdir 974 (time 1786753955.49 total 60.22 last 16.20)
total: 1000 mkdir in 61.96 seconds: 16.14 ops/second
 - mkdir 177 (time 1786753905.66 total 10.05 last 17.61)
 - mkdir 320 (time 1786753915.71 total 20.10 last 14.23)
 - mkdir 485 (time 1786753925.75 total 30.14 last 16.43)
 - mkdir 654 (time 1786753935.80 total 40.19 last 16.82)
 - mkdir 809 (time 1786753945.84 total 50.23 last 15.43)
 - mkdir 971 (time 1786753955.91 total 60.30 last 16.09)
total: 1000 mkdir in 62.23 seconds: 16.07 ops/second
 - mkdir 173 (time 1786753905.00 total 10.09 last 17.15)
 - mkdir 317 (time 1786753915.06 total 20.15 last 14.32)
 - mkdir 477 (time 1786753925.07 total 30.16 last 15.98)
 - mkdir 649 (time 1786753935.09 total 40.18 last 17.16)
 - mkdir 806 (time 1786753945.10 total 50.20 last 15.67)
 - mkdir 964 (time 1786753955.14 total 60.23 last 15.74)
total: 1000 mkdir in 62.97 seconds: 15.88 ops/second
 - mkdir 174 (time 1786753905.24 total 10.00 last 17.40)
 - mkdir 325 (time 1786753915.28 total 20.05 last 15.03)
 - mkdir 487 (time 1786753925.36 total 30.12 last 16.08)
 - mkdir 653 (time 1786753935.36 total 40.12 last 16.60)
 - mkdir 805 (time 1786753945.41 total 50.17 last 15.13)
 - mkdir 967 (time 1786753955.44 total 60.21 last 16.15)
total: 1000 mkdir in 62.71 seconds: 15.95 ops/second
 - mkdir 172 (time 1786753905.12 total 10.02 last 17.16)
 - mkdir 314 (time 1786753915.17 total 20.07 last 14.14)
 - mkdir 477 (time 1786753925.17 total 30.07 last 16.29)
 - mkdir 646 (time 1786753935.21 total 40.12 last 16.82)
 - mkdir 802 (time 1786753945.28 total 50.18 last 15.50)
 - mkdir 965 (time 1786753955.35 total 60.25 last 16.19)
total: 1000 mkdir in 62.87 seconds: 15.91 ops/second
 - mkdir 168 (time 1786753904.90 total 10.03 last 16.75)
 - mkdir 311 (time 1786753914.94 total 20.07 last 14.23)
 - mkdir 472 (time 1786753924.98 total 30.11 last 16.04)
 - mkdir 636 (time 1786753934.98 total 40.11 last 16.39)
 - mkdir 791 (time 1786753945.03 total 50.16 last 15.43)
 - mkdir 954 (time 1786753955.04 total 60.17 last 16.28)
total: 1000 mkdir in 63.54 seconds: 15.74 ops/second
 - mkdir 167 (time 1786753904.71 total 10.02 last 16.66)
 - mkdir 309 (time 1786753914.72 total 20.03 last 14.19)
 - mkdir 469 (time 1786753924.72 total 30.04 last 15.99)
 - mkdir 629 (time 1786753934.82 total 40.13 last 15.85)
 - mkdir 787 (time 1786753944.84 total 50.15 last 15.77)
 - mkdir 948 (time 1786753954.85 total 60.16 last 16.09)
total: 1000 mkdir in 63.95 seconds: 15.64 ops/second
 - mkdir 166 (time 1786753905.09 total 10.01 last 16.59)
 - mkdir 302 (time 1786753915.12 total 20.04 last 13.56)
 - mkdir 459 (time 1786753925.15 total 30.06 last 15.65)
 - mkdir 625 (time 1786753935.16 total 40.07 last 16.59)
 - mkdir 786 (time 1786753945.20 total 50.12 last 16.03)
 - mkdir 950 (time 1786753955.25 total 60.17 last 16.32)
total: 1000 mkdir in 63.88 seconds: 15.65 ops/second
Time for file creation 75 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786753967 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786753968 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786753968 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1786753968 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786753968 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786753968 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786753969 ; total 1 ; last 1)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786753968 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786753969 ; total 1 ; last 1)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1786753968 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8