== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 23:06:22 (1787886382)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.60 seconds: 16.80 ops/second
 - mkdir 142 (time 1787886403.37 total 10.00 last 14.20)
 - mkdir 305 (time 1787886413.40 total 20.03 last 16.25)
 - mkdir 484 (time 1787886423.42 total 30.05 last 17.87)
 - mkdir 642 (time 1787886433.46 total 40.09 last 15.74)
 - mkdir 803 (time 1787886443.48 total 50.11 last 16.06)
 - mkdir 969 (time 1787886453.51 total 60.14 last 16.56)
total: 1000 mkdir in 62.10 seconds: 16.10 ops/second
 - mkdir 150 (time 1787886404.41 total 10.04 last 14.94)
 - mkdir 314 (time 1787886414.43 total 20.06 last 16.37)
 - mkdir 497 (time 1787886424.44 total 30.08 last 18.27)
 - mkdir 655 (time 1787886434.49 total 40.12 last 15.73)
 - mkdir 813 (time 1787886444.49 total 50.12 last 15.80)
 - mkdir 980 (time 1787886454.59 total 60.22 last 16.53)
total: 1000 mkdir in 61.65 seconds: 16.22 ops/second
 - mkdir 152 (time 1787886404.86 total 10.02 last 15.17)
 - mkdir 316 (time 1787886414.91 total 20.06 last 16.33)
 - mkdir 503 (time 1787886424.93 total 30.09 last 18.65)
 - mkdir 656 (time 1787886434.95 total 40.10 last 15.28)
 - mkdir 818 (time 1787886444.96 total 50.12 last 16.18)
 - mkdir 984 (time 1787886454.98 total 60.13 last 16.58)
total: 1000 mkdir in 61.26 seconds: 16.32 ops/second
 - mkdir 148 (time 1787886403.80 total 10.12 last 14.63)
 - mkdir 306 (time 1787886413.83 total 20.14 last 15.76)
 - mkdir 485 (time 1787886423.84 total 30.16 last 17.87)
 - mkdir 640 (time 1787886433.85 total 40.16 last 15.49)
 - mkdir 798 (time 1787886443.92 total 50.23 last 15.69)
 - mkdir 967 (time 1787886453.97 total 60.29 last 16.81)
total: 1000 mkdir in 62.98 seconds: 15.88 ops/second
 - mkdir 144 (time 1787886404.36 total 10.06 last 14.32)
 - mkdir 306 (time 1787886414.36 total 20.06 last 16.19)
 - mkdir 483 (time 1787886424.42 total 30.13 last 17.59)
 - mkdir 642 (time 1787886434.46 total 40.17 last 15.84)
 - mkdir 801 (time 1787886444.49 total 50.19 last 15.86)
 - mkdir 971 (time 1787886454.55 total 60.25 last 16.89)
total: 1000 mkdir in 62.40 seconds: 16.02 ops/second
 - mkdir 147 (time 1787886404.63 total 10.04 last 14.64)
 - mkdir 305 (time 1787886414.64 total 20.05 last 15.78)
 - mkdir 481 (time 1787886424.69 total 30.10 last 17.52)
 - mkdir 641 (time 1787886434.80 total 40.21 last 15.83)
 - mkdir 798 (time 1787886444.80 total 50.21 last 15.70)
 - mkdir 965 (time 1787886454.83 total 60.24 last 16.65)
total: 1000 mkdir in 62.68 seconds: 15.95 ops/second
 - mkdir 140 (time 1787886404.72 total 10.01 last 13.99)
 - mkdir 302 (time 1787886414.73 total 20.02 last 16.18)
 - mkdir 477 (time 1787886424.77 total 30.06 last 17.43)
 - mkdir 635 (time 1787886434.81 total 40.10 last 15.73)
 - mkdir 798 (time 1787886444.85 total 50.14 last 16.23)
 - mkdir 967 (time 1787886454.86 total 60.15 last 16.89)
total: 1000 mkdir in 62.74 seconds: 15.94 ops/second
 - mkdir 141 (time 1787886404.39 total 10.04 last 14.05)
 - mkdir 301 (time 1787886414.50 total 20.15 last 15.81)
 - mkdir 476 (time 1787886424.55 total 30.20 last 17.42)
 - mkdir 633 (time 1787886434.60 total 40.25 last 15.62)
 - mkdir 799 (time 1787886444.63 total 50.28 last 16.54)
 - mkdir 966 (time 1787886454.69 total 60.34 last 16.61)
total: 1000 mkdir in 63.14 seconds: 15.84 ops/second
 - mkdir 139 (time 1787886404.15 total 10.00 last 13.90)
 - mkdir 295 (time 1787886414.22 total 20.07 last 15.50)
 - mkdir 464 (time 1787886424.26 total 30.11 last 16.83)
 - mkdir 620 (time 1787886434.29 total 40.14 last 15.56)
 - mkdir 775 (time 1787886444.29 total 50.14 last 15.50)
 - mkdir 945 (time 1787886454.34 total 60.19 last 16.92)
total: 1000 mkdir in 64.39 seconds: 15.53 ops/second
 - mkdir 139 (time 1787886404.24 total 10.06 last 13.82)
 - mkdir 294 (time 1787886414.30 total 20.11 last 15.41)
 - mkdir 467 (time 1787886424.35 total 30.17 last 17.20)
 - mkdir 625 (time 1787886434.40 total 40.22 last 15.72)
 - mkdir 784 (time 1787886444.44 total 50.26 last 15.84)
 - mkdir 947 (time 1787886454.48 total 60.29 last 16.24)
total: 1000 mkdir in 64.56 seconds: 15.49 ops/second
Time for file creation 74 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 1 seconds: 0.000000 unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 12 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.48 seconds: 20.64 ops/second
 - mkdir 137 (time 1787886987.06 total 10.04 last 13.65)
 - mkdir 289 (time 1787886997.10 total 20.08 last 15.13)
 - mkdir 473 (time 1787887007.14 total 30.12 last 18.34)
 - mkdir 629 (time 1787887017.14 total 40.13 last 15.59)
 - mkdir 806 (time 1787887027.17 total 50.15 last 17.65)
 - mkdir 964 (time 1787887037.19 total 60.17 last 15.77)
total: 1000 mkdir in 62.31 seconds: 16.05 ops/second
 - mkdir 135 (time 1787886986.83 total 10.00 last 13.50)
 - mkdir 277 (time 1787886996.88 total 20.06 last 14.12)
 - mkdir 458 (time 1787887006.90 total 30.07 last 18.07)
 - mkdir 616 (time 1787887016.94 total 40.11 last 15.74)
 - mkdir 796 (time 1787887027.00 total 50.18 last 17.89)
 - mkdir 953 (time 1787887037.01 total 60.18 last 15.69)
total: 1000 mkdir in 63.24 seconds: 15.81 ops/second
 - mkdir 136 (time 1787886988.00 total 10.12 last 13.44)
 - mkdir 281 (time 1787886998.00 total 20.12 last 14.49)
 - mkdir 462 (time 1787887008.06 total 30.17 last 18.01)
 - mkdir 630 (time 1787887018.06 total 40.18 last 16.78)
 - mkdir 801 (time 1787887028.07 total 50.18 last 17.10)
 - mkdir 957 (time 1787887038.11 total 60.23 last 15.53)
total: 1000 mkdir in 63.89 seconds: 15.65 ops/second
 - mkdir 136 (time 1787886987.28 total 10.04 last 13.54)
 - mkdir 281 (time 1787886997.39 total 20.15 last 14.34)
 - mkdir 459 (time 1787887007.44 total 30.20 last 17.71)
 - mkdir 618 (time 1787887017.50 total 40.26 last 15.81)
 - mkdir 793 (time 1787887027.50 total 50.27 last 17.49)
 - mkdir 948 (time 1787887037.55 total 60.31 last 15.43)
total: 1000 mkdir in 64.66 seconds: 15.47 ops/second
 - mkdir 126 (time 1787886985.98 total 10.02 last 12.58)
 - mkdir 255 (time 1787886996.00 total 20.03 last 12.88)
 - mkdir 423 (time 1787887006.05 total 30.08 last 16.72)
 - mkdir 584 (time 1787887016.07 total 40.10 last 16.06)
 - mkdir 761 (time 1787887026.07 total 50.10 last 17.70)
 - mkdir 925 (time 1787887036.13 total 60.16 last 16.30)
total: 1000 mkdir in 66.46 seconds: 15.05 ops/second
 - mkdir 133 (time 1787886988.00 total 10.15 last 13.11)
 - mkdir 278 (time 1787886998.02 total 20.16 last 14.48)
 - mkdir 453 (time 1787887008.03 total 30.18 last 17.47)
 - mkdir 617 (time 1787887018.05 total 40.20 last 16.36)
 - mkdir 794 (time 1787887028.07 total 50.22 last 17.66)
 - mkdir 950 (time 1787887038.11 total 60.25 last 15.55)
total: 1000 mkdir in 64.75 seconds: 15.44 ops/second
 - mkdir 130 (time 1787886987.38 total 10.04 last 12.95)
 - mkdir 274 (time 1787886997.40 total 20.07 last 14.36)
 - mkdir 454 (time 1787887007.41 total 30.07 last 17.99)
 - mkdir 616 (time 1787887017.42 total 40.09 last 16.17)
 - mkdir 786 (time 1787887027.46 total 50.12 last 16.95)
 - mkdir 943 (time 1787887037.53 total 60.19 last 15.59)
total: 1000 mkdir in 65.30 seconds: 15.31 ops/second
 - mkdir 137 (time 1787886987.70 total 10.10 last 13.56)
 - mkdir 278 (time 1787886997.71 total 20.11 last 14.09)
 - mkdir 454 (time 1787887007.75 total 30.15 last 17.53)
 - mkdir 618 (time 1787887017.76 total 40.17 last 16.37)
 - mkdir 791 (time 1787887027.81 total 50.22 last 17.21)
 - mkdir 946 (time 1787887037.88 total 60.28 last 15.40)
total: 1000 mkdir in 65.51 seconds: 15.26 ops/second
 - mkdir 127 (time 1787886987.28 total 10.03 last 12.67)
 - mkdir 265 (time 1787886997.40 total 20.15 last 13.63)
 - mkdir 436 (time 1787887007.41 total 30.16 last 17.09)
 - mkdir 593 (time 1787887017.51 total 40.26 last 15.54)
 - mkdir 771 (time 1787887027.55 total 50.30 last 17.73)
 - mkdir 931 (time 1787887037.55 total 60.30 last 16.00)
total: 1000 mkdir in 66.61 seconds: 15.01 ops/second
 - mkdir 126 (time 1787886987.90 total 10.01 last 12.59)
 - mkdir 263 (time 1787886997.91 total 20.01 last 13.69)
 - mkdir 441 (time 1787887007.96 total 30.07 last 17.70)
 - mkdir 606 (time 1787887017.99 total 40.10 last 16.45)
 - mkdir 779 (time 1787887028.01 total 50.12 last 17.27)
 - mkdir 936 (time 1787887038.10 total 60.20 last 15.56)
total: 1000 mkdir in 66.14 seconds: 15.12 ops/second
Time for file creation 77 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787887051 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787887051 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787887052 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787887053 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787887053 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787887053 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787887053 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787887053 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787887053 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787887053 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8