== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:00:57 (1787860857)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.75 seconds: 13.42 ops/second
 - mkdir 137 (time 1787860880.60 total 10.03 last 13.65)
 - mkdir 299 (time 1787860890.65 total 20.09 last 16.11)
 - mkdir 452 (time 1787860900.67 total 30.11 last 15.27)
 - mkdir 586 (time 1787860910.70 total 40.14 last 13.36)
 - mkdir 731 (time 1787860920.74 total 50.17 last 14.45)
 - mkdir 895 (time 1787860930.77 total 60.20 last 16.35)
total: 1000 mkdir in 66.63 seconds: 15.01 ops/second
 - mkdir 133 (time 1787860880.88 total 10.00 last 13.30)
 - mkdir 295 (time 1787860890.93 total 20.06 last 16.12)
 - mkdir 444 (time 1787860900.95 total 30.08 last 14.87)
 - mkdir 575 (time 1787860911.00 total 40.12 last 13.04)
 - mkdir 720 (time 1787860921.03 total 50.16 last 14.45)
 - mkdir 889 (time 1787860931.11 total 60.23 last 16.77)
total: 1000 mkdir in 67.95 seconds: 14.72 ops/second
 - mkdir 140 (time 1787860881.65 total 10.03 last 13.96)
 - mkdir 297 (time 1787860891.68 total 20.06 last 15.66)
 - mkdir 442 (time 1787860901.77 total 30.15 last 14.38)
 - mkdir 577 (time 1787860911.81 total 40.19 last 13.44)
 - mkdir 727 (time 1787860921.85 total 50.23 last 14.94)
 - mkdir 888 (time 1787860931.88 total 60.26 last 16.06)
total: 1000 mkdir in 68.04 seconds: 14.70 ops/second
 - mkdir 151 (time 1787860883.49 total 10.01 last 15.09)
 - mkdir 316 (time 1787860893.51 total 20.02 last 16.48)
 - mkdir 457 (time 1787860903.51 total 30.02 last 14.10)
 - mkdir 598 (time 1787860913.55 total 40.07 last 14.04)
 - mkdir 752 (time 1787860923.61 total 50.13 last 15.31)
 - mkdir 911 (time 1787860933.62 total 60.13 last 15.89)
total: 1000 mkdir in 66.28 seconds: 15.09 ops/second
 - mkdir 138 (time 1787860881.65 total 10.01 last 13.79)
 - mkdir 293 (time 1787860891.66 total 20.02 last 15.48)
 - mkdir 438 (time 1787860901.73 total 30.09 last 14.41)
 - mkdir 572 (time 1787860911.81 total 40.17 last 13.28)
 - mkdir 720 (time 1787860921.86 total 50.22 last 14.74)
 - mkdir 887 (time 1787860931.88 total 60.24 last 16.67)
total: 1000 mkdir in 68.60 seconds: 14.58 ops/second
 - mkdir 147 (time 1787860883.09 total 10.03 last 14.65)
 - mkdir 305 (time 1787860893.13 total 20.07 last 15.73)
 - mkdir 450 (time 1787860903.16 total 30.10 last 14.46)
 - mkdir 593 (time 1787860913.21 total 40.15 last 14.23)
 - mkdir 744 (time 1787860923.26 total 50.20 last 15.03)
 - mkdir 900 (time 1787860933.26 total 60.20 last 15.60)
total: 1000 mkdir in 67.26 seconds: 14.87 ops/second
 - mkdir 142 (time 1787860882.55 total 10.01 last 14.18)
 - mkdir 299 (time 1787860892.58 total 20.05 last 15.65)
 - mkdir 442 (time 1787860902.67 total 30.14 last 14.18)
 - mkdir 583 (time 1787860912.69 total 40.16 last 14.07)
 - mkdir 734 (time 1787860922.71 total 50.18 last 15.06)
 - mkdir 892 (time 1787860932.74 total 60.21 last 15.76)
total: 1000 mkdir in 67.79 seconds: 14.75 ops/second
 - mkdir 142 (time 1787860882.29 total 10.04 last 14.14)
 - mkdir 300 (time 1787860892.34 total 20.10 last 15.72)
 - mkdir 444 (time 1787860902.43 total 30.18 last 14.28)
 - mkdir 580 (time 1787860912.48 total 40.23 last 13.53)
 - mkdir 725 (time 1787860922.48 total 50.24 last 14.50)
 - mkdir 886 (time 1787860932.48 total 60.24 last 16.10)
total: 1000 mkdir in 68.33 seconds: 14.63 ops/second
 - mkdir 139 (time 1787860883.03 total 10.01 last 13.89)
 - mkdir 292 (time 1787860893.09 total 20.06 last 15.22)
 - mkdir 430 (time 1787860903.14 total 30.11 last 13.73)
 - mkdir 575 (time 1787860913.16 total 40.13 last 14.47)
 - mkdir 725 (time 1787860923.19 total 50.16 last 14.95)
 - mkdir 880 (time 1787860933.20 total 60.17 last 15.49)
total: 1000 mkdir in 69.20 seconds: 14.45 ops/second
 - mkdir 138 (time 1787860882.77 total 10.10 last 13.67)
 - mkdir 288 (time 1787860892.85 total 20.18 last 14.88)
 - mkdir 423 (time 1787860902.94 total 30.26 last 13.38)
 - mkdir 566 (time 1787860913.00 total 40.32 last 14.22)
 - mkdir 721 (time 1787860923.05 total 50.38 last 15.41)
 - mkdir 878 (time 1787860933.07 total 60.39 last 15.68)
total: 1000 mkdir in 70.06 seconds: 14.27 ops/second
Time for file creation 82 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.62 seconds: 16.04 ops/second
 - mkdir 147 (time 1787861431.97 total 10.04 last 14.65)
 - mkdir 316 (time 1787861442.01 total 20.07 last 16.84)
 - mkdir 484 (time 1787861452.01 total 30.08 last 16.79)
 - mkdir 619 (time 1787861462.04 total 40.10 last 13.47)
 - mkdir 785 (time 1787861472.06 total 50.13 last 16.56)
 - mkdir 954 (time 1787861482.12 total 60.19 last 16.80)
total: 1000 mkdir in 62.99 seconds: 15.87 ops/second
 - mkdir 153 (time 1787861433.39 total 10.10 last 15.15)
 - mkdir 321 (time 1787861443.42 total 20.13 last 16.76)
 - mkdir 490 (time 1787861453.45 total 30.15 last 16.85)
 - mkdir 631 (time 1787861463.46 total 40.17 last 14.08)
 - mkdir 794 (time 1787861473.50 total 50.21 last 16.23)
 - mkdir 967 (time 1787861483.57 total 60.28 last 17.18)
total: 1000 mkdir in 63.10 seconds: 15.85 ops/second
 - mkdir 150 (time 1787861433.74 total 10.05 last 14.92)
 - mkdir 313 (time 1787861443.78 total 20.10 last 16.23)
 - mkdir 488 (time 1787861453.82 total 30.13 last 17.44)
 - mkdir 634 (time 1787861463.87 total 40.18 last 14.52)
 - mkdir 791 (time 1787861473.95 total 50.26 last 15.58)
 - mkdir 964 (time 1787861484.01 total 60.32 last 17.20)
total: 1000 mkdir in 63.49 seconds: 15.75 ops/second
 - mkdir 148 (time 1787861433.81 total 10.04 last 14.74)
 - mkdir 314 (time 1787861443.85 total 20.08 last 16.54)
 - mkdir 483 (time 1787861453.90 total 30.13 last 16.82)
 - mkdir 623 (time 1787861463.93 total 40.16 last 13.95)
 - mkdir 788 (time 1787861474.00 total 50.22 last 16.39)
 - mkdir 962 (time 1787861484.04 total 60.27 last 17.32)
total: 1000 mkdir in 63.64 seconds: 15.71 ops/second
 - mkdir 141 (time 1787861433.24 total 10.04 last 14.05)
 - mkdir 309 (time 1787861443.25 total 20.05 last 16.77)
 - mkdir 484 (time 1787861453.28 total 30.08 last 17.45)
 - mkdir 623 (time 1787861463.34 total 40.14 last 13.81)
 - mkdir 787 (time 1787861473.37 total 50.17 last 16.35)
 - mkdir 953 (time 1787861483.38 total 60.18 last 16.58)
total: 1000 mkdir in 64.81 seconds: 15.43 ops/second
 - mkdir 150 (time 1787861434.02 total 10.01 last 14.99)
 - mkdir 311 (time 1787861444.05 total 20.04 last 16.05)
 - mkdir 483 (time 1787861454.11 total 30.10 last 17.10)
 - mkdir 627 (time 1787861464.15 total 40.14 last 14.34)
 - mkdir 790 (time 1787861474.17 total 50.15 last 16.28)
 - mkdir 961 (time 1787861484.17 total 60.15 last 17.10)
total: 1000 mkdir in 64.44 seconds: 15.52 ops/second
 - mkdir 141 (time 1787861434.05 total 10.00 last 14.09)
 - mkdir 299 (time 1787861444.09 total 20.04 last 15.74)
 - mkdir 465 (time 1787861454.09 total 30.04 last 16.60)
 - mkdir 608 (time 1787861464.13 total 40.09 last 14.24)
 - mkdir 772 (time 1787861474.15 total 50.10 last 16.37)
 - mkdir 940 (time 1787861484.17 total 60.13 last 16.76)
total: 1000 mkdir in 66.66 seconds: 15.00 ops/second
 - mkdir 154 (time 1787861434.26 total 10.03 last 15.36)
 - mkdir 313 (time 1787861444.29 total 20.05 last 15.86)
 - mkdir 481 (time 1787861454.35 total 30.11 last 16.70)
 - mkdir 620 (time 1787861464.37 total 40.13 last 13.87)
 - mkdir 779 (time 1787861474.40 total 50.16 last 15.86)
 - mkdir 946 (time 1787861484.46 total 60.23 last 16.59)
total: 1000 mkdir in 66.52 seconds: 15.03 ops/second
 - mkdir 143 (time 1787861434.34 total 10.05 last 14.23)
 - mkdir 299 (time 1787861444.34 total 20.05 last 15.60)
 - mkdir 465 (time 1787861454.38 total 30.09 last 16.54)
 - mkdir 612 (time 1787861464.43 total 40.13 last 14.64)
 - mkdir 776 (time 1787861474.46 total 50.17 last 16.34)
 - mkdir 943 (time 1787861484.53 total 60.24 last 16.58)
total: 1000 mkdir in 66.78 seconds: 14.97 ops/second
 - mkdir 141 (time 1787861433.83 total 10.04 last 14.05)
 - mkdir 293 (time 1787861443.88 total 20.08 last 15.13)
 - mkdir 453 (time 1787861453.97 total 30.17 last 15.86)
 - mkdir 602 (time 1787861464.04 total 40.24 last 14.80)
 - mkdir 761 (time 1787861474.10 total 50.30 last 15.80)
 - mkdir 932 (time 1787861484.13 total 60.34 last 17.05)
total: 1000 mkdir in 67.65 seconds: 14.78 ops/second
Time for file creation 78 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787861498 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787861499 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787861500 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787861501 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787861501 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787861501 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787861501 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787861501 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787861502 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787861502 ; total 1 ; last 1)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8