== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 02:38:20 (1786084700)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.60 seconds: 16.67 ops/second
 - mkdir 148 (time 1786084725.06 total 10.02 last 14.76)
 - mkdir 304 (time 1786084735.07 total 20.03 last 15.58)
 - mkdir 454 (time 1786084745.08 total 30.04 last 14.99)
 - mkdir 628 (time 1786084755.13 total 40.09 last 17.31)
 - mkdir 792 (time 1786084765.19 total 50.16 last 16.30)
 - mkdir 939 (time 1786084775.22 total 60.18 last 14.66)
total: 1000 mkdir in 65.43 seconds: 15.28 ops/second
 - mkdir 146 (time 1786084724.72 total 10.02 last 14.57)
 - mkdir 298 (time 1786084734.76 total 20.06 last 15.14)
 - mkdir 454 (time 1786084744.83 total 30.14 last 15.48)
 - mkdir 629 (time 1786084754.88 total 40.18 last 17.42)
 - mkdir 784 (time 1786084764.95 total 50.26 last 15.39)
 - mkdir 930 (time 1786084775.02 total 60.33 last 14.50)
total: 1000 mkdir in 65.79 seconds: 15.20 ops/second
 - mkdir 152 (time 1786084725.51 total 10.07 last 15.10)
 - mkdir 305 (time 1786084735.52 total 20.08 last 15.28)
 - mkdir 449 (time 1786084745.54 total 30.10 last 14.38)
 - mkdir 625 (time 1786084755.58 total 40.14 last 17.53)
 - mkdir 783 (time 1786084765.62 total 50.17 last 15.75)
 - mkdir 922 (time 1786084775.68 total 60.24 last 13.81)
total: 1000 mkdir in 67.40 seconds: 14.84 ops/second
 - mkdir 144 (time 1786084724.93 total 10.04 last 14.35)
 - mkdir 291 (time 1786084734.96 total 20.07 last 14.65)
 - mkdir 440 (time 1786084745.01 total 30.12 last 14.83)
 - mkdir 613 (time 1786084755.06 total 40.16 last 17.22)
 - mkdir 771 (time 1786084765.08 total 50.18 last 15.77)
 - mkdir 915 (time 1786084775.16 total 60.27 last 14.28)
total: 1000 mkdir in 68.22 seconds: 14.66 ops/second
 - mkdir 130 (time 1786084722.98 total 10.02 last 12.97)
 - mkdir 272 (time 1786084733.05 total 20.09 last 14.10)
 - mkdir 417 (time 1786084743.13 total 30.17 last 14.39)
 - mkdir 590 (time 1786084753.19 total 40.23 last 17.20)
 - mkdir 750 (time 1786084763.25 total 50.29 last 15.91)
 - mkdir 892 (time 1786084773.30 total 60.34 last 14.13)
total: 1000 mkdir in 70.22 seconds: 14.24 ops/second
 - mkdir 152 (time 1786084725.97 total 10.05 last 15.12)
 - mkdir 301 (time 1786084736.00 total 20.09 last 14.85)
 - mkdir 448 (time 1786084746.10 total 30.19 last 14.55)
 - mkdir 628 (time 1786084756.15 total 40.23 last 17.92)
 - mkdir 782 (time 1786084766.20 total 50.29 last 15.31)
 - mkdir 930 (time 1786084776.24 total 60.33 last 14.74)
total: 1000 mkdir in 67.29 seconds: 14.86 ops/second
 - mkdir 139 (time 1786084724.50 total 10.09 last 13.78)
 - mkdir 286 (time 1786084734.58 total 20.17 last 14.58)
 - mkdir 431 (time 1786084744.60 total 30.18 last 14.48)
 - mkdir 602 (time 1786084754.61 total 40.19 last 17.08)
 - mkdir 763 (time 1786084764.64 total 50.22 last 16.05)
 - mkdir 908 (time 1786084774.67 total 60.25 last 14.47)
total: 1000 mkdir in 68.95 seconds: 14.50 ops/second
 - mkdir 161 (time 1786084726.88 total 10.10 last 15.93)
 - mkdir 308 (time 1786084736.89 total 20.12 last 14.68)
 - mkdir 457 (time 1786084746.93 total 30.16 last 14.84)
 - mkdir 630 (time 1786084756.94 total 40.16 last 17.29)
 - mkdir 786 (time 1786084767.00 total 50.22 last 15.51)
 - mkdir 933 (time 1786084777.03 total 60.26 last 14.65)
total: 1000 mkdir in 67.34 seconds: 14.85 ops/second
 - mkdir 153 (time 1786084726.09 total 10.00 last 15.30)
 - mkdir 298 (time 1786084736.11 total 20.02 last 14.48)
 - mkdir 439 (time 1786084746.14 total 30.05 last 14.06)
 - mkdir 615 (time 1786084756.16 total 40.07 last 17.57)
 - mkdir 775 (time 1786084766.20 total 50.10 last 15.95)
 - mkdir 919 (time 1786084776.22 total 60.12 last 14.37)
total: 1000 mkdir in 68.29 seconds: 14.64 ops/second
 - mkdir 147 (time 1786084725.91 total 10.00 last 14.70)
 - mkdir 292 (time 1786084735.93 total 20.03 last 14.46)
 - mkdir 430 (time 1786084745.98 total 30.07 last 13.74)
 - mkdir 609 (time 1786084755.99 total 40.08 last 17.87)
 - mkdir 767 (time 1786084766.03 total 50.12 last 15.74)
 - mkdir 915 (time 1786084776.05 total 60.14 last 14.77)
total: 1000 mkdir in 69.15 seconds: 14.46 ops/second
Time for file creation 83 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.54 seconds: 18.60 ops/second
 - mkdir 121 (time 1786085287.63 total 10.04 last 12.06)
 - mkdir 265 (time 1786085297.68 total 20.08 last 14.33)
 - mkdir 393 (time 1786085307.68 total 30.09 last 12.80)
 - mkdir 531 (time 1786085317.71 total 40.11 last 13.76)
 - mkdir 687 (time 1786085327.81 total 50.21 last 15.45)
 - mkdir 921 (time 1786085337.82 total 60.22 last 23.37)
total: 1000 mkdir in 64.60 seconds: 15.48 ops/second
 - mkdir 141 (time 1786085291.38 total 10.06 last 14.01)
 - mkdir 291 (time 1786085301.39 total 20.08 last 14.98)
 - mkdir 445 (time 1786085311.43 total 30.12 last 15.34)
 - mkdir 589 (time 1786085321.44 total 40.13 last 14.39)
 - mkdir 769 (time 1786085331.47 total 50.16 last 17.94)
 - mkdir 981 (time 1786085341.52 total 60.20 last 21.10)
total: 1000 mkdir in 61.83 seconds: 16.17 ops/second
 - mkdir 127 (time 1786085290.17 total 10.03 last 12.66)
 - mkdir 280 (time 1786085300.20 total 20.06 last 15.26)
 - mkdir 431 (time 1786085310.20 total 30.07 last 15.09)
 - mkdir 567 (time 1786085320.22 total 40.08 last 13.58)
 - mkdir 733 (time 1786085330.24 total 50.11 last 16.56)
 - mkdir 956 (time 1786085340.24 total 60.11 last 22.30)
total: 1000 mkdir in 63.80 seconds: 15.67 ops/second
 - mkdir 128 (time 1786085290.34 total 10.02 last 12.77)
 - mkdir 278 (time 1786085300.38 total 20.07 last 14.94)
 - mkdir 424 (time 1786085310.44 total 30.13 last 14.51)
 - mkdir 567 (time 1786085320.48 total 40.17 last 14.24)
 - mkdir 737 (time 1786085330.51 total 50.20 last 16.95)
 - mkdir 956 (time 1786085340.54 total 60.23 last 21.84)
total: 1000 mkdir in 64.10 seconds: 15.60 ops/second
 - mkdir 121 (time 1786085290.45 total 10.01 last 12.09)
 - mkdir 273 (time 1786085300.50 total 20.06 last 15.12)
 - mkdir 423 (time 1786085310.55 total 30.11 last 14.94)
 - mkdir 566 (time 1786085320.60 total 40.16 last 14.22)
 - mkdir 733 (time 1786085330.63 total 50.19 last 16.66)
 - mkdir 957 (time 1786085340.65 total 60.21 last 22.35)
total: 1000 mkdir in 64.07 seconds: 15.61 ops/second
 - mkdir 128 (time 1786085291.04 total 10.07 last 12.71)
 - mkdir 265 (time 1786085301.06 total 20.08 last 13.68)
 - mkdir 417 (time 1786085311.07 total 30.09 last 15.18)
 - mkdir 566 (time 1786085321.09 total 40.11 last 14.87)
 - mkdir 742 (time 1786085331.09 total 50.11 last 17.59)
 - mkdir 964 (time 1786085341.11 total 60.13 last 22.17)
total: 1000 mkdir in 63.97 seconds: 15.63 ops/second
 - mkdir 135 (time 1786085291.43 total 10.11 last 13.35)
 - mkdir 279 (time 1786085301.52 total 20.20 last 14.28)
 - mkdir 429 (time 1786085311.54 total 30.22 last 14.97)
 - mkdir 577 (time 1786085321.57 total 40.26 last 14.75)
 - mkdir 758 (time 1786085331.59 total 50.27 last 18.08)
 - mkdir 968 (time 1786085341.61 total 60.29 last 20.96)
total: 1000 mkdir in 63.91 seconds: 15.65 ops/second
 - mkdir 122 (time 1786085290.04 total 10.05 last 12.14)
 - mkdir 268 (time 1786085300.15 total 20.16 last 14.43)
 - mkdir 415 (time 1786085310.16 total 30.17 last 14.69)
 - mkdir 553 (time 1786085320.20 total 40.21 last 13.75)
 - mkdir 726 (time 1786085330.25 total 50.26 last 17.22)
 - mkdir 947 (time 1786085340.28 total 60.29 last 22.02)
total: 1000 mkdir in 65.25 seconds: 15.33 ops/second
 - mkdir 137 (time 1786085291.53 total 10.08 last 13.59)
 - mkdir 281 (time 1786085301.57 total 20.13 last 14.34)
 - mkdir 431 (time 1786085311.60 total 30.16 last 14.95)
 - mkdir 573 (time 1786085321.61 total 40.17 last 14.18)
 - mkdir 751 (time 1786085331.63 total 50.18 last 17.78)
 - mkdir 966 (time 1786085341.65 total 60.20 last 21.45)
total: 1000 mkdir in 63.88 seconds: 15.65 ops/second
 - mkdir 134 (time 1786085291.24 total 10.06 last 13.32)
 - mkdir 275 (time 1786085301.25 total 20.07 last 14.08)
 - mkdir 420 (time 1786085311.27 total 30.08 last 14.48)
 - mkdir 562 (time 1786085321.32 total 40.13 last 14.13)
 - mkdir 743 (time 1786085331.33 total 50.15 last 18.07)
 - mkdir 958 (time 1786085341.36 total 60.18 last 21.44)
total: 1000 mkdir in 64.26 seconds: 15.56 ops/second
Time for file creation 80 sec for 1 RPC sent at a time
 - unlinked 0 (time 1786085357 ; total 1 ; last 1)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786085358 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786085358 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786085359 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786085360 ; total 0 ; last 0)
total: 1000 unlinks in 27 seconds: 37.037037 unlinks/second
 - unlinked 0 (time 1786085360 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786085360 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1786085360 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786085360 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1786085361 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
Time for file removal 42 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8