== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 16:31:21 (1787862681)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.43 seconds: 23.12 ops/second
 - mkdir 128 (time 1787862704.56 total 10.01 last 12.78)
 - mkdir 287 (time 1787862714.59 total 20.04 last 15.85)
 - mkdir 487 (time 1787862724.60 total 30.06 last 19.97)
 - mkdir 689 (time 1787862734.61 total 40.06 last 20.19)
 - mkdir 879 (time 1787862744.61 total 50.07 last 18.99)
total: 1000 mkdir in 56.32 seconds: 17.76 ops/second
 - mkdir 142 (time 1787862707.00 total 10.05 last 14.13)
 - mkdir 295 (time 1787862717.04 total 20.09 last 15.24)
 - mkdir 507 (time 1787862727.04 total 30.09 last 21.20)
 - mkdir 711 (time 1787862737.07 total 40.11 last 20.35)
 - mkdir 899 (time 1787862747.08 total 50.12 last 18.78)
total: 1000 mkdir in 55.07 seconds: 18.16 ops/second
 - mkdir 138 (time 1787862705.74 total 10.01 last 13.78)
 - mkdir 291 (time 1787862715.75 total 20.02 last 15.28)
 - mkdir 497 (time 1787862725.75 total 30.02 last 20.60)
 - mkdir 698 (time 1787862735.77 total 40.04 last 20.07)
 - mkdir 885 (time 1787862745.82 total 50.09 last 18.60)
total: 1000 mkdir in 57.03 seconds: 17.53 ops/second
 - mkdir 141 (time 1787862706.43 total 10.04 last 14.04)
 - mkdir 297 (time 1787862716.49 total 20.10 last 15.51)
 - mkdir 501 (time 1787862726.51 total 30.13 last 20.35)
 - mkdir 699 (time 1787862736.52 total 40.14 last 19.78)
 - mkdir 883 (time 1787862746.58 total 50.20 last 18.30)
total: 1000 mkdir in 57.10 seconds: 17.51 ops/second
 - mkdir 137 (time 1787862706.36 total 10.04 last 13.64)
 - mkdir 291 (time 1787862716.38 total 20.06 last 15.37)
 - mkdir 497 (time 1787862726.40 total 30.09 last 20.56)
 - mkdir 698 (time 1787862736.44 total 40.12 last 20.04)
 - mkdir 882 (time 1787862746.48 total 50.16 last 18.32)
total: 1000 mkdir in 57.59 seconds: 17.37 ops/second
 - mkdir 143 (time 1787862706.86 total 10.02 last 14.27)
 - mkdir 298 (time 1787862716.86 total 20.02 last 15.50)
 - mkdir 501 (time 1787862726.87 total 30.03 last 20.29)
 - mkdir 697 (time 1787862736.88 total 40.03 last 19.59)
 - mkdir 882 (time 1787862746.92 total 50.08 last 18.42)
total: 1000 mkdir in 57.72 seconds: 17.33 ops/second
 - mkdir 131 (time 1787862706.43 total 10.05 last 13.03)
 - mkdir 281 (time 1787862716.49 total 20.11 last 14.91)
 - mkdir 486 (time 1787862726.52 total 30.15 last 20.43)
 - mkdir 680 (time 1787862736.52 total 40.15 last 19.40)
 - mkdir 867 (time 1787862746.60 total 50.23 last 18.55)
total: 1000 mkdir in 59.40 seconds: 16.84 ops/second
 - mkdir 131 (time 1787862706.92 total 10.05 last 13.04)
 - mkdir 281 (time 1787862716.96 total 20.10 last 14.93)
 - mkdir 494 (time 1787862727.03 total 30.17 last 21.15)
 - mkdir 695 (time 1787862737.07 total 40.20 last 20.04)
 - mkdir 874 (time 1787862747.10 total 50.23 last 17.84)
total: 1000 mkdir in 59.52 seconds: 16.80 ops/second
 - mkdir 131 (time 1787862706.06 total 10.02 last 13.08)
 - mkdir 280 (time 1787862716.07 total 20.03 last 14.88)
 - mkdir 480 (time 1787862726.09 total 30.05 last 19.95)
 - mkdir 677 (time 1787862736.10 total 40.06 last 19.69)
 - mkdir 858 (time 1787862746.13 total 50.09 last 18.04)
 - mkdir 996 (time 1787862756.17 total 60.13 last 13.75)
total: 1000 mkdir in 60.39 seconds: 16.56 ops/second
 - mkdir 129 (time 1787862707.21 total 10.01 last 12.88)
 - mkdir 273 (time 1787862717.26 total 20.06 last 14.33)
 - mkdir 475 (time 1787862727.30 total 30.11 last 20.12)
 - mkdir 662 (time 1787862737.33 total 40.13 last 18.64)
 - mkdir 834 (time 1787862747.41 total 50.21 last 17.06)
 - mkdir 966 (time 1787862757.49 total 60.30 last 13.09)
total: 1000 mkdir in 62.35 seconds: 16.04 ops/second
Time for file creation 76 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 15 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.52 seconds: 19.38 ops/second
 - mkdir 167 (time 1787863282.01 total 10.08 last 16.57)
 - mkdir 308 (time 1787863292.06 total 20.13 last 14.03)
 - mkdir 494 (time 1787863302.16 total 30.23 last 18.41)
 - mkdir 664 (time 1787863312.19 total 40.25 last 16.96)
 - mkdir 791 (time 1787863322.26 total 50.33 last 12.61)
 - mkdir 934 (time 1787863332.27 total 60.34 last 14.29)
total: 1000 mkdir in 63.23 seconds: 15.82 ops/second
 - mkdir 172 (time 1787863281.64 total 10.09 last 17.04)
 - mkdir 311 (time 1787863291.67 total 20.12 last 13.86)
 - mkdir 489 (time 1787863301.73 total 30.18 last 17.70)
 - mkdir 653 (time 1787863311.74 total 40.20 last 16.37)
 - mkdir 786 (time 1787863321.80 total 50.25 last 13.22)
 - mkdir 925 (time 1787863331.86 total 60.31 last 13.82)
total: 1000 mkdir in 63.71 seconds: 15.69 ops/second
 - mkdir 165 (time 1787863282.89 total 10.01 last 16.48)
 - mkdir 311 (time 1787863292.93 total 20.05 last 14.54)
 - mkdir 499 (time 1787863302.94 total 30.07 last 18.77)
 - mkdir 665 (time 1787863313.01 total 40.13 last 16.50)
 - mkdir 787 (time 1787863323.08 total 50.21 last 12.11)
 - mkdir 947 (time 1787863333.11 total 60.24 last 15.95)
total: 1000 mkdir in 63.23 seconds: 15.81 ops/second
 - mkdir 160 (time 1787863283.14 total 10.08 last 15.88)
 - mkdir 310 (time 1787863293.18 total 20.11 last 14.95)
 - mkdir 500 (time 1787863303.20 total 30.13 last 18.97)
 - mkdir 663 (time 1787863313.21 total 40.14 last 16.28)
 - mkdir 784 (time 1787863323.30 total 50.23 last 11.99)
 - mkdir 947 (time 1787863333.33 total 60.26 last 16.25)
total: 1000 mkdir in 63.63 seconds: 15.72 ops/second
 - mkdir 163 (time 1787863283.24 total 10.01 last 16.28)
 - mkdir 313 (time 1787863293.27 total 20.04 last 14.96)
 - mkdir 503 (time 1787863303.33 total 30.10 last 18.88)
 - mkdir 668 (time 1787863313.35 total 40.12 last 16.48)
 - mkdir 784 (time 1787863323.39 total 50.16 last 11.55)
 - mkdir 944 (time 1787863333.40 total 60.16 last 16.00)
total: 1000 mkdir in 64.25 seconds: 15.56 ops/second
 - mkdir 166 (time 1787863283.30 total 10.06 last 16.50)
 - mkdir 317 (time 1787863293.37 total 20.13 last 14.99)
 - mkdir 498 (time 1787863303.40 total 30.16 last 18.05)
 - mkdir 661 (time 1787863313.40 total 40.16 last 16.30)
 - mkdir 782 (time 1787863323.48 total 50.24 last 12.01)
 - mkdir 942 (time 1787863333.53 total 60.29 last 15.91)
total: 1000 mkdir in 64.61 seconds: 15.48 ops/second
 - mkdir 164 (time 1787863283.14 total 10.06 last 16.31)
 - mkdir 310 (time 1787863293.15 total 20.06 last 14.60)
 - mkdir 493 (time 1787863303.23 total 30.14 last 18.15)
 - mkdir 652 (time 1787863313.28 total 40.20 last 15.81)
 - mkdir 773 (time 1787863323.34 total 50.25 last 12.03)
 - mkdir 935 (time 1787863333.36 total 60.28 last 16.16)
total: 1000 mkdir in 65.49 seconds: 15.27 ops/second
 - mkdir 164 (time 1787863283.22 total 10.08 last 16.27)
 - mkdir 307 (time 1787863293.23 total 20.10 last 14.28)
 - mkdir 487 (time 1787863303.26 total 30.13 last 17.95)
 - mkdir 649 (time 1787863313.28 total 40.15 last 16.16)
 - mkdir 770 (time 1787863323.32 total 50.18 last 12.06)
 - mkdir 931 (time 1787863333.34 total 60.21 last 16.06)
total: 1000 mkdir in 65.80 seconds: 15.20 ops/second
 - mkdir 160 (time 1787863282.40 total 10.05 last 15.92)
 - mkdir 300 (time 1787863292.44 total 20.09 last 13.94)
 - mkdir 478 (time 1787863302.45 total 30.10 last 17.78)
 - mkdir 642 (time 1787863312.47 total 40.12 last 16.38)
 - mkdir 764 (time 1787863322.48 total 50.13 last 12.18)
 - mkdir 911 (time 1787863332.49 total 60.14 last 14.69)
total: 1000 mkdir in 66.82 seconds: 14.96 ops/second
 - mkdir 157 (time 1787863282.39 total 10.02 last 15.68)
 - mkdir 293 (time 1787863292.44 total 20.06 last 13.54)
 - mkdir 465 (time 1787863302.45 total 30.07 last 17.18)
 - mkdir 625 (time 1787863312.46 total 40.09 last 15.98)
 - mkdir 752 (time 1787863322.59 total 50.21 last 12.54)
 - mkdir 900 (time 1787863332.60 total 60.22 last 14.79)
total: 1000 mkdir in 68.02 seconds: 14.70 ops/second
Time for file creation 78 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787863347 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787863350 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1787863350 ; total 0 ; last 0)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787863351 ; total 1 ; last 1)
total: 1000 unlinks in 36 seconds: 27.777779 unlinks/second
 - unlinked 0 (time 1787863351 ; total 1 ; last 1)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787863351 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787863351 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787863351 ; total 1 ; last 1)
total: 1000 unlinks in 38 seconds: 26.315790 unlinks/second
 - unlinked 0 (time 1787863351 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
 - unlinked 0 (time 1787863351 ; total 0 ; last 0)
total: 1000 unlinks in 37 seconds: 27.027027 unlinks/second
Time for file removal 49 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8