== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 03:43:35 (1787730215)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.62 seconds: 16.12 ops/second
 - mkdir 161 (time 1787730236.12 total 10.00 last 16.10)
 - mkdir 309 (time 1787730246.14 total 20.02 last 14.77)
 - mkdir 479 (time 1787730256.18 total 30.06 last 16.94)
 - mkdir 655 (time 1787730266.25 total 40.13 last 17.48)
 - mkdir 843 (time 1787730276.27 total 50.15 last 18.76)
total: 1000 mkdir in 59.64 seconds: 16.77 ops/second
 - mkdir 170 (time 1787730237.12 total 10.04 last 16.94)
 - mkdir 312 (time 1787730247.15 total 20.07 last 14.16)
 - mkdir 484 (time 1787730257.16 total 30.08 last 17.17)
 - mkdir 661 (time 1787730267.18 total 40.10 last 17.67)
 - mkdir 848 (time 1787730277.23 total 50.15 last 18.61)
total: 1000 mkdir in 59.66 seconds: 16.76 ops/second
 - mkdir 168 (time 1787730236.76 total 10.03 last 16.75)
 - mkdir 309 (time 1787730246.76 total 20.03 last 14.10)
 - mkdir 472 (time 1787730256.80 total 30.08 last 16.23)
 - mkdir 647 (time 1787730266.80 total 40.08 last 17.50)
 - mkdir 833 (time 1787730276.80 total 50.08 last 18.60)
 - mkdir 992 (time 1787730286.84 total 60.11 last 15.84)
total: 1000 mkdir in 60.75 seconds: 16.46 ops/second
 - mkdir 164 (time 1787730236.71 total 10.04 last 16.34)
 - mkdir 304 (time 1787730246.73 total 20.05 last 13.98)
 - mkdir 474 (time 1787730256.76 total 30.09 last 16.94)
 - mkdir 645 (time 1787730266.79 total 40.11 last 17.05)
 - mkdir 827 (time 1787730276.83 total 50.16 last 18.12)
 - mkdir 988 (time 1787730286.94 total 60.26 last 15.94)
total: 1000 mkdir in 61.37 seconds: 16.30 ops/second
 - mkdir 160 (time 1787730236.30 total 10.02 last 15.97)
 - mkdir 301 (time 1787730246.34 total 20.06 last 14.05)
 - mkdir 464 (time 1787730256.37 total 30.09 last 16.25)
 - mkdir 636 (time 1787730266.43 total 40.15 last 17.10)
 - mkdir 818 (time 1787730276.46 total 50.17 last 18.15)
 - mkdir 982 (time 1787730286.47 total 60.19 last 16.38)
total: 1000 mkdir in 62.06 seconds: 16.11 ops/second
 - mkdir 159 (time 1787730236.62 total 10.05 last 15.82)
 - mkdir 299 (time 1787730246.65 total 20.08 last 13.96)
 - mkdir 463 (time 1787730256.69 total 30.12 last 16.33)
 - mkdir 639 (time 1787730266.73 total 40.16 last 17.53)
 - mkdir 819 (time 1787730276.76 total 50.19 last 17.94)
 - mkdir 979 (time 1787730286.92 total 60.35 last 15.75)
total: 1000 mkdir in 62.72 seconds: 15.94 ops/second
 - mkdir 153 (time 1787730235.63 total 10.02 last 15.27)
 - mkdir 296 (time 1787730245.69 total 20.08 last 14.22)
 - mkdir 449 (time 1787730255.73 total 30.12 last 15.24)
 - mkdir 624 (time 1787730265.74 total 40.12 last 17.49)
 - mkdir 801 (time 1787730275.76 total 50.14 last 17.67)
 - mkdir 964 (time 1787730285.80 total 60.19 last 16.23)
total: 1000 mkdir in 64.21 seconds: 15.57 ops/second
 - mkdir 166 (time 1787730237.01 total 10.06 last 16.51)
 - mkdir 304 (time 1787730247.03 total 20.07 last 13.78)
 - mkdir 464 (time 1787730257.05 total 30.10 last 15.96)
 - mkdir 635 (time 1787730267.11 total 40.16 last 17.00)
 - mkdir 819 (time 1787730277.12 total 50.16 last 18.39)
 - mkdir 975 (time 1787730287.22 total 60.26 last 15.45)
total: 1000 mkdir in 63.00 seconds: 15.87 ops/second
 - mkdir 161 (time 1787730236.63 total 10.04 last 16.03)
 - mkdir 302 (time 1787730246.73 total 20.14 last 13.96)
 - mkdir 460 (time 1787730256.75 total 30.17 last 15.76)
 - mkdir 626 (time 1787730266.79 total 40.20 last 16.55)
 - mkdir 810 (time 1787730276.81 total 50.23 last 18.35)
 - mkdir 966 (time 1787730286.91 total 60.33 last 15.45)
total: 1000 mkdir in 64.38 seconds: 15.53 ops/second
 - mkdir 154 (time 1787730236.76 total 10.03 last 15.36)
 - mkdir 285 (time 1787730246.77 total 20.04 last 13.09)
 - mkdir 442 (time 1787730256.79 total 30.06 last 15.66)
 - mkdir 608 (time 1787730266.85 total 40.12 last 16.50)
 - mkdir 783 (time 1787730276.88 total 50.14 last 17.46)
 - mkdir 936 (time 1787730286.99 total 60.26 last 15.13)
total: 1000 mkdir in 66.33 seconds: 15.08 ops/second
Time for file creation 76 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 13 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.57 seconds: 17.50 ops/second
 - mkdir 188 (time 1787730834.44 total 10.02 last 18.77)
 - mkdir 345 (time 1787730844.48 total 20.06 last 15.63)
 - mkdir 516 (time 1787730854.49 total 30.07 last 17.09)
 - mkdir 674 (time 1787730864.51 total 40.09 last 15.77)
 - mkdir 841 (time 1787730874.52 total 50.09 last 16.69)
total: 1000 mkdir in 58.74 seconds: 17.02 ops/second
 - mkdir 178 (time 1787730835.38 total 10.02 last 17.76)
 - mkdir 332 (time 1787730845.50 total 20.14 last 15.22)
 - mkdir 494 (time 1787730855.50 total 30.15 last 16.19)
 - mkdir 651 (time 1787730865.53 total 40.17 last 15.67)
 - mkdir 818 (time 1787730875.54 total 50.18 last 16.67)
 - mkdir 983 (time 1787730885.62 total 60.26 last 16.37)
total: 1000 mkdir in 62.51 seconds: 16.00 ops/second
 - mkdir 182 (time 1787730836.08 total 10.03 last 18.14)
 - mkdir 332 (time 1787730846.11 total 20.06 last 14.97)
 - mkdir 494 (time 1787730856.11 total 30.06 last 16.19)
 - mkdir 661 (time 1787730866.12 total 40.07 last 16.69)
 - mkdir 828 (time 1787730876.14 total 50.09 last 16.66)
 - mkdir 986 (time 1787730886.17 total 60.12 last 15.76)
total: 1000 mkdir in 61.94 seconds: 16.14 ops/second
 - mkdir 180 (time 1787730835.37 total 10.08 last 17.86)
 - mkdir 329 (time 1787730845.39 total 20.09 last 14.88)
 - mkdir 487 (time 1787730855.39 total 30.10 last 15.79)
 - mkdir 644 (time 1787730865.43 total 40.14 last 15.64)
 - mkdir 809 (time 1787730875.46 total 50.17 last 16.45)
 - mkdir 978 (time 1787730885.54 total 60.24 last 16.77)
total: 1000 mkdir in 63.03 seconds: 15.87 ops/second
 - mkdir 175 (time 1787730835.69 total 10.05 last 17.41)
 - mkdir 326 (time 1787730845.73 total 20.09 last 15.04)
 - mkdir 491 (time 1787730855.81 total 30.17 last 16.37)
 - mkdir 652 (time 1787730865.84 total 40.20 last 16.05)
 - mkdir 816 (time 1787730875.86 total 50.22 last 16.36)
 - mkdir 978 (time 1787730885.87 total 60.23 last 16.19)
total: 1000 mkdir in 62.74 seconds: 15.94 ops/second
 - mkdir 174 (time 1787730835.85 total 10.00 last 17.40)
 - mkdir 324 (time 1787730845.94 total 20.10 last 14.86)
 - mkdir 486 (time 1787730855.95 total 30.11 last 16.18)
 - mkdir 649 (time 1787730865.99 total 40.14 last 16.25)
 - mkdir 818 (time 1787730876.00 total 50.15 last 16.88)
 - mkdir 981 (time 1787730886.10 total 60.25 last 16.14)
total: 1000 mkdir in 62.62 seconds: 15.97 ops/second
 - mkdir 173 (time 1787730835.26 total 10.02 last 17.26)
 - mkdir 321 (time 1787730845.35 total 20.11 last 14.67)
 - mkdir 481 (time 1787730855.46 total 30.23 last 15.82)
 - mkdir 640 (time 1787730865.49 total 40.25 last 15.86)
 - mkdir 806 (time 1787730875.52 total 50.28 last 16.54)
 - mkdir 973 (time 1787730885.55 total 60.31 last 16.65)
total: 1000 mkdir in 63.37 seconds: 15.78 ops/second
 - mkdir 171 (time 1787730835.96 total 10.06 last 16.99)
 - mkdir 321 (time 1787730845.99 total 20.09 last 14.96)
 - mkdir 483 (time 1787730855.99 total 30.10 last 16.19)
 - mkdir 652 (time 1787730866.03 total 40.13 last 16.84)
 - mkdir 823 (time 1787730876.06 total 50.16 last 17.05)
 - mkdir 979 (time 1787730886.10 total 60.20 last 15.53)
total: 1000 mkdir in 62.82 seconds: 15.92 ops/second
 - mkdir 173 (time 1787730835.69 total 10.05 last 17.21)
 - mkdir 322 (time 1787730845.73 total 20.10 last 14.84)
 - mkdir 488 (time 1787730855.79 total 30.15 last 16.51)
 - mkdir 652 (time 1787730865.80 total 40.16 last 16.39)
 - mkdir 811 (time 1787730875.80 total 50.16 last 15.89)
 - mkdir 975 (time 1787730885.90 total 60.27 last 16.24)
total: 1000 mkdir in 63.13 seconds: 15.84 ops/second
 - mkdir 170 (time 1787730835.16 total 10.00 last 17.00)
 - mkdir 313 (time 1787730845.18 total 20.02 last 14.28)
 - mkdir 467 (time 1787730855.21 total 30.05 last 15.35)
 - mkdir 629 (time 1787730865.21 total 40.05 last 16.20)
 - mkdir 797 (time 1787730875.24 total 50.08 last 16.75)
 - mkdir 967 (time 1787730885.27 total 60.11 last 16.95)
total: 1000 mkdir in 63.65 seconds: 15.71 ops/second
Time for file creation 73 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787730896 ; total 0 ; last 0)
total: 1000 unlinks in 28 seconds: 35.714287 unlinks/second
 - unlinked 0 (time 1787730896 ; total 0 ; last 0)
total: 1000 unlinks in 29 seconds: 34.482758 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787730897 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
Time for file removal 39 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8