== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 01:14:59 (1781241299)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.49 seconds: 20.21 ops/second
 - mkdir 145 (time 1781241317.54 total 10.03 last 14.45)
 - mkdir 313 (time 1781241327.58 total 20.08 last 16.73)
 - mkdir 461 (time 1781241337.62 total 30.11 last 14.75)
 - mkdir 626 (time 1781241347.70 total 40.20 last 16.36)
 - mkdir 781 (time 1781241357.75 total 50.25 last 15.43)
 - mkdir 913 (time 1781241367.75 total 60.25 last 13.20)
total: 1000 mkdir in 65.65 seconds: 15.23 ops/second
 - mkdir 147 (time 1781241317.99 total 10.00 last 14.70)
 - mkdir 306 (time 1781241328.01 total 20.02 last 15.87)
 - mkdir 450 (time 1781241338.02 total 30.04 last 14.38)
 - mkdir 611 (time 1781241348.08 total 40.09 last 16.01)
 - mkdir 766 (time 1781241358.13 total 50.14 last 15.42)
 - mkdir 897 (time 1781241368.15 total 60.17 last 13.07)
total: 1000 mkdir in 68.50 seconds: 14.60 ops/second
 - mkdir 155 (time 1781241320.47 total 10.01 last 15.49)
 - mkdir 321 (time 1781241330.48 total 20.02 last 16.58)
 - mkdir 473 (time 1781241340.52 total 30.06 last 15.14)
 - mkdir 636 (time 1781241350.57 total 40.11 last 16.22)
 - mkdir 786 (time 1781241360.59 total 50.13 last 14.96)
 - mkdir 930 (time 1781241370.63 total 60.17 last 14.35)
total: 1000 mkdir in 66.63 seconds: 15.01 ops/second
 - mkdir 152 (time 1781241319.57 total 10.03 last 15.16)
 - mkdir 308 (time 1781241329.57 total 20.03 last 15.60)
 - mkdir 452 (time 1781241339.57 total 30.03 last 14.40)
 - mkdir 616 (time 1781241349.59 total 40.05 last 16.37)
 - mkdir 760 (time 1781241359.61 total 50.07 last 14.37)
 - mkdir 896 (time 1781241369.63 total 60.09 last 13.57)
 - mkdir 996 (time 1781241379.64 total 70.10 last 9.99)
total: 1000 mkdir in 70.59 seconds: 14.17 ops/second
 - mkdir 149 (time 1781241320.06 total 10.00 last 14.89)
 - mkdir 316 (time 1781241330.08 total 20.02 last 16.67)
 - mkdir 461 (time 1781241340.10 total 30.04 last 14.48)
 - mkdir 630 (time 1781241350.12 total 40.06 last 16.86)
 - mkdir 779 (time 1781241360.17 total 50.11 last 14.82)
 - mkdir 909 (time 1781241370.25 total 60.19 last 12.90)
 - mkdir 999 (time 1781241380.32 total 70.26 last 8.94)
total: 1000 mkdir in 70.26 seconds: 14.23 ops/second
 - mkdir 152 (time 1781241320.27 total 10.03 last 15.16)
 - mkdir 317 (time 1781241330.29 total 20.05 last 16.46)
 - mkdir 465 (time 1781241340.31 total 30.06 last 14.78)
 - mkdir 632 (time 1781241350.33 total 40.09 last 16.65)
 - mkdir 780 (time 1781241360.43 total 50.19 last 14.66)
 - mkdir 911 (time 1781241370.51 total 60.27 last 13.00)
total: 1000 mkdir in 70.14 seconds: 14.26 ops/second
 - mkdir 151 (time 1781241320.19 total 10.02 last 15.08)
 - mkdir 310 (time 1781241330.24 total 20.07 last 15.82)
 - mkdir 468 (time 1781241340.27 total 30.09 last 15.76)
 - mkdir 630 (time 1781241350.32 total 40.14 last 16.13)
 - mkdir 775 (time 1781241360.33 total 50.15 last 14.49)
 - mkdir 907 (time 1781241370.33 total 60.15 last 13.20)
 - mkdir 998 (time 1781241380.53 total 70.35 last 8.92)
total: 1000 mkdir in 70.59 seconds: 14.17 ops/second
 - mkdir 156 (time 1781241320.79 total 10.05 last 15.52)
 - mkdir 315 (time 1781241330.86 total 20.12 last 15.79)
 - mkdir 470 (time 1781241340.87 total 30.13 last 15.48)
 - mkdir 630 (time 1781241350.88 total 40.15 last 15.98)
 - mkdir 770 (time 1781241360.96 total 50.22 last 13.89)
 - mkdir 911 (time 1781241370.98 total 60.25 last 14.07)
 - mkdir 996 (time 1781241381.09 total 70.35 last 8.41)
total: 1000 mkdir in 70.65 seconds: 14.15 ops/second
 - mkdir 157 (time 1781241320.66 total 10.03 last 15.65)
 - mkdir 317 (time 1781241330.73 total 20.10 last 15.89)
 - mkdir 469 (time 1781241340.76 total 30.13 last 15.15)
 - mkdir 632 (time 1781241350.83 total 40.20 last 16.18)
 - mkdir 774 (time 1781241360.88 total 50.25 last 14.14)
 - mkdir 913 (time 1781241370.90 total 60.28 last 13.86)
 - mkdir 994 (time 1781241380.96 total 70.33 last 8.05)
total: 1000 mkdir in 70.86 seconds: 14.11 ops/second
 - mkdir 155 (time 1781241320.86 total 10.03 last 15.45)
 - mkdir 311 (time 1781241330.91 total 20.08 last 15.52)
 - mkdir 455 (time 1781241340.92 total 30.09 last 14.39)
 - mkdir 612 (time 1781241350.92 total 40.09 last 15.70)
 - mkdir 751 (time 1781241360.99 total 50.16 last 13.80)
 - mkdir 885 (time 1781241371.00 total 60.18 last 13.38)
 - mkdir 974 (time 1781241381.13 total 70.30 last 8.79)
total: 1000 mkdir in 72.48 seconds: 13.80 ops/second
Time for file creation 83 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 16 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.52 seconds: 19.15 ops/second
 - mkdir 192 (time 1781241897.33 total 10.02 last 19.16)
 - mkdir 369 (time 1781241907.37 total 20.06 last 17.64)
 - mkdir 531 (time 1781241917.39 total 30.08 last 16.17)
 - mkdir 745 (time 1781241927.39 total 40.08 last 21.39)
 - mkdir 925 (time 1781241937.44 total 50.13 last 17.91)
total: 1000 mkdir in 54.38 seconds: 18.39 ops/second
 - mkdir 197 (time 1781241900.78 total 10.03 last 19.64)
 - mkdir 369 (time 1781241910.80 total 20.04 last 17.18)
 - mkdir 566 (time 1781241920.84 total 30.08 last 19.62)
 - mkdir 780 (time 1781241930.89 total 40.14 last 21.29)
 - mkdir 967 (time 1781241940.92 total 50.16 last 18.65)
total: 1000 mkdir in 52.83 seconds: 18.93 ops/second
 - mkdir 177 (time 1781241899.41 total 10.01 last 17.68)
 - mkdir 356 (time 1781241909.51 total 20.11 last 17.72)
 - mkdir 539 (time 1781241919.51 total 30.12 last 18.29)
 - mkdir 748 (time 1781241929.52 total 40.12 last 20.89)
 - mkdir 923 (time 1781241939.54 total 50.14 last 17.46)
total: 1000 mkdir in 56.28 seconds: 17.77 ops/second
 - mkdir 189 (time 1781241900.39 total 10.02 last 18.87)
 - mkdir 364 (time 1781241910.39 total 20.02 last 17.50)
 - mkdir 548 (time 1781241920.42 total 30.05 last 18.34)
 - mkdir 755 (time 1781241930.50 total 40.13 last 20.54)
 - mkdir 939 (time 1781241940.52 total 50.15 last 18.36)
total: 1000 mkdir in 55.38 seconds: 18.06 ops/second
 - mkdir 185 (time 1781241899.75 total 10.00 last 18.50)
 - mkdir 361 (time 1781241909.76 total 20.01 last 17.59)
 - mkdir 535 (time 1781241919.84 total 30.09 last 17.25)
 - mkdir 749 (time 1781241929.89 total 40.14 last 21.29)
 - mkdir 927 (time 1781241939.92 total 50.17 last 17.75)
total: 1000 mkdir in 56.88 seconds: 17.58 ops/second
 - mkdir 187 (time 1781241900.01 total 10.03 last 18.64)
 - mkdir 357 (time 1781241910.08 total 20.10 last 16.88)
 - mkdir 541 (time 1781241920.08 total 30.11 last 18.39)
 - mkdir 746 (time 1781241930.11 total 40.14 last 20.43)
 - mkdir 930 (time 1781241940.14 total 50.17 last 18.35)
total: 1000 mkdir in 57.19 seconds: 17.49 ops/second
 - mkdir 184 (time 1781241900.23 total 10.01 last 18.38)
 - mkdir 355 (time 1781241910.28 total 20.06 last 17.02)
 - mkdir 535 (time 1781241920.32 total 30.10 last 17.93)
 - mkdir 743 (time 1781241930.33 total 40.11 last 20.77)
 - mkdir 928 (time 1781241940.38 total 50.17 last 18.40)
total: 1000 mkdir in 57.14 seconds: 17.50 ops/second
 - mkdir 175 (time 1781241899.82 total 10.00 last 17.49)
 - mkdir 343 (time 1781241909.87 total 20.06 last 16.71)
 - mkdir 526 (time 1781241919.89 total 30.08 last 18.26)
 - mkdir 739 (time 1781241929.93 total 40.12 last 21.22)
 - mkdir 914 (time 1781241939.94 total 50.13 last 17.48)
total: 1000 mkdir in 58.08 seconds: 17.22 ops/second
 - mkdir 181 (time 1781241900.29 total 10.00 last 18.09)
 - mkdir 348 (time 1781241910.30 total 20.02 last 16.67)
 - mkdir 532 (time 1781241920.32 total 30.04 last 18.37)
 - mkdir 735 (time 1781241930.33 total 40.05 last 20.28)
 - mkdir 920 (time 1781241940.39 total 50.10 last 18.40)
total: 1000 mkdir in 58.10 seconds: 17.21 ops/second
 - mkdir 177 (time 1781241900.35 total 10.03 last 17.65)
 - mkdir 340 (time 1781241910.37 total 20.05 last 16.27)
 - mkdir 517 (time 1781241920.40 total 30.08 last 17.64)
 - mkdir 721 (time 1781241930.44 total 40.12 last 20.32)
 - mkdir 897 (time 1781241940.48 total 50.16 last 17.54)
total: 1000 mkdir in 59.23 seconds: 16.88 ops/second
Time for file creation 68 sec for 1 RPC sent at a time
 - unlinked 0 (time 1781241955 ; total 0 ; last 0)
total: 1000 unlinks in 30 seconds: 33.333332 unlinks/second
 - unlinked 0 (time 1781241956 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781241956 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781241957 ; total 1 ; last 1)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781241957 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781241957 ; total 0 ; last 0)
total: 1000 unlinks in 34 seconds: 29.411764 unlinks/second
 - unlinked 0 (time 1781241957 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1781241957 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1781241957 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
 - unlinked 0 (time 1781241957 ; total 0 ; last 0)
total: 1000 unlinks in 35 seconds: 28.571428 unlinks/second
Time for file removal 45 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8