== sanity test 182b: Test parallel modify metadata operations from osp ========================================================== 12:30:17 (1787848217)
osp.lustre-MDT0000-osp-MDT0001.rpc_stats
osp.lustre-MDT0001-osp-MDT0000.rpc_stats
total: 10 mkdir in 0.47 seconds: 21.09 ops/second
 - mkdir 142 (time 1787848239.56 total 10.02 last 14.17)
 - mkdir 304 (time 1787848249.59 total 20.04 last 16.16)
 - mkdir 457 (time 1787848259.63 total 30.08 last 15.24)
 - mkdir 608 (time 1787848269.70 total 40.16 last 14.99)
 - mkdir 780 (time 1787848279.72 total 50.17 last 17.17)
 - mkdir 955 (time 1787848289.73 total 60.19 last 17.48)
total: 1000 mkdir in 63.57 seconds: 15.73 ops/second
 - mkdir 147 (time 1787848239.57 total 10.05 last 14.63)
 - mkdir 313 (time 1787848249.61 total 20.08 last 16.55)
 - mkdir 465 (time 1787848259.61 total 30.09 last 15.19)
 - mkdir 612 (time 1787848269.75 total 40.22 last 14.51)
 - mkdir 782 (time 1787848279.85 total 50.33 last 16.82)
 - mkdir 953 (time 1787848289.90 total 60.38 last 17.02)
total: 1000 mkdir in 63.58 seconds: 15.73 ops/second
 - mkdir 149 (time 1787848240.53 total 10.01 last 14.89)
 - mkdir 309 (time 1787848250.58 total 20.06 last 15.91)
 - mkdir 462 (time 1787848260.64 total 30.12 last 15.21)
 - mkdir 612 (time 1787848270.65 total 40.13 last 14.99)
 - mkdir 785 (time 1787848280.66 total 50.14 last 17.28)
 - mkdir 946 (time 1787848290.72 total 60.20 last 16.00)
total: 1000 mkdir in 64.10 seconds: 15.60 ops/second
 - mkdir 153 (time 1787848240.73 total 10.05 last 15.23)
 - mkdir 312 (time 1787848250.74 total 20.06 last 15.88)
 - mkdir 465 (time 1787848260.81 total 30.13 last 15.19)
 - mkdir 613 (time 1787848270.83 total 40.14 last 14.78)
 - mkdir 784 (time 1787848280.84 total 50.15 last 17.08)
 - mkdir 949 (time 1787848290.84 total 60.16 last 16.50)
total: 1000 mkdir in 64.30 seconds: 15.55 ops/second
 - mkdir 147 (time 1787848240.18 total 10.01 last 14.69)
 - mkdir 302 (time 1787848250.22 total 20.04 last 15.44)
 - mkdir 457 (time 1787848260.26 total 30.09 last 15.43)
 - mkdir 602 (time 1787848270.34 total 40.16 last 14.40)
 - mkdir 775 (time 1787848280.38 total 50.20 last 17.23)
 - mkdir 940 (time 1787848290.41 total 60.24 last 16.44)
total: 1000 mkdir in 65.28 seconds: 15.32 ops/second
 - mkdir 143 (time 1787848240.76 total 10.03 last 14.26)
 - mkdir 310 (time 1787848250.81 total 20.08 last 16.62)
 - mkdir 460 (time 1787848260.86 total 30.13 last 14.92)
 - mkdir 607 (time 1787848270.87 total 40.14 last 14.69)
 - mkdir 775 (time 1787848280.88 total 50.15 last 16.78)
 - mkdir 938 (time 1787848290.91 total 60.17 last 16.26)
total: 1000 mkdir in 65.55 seconds: 15.25 ops/second
 - mkdir 144 (time 1787848240.40 total 10.02 last 14.37)
 - mkdir 300 (time 1787848250.41 total 20.04 last 15.58)
 - mkdir 449 (time 1787848260.48 total 30.10 last 14.80)
 - mkdir 593 (time 1787848270.50 total 40.12 last 14.37)
 - mkdir 766 (time 1787848280.54 total 50.16 last 17.24)
 - mkdir 937 (time 1787848290.59 total 60.21 last 17.02)
total: 1000 mkdir in 66.15 seconds: 15.12 ops/second
 - mkdir 139 (time 1787848240.08 total 10.03 last 13.85)
 - mkdir 297 (time 1787848250.08 total 20.04 last 15.79)
 - mkdir 449 (time 1787848260.12 total 30.08 last 15.14)
 - mkdir 595 (time 1787848270.12 total 40.08 last 14.60)
 - mkdir 764 (time 1787848280.14 total 50.10 last 16.86)
 - mkdir 928 (time 1787848290.18 total 60.13 last 16.35)
total: 1000 mkdir in 66.49 seconds: 15.04 ops/second
 - mkdir 137 (time 1787848240.29 total 10.03 last 13.66)
 - mkdir 289 (time 1787848250.33 total 20.07 last 15.14)
 - mkdir 441 (time 1787848260.34 total 30.08 last 15.18)
 - mkdir 584 (time 1787848270.34 total 40.08 last 14.30)
 - mkdir 754 (time 1787848280.35 total 50.08 last 17.00)
 - mkdir 920 (time 1787848290.38 total 60.12 last 16.54)
total: 1000 mkdir in 67.48 seconds: 14.82 ops/second
 - mkdir 131 (time 1787848240.18 total 10.02 last 13.08)
 - mkdir 287 (time 1787848250.19 total 20.03 last 15.58)
 - mkdir 434 (time 1787848260.23 total 30.07 last 14.64)
 - mkdir 579 (time 1787848270.25 total 40.09 last 14.47)
 - mkdir 750 (time 1787848280.30 total 50.13 last 17.02)
 - mkdir 921 (time 1787848290.38 total 60.22 last 16.95)
total: 1000 mkdir in 68.07 seconds: 14.69 ops/second
Time for file creation 79 sec for 8 parallel RPCs
rmdir(/mnt/lustre/d182b.sanity/0/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/6/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/1/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/4/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/7/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/3/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/5/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/8/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/9/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
rmdir(/mnt/lustre/d182b.sanity/2/d-0) error: No such file or directory
total: 0 unlinks in 0 seconds: -nan unlinks/second
Time for file removal 11 sec for 8 parallel RPCs
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=1
total: 10 mkdir in 0.42 seconds: 24.02 ops/second
 - mkdir 158 (time 1787848837.88 total 10.04 last 15.74)
 - mkdir 336 (time 1787848847.93 total 20.09 last 17.72)
 - mkdir 491 (time 1787848858.02 total 30.18 last 15.36)
 - mkdir 673 (time 1787848868.03 total 40.19 last 18.18)
 - mkdir 856 (time 1787848878.06 total 50.22 last 18.25)
total: 1000 mkdir in 58.84 seconds: 17.00 ops/second
 - mkdir 167 (time 1787848838.70 total 10.01 last 16.69)
 - mkdir 344 (time 1787848848.74 total 20.04 last 17.64)
 - mkdir 495 (time 1787848858.75 total 30.06 last 15.08)
 - mkdir 677 (time 1787848868.76 total 40.06 last 18.19)
 - mkdir 854 (time 1787848878.81 total 50.11 last 17.62)
total: 1000 mkdir in 59.09 seconds: 16.92 ops/second
 - mkdir 153 (time 1787848838.50 total 10.03 last 15.26)
 - mkdir 330 (time 1787848848.50 total 20.03 last 17.70)
 - mkdir 480 (time 1787848858.52 total 30.05 last 14.97)
 - mkdir 661 (time 1787848868.56 total 40.09 last 18.03)
 - mkdir 845 (time 1787848878.58 total 50.11 last 18.35)
total: 1000 mkdir in 59.67 seconds: 16.76 ops/second
 - mkdir 155 (time 1787848838.78 total 10.02 last 15.47)
 - mkdir 330 (time 1787848848.83 total 20.06 last 17.42)
 - mkdir 482 (time 1787848858.84 total 30.07 last 15.19)
 - mkdir 665 (time 1787848868.87 total 40.11 last 18.23)
 - mkdir 850 (time 1787848878.89 total 50.13 last 18.47)
total: 1000 mkdir in 59.67 seconds: 16.76 ops/second
 - mkdir 155 (time 1787848838.40 total 10.04 last 15.44)
 - mkdir 326 (time 1787848848.41 total 20.05 last 17.08)
 - mkdir 474 (time 1787848858.42 total 30.06 last 14.79)
 - mkdir 660 (time 1787848868.45 total 40.09 last 18.54)
 - mkdir 837 (time 1787848878.49 total 50.13 last 17.63)
 - mkdir 995 (time 1787848888.51 total 60.15 last 15.78)
total: 1000 mkdir in 60.50 seconds: 16.53 ops/second
 - mkdir 159 (time 1787848839.04 total 10.02 last 15.86)
 - mkdir 334 (time 1787848849.15 total 20.13 last 17.31)
 - mkdir 489 (time 1787848859.18 total 30.17 last 15.45)
 - mkdir 667 (time 1787848869.20 total 40.19 last 17.76)
 - mkdir 848 (time 1787848879.24 total 50.23 last 18.03)
total: 1000 mkdir in 60.22 seconds: 16.61 ops/second
 - mkdir 150 (time 1787848837.70 total 10.05 last 14.92)
 - mkdir 321 (time 1787848847.75 total 20.10 last 17.02)
 - mkdir 463 (time 1787848857.80 total 30.15 last 14.12)
 - mkdir 639 (time 1787848867.84 total 40.19 last 17.54)
 - mkdir 818 (time 1787848877.87 total 50.22 last 17.84)
 - mkdir 976 (time 1787848887.89 total 60.24 last 15.77)
total: 1000 mkdir in 62.21 seconds: 16.08 ops/second
 - mkdir 146 (time 1787848837.07 total 10.10 last 14.45)
 - mkdir 315 (time 1787848847.11 total 20.14 last 16.83)
 - mkdir 460 (time 1787848857.20 total 30.23 last 14.38)
 - mkdir 636 (time 1787848867.21 total 40.24 last 17.58)
 - mkdir 806 (time 1787848877.21 total 50.24 last 17.00)
 - mkdir 966 (time 1787848887.34 total 60.37 last 15.80)
total: 1000 mkdir in 63.57 seconds: 15.73 ops/second
 - mkdir 155 (time 1787848839.22 total 10.06 last 15.41)
 - mkdir 325 (time 1787848849.23 total 20.07 last 16.98)
 - mkdir 479 (time 1787848859.28 total 30.12 last 15.32)
 - mkdir 658 (time 1787848869.35 total 40.18 last 17.79)
 - mkdir 834 (time 1787848879.38 total 50.22 last 17.54)
 - mkdir 986 (time 1787848889.48 total 60.32 last 15.05)
total: 1000 mkdir in 61.38 seconds: 16.29 ops/second
 - mkdir 145 (time 1787848838.06 total 10.04 last 14.44)
 - mkdir 307 (time 1787848848.09 total 20.08 last 16.15)
 - mkdir 450 (time 1787848858.13 total 30.12 last 14.24)
 - mkdir 630 (time 1787848868.18 total 40.16 last 17.92)
 - mkdir 801 (time 1787848878.18 total 50.17 last 17.09)
 - mkdir 953 (time 1787848888.30 total 60.29 last 15.03)
total: 1000 mkdir in 64.05 seconds: 15.61 ops/second
Time for file creation 73 sec for 1 RPC sent at a time
 - unlinked 0 (time 1787848899 ; total 1 ; last 1)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787848900 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787848900 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787848900 ; total 0 ; last 0)
total: 1000 unlinks in 31 seconds: 32.258064 unlinks/second
 - unlinked 0 (time 1787848900 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787848901 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787848901 ; total 0 ; last 0)
total: 1000 unlinks in 32 seconds: 31.250000 unlinks/second
 - unlinked 0 (time 1787848901 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787848901 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
 - unlinked 0 (time 1787848901 ; total 0 ; last 0)
total: 1000 unlinks in 33 seconds: 30.303030 unlinks/second
Time for file removal 43 sec for 1 RPC sent at a time
osp.lustre-MDT0001-osp-MDT0000.max_mod_rpcs_in_flight=8