-----============= acceptance-small: sanity ============----- Mon Aug 24 16:20:57 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg413-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34683217 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34683217 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION >= v2_15_7-16-gab522d54ad (34683217 >= 34539280) for LU-16203, go 60i - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34683217 > 34616886) for LU-14590, go 0d - see CLIENT_VERSION >= v2_17_50-196-g63ee4af3bb (34683217 >= 34681540) for LU-19620, go 60b - see CLIENT_VERSION >= v2_17_50-34-g089f438ba9 (34683217 >= 34681378) for LU-19692, go 77k - see CLIENT_VERSION >= v2_17_50-71-g2cbe29c282 (34683217 >= 34681415) for LU-19644, go 150ib - see CLIENT_VERSION >= v2_17_50-72-ge1f272796c (34683217 >= 34681416) for LU-19743, go 27z - see CLIENT_VERSION >= v2_17_52-99-g84242c4358 (34683217 >= 34681955) for LU-20010, go 56aa - see CLIENT_VERSION >= v2_17_55-19-g2868627130 (34683217 >= 34682643) for LU-20435, go 430a - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34683217 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34683217 <= 34683217) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34683217 < 34486116) for LU-14927, skip 0f - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34683217 < 34681754) for LU-12550, skip 216 excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a 130b 130c 130d 130e 130f 130g skipping tests SLOW=no: 51c 51e 834 === sanity: start setup 16:21:28 (1787602888) === oleg413-client.virtnet: executing check_config_client /mnt/lustre oleg413-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg413-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff8d82d03a2000.idle_timeout=debug osc.lustre-OST0001-osc-ffff8d82d03a2000.idle_timeout=debug disable quota as required oleg413-server: oleg413-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all === sanity: finish setup 16:22:14 (1787602934) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8454] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all == sanity test 27m: create file while OST0 was full ====== 16:22:18 (1787602938) SKIP: sanity test_27m 7534592 > 600000 skipping out-of-space test on OST0 SKIP 27m (4s) == sanity test 51b: exceed 64k subdirectory nlink limit on create, verify unlink ========================================================== 16:22:23 (1787602943) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210688 2048 2206592 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 1792 2206848 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 531060 334 530726 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 536224 314 535910 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 118251 459 117792 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118251 459 117792 1% /mnt/lustre[OST:1] filesystem_summary: 236232 648 235584 1% /mnt/lustre - mkdir 551 (time 1787602959.91 total 10.01 last 55.03) - mkdir 1026 (time 1787602969.91 total 20.02 last 47.48) - mkdir 1488 (time 1787602979.92 total 30.02 last 46.17) - mkdir 1911 (time 1787602989.92 total 40.03 last 42.27) - mkdir 2376 (time 1787602999.93 total 50.03 last 46.49) - mkdir 2873 (time 1787603009.94 total 60.04 last 49.66) - mkdir 3334 (time 1787603019.96 total 70.06 last 46.00) - mkdir 3872 (time 1787603029.97 total 80.07 last 53.76) - mkdir 4377 (time 1787603039.98 total 90.09 last 50.41) - mkdir 4916 (time 1787603050.01 total 100.11 last 53.77) - mkdir 5418 (time 1787603060.02 total 110.12 last 50.15) - mkdir 5909 (time 1787603070.02 total 120.13 last 49.07) - mkdir 6440 (time 1787603080.03 total 130.13 last 53.08) - mkdir 6933 (time 1787603090.05 total 140.15 last 49.20) - mkdir 7394 (time 1787603100.10 total 150.21 last 45.86) - mkdir 7915 (time 1787603110.12 total 160.22 last 52.01) - mkdir 8423 (time 1787603120.12 total 170.23 last 50.78) - mkdir 8938 (time 1787603130.15 total 180.25 last 51.38) - mkdir 9431 (time 1787603140.19 total 190.29 last 49.10) - mkdir 9950 (time 1787603150.19 total 200.30 last 51.87) - mkdir 10447 (time 1787603160.21 total 210.31 last 49.63) - mkdir 10923 (time 1787603170.25 total 220.35 last 47.42) - mkdir 11388 (time 1787603180.28 total 230.39 last 46.34) - mkdir 11891 (time 1787603190.29 total 240.39 last 50.26) - mkdir 12392 (time 1787603200.29 total 250.40 last 50.07) - mkdir 12973 (time 1787603210.31 total 260.41 last 58.00) - mkdir 13446 (time 1787603220.32 total 270.43 last 47.25) - mkdir 13904 (time 1787603230.32 total 280.43 last 45.80) - mkdir 14540 (time 1787603240.33 total 290.43 last 63.55) - mkdir 15127 (time 1787603250.33 total 300.44 last 58.69) - mkdir 15735 (time 1787603260.36 total 310.46 last 60.63) - mkdir 16327 (time 1787603270.37 total 320.47 last 59.15) - mkdir 16913 (time 1787603280.37 total 330.48 last 58.58) - mkdir 17513 (time 1787603290.37 total 340.48 last 59.98) - mkdir 18093 (time 1787603300.38 total 350.49 last 57.95) - mkdir 18714 (time 1787603310.40 total 360.51 last 61.99) - mkdir 19273 (time 1787603320.43 total 370.54 last 55.74) - mkdir 19748 (time 1787603330.46 total 380.56 last 47.36) - mkdir 20000 (time 1787603335.72 total 385.82 last 47.93) - mkdir 20554 (time 1787603345.72 total 395.82 last 55.40) - mkdir 21141 (time 1787603355.73 total 405.84 last 58.63) - mkdir 21737 (time 1787603365.74 total 415.84 last 59.57) - mkdir 22320 (time 1787603375.76 total 425.86 last 58.19) - mkdir 22854 (time 1787603385.76 total 435.86 last 53.37) - mkdir 23335 (time 1787603395.76 total 445.87 last 48.09) - mkdir 23904 (time 1787603405.78 total 455.89 last 56.79) - mkdir 24451 (time 1787603415.79 total 465.90 last 54.64) - mkdir 24947 (time 1787603425.83 total 475.94 last 49.41) - mkdir 25557 (time 1787603435.86 total 485.97 last 60.81) - mkdir 26117 (time 1787603446.11 total 496.22 last 54.63) - mkdir 26649 (time 1787603456.14 total 506.25 last 53.06) - mkdir 27236 (time 1787603466.17 total 516.28 last 58.52) - mkdir 27738 (time 1787603476.18 total 526.29 last 50.15) - mkdir 28253 (time 1787603486.44 total 536.55 last 50.18) - mkdir 28758 (time 1787603496.45 total 546.55 last 50.46) - mkdir 29347 (time 1787603506.45 total 556.56 last 58.87) - mkdir 29879 (time 1787603516.48 total 566.59 last 53.04) - mkdir 30000 (time 1787603519.21 total 569.31 last 44.46) - mkdir 30578 (time 1787603529.21 total 579.32 last 57.77) - mkdir 31105 (time 1787603539.22 total 589.32 last 52.67) - mkdir 31722 (time 1787603549.24 total 599.35 last 61.53) - mkdir 32284 (time 1787603559.39 total 609.49 last 55.42) - mkdir 32798 (time 1787603569.43 total 619.53 last 51.18) total: 32818 mkdir in 619.94 seconds: 52.94 ops/second - mkdir 559 (time 1787602959.92 total 10.01 last 55.85) - mkdir 1029 (time 1787602969.95 total 20.04 last 46.84) - mkdir 1497 (time 1787602979.96 total 30.05 last 46.75) - mkdir 1896 (time 1787602989.98 total 40.07 last 39.85) - mkdir 2353 (time 1787603000.00 total 50.09 last 45.60) - mkdir 2850 (time 1787603010.02 total 60.11 last 49.57) - mkdir 3320 (time 1787603020.03 total 70.12 last 46.99) - mkdir 3868 (time 1787603030.04 total 80.13 last 54.73) - mkdir 4372 (time 1787603040.05 total 90.14 last 50.36) - mkdir 4889 (time 1787603050.08 total 100.17 last 51.53) - mkdir 5401 (time 1787603060.09 total 110.18 last 51.13) - mkdir 5895 (time 1787603070.11 total 120.20 last 49.31) - mkdir 6453 (time 1787603080.13 total 130.22 last 55.70) - mkdir 6945 (time 1787603090.13 total 140.22 last 49.17) - mkdir 7407 (time 1787603100.14 total 150.23 last 46.16) - mkdir 7913 (time 1787603110.15 total 160.24 last 50.55) - mkdir 8433 (time 1787603120.16 total 170.25 last 51.93) - mkdir 8956 (time 1787603130.17 total 180.26 last 52.26) - mkdir 9442 (time 1787603140.21 total 190.30 last 48.43) - mkdir 9937 (time 1787603150.22 total 200.31 last 49.45) - mkdir 10418 (time 1787603160.22 total 210.31 last 48.09) - mkdir 10906 (time 1787603170.23 total 220.32 last 48.77) - mkdir 11366 (time 1787603180.24 total 230.33 last 45.95) - mkdir 11876 (time 1787603190.24 total 240.33 last 50.99) - mkdir 12377 (time 1787603200.25 total 250.34 last 50.07) - mkdir 12971 (time 1787603210.26 total 260.35 last 59.31) - mkdir 13471 (time 1787603220.26 total 270.35 last 49.99) - mkdir 13940 (time 1787603230.31 total 280.40 last 46.66) - mkdir 14553 (time 1787603240.32 total 290.41 last 61.27) - mkdir 15136 (time 1787603250.37 total 300.46 last 58.01) - mkdir 15740 (time 1787603260.37 total 310.46 last 60.38) - mkdir 16339 (time 1787603270.40 total 320.49 last 59.71) - mkdir 16939 (time 1787603280.42 total 330.51 last 59.92) - mkdir 17553 (time 1787603290.42 total 340.51 last 61.40) - mkdir 18111 (time 1787603300.43 total 350.52 last 55.74) - mkdir 18721 (time 1787603310.43 total 360.52 last 60.97) - mkdir 19277 (time 1787603320.44 total 370.53 last 55.54) - mkdir 19747 (time 1787603330.45 total 380.54 last 46.96) - mkdir 20000 (time 1787603335.61 total 385.70 last 49.09) - mkdir 20573 (time 1787603345.64 total 395.73 last 57.14) - mkdir 21153 (time 1787603355.66 total 405.75 last 57.85) - mkdir 21753 (time 1787603365.67 total 415.76 last 59.94) - mkdir 22340 (time 1787603375.68 total 425.77 last 58.65) - mkdir 22880 (time 1787603385.68 total 435.77 last 53.99) - mkdir 23339 (time 1787603395.68 total 445.77 last 45.89) - mkdir 23889 (time 1787603405.68 total 455.77 last 55.00) - mkdir 24436 (time 1787603415.70 total 465.79 last 54.63) - mkdir 24930 (time 1787603425.73 total 475.82 last 49.25) - mkdir 25535 (time 1787603435.74 total 485.83 last 60.42) - mkdir 26119 (time 1787603446.08 total 496.17 last 56.46) - mkdir 26670 (time 1787603456.10 total 506.19 last 54.99) - mkdir 27231 (time 1787603466.10 total 516.19 last 56.09) - mkdir 27735 (time 1787603476.13 total 526.22 last 50.25) - mkdir 28237 (time 1787603486.44 total 536.53 last 48.71) - mkdir 28740 (time 1787603496.46 total 546.55 last 50.19) - mkdir 29301 (time 1787603506.47 total 556.56 last 56.02) - mkdir 29847 (time 1787603516.49 total 566.58 last 54.51) - mkdir 30000 (time 1787603519.78 total 569.87 last 46.58) - mkdir 30601 (time 1787603530.33 total 580.42 last 56.95) - mkdir 31146 (time 1787603540.34 total 590.43 last 54.46) - mkdir 31772 (time 1787603550.35 total 600.44 last 62.53) - mkdir 32293 (time 1787603560.35 total 610.44 last 52.08) total: 32818 mkdir in 620.23 seconds: 52.91 ops/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2210176 490112 1718016 23% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 1792 2206848 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 303970 65971 237999 22% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 536224 314 535910 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 118250 458 117792 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118251 459 117792 1% /mnt/lustre[OST:1] filesystem_summary: 301869 66285 235584 22% /mnt/lustre nlink before: 65638, created before: 65637 - unlinked 0 (time 1787604189 ; total 1 ; last 1) - unlinked 10000 (time 1787604495 ; total 307 ; last 306) - unlinked 20000 (time 1787604835 ; total 647 ; last 340) - unlinked 30000 (time 1787605165 ; total 977 ; last 330) total: 32768 unlinks in 1066 seconds: 30.739212 unlinks/second - unlinked 0 (time 1787604188 ; total 0 ; last 0) - unlinked 10000 (time 1787604497 ; total 309 ; last 309) - unlinked 20000 (time 1787604838 ; total 650 ; last 341) - unlinked 30000 (time 1787605174 ; total 986 ; last 336) total: 32768 unlinks in 1072 seconds: 30.567163 unlinks/second nlink between: 102 - unlinked 0 (time 1787605262 ; total 0 ; last 0) total: 50 unlinks in 3 seconds: 16.666666 unlinks/second - unlinked 0 (time 1787605262 ; total 0 ; last 0) total: 50 unlinks in 3 seconds: 16.666666 unlinks/second nlink after: 2 rmdir(/mnt/lustre/d51b.sanity/d.1.0) error: No such file or directory total: 0 unlinks in 1 seconds: 0.000000 unlinks/second rmdir(/mnt/lustre/d51b.sanity/d.0.0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2208384 2304 2204032 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 1792 2206848 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 526945 335 526610 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 536224 314 535910 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 118250 458 117792 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 118251 459 117792 1% /mnt/lustre[OST:1] filesystem_summary: 236233 649 235584 1% /mnt/lustre PASS 51b (2339s) == sanity test 64b: check out-of-space detection on client ========================================================== 17:01:25 (1787605285) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky STRIPECOUNT=2 ORIGFREE=7534592 MAXFREE=800000 SKIP: oos test_64b oos.sh: 7534592kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 2208384 2304 2204032 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 2210688 1792 2206848 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3771392 2048 3767296 1% /mnt/lustre[OST:1] filesystem_summary: 7542784 4096 7534592 1% /mnt/lustre pass grant check: client:6815744 server:6815744 SKIP 64b (30s) == sanity test 71: Running dbench on lustre (don't segment fault) ============================================================== 17:01:55 (1787605315) striped dir -i1 -c2 -H all_char /mnt/lustre/d71.sanity looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d71.sanity '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2' in /mnt/lustre/d71.sanity at Mon Aug 24 17:02:03 EDT 2026 waiting for dbench pid 15608 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 600 seconds with load 'client.txt' and minimum warmup 120 secs failed to create barrier semaphore 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 0 5 0.00 MB/sec warmup 1 sec latency 906.399 ms 2 45 1.66 MB/sec warmup 2 sec latency 156.710 ms 2 91 2.77 MB/sec warmup 3 sec latency 150.406 ms 2 118 2.70 MB/sec warmup 4 sec latency 295.700 ms 2 154 2.59 MB/sec warmup 5 sec latency 140.110 ms 2 181 2.44 MB/sec warmup 6 sec latency 311.530 ms 2 203 2.27 MB/sec warmup 7 sec latency 198.796 ms 2 241 2.30 MB/sec warmup 8 sec latency 155.228 ms 2 283 2.35 MB/sec warmup 9 sec latency 111.096 ms 2 319 2.32 MB/sec warmup 10 sec latency 177.924 ms 2 367 2.38 MB/sec warmup 11 sec latency 117.485 ms 2 417 2.45 MB/sec warmup 12 sec latency 113.782 ms 2 465 2.50 MB/sec warmup 13 sec latency 122.995 ms 2 507 2.51 MB/sec warmup 14 sec latency 173.495 ms 2 547 2.52 MB/sec warmup 15 sec latency 168.811 ms 2 627 2.62 MB/sec warmup 16 sec latency 126.816 ms 2 671 2.49 MB/sec warmup 17 sec latency 265.819 ms 2 703 2.35 MB/sec warmup 18 sec latency 196.719 ms 2 730 2.24 MB/sec warmup 19 sec latency 186.768 ms 2 776 2.13 MB/sec warmup 20 sec latency 115.791 ms 2 802 2.04 MB/sec warmup 21 sec latency 227.136 ms 2 857 1.96 MB/sec warmup 22 sec latency 105.122 ms 2 888 1.88 MB/sec warmup 23 sec latency 313.854 ms 2 913 1.81 MB/sec warmup 24 sec latency 310.850 ms 2 954 1.74 MB/sec warmup 25 sec latency 209.569 ms 2 982 1.68 MB/sec warmup 26 sec latency 257.500 ms 2 1056 1.69 MB/sec warmup 27 sec latency 101.088 ms 2 1115 1.64 MB/sec warmup 28 sec latency 110.272 ms 2 1152 1.58 MB/sec warmup 29 sec latency 130.323 ms 2 1195 1.53 MB/sec warmup 30 sec latency 104.443 ms 2 1238 1.49 MB/sec warmup 31 sec latency 80.244 ms 2 1278 1.44 MB/sec warmup 32 sec latency 229.866 ms 2 1410 1.57 MB/sec warmup 33 sec latency 104.279 ms 2 1470 1.53 MB/sec warmup 34 sec latency 109.860 ms 2 1507 1.49 MB/sec warmup 35 sec latency 194.829 ms 2 1581 1.45 MB/sec warmup 36 sec latency 89.888 ms 2 1627 1.41 MB/sec warmup 37 sec latency 230.423 ms 2 1667 1.38 MB/sec warmup 38 sec latency 242.847 ms 2 1714 1.34 MB/sec warmup 39 sec latency 112.101 ms 2 1798 1.31 MB/sec warmup 40 sec latency 85.943 ms 2 1850 1.28 MB/sec warmup 41 sec latency 120.379 ms 2 1894 1.26 MB/sec warmup 42 sec latency 263.213 ms 2 1976 1.23 MB/sec warmup 43 sec latency 149.152 ms 2 2012 1.20 MB/sec warmup 44 sec latency 117.327 ms 2 2100 1.18 MB/sec warmup 45 sec latency 85.916 ms 2 2161 1.16 MB/sec warmup 46 sec latency 92.875 ms 2 2194 1.14 MB/sec warmup 47 sec latency 271.506 ms 2 2293 1.15 MB/sec warmup 48 sec latency 90.469 ms 2 2360 1.14 MB/sec warmup 49 sec latency 161.829 ms 2 2395 1.12 MB/sec warmup 50 sec latency 196.280 ms 2 2434 1.10 MB/sec warmup 51 sec latency 227.689 ms 2 2483 1.10 MB/sec warmup 52 sec latency 152.401 ms 2 2580 1.09 MB/sec warmup 53 sec latency 171.030 ms 2 2620 1.08 MB/sec warmup 54 sec latency 130.783 ms 2 2773 1.16 MB/sec warmup 55 sec latency 367.318 ms 2 2910 1.18 MB/sec warmup 56 sec latency 219.801 ms 2 2977 1.17 MB/sec warmup 57 sec latency 266.256 ms 2 3018 1.15 MB/sec warmup 58 sec latency 198.949 ms 2 3211 1.16 MB/sec warmup 59 sec latency 213.514 ms 2 3312 1.18 MB/sec warmup 60 sec latency 120.469 ms 2 3371 1.16 MB/sec warmup 61 sec latency 101.032 ms 2 3543 1.24 MB/sec warmup 62 sec latency 75.191 ms 2 3606 1.22 MB/sec warmup 63 sec latency 102.001 ms 2 3686 1.21 MB/sec warmup 64 sec latency 88.537 ms 2 3733 1.20 MB/sec warmup 65 sec latency 118.018 ms 2 3793 1.20 MB/sec warmup 66 sec latency 119.792 ms 2 3815 1.18 MB/sec warmup 67 sec latency 1098.059 ms 2 3836 1.17 MB/sec warmup 68 sec latency 1624.901 ms 2 3886 1.15 MB/sec warmup 69 sec latency 95.286 ms 2 3924 1.14 MB/sec warmup 70 sec latency 188.058 ms 2 3969 1.13 MB/sec warmup 71 sec latency 127.986 ms 2 4012 1.11 MB/sec warmup 72 sec latency 98.654 ms 2 4062 1.10 MB/sec warmup 73 sec latency 122.959 ms 2 4120 1.08 MB/sec warmup 74 sec latency 106.043 ms 2 4163 1.07 MB/sec warmup 75 sec latency 116.968 ms 2 4212 1.06 MB/sec warmup 76 sec latency 203.303 ms 2 4247 1.04 MB/sec warmup 77 sec latency 403.527 ms 2 4279 1.03 MB/sec warmup 78 sec latency 196.185 ms 2 4306 1.02 MB/sec warmup 79 sec latency 336.721 ms 2 4345 1.01 MB/sec warmup 80 sec latency 177.358 ms 2 4365 1.00 MB/sec warmup 81 sec latency 395.567 ms 2 4402 0.99 MB/sec warmup 82 sec latency 183.311 ms 2 4445 0.98 MB/sec warmup 83 sec latency 201.733 ms 2 4466 0.97 MB/sec warmup 84 sec latency 349.088 ms 2 4489 0.96 MB/sec warmup 85 sec latency 256.648 ms 2 4536 0.95 MB/sec warmup 86 sec latency 328.565 ms 2 4558 0.94 MB/sec warmup 87 sec latency 436.459 ms 2 4618 0.95 MB/sec warmup 88 sec latency 111.292 ms 2 4668 0.94 MB/sec warmup 89 sec latency 124.390 ms 2 4722 0.93 MB/sec warmup 90 sec latency 120.771 ms 2 4780 0.93 MB/sec warmup 91 sec latency 103.413 ms 2 4827 0.92 MB/sec warmup 92 sec latency 114.270 ms 2 4956 0.97 MB/sec warmup 93 sec latency 115.095 ms 2 5000 0.96 MB/sec warmup 94 sec latency 126.936 ms 2 5044 0.95 MB/sec warmup 95 sec latency 228.933 ms 2 5079 0.94 MB/sec warmup 96 sec latency 324.014 ms 2 5128 0.93 MB/sec warmup 97 sec latency 113.766 ms 2 5154 0.92 MB/sec warmup 98 sec latency 129.545 ms 2 5197 0.91 MB/sec warmup 99 sec latency 295.251 ms 2 5236 0.90 MB/sec warmup 100 sec latency 206.578 ms 2 5273 0.90 MB/sec warmup 101 sec latency 95.457 ms 2 5316 0.89 MB/sec warmup 102 sec latency 98.526 ms 2 5360 0.88 MB/sec warmup 103 sec latency 112.599 ms 2 5405 0.87 MB/sec warmup 104 sec latency 107.589 ms 2 5447 0.86 MB/sec warmup 105 sec latency 242.074 ms 2 5519 0.86 MB/sec warmup 106 sec latency 117.611 ms 2 5569 0.85 MB/sec warmup 107 sec latency 128.727 ms 2 5614 0.84 MB/sec warmup 108 sec latency 127.912 ms 2 5662 0.84 MB/sec warmup 109 sec latency 140.367 ms 2 5713 0.83 MB/sec warmup 110 sec latency 89.015 ms 2 5744 0.82 MB/sec warmup 111 sec latency 130.961 ms 2 5805 0.82 MB/sec warmup 112 sec latency 133.239 ms 2 5881 0.83 MB/sec warmup 113 sec latency 153.163 ms 2 5921 0.82 MB/sec warmup 114 sec latency 268.884 ms 2 5946 0.82 MB/sec warmup 115 sec latency 269.052 ms 2 5974 0.81 MB/sec warmup 116 sec latency 228.475 ms 2 6014 0.81 MB/sec warmup 117 sec latency 276.451 ms 2 6075 0.81 MB/sec warmup 118 sec latency 282.488 ms 2 6143 0.81 MB/sec warmup 119 sec latency 215.356 ms 2 6380 3.12 MB/sec execute 1 sec latency 335.601 ms 2 6471 2.63 MB/sec execute 2 sec latency 329.828 ms 2 6521 2.00 MB/sec execute 3 sec latency 238.427 ms 2 6646 1.69 MB/sec execute 4 sec latency 241.778 ms 2 6786 1.71 MB/sec execute 5 sec latency 158.183 ms 2 6867 1.62 MB/sec execute 6 sec latency 242.309 ms 2 6930 1.45 MB/sec execute 7 sec latency 98.256 ms 2 7034 1.61 MB/sec execute 8 sec latency 82.171 ms 2 7147 1.78 MB/sec execute 9 sec latency 89.815 ms 2 7210 1.63 MB/sec execute 10 sec latency 69.291 ms 2 7265 1.59 MB/sec execute 11 sec latency 122.830 ms 2 7326 1.50 MB/sec execute 12 sec latency 78.630 ms 2 7369 1.42 MB/sec execute 13 sec latency 124.996 ms 2 7419 1.34 MB/sec execute 14 sec latency 87.949 ms 2 7475 1.27 MB/sec execute 15 sec latency 90.594 ms 2 7517 1.19 MB/sec execute 16 sec latency 138.360 ms 2 7569 1.12 MB/sec execute 17 sec latency 93.896 ms 2 7620 1.06 MB/sec execute 18 sec latency 92.441 ms 2 7689 1.01 MB/sec execute 19 sec latency 95.329 ms 2 7741 0.97 MB/sec execute 20 sec latency 152.886 ms 2 7786 0.93 MB/sec execute 21 sec latency 272.767 ms 2 7813 0.90 MB/sec execute 22 sec latency 204.968 ms 2 7847 0.86 MB/sec execute 23 sec latency 153.583 ms 2 7876 0.83 MB/sec execute 24 sec latency 235.770 ms 2 7910 0.81 MB/sec execute 25 sec latency 355.961 ms 2 7951 0.78 MB/sec execute 26 sec latency 172.384 ms 2 7992 0.76 MB/sec execute 27 sec latency 312.630 ms 2 8014 0.74 MB/sec execute 28 sec latency 330.259 ms 2 8046 0.72 MB/sec execute 29 sec latency 359.912 ms 2 8086 0.70 MB/sec execute 30 sec latency 166.010 ms 2 8131 0.71 MB/sec execute 31 sec latency 263.159 ms 2 8200 0.72 MB/sec execute 32 sec latency 143.344 ms 2 8259 0.70 MB/sec execute 33 sec latency 103.976 ms 2 8311 0.69 MB/sec execute 34 sec latency 97.994 ms 2 8361 0.67 MB/sec execute 35 sec latency 70.078 ms 2 8447 0.73 MB/sec execute 36 sec latency 101.988 ms 2 8534 0.79 MB/sec execute 37 sec latency 96.301 ms 2 8577 0.77 MB/sec execute 38 sec latency 219.328 ms 2 8628 0.75 MB/sec execute 39 sec latency 210.121 ms 2 8685 0.74 MB/sec execute 40 sec latency 77.876 ms 2 8732 0.72 MB/sec execute 41 sec latency 191.365 ms 2 8784 0.71 MB/sec execute 42 sec latency 163.080 ms 2 8827 0.69 MB/sec execute 43 sec latency 102.363 ms 2 8883 0.68 MB/sec execute 44 sec latency 87.510 ms 2 8928 0.66 MB/sec execute 45 sec latency 77.383 ms 2 8981 0.65 MB/sec execute 46 sec latency 186.450 ms 2 9058 0.64 MB/sec execute 47 sec latency 229.249 ms 2 9111 0.63 MB/sec execute 48 sec latency 110.347 ms 2 9169 0.62 MB/sec execute 49 sec latency 78.686 ms 2 9236 0.61 MB/sec execute 50 sec latency 101.312 ms 2 9288 0.60 MB/sec execute 51 sec latency 107.734 ms 2 9374 0.61 MB/sec execute 52 sec latency 113.988 ms 2 9456 0.62 MB/sec execute 53 sec latency 155.335 ms 2 9492 0.61 MB/sec execute 54 sec latency 225.077 ms 2 9525 0.61 MB/sec execute 55 sec latency 276.821 ms 2 9560 0.61 MB/sec execute 56 sec latency 247.316 ms 2 9627 0.61 MB/sec execute 57 sec latency 219.254 ms 2 9689 0.61 MB/sec execute 58 sec latency 89.441 ms 2 9844 0.70 MB/sec execute 59 sec latency 83.879 ms 2 9980 0.70 MB/sec execute 60 sec latency 299.398 ms 2 10023 0.72 MB/sec execute 61 sec latency 262.168 ms 2 10091 0.71 MB/sec execute 62 sec latency 209.550 ms 2 10205 0.71 MB/sec execute 63 sec latency 196.100 ms 2 10318 0.72 MB/sec execute 64 sec latency 283.033 ms 2 10403 0.74 MB/sec execute 65 sec latency 122.818 ms 2 10460 0.73 MB/sec execute 66 sec latency 106.430 ms 2 10572 0.78 MB/sec execute 67 sec latency 123.989 ms 2 10668 0.79 MB/sec execute 68 sec latency 89.448 ms 2 10725 0.79 MB/sec execute 69 sec latency 104.691 ms 2 10773 0.78 MB/sec execute 70 sec latency 113.381 ms 2 10812 0.77 MB/sec execute 71 sec latency 130.511 ms 2 10873 0.79 MB/sec execute 72 sec latency 117.465 ms 2 10921 0.78 MB/sec execute 73 sec latency 131.283 ms 2 10976 0.77 MB/sec execute 74 sec latency 84.585 ms 2 11009 0.76 MB/sec execute 75 sec latency 110.071 ms 2 11039 0.75 MB/sec execute 76 sec latency 156.303 ms 2 11065 0.74 MB/sec execute 77 sec latency 177.826 ms 2 11109 0.73 MB/sec execute 78 sec latency 122.437 ms 2 11142 0.72 MB/sec execute 79 sec latency 213.337 ms 2 11174 0.72 MB/sec execute 80 sec latency 180.845 ms 2 11220 0.71 MB/sec execute 81 sec latency 99.286 ms 2 11290 0.70 MB/sec execute 82 sec latency 105.784 ms 2 11327 0.70 MB/sec execute 83 sec latency 166.932 ms 2 11354 0.69 MB/sec execute 84 sec latency 207.868 ms 2 11368 0.68 MB/sec execute 85 sec latency 332.970 ms 2 11382 0.67 MB/sec execute 86 sec latency 450.687 ms 2 11396 0.67 MB/sec execute 87 sec latency 322.500 ms 2 11431 0.66 MB/sec execute 88 sec latency 197.646 ms 2 11452 0.66 MB/sec execute 89 sec latency 368.240 ms 2 11474 0.65 MB/sec execute 90 sec latency 304.432 ms 2 11529 0.64 MB/sec execute 91 sec latency 282.379 ms 2 11552 0.64 MB/sec execute 92 sec latency 426.802 ms 2 11576 0.63 MB/sec execute 93 sec latency 228.528 ms 2 11601 0.63 MB/sec execute 94 sec latency 347.764 ms 2 11641 0.62 MB/sec execute 95 sec latency 207.995 ms 2 11706 0.64 MB/sec execute 96 sec latency 190.518 ms 2 11769 0.63 MB/sec execute 97 sec latency 95.727 ms 2 11824 0.63 MB/sec execute 98 sec latency 94.676 ms 2 11878 0.62 MB/sec execute 99 sec latency 87.986 ms 2 11918 0.62 MB/sec execute 100 sec latency 116.407 ms 2 11998 0.64 MB/sec execute 101 sec latency 141.968 ms 2 12063 0.66 MB/sec execute 102 sec latency 162.401 ms 2 12115 0.65 MB/sec execute 103 sec latency 91.566 ms 2 12157 0.65 MB/sec execute 104 sec latency 258.136 ms 2 12215 0.64 MB/sec execute 105 sec latency 101.436 ms 2 12250 0.64 MB/sec execute 106 sec latency 95.863 ms 2 12297 0.63 MB/sec execute 107 sec latency 215.352 ms 2 12342 0.63 MB/sec execute 108 sec latency 283.572 ms 2 12376 0.62 MB/sec execute 109 sec latency 107.774 ms 2 12425 0.62 MB/sec execute 110 sec latency 95.853 ms 2 12455 0.61 MB/sec execute 111 sec latency 121.520 ms 2 12496 0.61 MB/sec execute 112 sec latency 136.283 ms 2 12546 0.60 MB/sec execute 113 sec latency 141.191 ms 2 12615 0.60 MB/sec execute 114 sec latency 106.649 ms 2 12661 0.59 MB/sec execute 115 sec latency 106.372 ms 2 12713 0.59 MB/sec execute 116 sec latency 107.175 ms 2 12781 0.59 MB/sec execute 117 sec latency 90.305 ms 2 12818 0.58 MB/sec execute 118 sec latency 128.880 ms 2 12870 0.58 MB/sec execute 119 sec latency 117.964 ms 2 12954 0.59 MB/sec execute 120 sec latency 99.508 ms 2 13011 0.59 MB/sec execute 121 sec latency 250.499 ms 2 13054 0.58 MB/sec execute 122 sec latency 177.970 ms 2 13093 0.58 MB/sec execute 123 sec latency 170.088 ms 2 13129 0.59 MB/sec execute 124 sec latency 217.189 ms 2 13213 0.59 MB/sec execute 125 sec latency 310.560 ms 2 13259 0.58 MB/sec execute 126 sec latency 81.807 ms 2 13421 0.62 MB/sec execute 127 sec latency 180.609 ms 2 13561 0.64 MB/sec execute 128 sec latency 139.758 ms 2 13632 0.64 MB/sec execute 129 sec latency 172.657 ms 2 13744 0.64 MB/sec execute 130 sec latency 253.956 ms 2 13867 0.64 MB/sec execute 131 sec latency 191.596 ms 2 13954 0.65 MB/sec execute 132 sec latency 230.953 ms 2 14007 0.65 MB/sec execute 133 sec latency 158.798 ms 2 14119 0.67 MB/sec execute 134 sec latency 122.803 ms 2 14235 0.68 MB/sec execute 135 sec latency 93.585 ms 2 14301 0.68 MB/sec execute 136 sec latency 86.636 ms 2 14361 0.68 MB/sec execute 137 sec latency 130.182 ms 2 14426 0.69 MB/sec execute 138 sec latency 99.098 ms 2 14476 0.68 MB/sec execute 139 sec latency 165.999 ms 2 14526 0.68 MB/sec execute 140 sec latency 85.041 ms 2 14573 0.68 MB/sec execute 141 sec latency 138.867 ms 2 14619 0.67 MB/sec execute 142 sec latency 175.148 ms 2 14673 0.67 MB/sec execute 143 sec latency 84.470 ms 2 14724 0.66 MB/sec execute 144 sec latency 88.597 ms 2 14782 0.66 MB/sec execute 145 sec latency 75.216 ms 2 14846 0.66 MB/sec execute 146 sec latency 87.058 ms 2 14878 0.65 MB/sec execute 147 sec latency 383.136 ms 2 14917 0.65 MB/sec execute 148 sec latency 124.138 ms 2 14953 0.65 MB/sec execute 149 sec latency 194.527 ms 2 14992 0.64 MB/sec execute 150 sec latency 219.325 ms 2 15034 0.64 MB/sec execute 151 sec latency 137.813 ms 2 15076 0.64 MB/sec execute 152 sec latency 244.813 ms 2 15110 0.63 MB/sec execute 153 sec latency 214.837 ms 2 15155 0.63 MB/sec execute 154 sec latency 176.997 ms 2 15191 0.63 MB/sec execute 155 sec latency 241.774 ms 2 15262 0.64 MB/sec execute 156 sec latency 263.180 ms 2 15330 0.63 MB/sec execute 157 sec latency 81.425 ms 2 15366 0.63 MB/sec execute 158 sec latency 554.379 ms 2 15415 0.63 MB/sec execute 159 sec latency 89.538 ms 2 15464 0.62 MB/sec execute 160 sec latency 92.635 ms 2 15589 0.66 MB/sec execute 161 sec latency 136.208 ms 2 15636 0.65 MB/sec execute 162 sec latency 118.251 ms 2 15683 0.65 MB/sec execute 163 sec latency 116.454 ms 2 15730 0.64 MB/sec execute 164 sec latency 204.419 ms 2 15774 0.64 MB/sec execute 165 sec latency 92.789 ms 2 15814 0.64 MB/sec execute 166 sec latency 122.898 ms 2 15854 0.63 MB/sec execute 167 sec latency 287.508 ms 2 15888 0.63 MB/sec execute 168 sec latency 168.379 ms 2 15909 0.63 MB/sec execute 169 sec latency 163.212 ms 2 15937 0.62 MB/sec execute 170 sec latency 219.796 ms 2 15985 0.62 MB/sec execute 171 sec latency 118.456 ms 2 16009 0.62 MB/sec execute 172 sec latency 139.374 ms 2 16039 0.61 MB/sec execute 173 sec latency 136.387 ms 2 16078 0.61 MB/sec execute 174 sec latency 120.950 ms 2 16125 0.61 MB/sec execute 175 sec latency 266.094 ms 2 16178 0.60 MB/sec execute 176 sec latency 103.619 ms 2 16213 0.60 MB/sec execute 177 sec latency 116.453 ms 2 16265 0.60 MB/sec execute 178 sec latency 112.715 ms 2 16325 0.60 MB/sec execute 179 sec latency 112.266 ms 2 16349 0.59 MB/sec execute 180 sec latency 226.063 ms 2 16365 0.59 MB/sec execute 181 sec latency 246.591 ms 2 16406 0.59 MB/sec execute 182 sec latency 142.891 ms 2 16458 0.59 MB/sec execute 183 sec latency 139.622 ms 2 16528 0.59 MB/sec execute 184 sec latency 149.257 ms 2 16554 0.59 MB/sec execute 185 sec latency 222.168 ms 2 16583 0.59 MB/sec execute 186 sec latency 183.656 ms 2 16624 0.59 MB/sec execute 187 sec latency 159.424 ms 2 16666 0.59 MB/sec execute 188 sec latency 110.206 ms 2 16723 0.59 MB/sec execute 189 sec latency 270.629 ms 2 16788 0.59 MB/sec execute 190 sec latency 101.828 ms 2 16950 0.61 MB/sec execute 191 sec latency 142.667 ms 2 17020 0.61 MB/sec execute 192 sec latency 333.950 ms 2 17109 0.62 MB/sec execute 193 sec latency 102.080 ms 2 17167 0.62 MB/sec execute 194 sec latency 244.056 ms 2 17197 0.62 MB/sec execute 195 sec latency 300.381 ms 2 17368 0.62 MB/sec execute 196 sec latency 115.146 ms 2 17433 0.62 MB/sec execute 197 sec latency 257.823 ms 2 17526 0.63 MB/sec execute 198 sec latency 156.896 ms 2 17569 0.63 MB/sec execute 199 sec latency 138.571 ms 2 17713 0.65 MB/sec execute 200 sec latency 107.416 ms 2 17773 0.65 MB/sec execute 201 sec latency 89.628 ms 2 17826 0.65 MB/sec execute 202 sec latency 174.598 ms 2 17885 0.65 MB/sec execute 203 sec latency 78.237 ms 2 17943 0.65 MB/sec execute 204 sec latency 142.502 ms 2 17999 0.65 MB/sec execute 205 sec latency 84.972 ms 2 18047 0.65 MB/sec execute 206 sec latency 99.222 ms 2 18098 0.65 MB/sec execute 207 sec latency 112.897 ms 2 18137 0.64 MB/sec execute 208 sec latency 128.001 ms 2 18187 0.64 MB/sec execute 209 sec latency 95.827 ms 2 18232 0.64 MB/sec execute 210 sec latency 99.599 ms 2 18288 0.63 MB/sec execute 211 sec latency 91.068 ms 2 18342 0.63 MB/sec execute 212 sec latency 92.055 ms 2 18401 0.63 MB/sec execute 213 sec latency 119.231 ms 2 18422 0.63 MB/sec execute 214 sec latency 490.325 ms 2 18453 0.62 MB/sec execute 215 sec latency 242.116 ms 2 18485 0.62 MB/sec execute 216 sec latency 246.815 ms 2 18524 0.62 MB/sec execute 217 sec latency 131.816 ms 2 18549 0.62 MB/sec execute 218 sec latency 272.269 ms 2 18575 0.62 MB/sec execute 219 sec latency 167.384 ms 2 18630 0.61 MB/sec execute 220 sec latency 224.765 ms 2 18665 0.61 MB/sec execute 221 sec latency 199.005 ms 2 18711 0.61 MB/sec execute 222 sec latency 166.516 ms 2 18743 0.61 MB/sec execute 223 sec latency 254.857 ms 2 18809 0.61 MB/sec execute 224 sec latency 96.809 ms 2 18875 0.61 MB/sec execute 225 sec latency 98.903 ms 2 18915 0.61 MB/sec execute 226 sec latency 101.559 ms 2 18973 0.61 MB/sec execute 227 sec latency 73.752 ms 2 19015 0.61 MB/sec execute 228 sec latency 94.980 ms 2 19147 0.63 MB/sec execute 229 sec latency 131.955 ms 2 19205 0.62 MB/sec execute 230 sec latency 76.509 ms 2 19257 0.62 MB/sec execute 231 sec latency 193.203 ms 2 19313 0.62 MB/sec execute 232 sec latency 107.893 ms 2 19355 0.62 MB/sec execute 233 sec latency 133.569 ms 2 19401 0.62 MB/sec execute 234 sec latency 157.855 ms 2 19446 0.61 MB/sec execute 235 sec latency 137.162 ms 2 19483 0.61 MB/sec execute 236 sec latency 114.793 ms 2 19542 0.61 MB/sec execute 237 sec latency 87.732 ms 2 19584 0.61 MB/sec execute 238 sec latency 121.395 ms 2 19656 0.60 MB/sec execute 239 sec latency 120.910 ms 2 19736 0.60 MB/sec execute 240 sec latency 95.521 ms 2 19771 0.60 MB/sec execute 241 sec latency 108.644 ms 2 19846 0.60 MB/sec execute 242 sec latency 86.818 ms 2 19913 0.60 MB/sec execute 243 sec latency 83.653 ms 2 19954 0.60 MB/sec execute 245 sec latency 136.504 ms 2 20025 0.59 MB/sec execute 246 sec latency 92.903 ms 2 20124 0.60 MB/sec execute 247 sec latency 81.282 ms 2 20162 0.60 MB/sec execute 248 sec latency 149.498 ms 2 20208 0.60 MB/sec execute 249 sec latency 127.883 ms 2 20263 0.60 MB/sec execute 250 sec latency 275.468 ms 2 20361 0.60 MB/sec execute 251 sec latency 90.151 ms 2 20501 0.62 MB/sec execute 252 sec latency 104.388 ms 2 20660 0.62 MB/sec execute 253 sec latency 173.192 ms 2 20712 0.63 MB/sec execute 254 sec latency 137.003 ms 2 20783 0.63 MB/sec execute 255 sec latency 145.020 ms 2 20977 0.63 MB/sec execute 256 sec latency 113.056 ms 2 21071 0.63 MB/sec execute 257 sec latency 143.665 ms 2 21134 0.63 MB/sec execute 258 sec latency 180.306 ms 2 21264 0.65 MB/sec execute 259 sec latency 108.254 ms 2 21342 0.65 MB/sec execute 260 sec latency 127.113 ms 2 21393 0.65 MB/sec execute 261 sec latency 124.278 ms 2 21446 0.65 MB/sec execute 262 sec latency 123.741 ms 2 21518 0.65 MB/sec execute 263 sec latency 75.663 ms 2 21566 0.65 MB/sec execute 264 sec latency 105.455 ms 2 21609 0.65 MB/sec execute 265 sec latency 233.002 ms 2 21649 0.65 MB/sec execute 266 sec latency 107.499 ms 2 21677 0.65 MB/sec execute 267 sec latency 148.631 ms 2 21725 0.64 MB/sec execute 268 sec latency 121.313 ms 2 21781 0.64 MB/sec execute 269 sec latency 82.574 ms 2 21831 0.64 MB/sec execute 270 sec latency 159.747 ms 2 21876 0.64 MB/sec execute 271 sec latency 126.076 ms 2 21914 0.63 MB/sec execute 272 sec latency 134.544 ms 2 21960 0.63 MB/sec execute 273 sec latency 123.615 ms 2 21996 0.63 MB/sec execute 274 sec latency 228.182 ms 2 22009 0.63 MB/sec execute 275 sec latency 418.253 ms 2 22042 0.63 MB/sec execute 276 sec latency 137.900 ms 2 22065 0.63 MB/sec execute 277 sec latency 318.273 ms 2 22103 0.62 MB/sec execute 278 sec latency 224.332 ms 2 22134 0.62 MB/sec execute 279 sec latency 249.292 ms 2 22173 0.62 MB/sec execute 280 sec latency 118.609 ms 2 22220 0.62 MB/sec execute 281 sec latency 247.860 ms 2 22252 0.62 MB/sec execute 282 sec latency 196.793 ms 2 22299 0.62 MB/sec execute 283 sec latency 105.249 ms 2 22331 0.61 MB/sec execute 284 sec latency 192.931 ms 2 22408 0.62 MB/sec execute 285 sec latency 109.778 ms 2 22466 0.62 MB/sec execute 286 sec latency 80.027 ms 2 22522 0.62 MB/sec execute 287 sec latency 119.386 ms 2 22565 0.61 MB/sec execute 288 sec latency 104.431 ms 2 22616 0.61 MB/sec execute 289 sec latency 109.395 ms 2 22734 0.63 MB/sec execute 290 sec latency 146.159 ms 2 22777 0.63 MB/sec execute 291 sec latency 112.104 ms 2 22823 0.63 MB/sec execute 292 sec latency 219.542 ms 2 22882 0.62 MB/sec execute 293 sec latency 87.017 ms 2 22905 0.62 MB/sec execute 294 sec latency 115.075 ms 2 22946 0.62 MB/sec execute 295 sec latency 105.490 ms 2 22988 0.62 MB/sec execute 296 sec latency 183.002 ms 2 23041 0.62 MB/sec execute 297 sec latency 101.109 ms 2 23086 0.61 MB/sec execute 298 sec latency 117.438 ms 2 23122 0.61 MB/sec execute 299 sec latency 116.657 ms 2 23152 0.61 MB/sec execute 300 sec latency 131.722 ms 2 23184 0.61 MB/sec execute 301 sec latency 149.081 ms 2 23235 0.61 MB/sec execute 302 sec latency 193.589 ms 2 23309 0.61 MB/sec execute 303 sec latency 98.939 ms 2 23340 0.60 MB/sec execute 304 sec latency 124.210 ms 2 23393 0.60 MB/sec execute 305 sec latency 115.468 ms 2 23450 0.60 MB/sec execute 306 sec latency 110.895 ms 2 23489 0.60 MB/sec execute 307 sec latency 115.559 ms 2 23523 0.60 MB/sec execute 308 sec latency 150.408 ms 2 23605 0.60 MB/sec execute 309 sec latency 111.796 ms 2 23676 0.60 MB/sec execute 310 sec latency 202.566 ms 2 23712 0.60 MB/sec execute 311 sec latency 178.176 ms 2 23745 0.60 MB/sec execute 312 sec latency 203.276 ms 2 23792 0.60 MB/sec execute 313 sec latency 80.536 ms 2 23823 0.60 MB/sec execute 314 sec latency 228.774 ms 2 23909 0.60 MB/sec execute 315 sec latency 86.252 ms 2 23969 0.60 MB/sec execute 316 sec latency 138.165 ms 2 24101 0.61 MB/sec execute 317 sec latency 252.714 ms 2 24242 0.62 MB/sec execute 318 sec latency 183.245 ms 2 24301 0.62 MB/sec execute 319 sec latency 191.358 ms 2 24323 0.62 MB/sec execute 320 sec latency 364.780 ms 2 24504 0.62 MB/sec execute 321 sec latency 271.704 ms 2 24563 0.62 MB/sec execute 322 sec latency 238.062 ms 2 24643 0.62 MB/sec execute 323 sec latency 154.601 ms 2 24695 0.62 MB/sec execute 324 sec latency 136.001 ms 2 24836 0.64 MB/sec execute 325 sec latency 167.909 ms 2 24893 0.64 MB/sec execute 326 sec latency 94.840 ms 2 24954 0.64 MB/sec execute 327 sec latency 97.148 ms 2 25010 0.63 MB/sec execute 328 sec latency 121.895 ms 2 25074 0.64 MB/sec execute 329 sec latency 209.525 ms 2 25129 0.64 MB/sec execute 330 sec latency 92.843 ms 2 25189 0.63 MB/sec execute 331 sec latency 76.903 ms 2 25246 0.63 MB/sec execute 332 sec latency 145.774 ms 2 25296 0.63 MB/sec execute 333 sec latency 87.085 ms 2 25340 0.63 MB/sec execute 334 sec latency 116.137 ms 2 25368 0.63 MB/sec execute 335 sec latency 152.577 ms 2 25426 0.63 MB/sec execute 336 sec latency 130.090 ms 2 25472 0.63 MB/sec execute 337 sec latency 111.935 ms 2 25544 0.62 MB/sec execute 338 sec latency 138.315 ms 2 25564 0.62 MB/sec execute 339 sec latency 310.854 ms 2 25607 0.62 MB/sec execute 340 sec latency 166.301 ms 2 25635 0.62 MB/sec execute 341 sec latency 300.904 ms 2 25678 0.62 MB/sec execute 342 sec latency 210.050 ms 2 25709 0.62 MB/sec execute 343 sec latency 217.993 ms 2 25764 0.62 MB/sec execute 344 sec latency 278.649 ms 2 25803 0.62 MB/sec execute 345 sec latency 180.342 ms 2 25851 0.61 MB/sec execute 346 sec latency 112.861 ms 2 25875 0.61 MB/sec execute 347 sec latency 274.599 ms 2 25945 0.62 MB/sec execute 348 sec latency 139.030 ms 2 26009 0.62 MB/sec execute 349 sec latency 85.147 ms 2 26055 0.61 MB/sec execute 350 sec latency 138.017 ms 2 26089 0.61 MB/sec execute 351 sec latency 166.867 ms 2 26128 0.61 MB/sec execute 352 sec latency 120.156 ms 2 26208 0.62 MB/sec execute 353 sec latency 133.499 ms 2 26285 0.62 MB/sec execute 354 sec latency 125.575 ms 2 26334 0.62 MB/sec execute 355 sec latency 100.773 ms 2 26370 0.62 MB/sec execute 356 sec latency 414.877 ms 2 26405 0.62 MB/sec execute 357 sec latency 317.134 ms 2 26445 0.62 MB/sec execute 358 sec latency 141.002 ms 2 26468 0.62 MB/sec execute 359 sec latency 136.517 ms 2 26513 0.61 MB/sec execute 360 sec latency 289.454 ms 2 26549 0.61 MB/sec execute 361 sec latency 306.288 ms 2 26585 0.61 MB/sec execute 362 sec latency 133.846 ms 2 26606 0.61 MB/sec execute 363 sec latency 193.044 ms 2 26659 0.61 MB/sec execute 364 sec latency 114.010 ms 2 26678 0.61 MB/sec execute 365 sec latency 195.626 ms 2 26710 0.61 MB/sec execute 366 sec latency 155.419 ms 2 26752 0.60 MB/sec execute 367 sec latency 141.790 ms 2 26789 0.60 MB/sec execute 368 sec latency 260.299 ms 2 26854 0.60 MB/sec execute 369 sec latency 86.931 ms 2 26878 0.60 MB/sec execute 370 sec latency 180.398 ms 2 26898 0.60 MB/sec execute 371 sec latency 187.501 ms 2 26944 0.60 MB/sec execute 372 sec latency 193.669 ms 2 26987 0.60 MB/sec execute 373 sec latency 146.521 ms 2 27033 0.59 MB/sec execute 374 sec latency 122.076 ms 2 27074 0.59 MB/sec execute 375 sec latency 108.775 ms 2 27143 0.59 MB/sec execute 376 sec latency 107.671 ms 2 27220 0.60 MB/sec execute 377 sec latency 150.461 ms 2 27258 0.59 MB/sec execute 378 sec latency 206.499 ms 2 27298 0.59 MB/sec execute 379 sec latency 199.458 ms 2 27334 0.59 MB/sec execute 380 sec latency 135.112 ms 2 27368 0.59 MB/sec execute 381 sec latency 278.925 ms 2 27450 0.59 MB/sec execute 382 sec latency 133.130 ms 2 27499 0.59 MB/sec execute 383 sec latency 109.486 ms 2 27642 0.61 MB/sec execute 384 sec latency 254.831 ms 2 27782 0.61 MB/sec execute 385 sec latency 226.430 ms 2 27846 0.61 MB/sec execute 386 sec latency 228.589 ms 2 27878 0.61 MB/sec execute 387 sec latency 210.791 ms 2 28047 0.61 MB/sec execute 388 sec latency 130.237 ms 2 28101 0.61 MB/sec execute 389 sec latency 251.116 ms 2 28171 0.61 MB/sec execute 390 sec latency 144.423 ms 2 28219 0.61 MB/sec execute 391 sec latency 162.652 ms 2 28331 0.62 MB/sec execute 392 sec latency 84.437 ms 2 28421 0.62 MB/sec execute 393 sec latency 87.010 ms 2 28487 0.62 MB/sec execute 394 sec latency 130.354 ms 2 28547 0.62 MB/sec execute 395 sec latency 89.791 ms 2 28599 0.62 MB/sec execute 396 sec latency 122.987 ms 2 28645 0.63 MB/sec execute 397 sec latency 168.751 ms 2 28683 0.62 MB/sec execute 398 sec latency 148.901 ms 2 28719 0.62 MB/sec execute 399 sec latency 268.535 ms 2 28762 0.62 MB/sec execute 400 sec latency 113.103 ms 2 28803 0.62 MB/sec execute 401 sec latency 168.074 ms 2 28842 0.62 MB/sec execute 402 sec latency 95.790 ms 2 28893 0.62 MB/sec execute 403 sec latency 92.371 ms 2 28936 0.62 MB/sec execute 404 sec latency 193.964 ms 2 28987 0.61 MB/sec execute 405 sec latency 91.844 ms 2 29055 0.61 MB/sec execute 406 sec latency 82.002 ms 2 29099 0.61 MB/sec execute 407 sec latency 266.318 ms 2 29138 0.61 MB/sec execute 408 sec latency 106.282 ms 2 29165 0.61 MB/sec execute 409 sec latency 133.252 ms 2 29214 0.61 MB/sec execute 410 sec latency 100.027 ms 2 29240 0.61 MB/sec execute 411 sec latency 169.053 ms 2 29300 0.61 MB/sec execute 412 sec latency 163.559 ms 2 29331 0.61 MB/sec execute 413 sec latency 273.961 ms 2 29370 0.61 MB/sec execute 414 sec latency 184.871 ms 2 29408 0.60 MB/sec execute 415 sec latency 259.038 ms 2 29471 0.61 MB/sec execute 416 sec latency 181.846 ms 2 29551 0.61 MB/sec execute 417 sec latency 80.543 ms 2 29613 0.61 MB/sec execute 418 sec latency 90.955 ms 2 29657 0.60 MB/sec execute 419 sec latency 75.900 ms 2 29763 0.61 MB/sec execute 420 sec latency 96.197 ms 2 29842 0.62 MB/sec execute 421 sec latency 111.355 ms 2 29892 0.61 MB/sec execute 422 sec latency 89.664 ms 2 29952 0.61 MB/sec execute 423 sec latency 161.814 ms 2 30001 0.61 MB/sec execute 424 sec latency 93.275 ms 2 30053 0.61 MB/sec execute 425 sec latency 86.690 ms 2 30109 0.61 MB/sec execute 426 sec latency 194.175 ms 2 30142 0.61 MB/sec execute 427 sec latency 122.368 ms 2 30201 0.61 MB/sec execute 428 sec latency 99.113 ms 2 30242 0.61 MB/sec execute 429 sec latency 90.338 ms 2 30290 0.60 MB/sec execute 430 sec latency 98.386 ms 2 30348 0.60 MB/sec execute 431 sec latency 243.440 ms 2 30407 0.60 MB/sec execute 432 sec latency 121.856 ms 2 30447 0.60 MB/sec execute 433 sec latency 108.174 ms 2 30516 0.60 MB/sec execute 434 sec latency 81.607 ms 2 30572 0.60 MB/sec execute 435 sec latency 125.691 ms 2 30596 0.60 MB/sec execute 436 sec latency 178.670 ms 2 30676 0.60 MB/sec execute 437 sec latency 84.389 ms 2 30765 0.60 MB/sec execute 438 sec latency 186.433 ms 2 30807 0.60 MB/sec execute 439 sec latency 164.821 ms 2 30842 0.60 MB/sec execute 440 sec latency 277.111 ms 2 30891 0.60 MB/sec execute 441 sec latency 110.715 ms 2 30977 0.60 MB/sec execute 442 sec latency 270.765 ms 2 31026 0.60 MB/sec execute 443 sec latency 75.839 ms 2 31204 0.61 MB/sec execute 444 sec latency 149.900 ms 2 31339 0.62 MB/sec execute 445 sec latency 153.560 ms 2 31409 0.61 MB/sec execute 446 sec latency 175.083 ms 2 31445 0.61 MB/sec execute 447 sec latency 144.854 ms 2 31661 0.62 MB/sec execute 448 sec latency 103.098 ms 2 31748 0.62 MB/sec execute 449 sec latency 134.701 ms 2 31799 0.62 MB/sec execute 450 sec latency 84.728 ms 2 31957 0.63 MB/sec execute 451 sec latency 86.844 ms 2 32034 0.63 MB/sec execute 452 sec latency 76.172 ms 2 32093 0.63 MB/sec execute 453 sec latency 82.626 ms 2 32169 0.63 MB/sec execute 454 sec latency 89.257 ms 2 32214 0.63 MB/sec execute 455 sec latency 133.417 ms 2 32264 0.63 MB/sec execute 456 sec latency 91.459 ms 2 32311 0.63 MB/sec execute 457 sec latency 126.645 ms 2 32352 0.63 MB/sec execute 458 sec latency 116.254 ms 2 32406 0.63 MB/sec execute 459 sec latency 129.120 ms 2 32455 0.62 MB/sec execute 460 sec latency 90.950 ms 2 32501 0.62 MB/sec execute 461 sec latency 108.135 ms 2 32549 0.62 MB/sec execute 462 sec latency 91.619 ms 2 32613 0.62 MB/sec execute 463 sec latency 110.263 ms 2 32643 0.62 MB/sec execute 464 sec latency 288.914 ms 2 32678 0.62 MB/sec execute 465 sec latency 116.616 ms 2 32715 0.62 MB/sec execute 466 sec latency 179.879 ms 2 32756 0.62 MB/sec execute 467 sec latency 118.267 ms 2 32778 0.62 MB/sec execute 468 sec latency 191.393 ms 2 32839 0.61 MB/sec execute 469 sec latency 85.677 ms 2 32870 0.61 MB/sec execute 470 sec latency 200.766 ms 2 32895 0.61 MB/sec execute 471 sec latency 210.169 ms 2 32940 0.61 MB/sec execute 472 sec latency 156.052 ms 2 32964 0.61 MB/sec execute 473 sec latency 185.392 ms 2 33023 0.61 MB/sec execute 474 sec latency 145.439 ms 2 33090 0.61 MB/sec execute 475 sec latency 77.150 ms 2 33134 0.61 MB/sec execute 476 sec latency 79.841 ms 2 33192 0.61 MB/sec execute 477 sec latency 84.244 ms 2 33230 0.61 MB/sec execute 478 sec latency 88.837 ms 2 33351 0.62 MB/sec execute 479 sec latency 124.387 ms 2 33390 0.62 MB/sec execute 480 sec latency 99.236 ms 2 33441 0.62 MB/sec execute 481 sec latency 99.242 ms 2 33491 0.62 MB/sec execute 482 sec latency 168.149 ms 2 33521 0.62 MB/sec execute 483 sec latency 517.499 ms 2 33539 0.61 MB/sec execute 484 sec latency 219.399 ms 2 33566 0.61 MB/sec execute 485 sec latency 153.277 ms 2 33608 0.61 MB/sec execute 486 sec latency 221.420 ms 2 33657 0.61 MB/sec execute 487 sec latency 148.741 ms 2 33668 0.61 MB/sec execute 488 sec latency 834.096 ms 2 33668 0.61 MB/sec execute 489 sec latency 1842.237 ms 2 33676 0.61 MB/sec execute 490 sec latency 2657.679 ms 2 33718 0.61 MB/sec execute 491 sec latency 124.759 ms 2 33764 0.61 MB/sec execute 492 sec latency 90.334 ms 2 33807 0.60 MB/sec execute 493 sec latency 112.453 ms 2 33849 0.60 MB/sec execute 494 sec latency 130.408 ms 2 33911 0.60 MB/sec execute 495 sec latency 279.253 ms 2 33966 0.60 MB/sec execute 496 sec latency 107.400 ms 2 33998 0.60 MB/sec execute 497 sec latency 97.084 ms 2 34066 0.60 MB/sec execute 498 sec latency 91.182 ms 2 34123 0.60 MB/sec execute 499 sec latency 99.553 ms 2 34154 0.60 MB/sec execute 500 sec latency 129.337 ms 2 34222 0.60 MB/sec execute 501 sec latency 88.516 ms 2 34302 0.60 MB/sec execute 502 sec latency 117.772 ms 2 34342 0.60 MB/sec execute 503 sec latency 126.680 ms 2 34380 0.60 MB/sec execute 504 sec latency 170.344 ms 2 34406 0.60 MB/sec execute 505 sec latency 302.594 ms 2 34453 0.60 MB/sec execute 506 sec latency 214.294 ms 2 34543 0.60 MB/sec execute 507 sec latency 90.132 ms 2 34583 0.60 MB/sec execute 508 sec latency 101.983 ms 2 34734 0.61 MB/sec execute 509 sec latency 462.874 ms 2 34849 0.61 MB/sec execute 510 sec latency 478.576 ms 2 34881 0.61 MB/sec execute 511 sec latency 186.365 ms 2 34911 0.61 MB/sec execute 512 sec latency 424.936 ms 2 34953 0.61 MB/sec execute 513 sec latency 316.570 ms 2 35060 0.61 MB/sec execute 514 sec latency 216.382 ms 2 35182 0.61 MB/sec execute 515 sec latency 284.393 ms 2 35264 0.61 MB/sec execute 516 sec latency 157.614 ms 2 35311 0.61 MB/sec execute 517 sec latency 193.495 ms 2 35406 0.62 MB/sec execute 518 sec latency 95.138 ms 2 35513 0.62 MB/sec execute 519 sec latency 81.696 ms 2 35560 0.62 MB/sec execute 520 sec latency 152.168 ms 2 35606 0.62 MB/sec execute 521 sec latency 158.557 ms 2 35652 0.62 MB/sec execute 522 sec latency 87.003 ms 2 35706 0.62 MB/sec execute 523 sec latency 113.222 ms 2 35749 0.62 MB/sec execute 524 sec latency 184.859 ms 2 35800 0.62 MB/sec execute 525 sec latency 86.911 ms 2 35845 0.62 MB/sec execute 526 sec latency 147.914 ms 2 35884 0.62 MB/sec execute 527 sec latency 122.248 ms 2 35930 0.62 MB/sec execute 528 sec latency 114.549 ms 2 35969 0.61 MB/sec execute 529 sec latency 103.563 ms 2 36014 0.61 MB/sec execute 530 sec latency 102.011 ms 2 36047 0.61 MB/sec execute 531 sec latency 261.716 ms 2 36106 0.61 MB/sec execute 532 sec latency 95.144 ms 2 36170 0.61 MB/sec execute 533 sec latency 108.015 ms 2 36200 0.61 MB/sec execute 534 sec latency 294.233 ms 2 36232 0.61 MB/sec execute 535 sec latency 173.368 ms 2 36253 0.61 MB/sec execute 536 sec latency 236.690 ms 2 36289 0.61 MB/sec execute 537 sec latency 169.267 ms 2 36310 0.61 MB/sec execute 538 sec latency 357.149 ms 2 36364 0.61 MB/sec execute 539 sec latency 122.195 ms 2 36393 0.60 MB/sec execute 540 sec latency 290.672 ms 2 36422 0.60 MB/sec execute 541 sec latency 131.575 ms 2 36439 0.60 MB/sec execute 542 sec latency 325.354 ms 2 36478 0.60 MB/sec execute 543 sec latency 150.687 ms 2 36500 0.60 MB/sec execute 544 sec latency 389.703 ms 2 36533 0.60 MB/sec execute 545 sec latency 186.069 ms 2 36585 0.60 MB/sec execute 546 sec latency 111.055 ms 2 36645 0.60 MB/sec execute 547 sec latency 107.741 ms 2 36673 0.60 MB/sec execute 548 sec latency 178.354 ms 2 36710 0.60 MB/sec execute 549 sec latency 597.452 ms 2 36756 0.60 MB/sec execute 550 sec latency 84.188 ms 2 36840 0.60 MB/sec execute 551 sec latency 228.111 ms 2 36916 0.61 MB/sec execute 552 sec latency 98.094 ms 2 36955 0.61 MB/sec execute 553 sec latency 133.594 ms 2 36996 0.61 MB/sec execute 554 sec latency 245.114 ms 2 37038 0.60 MB/sec execute 555 sec latency 260.707 ms 2 37083 0.60 MB/sec execute 556 sec latency 89.837 ms 2 37119 0.60 MB/sec execute 557 sec latency 102.036 ms 2 37161 0.60 MB/sec execute 558 sec latency 259.690 ms 2 37205 0.60 MB/sec execute 559 sec latency 93.582 ms 2 37236 0.60 MB/sec execute 560 sec latency 133.554 ms 2 37284 0.60 MB/sec execute 561 sec latency 97.241 ms 2 37309 0.60 MB/sec execute 562 sec latency 145.768 ms 2 37341 0.60 MB/sec execute 563 sec latency 118.231 ms 2 37380 0.60 MB/sec execute 564 sec latency 126.108 ms 2 37430 0.59 MB/sec execute 565 sec latency 227.804 ms 2 37489 0.59 MB/sec execute 566 sec latency 127.620 ms 2 37524 0.59 MB/sec execute 567 sec latency 97.138 ms 2 37578 0.59 MB/sec execute 568 sec latency 136.140 ms 2 37625 0.59 MB/sec execute 569 sec latency 154.140 ms 2 37669 0.59 MB/sec execute 570 sec latency 144.971 ms 2 37689 0.59 MB/sec execute 571 sec latency 169.418 ms 2 37762 0.59 MB/sec execute 572 sec latency 141.363 ms 2 37848 0.59 MB/sec execute 573 sec latency 139.882 ms 2 37875 0.59 MB/sec execute 574 sec latency 316.253 ms 2 37904 0.59 MB/sec execute 575 sec latency 354.365 ms 2 37940 0.59 MB/sec execute 576 sec latency 184.009 ms 2 37987 0.59 MB/sec execute 577 sec latency 128.364 ms 2 38083 0.59 MB/sec execute 578 sec latency 102.761 ms 2 38162 0.59 MB/sec execute 579 sec latency 93.434 ms 2 38334 0.60 MB/sec execute 580 sec latency 319.278 ms 2 38423 0.60 MB/sec execute 581 sec latency 230.893 ms 2 38481 0.60 MB/sec execute 582 sec latency 429.512 ms 2 38504 0.60 MB/sec execute 583 sec latency 300.644 ms 2 38687 0.60 MB/sec execute 584 sec latency 306.374 ms 2 38738 0.60 MB/sec execute 585 sec latency 254.649 ms 2 38811 0.60 MB/sec execute 586 sec latency 202.971 ms 2 38867 0.60 MB/sec execute 587 sec latency 131.418 ms 2 39006 0.61 MB/sec execute 588 sec latency 115.153 ms 2 39068 0.61 MB/sec execute 589 sec latency 104.153 ms 2 39131 0.61 MB/sec execute 590 sec latency 104.730 ms 2 39187 0.61 MB/sec execute 591 sec latency 75.855 ms 2 39245 0.61 MB/sec execute 592 sec latency 167.416 ms 2 39294 0.61 MB/sec execute 593 sec latency 102.117 ms 2 39345 0.61 MB/sec execute 594 sec latency 79.413 ms 2 39389 0.61 MB/sec execute 595 sec latency 83.306 ms 2 39420 0.61 MB/sec execute 596 sec latency 286.845 ms 2 39454 0.61 MB/sec execute 597 sec latency 118.241 ms 2 39500 0.61 MB/sec execute 598 sec latency 123.797 ms 2 39544 0.61 MB/sec execute 599 sec latency 140.210 ms 2 cleanup 600 sec 2 cleanup 601 sec 2 cleanup 602 sec 2 cleanup 603 sec 0 cleanup 604 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 11568 50.318 288.896 Close 8416 11.411 148.283 Rename 486 72.983 332.937 Unlink 2347 23.051 133.928 Qpathinfo 10361 13.352 286.811 Qfileinfo 1805 2.132 18.937 Qfsinfo 1944 1.250 41.711 Sfileinfo 900 51.425 225.562 Find 4037 12.348 502.814 WriteX 5655 11.231 116.808 ReadX 18297 0.156 81.672 LockX 40 12.885 38.092 UnlockX 40 10.523 21.352 Flush 792 144.835 490.316 Throughput 0.606522 MB/sec 2 clients 2 procs max_latency=2657.679 ms stopping dbench in /mnt/lustre/d71.sanity at Mon Aug 24 17:14:08 EDT 2026 with return code 0 clean dbench files in /mnt/lustre/d71.sanity /mnt/lustre/d71.sanity /mnt/lustre/d71.sanity removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d71.sanity dbench successfully finished PASS 71 (746s) == sanity test 255a: check 'lfs ladvise -a willread' ===== 17:14:29 (1787606069) 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 16.1118 s, 6.5 MB/s ladvise: range [2, 1] is invalid Provide servers with advice about access patterns for a file. usage: ladvise [--advice|-a ADVICE] [--start|-s START[kMGT]] [--background|-b] [--unset|-u] {--end|-e END[kMGT]|--length|-l LENGTH[kMGT]} {[--mode|-m [READ,WRITE]} ... ladvise: range [2, 2] is invalid Provide servers with advice about access patterns for a file. usage: ladvise [--advice|-a ADVICE] [--start|-s START[kMGT]] [--background|-b] [--unset|-u] {--end|-e END[kMGT]|--length|-l LENGTH[kMGT]} {[--mode|-m [READ,WRITE]} ... ladvise: conflicting arguments of -l and -e Provide servers with advice about access patterns for a file. usage: ladvise [--advice|-a ADVICE] [--start|-s START[kMGT]] [--background|-b] [--unset|-u] {--end|-e END[kMGT]|--length|-l LENGTH[kMGT]} {[--mode|-m [READ,WRITE]} ... Synchronous ladvise should wait fail_val=8 fail_loc=0x237 Asynchronous ladvise shouldn't wait llite.lustre-ffff8d82d03a2000.hybrid_io=0 Iter 1/10: reading without willread hint Iter 1/10: uncached speed: 0.303295 Iter 1/10: OSS cache speed: 0.258757 Iter 1/10: ladvise speed: 0.297026 Iter 2/10: reading without willread hint Iter 2/10: uncached speed: 0.273588 Iter 2/10: OSS cache speed: 0.311637 Iter 2/10: ladvise speed: 0.290021 Iter 3/10: reading without willread hint Iter 3/10: uncached speed: 0.290591 Iter 3/10: OSS cache speed: 0.319625 Iter 3/10: ladvise speed: 0.327999 Iter 4/10: reading without willread hint Iter 4/10: uncached speed: 0.304019 Iter 4/10: OSS cache speed: 0.296505 Iter 4/10: ladvise speed: 0.313556 Iter 5/10: reading without willread hint Iter 5/10: uncached speed: 0.345957 Iter 5/10: OSS cache speed: 0.331294 Iter 5/10: ladvise speed: 0.307639 Iter 6/10: reading without willread hint Iter 6/10: uncached speed: 0.306929 Iter 6/10: OSS cache speed: 0.291555 Iter 6/10: ladvise speed: 0.307118 Iter 7/10: reading without willread hint Iter 7/10: uncached speed: 0.334767 Iter 7/10: OSS cache speed: 0.334536 Iter 7/10: ladvise speed: 0.330797 Iter 8/10: reading without willread hint Iter 8/10: uncached speed: 0.356134 Iter 8/10: OSS cache speed: 0.353794 Iter 8/10: ladvise speed: 0.349125 Iter 9/10: reading without willread hint Iter 9/10: uncached speed: 0.320546 Iter 9/10: OSS cache speed: 0.300214 Iter 9/10: ladvise speed: 0.301037 Iter 10/10: reading without willread hint Iter 10/10: uncached speed: 0.297325 Iter 10/10: OSS cache speed: 0.310802 Iter 10/10: ladvise speed: 0.303691 Average uncached read: .31 Average speedup with OSS cached read: .31 = +0% Average speedup with ladvise willread: .31 = +0% Speedup with OSS cached read less than 20%, got 0%. Skipping ladvise willread check. fail_loc=0 PASS 255a (2187s) == sanity test 255b: check 'lfs ladvise -a dontneed' ===== 17:50:57 (1787608257) lfs ladvise: cannot give advice: Operation not supported (95) ladvise: cannot give advice 'dontneed' to file '/mnt/lustre/f255b.sanity': Operation not supported SKIP: sanity test_255b zfs-osd does not support 'ladvise dontneed' SKIP 255b (5s) == sanity test 255c: suite of ladvise lockahead tests ==== 17:51:02 (1787608262) striped dir -i1 -c2 -H all_char /mnt/lustre/d255c.sanity Starting test test10 at 1787608265 Finishing test test10 at 1787608266 Starting test test11 at 1787608267 Finishing test test11 at 1787608268 Starting test test12 at 1787608269 Finishing test test12 at 1787608269 Starting test test13 at 1787608269 Finishing test test13 at 1787608270 Starting test test14 at 1787608270 Finishing test test14 at 1787608271 Starting test test15 at 1787608271 Finishing test test15 at 1787608271 Starting test test16 at 1787608272 Finishing test test16 at 1787608272 Starting test test17 at 1787608273 Finishing test test17 at 1787608273 Starting test test18 at 1787608273 Finishing test test18 at 1787608273 Starting test test19 at 1787608274 Finishing test test19 at 1787608274 Starting test test20 at 1787608274 Finishing test test20 at 1787608274 Starting test test21 at 1787608275 Finishing test test21 at 1787608275 Starting test test22 at 1787608275 lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) Finishing test test22 at 1787608275 PASS 255c (20s) == sanity test 300o: unlink big sub stripe(> 65000 subdirs) ========================================================== 17:51:23 (1787608283) - mkdir 1043 (time 1787608300.13 total 10.00 last 104.29) - mkdir 2157 (time 1787608310.13 total 20.01 last 111.30) - mkdir 3214 (time 1787608320.14 total 30.01 last 105.69) - mkdir 4114 (time 1787608330.14 total 40.02 last 89.96) - mkdir 5291 (time 1787608340.15 total 50.02 last 117.65) - mkdir 6412 (time 1787608350.15 total 60.02 last 112.07) - mkdir 7521 (time 1787608360.15 total 70.02 last 110.88) - mkdir 8658 (time 1787608370.16 total 80.04 last 113.53) - mkdir 9647 (time 1787608380.17 total 90.04 last 98.88) - mkdir 10000 (time 1787608383.34 total 93.21 last 111.42) - mkdir 11134 (time 1787608393.34 total 103.21 last 113.38) - mkdir 12363 (time 1787608403.34 total 113.21 last 122.88) - mkdir 13432 (time 1787608413.35 total 123.23 last 106.77) - mkdir 14542 (time 1787608423.35 total 133.23 last 110.97) - mkdir 15700 (time 1787608433.35 total 143.23 last 115.80) - mkdir 16913 (time 1787608443.36 total 153.24 last 121.20) - mkdir 18020 (time 1787608453.37 total 163.24 last 110.66) - mkdir 19115 (time 1787608463.37 total 173.25 last 109.43) - mkdir 20000 (time 1787608471.83 total 181.71 last 104.60) - mkdir 21025 (time 1787608481.84 total 191.71 last 102.47) - mkdir 22149 (time 1787608491.84 total 201.71 last 112.40) - mkdir 23284 (time 1787608501.86 total 211.74 last 113.21) - mkdir 24421 (time 1787608511.87 total 221.74 last 113.65) - mkdir 25356 (time 1787608521.87 total 231.75 last 93.46) - mkdir 26311 (time 1787608531.88 total 241.75 last 95.45) - mkdir 27041 (time 1787608541.89 total 251.76 last 72.92) - mkdir 28088 (time 1787608551.89 total 261.76 last 104.69) - mkdir 29129 (time 1787608561.89 total 271.77 last 104.05) - mkdir 30000 (time 1787608569.98 total 279.85 last 107.73) - mkdir 31058 (time 1787608579.98 total 289.86 last 105.76) - mkdir 32129 (time 1787608589.98 total 299.86 last 107.09) - mkdir 33323 (time 1787608599.98 total 309.86 last 119.40) - mkdir 34412 (time 1787608609.99 total 319.86 last 108.84) - mkdir 35471 (time 1787608619.99 total 329.86 last 105.88) - mkdir 36565 (time 1787608630.00 total 339.87 last 109.31) - mkdir 37558 (time 1787608640.01 total 349.89 last 99.17) - mkdir 38458 (time 1787608650.02 total 359.89 last 89.94) - mkdir 39486 (time 1787608660.02 total 369.90 last 102.77) - mkdir 40000 (time 1787608665.03 total 374.91 last 102.59) - mkdir 41085 (time 1787608675.04 total 384.92 last 108.39) - mkdir 42140 (time 1787608685.06 total 394.93 last 105.34) - mkdir 43213 (time 1787608695.06 total 404.93 last 107.27) - mkdir 44330 (time 1787608705.06 total 414.94 last 111.65) - mkdir 45207 (time 1787608715.07 total 424.94 last 87.66) - mkdir 46215 (time 1787608725.07 total 434.94 last 100.79) - mkdir 47235 (time 1787608735.07 total 444.95 last 101.97) - mkdir 48272 (time 1787608745.08 total 454.96 last 103.59) - mkdir 49436 (time 1787608755.08 total 464.96 last 116.38) - mkdir 50000 (time 1787608759.52 total 469.40 last 127.11) - mkdir 51123 (time 1787608769.53 total 479.40 last 112.24) - mkdir 52348 (time 1787608779.53 total 489.40 last 122.46) - mkdir 53476 (time 1787608789.53 total 499.41 last 112.74) - mkdir 54617 (time 1787608799.54 total 509.41 last 114.07) - mkdir 55669 (time 1787608809.54 total 519.41 last 105.17) - mkdir 56695 (time 1787608819.55 total 529.43 last 102.48) - mkdir 57964 (time 1787608829.56 total 539.43 last 126.81) - mkdir 59133 (time 1787608839.56 total 549.44 last 116.87) - mkdir 60000 (time 1787608847.51 total 557.39 last 109.04) - mkdir 61188 (time 1787608857.52 total 567.40 last 118.66) - mkdir 62306 (time 1787608867.53 total 577.41 last 111.72) - mkdir 63486 (time 1787608877.53 total 587.41 last 117.99) - mkdir 64640 (time 1787608887.53 total 597.41 last 115.40) - mkdir 65718 (time 1787608897.53 total 607.41 last 107.79) - mkdir 66808 (time 1787608907.54 total 617.41 last 108.94) - mkdir 67938 (time 1787608917.54 total 627.42 last 112.96) - mkdir 69040 (time 1787608927.55 total 637.42 last 110.12) - mkdir 70000 (time 1787608935.74 total 645.61 last 117.25) - mkdir 71067 (time 1787608945.74 total 655.62 last 106.62) - mkdir 71827 (time 1787608955.75 total 665.63 last 75.91) - mkdir 72750 (time 1787608965.76 total 675.63 last 92.27) - mkdir 73613 (time 1787608975.76 total 685.64 last 86.27) - mkdir 74500 (time 1787608985.77 total 695.65 last 88.61) - mkdir 75492 (time 1787608995.78 total 705.65 last 99.16) - mkdir 76670 (time 1787609005.79 total 715.66 last 117.66) - mkdir 77851 (time 1787609015.79 total 725.67 last 118.05) - mkdir 79057 (time 1787609025.80 total 735.67 last 120.53) - mkdir 80000 (time 1787609035.15 total 745.03 last 100.85) - mkdir 81023 (time 1787609045.16 total 755.04 last 102.19) - mkdir 81994 (time 1787609055.16 total 765.04 last 97.09) - mkdir 83075 (time 1787609065.18 total 775.05 last 107.94) - mkdir 84194 (time 1787609075.19 total 785.06 last 111.79) - mkdir 85308 (time 1787609085.20 total 795.07 last 111.29) - mkdir 86403 (time 1787609095.20 total 805.08 last 109.44) - mkdir 87439 (time 1787609105.20 total 815.08 last 103.60) - mkdir 88526 (time 1787609115.25 total 825.13 last 108.16) - mkdir 89628 (time 1787609125.26 total 835.13 last 110.15) - mkdir 90000 (time 1787609128.66 total 838.53 last 109.29) - mkdir 91106 (time 1787609138.66 total 848.54 last 110.54) - mkdir 92058 (time 1787609148.68 total 858.55 last 95.06) - mkdir 92937 (time 1787609158.71 total 868.58 last 87.65) - mkdir 93777 (time 1787609168.71 total 878.59 last 83.96) - mkdir 94652 (time 1787609178.72 total 888.60 last 87.44) - mkdir 95608 (time 1787609188.73 total 898.60 last 95.51) - mkdir 96472 (time 1787609198.73 total 908.61 last 86.35) - mkdir 97301 (time 1787609208.75 total 918.62 last 82.81) - mkdir 98226 (time 1787609218.75 total 928.62 last 92.48) - mkdir 99175 (time 1787609228.76 total 938.64 last 94.74) - mkdir 100000 (time 1787609236.14 total 946.01 last 111.88) - mkdir 100928 (time 1787609246.14 total 956.02 last 92.76) - mkdir 101861 (time 1787609256.15 total 966.02 last 93.26) - mkdir 102927 (time 1787609266.15 total 976.03 last 106.53) - mkdir 103882 (time 1787609276.15 total 986.03 last 95.50) - mkdir 104855 (time 1787609286.16 total 996.04 last 97.24) - mkdir 105864 (time 1787609296.17 total 1006.04 last 100.81) - mkdir 106910 (time 1787609306.18 total 1016.05 last 104.51) - mkdir 108032 (time 1787609316.19 total 1026.07 last 112.05) - mkdir 109169 (time 1787609326.20 total 1036.07 last 113.66) - mkdir 110000 (time 1787609333.63 total 1043.50 last 111.84) - mkdir 110995 (time 1787609343.63 total 1053.50 last 99.50) - mkdir 112120 (time 1787609353.63 total 1063.51 last 112.45) - mkdir 113152 (time 1787609363.64 total 1073.51 last 103.15) - mkdir 114336 (time 1787609373.64 total 1083.52 last 118.31) - mkdir 115399 (time 1787609383.64 total 1093.52 last 106.28) - mkdir 116406 (time 1787609393.65 total 1103.53 last 100.65) - mkdir 117366 (time 1787609403.65 total 1113.53 last 95.99) - mkdir 118323 (time 1787609413.65 total 1123.53 last 95.67) - mkdir 119473 (time 1787609423.67 total 1133.55 last 114.80) - mkdir 120000 (time 1787609428.19 total 1138.07 last 116.60) - mkdir 121245 (time 1787609438.20 total 1148.07 last 124.46) - mkdir 122275 (time 1787609448.20 total 1158.08 last 102.94) - mkdir 123126 (time 1787609458.21 total 1168.09 last 85.02) - mkdir 123967 (time 1787609468.21 total 1178.09 last 84.06) - mkdir 125028 (time 1787609478.22 total 1188.10 last 106.03) - mkdir 126220 (time 1787609488.23 total 1198.10 last 119.14) - mkdir 127385 (time 1787609498.23 total 1208.11 last 116.41) - mkdir 128377 (time 1787609508.24 total 1218.11 last 99.17) - mkdir 129391 (time 1787609518.24 total 1228.11 last 101.39) - mkdir 130000 (time 1787609524.30 total 1234.18 last 100.40) - mkdir 130986 (time 1787609534.32 total 1244.20 last 98.44) total: 131000 mkdir in 1244.30 seconds: 105.28 ops/second ldlm.namespaces.lustre-MDT0000-mdc-ffff8d82d03a2000.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff8d82d03a2000.lru_size=0 - unlinked 0 (time 1787609548 ; total 0 ; last 0) - unlinked 10000 (time 1787609714 ; total 166 ; last 166) - unlinked 20000 (time 1787609876 ; total 328 ; last 162) - unlinked 30000 (time 1787610065 ; total 517 ; last 189) - unlinked 40000 (time 1787610238 ; total 690 ; last 173) - unlinked 50000 (time 1787610404 ; total 856 ; last 166) - unlinked 60000 (time 1787610560 ; total 1012 ; last 156) - unlinked 70000 (time 1787610716 ; total 1168 ; last 156) - unlinked 80000 (time 1787610874 ; total 1326 ; last 158) - unlinked 90000 (time 1787611037 ; total 1489 ; last 163) - unlinked 100000 (time 1787611209 ; total 1661 ; last 172) - unlinked 110000 (time 1787611374 ; total 1826 ; last 165) - unlinked 120000 (time 1787611546 ; total 1998 ; last 172) - unlinked 130000 (time 1787611716 ; total 2168 ; last 170) total: 131000 unlinks in 2190 seconds: 59.817352 unlinks/second PASS 300o (3467s) == sanity test complete, duration 8899 sec =============== 18:49:18 (1787611758) === sanity: start cleanup 18:49:21 (1787611761) === === sanity: finish cleanup 18:49:27 (1787611767) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck