-----============= acceptance-small: sanity ============----- Thu Jul 30 01:05:47 EDT 2026 MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky oleg343-server: /home/green/git/lustre-release/lustre/tests/except/sanity.56aa.ex oleg343-server: /home/green/git/lustre-release/lustre/tests/except/sanity.ex - see CLIENT_VERSION > v2_15_63-134-gdacc4b6d38 (34682882 > 34553734) for LU-15963, go 312 - see CLIENT_VERSION > v2_15_63-239-gab4ede45b4 (34682882 > 34553839) for LU-17856, go 56wa 56xe - see CLIENT_VERSION >= v2_15_7-16-gab522d54ad (34682882 >= 34539280) for LU-16203, go 60i - see CLIENT_VERSION > v2_16_54-54-ga2e3a2f5a3 (34682882 > 34616886) for LU-14590, go 0d - see CLIENT_VERSION >= v2_17_50-196-g63ee4af3bb (34682882 >= 34681540) for LU-19620, go 60b - see CLIENT_VERSION >= v2_17_50-34-g089f438ba9 (34682882 >= 34681378) for LU-19692, go 77k - see CLIENT_VERSION >= v2_17_50-71-g2cbe29c282 (34682882 >= 34681415) for LU-19644, go 150ib - see CLIENT_VERSION >= v2_17_50-72-ge1f272796c (34682882 >= 34681416) for LU-19743, go 27z - see CLIENT_VERSION >= v2_17_51-74 (34682882 >= 34681674) for LU-20010, go 56aa - need MDS1_VERSION <= 2.16.61-1-g89cf292a8c2 (34682882 <= 34618625) for LU-18938, skip 360 - see MDS1_VERSION <= CLIENT_VERSION (34682882 <= 34682882) for LU-18562, go 270a - need MDS1_VERSION < v2_14_55-100-g8a84c7f9c7 (34682882 < 34486116) for LU-14927, skip 0f - need OST1_VERSION < v2_17_50-410-gbd8e7b9555 (34682882 < 34681754) for LU-12550, skip 216 excepting tests: 42a 42c 42b 118c 118d 407 119i 216 817 411a skipping tests SLOW=no: 51c 51e 834 === sanity: start setup 01:06:22 (1785387982) === oleg343-client.virtnet: executing check_config_client /mnt/lustre oleg343-client.virtnet: Checking config lustre mounted on /mnt/lustre Checking servers environments Checking clients oleg343-client.virtnet environments Using TIMEOUT=20 osc.lustre-OST0000-osc-ffff9ca909e2d000.idle_timeout=debug osc.lustre-OST0001-osc-ffff9ca909e2d000.idle_timeout=debug disable quota as required oleg343-server: oleg343-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all osd-ldiskfs.track_declares_assert=1 === sanity: finish setup 01:07:12 (1785388032) === running as uid/gid/euid/egid 500/500/500/500, groups: 500 [true] running as uid/gid/euid/egid 500/500/500/500, groups: 500 [touch] [/mnt/lustre/d0_runas_test/f8256] preparing for tests involving mounts mke2fs 1.47.3-wc2 (11-Nov-2025) debug=all == sanity test 27m: create file while OST0 was full ====== 01:07:18 (1785388038) SKIP: sanity test_27m 7210952 > 600000 skipping out-of-space test on OST0 SKIP 27m (5s) == sanity test 51b: exceed 64k subdirectory nlink limit on create, verify unlink ========================================================== 01:07:24 (1785388044) UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1784 1269520 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 1632 1269672 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3088 7210952 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 280 1023720 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1024000 259 1023741 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 262144 368 261776 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 262144 369 261775 1% /mnt/lustre[OST:1] filesystem_summary: 524090 539 523551 1% /mnt/lustre - mkdir 472 (time 1785388060.85 total 10.02 last 47.09) - mkdir 949 (time 1785388070.89 total 20.06 last 47.52) - mkdir 1367 (time 1785388080.89 total 30.06 last 41.79) - mkdir 1945 (time 1785388090.90 total 40.07 last 57.77) - mkdir 2430 (time 1785388100.90 total 50.07 last 48.49) - mkdir 2996 (time 1785388110.93 total 60.10 last 56.41) - mkdir 3484 (time 1785388120.93 total 70.10 last 48.80) - mkdir 4186 (time 1785388130.95 total 80.12 last 70.10) - mkdir 4783 (time 1785388140.95 total 90.12 last 59.69) - mkdir 5369 (time 1785388150.95 total 100.12 last 58.60) - mkdir 5926 (time 1785388160.96 total 110.13 last 55.65) - mkdir 6445 (time 1785388170.98 total 120.15 last 51.81) - mkdir 6970 (time 1785388181.01 total 130.19 last 52.30) - mkdir 7452 (time 1785388191.06 total 140.24 last 47.96) - mkdir 7998 (time 1785388201.08 total 150.26 last 54.49) - mkdir 8599 (time 1785388211.10 total 160.27 last 60.01) - mkdir 9068 (time 1785388221.10 total 170.28 last 46.87) - mkdir 9660 (time 1785388231.11 total 180.28 last 59.17) - mkdir 10000 (time 1785388237.20 total 186.37 last 55.86) - mkdir 10672 (time 1785388247.20 total 196.37 last 67.20) - mkdir 11399 (time 1785388257.22 total 206.39 last 72.55) - mkdir 11945 (time 1785388267.27 total 216.44 last 54.31) - mkdir 12288 (time 1785388277.35 total 226.52 last 34.04) - mkdir 12534 (time 1785388287.36 total 236.53 last 24.58) - mkdir 12839 (time 1785388297.38 total 246.55 last 30.42) - mkdir 13202 (time 1785388307.39 total 256.56 last 36.27) - mkdir 13615 (time 1785388317.41 total 266.58 last 41.22) - mkdir 14042 (time 1785388327.42 total 276.59 last 42.68) - mkdir 14522 (time 1785388337.43 total 286.60 last 47.93) - mkdir 15129 (time 1785388347.45 total 296.62 last 60.60) - mkdir 15619 (time 1785388357.46 total 306.63 last 48.93) - mkdir 16162 (time 1785388367.47 total 316.65 last 54.23) - mkdir 16841 (time 1785388377.48 total 326.66 last 67.83) - mkdir 17557 (time 1785388387.49 total 336.67 last 71.52) - mkdir 18138 (time 1785388397.52 total 346.70 last 57.93) - mkdir 18588 (time 1785388407.58 total 356.75 last 44.77) - mkdir 19159 (time 1785388417.58 total 366.75 last 57.10) - mkdir 19730 (time 1785388427.59 total 376.76 last 57.02) - mkdir 20000 (time 1785388432.90 total 382.08 last 50.81) - mkdir 20459 (time 1785388442.91 total 392.08 last 45.89) - mkdir 21115 (time 1785388452.93 total 402.10 last 65.47) - mkdir 21373 (time 1785388462.98 total 412.15 last 25.67) - mkdir 21788 (time 1785388473.00 total 422.17 last 41.40) - mkdir 22332 (time 1785388483.03 total 432.20 last 54.26) - mkdir 22807 (time 1785388493.04 total 442.22 last 47.41) - mkdir 23365 (time 1785388503.05 total 452.22 last 55.77) - mkdir 23894 (time 1785388513.06 total 462.23 last 52.85) - mkdir 24448 (time 1785388523.07 total 472.25 last 55.32) - mkdir 25041 (time 1785388533.12 total 482.29 last 59.04) - mkdir 25443 (time 1785388543.14 total 492.31 last 40.12) - mkdir 25943 (time 1785388553.14 total 502.31 last 49.98) - mkdir 26471 (time 1785388563.17 total 512.34 last 52.67) - mkdir 26904 (time 1785388573.17 total 522.34 last 43.29) - mkdir 27203 (time 1785388583.19 total 532.36 last 29.82) - mkdir 27497 (time 1785388593.31 total 542.48 last 29.06) - mkdir 27860 (time 1785388603.35 total 552.52 last 36.16) - mkdir 28335 (time 1785388613.35 total 562.52 last 47.48) - mkdir 28881 (time 1785388623.38 total 572.55 last 54.47) - mkdir 29399 (time 1785388633.38 total 582.56 last 51.76) - mkdir 29983 (time 1785388643.41 total 592.58 last 58.24) - mkdir 30618 (time 1785388653.43 total 602.60 last 63.40) - mkdir 31134 (time 1785388663.46 total 612.63 last 51.44) - mkdir 31611 (time 1785388673.46 total 622.63 last 47.69) - mkdir 32000 (time 1785388683.46 total 632.63 last 38.89) - mkdir 32313 (time 1785388693.49 total 642.67 last 31.20) total: 32818 mkdir in 651.12 seconds: 50.40 ops/second - mkdir 480 (time 1785388060.80 total 10.00 last 47.98) - mkdir 944 (time 1785388070.81 total 20.01 last 46.35) - mkdir 1366 (time 1785388080.82 total 30.03 last 42.14) - mkdir 1905 (time 1785388090.83 total 40.03 last 53.88) - mkdir 2375 (time 1785388100.87 total 50.07 last 46.81) - mkdir 2926 (time 1785388110.87 total 60.07 last 55.10) - mkdir 3393 (time 1785388120.88 total 70.09 last 46.64) - mkdir 4087 (time 1785388130.90 total 80.10 last 69.27) - mkdir 4669 (time 1785388140.91 total 90.12 last 58.12) - mkdir 5259 (time 1785388150.91 total 100.12 last 58.99) - mkdir 5792 (time 1785388160.94 total 110.14 last 53.17) - mkdir 6300 (time 1785388170.95 total 120.16 last 50.73) - mkdir 6836 (time 1785388180.97 total 130.18 last 53.49) - mkdir 7315 (time 1785388190.99 total 140.19 last 47.83) - mkdir 7808 (time 1785388201.02 total 150.22 last 49.14) - mkdir 8398 (time 1785388211.05 total 160.25 last 58.82) - mkdir 8866 (time 1785388221.07 total 170.27 last 46.70) - mkdir 9455 (time 1785388231.08 total 180.28 last 58.86) - mkdir 10000 (time 1785388240.19 total 189.40 last 59.80) - mkdir 10738 (time 1785388250.20 total 199.40 last 73.75) - mkdir 11346 (time 1785388260.21 total 209.41 last 60.75) - mkdir 11928 (time 1785388270.25 total 219.45 last 57.97) - mkdir 12207 (time 1785388280.26 total 229.46 last 27.87) - mkdir 12417 (time 1785388290.33 total 239.53 last 20.86) - mkdir 12736 (time 1785388300.39 total 249.59 last 31.71) - mkdir 13139 (time 1785388310.40 total 259.61 last 40.23) - mkdir 13544 (time 1785388320.40 total 269.61 last 40.50) - mkdir 13963 (time 1785388330.41 total 279.62 last 41.86) - mkdir 14544 (time 1785388340.42 total 289.63 last 58.05) - mkdir 15089 (time 1785388350.46 total 299.66 last 54.30) - mkdir 15599 (time 1785388360.47 total 309.67 last 50.96) - mkdir 16208 (time 1785388370.53 total 319.73 last 60.53) - mkdir 16935 (time 1785388380.55 total 329.75 last 72.55) - mkdir 17621 (time 1785388390.55 total 339.76 last 68.56) - mkdir 18116 (time 1785388400.65 total 349.85 last 49.06) - mkdir 18573 (time 1785388410.66 total 359.87 last 45.63) - mkdir 19242 (time 1785388420.67 total 369.88 last 66.81) - mkdir 19758 (time 1785388430.69 total 379.89 last 51.54) - mkdir 20000 (time 1785388434.47 total 383.67 last 63.95) - mkdir 20519 (time 1785388444.48 total 393.69 last 51.82) - mkdir 21059 (time 1785388454.69 total 403.90 last 52.90) - mkdir 21348 (time 1785388464.71 total 413.92 last 28.84) - mkdir 21783 (time 1785388474.73 total 423.93 last 43.44) - mkdir 22379 (time 1785388484.75 total 433.95 last 59.47) - mkdir 22865 (time 1785388494.77 total 443.97 last 48.52) - mkdir 23424 (time 1785388504.78 total 453.99 last 55.82) - mkdir 23956 (time 1785388514.79 total 463.99 last 53.17) - mkdir 24519 (time 1785388524.80 total 474.00 last 56.25) - mkdir 25053 (time 1785388534.83 total 484.04 last 53.22) - mkdir 25437 (time 1785388544.86 total 494.06 last 38.31) - mkdir 25921 (time 1785388554.88 total 504.08 last 48.28) - mkdir 26483 (time 1785388564.89 total 514.09 last 56.16) - mkdir 26922 (time 1785388574.89 total 524.09 last 43.88) - mkdir 27218 (time 1785388584.89 total 534.10 last 29.59) - mkdir 27445 (time 1785388594.90 total 544.10 last 22.70) - mkdir 27818 (time 1785388604.92 total 554.13 last 37.20) - mkdir 28335 (time 1785388614.94 total 564.14 last 51.63) - mkdir 28882 (time 1785388624.95 total 574.15 last 54.65) - mkdir 29389 (time 1785388634.98 total 584.18 last 50.53) - mkdir 29950 (time 1785388644.99 total 594.20 last 56.02) - mkdir 30614 (time 1785388655.04 total 604.25 last 66.07) - mkdir 31144 (time 1785388665.07 total 614.28 last 52.85) - mkdir 31611 (time 1785388675.11 total 624.31 last 46.53) - mkdir 31970 (time 1785388685.13 total 634.33 last 35.82) - mkdir 32289 (time 1785388695.15 total 644.35 last 31.84) total: 32818 mkdir in 652.43 seconds: 50.30 ops/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1784 1269520 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 270704 1000600 22% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3088 7210952 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 280 1023720 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1024000 65895 958105 7% /mnt/lustre[MDT:1] lustre-OST0000_UUID 262144 368 261776 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 262144 369 261775 1% /mnt/lustre[OST:1] filesystem_summary: 589726 66175 523551 12% /mnt/lustre nlink before: 1, created before: 65637 - unlinked 0 (time 1785389463 ; total 0 ; last 0) - unlinked 10000 (time 1785389749 ; total 286 ; last 286) - unlinked 20000 (time 1785390065 ; total 602 ; last 316) - unlinked 30000 (time 1785390370 ; total 907 ; last 305) total: 32768 unlinks in 990 seconds: 33.098991 unlinks/second - unlinked 0 (time 1785389463 ; total 0 ; last 0) - unlinked 10000 (time 1785389746 ; total 283 ; last 283) - unlinked 20000 (time 1785390066 ; total 603 ; last 320) - unlinked 30000 (time 1785390370 ; total 907 ; last 304) total: 32768 unlinks in 990 seconds: 33.098991 unlinks/second nlink between: 1 - unlinked 0 (time 1785390457 ; total 0 ; last 0) total: 50 unlinks in 2 seconds: 25.000000 unlinks/second - unlinked 0 (time 1785390457 ; total 0 ; last 0) total: 50 unlinks in 2 seconds: 25.000000 unlinks/second nlink after: 1 rmdir(/mnt/lustre/d51b.sanity/d.1.0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second rmdir(/mnt/lustre/d51b.sanity/d.0.0) error: No such file or directory total: 0 unlinks in 0 seconds: -nan unlinks/second UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1784 1269520 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 8160 1263144 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3088 7210952 1% /mnt/lustre UUID Inodes IUsed IFree IUse% Mounted on lustre-MDT0000_UUID 1024000 280 1023720 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1024000 259 1023741 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 262144 368 261776 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 262144 369 261775 1% /mnt/lustre[OST:1] filesystem_summary: 524090 539 523551 1% /mnt/lustre PASS 51b (2433s) == sanity test 64b: check out-of-space detection on client ========================================================== 01:47:58 (1785390478) MGS_OS_ID_LIKE=rhel centos fedora rocky MGS_OS_VERSION_ID=8.10 MGS_OS_ID=rocky MGS_OS_VERSION_CODE=134873088 MDS1_OS_VERSION_ID=8.10 MDS1_OS_VERSION_CODE=134873088 MDS1_OS_ID_LIKE=rhel centos fedora rocky MDS1_OS_ID=rocky OST1_OS_VERSION_CODE=134873088 OST1_OS_ID_LIKE=rhel centos fedora rocky OST1_OS_VERSION_ID=8.10 OST1_OS_ID=rocky CLIENT_OS_ID=rocky CLIENT_OS_VERSION_CODE=134873088 CLIENT_OS_VERSION_ID=8.10 CLIENT_OS_ID_LIKE=rhel centos fedora rocky STRIPECOUNT=2 ORIGFREE=7210952 MAXFREE=800000 SKIP: oos test_64b oos.sh: 7210952kB free gt MAXFREE 800000kB, increase 800000 (or reduce test fs size) to proceed checking grant......UUID 1K-blocks Used Available Use% Mounted on lustre-MDT0000_UUID 1414116 1784 1269520 1% /mnt/lustre[MDT:0] lustre-MDT0001_UUID 1414116 8160 1263144 1% /mnt/lustre[MDT:1] lustre-OST0000_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:0] lustre-OST0001_UUID 3833116 1544 3605476 1% /mnt/lustre[OST:1] filesystem_summary: 7666232 3088 7210952 1% /mnt/lustre pass grant check: client:16875520 server:16875520 SKIP 64b (31s) == sanity test 71: Running dbench on lustre (don't segment fault) ============================================================== 01:48:29 (1785390509) striped dir -i1 -c2 -H crush /mnt/lustre/d71.sanity looking for dbench program /usr/bin/dbench found dbench client file /usr/share/dbench/client.txt '/usr/share/dbench/client.txt' -> 'client.txt' copying required dbench files to chroot directory /mnt/lustre/d71.sanity '/usr/bin/dbench' -> 'dbench' lib64/libpopt.so.0 lib64/libc.so.6 lib64/ld-linux-x86-64.so.2 running 'dbench 2' in /mnt/lustre/d71.sanity at Thu Jul 30 01:48:39 EDT 2026 waiting for dbench pid 15594 dbench version 4.00 - Copyright Andrew Tridgell 1999-2004 Running for 600 seconds with load 'client.txt' and minimum warmup 120 secs failed to create barrier semaphore 0 of 2 processes prepared for launch 0 sec 2 of 2 processes prepared for launch 0 sec releasing clients 0 9 0.00 MB/sec warmup 1 sec latency 65.423 ms 2 48 1.96 MB/sec warmup 2 sec latency 87.630 ms 2 91 2.79 MB/sec warmup 3 sec latency 176.808 ms 2 131 2.89 MB/sec warmup 4 sec latency 132.314 ms 2 161 2.64 MB/sec warmup 5 sec latency 160.293 ms 2 184 2.46 MB/sec warmup 6 sec latency 221.940 ms 2 184 2.11 MB/sec warmup 7 sec latency 1222.107 ms 2 184 1.84 MB/sec warmup 8 sec latency 2222.766 ms 2 190 1.68 MB/sec warmup 9 sec latency 2828.993 ms 2 217 1.68 MB/sec warmup 10 sec latency 256.803 ms 2 252 1.73 MB/sec warmup 11 sec latency 137.260 ms 2 284 1.76 MB/sec warmup 12 sec latency 142.766 ms 2 318 1.78 MB/sec warmup 13 sec latency 154.764 ms 2 347 1.77 MB/sec warmup 14 sec latency 156.177 ms 2 395 1.86 MB/sec warmup 15 sec latency 125.743 ms 2 449 1.97 MB/sec warmup 16 sec latency 89.738 ms 2 499 2.03 MB/sec warmup 17 sec latency 126.170 ms 2 550 2.08 MB/sec warmup 18 sec latency 140.621 ms 2 611 2.16 MB/sec warmup 19 sec latency 244.581 ms 2 672 2.11 MB/sec warmup 20 sec latency 97.255 ms 2 708 2.02 MB/sec warmup 21 sec latency 113.990 ms 2 742 1.93 MB/sec warmup 22 sec latency 150.178 ms 2 781 1.86 MB/sec warmup 23 sec latency 119.930 ms 2 834 1.79 MB/sec warmup 24 sec latency 118.057 ms 2 878 1.73 MB/sec warmup 25 sec latency 108.728 ms 2 909 1.67 MB/sec warmup 26 sec latency 125.885 ms 2 946 1.61 MB/sec warmup 27 sec latency 98.477 ms 2 997 1.58 MB/sec warmup 28 sec latency 114.489 ms 2 1037 1.54 MB/sec warmup 29 sec latency 138.452 ms 2 1096 1.52 MB/sec warmup 30 sec latency 87.723 ms 2 1134 1.48 MB/sec warmup 31 sec latency 124.888 ms 2 1168 1.43 MB/sec warmup 32 sec latency 116.450 ms 2 1202 1.39 MB/sec warmup 33 sec latency 141.330 ms 2 1233 1.35 MB/sec warmup 34 sec latency 146.394 ms 2 1280 1.34 MB/sec warmup 35 sec latency 135.040 ms 2 1336 1.36 MB/sec warmup 36 sec latency 178.471 ms 2 1416 1.40 MB/sec warmup 37 sec latency 259.600 ms 2 1456 1.37 MB/sec warmup 38 sec latency 115.523 ms 2 1483 1.33 MB/sec warmup 39 sec latency 157.008 ms 2 1530 1.30 MB/sec warmup 40 sec latency 173.114 ms 2 1574 1.27 MB/sec warmup 41 sec latency 124.961 ms 2 1615 1.24 MB/sec warmup 42 sec latency 272.980 ms 2 1643 1.21 MB/sec warmup 43 sec latency 153.004 ms 2 1671 1.19 MB/sec warmup 44 sec latency 171.546 ms 2 1711 1.16 MB/sec warmup 45 sec latency 150.319 ms 2 1737 1.14 MB/sec warmup 46 sec latency 205.601 ms 2 1778 1.12 MB/sec warmup 47 sec latency 178.430 ms 2 1792 1.09 MB/sec warmup 48 sec latency 361.280 ms 2 1818 1.07 MB/sec warmup 49 sec latency 237.828 ms 2 1849 1.05 MB/sec warmup 50 sec latency 162.585 ms 2 1888 1.03 MB/sec warmup 51 sec latency 201.953 ms 2 1939 1.01 MB/sec warmup 52 sec latency 124.893 ms 2 1985 1.00 MB/sec warmup 53 sec latency 120.284 ms 2 2006 0.98 MB/sec warmup 54 sec latency 185.755 ms 2 2047 0.96 MB/sec warmup 55 sec latency 136.089 ms 2 2103 0.95 MB/sec warmup 56 sec latency 134.105 ms 2 2143 0.93 MB/sec warmup 57 sec latency 156.925 ms 2 2170 0.92 MB/sec warmup 58 sec latency 183.084 ms 2 2197 0.90 MB/sec warmup 59 sec latency 219.840 ms 2 2243 0.90 MB/sec warmup 60 sec latency 164.616 ms 2 2309 0.90 MB/sec warmup 61 sec latency 143.741 ms 2 2360 0.90 MB/sec warmup 62 sec latency 110.960 ms 2 2390 0.88 MB/sec warmup 63 sec latency 126.291 ms 2 2414 0.87 MB/sec warmup 64 sec latency 227.464 ms 2 2440 0.87 MB/sec warmup 65 sec latency 172.286 ms 2 2467 0.86 MB/sec warmup 66 sec latency 201.254 ms 2 2523 0.86 MB/sec warmup 67 sec latency 241.056 ms 2 2586 0.85 MB/sec warmup 68 sec latency 171.480 ms 2 2688 0.88 MB/sec warmup 69 sec latency 182.980 ms 2 2834 0.92 MB/sec warmup 70 sec latency 151.626 ms 2 2905 0.92 MB/sec warmup 71 sec latency 166.631 ms 2 2949 0.93 MB/sec warmup 72 sec latency 118.884 ms 2 2990 0.92 MB/sec warmup 73 sec latency 159.398 ms 2 3086 0.91 MB/sec warmup 74 sec latency 165.505 ms 2 3117 0.90 MB/sec warmup 75 sec latency 210.230 ms 2 3244 0.91 MB/sec warmup 76 sec latency 134.244 ms 2 3308 0.92 MB/sec warmup 77 sec latency 143.495 ms 2 3358 0.91 MB/sec warmup 78 sec latency 88.445 ms 2 3430 0.93 MB/sec warmup 79 sec latency 212.575 ms 2 3520 0.96 MB/sec warmup 80 sec latency 180.157 ms 2 3567 0.95 MB/sec warmup 81 sec latency 161.047 ms 2 3640 0.94 MB/sec warmup 82 sec latency 96.288 ms 2 3691 0.93 MB/sec warmup 83 sec latency 100.123 ms 2 3741 0.93 MB/sec warmup 84 sec latency 116.390 ms 2 3786 0.93 MB/sec warmup 85 sec latency 142.830 ms 2 3824 0.92 MB/sec warmup 86 sec latency 180.673 ms 2 3865 0.91 MB/sec warmup 87 sec latency 112.110 ms 2 3909 0.91 MB/sec warmup 88 sec latency 113.652 ms 2 3959 0.90 MB/sec warmup 89 sec latency 115.971 ms 2 3998 0.89 MB/sec warmup 90 sec latency 109.899 ms 2 4037 0.88 MB/sec warmup 91 sec latency 149.287 ms 2 4090 0.87 MB/sec warmup 92 sec latency 97.540 ms 2 4156 0.86 MB/sec warmup 93 sec latency 66.243 ms 2 4228 0.85 MB/sec warmup 94 sec latency 109.643 ms 2 4280 0.85 MB/sec warmup 95 sec latency 91.496 ms 2 4326 0.84 MB/sec warmup 96 sec latency 116.585 ms 2 4355 0.83 MB/sec warmup 97 sec latency 304.445 ms 2 4374 0.83 MB/sec warmup 98 sec latency 165.289 ms 2 4408 0.82 MB/sec warmup 99 sec latency 175.286 ms 2 4450 0.81 MB/sec warmup 100 sec latency 146.369 ms 2 4480 0.81 MB/sec warmup 101 sec latency 183.383 ms 2 4533 0.80 MB/sec warmup 102 sec latency 82.605 ms 2 4573 0.80 MB/sec warmup 103 sec latency 156.205 ms 2 4620 0.81 MB/sec warmup 104 sec latency 145.392 ms 2 4689 0.80 MB/sec warmup 105 sec latency 76.370 ms 2 4724 0.79 MB/sec warmup 106 sec latency 116.343 ms 2 4764 0.79 MB/sec warmup 107 sec latency 114.654 ms 2 4794 0.78 MB/sec warmup 108 sec latency 123.874 ms 2 4819 0.77 MB/sec warmup 109 sec latency 170.538 ms 2 4889 0.79 MB/sec warmup 110 sec latency 196.042 ms 2 4958 0.81 MB/sec warmup 111 sec latency 298.622 ms 2 4983 0.80 MB/sec warmup 112 sec latency 159.696 ms 2 5015 0.80 MB/sec warmup 113 sec latency 164.907 ms 2 5055 0.79 MB/sec warmup 114 sec latency 132.359 ms 2 5110 0.78 MB/sec warmup 115 sec latency 107.717 ms 2 5145 0.78 MB/sec warmup 116 sec latency 159.213 ms 2 5175 0.77 MB/sec warmup 117 sec latency 120.662 ms 2 5206 0.77 MB/sec warmup 118 sec latency 143.820 ms 2 5230 0.76 MB/sec warmup 119 sec latency 272.592 ms 2 5281 0.05 MB/sec execute 1 sec latency 249.749 ms 2 5314 0.05 MB/sec execute 2 sec latency 146.402 ms 2 5348 0.05 MB/sec execute 3 sec latency 151.879 ms 2 5373 0.05 MB/sec execute 4 sec latency 151.931 ms 2 5396 0.05 MB/sec execute 5 sec latency 208.025 ms 2 5418 0.05 MB/sec execute 6 sec latency 222.555 ms 2 5453 0.05 MB/sec execute 7 sec latency 167.861 ms 2 5532 0.06 MB/sec execute 8 sec latency 105.062 ms 2 5562 0.06 MB/sec execute 9 sec latency 146.098 ms 2 5589 0.07 MB/sec execute 10 sec latency 163.810 ms 2 5630 0.07 MB/sec execute 11 sec latency 141.111 ms 2 5672 0.07 MB/sec execute 12 sec latency 195.460 ms 2 5709 0.07 MB/sec execute 13 sec latency 159.446 ms 2 5735 0.07 MB/sec execute 14 sec latency 176.379 ms 2 5769 0.07 MB/sec execute 15 sec latency 171.649 ms 2 5817 0.11 MB/sec execute 16 sec latency 132.290 ms 2 5873 0.16 MB/sec execute 17 sec latency 151.374 ms 2 5912 0.18 MB/sec execute 18 sec latency 158.012 ms 2 5931 0.18 MB/sec execute 19 sec latency 215.816 ms 2 5962 0.18 MB/sec execute 20 sec latency 140.593 ms 2 5999 0.18 MB/sec execute 21 sec latency 126.624 ms 2 6032 0.20 MB/sec execute 22 sec latency 147.910 ms 2 6095 0.23 MB/sec execute 23 sec latency 103.466 ms 2 6153 0.23 MB/sec execute 24 sec latency 91.759 ms 2 6252 0.34 MB/sec execute 25 sec latency 116.801 ms 2 6386 0.46 MB/sec execute 26 sec latency 106.846 ms 2 6471 0.51 MB/sec execute 27 sec latency 98.214 ms 2 6516 0.52 MB/sec execute 28 sec latency 182.901 ms 2 6640 0.52 MB/sec execute 29 sec latency 137.569 ms 2 6745 0.53 MB/sec execute 30 sec latency 120.109 ms 2 6797 0.55 MB/sec execute 31 sec latency 131.972 ms 2 6860 0.57 MB/sec execute 32 sec latency 142.143 ms 2 6910 0.56 MB/sec execute 33 sec latency 123.891 ms 2 6954 0.57 MB/sec execute 34 sec latency 148.043 ms 2 7043 0.64 MB/sec execute 35 sec latency 147.655 ms 2 7116 0.67 MB/sec execute 36 sec latency 116.665 ms 2 7169 0.66 MB/sec execute 37 sec latency 110.572 ms 2 7234 0.66 MB/sec execute 38 sec latency 101.479 ms 2 7291 0.67 MB/sec execute 39 sec latency 117.415 ms 2 7332 0.67 MB/sec execute 40 sec latency 131.800 ms 2 7364 0.66 MB/sec execute 41 sec latency 158.709 ms 2 7404 0.64 MB/sec execute 42 sec latency 97.289 ms 2 7446 0.63 MB/sec execute 43 sec latency 131.247 ms 2 7480 0.63 MB/sec execute 44 sec latency 155.621 ms 2 7513 0.61 MB/sec execute 45 sec latency 125.144 ms 2 7538 0.60 MB/sec execute 46 sec latency 197.713 ms 2 7580 0.59 MB/sec execute 47 sec latency 198.188 ms 2 7612 0.58 MB/sec execute 48 sec latency 159.758 ms 2 7656 0.56 MB/sec execute 49 sec latency 127.102 ms 2 7704 0.55 MB/sec execute 50 sec latency 105.540 ms 2 7745 0.54 MB/sec execute 51 sec latency 153.819 ms 2 7783 0.54 MB/sec execute 52 sec latency 171.306 ms 2 7819 0.53 MB/sec execute 53 sec latency 124.735 ms 2 7845 0.52 MB/sec execute 54 sec latency 146.080 ms 2 7884 0.52 MB/sec execute 55 sec latency 110.315 ms 2 7910 0.51 MB/sec execute 56 sec latency 171.110 ms 2 7948 0.50 MB/sec execute 57 sec latency 143.988 ms 2 7989 0.50 MB/sec execute 58 sec latency 144.667 ms 2 8018 0.49 MB/sec execute 59 sec latency 128.254 ms 2 8045 0.49 MB/sec execute 60 sec latency 139.965 ms 2 8073 0.48 MB/sec execute 61 sec latency 140.434 ms 2 8100 0.48 MB/sec execute 62 sec latency 125.673 ms 2 8152 0.50 MB/sec execute 63 sec latency 137.972 ms 2 8209 0.49 MB/sec execute 64 sec latency 92.571 ms 2 8254 0.49 MB/sec execute 65 sec latency 138.151 ms 2 8311 0.48 MB/sec execute 66 sec latency 112.420 ms 2 8345 0.48 MB/sec execute 67 sec latency 108.732 ms 2 8379 0.47 MB/sec execute 68 sec latency 137.096 ms 2 8495 0.55 MB/sec execute 69 sec latency 146.657 ms 2 8523 0.54 MB/sec execute 70 sec latency 152.395 ms 2 8562 0.53 MB/sec execute 71 sec latency 104.270 ms 2 8600 0.52 MB/sec execute 72 sec latency 146.083 ms 2 8637 0.52 MB/sec execute 73 sec latency 134.532 ms 2 8675 0.51 MB/sec execute 74 sec latency 140.160 ms 2 8706 0.51 MB/sec execute 75 sec latency 121.979 ms 2 8743 0.50 MB/sec execute 76 sec latency 132.924 ms 2 8778 0.49 MB/sec execute 77 sec latency 157.336 ms 2 8811 0.49 MB/sec execute 78 sec latency 133.911 ms 2 8836 0.48 MB/sec execute 79 sec latency 128.455 ms 2 8885 0.48 MB/sec execute 80 sec latency 150.949 ms 2 8903 0.47 MB/sec execute 81 sec latency 163.772 ms 2 8934 0.47 MB/sec execute 82 sec latency 145.602 ms 2 8966 0.46 MB/sec execute 83 sec latency 140.164 ms 2 9004 0.46 MB/sec execute 84 sec latency 164.665 ms 2 9054 0.45 MB/sec execute 85 sec latency 135.941 ms 2 9093 0.45 MB/sec execute 86 sec latency 135.312 ms 2 9123 0.45 MB/sec execute 87 sec latency 134.222 ms 2 9171 0.44 MB/sec execute 88 sec latency 149.065 ms 2 9214 0.44 MB/sec execute 89 sec latency 143.957 ms 2 9259 0.43 MB/sec execute 90 sec latency 122.735 ms 2 9288 0.43 MB/sec execute 91 sec latency 134.946 ms 2 9343 0.43 MB/sec execute 92 sec latency 133.563 ms 2 9419 0.44 MB/sec execute 93 sec latency 106.376 ms 2 9466 0.44 MB/sec execute 94 sec latency 139.540 ms 2 9504 0.44 MB/sec execute 95 sec latency 128.593 ms 2 9537 0.44 MB/sec execute 96 sec latency 100.081 ms 2 9576 0.44 MB/sec execute 97 sec latency 120.577 ms 2 9637 0.44 MB/sec execute 98 sec latency 117.589 ms 2 9692 0.44 MB/sec execute 99 sec latency 119.556 ms 2 9727 0.44 MB/sec execute 100 sec latency 533.219 ms 2 9868 0.49 MB/sec execute 101 sec latency 690.335 ms 2 9998 0.50 MB/sec execute 102 sec latency 111.560 ms 2 10080 0.51 MB/sec execute 103 sec latency 97.918 ms 2 10123 0.51 MB/sec execute 104 sec latency 138.579 ms 2 10303 0.52 MB/sec execute 105 sec latency 178.611 ms 2 10375 0.53 MB/sec execute 106 sec latency 133.909 ms 2 10448 0.53 MB/sec execute 107 sec latency 69.707 ms 2 10477 0.52 MB/sec execute 108 sec latency 106.758 ms 2 10622 0.57 MB/sec execute 109 sec latency 108.879 ms 2 10671 0.57 MB/sec execute 110 sec latency 106.681 ms 2 10726 0.57 MB/sec execute 111 sec latency 136.188 ms 2 10788 0.56 MB/sec execute 112 sec latency 83.274 ms 2 10850 0.58 MB/sec execute 113 sec latency 107.856 ms 2 10889 0.57 MB/sec execute 114 sec latency 119.177 ms 2 10924 0.57 MB/sec execute 115 sec latency 179.532 ms 2 10971 0.56 MB/sec execute 116 sec latency 133.115 ms 2 11016 0.56 MB/sec execute 117 sec latency 130.672 ms 2 11051 0.56 MB/sec execute 118 sec latency 133.793 ms 2 11094 0.55 MB/sec execute 119 sec latency 96.466 ms 2 11132 0.55 MB/sec execute 120 sec latency 112.045 ms 2 11161 0.54 MB/sec execute 121 sec latency 173.668 ms 2 11192 0.54 MB/sec execute 122 sec latency 286.391 ms 2 11239 0.53 MB/sec execute 123 sec latency 78.615 ms 2 11302 0.53 MB/sec execute 124 sec latency 101.818 ms 2 11337 0.53 MB/sec execute 125 sec latency 144.952 ms 2 11362 0.53 MB/sec execute 126 sec latency 301.822 ms 2 11388 0.52 MB/sec execute 127 sec latency 139.171 ms 2 11429 0.52 MB/sec execute 128 sec latency 154.998 ms 2 11460 0.52 MB/sec execute 129 sec latency 152.122 ms 2 11484 0.51 MB/sec execute 130 sec latency 177.560 ms 2 11532 0.51 MB/sec execute 131 sec latency 112.221 ms 2 11549 0.51 MB/sec execute 132 sec latency 210.753 ms 2 11563 0.51 MB/sec execute 133 sec latency 273.886 ms 2 11580 0.50 MB/sec execute 134 sec latency 165.601 ms 2 11613 0.50 MB/sec execute 135 sec latency 170.977 ms 2 11638 0.50 MB/sec execute 136 sec latency 150.023 ms 2 11678 0.50 MB/sec execute 137 sec latency 166.101 ms 2 11718 0.50 MB/sec execute 138 sec latency 114.791 ms 2 11766 0.50 MB/sec execute 139 sec latency 111.534 ms 2 11790 0.50 MB/sec execute 140 sec latency 227.819 ms 2 11827 0.50 MB/sec execute 141 sec latency 156.476 ms 2 11860 0.49 MB/sec execute 142 sec latency 101.125 ms 2 11893 0.49 MB/sec execute 143 sec latency 111.186 ms 2 11941 0.49 MB/sec execute 144 sec latency 139.364 ms 2 12052 0.52 MB/sec execute 145 sec latency 137.349 ms 2 12078 0.52 MB/sec execute 146 sec latency 204.914 ms 2 12111 0.52 MB/sec execute 147 sec latency 138.067 ms 2 12150 0.51 MB/sec execute 148 sec latency 122.999 ms 2 12195 0.51 MB/sec execute 149 sec latency 129.164 ms 2 12226 0.51 MB/sec execute 150 sec latency 121.898 ms 2 12259 0.50 MB/sec execute 151 sec latency 134.677 ms 2 12290 0.50 MB/sec execute 152 sec latency 206.025 ms 2 12324 0.50 MB/sec execute 153 sec latency 154.992 ms 2 12354 0.50 MB/sec execute 154 sec latency 164.767 ms 2 12378 0.49 MB/sec execute 155 sec latency 164.011 ms 2 12422 0.49 MB/sec execute 156 sec latency 106.477 ms 2 12449 0.49 MB/sec execute 157 sec latency 119.069 ms 2 12478 0.48 MB/sec execute 158 sec latency 163.693 ms 2 12509 0.48 MB/sec execute 160 sec latency 135.823 ms 2 12554 0.48 MB/sec execute 161 sec latency 114.746 ms 2 12619 0.48 MB/sec execute 162 sec latency 94.221 ms 2 12654 0.47 MB/sec execute 163 sec latency 133.542 ms 2 12696 0.47 MB/sec execute 164 sec latency 98.459 ms 2 12751 0.47 MB/sec execute 165 sec latency 126.862 ms 2 12802 0.47 MB/sec execute 166 sec latency 97.855 ms 2 12833 0.47 MB/sec execute 167 sec latency 132.656 ms 2 12882 0.46 MB/sec execute 168 sec latency 128.171 ms 2 12964 0.47 MB/sec execute 169 sec latency 99.549 ms 2 13011 0.47 MB/sec execute 170 sec latency 112.708 ms 2 13045 0.47 MB/sec execute 171 sec latency 116.956 ms 2 13076 0.47 MB/sec execute 172 sec latency 160.810 ms 2 13113 0.47 MB/sec execute 173 sec latency 180.369 ms 2 13149 0.47 MB/sec execute 174 sec latency 115.705 ms 2 13230 0.47 MB/sec execute 175 sec latency 106.596 ms 2 13316 0.48 MB/sec execute 176 sec latency 130.698 ms 2 13478 0.50 MB/sec execute 177 sec latency 96.091 ms 2 13562 0.51 MB/sec execute 178 sec latency 135.846 ms 2 13632 0.51 MB/sec execute 179 sec latency 136.901 ms 2 13750 0.51 MB/sec execute 180 sec latency 113.495 ms 2 13872 0.51 MB/sec execute 181 sec latency 122.059 ms 2 13944 0.52 MB/sec execute 182 sec latency 118.990 ms 2 14006 0.52 MB/sec execute 183 sec latency 89.723 ms 2 14103 0.53 MB/sec execute 184 sec latency 97.392 ms 2 14201 0.55 MB/sec execute 185 sec latency 111.135 ms 2 14246 0.54 MB/sec execute 186 sec latency 197.510 ms 2 14308 0.54 MB/sec execute 187 sec latency 122.230 ms 2 14347 0.54 MB/sec execute 188 sec latency 91.261 ms 2 14405 0.55 MB/sec execute 189 sec latency 140.017 ms 2 14441 0.55 MB/sec execute 190 sec latency 148.171 ms 2 14473 0.54 MB/sec execute 191 sec latency 128.749 ms 2 14515 0.54 MB/sec execute 192 sec latency 191.089 ms 2 14554 0.54 MB/sec execute 193 sec latency 118.361 ms 2 14590 0.54 MB/sec execute 194 sec latency 125.173 ms 2 14633 0.54 MB/sec execute 195 sec latency 112.995 ms 2 14668 0.53 MB/sec execute 196 sec latency 128.132 ms 2 14705 0.53 MB/sec execute 197 sec latency 190.335 ms 2 14763 0.53 MB/sec execute 198 sec latency 85.905 ms 2 14833 0.53 MB/sec execute 199 sec latency 82.562 ms 2 14883 0.52 MB/sec execute 200 sec latency 140.704 ms 2 14919 0.52 MB/sec execute 201 sec latency 133.011 ms 2 14955 0.52 MB/sec execute 202 sec latency 195.080 ms 2 14990 0.52 MB/sec execute 203 sec latency 164.495 ms 2 15022 0.52 MB/sec execute 204 sec latency 131.547 ms 2 15081 0.52 MB/sec execute 205 sec latency 126.407 ms 2 15112 0.51 MB/sec execute 206 sec latency 110.338 ms 2 15142 0.51 MB/sec execute 207 sec latency 160.493 ms 2 15183 0.51 MB/sec execute 208 sec latency 142.584 ms 2 15218 0.51 MB/sec execute 209 sec latency 135.304 ms 2 15285 0.52 MB/sec execute 210 sec latency 80.037 ms 2 15340 0.51 MB/sec execute 211 sec latency 90.552 ms 2 15384 0.51 MB/sec execute 212 sec latency 111.960 ms 2 15427 0.51 MB/sec execute 213 sec latency 103.243 ms 2 15475 0.51 MB/sec execute 214 sec latency 75.976 ms 2 15590 0.53 MB/sec execute 215 sec latency 131.113 ms 2 15616 0.53 MB/sec execute 216 sec latency 156.001 ms 2 15645 0.53 MB/sec execute 217 sec latency 175.947 ms 2 15676 0.53 MB/sec execute 218 sec latency 151.178 ms 2 15705 0.52 MB/sec execute 219 sec latency 135.139 ms 2 15737 0.52 MB/sec execute 220 sec latency 181.075 ms 2 15775 0.52 MB/sec execute 221 sec latency 114.394 ms 2 15805 0.52 MB/sec execute 222 sec latency 141.114 ms 2 15829 0.51 MB/sec execute 223 sec latency 186.948 ms 2 15871 0.51 MB/sec execute 224 sec latency 174.655 ms 2 15899 0.51 MB/sec execute 225 sec latency 190.507 ms 2 15924 0.51 MB/sec execute 226 sec latency 141.644 ms 2 15977 0.51 MB/sec execute 227 sec latency 163.108 ms 2 15997 0.50 MB/sec execute 228 sec latency 232.821 ms 2 16027 0.50 MB/sec execute 229 sec latency 150.992 ms 2 16054 0.50 MB/sec execute 230 sec latency 142.943 ms 2 16090 0.50 MB/sec execute 231 sec latency 219.361 ms 2 16147 0.50 MB/sec execute 232 sec latency 107.787 ms 2 16194 0.50 MB/sec execute 233 sec latency 134.020 ms 2 16218 0.49 MB/sec execute 234 sec latency 178.220 ms 2 16269 0.49 MB/sec execute 235 sec latency 134.329 ms 2 16315 0.49 MB/sec execute 236 sec latency 136.654 ms 2 16354 0.49 MB/sec execute 237 sec latency 136.342 ms 2 16375 0.49 MB/sec execute 238 sec latency 168.816 ms 2 16412 0.49 MB/sec execute 239 sec latency 203.628 ms 2 16464 0.49 MB/sec execute 240 sec latency 123.476 ms 2 16518 0.49 MB/sec execute 241 sec latency 149.623 ms 2 16558 0.49 MB/sec execute 242 sec latency 124.167 ms 2 16589 0.49 MB/sec execute 243 sec latency 122.772 ms 2 16625 0.49 MB/sec execute 244 sec latency 118.403 ms 2 16665 0.49 MB/sec execute 245 sec latency 119.032 ms 2 16720 0.49 MB/sec execute 246 sec latency 162.418 ms 2 16776 0.49 MB/sec execute 247 sec latency 126.239 ms 2 16875 0.50 MB/sec execute 248 sec latency 111.291 ms 2 16973 0.51 MB/sec execute 249 sec latency 133.827 ms 2 17088 0.51 MB/sec execute 250 sec latency 99.328 ms 2 17139 0.52 MB/sec execute 251 sec latency 129.714 ms 2 17188 0.51 MB/sec execute 252 sec latency 125.848 ms 2 17286 0.51 MB/sec execute 253 sec latency 121.089 ms 2 17404 0.52 MB/sec execute 254 sec latency 120.528 ms 2 17460 0.52 MB/sec execute 255 sec latency 135.443 ms 2 17537 0.52 MB/sec execute 256 sec latency 107.969 ms 2 17625 0.53 MB/sec execute 257 sec latency 83.739 ms 2 17719 0.54 MB/sec execute 258 sec latency 174.470 ms 2 17771 0.54 MB/sec execute 259 sec latency 105.429 ms 2 17834 0.54 MB/sec execute 260 sec latency 95.568 ms 2 17884 0.54 MB/sec execute 261 sec latency 97.775 ms 2 17937 0.54 MB/sec execute 262 sec latency 154.994 ms 2 17977 0.54 MB/sec execute 263 sec latency 148.826 ms 2 18013 0.54 MB/sec execute 264 sec latency 124.154 ms 2 18049 0.54 MB/sec execute 265 sec latency 210.762 ms 2 18082 0.53 MB/sec execute 266 sec latency 200.163 ms 2 18112 0.53 MB/sec execute 267 sec latency 205.979 ms 2 18140 0.53 MB/sec execute 268 sec latency 148.500 ms 2 18171 0.53 MB/sec execute 269 sec latency 168.571 ms 2 18199 0.53 MB/sec execute 270 sec latency 182.749 ms 2 18235 0.53 MB/sec execute 271 sec latency 127.293 ms 2 18268 0.52 MB/sec execute 272 sec latency 209.013 ms 2 18321 0.52 MB/sec execute 273 sec latency 126.423 ms 2 18391 0.52 MB/sec execute 274 sec latency 126.082 ms 2 18435 0.52 MB/sec execute 275 sec latency 139.626 ms 2 18477 0.52 MB/sec execute 276 sec latency 223.564 ms 2 18510 0.52 MB/sec execute 277 sec latency 148.311 ms 2 18546 0.52 MB/sec execute 278 sec latency 168.701 ms 2 18599 0.52 MB/sec execute 279 sec latency 79.866 ms 2 18642 0.51 MB/sec execute 280 sec latency 119.827 ms 2 18672 0.51 MB/sec execute 281 sec latency 149.967 ms 2 18699 0.51 MB/sec execute 282 sec latency 165.490 ms 2 18725 0.51 MB/sec execute 283 sec latency 198.710 ms 2 18756 0.51 MB/sec execute 284 sec latency 158.901 ms 2 18794 0.51 MB/sec execute 285 sec latency 153.004 ms 2 18837 0.51 MB/sec execute 286 sec latency 223.016 ms 2 18869 0.51 MB/sec execute 287 sec latency 121.643 ms 2 18906 0.51 MB/sec execute 288 sec latency 124.256 ms 2 18929 0.51 MB/sec execute 289 sec latency 200.089 ms 2 18960 0.51 MB/sec execute 290 sec latency 160.227 ms 2 18986 0.50 MB/sec execute 291 sec latency 167.197 ms 2 19031 0.51 MB/sec execute 292 sec latency 196.010 ms 2 19090 0.51 MB/sec execute 293 sec latency 228.800 ms 2 19156 0.52 MB/sec execute 294 sec latency 200.480 ms 2 19183 0.52 MB/sec execute 295 sec latency 197.126 ms 2 19222 0.52 MB/sec execute 296 sec latency 168.017 ms 2 19265 0.51 MB/sec execute 297 sec latency 104.532 ms 2 19300 0.51 MB/sec execute 298 sec latency 159.425 ms 2 19326 0.51 MB/sec execute 299 sec latency 199.654 ms 2 19353 0.51 MB/sec execute 300 sec latency 154.687 ms 2 19387 0.51 MB/sec execute 301 sec latency 194.834 ms 2 19419 0.51 MB/sec execute 302 sec latency 170.846 ms 2 19441 0.50 MB/sec execute 303 sec latency 216.818 ms 2 19465 0.50 MB/sec execute 304 sec latency 137.481 ms 2 19479 0.50 MB/sec execute 305 sec latency 248.227 ms 2 19522 0.50 MB/sec execute 306 sec latency 204.106 ms 2 19541 0.50 MB/sec execute 307 sec latency 216.738 ms 2 19560 0.50 MB/sec execute 308 sec latency 207.187 ms 2 19581 0.50 MB/sec execute 309 sec latency 192.411 ms 2 19609 0.49 MB/sec execute 310 sec latency 164.193 ms 2 19632 0.49 MB/sec execute 311 sec latency 308.203 ms 2 19660 0.49 MB/sec execute 312 sec latency 268.660 ms 2 19705 0.49 MB/sec execute 313 sec latency 173.940 ms 2 19734 0.49 MB/sec execute 314 sec latency 220.028 ms 2 19759 0.49 MB/sec execute 315 sec latency 162.932 ms 2 19765 0.49 MB/sec execute 316 sec latency 583.366 ms 2 19820 0.48 MB/sec execute 317 sec latency 250.762 ms 2 19849 0.48 MB/sec execute 318 sec latency 211.294 ms 2 19900 0.48 MB/sec execute 319 sec latency 133.637 ms 2 19908 0.48 MB/sec execute 320 sec latency 462.110 ms 2 19915 0.48 MB/sec execute 321 sec latency 405.584 ms 2 19940 0.48 MB/sec execute 322 sec latency 782.526 ms 2 19969 0.48 MB/sec execute 323 sec latency 128.577 ms 2 20042 0.48 MB/sec execute 324 sec latency 94.263 ms 2 20104 0.48 MB/sec execute 325 sec latency 128.489 ms 2 20143 0.48 MB/sec execute 326 sec latency 112.855 ms 2 20173 0.48 MB/sec execute 327 sec latency 152.434 ms 2 20209 0.48 MB/sec execute 328 sec latency 165.660 ms 2 20249 0.48 MB/sec execute 329 sec latency 154.629 ms 2 20310 0.48 MB/sec execute 330 sec latency 99.087 ms 2 20375 0.48 MB/sec execute 331 sec latency 117.331 ms 2 20494 0.49 MB/sec execute 332 sec latency 127.415 ms 2 20670 0.50 MB/sec execute 333 sec latency 101.748 ms 2 20711 0.50 MB/sec execute 334 sec latency 111.282 ms 2 20776 0.50 MB/sec execute 335 sec latency 88.488 ms 2 20877 0.50 MB/sec execute 336 sec latency 150.701 ms 2 21001 0.50 MB/sec execute 337 sec latency 115.433 ms 2 21093 0.51 MB/sec execute 338 sec latency 102.342 ms 2 21148 0.51 MB/sec execute 339 sec latency 86.697 ms 2 21229 0.51 MB/sec execute 340 sec latency 134.986 ms 2 21318 0.52 MB/sec execute 341 sec latency 131.094 ms 2 21374 0.52 MB/sec execute 342 sec latency 86.984 ms 2 21417 0.52 MB/sec execute 343 sec latency 145.454 ms 2 21456 0.52 MB/sec execute 344 sec latency 113.298 ms 2 21523 0.52 MB/sec execute 345 sec latency 110.910 ms 2 21567 0.52 MB/sec execute 346 sec latency 121.555 ms 2 21606 0.52 MB/sec execute 347 sec latency 123.083 ms 2 21653 0.52 MB/sec execute 348 sec latency 132.831 ms 2 21689 0.52 MB/sec execute 349 sec latency 156.082 ms 2 21728 0.52 MB/sec execute 350 sec latency 122.126 ms 2 21793 0.51 MB/sec execute 351 sec latency 68.129 ms 2 21833 0.51 MB/sec execute 352 sec latency 112.836 ms 2 21873 0.51 MB/sec execute 353 sec latency 208.827 ms 2 21932 0.51 MB/sec execute 354 sec latency 125.582 ms 2 21992 0.51 MB/sec execute 355 sec latency 119.360 ms 2 22016 0.51 MB/sec execute 356 sec latency 180.003 ms 2 22054 0.51 MB/sec execute 357 sec latency 129.979 ms 2 22097 0.51 MB/sec execute 358 sec latency 139.264 ms 2 22133 0.51 MB/sec execute 359 sec latency 112.615 ms 2 22168 0.50 MB/sec execute 360 sec latency 278.734 ms 2 22206 0.50 MB/sec execute 361 sec latency 150.670 ms 2 22232 0.50 MB/sec execute 362 sec latency 155.035 ms 2 22259 0.50 MB/sec execute 363 sec latency 138.959 ms 2 22296 0.50 MB/sec execute 364 sec latency 147.484 ms 2 22318 0.50 MB/sec execute 365 sec latency 198.763 ms 2 22358 0.50 MB/sec execute 366 sec latency 154.346 ms 2 22408 0.50 MB/sec execute 367 sec latency 144.203 ms 2 22456 0.50 MB/sec execute 368 sec latency 138.672 ms 2 22495 0.50 MB/sec execute 369 sec latency 139.897 ms 2 22535 0.50 MB/sec execute 370 sec latency 105.043 ms 2 22568 0.50 MB/sec execute 371 sec latency 124.889 ms 2 22599 0.50 MB/sec execute 372 sec latency 134.583 ms 2 22671 0.50 MB/sec execute 373 sec latency 204.209 ms 2 22729 0.51 MB/sec execute 374 sec latency 164.451 ms 2 22756 0.51 MB/sec execute 375 sec latency 197.230 ms 2 22790 0.51 MB/sec execute 376 sec latency 234.197 ms 2 22822 0.51 MB/sec execute 377 sec latency 164.808 ms 2 22862 0.50 MB/sec execute 378 sec latency 168.196 ms 2 22903 0.50 MB/sec execute 379 sec latency 153.747 ms 2 22953 0.50 MB/sec execute 380 sec latency 98.864 ms 2 22992 0.50 MB/sec execute 381 sec latency 111.852 ms 2 23023 0.50 MB/sec execute 382 sec latency 165.523 ms 2 23051 0.50 MB/sec execute 383 sec latency 139.010 ms 2 23086 0.50 MB/sec execute 384 sec latency 142.485 ms 2 23109 0.50 MB/sec execute 385 sec latency 207.654 ms 2 23137 0.50 MB/sec execute 386 sec latency 130.486 ms 2 23174 0.49 MB/sec execute 387 sec latency 110.543 ms 2 23213 0.49 MB/sec execute 388 sec latency 129.765 ms 2 23279 0.49 MB/sec execute 389 sec latency 116.257 ms 2 23317 0.49 MB/sec execute 390 sec latency 113.488 ms 2 23342 0.49 MB/sec execute 391 sec latency 228.978 ms 2 23379 0.49 MB/sec execute 393 sec latency 163.729 ms 2 23427 0.49 MB/sec execute 394 sec latency 119.603 ms 2 23477 0.49 MB/sec execute 395 sec latency 113.978 ms 2 23495 0.49 MB/sec execute 396 sec latency 146.676 ms 2 23535 0.49 MB/sec execute 397 sec latency 159.297 ms 2 23597 0.49 MB/sec execute 398 sec latency 131.904 ms 2 23663 0.49 MB/sec execute 399 sec latency 122.824 ms 2 23696 0.49 MB/sec execute 400 sec latency 103.212 ms 2 23729 0.49 MB/sec execute 401 sec latency 121.989 ms 2 23763 0.49 MB/sec execute 402 sec latency 166.227 ms 2 23815 0.49 MB/sec execute 403 sec latency 81.048 ms 2 23902 0.49 MB/sec execute 404 sec latency 102.402 ms 2 24002 0.49 MB/sec execute 405 sec latency 93.349 ms 2 24163 0.50 MB/sec execute 406 sec latency 99.748 ms 2 24243 0.51 MB/sec execute 407 sec latency 128.916 ms 2 24305 0.51 MB/sec execute 408 sec latency 106.876 ms 2 24344 0.50 MB/sec execute 409 sec latency 128.830 ms 2 24525 0.51 MB/sec execute 410 sec latency 151.114 ms 2 24602 0.51 MB/sec execute 411 sec latency 126.467 ms 2 24684 0.51 MB/sec execute 412 sec latency 108.213 ms 2 24772 0.52 MB/sec execute 413 sec latency 112.971 ms 2 24867 0.52 MB/sec execute 414 sec latency 86.303 ms 2 24926 0.52 MB/sec execute 415 sec latency 114.542 ms 2 24982 0.52 MB/sec execute 416 sec latency 154.430 ms 2 25028 0.52 MB/sec execute 417 sec latency 129.603 ms 2 25084 0.52 MB/sec execute 418 sec latency 95.516 ms 2 25125 0.52 MB/sec execute 419 sec latency 141.181 ms 2 25172 0.52 MB/sec execute 420 sec latency 99.865 ms 2 25212 0.52 MB/sec execute 421 sec latency 152.637 ms 2 25252 0.52 MB/sec execute 422 sec latency 127.211 ms 2 25281 0.52 MB/sec execute 423 sec latency 184.404 ms 2 25319 0.52 MB/sec execute 424 sec latency 144.627 ms 2 25354 0.52 MB/sec execute 425 sec latency 127.621 ms 2 25378 0.51 MB/sec execute 426 sec latency 280.970 ms 2 25423 0.51 MB/sec execute 427 sec latency 145.447 ms 2 25469 0.51 MB/sec execute 428 sec latency 133.537 ms 2 25521 0.51 MB/sec execute 429 sec latency 144.346 ms 2 25572 0.51 MB/sec execute 430 sec latency 119.821 ms 2 25615 0.51 MB/sec execute 431 sec latency 115.973 ms 2 25646 0.51 MB/sec execute 432 sec latency 173.221 ms 2 25675 0.51 MB/sec execute 433 sec latency 150.653 ms 2 25714 0.51 MB/sec execute 434 sec latency 146.314 ms 2 25748 0.51 MB/sec execute 435 sec latency 128.511 ms 2 25774 0.51 MB/sec execute 436 sec latency 154.494 ms 2 25795 0.51 MB/sec execute 437 sec latency 170.983 ms 2 25828 0.50 MB/sec execute 438 sec latency 124.075 ms 2 25864 0.50 MB/sec execute 439 sec latency 102.031 ms 2 25907 0.51 MB/sec execute 440 sec latency 104.474 ms 2 25961 0.51 MB/sec execute 441 sec latency 92.162 ms 2 26006 0.51 MB/sec execute 442 sec latency 132.936 ms 2 26032 0.50 MB/sec execute 443 sec latency 166.151 ms 2 26067 0.50 MB/sec execute 444 sec latency 158.976 ms 2 26100 0.50 MB/sec execute 445 sec latency 166.813 ms 2 26129 0.50 MB/sec execute 446 sec latency 118.013 ms 2 26167 0.50 MB/sec execute 447 sec latency 158.975 ms 2 26274 0.51 MB/sec execute 448 sec latency 133.179 ms 2 26301 0.51 MB/sec execute 449 sec latency 192.140 ms 2 26335 0.51 MB/sec execute 450 sec latency 122.562 ms 2 26375 0.51 MB/sec execute 451 sec latency 158.234 ms 2 26412 0.51 MB/sec execute 452 sec latency 140.254 ms 2 26448 0.51 MB/sec execute 453 sec latency 127.615 ms 2 26482 0.51 MB/sec execute 454 sec latency 106.525 ms 2 26506 0.50 MB/sec execute 455 sec latency 197.038 ms 2 26533 0.50 MB/sec execute 456 sec latency 199.713 ms 2 26569 0.50 MB/sec execute 457 sec latency 148.661 ms 2 26591 0.50 MB/sec execute 458 sec latency 211.465 ms 2 26622 0.50 MB/sec execute 459 sec latency 211.718 ms 2 26656 0.50 MB/sec execute 460 sec latency 153.767 ms 2 26670 0.50 MB/sec execute 461 sec latency 240.281 ms 2 26690 0.50 MB/sec execute 462 sec latency 158.430 ms 2 26716 0.50 MB/sec execute 463 sec latency 154.553 ms 2 26754 0.50 MB/sec execute 464 sec latency 139.284 ms 2 26812 0.50 MB/sec execute 465 sec latency 148.045 ms 2 26853 0.49 MB/sec execute 466 sec latency 154.877 ms 2 26874 0.49 MB/sec execute 467 sec latency 199.178 ms 2 26892 0.49 MB/sec execute 468 sec latency 191.145 ms 2 26921 0.49 MB/sec execute 469 sec latency 197.830 ms 2 26970 0.49 MB/sec execute 470 sec latency 146.770 ms 2 27015 0.49 MB/sec execute 471 sec latency 149.540 ms 2 27040 0.49 MB/sec execute 472 sec latency 142.777 ms 2 27070 0.49 MB/sec execute 473 sec latency 124.857 ms 2 27098 0.49 MB/sec execute 474 sec latency 174.485 ms 2 27137 0.49 MB/sec execute 475 sec latency 173.832 ms 2 27191 0.49 MB/sec execute 476 sec latency 157.622 ms 2 27230 0.49 MB/sec execute 477 sec latency 108.236 ms 2 27263 0.49 MB/sec execute 478 sec latency 106.991 ms 2 27290 0.49 MB/sec execute 479 sec latency 233.544 ms 2 27320 0.49 MB/sec execute 480 sec latency 166.934 ms 2 27338 0.49 MB/sec execute 481 sec latency 551.777 ms 2 27365 0.49 MB/sec execute 482 sec latency 159.537 ms 2 27438 0.49 MB/sec execute 483 sec latency 118.038 ms 2 27469 0.49 MB/sec execute 484 sec latency 122.780 ms 2 27598 0.50 MB/sec execute 485 sec latency 116.175 ms 2 27644 0.50 MB/sec execute 486 sec latency 435.607 ms 2 27769 0.50 MB/sec execute 487 sec latency 504.689 ms 2 27807 0.50 MB/sec execute 488 sec latency 168.507 ms 2 27869 0.50 MB/sec execute 489 sec latency 119.706 ms 2 28047 0.50 MB/sec execute 490 sec latency 99.295 ms 2 28121 0.50 MB/sec execute 491 sec latency 185.013 ms 2 28201 0.50 MB/sec execute 492 sec latency 91.698 ms 2 28264 0.50 MB/sec execute 493 sec latency 84.126 ms 2 28391 0.51 MB/sec execute 494 sec latency 137.389 ms 2 28428 0.51 MB/sec execute 495 sec latency 150.672 ms 2 28482 0.51 MB/sec execute 496 sec latency 165.136 ms 2 28523 0.51 MB/sec execute 497 sec latency 115.042 ms 2 28564 0.51 MB/sec execute 498 sec latency 110.089 ms 2 28613 0.51 MB/sec execute 499 sec latency 128.943 ms 2 28652 0.51 MB/sec execute 500 sec latency 110.275 ms 2 28679 0.51 MB/sec execute 501 sec latency 213.790 ms 2 28717 0.51 MB/sec execute 502 sec latency 105.404 ms 2 28763 0.51 MB/sec execute 503 sec latency 99.531 ms 2 28797 0.51 MB/sec execute 504 sec latency 121.934 ms 2 28846 0.51 MB/sec execute 505 sec latency 129.189 ms 2 28880 0.51 MB/sec execute 506 sec latency 219.278 ms 2 28922 0.51 MB/sec execute 507 sec latency 144.130 ms 2 28985 0.51 MB/sec execute 508 sec latency 85.935 ms 2 29072 0.51 MB/sec execute 509 sec latency 68.726 ms 2 29130 0.51 MB/sec execute 510 sec latency 94.909 ms 2 29166 0.51 MB/sec execute 511 sec latency 129.331 ms 2 29210 0.50 MB/sec execute 512 sec latency 183.883 ms 2 29228 0.50 MB/sec execute 513 sec latency 816.851 ms 2 29255 0.50 MB/sec execute 514 sec latency 1656.136 ms 2 29280 0.50 MB/sec execute 515 sec latency 144.444 ms 2 29326 0.50 MB/sec execute 516 sec latency 121.602 ms 2 29358 0.50 MB/sec execute 517 sec latency 116.622 ms 2 29383 0.50 MB/sec execute 518 sec latency 157.252 ms 2 29419 0.50 MB/sec execute 519 sec latency 145.889 ms 2 29478 0.50 MB/sec execute 520 sec latency 134.028 ms 2 29533 0.50 MB/sec execute 521 sec latency 112.990 ms 2 29580 0.50 MB/sec execute 522 sec latency 107.679 ms 2 29619 0.50 MB/sec execute 523 sec latency 132.033 ms 2 29660 0.50 MB/sec execute 524 sec latency 93.213 ms 2 29735 0.50 MB/sec execute 525 sec latency 118.556 ms 2 29766 0.50 MB/sec execute 526 sec latency 132.003 ms 2 29860 0.51 MB/sec execute 527 sec latency 84.700 ms 2 29902 0.51 MB/sec execute 528 sec latency 107.286 ms 2 29948 0.51 MB/sec execute 529 sec latency 126.585 ms 2 29994 0.51 MB/sec execute 530 sec latency 124.644 ms 2 30041 0.50 MB/sec execute 531 sec latency 93.005 ms 2 30091 0.50 MB/sec execute 532 sec latency 131.446 ms 2 30126 0.50 MB/sec execute 533 sec latency 171.991 ms 2 30160 0.50 MB/sec execute 534 sec latency 164.505 ms 2 30189 0.50 MB/sec execute 535 sec latency 144.889 ms 2 30222 0.50 MB/sec execute 536 sec latency 131.592 ms 2 30242 0.50 MB/sec execute 537 sec latency 162.260 ms 2 30276 0.50 MB/sec execute 538 sec latency 135.010 ms 2 30320 0.50 MB/sec execute 539 sec latency 140.323 ms 2 30367 0.50 MB/sec execute 540 sec latency 107.341 ms 2 30408 0.50 MB/sec execute 541 sec latency 129.653 ms 2 30433 0.50 MB/sec execute 542 sec latency 191.865 ms 2 30478 0.49 MB/sec execute 543 sec latency 145.364 ms 2 30527 0.49 MB/sec execute 544 sec latency 144.816 ms 2 30561 0.49 MB/sec execute 545 sec latency 146.993 ms 2 30602 0.49 MB/sec execute 546 sec latency 143.224 ms 2 30647 0.49 MB/sec execute 547 sec latency 156.677 ms 2 30715 0.49 MB/sec execute 548 sec latency 112.140 ms 2 30776 0.49 MB/sec execute 549 sec latency 93.222 ms 2 30814 0.49 MB/sec execute 550 sec latency 122.595 ms 2 30849 0.49 MB/sec execute 551 sec latency 97.599 ms 2 30885 0.49 MB/sec execute 552 sec latency 135.639 ms 2 30942 0.49 MB/sec execute 553 sec latency 107.625 ms 2 30966 0.49 MB/sec execute 554 sec latency 161.070 ms 2 31040 0.50 MB/sec execute 555 sec latency 167.690 ms 2 31109 0.50 MB/sec execute 556 sec latency 171.428 ms 2 31251 0.50 MB/sec execute 557 sec latency 115.679 ms 2 31343 0.50 MB/sec execute 558 sec latency 105.192 ms 2 31384 0.51 MB/sec execute 559 sec latency 89.817 ms 2 31496 0.51 MB/sec execute 560 sec latency 140.876 ms 2 31527 0.50 MB/sec execute 561 sec latency 157.843 ms 2 31645 0.51 MB/sec execute 562 sec latency 145.095 ms 2 31693 0.51 MB/sec execute 563 sec latency 198.360 ms 2 31739 0.51 MB/sec execute 564 sec latency 162.187 ms 2 31804 0.51 MB/sec execute 565 sec latency 108.797 ms 2 31869 0.51 MB/sec execute 566 sec latency 147.123 ms 2 31960 0.52 MB/sec execute 567 sec latency 160.023 ms 2 32022 0.51 MB/sec execute 568 sec latency 142.687 ms 2 32070 0.51 MB/sec execute 569 sec latency 109.650 ms 2 32136 0.52 MB/sec execute 570 sec latency 84.690 ms 2 32189 0.52 MB/sec execute 571 sec latency 133.423 ms 2 32236 0.52 MB/sec execute 572 sec latency 174.516 ms 2 32260 0.51 MB/sec execute 573 sec latency 253.505 ms 2 32287 0.51 MB/sec execute 574 sec latency 188.483 ms 2 32318 0.51 MB/sec execute 575 sec latency 175.791 ms 2 32349 0.51 MB/sec execute 576 sec latency 134.366 ms 2 32383 0.51 MB/sec execute 577 sec latency 146.030 ms 2 32411 0.51 MB/sec execute 578 sec latency 278.651 ms 2 32445 0.51 MB/sec execute 579 sec latency 121.192 ms 2 32478 0.51 MB/sec execute 580 sec latency 196.061 ms 2 32511 0.51 MB/sec execute 581 sec latency 189.484 ms 2 32546 0.51 MB/sec execute 582 sec latency 141.691 ms 2 32577 0.51 MB/sec execute 583 sec latency 255.579 ms 2 32611 0.51 MB/sec execute 584 sec latency 177.992 ms 2 32656 0.51 MB/sec execute 585 sec latency 127.059 ms 2 32693 0.51 MB/sec execute 586 sec latency 138.558 ms 2 32724 0.50 MB/sec execute 587 sec latency 135.433 ms 2 32749 0.50 MB/sec execute 588 sec latency 139.065 ms 2 32797 0.50 MB/sec execute 589 sec latency 123.367 ms 2 32820 0.50 MB/sec execute 590 sec latency 148.377 ms 2 32857 0.50 MB/sec execute 591 sec latency 164.174 ms 2 32891 0.50 MB/sec execute 592 sec latency 101.990 ms 2 32922 0.50 MB/sec execute 593 sec latency 119.427 ms 2 32963 0.50 MB/sec execute 594 sec latency 149.055 ms 2 33006 0.50 MB/sec execute 595 sec latency 119.035 ms 2 33056 0.50 MB/sec execute 596 sec latency 113.623 ms 2 33107 0.50 MB/sec execute 597 sec latency 97.072 ms 2 33155 0.50 MB/sec execute 598 sec latency 91.150 ms 2 33208 0.50 MB/sec execute 599 sec latency 102.713 ms 2 cleanup 600 sec 2 cleanup 601 sec 2 cleanup 602 sec 0 cleanup 603 sec Operation Count AvgLat MaxLat ---------------------------------------- NTCreateX 9681 63.740 782.512 Close 7104 14.742 130.324 Rename 414 86.882 273.862 Unlink 1972 27.466 177.968 Qpathinfo 8779 16.625 222.989 Qfileinfo 1522 3.120 47.805 Qfsinfo 1627 1.783 40.494 Sfileinfo 796 68.114 227.807 Find 3402 13.965 193.829 WriteX 4784 16.263 150.882 ReadX 15258 0.224 150.653 LockX 32 14.501 45.974 UnlockX 32 12.275 46.484 Flush 682 64.545 223.543 Throughput 0.500386 MB/sec 2 clients 2 procs max_latency=1656.136 ms stopping dbench in /mnt/lustre/d71.sanity at Thu Jul 30 02:00:44 EDT 2026 with return code 0 clean dbench files in /mnt/lustre/d71.sanity /mnt/lustre/d71.sanity /mnt/lustre/d71.sanity removed directory 'clients/client0/~dmtmp/PM' removed directory 'clients/client0/~dmtmp/WORDPRO' removed directory 'clients/client0/~dmtmp/ACCESS' removed directory 'clients/client0/~dmtmp/EXCEL' removed directory 'clients/client0/~dmtmp/COREL' removed directory 'clients/client0/~dmtmp/PWRPNT' removed directory 'clients/client0/~dmtmp/WORD' removed directory 'clients/client0/~dmtmp/SEED' removed directory 'clients/client0/~dmtmp/PARADOX' removed directory 'clients/client0/~dmtmp' removed directory 'clients/client0' removed directory 'clients/client1/~dmtmp/PM' removed directory 'clients/client1/~dmtmp/WORDPRO' removed directory 'clients/client1/~dmtmp/ACCESS' removed directory 'clients/client1/~dmtmp/EXCEL' removed directory 'clients/client1/~dmtmp/COREL' removed directory 'clients/client1/~dmtmp/PWRPNT' removed directory 'clients/client1/~dmtmp/WORD' removed directory 'clients/client1/~dmtmp/SEED' removed directory 'clients/client1/~dmtmp/PARADOX' removed directory 'clients/client1/~dmtmp' removed directory 'clients/client1' removed directory 'clients' removed 'client.txt' removed 'dbench' removed 'lib64/libpopt.so.0' removed 'lib64/libc.so.6' removed 'lib64/ld-linux-x86-64.so.2' /mnt/lustre/d71.sanity dbench successfully finished PASS 71 (745s) == sanity test 255a: check 'lfs ladvise -a willread' ===== 02:01:04 (1785391264) 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 18.5202 s, 5.7 MB/s ladvise: range [2, 1] is invalid Provide servers with advice about access patterns for a file. usage: ladvise [--advice|-a ADVICE] [--start|-s START[kMGT]] [--background|-b] [--unset|-u] {--end|-e END[kMGT]|--length|-l LENGTH[kMGT]} {[--mode|-m [READ,WRITE]} ... ladvise: range [2, 2] is invalid Provide servers with advice about access patterns for a file. usage: ladvise [--advice|-a ADVICE] [--start|-s START[kMGT]] [--background|-b] [--unset|-u] {--end|-e END[kMGT]|--length|-l LENGTH[kMGT]} {[--mode|-m [READ,WRITE]} ... ladvise: conflicting arguments of -l and -e Provide servers with advice about access patterns for a file. usage: ladvise [--advice|-a ADVICE] [--start|-s START[kMGT]] [--background|-b] [--unset|-u] {--end|-e END[kMGT]|--length|-l LENGTH[kMGT]} {[--mode|-m [READ,WRITE]} ... Synchronous ladvise should wait fail_val=8 fail_loc=0x237 Asynchronous ladvise shouldn't wait llite.lustre-ffff9ca909e2d000.hybrid_io=0 Iter 1/10: reading without willread hint Iter 1/10: uncached speed: 0.240928 Iter 1/10: OSS cache speed: 0.241352 Iter 1/10: ladvise speed: 0.243316 Iter 2/10: reading without willread hint Iter 2/10: uncached speed: 0.225555 Iter 2/10: OSS cache speed: 0.258633 Iter 2/10: ladvise speed: 0.28234 Iter 3/10: reading without willread hint Iter 3/10: uncached speed: 0.253083 Iter 3/10: OSS cache speed: 0.210282 Iter 3/10: ladvise speed: 0.20595 Iter 4/10: reading without willread hint Iter 4/10: uncached speed: 0.207588 Iter 4/10: OSS cache speed: 0.242166 Iter 4/10: ladvise speed: 0.263036 Iter 5/10: reading without willread hint Iter 5/10: uncached speed: 0.2373 Iter 5/10: OSS cache speed: 0.24812 Iter 5/10: ladvise speed: 0.283336 Iter 6/10: reading without willread hint Iter 6/10: uncached speed: 0.25393 Iter 6/10: OSS cache speed: 0.279176 Iter 6/10: ladvise speed: 0.23785 Iter 7/10: reading without willread hint Iter 7/10: uncached speed: 0.209291 Iter 7/10: OSS cache speed: 0.248587 Iter 7/10: ladvise speed: 0.18906 Iter 8/10: reading without willread hint Iter 8/10: uncached speed: 0.206694 Iter 8/10: OSS cache speed: 0.23753 Iter 8/10: ladvise speed: 0.204367 Iter 9/10: reading without willread hint Iter 9/10: uncached speed: 0.227104 Iter 9/10: OSS cache speed: 0.223788 Iter 9/10: ladvise speed: 0.246987 Iter 10/10: reading without willread hint Iter 10/10: uncached speed: 0.236209 Iter 10/10: OSS cache speed: 0.253484 Iter 10/10: ladvise speed: 0.257822 Average uncached read: .22 Average speedup with OSS cached read: .24 = +9% Average speedup with ladvise willread: .24 = +9% Speedup with OSS cached read less than 20%, got 9%. Skipping ladvise willread check. fail_loc=0 PASS 255a (2133s) == sanity test 255b: check 'lfs ladvise -a dontneed' ===== 02:36:37 (1785393397) 100+0 records in 100+0 records out 104857600 bytes (105 MB, 100 MiB) copied, 18.1127 s, 5.8 MB/s Total memory: 3781768 KiB Cache used before read: 99968 KiB Cache used after read: 202432 KiB Cache used after dontneed ladvise: 100024 KiB PASS 255b (50s) == sanity test 255c: suite of ladvise lockahead tests ==== 02:37:28 (1785393448) striped dir -i1 -c2 -H crush2 /mnt/lustre/d255c.sanity Starting test test10 at 1785393452 Finishing test test10 at 1785393452 Starting test test11 at 1785393454 Finishing test test11 at 1785393454 Starting test test12 at 1785393457 Finishing test test12 at 1785393457 Starting test test13 at 1785393457 Finishing test test13 at 1785393458 Starting test test14 at 1785393459 Finishing test test14 at 1785393460 Starting test test15 at 1785393461 Finishing test test15 at 1785393462 Starting test test16 at 1785393463 Finishing test test16 at 1785393463 Starting test test17 at 1785393464 Finishing test test17 at 1785393465 Starting test test18 at 1785393465 Finishing test test18 at 1785393465 Starting test test19 at 1785393466 Finishing test test19 at 1785393466 Starting test test20 at 1785393466 Finishing test test20 at 1785393467 Starting test test21 at 1785393467 Finishing test test21 at 1785393468 Starting test test22 at 1785393468 lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) lockahead_test: cannot give advice: Invalid argument (22) Finishing test test22 at 1785393468 PASS 255c (33s) == sanity test 300o: unlink big sub stripe(> 65000 subdirs) ========================================================== 02:38:05 (1785393485) - mkdir 888 (time 1785393502.16 total 10.00 last 88.79) - mkdir 2034 (time 1785393512.17 total 20.01 last 114.50) - mkdir 2942 (time 1785393522.17 total 30.01 last 90.77) - mkdir 4147 (time 1785393532.19 total 40.03 last 120.34) - mkdir 5464 (time 1785393542.19 total 50.03 last 131.68) - mkdir 6590 (time 1785393552.19 total 60.03 last 112.55) - mkdir 7917 (time 1785393562.20 total 70.03 last 132.66) - mkdir 9042 (time 1785393572.20 total 80.04 last 112.44) - mkdir 10000 (time 1785393581.30 total 89.13 last 105.35) - mkdir 11103 (time 1785393591.30 total 99.14 last 110.25) - mkdir 12156 (time 1785393601.30 total 109.14 last 105.30) - mkdir 13257 (time 1785393611.30 total 119.14 last 110.09) - mkdir 14153 (time 1785393621.32 total 129.16 last 89.43) - mkdir 15490 (time 1785393631.33 total 139.16 last 133.62) - mkdir 16439 (time 1785393641.33 total 149.17 last 94.85) - mkdir 17297 (time 1785393651.34 total 159.18 last 85.75) - mkdir 18424 (time 1785393661.35 total 169.19 last 112.54) - mkdir 19161 (time 1785393671.37 total 179.21 last 73.53) - mkdir 20000 (time 1785393680.38 total 188.21 last 93.21) - mkdir 21075 (time 1785393690.38 total 198.22 last 107.49) - mkdir 22184 (time 1785393700.39 total 208.23 last 110.76) - mkdir 23331 (time 1785393710.40 total 218.23 last 114.63) - mkdir 24486 (time 1785393720.40 total 228.24 last 115.40) - mkdir 25459 (time 1785393730.42 total 238.26 last 97.17) - mkdir 26557 (time 1785393740.43 total 248.27 last 109.69) - mkdir 27661 (time 1785393750.44 total 258.27 last 110.31) - mkdir 28739 (time 1785393760.44 total 268.28 last 107.78) - mkdir 29817 (time 1785393770.44 total 278.28 last 107.76) - mkdir 30970 (time 1785393780.45 total 288.28 last 115.25) - mkdir 31979 (time 1785393790.45 total 298.29 last 100.85) - mkdir 32729 (time 1785393800.47 total 308.31 last 74.88) - mkdir 33618 (time 1785393810.47 total 318.31 last 88.89) - mkdir 34636 (time 1785393820.49 total 328.33 last 101.59) - mkdir 35541 (time 1785393830.49 total 338.33 last 90.48) - mkdir 36369 (time 1785393840.52 total 348.36 last 82.59) - mkdir 37437 (time 1785393850.52 total 358.36 last 106.80) - mkdir 38798 (time 1785393860.52 total 368.36 last 136.09) - mkdir 39869 (time 1785393870.53 total 378.36 last 107.01) - mkdir 41070 (time 1785393880.54 total 388.37 last 119.98) - mkdir 42057 (time 1785393890.55 total 398.38 last 98.61) - mkdir 43354 (time 1785393900.55 total 408.39 last 129.65) - mkdir 44265 (time 1785393910.55 total 418.39 last 91.09) - mkdir 45164 (time 1785393920.56 total 428.39 last 89.86) - mkdir 46188 (time 1785393930.56 total 438.40 last 102.35) - mkdir 47146 (time 1785393940.57 total 448.41 last 95.66) - mkdir 47927 (time 1785393950.59 total 458.43 last 77.98) - mkdir 48930 (time 1785393960.59 total 468.43 last 100.28) - mkdir 49822 (time 1785393970.61 total 478.45 last 89.02) - mkdir 50887 (time 1785393980.62 total 488.46 last 106.42) - mkdir 51859 (time 1785393990.63 total 498.47 last 97.11) - mkdir 53010 (time 1785394000.63 total 508.47 last 115.03) - mkdir 54565 (time 1785394010.66 total 518.49 last 155.15) - mkdir 55279 (time 1785394020.67 total 528.51 last 71.30) - mkdir 56025 (time 1785394030.68 total 538.52 last 74.55) - mkdir 57136 (time 1785394040.69 total 548.52 last 111.02) - mkdir 58150 (time 1785394050.69 total 558.53 last 101.38) - mkdir 59085 (time 1785394060.69 total 568.53 last 93.49) - mkdir 59944 (time 1785394070.69 total 578.53 last 85.90) - mkdir 60966 (time 1785394080.69 total 588.53 last 102.18) - mkdir 61760 (time 1785394090.69 total 598.53 last 79.38) - mkdir 62744 (time 1785394100.70 total 608.54 last 98.36) - mkdir 63731 (time 1785394110.72 total 618.56 last 98.47) - mkdir 64958 (time 1785394120.72 total 628.56 last 122.69) - mkdir 66064 (time 1785394130.74 total 638.58 last 110.38) - mkdir 66936 (time 1785394140.79 total 648.62 last 86.82) - mkdir 68079 (time 1785394150.79 total 658.62 last 114.29) - mkdir 69336 (time 1785394160.79 total 668.62 last 125.69) - mkdir 70000 (time 1785394165.24 total 673.08 last 149.00) - mkdir 71346 (time 1785394175.25 total 683.08 last 134.57) - mkdir 72363 (time 1785394185.26 total 693.09 last 101.59) - mkdir 73304 (time 1785394195.27 total 703.11 last 93.94) - mkdir 74241 (time 1785394205.28 total 713.12 last 93.63) - mkdir 75280 (time 1785394215.28 total 723.12 last 103.88) - mkdir 76304 (time 1785394225.30 total 733.14 last 102.26) - mkdir 77187 (time 1785394235.30 total 743.14 last 88.29) - mkdir 78318 (time 1785394245.30 total 753.14 last 113.10) - mkdir 79104 (time 1785394255.31 total 763.15 last 78.49) - mkdir 79995 (time 1785394265.32 total 773.16 last 89.05) - mkdir 81002 (time 1785394275.32 total 783.16 last 100.66) - mkdir 81946 (time 1785394285.33 total 793.16 last 94.37) - mkdir 82956 (time 1785394295.33 total 803.17 last 100.98) - mkdir 84000 (time 1785394305.33 total 813.17 last 104.35) - mkdir 84951 (time 1785394315.34 total 823.17 last 95.07) - mkdir 85792 (time 1785394325.34 total 833.18 last 84.08) - mkdir 86523 (time 1785394335.35 total 843.19 last 72.99) - mkdir 87278 (time 1785394345.37 total 853.21 last 75.36) - mkdir 88072 (time 1785394355.39 total 863.23 last 79.27) - mkdir 89151 (time 1785394365.40 total 873.24 last 107.81) - mkdir 90000 (time 1785394372.32 total 880.16 last 122.61) - mkdir 90751 (time 1785394382.32 total 890.16 last 75.08) - mkdir 91547 (time 1785394392.34 total 900.17 last 79.51) - mkdir 92411 (time 1785394402.35 total 910.19 last 86.24) - mkdir 93263 (time 1785394412.37 total 920.21 last 85.07) - mkdir 94489 (time 1785394422.38 total 930.21 last 122.51) - mkdir 95601 (time 1785394432.38 total 940.22 last 111.18) - mkdir 97025 (time 1785394442.38 total 950.22 last 142.38) - mkdir 98059 (time 1785394452.39 total 960.23 last 103.26) - mkdir 98994 (time 1785394462.40 total 970.24 last 93.44) - mkdir 99966 (time 1785394472.40 total 980.24 last 97.19) - mkdir 100878 (time 1785394482.41 total 990.25 last 91.14) - mkdir 101623 (time 1785394492.43 total 1000.27 last 74.32) - mkdir 102214 (time 1785394502.44 total 1010.27 last 59.07) - mkdir 103019 (time 1785394512.44 total 1020.28 last 80.45) - mkdir 103912 (time 1785394522.45 total 1030.29 last 89.19) - mkdir 104900 (time 1785394532.46 total 1040.30 last 98.77) - mkdir 105808 (time 1785394542.46 total 1050.30 last 90.74) - mkdir 106604 (time 1785394552.48 total 1060.32 last 79.48) - mkdir 107464 (time 1785394562.49 total 1070.32 last 85.95) - mkdir 108560 (time 1785394572.49 total 1080.33 last 109.51) - mkdir 109547 (time 1785394582.51 total 1090.34 last 98.58) - mkdir 110000 (time 1785394588.15 total 1095.98 last 80.32) - mkdir 110991 (time 1785394598.15 total 1105.99 last 99.05) - mkdir 112345 (time 1785394608.15 total 1115.99 last 135.38) - mkdir 113481 (time 1785394618.16 total 1126.00 last 113.53) - mkdir 114628 (time 1785394628.16 total 1136.00 last 114.66) - mkdir 115744 (time 1785394638.18 total 1146.02 last 111.35) - mkdir 116754 (time 1785394648.19 total 1156.03 last 100.93) - mkdir 117643 (time 1785394658.20 total 1166.04 last 88.82) - mkdir 118701 (time 1785394668.21 total 1176.05 last 105.72) - mkdir 119667 (time 1785394678.21 total 1186.05 last 96.58) - mkdir 120000 (time 1785394681.20 total 1189.04 last 111.48) - mkdir 120960 (time 1785394691.21 total 1199.05 last 95.84) - mkdir 121925 (time 1785394701.22 total 1209.06 last 96.43) - mkdir 122825 (time 1785394711.27 total 1219.11 last 89.57) - mkdir 123885 (time 1785394721.27 total 1229.11 last 105.96) - mkdir 124834 (time 1785394731.28 total 1239.12 last 94.84) - mkdir 125768 (time 1785394741.29 total 1249.13 last 93.33) - mkdir 127041 (time 1785394751.30 total 1259.14 last 127.08) - mkdir 128052 (time 1785394761.31 total 1269.15 last 101.06) - mkdir 129148 (time 1785394771.31 total 1279.15 last 109.59) - mkdir 130000 (time 1785394780.17 total 1288.01 last 96.12) - mkdir 130939 (time 1785394790.18 total 1298.02 last 93.80) total: 131000 mkdir in 1298.87 seconds: 100.86 ops/second ldlm.namespaces.lustre-MDT0000-mdc-ffff9ca909e2d000.lru_size=0 ldlm.namespaces.lustre-MDT0001-mdc-ffff9ca909e2d000.lru_size=0 - unlinked 0 (time 1785394806 ; total 0 ; last 0) - unlinked 10000 (time 1785394966 ; total 160 ; last 160) - unlinked 20000 (time 1785395119 ; total 313 ; last 153) - unlinked 30000 (time 1785395279 ; total 473 ; last 160) - unlinked 40000 (time 1785395439 ; total 633 ; last 160) - unlinked 50000 (time 1785395608 ; total 802 ; last 169) - unlinked 60000 (time 1785395752 ; total 946 ; last 144) - unlinked 70000 (time 1785395906 ; total 1100 ; last 154) - unlinked 80000 (time 1785396071 ; total 1265 ; last 165) - unlinked 90000 (time 1785396235 ; total 1429 ; last 164) - unlinked 100000 (time 1785396405 ; total 1599 ; last 170) - unlinked 110000 (time 1785396567 ; total 1761 ; last 162) - unlinked 120000 (time 1785396708 ; total 1902 ; last 141) - unlinked 130000 (time 1785396861 ; total 2055 ; last 153) total: 131000 unlinks in 2071 seconds: 63.254467 unlinks/second PASS 300o (3405s) == sanity test complete, duration 8950 sec =============== 03:34:59 (1785396899) === sanity: start cleanup 03:35:01 (1785396901) === === sanity: finish cleanup 03:35:09 (1785396909) === debug=super ioctl neterror warning dlmtrace error emerg ha rpctrace vfstrace config console lfsck