== sanity test 398b: DIO and buffer IO race ============== 11:42:11 (1736268131) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB) copied, 0.0762002 s, 165 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=16748: Tue Jan 7 11:42:13 2025 read: IOPS=323, BW=1293KiB/s (1324kB/s)(1480KiB/1145msec) clat (usec): min=3, max=30143, avg=1768.31, stdev=2654.61 lat (usec): min=3, max=30143, avg=1769.32, stdev=2654.72 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 16], 40.00th=[ 914], 50.00th=[ 1565], 60.00th=[ 2040], | 70.00th=[ 2376], 80.00th=[ 2769], 90.00th=[ 3523], 95.00th=[ 4424], | 99.00th=[10290], 99.50th=[28443], 99.90th=[30016], 99.95th=[30016], | 99.99th=[30016] bw ( KiB/s): min= 976, max= 1448, per=23.34%, avg=1212.00, stdev=333.75, samples=2 iops : min= 244, max= 362, avg=303.00, stdev=83.44, samples=2 write: IOPS=347, BW=1390KiB/s (1424kB/s)(1592KiB/1145msec) clat (usec): min=90, max=7756, avg=1208.59, stdev=1311.88 lat (usec): min=91, max=7757, avg=1209.44, stdev=1311.76 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 110], 10.00th=[ 135], 20.00th=[ 172], | 30.00th=[ 206], 40.00th=[ 465], 50.00th=[ 857], 60.00th=[ 1037], | 70.00th=[ 1500], 80.00th=[ 2147], 90.00th=[ 2769], 95.00th=[ 3884], | 99.00th=[ 6849], 99.50th=[ 7504], 99.90th=[ 7767], 99.95th=[ 7767], | 99.99th=[ 7767] bw ( KiB/s): min= 920, max= 1776, per=24.67%, avg=1348.00, stdev=605.28, samples=2 iops : min= 230, max= 444, avg=337.00, stdev=151.32, samples=2 lat (usec) : 4=0.78%, 10=7.68%, 20=7.55%, 50=0.91%, 100=1.69% lat (usec) : 250=16.93%, 500=4.04%, 750=2.21%, 1000=8.59% lat (msec) : 2=17.97%, 4=26.30%, 10=4.82%, 20=0.26%, 50=0.26% cpu : usr=1.14%, sys=18.27%, ctx=1047, majf=0, minf=35 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=16749: Tue Jan 7 11:42:13 2025 read: IOPS=341, BW=1365KiB/s (1398kB/s)(1436KiB/1052msec) clat (usec): min=3, max=16170, avg=1558.06, stdev=1779.33 lat (usec): min=4, max=16170, avg=1558.99, stdev=1779.04 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 865], 50.00th=[ 1467], 60.00th=[ 1860], | 70.00th=[ 2180], 80.00th=[ 2769], 90.00th=[ 3359], 95.00th=[ 4424], | 99.00th=[ 7635], 99.50th=[10683], 99.90th=[16188], 99.95th=[16188], | 99.99th=[16188] bw ( KiB/s): min= 952, max= 1696, per=25.50%, avg=1324.00, stdev=526.09, samples=2 iops : min= 238, max= 424, avg=331.00, stdev=131.52, samples=2 write: IOPS=388, BW=1555KiB/s (1592kB/s)(1636KiB/1052msec) clat (usec): min=90, max=14445, avg=1181.24, stdev=1451.68 lat (usec): min=91, max=14446, avg=1182.17, stdev=1451.82 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 110], 10.00th=[ 120], 20.00th=[ 157], | 30.00th=[ 188], 40.00th=[ 338], 50.00th=[ 865], 60.00th=[ 1106], | 70.00th=[ 1385], 80.00th=[ 2040], 90.00th=[ 2835], 95.00th=[ 3294], | 99.00th=[ 6325], 99.50th=[ 7308], 99.90th=[14484], 99.95th=[14484], | 99.99th=[14484] bw ( KiB/s): min= 1176, max= 1784, per=27.09%, avg=1480.00, stdev=429.92, samples=2 iops : min= 294, max= 446, avg=370.00, stdev=107.48, samples=2 lat (usec) : 4=0.13%, 10=8.07%, 20=8.85%, 50=0.39%, 100=1.17% lat (usec) : 250=18.88%, 500=2.99%, 750=2.60%, 1000=5.86% lat (msec) : 2=23.44%, 4=23.31%, 10=3.78%, 20=0.52% cpu : usr=0.29%, sys=18.65%, ctx=974, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=16750: Tue Jan 7 11:42:13 2025 read: IOPS=339, BW=1356KiB/s (1389kB/s)(1564KiB/1153msec) clat (usec): min=3, max=23385, avg=1768.76, stdev=2216.80 lat (usec): min=3, max=23386, avg=1769.60, stdev=2216.75 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 1205], 50.00th=[ 1631], 60.00th=[ 2040], | 70.00th=[ 2442], 80.00th=[ 2900], 90.00th=[ 3556], 95.00th=[ 4146], | 99.00th=[ 8356], 99.50th=[20841], 99.90th=[23462], 99.95th=[23462], | 99.99th=[23462] bw ( KiB/s): min= 944, max= 1528, per=23.80%, avg=1236.00, stdev=412.95, samples=2 iops : min= 236, max= 382, avg=309.00, stdev=103.24, samples=2 write: IOPS=326, BW=1308KiB/s (1339kB/s)(1508KiB/1153msec) clat (usec): min=95, max=14385, avg=1204.45, stdev=1450.68 lat (usec): min=95, max=14386, avg=1205.20, stdev=1450.73 clat percentiles (usec): | 1.00th=[ 99], 5.00th=[ 114], 10.00th=[ 126], 20.00th=[ 165], | 30.00th=[ 206], 40.00th=[ 474], 50.00th=[ 906], 60.00th=[ 1074], | 70.00th=[ 1401], 80.00th=[ 1942], 90.00th=[ 2868], 95.00th=[ 3490], | 99.00th=[ 5407], 99.50th=[11469], 99.90th=[14353], 99.95th=[14353], | 99.99th=[14353] bw ( KiB/s): min= 992, max= 1456, per=22.40%, avg=1224.00, stdev=328.10, samples=2 iops : min= 248, max= 364, avg=306.00, stdev=82.02, samples=2 lat (usec) : 4=0.39%, 10=8.59%, 20=8.07%, 50=0.13%, 100=0.65% lat (usec) : 250=16.15%, 500=3.65%, 750=2.34%, 1000=6.90% lat (msec) : 2=23.18%, 4=25.13%, 10=4.17%, 20=0.39%, 50=0.26% cpu : usr=0.61%, sys=17.62%, ctx=1013, majf=0, minf=33 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=16751: Tue Jan 7 11:42:13 2025 read: IOPS=343, BW=1375KiB/s (1408kB/s)(1508KiB/1097msec) clat (usec): min=3, max=15422, avg=1744.32, stdev=1933.91 lat (usec): min=3, max=15422, avg=1745.51, stdev=1934.21 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 16], 40.00th=[ 1205], 50.00th=[ 1713], 60.00th=[ 2008], | 70.00th=[ 2376], 80.00th=[ 2802], 90.00th=[ 3425], 95.00th=[ 4424], | 99.00th=[ 8717], 99.50th=[13829], 99.90th=[15401], 99.95th=[15401], | 99.99th=[15401] bw ( KiB/s): min= 1088, max= 1520, per=25.11%, avg=1304.00, stdev=305.47, samples=2 iops : min= 272, max= 380, avg=326.00, stdev=76.37, samples=2 write: IOPS=356, BW=1426KiB/s (1460kB/s)(1564KiB/1097msec) clat (usec): min=85, max=18740, avg=1105.08, stdev=1548.55 lat (usec): min=86, max=18742, avg=1105.98, stdev=1548.46 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 102], 10.00th=[ 113], 20.00th=[ 143], | 30.00th=[ 174], 40.00th=[ 210], 50.00th=[ 725], 60.00th=[ 930], | 70.00th=[ 1139], 80.00th=[ 2008], 90.00th=[ 2802], 95.00th=[ 3752], | 99.00th=[ 6390], 99.50th=[ 7767], 99.90th=[18744], 99.95th=[18744], | 99.99th=[18744] bw ( KiB/s): min= 1056, max= 1664, per=24.89%, avg=1360.00, stdev=429.92, samples=2 iops : min= 264, max= 416, avg=340.00, stdev=107.48, samples=2 lat (usec) : 4=0.26%, 10=8.33%, 20=7.03%, 50=0.26%, 100=2.34% lat (usec) : 250=19.92%, 500=3.12%, 750=1.95%, 1000=8.33% lat (msec) : 2=18.62%, 4=24.35%, 10=4.95%, 20=0.52% cpu : usr=0.36%, sys=16.15%, ctx=951, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5193KiB/s (5318kB/s), 1293KiB/s-1375KiB/s (1324kB/s-1408kB/s), io=5988KiB (6132kB), run=1052-1153msec WRITE: bw=5464KiB/s (5595kB/s), 1308KiB/s-1555KiB/s (1339kB/s-1592kB/s), io=6300KiB (6451kB), run=1052-1153msec rand-rw: (groupid=0, jobs=1): err= 0: pid=16744: Tue Jan 7 11:42:14 2025 read: IOPS=211, BW=847KiB/s (867kB/s)(1480KiB/1747msec) clat (usec): min=587, max=31938, avg=1648.50, stdev=2306.02 lat (usec): min=588, max=31939, avg=1649.31, stdev=2306.02 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 709], 10.00th=[ 742], 20.00th=[ 783], | 30.00th=[ 832], 40.00th=[ 881], 50.00th=[ 938], 60.00th=[ 1012], | 70.00th=[ 1172], 80.00th=[ 1778], 90.00th=[ 3752], 95.00th=[ 4883], | 99.00th=[12911], 99.50th=[14484], 99.90th=[31851], 99.95th=[31851], | 99.99th=[31851] bw ( KiB/s): min= 544, max= 998, per=22.31%, avg=764.67, stdev=227.26, samples=3 iops : min= 136, max= 249, avg=191.00, stdev=56.56, samples=3 write: IOPS=227, BW=911KiB/s (933kB/s)(1592KiB/1747msec) clat (usec): min=1181, max=14670, avg=2835.37, stdev=1549.76 lat (usec): min=1182, max=14670, avg=2836.52, stdev=1549.74 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 1565], 20.00th=[ 1827], | 30.00th=[ 1958], 40.00th=[ 2057], 50.00th=[ 2245], 60.00th=[ 2540], | 70.00th=[ 3064], 80.00th=[ 3720], 90.00th=[ 4883], 95.00th=[ 5735], | 99.00th=[ 8586], 99.50th=[10945], 99.90th=[14615], 99.95th=[14615], | 99.99th=[14615] bw ( KiB/s): min= 584, max= 1181, per=22.97%, avg=828.33, stdev=312.90, samples=3 iops : min= 146, max= 295, avg=207.00, stdev=78.08, samples=3 lat (usec) : 750=5.99%, 1000=22.53% lat (msec) : 2=29.69%, 4=28.52%, 10=12.50%, 20=0.65%, 50=0.13% cpu : usr=0.46%, sys=5.73%, ctx=817, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=16745: Tue Jan 7 11:42:14 2025 read: IOPS=210, BW=843KiB/s (863kB/s)(1436KiB/1703msec) clat (usec): min=613, max=10725, avg=1582.82, stdev=1441.52 lat (usec): min=614, max=10726, avg=1583.48, stdev=1441.54 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 685], 10.00th=[ 717], 20.00th=[ 775], | 30.00th=[ 832], 40.00th=[ 889], 50.00th=[ 955], 60.00th=[ 1090], | 70.00th=[ 1434], 80.00th=[ 1942], 90.00th=[ 3654], 95.00th=[ 4817], | 99.00th=[ 6849], 99.50th=[10159], 99.90th=[10683], 99.95th=[10683], | 99.99th=[10683] bw ( KiB/s): min= 600, max= 1173, per=23.24%, avg=796.33, stdev=326.30, samples=3 iops : min= 150, max= 293, avg=199.00, stdev=81.43, samples=3 write: IOPS=240, BW=961KiB/s (984kB/s)(1636KiB/1703msec) clat (usec): min=1172, max=13043, avg=2744.88, stdev=1477.74 lat (usec): min=1173, max=13044, avg=2745.70, stdev=1477.75 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 1631], 20.00th=[ 1876], | 30.00th=[ 2024], 40.00th=[ 2114], 50.00th=[ 2245], 60.00th=[ 2442], | 70.00th=[ 2769], 80.00th=[ 3392], 90.00th=[ 4490], 95.00th=[ 5538], | 99.00th=[ 8455], 99.50th=[10028], 99.90th=[13042], 99.95th=[13042], | 99.99th=[13042] bw ( KiB/s): min= 656, max= 1189, per=24.89%, avg=897.67, stdev=269.95, samples=3 iops : min= 164, max= 297, avg=224.33, stdev=67.35, samples=3 lat (usec) : 750=7.29%, 1000=18.49% lat (msec) : 2=27.08%, 4=36.33%, 10=10.16%, 20=0.65% cpu : usr=0.53%, sys=5.70%, ctx=819, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=16746: Tue Jan 7 11:42:14 2025 read: IOPS=227, BW=911KiB/s (933kB/s)(1564KiB/1716msec) clat (usec): min=559, max=9155, avg=1532.67, stdev=1305.90 lat (usec): min=559, max=9156, avg=1533.72, stdev=1305.77 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 693], 10.00th=[ 734], 20.00th=[ 807], | 30.00th=[ 857], 40.00th=[ 914], 50.00th=[ 979], 60.00th=[ 1074], | 70.00th=[ 1254], 80.00th=[ 1893], 90.00th=[ 3523], 95.00th=[ 4490], | 99.00th=[ 6325], 99.50th=[ 8291], 99.90th=[ 9110], 99.95th=[ 9110], | 99.99th=[ 9110] bw ( KiB/s): min= 550, max= 1192, per=24.10%, avg=826.00, stdev=330.33, samples=3 iops : min= 137, max= 298, avg=206.33, stdev=82.79, samples=3 write: IOPS=219, BW=879KiB/s (900kB/s)(1508KiB/1716msec) clat (usec): min=1063, max=16362, avg=2930.69, stdev=1697.40 lat (usec): min=1064, max=16363, avg=2934.43, stdev=1702.09 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1483], 10.00th=[ 1680], 20.00th=[ 1893], | 30.00th=[ 2024], 40.00th=[ 2114], 50.00th=[ 2311], 60.00th=[ 2573], | 70.00th=[ 3195], 80.00th=[ 3720], 90.00th=[ 4948], 95.00th=[ 6325], | 99.00th=[ 9372], 99.50th=[12387], 99.90th=[16319], 99.95th=[16319], | 99.99th=[16319] bw ( KiB/s): min= 646, max= 1168, per=22.76%, avg=820.67, stdev=300.80, samples=3 iops : min= 161, max= 292, avg=205.00, stdev=75.35, samples=3 lat (usec) : 750=6.12%, 1000=20.83% lat (msec) : 2=28.52%, 4=32.94%, 10=11.20%, 20=0.39% cpu : usr=0.35%, sys=6.01%, ctx=820, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=16747: Tue Jan 7 11:42:14 2025 read: IOPS=218, BW=876KiB/s (897kB/s)(1508KiB/1722msec) clat (usec): min=592, max=22108, avg=1639.35, stdev=1744.41 lat (usec): min=593, max=22108, avg=1640.08, stdev=1744.38 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 693], 10.00th=[ 750], 20.00th=[ 816], | 30.00th=[ 873], 40.00th=[ 922], 50.00th=[ 1004], 60.00th=[ 1139], | 70.00th=[ 1418], 80.00th=[ 1958], 90.00th=[ 3490], 95.00th=[ 4817], | 99.00th=[ 8029], 99.50th=[ 9634], 99.90th=[22152], 99.95th=[22152], | 99.99th=[22152] bw ( KiB/s): min= 576, max= 1024, per=23.11%, avg=792.00, stdev=224.43, samples=3 iops : min= 144, max= 256, avg=198.00, stdev=56.11, samples=3 write: IOPS=227, BW=908KiB/s (930kB/s)(1564KiB/1722msec) clat (usec): min=1202, max=19334, avg=2795.91, stdev=1612.86 lat (usec): min=1203, max=19336, avg=2796.68, stdev=1612.89 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1467], 10.00th=[ 1713], 20.00th=[ 1893], | 30.00th=[ 1991], 40.00th=[ 2114], 50.00th=[ 2212], 60.00th=[ 2442], | 70.00th=[ 2868], 80.00th=[ 3523], 90.00th=[ 4490], 95.00th=[ 5997], | 99.00th=[ 7963], 99.50th=[10552], 99.90th=[19268], 99.95th=[19268], | 99.99th=[19268] bw ( KiB/s): min= 608, max= 1232, per=23.59%, avg=850.67, stdev=334.31, samples=3 iops : min= 152, max= 308, avg=212.67, stdev=83.58, samples=3 lat (usec) : 750=5.34%, 1000=19.01% lat (msec) : 2=30.99%, 4=33.59%, 10=10.68%, 20=0.26%, 50=0.13% cpu : usr=0.35%, sys=5.81%, ctx=811, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3428KiB/s (3510kB/s), 843KiB/s-911KiB/s (863kB/s-933kB/s), io=5988KiB (6132kB), run=1703-1747msec WRITE: bw=3606KiB/s (3693kB/s), 879KiB/s-961KiB/s (900kB/s-984kB/s), io=6300KiB (6451kB), run=1703-1747msec