== sanity test 398b: DIO and buffer IO race ============== 11:10:33 (1736266233) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB) copied, 0.0625105 s, 201 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=17660: Tue Jan 7 11:10:35 2025 read: IOPS=331, BW=1326KiB/s (1358kB/s)(1480KiB/1116msec) clat (usec): min=4, max=22579, avg=1842.99, stdev=2361.41 lat (usec): min=4, max=22579, avg=1844.62, stdev=2361.81 clat percentiles (usec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 979], 50.00th=[ 1647], 60.00th=[ 2008], | 70.00th=[ 2442], 80.00th=[ 2900], 90.00th=[ 3785], 95.00th=[ 5735], | 99.00th=[11076], 99.50th=[16450], 99.90th=[22676], 99.95th=[22676], | 99.99th=[22676] bw ( KiB/s): min= 920, max= 1664, per=24.08%, avg=1292.00, stdev=526.09, samples=2 iops : min= 230, max= 416, avg=323.00, stdev=131.52, samples=2 write: IOPS=356, BW=1427KiB/s (1461kB/s)(1592KiB/1116msec) clat (usec): min=90, max=7438, avg=1072.05, stdev=1297.98 lat (usec): min=91, max=7439, avg=1073.42, stdev=1297.98 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 110], 10.00th=[ 118], 20.00th=[ 147], | 30.00th=[ 176], 40.00th=[ 241], 50.00th=[ 611], 60.00th=[ 898], | 70.00th=[ 1237], 80.00th=[ 1876], 90.00th=[ 2802], 95.00th=[ 3589], | 99.00th=[ 6521], 99.50th=[ 7046], 99.90th=[ 7439], 99.95th=[ 7439], | 99.99th=[ 7439] bw ( KiB/s): min= 912, max= 1896, per=24.87%, avg=1404.00, stdev=695.79, samples=2 iops : min= 228, max= 474, avg=351.00, stdev=173.95, samples=2 lat (usec) : 10=8.72%, 20=8.07%, 50=0.52%, 100=1.04%, 250=20.70% lat (usec) : 500=4.04%, 750=2.34%, 1000=6.51% lat (msec) : 2=19.14%, 4=22.66%, 10=5.60%, 20=0.52%, 50=0.13% cpu : usr=0.36%, sys=16.68%, ctx=1053, majf=0, minf=33 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17661: Tue Jan 7 11:10:35 2025 read: IOPS=325, BW=1301KiB/s (1332kB/s)(1436KiB/1104msec) clat (usec): min=3, max=31560, avg=1663.28, stdev=2379.05 lat (usec): min=3, max=31560, avg=1663.86, stdev=2379.07 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 947], 50.00th=[ 1500], 60.00th=[ 1909], | 70.00th=[ 2278], 80.00th=[ 2671], 90.00th=[ 3392], 95.00th=[ 4424], | 99.00th=[ 8029], 99.50th=[15926], 99.90th=[31589], 99.95th=[31589], | 99.99th=[31589] bw ( KiB/s): min= 936, max= 1600, per=23.63%, avg=1268.00, stdev=469.52, samples=2 iops : min= 234, max= 400, avg=317.00, stdev=117.38, samples=2 write: IOPS=370, BW=1482KiB/s (1517kB/s)(1636KiB/1104msec) clat (usec): min=89, max=10619, avg=1224.05, stdev=1557.45 lat (usec): min=89, max=10619, avg=1224.72, stdev=1557.47 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 108], 10.00th=[ 118], 20.00th=[ 151], | 30.00th=[ 178], 40.00th=[ 243], 50.00th=[ 807], 60.00th=[ 988], | 70.00th=[ 1303], 80.00th=[ 2024], 90.00th=[ 3163], 95.00th=[ 4293], | 99.00th=[ 7308], 99.50th=[ 7504], 99.90th=[10683], 99.95th=[10683], | 99.99th=[10683] bw ( KiB/s): min= 1144, max= 1712, per=25.30%, avg=1428.00, stdev=401.64, samples=2 iops : min= 286, max= 428, avg=357.00, stdev=100.41, samples=2 lat (usec) : 4=0.39%, 10=8.07%, 20=7.03%, 50=0.78%, 100=1.82% lat (usec) : 250=20.57%, 500=2.73%, 750=1.56%, 1000=8.33% lat (msec) : 2=20.31%, 4=21.87%, 10=5.86%, 20=0.52%, 50=0.13% cpu : usr=0.18%, sys=17.95%, ctx=951, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17662: Tue Jan 7 11:10:35 2025 read: IOPS=369, BW=1477KiB/s (1512kB/s)(1564KiB/1059msec) clat (usec): min=3, max=17259, avg=1564.34, stdev=2023.01 lat (usec): min=3, max=17259, avg=1564.89, stdev=2023.03 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 13], 40.00th=[ 71], 50.00th=[ 1303], 60.00th=[ 1762], | 70.00th=[ 2147], 80.00th=[ 2638], 90.00th=[ 3294], 95.00th=[ 4490], | 99.00th=[ 9896], 99.50th=[13698], 99.90th=[17171], 99.95th=[17171], | 99.99th=[17171] bw ( KiB/s): min= 1192, max= 1704, per=26.99%, avg=1448.00, stdev=362.04, samples=2 iops : min= 298, max= 426, avg=362.00, stdev=90.51, samples=2 write: IOPS=355, BW=1424KiB/s (1458kB/s)(1508KiB/1059msec) clat (usec): min=90, max=17138, avg=1166.55, stdev=1543.96 lat (usec): min=91, max=17139, avg=1167.23, stdev=1544.00 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 111], 10.00th=[ 118], 20.00th=[ 149], | 30.00th=[ 176], 40.00th=[ 243], 50.00th=[ 775], 60.00th=[ 988], | 70.00th=[ 1287], 80.00th=[ 2114], 90.00th=[ 2835], 95.00th=[ 3752], | 99.00th=[ 6718], 99.50th=[ 6915], 99.90th=[17171], 99.95th=[17171], | 99.99th=[17171] bw ( KiB/s): min= 1144, max= 1576, per=24.09%, avg=1360.00, stdev=305.47, samples=2 iops : min= 286, max= 394, avg=340.00, stdev=76.37, samples=2 lat (usec) : 4=0.65%, 10=10.94%, 20=7.94%, 50=0.78%, 100=1.04% lat (usec) : 250=19.53%, 500=2.99%, 750=1.56%, 1000=7.55% lat (msec) : 2=19.66%, 4=22.14%, 10=4.69%, 20=0.52% cpu : usr=0.38%, sys=16.82%, ctx=891, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17663: Tue Jan 7 11:10:35 2025 read: IOPS=342, BW=1371KiB/s (1404kB/s)(1508KiB/1100msec) clat (usec): min=3, max=28513, avg=1578.93, stdev=2212.09 lat (usec): min=3, max=28514, avg=1579.62, stdev=2211.99 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 37], 50.00th=[ 1336], 60.00th=[ 1926], | 70.00th=[ 2311], 80.00th=[ 2704], 90.00th=[ 3326], 95.00th=[ 4178], | 99.00th=[10421], 99.50th=[12387], 99.90th=[28443], 99.95th=[28443], | 99.99th=[28443] bw ( KiB/s): min= 1072, max= 1568, per=24.60%, avg=1320.00, stdev=350.72, samples=2 iops : min= 268, max= 392, avg=330.00, stdev=87.68, samples=2 write: IOPS=355, BW=1422KiB/s (1456kB/s)(1564KiB/1100msec) clat (usec): min=92, max=16984, avg=1270.39, stdev=1718.50 lat (usec): min=93, max=16984, avg=1271.32, stdev=1718.49 clat percentiles (usec): | 1.00th=[ 96], 5.00th=[ 109], 10.00th=[ 120], 20.00th=[ 151], | 30.00th=[ 178], 40.00th=[ 334], 50.00th=[ 857], 60.00th=[ 1045], | 70.00th=[ 1319], 80.00th=[ 2008], 90.00th=[ 3195], 95.00th=[ 4293], | 99.00th=[ 7898], 99.50th=[11600], 99.90th=[16909], 99.95th=[16909], | 99.99th=[16909] bw ( KiB/s): min= 1056, max= 1704, per=24.45%, avg=1380.00, stdev=458.21, samples=2 iops : min= 264, max= 426, avg=345.00, stdev=114.55, samples=2 lat (usec) : 4=0.26%, 10=8.46%, 20=10.29%, 50=0.65%, 100=1.17% lat (usec) : 250=17.84%, 500=3.39%, 750=2.08%, 1000=7.68% lat (msec) : 2=19.14%, 4=23.31%, 10=4.82%, 20=0.78%, 50=0.13% cpu : usr=0.00%, sys=18.29%, ctx=1001, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5366KiB/s (5494kB/s), 1301KiB/s-1477KiB/s (1332kB/s-1512kB/s), io=5988KiB (6132kB), run=1059-1116msec WRITE: bw=5645KiB/s (5781kB/s), 1422KiB/s-1482KiB/s (1456kB/s-1517kB/s), io=6300KiB (6451kB), run=1059-1116msec rand-rw: (groupid=0, jobs=1): err= 0: pid=17656: Tue Jan 7 11:10:36 2025 read: IOPS=213, BW=855KiB/s (876kB/s)(1480KiB/1731msec) clat (usec): min=657, max=13175, avg=1630.92, stdev=1604.38 lat (usec): min=658, max=13177, avg=1631.68, stdev=1604.39 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 734], 10.00th=[ 783], 20.00th=[ 848], | 30.00th=[ 898], 40.00th=[ 955], 50.00th=[ 1012], 60.00th=[ 1106], | 70.00th=[ 1434], 80.00th=[ 2008], 90.00th=[ 3392], 95.00th=[ 4293], | 99.00th=[ 9503], 99.50th=[12518], 99.90th=[13173], 99.95th=[13173], | 99.99th=[13173] bw ( KiB/s): min= 616, max= 1064, per=23.44%, avg=794.67, stdev=237.36, samples=3 iops : min= 154, max= 266, avg=198.67, stdev=59.34, samples=3 write: IOPS=229, BW=920KiB/s (942kB/s)(1592KiB/1731msec) clat (usec): min=1290, max=9679, avg=2803.16, stdev=1373.61 lat (usec): min=1291, max=9679, avg=2804.11, stdev=1373.55 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1500], 10.00th=[ 1696], 20.00th=[ 1926], | 30.00th=[ 2040], 40.00th=[ 2147], 50.00th=[ 2245], 60.00th=[ 2442], | 70.00th=[ 2868], 80.00th=[ 3523], 90.00th=[ 4883], 95.00th=[ 5800], | 99.00th=[ 7701], 99.50th=[ 8455], 99.90th=[ 9634], 99.95th=[ 9634], | 99.99th=[ 9634] bw ( KiB/s): min= 616, max= 1224, per=24.22%, avg=864.00, stdev=319.10, samples=3 iops : min= 154, max= 306, avg=216.00, stdev=79.77, samples=3 lat (usec) : 750=2.99%, 1000=20.44% lat (msec) : 2=28.52%, 4=36.20%, 10=11.46%, 20=0.39% cpu : usr=0.46%, sys=5.84%, ctx=815, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17657: Tue Jan 7 11:10:36 2025 read: IOPS=206, BW=825KiB/s (845kB/s)(1436KiB/1741msec) clat (usec): min=660, max=13980, avg=1524.56, stdev=1397.59 lat (usec): min=660, max=13981, avg=1525.22, stdev=1397.62 clat percentiles (usec): | 1.00th=[ 676], 5.00th=[ 734], 10.00th=[ 775], 20.00th=[ 832], | 30.00th=[ 873], 40.00th=[ 922], 50.00th=[ 996], 60.00th=[ 1090], | 70.00th=[ 1319], 80.00th=[ 1762], 90.00th=[ 3359], 95.00th=[ 4228], | 99.00th=[ 6128], 99.50th=[11469], 99.90th=[13960], 99.95th=[13960], | 99.99th=[13960] bw ( KiB/s): min= 582, max= 1192, per=23.19%, avg=786.00, stdev=351.61, samples=3 iops : min= 145, max= 298, avg=196.33, stdev=88.05, samples=3 write: IOPS=234, BW=940KiB/s (962kB/s)(1636KiB/1741msec) clat (usec): min=1214, max=17645, avg=2892.56, stdev=1604.23 lat (usec): min=1215, max=17646, avg=2893.38, stdev=1604.22 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 1532], 10.00th=[ 1729], 20.00th=[ 1926], | 30.00th=[ 2040], 40.00th=[ 2147], 50.00th=[ 2278], 60.00th=[ 2540], | 70.00th=[ 3064], 80.00th=[ 3621], 90.00th=[ 4948], 95.00th=[ 5866], | 99.00th=[ 7570], 99.50th=[ 9634], 99.90th=[17695], 99.95th=[17695], | 99.99th=[17695] bw ( KiB/s): min= 638, max= 1112, per=23.98%, avg=855.33, stdev=239.44, samples=3 iops : min= 159, max= 278, avg=213.67, stdev=60.09, samples=3 lat (usec) : 750=2.99%, 1000=20.57% lat (msec) : 2=28.65%, 4=36.07%, 10=11.20%, 20=0.52% cpu : usr=0.23%, sys=5.92%, ctx=831, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17658: Tue Jan 7 11:10:36 2025 read: IOPS=226, BW=906KiB/s (927kB/s)(1564KiB/1727msec) clat (usec): min=642, max=13947, avg=1628.59, stdev=1585.91 lat (usec): min=643, max=13948, avg=1629.26, stdev=1585.90 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 742], 10.00th=[ 783], 20.00th=[ 848], | 30.00th=[ 898], 40.00th=[ 955], 50.00th=[ 996], 60.00th=[ 1106], | 70.00th=[ 1418], 80.00th=[ 2008], 90.00th=[ 3326], 95.00th=[ 4490], | 99.00th=[ 8455], 99.50th=[12387], 99.90th=[13960], 99.95th=[13960], | 99.99th=[13960] bw ( KiB/s): min= 504, max= 1157, per=24.12%, avg=817.67, stdev=327.26, samples=3 iops : min= 126, max= 289, avg=204.33, stdev=81.68, samples=3 write: IOPS=218, BW=873KiB/s (894kB/s)(1508KiB/1727msec) clat (usec): min=1254, max=19938, avg=2869.31, stdev=1655.11 lat (usec): min=1255, max=19940, avg=2870.11, stdev=1655.15 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1483], 10.00th=[ 1647], 20.00th=[ 1926], | 30.00th=[ 2040], 40.00th=[ 2114], 50.00th=[ 2278], 60.00th=[ 2474], | 70.00th=[ 3064], 80.00th=[ 3589], 90.00th=[ 4817], 95.00th=[ 5997], | 99.00th=[ 7570], 99.50th=[ 9503], 99.90th=[20055], 99.95th=[20055], | 99.99th=[20055] bw ( KiB/s): min= 640, max= 1141, per=22.85%, avg=815.00, stdev=282.58, samples=3 iops : min= 160, max= 285, avg=203.67, stdev=70.50, samples=3 lat (usec) : 750=3.12%, 1000=22.79% lat (msec) : 2=28.39%, 4=34.37%, 10=10.94%, 20=0.39% cpu : usr=0.35%, sys=5.97%, ctx=841, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17659: Tue Jan 7 11:10:36 2025 read: IOPS=213, BW=854KiB/s (874kB/s)(1508KiB/1766msec) clat (usec): min=615, max=17729, avg=1649.55, stdev=1660.20 lat (usec): min=615, max=17730, avg=1650.21, stdev=1660.19 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 725], 10.00th=[ 766], 20.00th=[ 840], | 30.00th=[ 898], 40.00th=[ 947], 50.00th=[ 1037], 60.00th=[ 1156], | 70.00th=[ 1500], 80.00th=[ 2008], 90.00th=[ 3687], 95.00th=[ 4490], | 99.00th=[ 7635], 99.50th=[13304], 99.90th=[17695], 99.95th=[17695], | 99.99th=[17695] bw ( KiB/s): min= 536, max= 1008, per=22.42%, avg=760.00, stdev=236.91, samples=3 iops : min= 134, max= 252, avg=190.00, stdev=59.23, samples=3 write: IOPS=221, BW=886KiB/s (907kB/s)(1564KiB/1766msec) clat (usec): min=1294, max=22184, avg=2890.06, stdev=1725.07 lat (usec): min=1295, max=22185, avg=2890.96, stdev=1725.12 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1450], 10.00th=[ 1647], 20.00th=[ 1942], | 30.00th=[ 2057], 40.00th=[ 2147], 50.00th=[ 2278], 60.00th=[ 2540], | 70.00th=[ 2966], 80.00th=[ 3556], 90.00th=[ 4883], 95.00th=[ 6063], | 99.00th=[ 7701], 99.50th=[12256], 99.90th=[22152], 99.95th=[22152], | 99.99th=[22152] bw ( KiB/s): min= 600, max= 1184, per=23.03%, avg=821.33, stdev=316.62, samples=3 iops : min= 150, max= 296, avg=205.33, stdev=79.15, samples=3 lat (usec) : 750=3.65%, 1000=19.40% lat (msec) : 2=28.12%, 4=36.98%, 10=11.20%, 20=0.52%, 50=0.13% cpu : usr=0.68%, sys=5.78%, ctx=850, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3391KiB/s (3472kB/s), 825KiB/s-906KiB/s (845kB/s-927kB/s), io=5988KiB (6132kB), run=1727-1766msec WRITE: bw=3567KiB/s (3653kB/s), 873KiB/s-940KiB/s (894kB/s-962kB/s), io=6300KiB (6451kB), run=1727-1766msec