== sanity test 398b: DIO and buffer IO race ============== 18:43:16 (1748990596) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB) copied, 0.0964213 s, 130 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=29937: Tue Jun 3 18:43:19 2025 read: IOPS=353, BW=1412KiB/s (1446kB/s)(1480KiB/1048msec) clat (usec): min=3, max=29159, avg=1732.15, stdev=3113.53 lat (usec): min=3, max=29160, avg=1733.25, stdev=3113.51 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 26], 50.00th=[ 1221], 60.00th=[ 1663], | 70.00th=[ 2089], 80.00th=[ 2474], 90.00th=[ 3294], 95.00th=[ 4883], | 99.00th=[20317], 99.50th=[22414], 99.90th=[29230], 99.95th=[29230], | 99.99th=[29230] bw ( KiB/s): min= 800, max= 1816, per=22.90%, avg=1308.00, stdev=718.42, samples=2 iops : min= 200, max= 454, avg=327.00, stdev=179.61, samples=2 write: IOPS=379, BW=1519KiB/s (1556kB/s)(1592KiB/1048msec) clat (usec): min=85, max=10891, avg=989.50, stdev=1274.07 lat (usec): min=85, max=10892, avg=990.17, stdev=1274.14 clat percentiles (usec): | 1.00th=[ 93], 5.00th=[ 105], 10.00th=[ 114], 20.00th=[ 135], | 30.00th=[ 163], 40.00th=[ 200], 50.00th=[ 371], 60.00th=[ 799], | 70.00th=[ 1139], 80.00th=[ 1811], 90.00th=[ 2573], 95.00th=[ 3425], | 99.00th=[ 5473], 99.50th=[ 8094], 99.90th=[10945], 99.95th=[10945], | 99.99th=[10945] bw ( KiB/s): min= 856, max= 1992, per=23.69%, avg=1424.00, stdev=803.27, samples=2 iops : min= 214, max= 498, avg=356.00, stdev=200.82, samples=2 lat (usec) : 4=1.17%, 10=12.76%, 20=5.21%, 50=0.39%, 100=2.08% lat (usec) : 250=21.87%, 500=3.91%, 750=2.99%, 1000=5.86% lat (msec) : 2=19.92%, 4=18.75%, 10=4.04%, 20=0.52%, 50=0.52% cpu : usr=0.67%, sys=19.01%, ctx=925, majf=0, minf=35 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=29939: Tue Jun 3 18:43:19 2025 read: IOPS=349, BW=1397KiB/s (1430kB/s)(1436KiB/1028msec) clat (usec): min=3, max=48664, avg=1526.64, stdev=3247.71 lat (usec): min=3, max=48665, avg=1527.25, stdev=3247.76 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 19], 50.00th=[ 1172], 60.00th=[ 1516], | 70.00th=[ 1926], 80.00th=[ 2442], 90.00th=[ 3097], 95.00th=[ 4146], | 99.00th=[ 8586], 99.50th=[23987], 99.90th=[48497], 99.95th=[48497], | 99.99th=[48497] bw ( KiB/s): min= 840, max= 1920, per=24.16%, avg=1380.00, stdev=763.68, samples=2 iops : min= 210, max= 480, avg=345.00, stdev=190.92, samples=2 write: IOPS=397, BW=1591KiB/s (1630kB/s)(1636KiB/1028msec) clat (usec): min=94, max=21090, avg=1143.86, stdev=2032.43 lat (usec): min=94, max=21091, avg=1144.77, stdev=2032.52 clat percentiles (usec): | 1.00th=[ 102], 5.00th=[ 112], 10.00th=[ 127], 20.00th=[ 149], | 30.00th=[ 167], 40.00th=[ 198], 50.00th=[ 635], 60.00th=[ 840], | 70.00th=[ 1074], 80.00th=[ 1745], 90.00th=[ 2638], 95.00th=[ 3654], | 99.00th=[11338], 99.50th=[13566], 99.90th=[21103], 99.95th=[21103], | 99.99th=[21103] bw ( KiB/s): min= 936, max= 2176, per=25.89%, avg=1556.00, stdev=876.81, samples=2 iops : min= 234, max= 544, avg=389.00, stdev=219.20, samples=2 lat (usec) : 4=0.52%, 10=10.68%, 20=7.55%, 50=0.52%, 100=0.65% lat (usec) : 250=23.18%, 500=3.52%, 750=2.86%, 1000=8.46% lat (msec) : 2=20.18%, 4=17.32%, 10=3.52%, 20=0.65%, 50=0.39% cpu : usr=0.19%, sys=17.43%, ctx=801, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=29940: Tue Jun 3 18:43:19 2025 read: IOPS=377, BW=1510KiB/s (1546kB/s)(1564KiB/1036msec) clat (usec): min=3, max=23911, avg=1517.89, stdev=2073.59 lat (usec): min=3, max=23911, avg=1518.45, stdev=2073.65 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 139], 50.00th=[ 1369], 60.00th=[ 1762], | 70.00th=[ 2089], 80.00th=[ 2507], 90.00th=[ 3228], 95.00th=[ 4178], | 99.00th=[ 8848], 99.50th=[16581], 99.90th=[23987], 99.95th=[23987], | 99.99th=[23987] bw ( KiB/s): min= 936, max= 1972, per=25.45%, avg=1454.00, stdev=732.56, samples=2 iops : min= 234, max= 493, avg=363.50, stdev=183.14, samples=2 write: IOPS=363, BW=1456KiB/s (1491kB/s)(1508KiB/1036msec) clat (usec): min=95, max=17848, avg=1142.22, stdev=1655.76 lat (usec): min=95, max=17849, avg=1143.00, stdev=1655.78 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 111], 10.00th=[ 121], 20.00th=[ 143], | 30.00th=[ 174], 40.00th=[ 231], 50.00th=[ 660], 60.00th=[ 914], | 70.00th=[ 1270], 80.00th=[ 1893], 90.00th=[ 2835], 95.00th=[ 3982], | 99.00th=[ 7439], 99.50th=[11469], 99.90th=[17957], 99.95th=[17957], | 99.99th=[17957] bw ( KiB/s): min= 992, max= 1756, per=22.86%, avg=1374.00, stdev=540.23, samples=2 iops : min= 248, max= 439, avg=343.50, stdev=135.06, samples=2 lat (usec) : 4=0.52%, 10=12.37%, 20=5.86%, 50=0.52%, 100=1.30% lat (usec) : 250=20.18%, 500=3.39%, 750=2.86%, 1000=7.94% lat (msec) : 2=19.40%, 4=20.44%, 10=4.69%, 20=0.39%, 50=0.13% cpu : usr=0.48%, sys=16.23%, ctx=877, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=29941: Tue Jun 3 18:43:19 2025 read: IOPS=363, BW=1454KiB/s (1489kB/s)(1508KiB/1037msec) clat (usec): min=3, max=24480, avg=1537.47, stdev=2101.82 lat (usec): min=3, max=24481, avg=1538.06, stdev=2101.85 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 247], 50.00th=[ 1352], 60.00th=[ 1713], | 70.00th=[ 2147], 80.00th=[ 2540], 90.00th=[ 3523], 95.00th=[ 4228], | 99.00th=[ 7963], 99.50th=[15926], 99.90th=[24511], 99.95th=[24511], | 99.99th=[24511] bw ( KiB/s): min= 888, max= 1908, per=24.47%, avg=1398.00, stdev=721.25, samples=2 iops : min= 222, max= 477, avg=349.50, stdev=180.31, samples=2 write: IOPS=377, BW=1508KiB/s (1544kB/s)(1564KiB/1037msec) clat (usec): min=79, max=19905, avg=1146.21, stdev=1729.56 lat (usec): min=79, max=19906, avg=1146.89, stdev=1729.61 clat percentiles (usec): | 1.00th=[ 95], 5.00th=[ 108], 10.00th=[ 121], 20.00th=[ 149], | 30.00th=[ 176], 40.00th=[ 277], 50.00th=[ 783], 60.00th=[ 963], | 70.00th=[ 1287], 80.00th=[ 1827], 90.00th=[ 2507], 95.00th=[ 3523], | 99.00th=[ 9110], 99.50th=[13304], 99.90th=[19792], 99.95th=[19792], | 99.99th=[19792] bw ( KiB/s): min= 912, max= 2035, per=24.51%, avg=1473.50, stdev=794.08, samples=2 iops : min= 228, max= 508, avg=368.00, stdev=197.99, samples=2 lat (usec) : 4=1.04%, 10=12.50%, 20=4.82%, 50=0.52%, 100=1.56% lat (usec) : 250=18.88%, 500=3.26%, 750=2.86%, 1000=7.55% lat (msec) : 2=22.40%, 4=19.92%, 10=3.91%, 20=0.65%, 50=0.13% cpu : usr=0.48%, sys=16.49%, ctx=898, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5714KiB/s (5851kB/s), 1397KiB/s-1510KiB/s (1430kB/s-1546kB/s), io=5988KiB (6132kB), run=1028-1048msec WRITE: bw=6011KiB/s (6156kB/s), 1456KiB/s-1591KiB/s (1491kB/s-1630kB/s), io=6300KiB (6451kB), run=1028-1048msec rand-rw: (groupid=0, jobs=1): err= 0: pid=29934: Tue Jun 3 18:43:19 2025 read: IOPS=228, BW=915KiB/s (937kB/s)(1480KiB/1618msec) clat (usec): min=553, max=37877, avg=1726.54, stdev=2745.46 lat (usec): min=553, max=37878, avg=1727.16, stdev=2745.54 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 652], 10.00th=[ 685], 20.00th=[ 734], | 30.00th=[ 783], 40.00th=[ 832], 50.00th=[ 906], 60.00th=[ 1029], | 70.00th=[ 1303], 80.00th=[ 2008], 90.00th=[ 3687], 95.00th=[ 4883], | 99.00th=[12387], 99.50th=[23200], 99.90th=[38011], 99.95th=[38011], | 99.99th=[38011] bw ( KiB/s): min= 488, max= 1272, per=23.60%, avg=869.33, stdev=392.44, samples=3 iops : min= 122, max= 318, avg=217.33, stdev=98.11, samples=3 write: IOPS=245, BW=984KiB/s (1008kB/s)(1592KiB/1618msec) clat (usec): min=1057, max=17896, avg=2438.45, stdev=1464.62 lat (usec): min=1058, max=17898, avg=2439.36, stdev=1464.66 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1450], 20.00th=[ 1663], | 30.00th=[ 1745], 40.00th=[ 1844], 50.00th=[ 1958], 60.00th=[ 2147], | 70.00th=[ 2474], 80.00th=[ 2966], 90.00th=[ 4047], 95.00th=[ 4948], | 99.00th=[ 8848], 99.50th=[11338], 99.90th=[17957], 99.95th=[17957], | 99.99th=[17957] bw ( KiB/s): min= 504, max= 1464, per=24.42%, avg=946.67, stdev=484.34, samples=3 iops : min= 126, max= 366, avg=236.67, stdev=121.08, samples=3 lat (usec) : 750=11.33%, 1000=16.54% lat (msec) : 2=37.63%, 4=24.87%, 10=8.85%, 20=0.52%, 50=0.26% cpu : usr=0.37%, sys=6.06%, ctx=809, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=29935: Tue Jun 3 18:43:19 2025 read: IOPS=220, BW=884KiB/s (905kB/s)(1436KiB/1625msec) clat (usec): min=554, max=18766, avg=1483.76, stdev=1899.52 lat (usec): min=555, max=18768, avg=1484.35, stdev=1899.56 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 635], 10.00th=[ 676], 20.00th=[ 717], | 30.00th=[ 758], 40.00th=[ 816], 50.00th=[ 865], 60.00th=[ 963], | 70.00th=[ 1123], 80.00th=[ 1729], 90.00th=[ 2868], 95.00th=[ 4228], | 99.00th=[13173], 99.50th=[16319], 99.90th=[18744], 99.95th=[18744], | 99.99th=[18744] bw ( KiB/s): min= 440, max= 1352, per=23.24%, avg=856.00, stdev=461.23, samples=3 iops : min= 110, max= 338, avg=214.00, stdev=115.31, samples=3 write: IOPS=251, BW=1007KiB/s (1031kB/s)(1636KiB/1625msec) clat (usec): min=1134, max=21955, avg=2641.22, stdev=2162.99 lat (usec): min=1135, max=21956, avg=2642.07, stdev=2163.07 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1369], 10.00th=[ 1516], 20.00th=[ 1663], | 30.00th=[ 1745], 40.00th=[ 1860], 50.00th=[ 1958], 60.00th=[ 2147], | 70.00th=[ 2606], 80.00th=[ 3032], 90.00th=[ 4178], 95.00th=[ 5604], | 99.00th=[12256], 99.50th=[14353], 99.90th=[21890], 99.95th=[21890], | 99.99th=[21890] bw ( KiB/s): min= 520, max= 1400, per=24.97%, avg=968.00, stdev=440.22, samples=3 iops : min= 130, max= 350, avg=242.00, stdev=110.05, samples=3 lat (usec) : 750=13.54%, 1000=16.02% lat (msec) : 2=37.50%, 4=24.61%, 10=6.64%, 20=1.43%, 50=0.26% cpu : usr=0.12%, sys=6.16%, ctx=825, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=29936: Tue Jun 3 18:43:19 2025 read: IOPS=242, BW=968KiB/s (992kB/s)(1564KiB/1615msec) clat (usec): min=530, max=21130, avg=1504.68, stdev=1905.75 lat (usec): min=531, max=21131, avg=1505.29, stdev=1905.80 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 644], 10.00th=[ 668], 20.00th=[ 725], | 30.00th=[ 775], 40.00th=[ 840], 50.00th=[ 914], 60.00th=[ 1037], | 70.00th=[ 1303], 80.00th=[ 1795], 90.00th=[ 3032], 95.00th=[ 3982], | 99.00th=[ 9634], 99.50th=[19530], 99.90th=[21103], 99.95th=[21103], | 99.99th=[21103] bw ( KiB/s): min= 464, max= 1448, per=25.19%, avg=928.00, stdev=494.38, samples=3 iops : min= 116, max= 362, avg=232.00, stdev=123.60, samples=3 write: IOPS=233, BW=934KiB/s (956kB/s)(1508KiB/1615msec) clat (usec): min=1069, max=28180, avg=2682.26, stdev=2215.06 lat (usec): min=1069, max=28182, avg=2683.33, stdev=2215.14 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1270], 10.00th=[ 1450], 20.00th=[ 1647], | 30.00th=[ 1729], 40.00th=[ 1844], 50.00th=[ 1975], 60.00th=[ 2180], | 70.00th=[ 2704], 80.00th=[ 3261], 90.00th=[ 4686], 95.00th=[ 5866], | 99.00th=[11338], 99.50th=[19792], 99.90th=[28181], 99.95th=[28181], | 99.99th=[28181] bw ( KiB/s): min= 560, max= 1360, per=23.12%, avg=896.00, stdev=415.08, samples=3 iops : min= 140, max= 340, avg=224.00, stdev=103.77, samples=3 lat (usec) : 750=13.28%, 1000=16.15% lat (msec) : 2=38.67%, 4=22.40%, 10=8.46%, 20=0.78%, 50=0.26% cpu : usr=0.31%, sys=6.13%, ctx=822, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=29938: Tue Jun 3 18:43:19 2025 read: IOPS=232, BW=930KiB/s (952kB/s)(1508KiB/1622msec) clat (usec): min=512, max=35100, avg=1541.76, stdev=2302.06 lat (usec): min=512, max=35101, avg=1542.52, stdev=2302.08 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 635], 10.00th=[ 676], 20.00th=[ 734], | 30.00th=[ 799], 40.00th=[ 840], 50.00th=[ 922], 60.00th=[ 1004], | 70.00th=[ 1205], 80.00th=[ 1713], 90.00th=[ 3064], 95.00th=[ 4359], | 99.00th=[10421], 99.50th=[16581], 99.90th=[34866], 99.95th=[34866], | 99.99th=[34866] bw ( KiB/s): min= 472, max= 1272, per=23.96%, avg=882.67, stdev=400.43, samples=3 iops : min= 118, max= 318, avg=220.67, stdev=100.11, samples=3 write: IOPS=241, BW=964KiB/s (987kB/s)(1564KiB/1622msec) clat (usec): min=1084, max=33693, avg=2616.67, stdev=2349.62 lat (usec): min=1084, max=33695, avg=2617.40, stdev=2349.73 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1287], 10.00th=[ 1450], 20.00th=[ 1680], | 30.00th=[ 1762], 40.00th=[ 1876], 50.00th=[ 1991], 60.00th=[ 2180], | 70.00th=[ 2573], 80.00th=[ 3032], 90.00th=[ 4146], 95.00th=[ 5145], | 99.00th=[14091], 99.50th=[20579], 99.90th=[33817], 99.95th=[33817], | 99.99th=[33817] bw ( KiB/s): min= 512, max= 1416, per=23.94%, avg=928.00, stdev=456.28, samples=3 iops : min= 128, max= 354, avg=232.00, stdev=114.07, samples=3 lat (usec) : 750=11.33%, 1000=17.84% lat (msec) : 2=37.50%, 4=24.87%, 10=7.42%, 20=0.65%, 50=0.39% cpu : usr=0.31%, sys=6.10%, ctx=824, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3685KiB/s (3773kB/s), 884KiB/s-968KiB/s (905kB/s-992kB/s), io=5988KiB (6132kB), run=1615-1625msec WRITE: bw=3877KiB/s (3970kB/s), 934KiB/s-1007KiB/s (956kB/s-1031kB/s), io=6300KiB (6451kB), run=1615-1625msec