== sanity test 398b: DIO and buffer IO race ============== 18:31:29 (1715207489) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB) copied, 0.122447 s, 103 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=15463: Wed May 8 18:31:32 2024 read: IOPS=389, BW=1556KiB/s (1594kB/s)(1480KiB/951msec) clat (usec): min=3, max=59141, avg=1477.57, stdev=3557.55 lat (usec): min=4, max=59142, avg=1478.07, stdev=3557.60 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 21], 50.00th=[ 963], 60.00th=[ 1549], | 70.00th=[ 1909], 80.00th=[ 2343], 90.00th=[ 2868], 95.00th=[ 3556], | 99.00th=[11600], 99.50th=[20579], 99.90th=[58983], 99.95th=[58983], | 99.99th=[58983] bw ( KiB/s): min= 1072, max= 1072, per=17.17%, avg=1072.00, stdev= 0.00, samples=1 iops : min= 268, max= 268, avg=268.00, stdev= 0.00, samples=1 write: IOPS=418, BW=1674KiB/s (1714kB/s)(1592KiB/951msec) clat (usec): min=81, max=7757, avg=996.24, stdev=1214.90 lat (usec): min=81, max=7758, avg=997.47, stdev=1215.12 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 104], 10.00th=[ 111], 20.00th=[ 123], | 30.00th=[ 145], 40.00th=[ 208], 50.00th=[ 660], 60.00th=[ 816], | 70.00th=[ 1188], 80.00th=[ 1696], 90.00th=[ 2442], 95.00th=[ 3458], | 99.00th=[ 5604], 99.50th=[ 7570], 99.90th=[ 7767], 99.95th=[ 7767], | 99.99th=[ 7767] bw ( KiB/s): min= 1008, max= 1008, per=15.34%, avg=1008.00, stdev= 0.00, samples=1 iops : min= 252, max= 252, avg=252.00, stdev= 0.00, samples=1 lat (usec) : 4=0.26%, 10=13.15%, 20=5.73%, 50=1.17%, 100=1.69% lat (usec) : 250=21.61%, 500=1.95%, 750=5.99%, 1000=7.03% lat (msec) : 2=19.27%, 4=18.49%, 10=3.12%, 20=0.26%, 50=0.13% lat (msec) : 100=0.13% cpu : usr=0.21%, sys=18.21%, ctx=906, majf=0, minf=33 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=15464: Wed May 8 18:31:32 2024 read: IOPS=383, BW=1536KiB/s (1573kB/s)(1436KiB/935msec) clat (usec): min=3, max=16339, avg=1255.27, stdev=1673.69 lat (usec): min=3, max=16339, avg=1256.00, stdev=1673.70 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 15], 50.00th=[ 971], 60.00th=[ 1418], | 70.00th=[ 1844], 80.00th=[ 2245], 90.00th=[ 2802], 95.00th=[ 3654], | 99.00th=[ 7832], 99.50th=[10290], 99.90th=[16319], 99.95th=[16319], | 99.99th=[16319] bw ( KiB/s): min= 984, max= 984, per=15.76%, avg=984.00, stdev= 0.00, samples=1 iops : min= 246, max= 246, avg=246.00, stdev= 0.00, samples=1 write: IOPS=437, BW=1750KiB/s (1792kB/s)(1636KiB/935msec) clat (usec): min=88, max=36411, avg=1163.26, stdev=2277.63 lat (usec): min=88, max=36412, avg=1163.88, stdev=2277.71 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 100], 10.00th=[ 108], 20.00th=[ 120], | 30.00th=[ 141], 40.00th=[ 231], 50.00th=[ 676], 60.00th=[ 857], | 70.00th=[ 1221], 80.00th=[ 1909], 90.00th=[ 2540], 95.00th=[ 3752], | 99.00th=[ 8094], 99.50th=[11076], 99.90th=[36439], 99.95th=[36439], | 99.99th=[36439] bw ( KiB/s): min= 1192, max= 1192, per=18.15%, avg=1192.00, stdev= 0.00, samples=1 iops : min= 298, max= 298, avg=298.00, stdev= 0.00, samples=1 lat (usec) : 4=0.39%, 10=13.80%, 20=4.95%, 50=0.52%, 100=2.99% lat (usec) : 250=19.27%, 500=2.86%, 750=4.56%, 1000=8.98% lat (msec) : 2=20.05%, 4=17.71%, 10=3.26%, 20=0.52%, 50=0.13% cpu : usr=0.64%, sys=15.74%, ctx=936, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=15465: Wed May 8 18:31:32 2024 read: IOPS=407, BW=1631KiB/s (1670kB/s)(1564KiB/959msec) clat (usec): min=3, max=31231, avg=1497.34, stdev=2597.70 lat (usec): min=3, max=31232, avg=1497.85, stdev=2597.75 clat percentiles (usec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 269], 50.00th=[ 1172], 60.00th=[ 1631], | 70.00th=[ 2024], 80.00th=[ 2343], 90.00th=[ 2868], 95.00th=[ 4178], | 99.00th=[13042], 99.50th=[27919], 99.90th=[31327], 99.95th=[31327], | 99.99th=[31327] bw ( KiB/s): min= 1016, max= 1016, per=16.27%, avg=1016.00, stdev= 0.00, samples=1 iops : min= 254, max= 254, avg=254.00, stdev= 0.00, samples=1 write: IOPS=393, BW=1572KiB/s (1610kB/s)(1508KiB/959msec) clat (usec): min=85, max=12120, avg=975.53, stdev=1286.57 lat (usec): min=85, max=12120, avg=976.13, stdev=1286.63 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 97], 10.00th=[ 105], 20.00th=[ 120], | 30.00th=[ 153], 40.00th=[ 210], 50.00th=[ 594], 60.00th=[ 807], | 70.00th=[ 1106], 80.00th=[ 1696], 90.00th=[ 2442], 95.00th=[ 3425], | 99.00th=[ 5342], 99.50th=[ 8979], 99.90th=[12125], 99.95th=[12125], | 99.99th=[12125] bw ( KiB/s): min= 1024, max= 1024, per=15.59%, avg=1024.00, stdev= 0.00, samples=1 iops : min= 256, max= 256, avg=256.00, stdev= 0.00, samples=1 lat (usec) : 4=0.13%, 10=13.15%, 20=5.86%, 50=0.78%, 100=3.52% lat (usec) : 250=18.75%, 500=2.34%, 750=4.95%, 1000=7.94% lat (msec) : 2=19.40%, 4=19.14%, 10=3.39%, 20=0.39%, 50=0.26% cpu : usr=0.21%, sys=17.12%, ctx=972, majf=0, minf=33 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=15466: Wed May 8 18:31:32 2024 read: IOPS=396, BW=1584KiB/s (1622kB/s)(1508KiB/952msec) clat (usec): min=3, max=50633, avg=1470.73, stdev=3075.82 lat (usec): min=3, max=50634, avg=1471.25, stdev=3075.87 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 28], 50.00th=[ 1045], 60.00th=[ 1483], | 70.00th=[ 1909], 80.00th=[ 2278], 90.00th=[ 3064], 95.00th=[ 4490], | 99.00th=[ 7504], 99.50th=[18482], 99.90th=[50594], 99.95th=[50594], | 99.99th=[50594] bw ( KiB/s): min= 984, max= 984, per=15.76%, avg=984.00, stdev= 0.00, samples=1 iops : min= 246, max= 246, avg=246.00, stdev= 0.00, samples=1 write: IOPS=410, BW=1643KiB/s (1682kB/s)(1564KiB/952msec) clat (usec): min=83, max=15001, avg=993.34, stdev=1478.98 lat (usec): min=84, max=15003, avg=994.64, stdev=1479.08 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 101], 10.00th=[ 109], 20.00th=[ 120], | 30.00th=[ 137], 40.00th=[ 198], 50.00th=[ 594], 60.00th=[ 857], | 70.00th=[ 1057], 80.00th=[ 1647], 90.00th=[ 2343], 95.00th=[ 3064], | 99.00th=[ 7767], 99.50th=[11994], 99.90th=[15008], 99.95th=[15008], | 99.99th=[15008] bw ( KiB/s): min= 1016, max= 1016, per=15.47%, avg=1016.00, stdev= 0.00, samples=1 iops : min= 254, max= 254, avg=254.00, stdev= 0.00, samples=1 lat (usec) : 4=0.91%, 10=13.93%, 20=4.30%, 50=0.91%, 100=2.34% lat (usec) : 250=20.18%, 500=3.12%, 750=4.17%, 1000=8.72% lat (msec) : 2=20.70%, 4=15.76%, 10=4.30%, 20=0.52%, 100=0.13% cpu : usr=0.74%, sys=14.62%, ctx=933, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6244KiB/s (6394kB/s), 1536KiB/s-1631KiB/s (1573kB/s-1670kB/s), io=5988KiB (6132kB), run=935-959msec WRITE: bw=6569KiB/s (6727kB/s), 1572KiB/s-1750KiB/s (1610kB/s-1792kB/s), io=6300KiB (6451kB), run=935-959msec rand-rw: (groupid=0, jobs=1): err= 0: pid=15458: Wed May 8 18:31:32 2024 read: IOPS=235, BW=940KiB/s (963kB/s)(1480KiB/1574msec) clat (usec): min=474, max=15950, avg=1489.60, stdev=1689.05 lat (usec): min=475, max=15952, avg=1490.28, stdev=1689.10 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 619], 10.00th=[ 660], 20.00th=[ 725], | 30.00th=[ 775], 40.00th=[ 840], 50.00th=[ 930], 60.00th=[ 1057], | 70.00th=[ 1270], 80.00th=[ 1582], 90.00th=[ 2704], 95.00th=[ 4621], | 99.00th=[ 9896], 99.50th=[12780], 99.90th=[15926], 99.95th=[15926], | 99.99th=[15926] bw ( KiB/s): min= 496, max= 1328, per=24.38%, avg=914.67, stdev=416.03, samples=3 iops : min= 124, max= 332, avg=228.67, stdev=104.01, samples=3 write: IOPS=252, BW=1011KiB/s (1036kB/s)(1592KiB/1574msec) clat (usec): min=1121, max=65002, avg=2517.61, stdev=3321.50 lat (usec): min=1122, max=65003, avg=2519.16, stdev=3322.75 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1483], 20.00th=[ 1696], | 30.00th=[ 1795], 40.00th=[ 1876], 50.00th=[ 1991], 60.00th=[ 2147], | 70.00th=[ 2442], 80.00th=[ 2933], 90.00th=[ 3720], 95.00th=[ 4424], | 99.00th=[ 7439], 99.50th=[ 8848], 99.90th=[64750], 99.95th=[64750], | 99.99th=[64750] bw ( KiB/s): min= 528, max= 1496, per=25.07%, avg=989.33, stdev=485.59, samples=3 iops : min= 132, max= 374, avg=247.33, stdev=121.40, samples=3 lat (usec) : 500=0.13%, 750=11.72%, 1000=15.23% lat (msec) : 2=40.89%, 4=25.39%, 10=6.12%, 20=0.39%, 100=0.13% cpu : usr=0.25%, sys=6.48%, ctx=823, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=15459: Wed May 8 18:31:32 2024 read: IOPS=224, BW=900KiB/s (921kB/s)(1436KiB/1596msec) clat (usec): min=526, max=20641, avg=1413.06, stdev=1771.76 lat (usec): min=526, max=20641, avg=1413.63, stdev=1771.86 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 627], 10.00th=[ 668], 20.00th=[ 725], | 30.00th=[ 783], 40.00th=[ 832], 50.00th=[ 881], 60.00th=[ 947], | 70.00th=[ 1106], 80.00th=[ 1500], 90.00th=[ 2507], 95.00th=[ 4293], | 99.00th=[ 9110], 99.50th=[15926], 99.90th=[20579], 99.95th=[20579], | 99.99th=[20579] bw ( KiB/s): min= 448, max= 1416, per=23.60%, avg=885.33, stdev=490.70, samples=3 iops : min= 112, max= 354, avg=221.33, stdev=122.68, samples=3 write: IOPS=256, BW=1025KiB/s (1050kB/s)(1636KiB/1596msec) clat (usec): min=975, max=12360, avg=2617.94, stdev=1621.88 lat (usec): min=976, max=12362, avg=2618.64, stdev=1621.99 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1516], 20.00th=[ 1680], | 30.00th=[ 1795], 40.00th=[ 1926], 50.00th=[ 2024], 60.00th=[ 2212], | 70.00th=[ 2573], 80.00th=[ 3195], 90.00th=[ 4490], 95.00th=[ 5735], | 99.00th=[ 9896], 99.50th=[11076], 99.90th=[12387], 99.95th=[12387], | 99.99th=[12387] bw ( KiB/s): min= 528, max= 1440, per=25.07%, avg=989.33, stdev=456.09, samples=3 iops : min= 132, max= 360, avg=247.33, stdev=114.02, samples=3 lat (usec) : 750=11.98%, 1000=18.36% lat (msec) : 2=35.42%, 4=24.61%, 10=8.98%, 20=0.52%, 50=0.13% cpu : usr=0.19%, sys=6.39%, ctx=815, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=15460: Wed May 8 18:31:32 2024 read: IOPS=244, BW=980KiB/s (1003kB/s)(1564KiB/1596msec) clat (usec): min=503, max=20663, avg=1487.19, stdev=1924.29 lat (usec): min=504, max=20664, avg=1489.47, stdev=1925.04 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 627], 10.00th=[ 676], 20.00th=[ 742], | 30.00th=[ 799], 40.00th=[ 865], 50.00th=[ 930], 60.00th=[ 1037], | 70.00th=[ 1287], 80.00th=[ 1696], 90.00th=[ 2704], 95.00th=[ 3654], | 99.00th=[10683], 99.50th=[20317], 99.90th=[20579], 99.95th=[20579], | 99.99th=[20579] bw ( KiB/s): min= 456, max= 1520, per=25.66%, avg=962.67, stdev=533.81, samples=3 iops : min= 114, max= 380, avg=240.67, stdev=133.45, samples=3 write: IOPS=236, BW=945KiB/s (968kB/s)(1508KiB/1596msec) clat (usec): min=972, max=30580, avg=2664.40, stdev=2175.05 lat (usec): min=973, max=30583, avg=2665.10, stdev=2175.16 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1565], 20.00th=[ 1729], | 30.00th=[ 1844], 40.00th=[ 1909], 50.00th=[ 2008], 60.00th=[ 2212], | 70.00th=[ 2606], 80.00th=[ 3261], 90.00th=[ 4293], 95.00th=[ 5211], | 99.00th=[ 9896], 99.50th=[20055], 99.90th=[30540], 99.95th=[30540], | 99.99th=[30540] bw ( KiB/s): min= 544, max= 1344, per=22.97%, avg=906.67, stdev=405.19, samples=3 iops : min= 136, max= 336, avg=226.67, stdev=101.30, samples=3 lat (usec) : 750=10.81%, 1000=18.36% lat (msec) : 2=38.28%, 4=24.22%, 10=7.42%, 20=0.52%, 50=0.39% cpu : usr=0.38%, sys=6.27%, ctx=819, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=15461: Wed May 8 18:31:32 2024 read: IOPS=238, BW=954KiB/s (977kB/s)(1508KiB/1580msec) clat (usec): min=497, max=49912, avg=1490.20, stdev=2881.73 lat (usec): min=497, max=49913, avg=1491.06, stdev=2881.74 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 627], 10.00th=[ 668], 20.00th=[ 734], | 30.00th=[ 791], 40.00th=[ 840], 50.00th=[ 922], 60.00th=[ 1012], | 70.00th=[ 1205], 80.00th=[ 1549], 90.00th=[ 2573], 95.00th=[ 3851], | 99.00th=[ 7046], 99.50th=[19530], 99.90th=[50070], 99.95th=[50070], | 99.99th=[50070] bw ( KiB/s): min= 504, max= 1320, per=24.60%, avg=922.67, stdev=408.42, samples=3 iops : min= 126, max= 330, avg=230.67, stdev=102.10, samples=3 write: IOPS=247, BW=990KiB/s (1014kB/s)(1564KiB/1580msec) clat (usec): min=951, max=35661, avg=2558.16, stdev=2216.47 lat (usec): min=952, max=35663, avg=2558.87, stdev=2216.58 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1450], 20.00th=[ 1663], | 30.00th=[ 1762], 40.00th=[ 1876], 50.00th=[ 1958], 60.00th=[ 2114], | 70.00th=[ 2409], 80.00th=[ 3032], 90.00th=[ 4359], 95.00th=[ 5211], | 99.00th=[10552], 99.50th=[12125], 99.90th=[35914], 99.95th=[35914], | 99.99th=[35914] bw ( KiB/s): min= 560, max= 1480, per=24.59%, avg=970.67, stdev=467.87, samples=3 iops : min= 140, max= 370, avg=242.67, stdev=116.97, samples=3 lat (usec) : 500=0.13%, 750=11.20%, 1000=17.45% lat (msec) : 2=40.36%, 4=22.66%, 10=7.29%, 20=0.65%, 50=0.26% cpu : usr=0.25%, sys=6.46%, ctx=812, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3752KiB/s (3842kB/s), 900KiB/s-980KiB/s (921kB/s-1003kB/s), io=5988KiB (6132kB), run=1574-1596msec WRITE: bw=3947KiB/s (4042kB/s), 945KiB/s-1025KiB/s (968kB/s-1050kB/s), io=6300KiB (6451kB), run=1574-1596msec