== sanity test 398b: DIO and buffer IO race ============== 14:00:16 (1736362816) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB) copied, 0.0851416 s, 148 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.7 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=17255: Wed Jan 8 14:00:19 2025 read: IOPS=385, BW=1543KiB/s (1580kB/s)(1480KiB/959msec) clat (usec): min=3, max=52560, avg=1547.67, stdev=3380.27 lat (usec): min=3, max=52561, avg=1548.17, stdev=3380.34 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 586], 50.00th=[ 1139], 60.00th=[ 1467], | 70.00th=[ 1893], 80.00th=[ 2245], 90.00th=[ 3130], 95.00th=[ 4015], | 99.00th=[11863], 99.50th=[24773], 99.90th=[52691], 99.95th=[52691], | 99.99th=[52691] bw ( KiB/s): min= 902, max= 902, per=14.45%, avg=902.00, stdev= 0.00, samples=1 iops : min= 225, max= 225, avg=225.00, stdev= 0.00, samples=1 write: IOPS=415, BW=1660KiB/s (1700kB/s)(1592KiB/959msec) clat (usec): min=86, max=11755, avg=893.01, stdev=1215.19 lat (usec): min=86, max=11756, avg=893.94, stdev=1215.46 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 95], 10.00th=[ 100], 20.00th=[ 111], | 30.00th=[ 129], 40.00th=[ 182], 50.00th=[ 392], 60.00th=[ 758], | 70.00th=[ 1045], 80.00th=[ 1532], 90.00th=[ 2245], 95.00th=[ 3097], | 99.00th=[ 5669], 99.50th=[ 8225], 99.90th=[11731], 99.95th=[11731], | 99.99th=[11731] bw ( KiB/s): min= 902, max= 902, per=13.73%, avg=902.00, stdev= 0.00, samples=1 iops : min= 225, max= 225, avg=225.00, stdev= 0.00, samples=1 lat (usec) : 4=1.17%, 10=13.41%, 20=2.99%, 50=0.52%, 100=5.73% lat (usec) : 250=19.40%, 500=2.73%, 750=4.95%, 1000=7.68% lat (msec) : 2=22.53%, 4=15.36%, 10=2.73%, 20=0.52%, 50=0.13% lat (msec) : 100=0.13% cpu : usr=0.10%, sys=20.88%, ctx=1105, majf=0, minf=35 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17257: Wed Jan 8 14:00:19 2025 read: IOPS=393, BW=1573KiB/s (1611kB/s)(1436KiB/913msec) clat (usec): min=3, max=33921, avg=1431.96, stdev=2578.79 lat (usec): min=3, max=33922, avg=1432.82, stdev=2578.87 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 30], 50.00th=[ 955], 60.00th=[ 1483], | 70.00th=[ 1827], 80.00th=[ 2278], 90.00th=[ 3032], 95.00th=[ 4293], | 99.00th=[ 8455], 99.50th=[22152], 99.90th=[33817], 99.95th=[33817], | 99.99th=[33817] bw ( KiB/s): min= 1016, max= 1016, per=16.27%, avg=1016.00, stdev= 0.00, samples=1 iops : min= 254, max= 254, avg=254.00, stdev= 0.00, samples=1 write: IOPS=447, BW=1792KiB/s (1835kB/s)(1636KiB/913msec) clat (usec): min=81, max=22835, avg=939.40, stdev=1793.24 lat (usec): min=81, max=22836, avg=940.30, stdev=1793.22 clat percentiles (usec): | 1.00th=[ 90], 5.00th=[ 98], 10.00th=[ 103], 20.00th=[ 115], | 30.00th=[ 135], 40.00th=[ 188], 50.00th=[ 310], 60.00th=[ 652], | 70.00th=[ 857], 80.00th=[ 1401], 90.00th=[ 2278], 95.00th=[ 3458], | 99.00th=[ 6915], 99.50th=[10683], 99.90th=[22938], 99.95th=[22938], | 99.99th=[22938] bw ( KiB/s): min= 1248, max= 1248, per=19.00%, avg=1248.00, stdev= 0.00, samples=1 iops : min= 312, max= 312, avg=312.00, stdev= 0.00, samples=1 lat (usec) : 4=0.91%, 10=13.67%, 20=3.52%, 50=0.91%, 100=3.91% lat (usec) : 250=20.96%, 500=4.04%, 750=7.55%, 1000=7.81% lat (msec) : 2=17.45%, 4=15.36%, 10=3.12%, 20=0.39%, 50=0.39% cpu : usr=0.88%, sys=18.31%, ctx=994, majf=0, minf=32 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17259: Wed Jan 8 14:00:19 2025 read: IOPS=427, BW=1709KiB/s (1750kB/s)(1564KiB/915msec) clat (usec): min=3, max=32010, avg=1311.55, stdev=2233.63 lat (usec): min=3, max=32011, avg=1312.29, stdev=2233.56 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 30], 50.00th=[ 922], 60.00th=[ 1369], | 70.00th=[ 1680], 80.00th=[ 2114], 90.00th=[ 2802], 95.00th=[ 3687], | 99.00th=[ 7832], 99.50th=[15926], 99.90th=[32113], 99.95th=[32113], | 99.99th=[32113] bw ( KiB/s): min= 912, max= 912, per=14.61%, avg=912.00, stdev= 0.00, samples=1 iops : min= 228, max= 228, avg=228.00, stdev= 0.00, samples=1 write: IOPS=412, BW=1648KiB/s (1688kB/s)(1508KiB/915msec) clat (usec): min=82, max=21457, avg=973.97, stdev=1651.37 lat (usec): min=82, max=21460, avg=974.74, stdev=1651.49 clat percentiles (usec): | 1.00th=[ 86], 5.00th=[ 93], 10.00th=[ 101], 20.00th=[ 116], | 30.00th=[ 141], 40.00th=[ 190], 50.00th=[ 429], 60.00th=[ 725], | 70.00th=[ 971], 80.00th=[ 1614], 90.00th=[ 2245], 95.00th=[ 3425], | 99.00th=[ 7242], 99.50th=[10290], 99.90th=[21365], 99.95th=[21365], | 99.99th=[21365] bw ( KiB/s): min= 976, max= 976, per=14.86%, avg=976.00, stdev= 0.00, samples=1 iops : min= 244, max= 244, avg=244.00, stdev= 0.00, samples=1 lat (usec) : 4=2.73%, 10=14.97%, 20=2.34%, 50=0.39%, 100=5.34% lat (usec) : 250=17.32%, 500=3.39%, 750=6.38%, 1000=7.55% lat (msec) : 2=22.14%, 4=13.93%, 10=2.99%, 20=0.26%, 50=0.26% cpu : usr=0.33%, sys=16.41%, ctx=917, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17261: Wed Jan 8 14:00:19 2025 read: IOPS=410, BW=1643KiB/s (1682kB/s)(1508KiB/918msec) clat (usec): min=3, max=16751, avg=1221.62, stdev=1571.58 lat (usec): min=3, max=16753, avg=1222.46, stdev=1571.40 clat percentiles (usec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 963], 60.00th=[ 1385], | 70.00th=[ 1778], 80.00th=[ 2180], 90.00th=[ 2835], 95.00th=[ 3851], | 99.00th=[ 6128], 99.50th=[ 7373], 99.90th=[16712], 99.95th=[16712], | 99.99th=[16712] bw ( KiB/s): min= 1192, max= 1192, per=19.09%, avg=1192.00, stdev= 0.00, samples=1 iops : min= 298, max= 298, avg=298.00, stdev= 0.00, samples=1 write: IOPS=425, BW=1704KiB/s (1745kB/s)(1564KiB/918msec) clat (usec): min=77, max=20851, avg=1079.57, stdev=1889.23 lat (usec): min=78, max=20852, avg=1080.37, stdev=1889.54 clat percentiles (usec): | 1.00th=[ 83], 5.00th=[ 92], 10.00th=[ 100], 20.00th=[ 112], | 30.00th=[ 141], 40.00th=[ 198], 50.00th=[ 388], 60.00th=[ 791], | 70.00th=[ 1020], 80.00th=[ 1696], 90.00th=[ 2769], 95.00th=[ 3720], | 99.00th=[10945], 99.50th=[15926], 99.90th=[20841], 99.95th=[20841], | 99.99th=[20841] bw ( KiB/s): min= 1208, max= 1208, per=18.39%, avg=1208.00, stdev= 0.00, samples=1 iops : min= 302, max= 302, avg=302.00, stdev= 0.00, samples=1 lat (usec) : 4=1.43%, 10=16.15%, 20=3.12%, 50=0.26%, 100=6.12% lat (usec) : 250=17.58%, 500=2.99%, 750=4.95%, 1000=7.16% lat (msec) : 2=20.70%, 4=15.36%, 10=3.52%, 20=0.52%, 50=0.13% cpu : usr=0.55%, sys=16.90%, ctx=910, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6244KiB/s (6394kB/s), 1543KiB/s-1709KiB/s (1580kB/s-1750kB/s), io=5988KiB (6132kB), run=913-959msec WRITE: bw=6569KiB/s (6727kB/s), 1648KiB/s-1792KiB/s (1688kB/s-1835kB/s), io=6300KiB (6451kB), run=913-959msec rand-rw: (groupid=0, jobs=1): err= 0: pid=17254: Wed Jan 8 14:00:20 2025 read: IOPS=220, BW=881KiB/s (902kB/s)(1480KiB/1680msec) clat (usec): min=493, max=33612, avg=1552.85, stdev=2305.62 lat (usec): min=494, max=33614, avg=1553.51, stdev=2305.68 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 594], 10.00th=[ 635], 20.00th=[ 709], | 30.00th=[ 775], 40.00th=[ 848], 50.00th=[ 947], 60.00th=[ 1156], | 70.00th=[ 1418], 80.00th=[ 1762], 90.00th=[ 3032], 95.00th=[ 3752], | 99.00th=[11600], 99.50th=[18220], 99.90th=[33817], 99.95th=[33817], | 99.99th=[33817] bw ( KiB/s): min= 448, max= 1197, per=25.05%, avg=884.33, stdev=389.51, samples=3 iops : min= 112, max= 299, avg=221.00, stdev=97.28, samples=3 write: IOPS=236, BW=948KiB/s (970kB/s)(1592KiB/1680msec) clat (usec): min=960, max=24141, avg=2693.54, stdev=2022.33 lat (usec): min=961, max=24142, avg=2694.39, stdev=2022.39 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1221], 10.00th=[ 1450], 20.00th=[ 1663], | 30.00th=[ 1778], 40.00th=[ 1909], 50.00th=[ 2089], 60.00th=[ 2507], | 70.00th=[ 2835], 80.00th=[ 3195], 90.00th=[ 4178], 95.00th=[ 5800], | 99.00th=[13304], 99.50th=[17171], 99.90th=[24249], 99.95th=[24249], | 99.99th=[24249] bw ( KiB/s): min= 488, max= 1397, per=25.89%, avg=961.67, stdev=455.71, samples=3 iops : min= 122, max= 349, avg=240.33, stdev=113.81, samples=3 lat (usec) : 500=0.13%, 750=12.11%, 1000=13.02% lat (msec) : 2=38.28%, 4=28.52%, 10=6.77%, 20=0.91%, 50=0.26% cpu : usr=0.54%, sys=6.55%, ctx=812, majf=0, minf=37 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17256: Wed Jan 8 14:00:20 2025 read: IOPS=211, BW=847KiB/s (867kB/s)(1436KiB/1696msec) clat (usec): min=509, max=15617, avg=1486.50, stdev=1455.40 lat (usec): min=510, max=15618, avg=1487.33, stdev=1455.41 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 586], 10.00th=[ 627], 20.00th=[ 701], | 30.00th=[ 791], 40.00th=[ 881], 50.00th=[ 1004], 60.00th=[ 1221], | 70.00th=[ 1500], 80.00th=[ 1778], 90.00th=[ 2802], 95.00th=[ 3916], | 99.00th=[ 7373], 99.50th=[10028], 99.90th=[15664], 99.95th=[15664], | 99.99th=[15664] bw ( KiB/s): min= 448, max= 1264, per=24.48%, avg=864.00, stdev=408.24, samples=3 iops : min= 112, max= 316, avg=216.00, stdev=102.06, samples=3 write: IOPS=241, BW=965KiB/s (988kB/s)(1636KiB/1696msec) clat (usec): min=977, max=24713, avg=2757.10, stdev=2138.20 lat (usec): min=977, max=24715, avg=2757.88, stdev=2138.33 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1385], 10.00th=[ 1614], 20.00th=[ 1762], | 30.00th=[ 1893], 40.00th=[ 2057], 50.00th=[ 2278], 60.00th=[ 2507], | 70.00th=[ 2802], 80.00th=[ 3195], 90.00th=[ 4113], 95.00th=[ 5080], | 99.00th=[13435], 99.50th=[16319], 99.90th=[24773], 99.95th=[24773], | 99.99th=[24773] bw ( KiB/s): min= 536, max= 1328, per=26.28%, avg=976.00, stdev=403.27, samples=3 iops : min= 134, max= 332, avg=244.00, stdev=100.82, samples=3 lat (usec) : 750=12.37%, 1000=11.07% lat (msec) : 2=35.29%, 4=33.46%, 10=6.64%, 20=0.91%, 50=0.26% cpu : usr=0.24%, sys=6.37%, ctx=827, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17258: Wed Jan 8 14:00:20 2025 read: IOPS=232, BW=932KiB/s (954kB/s)(1564KiB/1679msec) clat (usec): min=477, max=37640, avg=1543.94, stdev=2298.05 lat (usec): min=477, max=37641, avg=1544.64, stdev=2298.09 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 578], 10.00th=[ 619], 20.00th=[ 693], | 30.00th=[ 775], 40.00th=[ 881], 50.00th=[ 1029], 60.00th=[ 1237], | 70.00th=[ 1418], 80.00th=[ 1745], 90.00th=[ 2900], 95.00th=[ 3884], | 99.00th=[ 9241], 99.50th=[15008], 99.90th=[37487], 99.95th=[37487], | 99.99th=[37487] bw ( KiB/s): min= 440, max= 1432, per=26.87%, avg=948.67, stdev=496.48, samples=3 iops : min= 110, max= 358, avg=237.00, stdev=124.11, samples=3 write: IOPS=224, BW=898KiB/s (920kB/s)(1508KiB/1679msec) clat (usec): min=948, max=21928, avg=2762.23, stdev=1958.53 lat (usec): min=948, max=21930, avg=2763.28, stdev=1958.50 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1532], 20.00th=[ 1745], | 30.00th=[ 1876], 40.00th=[ 2024], 50.00th=[ 2311], 60.00th=[ 2638], | 70.00th=[ 2868], 80.00th=[ 3261], 90.00th=[ 4293], 95.00th=[ 5473], | 99.00th=[10683], 99.50th=[18482], 99.90th=[21890], 99.95th=[21890], | 99.99th=[21890] bw ( KiB/s): min= 528, max= 1280, per=24.32%, avg=903.33, stdev=376.00, samples=3 iops : min= 132, max= 320, avg=225.67, stdev=94.00, samples=3 lat (usec) : 500=0.13%, 750=14.19%, 1000=10.03% lat (msec) : 2=36.46%, 4=30.99%, 10=7.29%, 20=0.65%, 50=0.26% cpu : usr=0.30%, sys=6.62%, ctx=844, majf=0, minf=34 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=17260: Wed Jan 8 14:00:20 2025 read: IOPS=226, BW=906KiB/s (928kB/s)(1508KiB/1664msec) clat (usec): min=458, max=21774, avg=1501.20, stdev=1707.05 lat (usec): min=459, max=21775, avg=1501.91, stdev=1707.12 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 603], 10.00th=[ 627], 20.00th=[ 709], | 30.00th=[ 783], 40.00th=[ 881], 50.00th=[ 1090], 60.00th=[ 1237], | 70.00th=[ 1418], 80.00th=[ 1795], 90.00th=[ 2769], 95.00th=[ 3818], | 99.00th=[ 9241], 99.50th=[14222], 99.90th=[21890], 99.95th=[21890], | 99.99th=[21890] bw ( KiB/s): min= 472, max= 1200, per=25.58%, avg=903.00, stdev=382.05, samples=3 iops : min= 118, max= 300, avg=225.67, stdev=95.47, samples=3 write: IOPS=234, BW=940KiB/s (962kB/s)(1564KiB/1664msec) clat (usec): min=960, max=34751, avg=2781.06, stdev=2423.92 lat (usec): min=960, max=34754, avg=2781.82, stdev=2424.07 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1434], 10.00th=[ 1582], 20.00th=[ 1713], | 30.00th=[ 1844], 40.00th=[ 1958], 50.00th=[ 2180], 60.00th=[ 2474], | 70.00th=[ 2802], 80.00th=[ 3163], 90.00th=[ 4113], 95.00th=[ 5538], | 99.00th=[15401], 99.50th=[16909], 99.90th=[34866], 99.95th=[34866], | 99.99th=[34866] bw ( KiB/s): min= 528, max= 1352, per=25.61%, avg=951.33, stdev=412.47, samples=3 iops : min= 132, max= 338, avg=237.67, stdev=103.10, samples=3 lat (usec) : 500=0.39%, 750=11.46%, 1000=11.33% lat (msec) : 2=38.93%, 4=30.08%, 10=6.64%, 20=0.91%, 50=0.26% cpu : usr=0.48%, sys=6.25%, ctx=804, majf=0, minf=30 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3531KiB/s (3615kB/s), 847KiB/s-932KiB/s (867kB/s-954kB/s), io=5988KiB (6132kB), run=1664-1696msec WRITE: bw=3715KiB/s (3804kB/s), 898KiB/s-965KiB/s (920kB/s-988kB/s), io=6300KiB (6451kB), run=1664-1696msec