== sanity test 398b: DIO and buffer IO race ============== 13:32:17 (1781285537) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.334861 s, 37.6 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=142957: Fri Jun 12 13:32:42 2026 read: IOPS=25, BW=102KiB/s (104kB/s)(1480KiB/14562msec) clat (usec): min=6, max=163076, avg=17264.98, stdev=25163.53 lat (usec): min=6, max=163076, avg=17271.28, stdev=25168.89 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 23], | 30.00th=[ 34], 40.00th=[ 47], 50.00th=[ 799], 60.00th=[ 15270], | 70.00th=[ 24511], 80.00th=[ 33817], 90.00th=[ 44827], 95.00th=[ 57410], | 99.00th=[131597], 99.50th=[154141], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 39, max= 176, per=24.45%, avg=98.29, stdev=40.98, samples=28 iops : min= 9, max= 44, avg=24.07, stdev=10.33, samples=28 write: IOPS=27, BW=109KiB/s (112kB/s)(1592KiB/14562msec); 0 zone resets clat (usec): min=158, max=144708, avg=20368.76, stdev=27643.52 lat (usec): min=159, max=144709, avg=20372.95, stdev=27646.08 clat percentiles (usec): | 1.00th=[ 174], 5.00th=[ 200], 10.00th=[ 235], 20.00th=[ 297], | 30.00th=[ 404], 40.00th=[ 1663], 50.00th=[ 6718], 60.00th=[ 15795], | 70.00th=[ 26346], 80.00th=[ 40633], 90.00th=[ 57934], 95.00th=[ 79168], | 99.00th=[115868], 99.50th=[139461], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 55, max= 190, per=25.14%, avg=106.36, stdev=38.90, samples=28 iops : min= 13, max= 47, avg=26.07, stdev= 9.77, samples=28 lat (usec) : 10=1.82%, 20=6.38%, 50=11.72%, 100=3.39%, 250=6.90% lat (usec) : 500=10.42%, 750=1.82%, 1000=1.43% lat (msec) : 2=1.56%, 4=1.17%, 10=7.29%, 20=11.46%, 50=23.18% lat (msec) : 100=9.11%, 250=2.34% cpu : usr=0.08%, sys=2.84%, ctx=811, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142958: Fri Jun 12 13:32:42 2026 read: IOPS=26, BW=107KiB/s (110kB/s)(1436KiB/13421msec) clat (usec): min=6, max=157556, avg=15100.31, stdev=22296.49 lat (usec): min=6, max=157557, avg=15101.27, stdev=22296.55 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 23], | 30.00th=[ 31], 40.00th=[ 41], 50.00th=[ 91], 60.00th=[ 12125], | 70.00th=[ 22152], 80.00th=[ 33817], 90.00th=[ 44303], 95.00th=[ 53216], | 99.00th=[ 93848], 99.50th=[107480], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 39, max= 325, per=25.30%, avg=101.69, stdev=52.92, samples=26 iops : min= 9, max= 81, avg=24.85, stdev=13.29, samples=26 write: IOPS=30, BW=122KiB/s (125kB/s)(1636KiB/13421msec); 0 zone resets clat (usec): min=170, max=202347, avg=19320.76, stdev=28283.38 lat (usec): min=171, max=202349, avg=19331.20, stdev=28279.45 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 204], 10.00th=[ 221], 20.00th=[ 285], | 30.00th=[ 383], 40.00th=[ 1057], 50.00th=[ 6521], 60.00th=[ 15664], | 70.00th=[ 24773], 80.00th=[ 33424], 90.00th=[ 54789], 95.00th=[ 73925], | 99.00th=[131597], 99.50th=[149947], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 47, max= 368, per=27.62%, avg=116.85, stdev=63.12, samples=26 iops : min= 11, max= 92, avg=28.65, stdev=15.87, samples=26 lat (usec) : 10=1.95%, 20=5.86%, 50=13.02%, 100=2.86%, 250=9.24% lat (usec) : 500=10.55%, 750=1.82%, 1000=1.30% lat (msec) : 2=2.34%, 4=2.34%, 10=4.95%, 20=10.16%, 50=23.83% lat (msec) : 100=8.20%, 250=1.56% cpu : usr=0.13%, sys=2.82%, ctx=723, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142959: Fri Jun 12 13:32:42 2026 read: IOPS=26, BW=105KiB/s (108kB/s)(1564KiB/14872msec) clat (usec): min=6, max=140722, avg=16371.98, stdev=23880.90 lat (usec): min=6, max=140723, avg=16372.89, stdev=23880.92 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 23], | 30.00th=[ 30], 40.00th=[ 41], 50.00th=[ 90], 60.00th=[ 13173], | 70.00th=[ 24773], 80.00th=[ 33817], 90.00th=[ 44303], 95.00th=[ 59507], | 99.00th=[116917], 99.50th=[135267], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 39, max= 190, per=26.21%, avg=105.36, stdev=43.45, samples=28 iops : min= 9, max= 47, avg=25.82, stdev=10.96, samples=28 write: IOPS=25, BW=101KiB/s (104kB/s)(1508KiB/14872msec); 0 zone resets clat (usec): min=167, max=162787, avg=22282.66, stdev=30852.69 lat (usec): min=168, max=162788, avg=22283.91, stdev=30852.68 clat percentiles (usec): | 1.00th=[ 180], 5.00th=[ 202], 10.00th=[ 225], 20.00th=[ 293], | 30.00th=[ 469], 40.00th=[ 1975], 50.00th=[ 9634], 60.00th=[ 18220], | 70.00th=[ 26870], 80.00th=[ 40633], 90.00th=[ 61604], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[160433], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 15, max= 182, per=23.33%, avg=98.68, stdev=39.97, samples=28 iops : min= 3, max= 45, avg=24.14, stdev=10.09, samples=28 lat (usec) : 10=3.26%, 20=5.99%, 50=13.80%, 100=2.60%, 250=7.42% lat (usec) : 500=8.85%, 750=1.17%, 1000=1.30% lat (msec) : 2=2.21%, 4=2.21%, 10=5.21%, 20=9.64%, 50=26.17% lat (msec) : 100=7.55%, 250=2.60% cpu : usr=0.14%, sys=2.37%, ctx=792, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142960: Fri Jun 12 13:32:42 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(1508KiB/14119msec) clat (usec): min=5, max=182556, avg=17876.23, stdev=26178.18 lat (usec): min=5, max=182556, avg=17877.23, stdev=26178.47 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 17], 20.00th=[ 26], | 30.00th=[ 40], 40.00th=[ 56], 50.00th=[ 3064], 60.00th=[ 16909], | 70.00th=[ 26608], 80.00th=[ 35390], 90.00th=[ 46400], 95.00th=[ 60031], | 99.00th=[147850], 99.50th=[177210], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 47, max= 175, per=25.99%, avg=104.48, stdev=36.06, samples=27 iops : min= 11, max= 43, avg=25.59, stdev= 8.97, samples=27 write: IOPS=27, BW=111KiB/s (113kB/s)(1564KiB/14119msec); 0 zone resets clat (usec): min=152, max=188273, avg=18729.00, stdev=29564.38 lat (usec): min=153, max=188276, avg=18739.54, stdev=29570.88 clat percentiles (usec): | 1.00th=[ 174], 5.00th=[ 190], 10.00th=[ 215], 20.00th=[ 289], | 30.00th=[ 379], 40.00th=[ 594], 50.00th=[ 3949], 60.00th=[ 11600], | 70.00th=[ 19268], 80.00th=[ 31589], 90.00th=[ 58459], 95.00th=[ 86508], | 99.00th=[133694], 99.50th=[139461], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 32, max= 190, per=25.85%, avg=109.33, stdev=35.64, samples=27 iops : min= 8, max= 47, avg=26.81, stdev= 8.84, samples=27 lat (usec) : 10=1.69%, 20=4.56%, 50=13.02%, 100=2.47%, 250=8.07% lat (usec) : 500=13.02%, 750=2.34%, 1000=0.65% lat (msec) : 2=2.21%, 4=2.21%, 10=5.73%, 20=11.07%, 50=21.88% lat (msec) : 100=8.85%, 250=2.21% cpu : usr=0.07%, sys=2.84%, ctx=813, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=403KiB/s (412kB/s), 102KiB/s-107KiB/s (104kB/s-110kB/s), io=5988KiB (6132kB), run=13421-14872msec WRITE: bw=424KiB/s (434kB/s), 101KiB/s-122KiB/s (104kB/s-125kB/s), io=6300KiB (6451kB), run=13421-14872msec rand-rw: (groupid=0, jobs=1): err= 0: pid=142962: Fri Jun 12 13:33:18 2026 read: IOPS=7, BW=29.7KiB/s (30.5kB/s)(1480KiB/49761msec) clat (msec): min=2, max=330, avg=20.20, stdev=28.00 lat (msec): min=2, max=330, avg=20.21, stdev=28.00 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 53], | 99.00th=[ 148], 99.50th=[ 201], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 111, per=25.49%, avg=30.33, stdev=18.84, samples=94 iops : min= 1, max= 27, avg= 6.98, stdev= 4.81, samples=94 write: IOPS=7, BW=31.0KiB/s (32.8kB/s)(1592KiB/49761msec); 0 zone resets clat (msec): min=33, max=400, avg=106.10, stdev=46.36 lat (msec): min=33, max=400, avg=106.11, stdev=46.36 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 97], 60.00th=[ 105], | 70.00th=[ 115], 80.00th=[ 133], 90.00th=[ 163], 95.00th=[ 203], | 99.00th=[ 253], 99.50th=[ 355], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 55, per=24.95%, avg=31.44, stdev=10.99, samples=98 iops : min= 1, max= 13, avg= 7.27, stdev= 2.79, samples=98 lat (msec) : 4=0.65%, 10=15.36%, 20=19.27%, 50=12.37%, 100=27.60% lat (msec) : 250=24.09%, 500=0.65% cpu : usr=0.06%, sys=0.59%, ctx=873, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142963: Fri Jun 12 13:33:18 2026 read: IOPS=7, BW=28.8KiB/s (29.5kB/s)(1436KiB/49922msec) clat (msec): min=2, max=181, avg=18.16, stdev=18.54 lat (msec): min=2, max=181, avg=18.16, stdev=18.54 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 36], 95.00th=[ 52], | 99.00th=[ 89], 99.50th=[ 157], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 5, max= 104, per=26.09%, avg=31.04, stdev=20.67, samples=89 iops : min= 1, max= 26, avg= 7.16, stdev= 5.21, samples=89 write: IOPS=8, BW=32.8KiB/s (33.6kB/s)(1636KiB/49922msec); 0 zone resets clat (msec): min=44, max=414, avg=105.98, stdev=44.73 lat (msec): min=44, max=414, avg=105.99, stdev=44.73 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 72], | 30.00th=[ 82], 40.00th=[ 90], 50.00th=[ 96], 60.00th=[ 105], | 70.00th=[ 114], 80.00th=[ 134], 90.00th=[ 163], 95.00th=[ 199], | 99.00th=[ 247], 99.50th=[ 292], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 48, per=25.48%, avg=32.10, stdev=10.37, samples=98 iops : min= 1, max= 12, avg= 7.43, stdev= 2.60, samples=98 lat (msec) : 4=0.65%, 10=15.23%, 20=19.27%, 50=10.03%, 100=30.60% lat (msec) : 250=23.70%, 500=0.52% cpu : usr=0.10%, sys=0.63%, ctx=881, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142964: Fri Jun 12 13:33:18 2026 read: IOPS=8, BW=32.6KiB/s (33.4kB/s)(1564KiB/47906msec) clat (msec): min=3, max=267, avg=19.26, stdev=22.08 lat (msec): min=3, max=267, avg=19.26, stdev=22.08 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 36], 95.00th=[ 59], | 99.00th=[ 111], 99.50th=[ 142], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 7, max= 95, per=28.49%, avg=33.90, stdev=22.18, samples=90 iops : min= 1, max= 23, avg= 7.88, stdev= 5.55, samples=90 write: IOPS=7, BW=31.5KiB/s (32.2kB/s)(1508KiB/47906msec); 0 zone resets clat (msec): min=34, max=376, avg=106.99, stdev=45.30 lat (msec): min=34, max=376, avg=107.00, stdev=45.30 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 71], | 30.00th=[ 79], 40.00th=[ 88], 50.00th=[ 100], 60.00th=[ 109], | 70.00th=[ 118], 80.00th=[ 136], 90.00th=[ 167], 95.00th=[ 188], | 99.00th=[ 257], 99.50th=[ 355], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 55, per=24.53%, avg=30.90, stdev=10.69, samples=94 iops : min= 1, max= 13, avg= 7.13, stdev= 2.71, samples=94 lat (msec) : 4=0.39%, 10=17.97%, 20=17.97%, 50=13.28%, 100=25.39% lat (msec) : 250=24.22%, 500=0.78% cpu : usr=0.10%, sys=0.71%, ctx=909, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142965: Fri Jun 12 13:33:18 2026 read: IOPS=7, BW=30.5KiB/s (31.2kB/s)(1508KiB/49444msec) clat (msec): min=3, max=117, avg=17.84, stdev=15.89 lat (msec): min=3, max=117, avg=17.85, stdev=15.90 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 48], | 99.00th=[ 84], 99.50th=[ 113], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 7, max= 87, per=26.40%, avg=31.41, stdev=21.16, samples=92 iops : min= 1, max= 21, avg= 7.26, stdev= 5.37, samples=92 write: IOPS=7, BW=31.6KiB/s (32.4kB/s)(1564KiB/49444msec); 0 zone resets clat (msec): min=33, max=374, avg=109.13, stdev=48.59 lat (msec): min=33, max=374, avg=109.14, stdev=48.59 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 64], 20.00th=[ 74], | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 102], 60.00th=[ 107], | 70.00th=[ 118], 80.00th=[ 134], 90.00th=[ 165], 95.00th=[ 188], | 99.00th=[ 309], 99.50th=[ 351], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 56, per=24.64%, avg=31.05, stdev= 9.78, samples=97 iops : min= 1, max= 14, avg= 7.15, stdev= 2.50, samples=97 lat (msec) : 4=0.91%, 10=16.28%, 20=18.75%, 50=12.24%, 100=25.52% lat (msec) : 250=24.74%, 500=1.56% cpu : usr=0.07%, sys=0.62%, ctx=869, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=120KiB/s (123kB/s), 28.8KiB/s-32.6KiB/s (29.5kB/s-33.4kB/s), io=5988KiB (6132kB), run=47906-49922msec WRITE: bw=126KiB/s (129kB/s), 31.5KiB/s-32.8KiB/s (32.2kB/s-33.6kB/s), io=6300KiB (6451kB), run=47906-49922msec