== sanity test 398b: DIO and buffer IO race ============== 17:36:48 (1776202608) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.51901 s, 24.2 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=122537: Tue Apr 14 17:37:18 2026 read: IOPS=22, BW=90.3KiB/s (92.5kB/s)(1480KiB/16383msec) clat (usec): min=6, max=192349, avg=16119.27, stdev=24668.43 lat (usec): min=6, max=192350, avg=16124.12, stdev=24666.31 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 27], | 30.00th=[ 39], 40.00th=[ 55], 50.00th=[ 388], 60.00th=[ 12518], | 70.00th=[ 19530], 80.00th=[ 31327], 90.00th=[ 47973], 95.00th=[ 63701], | 99.00th=[ 93848], 99.50th=[147850], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 15, max= 279, per=23.84%, avg=87.00, stdev=56.30, samples=32 iops : min= 3, max= 69, avg=21.19, stdev=14.15, samples=32 write: IOPS=24, BW=97.2KiB/s (99.5kB/s)(1592KiB/16383msec); 0 zone resets clat (usec): min=125, max=286285, avg=25932.28, stdev=39054.86 lat (usec): min=126, max=286287, avg=25935.15, stdev=39055.30 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 200], 10.00th=[ 241], 20.00th=[ 351], | 30.00th=[ 979], 40.00th=[ 5276], 50.00th=[ 11207], 60.00th=[ 18744], | 70.00th=[ 30802], 80.00th=[ 41681], 90.00th=[ 71828], 95.00th=[ 95945], | 99.00th=[196084], 99.50th=[223347], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 247, per=24.61%, avg=94.50, stdev=52.77, samples=32 iops : min= 7, max= 61, avg=23.09, stdev=13.25, samples=32 lat (usec) : 10=1.30%, 20=5.47%, 50=11.85%, 100=3.39%, 250=6.90% lat (usec) : 500=8.59%, 750=1.56%, 1000=1.30% lat (msec) : 2=1.69%, 4=2.86%, 10=7.29%, 20=13.41%, 50=21.74% lat (msec) : 100=9.90%, 250=2.60%, 500=0.13% cpu : usr=0.12%, sys=2.79%, ctx=867, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122538: Tue Apr 14 17:37:18 2026 read: IOPS=22, BW=88.2KiB/s (90.4kB/s)(1436KiB/16272msec) clat (usec): min=6, max=256602, avg=17378.64, stdev=27138.65 lat (usec): min=6, max=256603, avg=17380.53, stdev=27141.89 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 17], 20.00th=[ 29], | 30.00th=[ 39], 40.00th=[ 60], 50.00th=[ 2900], 60.00th=[ 15270], | 70.00th=[ 23200], 80.00th=[ 33424], 90.00th=[ 47449], 95.00th=[ 64226], | 99.00th=[115868], 99.50th=[212861], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 15, max= 223, per=23.80%, avg=86.87, stdev=50.67, samples=31 iops : min= 3, max= 55, avg=21.13, stdev=12.75, samples=31 write: IOPS=25, BW=101KiB/s (103kB/s)(1636KiB/16272msec); 0 zone resets clat (usec): min=139, max=200398, avg=24396.46, stdev=31159.64 lat (usec): min=139, max=200400, avg=24398.86, stdev=31158.94 clat percentiles (usec): | 1.00th=[ 182], 5.00th=[ 198], 10.00th=[ 243], 20.00th=[ 351], | 30.00th=[ 1713], 40.00th=[ 6259], 50.00th=[ 13173], 60.00th=[ 17957], | 70.00th=[ 30540], 80.00th=[ 45876], 90.00th=[ 67634], 95.00th=[ 87557], | 99.00th=[139461], 99.50th=[143655], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 39, max= 263, per=25.39%, avg=97.48, stdev=45.11, samples=31 iops : min= 9, max= 65, avg=23.81, stdev=11.28, samples=31 lat (usec) : 10=1.56%, 20=3.78%, 50=11.98%, 100=3.78%, 250=6.51% lat (usec) : 500=7.29%, 750=0.91%, 1000=1.43% lat (msec) : 2=2.21%, 4=2.73%, 10=7.29%, 20=14.58%, 50=21.88% lat (msec) : 100=11.85%, 250=2.08%, 500=0.13% cpu : usr=0.16%, sys=2.77%, ctx=892, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122539: Tue Apr 14 17:37:18 2026 read: IOPS=24, BW=96.6KiB/s (98.9kB/s)(1564KiB/16192msec) clat (usec): min=4, max=142259, avg=15802.96, stdev=22334.83 lat (usec): min=5, max=142261, avg=15804.32, stdev=22334.87 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 16], 20.00th=[ 30], | 30.00th=[ 40], 40.00th=[ 59], 50.00th=[ 4621], 60.00th=[ 14615], | 70.00th=[ 21103], 80.00th=[ 31589], 90.00th=[ 46924], 95.00th=[ 60031], | 99.00th=[ 91751], 99.50th=[132645], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 36, max= 247, per=26.63%, avg=97.19, stdev=45.31, samples=31 iops : min= 9, max= 61, avg=23.77, stdev=11.31, samples=31 write: IOPS=23, BW=93.1KiB/s (95.4kB/s)(1508KiB/16192msec); 0 zone resets clat (usec): min=107, max=190681, avg=26105.36, stdev=34037.92 lat (usec): min=107, max=190684, avg=26106.70, stdev=34038.05 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 212], 10.00th=[ 285], 20.00th=[ 392], | 30.00th=[ 1467], 40.00th=[ 6849], 50.00th=[ 14353], 60.00th=[ 19792], | 70.00th=[ 28967], 80.00th=[ 46924], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[158335], 99.50th=[166724], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 23, max= 279, per=24.03%, avg=92.29, stdev=53.81, samples=31 iops : min= 5, max= 69, avg=22.55, stdev=13.50, samples=31 lat (usec) : 10=2.34%, 20=4.04%, 50=12.63%, 100=4.04%, 250=4.43% lat (usec) : 500=9.38%, 750=1.17%, 1000=0.91% lat (msec) : 2=1.69%, 4=2.21%, 10=7.29%, 20=14.58%, 50=22.01% lat (msec) : 100=10.68%, 250=2.60% cpu : usr=0.08%, sys=2.66%, ctx=839, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122540: Tue Apr 14 17:37:18 2026 read: IOPS=23, BW=93.5KiB/s (95.8kB/s)(1508KiB/16123msec) clat (usec): min=6, max=224211, avg=16599.04, stdev=27427.32 lat (usec): min=6, max=224212, avg=16600.17, stdev=27427.20 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 19], 20.00th=[ 29], | 30.00th=[ 38], 40.00th=[ 55], 50.00th=[ 217], 60.00th=[ 11600], | 70.00th=[ 22152], 80.00th=[ 31327], 90.00th=[ 49021], 95.00th=[ 61604], | 99.00th=[126354], 99.50th=[212861], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 15, max= 208, per=25.47%, avg=92.97, stdev=46.82, samples=31 iops : min= 3, max= 52, avg=22.65, stdev=11.77, samples=31 write: IOPS=24, BW=97.0KiB/s (99.3kB/s)(1564KiB/16123msec); 0 zone resets clat (usec): min=132, max=272317, avg=24882.63, stdev=37240.43 lat (usec): min=133, max=272317, avg=24883.85, stdev=37240.56 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 225], 10.00th=[ 273], 20.00th=[ 343], | 30.00th=[ 644], 40.00th=[ 3097], 50.00th=[ 10290], 60.00th=[ 16909], | 70.00th=[ 25822], 80.00th=[ 46924], 90.00th=[ 68682], 95.00th=[ 99091], | 99.00th=[185598], 99.50th=[217056], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 23, max= 199, per=25.18%, avg=96.68, stdev=44.89, samples=31 iops : min= 5, max= 49, avg=23.61, stdev=11.22, samples=31 lat (usec) : 10=1.56%, 20=3.52%, 50=13.93%, 100=4.95%, 250=5.08% lat (usec) : 500=10.81%, 750=1.69%, 1000=0.91% lat (msec) : 2=2.73%, 4=2.21%, 10=6.77%, 20=10.94%, 50=21.88% lat (msec) : 100=9.77%, 250=3.12%, 500=0.13% cpu : usr=0.14%, sys=2.87%, ctx=846, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=366KiB/s (374kB/s), 88.2KiB/s-96.6KiB/s (90.4kB/s-98.9kB/s), io=5988KiB (6132kB), run=16123-16383msec WRITE: bw=385KiB/s (394kB/s), 93.1KiB/s-101KiB/s (95.4kB/s-103kB/s), io=6300KiB (6451kB), run=16123-16383msec rand-rw: (groupid=0, jobs=1): err= 0: pid=122541: Tue Apr 14 17:37:47 2026 read: IOPS=8, BW=32.7KiB/s (33.5kB/s)(1480KiB/45208msec) clat (msec): min=2, max=188, avg=17.60, stdev=22.85 lat (msec): min=2, max=188, avg=17.60, stdev=22.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 21], 90.00th=[ 42], 95.00th=[ 60], | 99.00th=[ 124], 99.50th=[ 180], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 7, max= 95, per=25.38%, avg=33.51, stdev=20.38, samples=85 iops : min= 1, max= 23, avg= 7.88, stdev= 5.14, samples=85 write: IOPS=8, BW=35.2KiB/s (36.1kB/s)(1592KiB/45208msec); 0 zone resets clat (msec): min=26, max=329, avg=96.93, stdev=49.58 lat (msec): min=26, max=329, avg=96.94, stdev=49.58 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 42], 10.00th=[ 50], 20.00th=[ 59], | 30.00th=[ 68], 40.00th=[ 75], 50.00th=[ 82], 60.00th=[ 96], | 70.00th=[ 111], 80.00th=[ 126], 90.00th=[ 167], 95.00th=[ 203], | 99.00th=[ 284], 99.50th=[ 305], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 64, per=24.94%, avg=34.66, stdev=15.62, samples=89 iops : min= 1, max= 16, avg= 8.17, stdev= 4.03, samples=89 lat (msec) : 4=2.99%, 10=20.31%, 20=15.10%, 50=11.85%, 100=30.34% lat (msec) : 250=18.62%, 500=0.78% cpu : usr=0.05%, sys=0.57%, ctx=846, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122542: Tue Apr 14 17:37:47 2026 read: IOPS=7, BW=31.8KiB/s (32.6kB/s)(1436KiB/45094msec) clat (msec): min=2, max=191, avg=16.93, stdev=21.60 lat (msec): min=2, max=191, avg=16.94, stdev=21.60 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 22], 90.00th=[ 36], 95.00th=[ 57], | 99.00th=[ 138], 99.50th=[ 159], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 7, max= 120, per=25.34%, avg=33.45, stdev=24.77, samples=84 iops : min= 1, max= 30, avg= 7.86, stdev= 6.31, samples=84 write: IOPS=9, BW=36.3KiB/s (37.1kB/s)(1636KiB/45094msec); 0 zone resets clat (msec): min=24, max=457, avg=95.15, stdev=52.39 lat (msec): min=24, max=457, avg=95.15, stdev=52.39 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 42], 10.00th=[ 46], 20.00th=[ 57], | 30.00th=[ 64], 40.00th=[ 74], 50.00th=[ 84], 60.00th=[ 92], | 70.00th=[ 107], 80.00th=[ 125], 90.00th=[ 159], 95.00th=[ 197], | 99.00th=[ 296], 99.50th=[ 317], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 80, per=25.73%, avg=35.76, stdev=16.59, samples=89 iops : min= 1, max= 20, avg= 8.44, stdev= 4.25, samples=89 lat (msec) : 4=2.60%, 10=20.57%, 20=13.54%, 50=14.58%, 100=30.47% lat (msec) : 250=17.45%, 500=0.78% cpu : usr=0.06%, sys=0.55%, ctx=833, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122543: Tue Apr 14 17:37:47 2026 read: IOPS=8, BW=35.9KiB/s (36.7kB/s)(1564KiB/43598msec) clat (msec): min=2, max=158, avg=15.09, stdev=16.31 lat (msec): min=2, max=158, avg=15.09, stdev=16.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 14], 80.00th=[ 20], 90.00th=[ 31], 95.00th=[ 48], | 99.00th=[ 88], 99.50th=[ 108], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 7, max= 127, per=28.29%, avg=37.34, stdev=25.12, samples=82 iops : min= 1, max= 31, avg= 8.84, stdev= 6.32, samples=82 write: IOPS=8, BW=34.6KiB/s (35.4kB/s)(1508KiB/43598msec); 0 zone resets clat (msec): min=30, max=450, avg=99.70, stdev=56.57 lat (msec): min=30, max=450, avg=99.70, stdev=56.57 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 44], 10.00th=[ 53], 20.00th=[ 61], | 30.00th=[ 69], 40.00th=[ 74], 50.00th=[ 85], 60.00th=[ 96], | 70.00th=[ 108], 80.00th=[ 126], 90.00th=[ 171], 95.00th=[ 220], | 99.00th=[ 300], 99.50th=[ 351], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 80, per=24.52%, avg=34.08, stdev=15.09, samples=86 iops : min= 1, max= 20, avg= 8.01, stdev= 3.90, samples=86 lat (msec) : 4=2.73%, 10=22.79%, 20=16.28%, 50=11.07%, 100=29.17% lat (msec) : 250=16.28%, 500=1.69% cpu : usr=0.06%, sys=0.65%, ctx=849, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122544: Tue Apr 14 17:37:47 2026 read: IOPS=8, BW=34.6KiB/s (35.4kB/s)(1508KiB/43637msec) clat (msec): min=2, max=181, avg=15.62, stdev=17.90 lat (msec): min=2, max=181, avg=15.62, stdev=17.90 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 15], 80.00th=[ 20], 90.00th=[ 32], 95.00th=[ 50], | 99.00th=[ 93], 99.50th=[ 109], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 7, max= 96, per=27.69%, avg=36.55, stdev=22.23, samples=80 iops : min= 1, max= 24, avg= 8.65, stdev= 5.65, samples=80 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(1564KiB/43637msec); 0 zone resets clat (msec): min=25, max=472, avg=96.28, stdev=53.14 lat (msec): min=25, max=472, avg=96.29, stdev=53.14 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 43], 10.00th=[ 49], 20.00th=[ 59], | 30.00th=[ 67], 40.00th=[ 75], 50.00th=[ 83], 60.00th=[ 93], | 70.00th=[ 108], 80.00th=[ 124], 90.00th=[ 157], 95.00th=[ 199], | 99.00th=[ 317], 99.50th=[ 355], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 72, per=25.46%, avg=35.38, stdev=15.39, samples=86 iops : min= 1, max= 18, avg= 8.34, stdev= 3.94, samples=86 lat (msec) : 4=2.47%, 10=22.14%, 20=15.63%, 50=12.50%, 100=28.78% lat (msec) : 250=17.45%, 500=1.04% cpu : usr=0.06%, sys=0.60%, ctx=840, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=132KiB/s (136kB/s), 31.8KiB/s-35.9KiB/s (32.6kB/s-36.7kB/s), io=5988KiB (6132kB), run=43598-45208msec WRITE: bw=139KiB/s (143kB/s), 34.6KiB/s-36.3KiB/s (35.4kB/s-37.1kB/s), io=6300KiB (6451kB), run=43598-45208msec