== sanity test 398b: DIO and buffer IO race ============== 14:29:43 (1776191383) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.2817 s, 44.7 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=124438: Tue Apr 14 14:30:14 2026 read: IOPS=19, BW=77.6KiB/s (79.5kB/s)(1480KiB/19063msec) clat (usec): min=4, max=275448, avg=19667.26, stdev=34275.95 lat (usec): min=4, max=275448, avg=19668.17, stdev=34275.99 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 20], | 30.00th=[ 29], 40.00th=[ 41], 50.00th=[ 64], 60.00th=[ 13698], | 70.00th=[ 27132], 80.00th=[ 34866], 90.00th=[ 54264], 95.00th=[ 74974], | 99.00th=[200279], 99.50th=[254804], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 15, max= 191, per=27.03%, avg=77.30, stdev=43.25, samples=37 iops : min= 3, max= 47, avg=18.68, stdev=10.78, samples=37 write: IOPS=20, BW=83.5KiB/s (85.5kB/s)(1592KiB/19063msec); 0 zone resets clat (usec): min=154, max=281789, avg=29406.76, stdev=47229.85 lat (usec): min=154, max=281789, avg=29407.85, stdev=47229.84 clat percentiles (usec): | 1.00th=[ 182], 5.00th=[ 204], 10.00th=[ 229], 20.00th=[ 302], | 30.00th=[ 371], 40.00th=[ 742], 50.00th=[ 6259], 60.00th=[ 16057], | 70.00th=[ 29754], 80.00th=[ 50070], 90.00th=[ 95945], 95.00th=[139461], | 99.00th=[217056], 99.50th=[270533], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 15, max= 159, per=27.84%, avg=83.51, stdev=35.59, samples=37 iops : min= 3, max= 39, avg=20.24, stdev= 8.86, samples=37 lat (usec) : 10=2.99%, 20=6.64%, 50=12.63%, 100=3.12%, 250=7.81% lat (usec) : 500=11.46%, 750=2.86%, 1000=0.91% lat (msec) : 2=1.82%, 4=1.30%, 10=3.39%, 20=8.72%, 50=20.44% lat (msec) : 100=9.77%, 250=5.60%, 500=0.52% cpu : usr=0.10%, sys=1.96%, ctx=689, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=124439: Tue Apr 14 14:30:14 2026 read: IOPS=17, BW=68.6KiB/s (70.2kB/s)(1436KiB/20933msec) clat (usec): min=6, max=249254, avg=21901.31, stdev=34634.50 lat (usec): min=6, max=249255, avg=21902.26, stdev=34634.46 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 25], | 30.00th=[ 32], 40.00th=[ 47], 50.00th=[ 97], 60.00th=[ 17957], | 70.00th=[ 30278], 80.00th=[ 42206], 90.00th=[ 65274], 95.00th=[ 87557], | 99.00th=[152044], 99.50th=[244319], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 15, max= 183, per=23.47%, avg=67.12, stdev=34.28, samples=41 iops : min= 3, max= 45, avg=16.12, stdev= 8.57, samples=41 write: IOPS=19, BW=78.2KiB/s (80.0kB/s)(1636KiB/20933msec); 0 zone resets clat (usec): min=174, max=264086, avg=31689.10, stdev=48071.69 lat (usec): min=174, max=264087, avg=31690.27, stdev=48071.65 clat percentiles (usec): | 1.00th=[ 184], 5.00th=[ 202], 10.00th=[ 223], 20.00th=[ 285], | 30.00th=[ 404], 40.00th=[ 2507], 50.00th=[ 10814], 60.00th=[ 20579], | 70.00th=[ 34866], 80.00th=[ 54789], 90.00th=[ 99091], 95.00th=[141558], | 99.00th=[198181], 99.50th=[238027], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 16, max= 294, per=25.38%, avg=76.15, stdev=47.79, samples=41 iops : min= 4, max= 73, avg=18.39, stdev=11.95, samples=41 lat (usec) : 10=1.82%, 20=5.08%, 50=12.50%, 100=4.17%, 250=8.33% lat (usec) : 500=9.90%, 750=1.95%, 1000=0.78% lat (msec) : 2=1.69%, 4=2.21%, 10=3.78%, 20=8.59%, 50=19.14% lat (msec) : 100=13.54%, 250=6.25%, 500=0.26% cpu : usr=0.13%, sys=2.63%, ctx=797, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=124440: Tue Apr 14 14:30:14 2026 read: IOPS=20, BW=80.0KiB/s (81.9kB/s)(1564KiB/19545msec) clat (usec): min=5, max=351564, avg=20993.35, stdev=37351.27 lat (usec): min=6, max=351564, avg=20994.54, stdev=37351.28 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 12], 20.00th=[ 22], | 30.00th=[ 30], 40.00th=[ 39], 50.00th=[ 65], 60.00th=[ 12780], | 70.00th=[ 23987], 80.00th=[ 40109], 90.00th=[ 61080], 95.00th=[ 84411], | 99.00th=[202376], 99.50th=[267387], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 14, max= 231, per=28.31%, avg=80.97, stdev=46.39, samples=38 iops : min= 3, max= 57, avg=19.58, stdev=11.61, samples=38 write: IOPS=19, BW=77.2KiB/s (79.0kB/s)(1508KiB/19545msec); 0 zone resets clat (usec): min=162, max=296624, avg=29493.77, stdev=48393.99 lat (usec): min=163, max=296625, avg=29499.42, stdev=48391.42 clat percentiles (usec): | 1.00th=[ 186], 5.00th=[ 208], 10.00th=[ 239], 20.00th=[ 310], | 30.00th=[ 404], 40.00th=[ 1516], 50.00th=[ 8717], 60.00th=[ 19268], | 70.00th=[ 31065], 80.00th=[ 45876], 90.00th=[ 87557], 95.00th=[131597], | 99.00th=[246416], 99.50th=[287310], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 23, max= 159, per=25.56%, avg=76.68, stdev=35.15, samples=38 iops : min= 5, max= 39, avg=18.53, stdev= 8.77, samples=38 lat (usec) : 10=3.91%, 20=5.86%, 50=13.67%, 100=3.39%, 250=6.38% lat (usec) : 500=11.07%, 750=1.82%, 1000=0.65% lat (msec) : 2=1.82%, 4=2.60%, 10=3.52%, 20=8.33%, 50=21.35% lat (msec) : 100=9.90%, 250=5.08%, 500=0.65% cpu : usr=0.09%, sys=2.02%, ctx=761, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=124443: Tue Apr 14 14:30:14 2026 read: IOPS=18, BW=75.8KiB/s (77.6kB/s)(1508KiB/19890msec) clat (usec): min=7, max=230766, avg=20600.85, stdev=29900.65 lat (usec): min=7, max=230766, avg=20601.75, stdev=29900.63 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 25], | 30.00th=[ 34], 40.00th=[ 45], 50.00th=[ 184], 60.00th=[ 21365], | 70.00th=[ 29230], 80.00th=[ 40633], 90.00th=[ 57934], 95.00th=[ 74974], | 99.00th=[121111], 99.50th=[181404], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 166, per=26.74%, avg=76.47, stdev=41.40, samples=38 iops : min= 1, max= 41, avg=18.47, stdev=10.37, samples=38 write: IOPS=19, BW=78.6KiB/s (80.5kB/s)(1564KiB/19890msec); 0 zone resets clat (usec): min=158, max=348449, avg=30614.54, stdev=53518.26 lat (usec): min=158, max=348450, avg=30615.70, stdev=53518.29 clat percentiles (usec): | 1.00th=[ 180], 5.00th=[ 208], 10.00th=[ 239], 20.00th=[ 310], | 30.00th=[ 392], 40.00th=[ 783], 50.00th=[ 5932], 60.00th=[ 17433], | 70.00th=[ 29230], 80.00th=[ 45876], 90.00th=[ 85459], 95.00th=[145753], | 99.00th=[256902], 99.50th=[299893], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 14, max= 151, per=25.91%, avg=77.74, stdev=37.06, samples=39 iops : min= 3, max= 37, avg=18.79, stdev= 9.29, samples=39 lat (usec) : 10=1.82%, 20=6.38%, 50=12.76%, 100=3.12%, 250=6.51% lat (usec) : 500=12.63%, 750=2.47%, 1000=0.65% lat (msec) : 2=2.60%, 4=1.43%, 10=3.12%, 20=6.90%, 50=23.05% lat (msec) : 100=11.46%, 250=4.30%, 500=0.78% cpu : usr=0.06%, sys=1.81%, ctx=738, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=286KiB/s (293kB/s), 68.6KiB/s-80.0KiB/s (70.2kB/s-81.9kB/s), io=5988KiB (6132kB), run=19063-20933msec WRITE: bw=301KiB/s (308kB/s), 77.2KiB/s-83.5KiB/s (79.0kB/s-85.5kB/s), io=6300KiB (6451kB), run=19063-20933msec rand-rw: (groupid=0, jobs=1): err= 0: pid=124441: Tue Apr 14 14:30:52 2026 read: IOPS=6, BW=25.5KiB/s (26.1kB/s)(1480KiB/58076msec) clat (msec): min=3, max=314, avg=22.04, stdev=27.83 lat (msec): min=3, max=314, avg=22.04, stdev=27.83 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 47], 95.00th=[ 74], | 99.00th=[ 140], 99.50th=[ 165], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 80, per=26.94%, avg=27.21, stdev=17.31, samples=104 iops : min= 1, max= 20, avg= 6.21, stdev= 4.40, samples=104 write: IOPS=6, BW=27.4KiB/s (28.1kB/s)(1592KiB/58076msec); 0 zone resets clat (msec): min=34, max=544, avg=124.99, stdev=66.10 lat (msec): min=34, max=544, avg=124.99, stdev=66.10 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 65], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 108], 60.00th=[ 120], | 70.00th=[ 134], 80.00th=[ 157], 90.00th=[ 213], 95.00th=[ 279], | 99.00th=[ 347], 99.50th=[ 393], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 56, per=25.98%, avg=27.54, stdev=11.55, samples=111 iops : min= 1, max= 14, avg= 6.29, stdev= 2.96, samples=111 lat (msec) : 4=0.39%, 10=15.63%, 20=17.19%, 50=13.15%, 100=22.14% lat (msec) : 250=28.13%, 500=3.26%, 750=0.13% cpu : usr=0.07%, sys=0.48%, ctx=856, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=124442: Tue Apr 14 14:30:52 2026 read: IOPS=6, BW=24.3KiB/s (24.9kB/s)(1436KiB/59095msec) clat (msec): min=3, max=223, avg=21.71, stdev=26.01 lat (msec): min=3, max=223, avg=21.71, stdev=26.01 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 44], 95.00th=[ 67], | 99.00th=[ 161], 99.50th=[ 190], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 7, max= 85, per=27.87%, avg=28.15, stdev=18.16, samples=99 iops : min= 1, max= 21, avg= 6.46, stdev= 4.63, samples=99 write: IOPS=6, BW=27.7KiB/s (28.3kB/s)(1636KiB/59095msec); 0 zone resets clat (msec): min=37, max=588, avg=124.81, stdev=74.40 lat (msec): min=37, max=588, avg=124.81, stdev=74.40 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 73], | 30.00th=[ 85], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 115], | 70.00th=[ 132], 80.00th=[ 169], 90.00th=[ 213], 95.00th=[ 275], | 99.00th=[ 418], 99.50th=[ 447], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 56, per=25.55%, avg=27.09, stdev=12.93, samples=117 iops : min= 1, max= 14, avg= 6.18, stdev= 3.33, samples=117 lat (msec) : 4=0.26%, 10=12.24%, 20=20.57%, 50=11.85%, 100=26.17% lat (msec) : 250=25.65%, 500=3.12%, 750=0.13% cpu : usr=0.05%, sys=0.51%, ctx=881, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=124444: Tue Apr 14 14:30:52 2026 read: IOPS=6, BW=27.4KiB/s (28.1kB/s)(1564KiB/57028msec) clat (msec): min=3, max=396, avg=22.28, stdev=32.86 lat (msec): min=3, max=396, avg=22.28, stdev=32.86 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 26], 90.00th=[ 41], 95.00th=[ 74], | 99.00th=[ 155], 99.50th=[ 249], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 111, per=29.12%, avg=29.41, stdev=22.14, samples=103 iops : min= 1, max= 27, avg= 6.77, stdev= 5.56, samples=103 write: IOPS=6, BW=26.4KiB/s (27.1kB/s)(1508KiB/57028msec); 0 zone resets clat (msec): min=34, max=470, avg=127.56, stdev=71.80 lat (msec): min=34, max=470, avg=127.57, stdev=71.80 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 109], 60.00th=[ 117], | 70.00th=[ 130], 80.00th=[ 157], 90.00th=[ 211], 95.00th=[ 288], | 99.00th=[ 397], 99.50th=[ 464], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 55, per=24.50%, avg=25.97, stdev=11.39, samples=111 iops : min= 1, max= 13, avg= 5.88, stdev= 2.91, samples=111 lat (msec) : 4=0.26%, 10=15.76%, 20=20.44%, 50=11.72%, 100=21.61% lat (msec) : 250=27.08%, 500=3.12% cpu : usr=0.05%, sys=0.61%, ctx=901, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=124445: Tue Apr 14 14:30:52 2026 read: IOPS=6, BW=25.7KiB/s (26.3kB/s)(1508KiB/58616msec) clat (msec): min=3, max=304, avg=23.27, stdev=34.16 lat (msec): min=3, max=304, avg=23.27, stdev=34.16 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 50], 95.00th=[ 83], | 99.00th=[ 186], 99.50th=[ 243], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 79, per=27.84%, avg=28.12, stdev=19.09, samples=103 iops : min= 1, max= 19, avg= 6.45, stdev= 4.79, samples=103 write: IOPS=6, BW=26.7KiB/s (27.3kB/s)(1564KiB/58616msec); 0 zone resets clat (msec): min=41, max=529, avg=127.15, stdev=70.40 lat (msec): min=41, max=529, avg=127.15, stdev=70.40 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 77], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 110], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 163], 90.00th=[ 218], 95.00th=[ 279], | 99.00th=[ 414], 99.50th=[ 430], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 55, per=24.88%, avg=26.37, stdev=12.44, samples=115 iops : min= 1, max= 13, avg= 6.00, stdev= 3.18, samples=115 lat (msec) : 4=0.39%, 10=16.02%, 20=18.88%, 50=10.16%, 100=23.31% lat (msec) : 250=27.47%, 500=3.65%, 750=0.13% cpu : usr=0.06%, sys=0.53%, ctx=871, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=101KiB/s (104kB/s), 24.3KiB/s-27.4KiB/s (24.9kB/s-28.1kB/s), io=5988KiB (6132kB), run=57028-59095msec WRITE: bw=107KiB/s (109kB/s), 26.4KiB/s-27.7KiB/s (27.1kB/s-28.3kB/s), io=6300KiB (6451kB), run=57028-59095msec