== sanity test 398b: DIO and buffer IO race ============== 18:47:47 (1776206867) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.458697 s, 27.4 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147175: Tue Apr 14 18:48:18 2026 read: IOPS=24, BW=97.1KiB/s (99.4kB/s)(1480KiB/15246msec) clat (usec): min=6, max=157453, avg=22685.21, stdev=29150.98 lat (usec): min=6, max=157455, avg=22693.48, stdev=29155.52 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 17], 20.00th=[ 25], | 30.00th=[ 35], 40.00th=[ 51], 50.00th=[ 11731], 60.00th=[ 23462], | 70.00th=[ 32375], 80.00th=[ 43254], 90.00th=[ 60556], 95.00th=[ 74974], | 99.00th=[129500], 99.50th=[143655], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 32, max= 191, per=23.33%, avg=90.28, stdev=37.46, samples=29 iops : min= 8, max= 47, avg=22.00, stdev= 9.38, samples=29 write: IOPS=26, BW=104KiB/s (107kB/s)(1592KiB/15246msec); 0 zone resets clat (usec): min=161, max=136413, avg=17059.40, stdev=21964.18 lat (usec): min=162, max=136417, avg=17066.59, stdev=21959.95 clat percentiles (usec): | 1.00th=[ 174], 5.00th=[ 198], 10.00th=[ 227], 20.00th=[ 310], | 30.00th=[ 469], 40.00th=[ 1795], 50.00th=[ 7111], 60.00th=[ 14484], | 70.00th=[ 23725], 80.00th=[ 31327], 90.00th=[ 51643], 95.00th=[ 62129], | 99.00th=[ 96994], 99.50th=[106431], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 31, max= 220, per=23.97%, avg=97.55, stdev=45.39, samples=29 iops : min= 7, max= 55, avg=23.86, stdev=11.46, samples=29 lat (usec) : 10=1.43%, 20=4.69%, 50=12.76%, 100=1.95%, 250=7.42% lat (usec) : 500=9.11%, 750=2.86%, 1000=1.04% lat (msec) : 2=1.95%, 4=2.21%, 10=5.34%, 20=10.94%, 50=25.39% lat (msec) : 100=11.07%, 250=1.82% cpu : usr=0.18%, sys=3.10%, ctx=761, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147176: Tue Apr 14 18:48:18 2026 read: IOPS=23, BW=92.8KiB/s (95.1kB/s)(1436KiB/15469msec) clat (usec): min=7, max=333632, avg=25066.62, stdev=31625.35 lat (usec): min=7, max=333633, avg=25067.93, stdev=31625.67 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 19], 20.00th=[ 30], | 30.00th=[ 41], 40.00th=[ 1303], 50.00th=[ 20055], 60.00th=[ 28705], | 70.00th=[ 36963], 80.00th=[ 46924], 90.00th=[ 57934], 95.00th=[ 67634], | 99.00th=[124257], 99.50th=[173016], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 207, per=23.57%, avg=91.23, stdev=41.93, samples=30 iops : min= 1, max= 51, avg=22.30, stdev=10.57, samples=30 write: IOPS=26, BW=106KiB/s (108kB/s)(1636KiB/15469msec); 0 zone resets clat (usec): min=162, max=125846, avg=15536.50, stdev=21003.11 lat (usec): min=163, max=125848, avg=15544.86, stdev=20999.08 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 198], 10.00th=[ 225], 20.00th=[ 285], | 30.00th=[ 392], 40.00th=[ 1012], 50.00th=[ 7963], 60.00th=[ 13435], | 70.00th=[ 19792], 80.00th=[ 28705], 90.00th=[ 45351], 95.00th=[ 59507], | 99.00th=[ 82314], 99.50th=[104334], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 23, max= 175, per=25.44%, avg=103.53, stdev=35.67, samples=30 iops : min= 5, max= 43, avg=25.33, stdev= 9.00, samples=30 lat (usec) : 10=1.30%, 20=3.65%, 50=10.94%, 100=2.21%, 250=7.81% lat (usec) : 500=11.59%, 750=1.56%, 1000=0.78% lat (msec) : 2=2.34%, 4=1.30%, 10=5.73%, 20=12.11%, 50=27.47% lat (msec) : 100=9.90%, 250=1.17%, 500=0.13% cpu : usr=0.16%, sys=3.13%, ctx=790, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147177: Tue Apr 14 18:48:18 2026 read: IOPS=25, BW=102KiB/s (105kB/s)(1564KiB/15323msec) clat (usec): min=7, max=348193, avg=23975.59, stdev=30891.48 lat (usec): min=7, max=348194, avg=23982.58, stdev=30894.02 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 16], 20.00th=[ 26], | 30.00th=[ 36], 40.00th=[ 67], 50.00th=[ 19006], 60.00th=[ 26870], | 70.00th=[ 34341], 80.00th=[ 44303], 90.00th=[ 59507], 95.00th=[ 69731], | 99.00th=[ 96994], 99.50th=[164627], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 167, per=25.86%, avg=100.07, stdev=33.78, samples=29 iops : min= 7, max= 41, avg=24.48, stdev= 8.57, samples=29 write: IOPS=24, BW=98.4KiB/s (101kB/s)(1508KiB/15323msec); 0 zone resets clat (usec): min=155, max=117910, avg=15627.39, stdev=22546.65 lat (usec): min=155, max=117912, avg=15632.69, stdev=22557.95 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 198], 10.00th=[ 227], 20.00th=[ 285], | 30.00th=[ 379], 40.00th=[ 758], 50.00th=[ 4621], 60.00th=[ 12256], | 70.00th=[ 19006], 80.00th=[ 27132], 90.00th=[ 46400], 95.00th=[ 64750], | 99.00th=[104334], 99.50th=[116917], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 30, max= 204, per=22.80%, avg=92.79, stdev=38.13, samples=29 iops : min= 7, max= 51, avg=22.66, stdev= 9.64, samples=29 lat (usec) : 10=1.95%, 20=5.08%, 50=12.37%, 100=1.17%, 250=6.90% lat (usec) : 500=10.94%, 750=2.21%, 1000=0.91% lat (msec) : 2=2.34%, 4=1.43%, 10=4.82%, 20=10.55%, 50=27.47% lat (msec) : 100=10.94%, 250=0.78%, 500=0.13% cpu : usr=0.17%, sys=3.16%, ctx=752, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147178: Tue Apr 14 18:48:18 2026 read: IOPS=24, BW=97.5KiB/s (99.9kB/s)(1508KiB/15463msec) clat (usec): min=7, max=202278, avg=25615.51, stdev=31396.10 lat (usec): min=7, max=202280, avg=25616.54, stdev=31396.28 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 23], | 30.00th=[ 35], 40.00th=[ 52], 50.00th=[ 16188], 60.00th=[ 28705], | 70.00th=[ 36963], 80.00th=[ 46924], 90.00th=[ 67634], 95.00th=[ 92799], | 99.00th=[124257], 99.50th=[156238], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 30, max= 205, per=24.40%, avg=94.43, stdev=39.84, samples=30 iops : min= 7, max= 51, avg=23.07, stdev=10.11, samples=30 write: IOPS=25, BW=101KiB/s (104kB/s)(1564KiB/15463msec); 0 zone resets clat (usec): min=166, max=111757, avg=14494.07, stdev=19946.07 lat (usec): min=166, max=111758, avg=14495.14, stdev=19946.04 clat percentiles (usec): | 1.00th=[ 178], 5.00th=[ 204], 10.00th=[ 233], 20.00th=[ 293], | 30.00th=[ 359], 40.00th=[ 635], 50.00th=[ 4948], 60.00th=[ 10945], | 70.00th=[ 18744], 80.00th=[ 29230], 90.00th=[ 42730], 95.00th=[ 54789], | 99.00th=[ 87557], 99.50th=[107480], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 15, max= 221, per=24.07%, avg=97.97, stdev=45.82, samples=30 iops : min= 3, max= 55, avg=23.97, stdev=11.54, samples=30 lat (usec) : 10=1.82%, 20=6.64%, 50=10.94%, 100=1.43%, 250=7.68% lat (usec) : 500=11.72%, 750=2.21%, 1000=1.30% lat (msec) : 2=1.17%, 4=1.95%, 10=5.21%, 20=9.38%, 50=26.69% lat (msec) : 100=9.64%, 250=2.21% cpu : usr=0.14%, sys=2.86%, ctx=753, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=387KiB/s (396kB/s), 92.8KiB/s-102KiB/s (95.1kB/s-105kB/s), io=5988KiB (6132kB), run=15246-15469msec WRITE: bw=407KiB/s (417kB/s), 98.4KiB/s-106KiB/s (101kB/s-108kB/s), io=6300KiB (6451kB), run=15246-15469msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147180: Tue Apr 14 18:48:28 2026 read: IOPS=14, BW=58.3KiB/s (59.7kB/s)(1480KiB/25394msec) clat (msec): min=3, max=244, avg=24.92, stdev=25.26 lat (msec): min=3, max=244, avg=24.92, stdev=25.26 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 78], | 99.00th=[ 114], 99.50th=[ 146], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 16, max= 166, per=24.78%, avg=57.98, stdev=32.48, samples=50 iops : min= 4, max= 41, avg=13.84, stdev= 8.14, samples=50 write: IOPS=15, BW=62.7KiB/s (64.2kB/s)(1592KiB/25394msec); 0 zone resets clat (msec): min=8, max=160, avg=40.46, stdev=25.30 lat (msec): min=8, max=160, avg=40.46, stdev=25.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 75], 95.00th=[ 102], | 99.00th=[ 121], 99.50th=[ 128], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 8, max= 134, per=25.36%, avg=62.38, stdev=32.42, samples=50 iops : min= 2, max= 33, avg=14.94, stdev= 8.09, samples=50 lat (msec) : 4=0.26%, 10=10.81%, 20=26.30%, 50=43.75%, 100=15.36% lat (msec) : 250=3.52% cpu : usr=0.15%, sys=1.18%, ctx=878, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147181: Tue Apr 14 18:48:28 2026 read: IOPS=14, BW=56.2KiB/s (57.5kB/s)(1436KiB/25570msec) clat (msec): min=3, max=244, avg=24.34, stdev=24.61 lat (msec): min=3, max=244, avg=24.34, stdev=24.61 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 51], 95.00th=[ 74], | 99.00th=[ 112], 99.50th=[ 155], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 7, max= 134, per=24.11%, avg=56.43, stdev=32.97, samples=49 iops : min= 1, max= 33, avg=13.45, stdev= 8.21, samples=49 write: IOPS=15, BW=63.0KiB/s (65.5kB/s)(1636KiB/25570msec); 0 zone resets clat (msec): min=6, max=160, avg=41.06, stdev=25.93 lat (msec): min=6, max=160, avg=41.06, stdev=25.93 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 77], 95.00th=[ 91], | 99.00th=[ 142], 99.50th=[ 148], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 15, max= 119, per=25.32%, avg=62.28, stdev=27.89, samples=50 iops : min= 3, max= 29, avg=14.92, stdev= 6.97, samples=50 lat (msec) : 4=0.13%, 10=11.59%, 20=26.17%, 50=44.66%, 100=14.45% lat (msec) : 250=2.99% cpu : usr=0.15%, sys=1.08%, ctx=841, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147182: Tue Apr 14 18:48:28 2026 read: IOPS=15, BW=62.4KiB/s (63.9kB/s)(1564KiB/25059msec) clat (msec): min=2, max=157, avg=24.66, stdev=22.81 lat (msec): min=2, max=157, avg=24.66, stdev=22.81 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 36], 90.00th=[ 52], 95.00th=[ 74], | 99.00th=[ 113], 99.50th=[ 140], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 15, max= 159, per=26.65%, avg=62.37, stdev=36.41, samples=49 iops : min= 3, max= 39, avg=14.94, stdev= 9.09, samples=49 write: IOPS=15, BW=60.2KiB/s (61.6kB/s)(1508KiB/25059msec); 0 zone resets clat (msec): min=7, max=270, avg=40.77, stdev=25.98 lat (msec): min=7, max=270, avg=40.78, stdev=25.98 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 56], 90.00th=[ 74], 95.00th=[ 91], | 99.00th=[ 127], 99.50th=[ 150], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 126, per=24.00%, avg=59.04, stdev=29.79, samples=49 iops : min= 1, max= 31, avg=14.10, stdev= 7.47, samples=49 lat (msec) : 4=0.52%, 10=10.81%, 20=25.78%, 50=44.27%, 100=16.67% lat (msec) : 250=1.82%, 500=0.13% cpu : usr=0.12%, sys=1.31%, ctx=867, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147183: Tue Apr 14 18:48:28 2026 read: IOPS=14, BW=59.1KiB/s (60.5kB/s)(1508KiB/25520msec) clat (msec): min=2, max=337, avg=24.73, stdev=26.92 lat (msec): min=2, max=337, avg=24.73, stdev=26.92 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 54], 95.00th=[ 77], | 99.00th=[ 112], 99.50th=[ 130], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 17, max= 119, per=24.75%, avg=57.92, stdev=27.60, samples=50 iops : min= 4, max= 29, avg=13.82, stdev= 6.90, samples=50 write: IOPS=15, BW=61.3KiB/s (62.8kB/s)(1564KiB/25520msec); 0 zone resets clat (msec): min=9, max=197, avg=41.27, stdev=27.10 lat (msec): min=9, max=197, avg=41.27, stdev=27.10 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 56], 90.00th=[ 75], 95.00th=[ 94], | 99.00th=[ 150], 99.50th=[ 194], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 15, max= 127, per=24.63%, avg=60.58, stdev=31.17, samples=50 iops : min= 3, max= 31, avg=14.48, stdev= 7.80, samples=50 lat (msec) : 4=0.39%, 10=11.59%, 20=24.22%, 50=45.83%, 100=14.97% lat (msec) : 250=2.86%, 500=0.13% cpu : usr=0.13%, sys=1.09%, ctx=865, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=234KiB/s (240kB/s), 56.2KiB/s-62.4KiB/s (57.5kB/s-63.9kB/s), io=5988KiB (6132kB), run=25059-25570msec WRITE: bw=246KiB/s (252kB/s), 60.2KiB/s-63.0KiB/s (61.6kB/s-65.5kB/s), io=6300KiB (6451kB), run=25059-25570msec