== sanity test 398b: DIO and buffer IO race ============== 17:55:41 (1776203741) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.323813 s, 38.9 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=122213: Tue Apr 14 17:56:07 2026 read: IOPS=25, BW=101KiB/s (103kB/s)(1480KiB/14697msec) clat (usec): min=6, max=151854, avg=16598.03, stdev=22902.36 lat (usec): min=6, max=151855, avg=16599.97, stdev=22902.33 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 18], 20.00th=[ 31], | 30.00th=[ 41], 40.00th=[ 58], 50.00th=[ 3392], 60.00th=[ 17171], | 70.00th=[ 24249], 80.00th=[ 31851], 90.00th=[ 41157], 95.00th=[ 55313], | 99.00th=[114820], 99.50th=[135267], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 31, max= 191, per=24.65%, avg=100.34, stdev=39.14, samples=29 iops : min= 7, max= 47, avg=24.41, stdev= 9.78, samples=29 write: IOPS=27, BW=108KiB/s (111kB/s)(1592KiB/14697msec); 0 zone resets clat (usec): min=168, max=227967, avg=21438.18, stdev=31456.54 lat (usec): min=168, max=227968, avg=21440.93, stdev=31457.10 clat percentiles (usec): | 1.00th=[ 192], 5.00th=[ 241], 10.00th=[ 281], 20.00th=[ 351], | 30.00th=[ 494], 40.00th=[ 4178], 50.00th=[ 10683], 60.00th=[ 16188], | 70.00th=[ 22676], 80.00th=[ 36439], 90.00th=[ 58459], 95.00th=[ 81265], | 99.00th=[164627], 99.50th=[196084], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 33, max= 207, per=25.31%, avg=108.34, stdev=45.02, samples=29 iops : min= 8, max= 51, avg=26.41, stdev=11.26, samples=29 lat (usec) : 10=1.17%, 20=4.30%, 50=11.98%, 100=4.82%, 250=3.65% lat (usec) : 500=13.02%, 750=1.30%, 1000=1.04% lat (msec) : 2=1.56%, 4=2.08%, 10=5.34%, 20=14.06%, 50=26.30% lat (msec) : 100=6.90%, 250=2.47% cpu : usr=0.18%, sys=3.33%, ctx=861, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122214: Tue Apr 14 17:56:07 2026 read: IOPS=24, BW=99.2KiB/s (102kB/s)(1436KiB/14482msec) clat (usec): min=6, max=205411, avg=15604.41, stdev=24096.59 lat (usec): min=6, max=205412, avg=15605.46, stdev=24096.61 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 28], | 30.00th=[ 40], 40.00th=[ 49], 50.00th=[ 96], 60.00th=[ 13173], | 70.00th=[ 23462], 80.00th=[ 31589], 90.00th=[ 43779], 95.00th=[ 58459], | 99.00th=[ 78119], 99.50th=[175113], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 6, max= 159, per=24.32%, avg=99.00, stdev=39.90, samples=28 iops : min= 1, max= 39, avg=24.07, stdev=10.00, samples=28 write: IOPS=28, BW=113KiB/s (116kB/s)(1636KiB/14482msec); 0 zone resets clat (usec): min=171, max=246333, avg=21653.38, stdev=31676.71 lat (usec): min=171, max=246335, avg=21654.64, stdev=31676.80 clat percentiles (usec): | 1.00th=[ 192], 5.00th=[ 223], 10.00th=[ 285], 20.00th=[ 367], | 30.00th=[ 881], 40.00th=[ 6063], 50.00th=[ 11863], 60.00th=[ 16909], | 70.00th=[ 25822], 80.00th=[ 36439], 90.00th=[ 51643], 95.00th=[ 77071], | 99.00th=[164627], 99.50th=[206570], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 26, max= 206, per=25.82%, avg=110.50, stdev=43.31, samples=28 iops : min= 6, max= 51, avg=26.96, stdev=10.86, samples=28 lat (usec) : 10=1.56%, 20=5.34%, 50=12.24%, 100=4.56%, 250=4.17% lat (usec) : 500=10.68%, 750=1.95%, 1000=0.91% lat (msec) : 2=1.95%, 4=1.43%, 10=6.77%, 20=13.80%, 50=25.13% lat (msec) : 100=7.81%, 250=1.69% cpu : usr=0.18%, sys=3.27%, ctx=849, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122215: Tue Apr 14 17:56:07 2026 read: IOPS=27, BW=111KiB/s (113kB/s)(1564KiB/14131msec) clat (usec): min=7, max=235372, avg=16182.42, stdev=23522.41 lat (usec): min=7, max=235374, avg=16188.54, stdev=23519.23 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 20], 20.00th=[ 32], | 30.00th=[ 44], 40.00th=[ 72], 50.00th=[ 7767], 60.00th=[ 16188], | 70.00th=[ 22676], 80.00th=[ 29492], 90.00th=[ 42730], 95.00th=[ 56361], | 99.00th=[ 85459], 99.50th=[168821], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 13, max= 318, per=27.55%, avg=112.11, stdev=63.56, samples=27 iops : min= 3, max= 79, avg=27.37, stdev=15.93, samples=27 write: IOPS=26, BW=107KiB/s (109kB/s)(1508KiB/14131msec); 0 zone resets clat (usec): min=177, max=263764, avg=20612.66, stdev=30380.01 lat (usec): min=178, max=263766, avg=20627.90, stdev=30401.15 clat percentiles (usec): | 1.00th=[ 192], 5.00th=[ 219], 10.00th=[ 255], 20.00th=[ 363], | 30.00th=[ 709], 40.00th=[ 2245], 50.00th=[ 9372], 60.00th=[ 15008], | 70.00th=[ 22938], 80.00th=[ 36439], 90.00th=[ 58983], 95.00th=[ 80217], | 99.00th=[147850], 99.50th=[183501], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 19, max= 190, per=24.94%, avg=106.74, stdev=39.60, samples=27 iops : min= 4, max= 47, avg=26.00, stdev= 9.98, samples=27 lat (usec) : 10=1.17%, 20=4.17%, 50=11.98%, 100=3.91%, 250=6.12% lat (usec) : 500=10.03%, 750=1.82%, 1000=1.17% lat (msec) : 2=2.99%, 4=2.21%, 10=6.12%, 20=14.71%, 50=23.83% lat (msec) : 100=8.46%, 250=1.17%, 500=0.13% cpu : usr=0.16%, sys=3.01%, ctx=839, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122216: Tue Apr 14 17:56:07 2026 read: IOPS=26, BW=107KiB/s (109kB/s)(1508KiB/14116msec) clat (usec): min=6, max=108881, avg=14062.67, stdev=20927.57 lat (usec): min=6, max=108881, avg=14063.69, stdev=20927.61 clat percentiles (usec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 17], 20.00th=[ 28], | 30.00th=[ 36], 40.00th=[ 47], 50.00th=[ 79], 60.00th=[ 9896], | 70.00th=[ 19268], 80.00th=[ 30802], 90.00th=[ 46400], 95.00th=[ 60031], | 99.00th=[ 84411], 99.50th=[106431], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 7, max= 207, per=25.68%, avg=104.52, stdev=53.20, samples=27 iops : min= 1, max= 51, avg=25.44, stdev=13.34, samples=27 write: IOPS=27, BW=111KiB/s (113kB/s)(1564KiB/14116msec); 0 zone resets clat (usec): min=178, max=218051, avg=22443.92, stdev=33469.12 lat (usec): min=179, max=218053, avg=22469.61, stdev=33467.73 clat percentiles (usec): | 1.00th=[ 194], 5.00th=[ 225], 10.00th=[ 249], 20.00th=[ 347], | 30.00th=[ 523], 40.00th=[ 2835], 50.00th=[ 9372], 60.00th=[ 16712], | 70.00th=[ 25297], 80.00th=[ 38011], 90.00th=[ 62129], 95.00th=[ 90702], | 99.00th=[156238], 99.50th=[210764], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 23, max= 183, per=25.56%, avg=109.41, stdev=41.81, samples=27 iops : min= 5, max= 45, avg=26.70, stdev=10.41, samples=27 lat (usec) : 10=2.08%, 20=4.04%, 50=14.97%, 100=4.30%, 250=6.51% lat (usec) : 500=9.90%, 750=1.43%, 1000=1.30% lat (msec) : 2=2.08%, 4=2.73%, 10=6.38%, 20=12.24%, 50=21.61% lat (msec) : 100=8.33%, 250=2.08% cpu : usr=0.13%, sys=3.05%, ctx=784, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=407KiB/s (417kB/s), 99.2KiB/s-111KiB/s (102kB/s-113kB/s), io=5988KiB (6132kB), run=14116-14697msec WRITE: bw=429KiB/s (439kB/s), 107KiB/s-113KiB/s (109kB/s-116kB/s), io=6300KiB (6451kB), run=14116-14697msec rand-rw: (groupid=0, jobs=1): err= 0: pid=122208: Tue Apr 14 17:56:39 2026 read: IOPS=8, BW=32.0KiB/s (32.8kB/s)(1480KiB/46230msec) clat (msec): min=3, max=340, avg=21.47, stdev=30.86 lat (msec): min=3, max=340, avg=21.47, stdev=30.86 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 40], 95.00th=[ 62], | 99.00th=[ 133], 99.50th=[ 321], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 103, per=26.08%, avg=33.39, stdev=18.64, samples=85 iops : min= 1, max= 25, avg= 7.74, stdev= 4.71, samples=85 write: IOPS=8, BW=34.4KiB/s (35.3kB/s)(1592KiB/46230msec); 0 zone resets clat (msec): min=27, max=362, avg=96.02, stdev=43.17 lat (msec): min=27, max=362, avg=96.03, stdev=43.17 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 55], 20.00th=[ 65], | 30.00th=[ 71], 40.00th=[ 81], 50.00th=[ 86], 60.00th=[ 94], | 70.00th=[ 106], 80.00th=[ 120], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 249], 99.50th=[ 342], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 56, per=24.99%, avg=33.74, stdev=12.12, samples=91 iops : min= 1, max= 14, avg= 7.82, stdev= 3.07, samples=91 lat (msec) : 4=0.91%, 10=15.36%, 20=17.58%, 50=14.58%, 100=32.29% lat (msec) : 250=18.62%, 500=0.65% cpu : usr=0.09%, sys=0.72%, ctx=920, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122209: Tue Apr 14 17:56:39 2026 read: IOPS=7, BW=30.8KiB/s (31.5kB/s)(1436KiB/46613msec) clat (msec): min=3, max=203, avg=20.42, stdev=25.60 lat (msec): min=3, max=203, avg=20.42, stdev=25.60 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 60], | 99.00th=[ 161], 99.50th=[ 186], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 5, max= 104, per=25.14%, avg=32.17, stdev=21.41, samples=86 iops : min= 1, max= 26, avg= 7.45, stdev= 5.41, samples=86 write: IOPS=8, BW=35.1KiB/s (35.9kB/s)(1636KiB/46613msec); 0 zone resets clat (msec): min=32, max=324, avg=95.79, stdev=40.65 lat (msec): min=32, max=324, avg=95.79, stdev=40.65 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 54], 20.00th=[ 65], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 88], 60.00th=[ 97], | 70.00th=[ 106], 80.00th=[ 118], 90.00th=[ 144], 95.00th=[ 174], | 99.00th=[ 249], 99.50th=[ 279], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 56, per=25.51%, avg=34.43, stdev=11.74, samples=92 iops : min= 1, max= 14, avg= 8.01, stdev= 2.97, samples=92 lat (msec) : 4=0.65%, 10=15.76%, 20=17.19%, 50=12.50%, 100=33.59% lat (msec) : 250=19.79%, 500=0.52% cpu : usr=0.08%, sys=0.68%, ctx=921, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122210: Tue Apr 14 17:56:39 2026 read: IOPS=8, BW=35.7KiB/s (36.6kB/s)(1564KiB/43811msec) clat (msec): min=3, max=196, avg=18.31, stdev=18.98 lat (msec): min=3, max=196, avg=18.32, stdev=18.98 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 54], | 99.00th=[ 100], 99.50th=[ 125], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 5, max= 111, per=28.08%, avg=35.94, stdev=24.39, samples=85 iops : min= 1, max= 27, avg= 8.39, stdev= 6.12, samples=85 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(1508KiB/43811msec); 0 zone resets clat (msec): min=34, max=320, avg=97.04, stdev=42.74 lat (msec): min=34, max=320, avg=97.05, stdev=42.74 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 52], 10.00th=[ 57], 20.00th=[ 66], | 30.00th=[ 72], 40.00th=[ 82], 50.00th=[ 88], 60.00th=[ 96], | 70.00th=[ 108], 80.00th=[ 118], 90.00th=[ 146], 95.00th=[ 182], | 99.00th=[ 271], 99.50th=[ 309], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 55, per=25.05%, avg=33.81, stdev=11.20, samples=86 iops : min= 1, max= 13, avg= 7.85, stdev= 2.83, samples=86 lat (msec) : 4=0.39%, 10=18.49%, 20=18.62%, 50=12.76%, 100=31.77% lat (msec) : 250=17.32%, 500=0.65% cpu : usr=0.09%, sys=0.78%, ctx=913, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=122211: Tue Apr 14 17:56:39 2026 read: IOPS=8, BW=33.4KiB/s (34.2kB/s)(1508KiB/45128msec) clat (msec): min=3, max=228, avg=19.82, stdev=22.87 lat (msec): min=3, max=228, avg=19.82, stdev=22.87 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 41], 95.00th=[ 54], | 99.00th=[ 115], 99.50th=[ 165], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 7, max= 80, per=26.77%, avg=34.27, stdev=21.94, samples=85 iops : min= 1, max= 20, avg= 7.96, stdev= 5.53, samples=85 write: IOPS=8, BW=34.7KiB/s (35.5kB/s)(1564KiB/45128msec); 0 zone resets clat (msec): min=36, max=406, avg=96.02, stdev=42.71 lat (msec): min=36, max=406, avg=96.02, stdev=42.71 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 49], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 79], 50.00th=[ 87], 60.00th=[ 95], | 70.00th=[ 106], 80.00th=[ 122], 90.00th=[ 142], 95.00th=[ 176], | 99.00th=[ 236], 99.50th=[ 355], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 56, per=25.26%, avg=34.10, stdev=12.31, samples=89 iops : min= 1, max= 14, avg= 7.92, stdev= 3.17, samples=89 lat (msec) : 4=0.13%, 10=16.93%, 20=19.27%, 50=13.15%, 100=31.12% lat (msec) : 250=19.14%, 500=0.26% cpu : usr=0.09%, sys=0.76%, ctx=918, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=128KiB/s (132kB/s), 30.8KiB/s-35.7KiB/s (31.5kB/s-36.6kB/s), io=5988KiB (6132kB), run=43811-46613msec WRITE: bw=135KiB/s (138kB/s), 34.4KiB/s-35.1KiB/s (35.2kB/s-35.9kB/s), io=6300KiB (6451kB), run=43811-46613msec