== sanity test 398b: DIO and buffer IO race ============== 18:09:48 (1778537388) /usr/bin/fio 12+0 records in 12+0 records out 12582912 bytes (13 MB, 12 MiB) copied, 0.142338 s, 88.4 MB/s mix direct rw 12M to OST0 by fio with 4 jobs... mix buffer rw 12M to OST0 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=142736: Mon May 11 18:10:01 2026 read: IOPS=61, BW=244KiB/s (250kB/s)(1480KiB/6063msec) clat (usec): min=4, max=110522, avg=6080.43, stdev=11499.58 lat (usec): min=4, max=110523, avg=6081.19, stdev=11499.64 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 22], | 30.00th=[ 29], 40.00th=[ 44], 50.00th=[ 76], 60.00th=[ 5604], | 70.00th=[ 8225], 80.00th=[ 11076], 90.00th=[ 14615], 95.00th=[ 19792], | 99.00th=[ 50594], 99.50th=[106431], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 114, max= 383, per=24.05%, avg=233.55, stdev=87.30, samples=11 iops : min= 28, max= 95, avg=58.09, stdev=21.87, samples=11 write: IOPS=65, BW=263KiB/s (269kB/s)(1592KiB/6063msec); 0 zone resets clat (usec): min=137, max=74739, avg=9451.79, stdev=11466.47 lat (usec): min=138, max=74741, avg=9452.61, stdev=11466.52 clat percentiles (usec): | 1.00th=[ 159], 5.00th=[ 204], 10.00th=[ 249], 20.00th=[ 359], | 30.00th=[ 652], 40.00th=[ 2802], 50.00th=[ 4948], 60.00th=[ 7635], | 70.00th=[12387], 80.00th=[17957], 90.00th=[25822], 95.00th=[31589], | 99.00th=[51643], 99.50th=[59507], 99.90th=[74974], 99.95th=[74974], | 99.99th=[74974] bw ( KiB/s): min= 129, max= 328, per=24.83%, avg=253.73, stdev=54.41, samples=11 iops : min= 32, max= 82, avg=63.18, stdev=13.65, samples=11 lat (usec) : 10=2.34%, 20=6.38%, 50=12.37%, 100=3.26%, 250=6.12% lat (usec) : 500=8.72%, 750=2.86%, 1000=0.65% lat (msec) : 2=2.08%, 4=5.73%, 10=20.31%, 20=18.23%, 50=9.90% lat (msec) : 100=0.78%, 250=0.26% cpu : usr=0.10%, sys=6.20%, ctx=946, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142737: Mon May 11 18:10:01 2026 read: IOPS=60, BW=241KiB/s (247kB/s)(1436KiB/5949msec) clat (usec): min=6, max=82642, avg=5949.60, stdev=9099.05 lat (usec): min=6, max=82643, avg=5950.34, stdev=9099.16 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 24], | 30.00th=[ 33], 40.00th=[ 52], 50.00th=[ 1647], 60.00th=[ 5604], | 70.00th=[ 8455], 80.00th=[10814], 90.00th=[15270], 95.00th=[20317], | 99.00th=[43254], 99.50th=[60556], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 86, max= 328, per=24.70%, avg=239.82, stdev=71.15, samples=11 iops : min= 21, max= 82, avg=59.73, stdev=17.89, samples=11 write: IOPS=68, BW=275KiB/s (282kB/s)(1636KiB/5949msec); 0 zone resets clat (usec): min=158, max=110977, avg=9145.53, stdev=12208.36 lat (usec): min=158, max=110978, avg=9150.84, stdev=12205.61 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 198], 10.00th=[ 235], 20.00th=[ 334], | 30.00th=[ 644], 40.00th=[ 2966], 50.00th=[ 5276], 60.00th=[ 7373], | 70.00th=[ 10421], 80.00th=[ 16909], 90.00th=[ 23200], 95.00th=[ 31065], | 99.00th=[ 50594], 99.50th=[ 57934], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 144, max= 423, per=26.23%, avg=268.09, stdev=81.34, samples=11 iops : min= 36, max= 105, avg=66.82, stdev=20.25, samples=11 lat (usec) : 10=1.04%, 20=5.73%, 50=11.46%, 100=2.99%, 250=7.68% lat (usec) : 500=8.85%, 750=2.21%, 1000=1.04% lat (msec) : 2=1.95%, 4=6.25%, 10=23.83%, 20=16.67%, 50=9.24% lat (msec) : 100=0.91%, 250=0.13% cpu : usr=0.18%, sys=5.93%, ctx=1000, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142739: Mon May 11 18:10:01 2026 read: IOPS=64, BW=256KiB/s (263kB/s)(1564KiB/6101msec) clat (usec): min=4, max=60422, avg=5094.42, stdev=7260.25 lat (usec): min=4, max=60423, avg=5095.15, stdev=7260.25 clat percentiles (usec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 31], 40.00th=[ 50], 50.00th=[ 1303], 60.00th=[ 5014], | 70.00th=[ 7308], 80.00th=[ 9503], 90.00th=[13698], 95.00th=[17171], | 99.00th=[28181], 99.50th=[41681], 99.90th=[60556], 99.95th=[60556], | 99.99th=[60556] bw ( KiB/s): min= 64, max= 384, per=26.62%, avg=258.50, stdev=84.11, samples=12 iops : min= 16, max= 96, avg=64.42, stdev=20.93, samples=12 write: IOPS=61, BW=247KiB/s (253kB/s)(1508KiB/6101msec); 0 zone resets clat (usec): min=139, max=165464, avg=10632.26, stdev=15626.20 lat (usec): min=139, max=165466, avg=10633.18, stdev=15626.26 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 225], 10.00th=[ 265], 20.00th=[ 347], | 30.00th=[ 660], 40.00th=[ 3064], 50.00th=[ 5145], 60.00th=[ 8291], | 70.00th=[ 11469], 80.00th=[ 18220], 90.00th=[ 27657], 95.00th=[ 40633], | 99.00th=[ 70779], 99.50th=[ 96994], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 71, max= 373, per=23.97%, avg=245.00, stdev=77.02, samples=12 iops : min= 17, max= 93, avg=61.00, stdev=19.41, samples=12 lat (usec) : 10=1.56%, 20=7.29%, 50=11.72%, 100=3.52%, 250=4.04% lat (usec) : 500=10.55%, 750=1.69%, 1000=0.65% lat (msec) : 2=2.47%, 4=7.55%, 10=21.61%, 20=16.67%, 50=9.51% lat (msec) : 100=1.04%, 250=0.13% cpu : usr=0.11%, sys=5.34%, ctx=942, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142741: Mon May 11 18:10:01 2026 read: IOPS=61, BW=245KiB/s (251kB/s)(1508KiB/6163msec) clat (usec): min=4, max=117596, avg=5568.18, stdev=10077.31 lat (usec): min=4, max=117596, avg=5569.04, stdev=10077.20 clat percentiles (usec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 14], 20.00th=[ 21], | 30.00th=[ 29], 40.00th=[ 38], 50.00th=[ 63], 60.00th=[ 4883], | 70.00th=[ 7177], 80.00th=[ 10028], 90.00th=[ 15008], 95.00th=[ 19792], | 99.00th=[ 47449], 99.50th=[ 71828], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 104, max= 392, per=26.74%, avg=259.64, stdev=99.23, samples=11 iops : min= 26, max= 98, avg=64.73, stdev=24.73, samples=11 write: IOPS=63, BW=254KiB/s (260kB/s)(1564KiB/6163msec); 0 zone resets clat (usec): min=113, max=152377, avg=10129.96, stdev=16761.23 lat (usec): min=114, max=152378, avg=10130.79, stdev=16761.30 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 196], 10.00th=[ 245], 20.00th=[ 363], | 30.00th=[ 930], 40.00th=[ 3425], 50.00th=[ 5276], 60.00th=[ 7373], | 70.00th=[ 10421], 80.00th=[ 14746], 90.00th=[ 23987], 95.00th=[ 36439], | 99.00th=[ 95945], 99.50th=[137364], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 21, max= 383, per=24.29%, avg=248.25, stdev=111.76, samples=12 iops : min= 5, max= 95, avg=61.83, stdev=27.86, samples=12 lat (usec) : 10=2.73%, 20=7.16%, 50=12.37%, 100=2.73%, 250=6.12% lat (usec) : 500=8.72%, 750=1.30%, 1000=0.78% lat (msec) : 2=2.08%, 4=6.77%, 10=23.31%, 20=17.06%, 50=7.29% lat (msec) : 100=1.04%, 250=0.52% cpu : usr=0.23%, sys=5.01%, ctx=898, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=972KiB/s (995kB/s), 241KiB/s-256KiB/s (247kB/s-263kB/s), io=5988KiB (6132kB), run=5949-6163msec WRITE: bw=1022KiB/s (1047kB/s), 247KiB/s-275KiB/s (253kB/s-282kB/s), io=6300KiB (6451kB), run=5949-6163msec rand-rw: (groupid=0, jobs=1): err= 0: pid=142734: Mon May 11 18:10:12 2026 read: IOPS=21, BW=86.7KiB/s (88.8kB/s)(1480KiB/17076msec) clat (usec): min=1280, max=97992, avg=7596.20, stdev=11229.32 lat (usec): min=1280, max=97993, avg=7597.79, stdev=11229.20 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1827], 10.00th=[ 2212], 20.00th=[ 2671], | 30.00th=[ 3064], 40.00th=[ 3589], 50.00th=[ 4228], 60.00th=[ 5145], | 70.00th=[ 6063], 80.00th=[ 8291], 90.00th=[15008], 95.00th=[21103], | 99.00th=[63701], 99.50th=[72877], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 31, max= 216, per=24.29%, avg=84.06, stdev=40.05, samples=33 iops : min= 7, max= 54, avg=20.73, stdev=10.06, samples=33 write: IOPS=23, BW=93.2KiB/s (95.5kB/s)(1592KiB/17076msec); 0 zone resets clat (msec): min=13, max=144, avg=35.74, stdev=16.40 lat (msec): min=13, max=144, avg=35.74, stdev=16.40 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 41], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 63], | 99.00th=[ 108], 99.50th=[ 123], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 13, max= 151, per=25.25%, avg=91.91, stdev=31.85, samples=33 iops : min= 3, max= 37, avg=22.70, stdev= 8.08, samples=33 lat (msec) : 2=3.12%, 4=19.27%, 10=17.84%, 20=10.29%, 50=40.76% lat (msec) : 100=8.20%, 250=0.52% cpu : usr=0.16%, sys=1.28%, ctx=832, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142735: Mon May 11 18:10:12 2026 read: IOPS=20, BW=83.1KiB/s (85.0kB/s)(1436KiB/17290msec) clat (usec): min=1167, max=73597, avg=6421.71, stdev=8507.51 lat (usec): min=1167, max=73599, avg=6423.07, stdev=8507.49 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1893], 10.00th=[ 2147], 20.00th=[ 2671], | 30.00th=[ 3097], 40.00th=[ 3490], 50.00th=[ 3982], 60.00th=[ 4555], | 70.00th=[ 5735], 80.00th=[ 7242], 90.00th=[11600], 95.00th=[18220], | 99.00th=[49021], 99.50th=[65799], 99.90th=[73925], 99.95th=[73925], | 99.99th=[73925] bw ( KiB/s): min= 6, max= 151, per=23.82%, avg=82.41, stdev=35.25, samples=34 iops : min= 1, max= 37, avg=20.32, stdev= 8.86, samples=34 write: IOPS=23, BW=94.6KiB/s (96.9kB/s)(1636KiB/17290msec); 0 zone resets clat (msec): min=10, max=153, avg=36.40, stdev=18.23 lat (msec): min=10, max=153, avg=36.40, stdev=18.23 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 36], | 70.00th=[ 40], 80.00th=[ 46], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 94], 99.50th=[ 134], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 20, max= 144, per=25.60%, avg=93.18, stdev=32.45, samples=34 iops : min= 5, max= 36, avg=23.03, stdev= 8.23, samples=34 lat (msec) : 2=2.99%, 4=20.44%, 10=17.71%, 20=8.46%, 50=41.93% lat (msec) : 100=7.94%, 250=0.52% cpu : usr=0.11%, sys=1.42%, ctx=850, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142738: Mon May 11 18:10:12 2026 read: IOPS=23, BW=95.2KiB/s (97.4kB/s)(1564KiB/16435msec) clat (usec): min=1194, max=61279, avg=6303.25, stdev=7624.72 lat (usec): min=1195, max=61280, avg=6305.27, stdev=7624.65 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1811], 10.00th=[ 2073], 20.00th=[ 2606], | 30.00th=[ 3064], 40.00th=[ 3458], 50.00th=[ 3851], 60.00th=[ 4817], | 70.00th=[ 5669], 80.00th=[ 7177], 90.00th=[11600], 95.00th=[20841], | 99.00th=[42206], 99.50th=[60031], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 13, max= 240, per=27.68%, avg=95.78, stdev=56.27, samples=32 iops : min= 3, max= 60, avg=23.66, stdev=14.18, samples=32 write: IOPS=22, BW=91.8KiB/s (93.0kB/s)(1508KiB/16435msec); 0 zone resets clat (msec): min=14, max=146, avg=36.81, stdev=17.63 lat (msec): min=14, max=146, avg=36.81, stdev=17.63 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 42], 80.00th=[ 48], 90.00th=[ 58], 95.00th=[ 67], | 99.00th=[ 102], 99.50th=[ 136], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 27, max= 143, per=24.99%, avg=90.97, stdev=29.39, samples=32 iops : min= 6, max= 35, avg=22.44, stdev= 7.49, samples=32 lat (msec) : 2=4.56%, 4=22.01%, 10=17.97%, 20=8.85%, 50=37.76% lat (msec) : 100=8.33%, 250=0.52% cpu : usr=0.10%, sys=1.39%, ctx=852, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=142740: Mon May 11 18:10:12 2026 read: IOPS=22, BW=88.1KiB/s (90.2kB/s)(1508KiB/17119msec) clat (usec): min=1292, max=91553, avg=6784.11, stdev=10058.34 lat (usec): min=1293, max=91555, avg=6785.43, stdev=10058.27 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1860], 10.00th=[ 2147], 20.00th=[ 2540], | 30.00th=[ 2900], 40.00th=[ 3359], 50.00th=[ 3949], 60.00th=[ 4686], | 70.00th=[ 6063], 80.00th=[ 7635], 90.00th=[11338], 95.00th=[19268], | 99.00th=[67634], 99.50th=[79168], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 7, max= 168, per=25.26%, avg=87.38, stdev=41.64, samples=34 iops : min= 1, max= 42, avg=21.56, stdev=10.58, samples=34 write: IOPS=22, BW=91.4KiB/s (93.6kB/s)(1564KiB/17119msec); 0 zone resets clat (msec): min=14, max=153, avg=37.01, stdev=18.68 lat (msec): min=14, max=153, avg=37.02, stdev=18.68 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 41], 80.00th=[ 48], 90.00th=[ 60], 95.00th=[ 69], | 99.00th=[ 114], 99.50th=[ 136], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 28, max= 152, per=25.15%, avg=91.53, stdev=32.99, samples=34 iops : min= 7, max= 38, avg=22.62, stdev= 8.36, samples=34 lat (msec) : 2=3.26%, 4=21.74%, 10=17.97%, 20=9.38%, 50=38.41% lat (msec) : 100=8.46%, 250=0.78% cpu : usr=0.13%, sys=1.34%, ctx=840, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=346KiB/s (355kB/s), 83.1KiB/s-95.2KiB/s (85.0kB/s-97.4kB/s), io=5988KiB (6132kB), run=16435-17290msec WRITE: bw=364KiB/s (373kB/s), 91.4KiB/s-94.6KiB/s (93.6kB/s-96.9kB/s), io=6300KiB (6451kB), run=16435-17290msec