== sanity test 398b: DIO and buffer IO race ============== 10:55:00 (1760453700)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.105018 s, 120 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=146740: Tue Oct 14 10:55:07 2025
  read: IOPS=639, BW=2556KiB/s (2617kB/s)(1480KiB/579msec)
    clat (usec): min=7, max=10196, avg=273.18, stdev=1118.58
     lat (usec): min=7, max=10197, avg=273.50, stdev=1118.63
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   14], 10.00th=[   16], 20.00th=[   20],
     | 30.00th=[   22], 40.00th=[   24], 50.00th=[   26], 60.00th=[   29],
     | 70.00th=[   32], 80.00th=[   36], 90.00th=[   46], 95.00th=[ 2409],
     | 99.00th=[ 5866], 99.50th=[ 7635], 99.90th=[10159], 99.95th=[10159],
     | 99.99th=[10159]
  write: IOPS=687, BW=2750KiB/s (2816kB/s)(1592KiB/579msec); 0 zone resets
    clat (usec): min=187, max=32889, avg=1155.91, stdev=2073.83
     lat (usec): min=187, max=32889, avg=1156.31, stdev=2073.83
    clat percentiles (usec):
     |  1.00th=[  241],  5.00th=[  359], 10.00th=[  562], 20.00th=[  717],
     | 30.00th=[  791], 40.00th=[  848], 50.00th=[  914], 60.00th=[  963],
     | 70.00th=[ 1020], 80.00th=[ 1106], 90.00th=[ 1336], 95.00th=[ 1532],
     | 99.00th=[ 8848], 99.50th=[20317], 99.90th=[32900], 99.95th=[32900],
     | 99.99th=[32900]
  lat (usec)   : 10=0.65%, 20=10.55%, 50=32.81%, 100=1.43%, 250=0.65%
  lat (usec)   : 500=3.39%, 750=8.72%, 1000=21.88%
  lat (msec)   : 2=15.63%, 4=1.69%, 10=2.08%, 20=0.26%, 50=0.26%
  cpu          : usr=0.52%, sys=64.53%, ctx=104, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146741: Tue Oct 14 10:55:07 2025
  read: IOPS=308, BW=1233KiB/s (1262kB/s)(1436KiB/1165msec)
    clat (usec): min=5, max=41494, avg=1423.20, stdev=3367.15
     lat (usec): min=6, max=41494, avg=1423.56, stdev=3367.18
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   15], 20.00th=[   20],
     | 30.00th=[   22], 40.00th=[   25], 50.00th=[   29], 60.00th=[   33],
     | 70.00th=[   45], 80.00th=[ 3654], 90.00th=[ 5080], 95.00th=[ 5866],
     | 99.00th=[11207], 99.50th=[23200], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=  592, max= 1815, per=23.42%, avg=1203.50, stdev=864.79, samples=2
   iops        : min=  148, max=  453, avg=300.50, stdev=215.67, samples=2
  write: IOPS=351, BW=1404KiB/s (1438kB/s)(1636KiB/1165msec); 0 zone resets
    clat (usec): min=176, max=18503, avg=1552.07, stdev=1758.09
     lat (usec): min=177, max=18503, avg=1552.72, stdev=1758.04
    clat percentiles (usec):
     |  1.00th=[  215],  5.00th=[  302], 10.00th=[  482], 20.00th=[  685],
     | 30.00th=[  840], 40.00th=[  922], 50.00th=[ 1020], 60.00th=[ 1156],
     | 70.00th=[ 1352], 80.00th=[ 1647], 90.00th=[ 3589], 95.00th=[ 4752],
     | 99.00th=[10028], 99.50th=[10028], 99.90th=[18482], 99.95th=[18482],
     | 99.99th=[18482]
   bw (  KiB/s): min=  688, max= 2010, per=24.95%, avg=1349.00, stdev=934.80, samples=2
   iops        : min=  172, max=  502, avg=337.00, stdev=233.35, samples=2
  lat (usec)   : 10=0.52%, 20=9.90%, 50=22.92%, 100=0.91%, 250=1.69%
  lat (usec)   : 500=4.30%, 750=6.64%, 1000=12.89%
  lat (msec)   : 2=20.05%, 4=8.20%, 10=10.68%, 20=1.04%, 50=0.26%
  cpu          : usr=0.26%, sys=36.00%, ctx=464, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146742: Tue Oct 14 10:55:07 2025
  read: IOPS=414, BW=1659KiB/s (1698kB/s)(1564KiB/943msec)
    clat (usec): min=7, max=33483, avg=1029.18, stdev=2817.73
     lat (usec): min=7, max=33483, avg=1029.57, stdev=2817.78
    clat percentiles (usec):
     |  1.00th=[   11],  5.00th=[   15], 10.00th=[   17], 20.00th=[   19],
     | 30.00th=[   21], 40.00th=[   23], 50.00th=[   25], 60.00th=[   28],
     | 70.00th=[   32], 80.00th=[   56], 90.00th=[ 4621], 95.00th=[ 6390],
     | 99.00th=[ 9372], 99.50th=[20579], 99.90th=[33424], 99.95th=[33424],
     | 99.99th=[33424]
   bw (  KiB/s): min= 2164, max= 2164, per=42.11%, avg=2164.00, stdev= 0.00, samples=1
   iops        : min=  541, max=  541, avg=541.00, stdev= 0.00, samples=1
  write: IOPS=399, BW=1599KiB/s (1638kB/s)(1508KiB/943msec); 0 zone resets
    clat (usec): min=173, max=17950, avg=1378.49, stdev=1824.70
     lat (usec): min=174, max=17951, avg=1378.92, stdev=1824.72
    clat percentiles (usec):
     |  1.00th=[  229],  5.00th=[  326], 10.00th=[  461], 20.00th=[  619],
     | 30.00th=[  725], 40.00th=[  816], 50.00th=[  914], 60.00th=[  979],
     | 70.00th=[ 1074], 80.00th=[ 1385], 90.00th=[ 2343], 95.00th=[ 5014],
     | 99.00th=[ 9503], 99.50th=[15664], 99.90th=[17957], 99.95th=[17957],
     | 99.99th=[17957]
   bw (  KiB/s): min= 2137, max= 2137, per=39.52%, avg=2137.00, stdev= 0.00, samples=1
   iops        : min=  534, max=  534, avg=534.00, stdev= 0.00, samples=1
  lat (usec)   : 10=0.39%, 20=13.54%, 50=26.17%, 100=1.17%, 250=1.56%
  lat (usec)   : 500=4.69%, 750=10.94%, 1000=14.19%
  lat (msec)   : 2=13.15%, 4=4.56%, 10=8.98%, 20=0.39%, 50=0.26%
  cpu          : usr=0.42%, sys=38.43%, ctx=351, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146743: Tue Oct 14 10:55:07 2025
  read: IOPS=736, BW=2945KiB/s (3016kB/s)(1508KiB/512msec)
    clat (usec): min=6, max=38486, avg=332.72, stdev=2382.42
     lat (usec): min=6, max=38486, avg=332.99, stdev=2382.44
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   15], 20.00th=[   18],
     | 30.00th=[   20], 40.00th=[   21], 50.00th=[   23], 60.00th=[   25],
     | 70.00th=[   28], 80.00th=[   32], 90.00th=[   38], 95.00th=[   69],
     | 99.00th=[12387], 99.50th=[13042], 99.90th=[38536], 99.95th=[38536],
     | 99.99th=[38536]
  write: IOPS=763, BW=3055KiB/s (3128kB/s)(1564KiB/512msec); 0 zone resets
    clat (usec): min=173, max=15300, avg=942.75, stdev=944.45
     lat (usec): min=173, max=15300, avg=943.11, stdev=944.47
    clat percentiles (usec):
     |  1.00th=[  326],  5.00th=[  474], 10.00th=[  553], 20.00th=[  635],
     | 30.00th=[  693], 40.00th=[  742], 50.00th=[  799], 60.00th=[  865],
     | 70.00th=[  947], 80.00th=[ 1057], 90.00th=[ 1254], 95.00th=[ 1450],
     | 99.00th=[ 5014], 99.50th=[ 7111], 99.90th=[15270], 99.95th=[15270],
     | 99.99th=[15270]
  lat (usec)   : 10=0.65%, 20=16.67%, 50=28.65%, 100=1.30%, 250=0.52%
  lat (usec)   : 500=3.12%, 750=17.58%, 1000=17.32%
  lat (msec)   : 2=11.59%, 4=0.78%, 10=1.17%, 20=0.52%, 50=0.13%
  cpu          : usr=0.20%, sys=65.56%, ctx=131, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5140KiB/s (5263kB/s), 1233KiB/s-2945KiB/s (1262kB/s-3016kB/s), io=5988KiB (6132kB), run=512-1165msec
  WRITE: bw=5408KiB/s (5538kB/s), 1404KiB/s-3055KiB/s (1438kB/s-3128kB/s), io=6300KiB (6451kB), run=512-1165msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=146745: Tue Oct 14 10:55:09 2025
  read: IOPS=145, BW=584KiB/s (598kB/s)(1480KiB/2535msec)
    clat (usec): min=936, max=55559, avg=2396.03, stdev=3191.63
     lat (usec): min=936, max=55561, avg=2396.50, stdev=3191.72
    clat percentiles (usec):
     |  1.00th=[ 1020],  5.00th=[ 1106], 10.00th=[ 1172], 20.00th=[ 1303],
     | 30.00th=[ 1385], 40.00th=[ 1500], 50.00th=[ 1680], 60.00th=[ 1926],
     | 70.00th=[ 2245], 80.00th=[ 2769], 90.00th=[ 3818], 95.00th=[ 5669],
     | 99.00th=[ 9503], 99.50th=[12256], 99.90th=[55313], 99.95th=[55313],
     | 99.99th=[55313]
   bw (  KiB/s): min=  337, max=  744, per=24.73%, avg=584.20, stdev=152.01, samples=5
   iops        : min=   84, max=  186, avg=146.00, stdev=38.11, samples=5
  write: IOPS=157, BW=628KiB/s (643kB/s)(1592KiB/2535msec); 0 zone resets
    clat (usec): min=1794, max=16480, avg=4100.39, stdev=1683.73
     lat (usec): min=1794, max=16480, avg=4101.03, stdev=1683.73
    clat percentiles (usec):
     |  1.00th=[ 1876],  5.00th=[ 2409], 10.00th=[ 2671], 20.00th=[ 3032],
     | 30.00th=[ 3195], 40.00th=[ 3425], 50.00th=[ 3654], 60.00th=[ 3884],
     | 70.00th=[ 4359], 80.00th=[ 4948], 90.00th=[ 5800], 95.00th=[ 6718],
     | 99.00th=[11207], 99.50th=[13960], 99.90th=[16450], 99.95th=[16450],
     | 99.99th=[16450]
   bw (  KiB/s): min=  399, max=  800, per=25.30%, avg=628.60, stdev=148.94, samples=5
   iops        : min=   99, max=  200, avg=157.00, stdev=37.52, samples=5
  lat (usec)   : 1000=0.39%
  lat (msec)   : 2=31.12%, 4=44.79%, 10=22.92%, 20=0.65%, 100=0.13%
  cpu          : usr=0.28%, sys=6.67%, ctx=905, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146746: Tue Oct 14 10:55:09 2025
  read: IOPS=142, BW=570KiB/s (584kB/s)(1436KiB/2518msec)
    clat (usec): min=963, max=58280, avg=2322.32, stdev=3258.30
     lat (usec): min=964, max=58281, avg=2322.85, stdev=3258.29
    clat percentiles (usec):
     |  1.00th=[ 1029],  5.00th=[ 1123], 10.00th=[ 1188], 20.00th=[ 1287],
     | 30.00th=[ 1401], 40.00th=[ 1516], 50.00th=[ 1631], 60.00th=[ 1827],
     | 70.00th=[ 2245], 80.00th=[ 2868], 90.00th=[ 3818], 95.00th=[ 5342],
     | 99.00th=[ 8356], 99.50th=[ 8717], 99.90th=[58459], 99.95th=[58459],
     | 99.99th=[58459]
   bw (  KiB/s): min=  340, max=  720, per=24.51%, avg=579.00, stdev=170.50, samples=4
   iops        : min=   85, max=  180, avg=144.75, stdev=42.63, samples=4
  write: IOPS=162, BW=650KiB/s (665kB/s)(1636KiB/2518msec); 0 zone resets
    clat (usec): min=1997, max=13526, avg=4095.38, stdev=1788.53
     lat (usec): min=1997, max=13527, avg=4096.07, stdev=1788.52
    clat percentiles (usec):
     |  1.00th=[ 2089],  5.00th=[ 2409], 10.00th=[ 2606], 20.00th=[ 2868],
     | 30.00th=[ 3097], 40.00th=[ 3326], 50.00th=[ 3556], 60.00th=[ 3851],
     | 70.00th=[ 4293], 80.00th=[ 5145], 90.00th=[ 5997], 95.00th=[ 8029],
     | 99.00th=[11207], 99.50th=[11469], 99.90th=[13566], 99.95th=[13566],
     | 99.99th=[13566]
   bw (  KiB/s): min=  355, max=  808, per=25.22%, avg=626.75, stdev=193.17, samples=4
   iops        : min=   88, max=  202, avg=156.50, stdev=48.64, samples=4
  lat (usec)   : 1000=0.13%
  lat (msec)   : 2=30.47%, 4=45.96%, 10=22.14%, 20=1.17%, 100=0.13%
  cpu          : usr=0.32%, sys=6.28%, ctx=893, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146747: Tue Oct 14 10:55:09 2025
  read: IOPS=158, BW=633KiB/s (648kB/s)(1564KiB/2472msec)
    clat (usec): min=1009, max=9305, avg=2179.85, stdev=1268.33
     lat (usec): min=1010, max=9306, avg=2180.41, stdev=1268.30
    clat percentiles (usec):
     |  1.00th=[ 1029],  5.00th=[ 1123], 10.00th=[ 1188], 20.00th=[ 1287],
     | 30.00th=[ 1401], 40.00th=[ 1549], 50.00th=[ 1713], 60.00th=[ 1975],
     | 70.00th=[ 2343], 80.00th=[ 2900], 90.00th=[ 3720], 95.00th=[ 4752],
     | 99.00th=[ 7177], 99.50th=[ 8455], 99.90th=[ 9241], 99.95th=[ 9241],
     | 99.99th=[ 9241]
   bw (  KiB/s): min=  314, max=  792, per=25.93%, avg=612.50, stdev=215.07, samples=4
   iops        : min=   78, max=  198, avg=153.00, stdev=54.00, samples=4
  write: IOPS=152, BW=610KiB/s (625kB/s)(1508KiB/2472msec); 0 zone resets
    clat (usec): min=1868, max=59264, avg=4248.53, stdev=3305.63
     lat (usec): min=1869, max=59266, avg=4249.23, stdev=3305.70
    clat percentiles (usec):
     |  1.00th=[ 2147],  5.00th=[ 2474], 10.00th=[ 2769], 20.00th=[ 3032],
     | 30.00th=[ 3163], 40.00th=[ 3294], 50.00th=[ 3523], 60.00th=[ 3884],
     | 70.00th=[ 4228], 80.00th=[ 4883], 90.00th=[ 6390], 95.00th=[ 7767],
     | 99.00th=[11600], 99.50th=[12649], 99.90th=[59507], 99.95th=[59507],
     | 99.99th=[59507]
   bw (  KiB/s): min=  398, max=  760, per=24.45%, avg=607.50, stdev=151.72, samples=4
   iops        : min=   99, max=  190, avg=151.75, stdev=38.16, samples=4
  lat (msec)   : 2=31.12%, 4=46.74%, 10=21.48%, 20=0.52%, 100=0.13%
  cpu          : usr=0.24%, sys=7.00%, ctx=925, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146748: Tue Oct 14 10:55:09 2025
  read: IOPS=151, BW=605KiB/s (619kB/s)(1508KiB/2494msec)
    clat (usec): min=914, max=9239, avg=2134.70, stdev=1280.63
     lat (usec): min=915, max=9239, avg=2135.16, stdev=1280.64
    clat percentiles (usec):
     |  1.00th=[ 1020],  5.00th=[ 1123], 10.00th=[ 1188], 20.00th=[ 1270],
     | 30.00th=[ 1385], 40.00th=[ 1516], 50.00th=[ 1680], 60.00th=[ 1860],
     | 70.00th=[ 2212], 80.00th=[ 2769], 90.00th=[ 3589], 95.00th=[ 4621],
     | 99.00th=[ 7898], 99.50th=[ 8717], 99.90th=[ 9241], 99.95th=[ 9241],
     | 99.99th=[ 9241]
   bw (  KiB/s): min=  322, max=  720, per=24.66%, avg=582.50, stdev=185.81, samples=4
   iops        : min=   80, max=  180, avg=145.50, stdev=46.69, samples=4
  write: IOPS=156, BW=627KiB/s (642kB/s)(1564KiB/2494msec); 0 zone resets
    clat (usec): min=1986, max=58321, avg=4286.67, stdev=3299.99
     lat (usec): min=1987, max=58323, avg=4287.30, stdev=3300.04
    clat percentiles (usec):
     |  1.00th=[ 2114],  5.00th=[ 2507], 10.00th=[ 2671], 20.00th=[ 2933],
     | 30.00th=[ 3130], 40.00th=[ 3326], 50.00th=[ 3556], 60.00th=[ 3851],
     | 70.00th=[ 4293], 80.00th=[ 5145], 90.00th=[ 6390], 95.00th=[ 7767],
     | 99.00th=[12256], 99.50th=[16909], 99.90th=[58459], 99.95th=[58459],
     | 99.99th=[58459]
   bw (  KiB/s): min=  391, max=  776, per=25.34%, avg=629.75, stdev=167.57, samples=4
   iops        : min=   97, max=  194, avg=157.25, stdev=42.25, samples=4
  lat (usec)   : 1000=0.39%
  lat (msec)   : 2=31.51%, 4=45.70%, 10=21.35%, 20=0.91%, 100=0.13%
  cpu          : usr=0.40%, sys=6.42%, ctx=902, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2362KiB/s (2419kB/s), 570KiB/s-633KiB/s (584kB/s-648kB/s), io=5988KiB (6132kB), run=2472-2535msec
  WRITE: bw=2485KiB/s (2545kB/s), 610KiB/s-650KiB/s (625kB/s-665kB/s), io=6300KiB (6451kB), run=2472-2535msec