== sanity test 398b: DIO and buffer IO race ============== 10:01:04 (1747404064)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0551968 s, 228 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=23365: Fri May 16 10:01:07 2025
   read: IOPS=191, BW=764KiB/s (783kB/s)(1480KiB/1936msec)
    clat (usec): min=3, max=36470, avg=1214.67, stdev=2801.77
     lat (usec): min=4, max=36472, avg=1215.25, stdev=2801.84
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   17], 50.00th=[   28], 60.00th=[ 1074],
     | 70.00th=[ 1516], 80.00th=[ 2147], 90.00th=[ 2835], 95.00th=[ 3687],
     | 99.00th=[15926], 99.50th=[18482], 99.90th=[36439], 99.95th=[36439],
     | 99.99th=[36439]
   bw (  KiB/s): min=  672, max=  808, per=23.80%, avg=736.00, stdev=68.35, samples=3
   iops        : min=  168, max=  202, avg=184.00, stdev=17.09, samples=3
  write: IOPS=205, BW=822KiB/s (842kB/s)(1592KiB/1936msec)
    clat (usec): min=90, max=37099, avg=3713.86, stdev=5610.16
     lat (usec): min=90, max=37100, avg=3714.56, stdev=5610.18
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  113], 10.00th=[  124], 20.00th=[  155],
     | 30.00th=[  198], 40.00th=[  791], 50.00th=[ 1237], 60.00th=[ 1991],
     | 70.00th=[ 3392], 80.00th=[ 6718], 90.00th=[10945], 95.00th=[16909],
     | 99.00th=[23200], 99.50th=[34866], 99.90th=[36963], 99.95th=[36963],
     | 99.99th=[36963]
   bw (  KiB/s): min=  752, max=  832, per=24.01%, avg=781.33, stdev=44.06, samples=3
   iops        : min=  188, max=  208, avg=195.33, stdev=11.02, samples=3
  lat (usec)   : 4=0.13%, 10=10.42%, 20=10.42%, 50=5.86%, 100=0.65%
  lat (usec)   : 250=19.14%, 500=1.04%, 750=1.17%, 1000=3.39%
  lat (msec)   : 2=16.67%, 4=15.62%, 10=8.46%, 20=5.73%, 50=1.30%
  cpu          : usr=0.47%, sys=9.72%, ctx=890, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23366: Fri May 16 10:01:07 2025
   read: IOPS=197, BW=788KiB/s (807kB/s)(1436KiB/1822msec)
    clat (usec): min=3, max=14760, avg=1045.22, stdev=1603.08
     lat (usec): min=3, max=14761, avg=1045.98, stdev=1602.99
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[   19], 50.00th=[   32], 60.00th=[ 1106],
     | 70.00th=[ 1614], 80.00th=[ 2073], 90.00th=[ 2737], 95.00th=[ 3326],
     | 99.00th=[ 6849], 99.50th=[11731], 99.90th=[14746], 99.95th=[14746],
     | 99.99th=[14746]
   bw (  KiB/s): min=  696, max=  848, per=25.36%, avg=784.00, stdev=78.79, samples=3
   iops        : min=  174, max=  212, avg=196.00, stdev=19.70, samples=3
  write: IOPS=224, BW=898KiB/s (919kB/s)(1636KiB/1822msec)
    clat (usec): min=93, max=36152, avg=3517.43, stdev=5092.67
     lat (usec): min=94, max=36154, avg=3518.31, stdev=5092.61
    clat percentiles (usec):
     |  1.00th=[  105],  5.00th=[  122], 10.00th=[  137], 20.00th=[  178],
     | 30.00th=[  253], 40.00th=[  930], 50.00th=[ 1352], 60.00th=[ 1991],
     | 70.00th=[ 3064], 80.00th=[ 5997], 90.00th=[10945], 95.00th=[13042],
     | 99.00th=[20841], 99.50th=[22152], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  752, max= 1016, per=25.98%, avg=845.33, stdev=148.02, samples=3
   iops        : min=  188, max=  254, avg=211.33, stdev=37.00, samples=3
  lat (usec)   : 4=0.52%, 10=7.94%, 20=11.33%, 50=4.43%, 100=0.78%
  lat (usec)   : 250=15.89%, 500=2.86%, 750=1.82%, 1000=4.43%
  lat (msec)   : 2=18.75%, 4=16.54%, 10=8.07%, 20=5.73%, 50=0.91%
  cpu          : usr=0.27%, sys=9.01%, ctx=915, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23367: Fri May 16 10:01:07 2025
   read: IOPS=206, BW=826KiB/s (846kB/s)(1564KiB/1894msec)
    clat (usec): min=3, max=25232, avg=1367.97, stdev=2671.93
     lat (usec): min=3, max=25233, avg=1368.74, stdev=2672.00
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   12], 40.00th=[   17], 50.00th=[   34], 60.00th=[ 1418],
     | 70.00th=[ 1844], 80.00th=[ 2343], 90.00th=[ 2966], 95.00th=[ 3752],
     | 99.00th=[17433], 99.50th=[23987], 99.90th=[25297], 99.95th=[25297],
     | 99.99th=[25297]
   bw (  KiB/s): min=  616, max=  856, per=24.92%, avg=770.67, stdev=134.18, samples=3
   iops        : min=  154, max=  214, avg=192.67, stdev=33.55, samples=3
  write: IOPS=199, BW=796KiB/s (815kB/s)(1508KiB/1894msec)
    clat (usec): min=95, max=55538, avg=3577.75, stdev=5351.66
     lat (usec): min=95, max=55539, avg=3578.50, stdev=5351.70
    clat percentiles (usec):
     |  1.00th=[   98],  5.00th=[  115], 10.00th=[  130], 20.00th=[  167],
     | 30.00th=[  318], 40.00th=[  996], 50.00th=[ 1598], 60.00th=[ 2089],
     | 70.00th=[ 2966], 80.00th=[ 6849], 90.00th=[10028], 95.00th=[13829],
     | 99.00th=[21627], 99.50th=[27919], 99.90th=[55313], 99.95th=[55313],
     | 99.99th=[55313]
   bw (  KiB/s): min=  720, max=  800, per=23.36%, avg=760.00, stdev=40.00, samples=3
   iops        : min=  180, max=  200, avg=190.00, stdev=10.00, samples=3
  lat (usec)   : 4=0.78%, 10=11.59%, 20=9.24%, 50=4.95%, 100=0.52%
  lat (usec)   : 250=14.19%, 500=1.69%, 750=1.30%, 1000=4.17%
  lat (msec)   : 2=16.93%, 4=19.14%, 10=9.64%, 20=4.82%, 50=0.91%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.37%, sys=9.51%, ctx=955, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23368: Fri May 16 10:01:07 2025
   read: IOPS=196, BW=786KiB/s (805kB/s)(1508KiB/1918msec)
    clat (usec): min=3, max=17351, avg=1054.42, stdev=1783.79
     lat (usec): min=3, max=17352, avg=1054.99, stdev=1783.81
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   16], 50.00th=[   26], 60.00th=[  971],
     | 70.00th=[ 1598], 80.00th=[ 2147], 90.00th=[ 3032], 95.00th=[ 3490],
     | 99.00th=[ 7635], 99.50th=[13829], 99.90th=[17433], 99.95th=[17433],
     | 99.99th=[17433]
   bw (  KiB/s): min=  632, max=  856, per=23.29%, avg=720.00, stdev=119.47, samples=3
   iops        : min=  158, max=  214, avg=180.00, stdev=29.87, samples=3
  write: IOPS=203, BW=815KiB/s (835kB/s)(1564KiB/1918msec)
    clat (usec): min=82, max=37012, avg=3867.05, stdev=5657.15
     lat (usec): min=82, max=37012, avg=3867.72, stdev=5657.17
    clat percentiles (usec):
     |  1.00th=[  103],  5.00th=[  116], 10.00th=[  130], 20.00th=[  169],
     | 30.00th=[  221], 40.00th=[  938], 50.00th=[ 1434], 60.00th=[ 2278],
     | 70.00th=[ 3720], 80.00th=[ 6652], 90.00th=[11469], 95.00th=[15664],
     | 99.00th=[26608], 99.50th=[36439], 99.90th=[36963], 99.95th=[36963],
     | 99.99th=[36963]
   bw (  KiB/s): min=  672, max=  856, per=24.26%, avg=789.33, stdev=101.93, samples=3
   iops        : min=  168, max=  214, avg=197.33, stdev=25.48, samples=3
  lat (usec)   : 4=0.13%, 10=10.81%, 20=11.20%, 50=5.08%, 100=1.43%
  lat (usec)   : 250=16.02%, 500=2.08%, 750=0.91%, 1000=2.86%
  lat (msec)   : 2=16.02%, 4=17.84%, 10=8.07%, 20=6.64%, 50=0.91%
  cpu          : usr=0.42%, sys=8.56%, ctx=947, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3093KiB/s (3167kB/s), 764KiB/s-826KiB/s (783kB/s-846kB/s), io=5988KiB (6132kB), run=1822-1936msec
  WRITE: bw=3254KiB/s (3332kB/s), 796KiB/s-898KiB/s (815kB/s-919kB/s), io=6300KiB (6451kB), run=1822-1936msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=23360: Fri May 16 10:01:13 2025
   read: IOPS=49, BW=198KiB/s (203kB/s)(1480KiB/7471msec)
    clat (usec): min=676, max=26920, avg=2169.68, stdev=3378.45
     lat (usec): min=677, max=26921, avg=2170.50, stdev=3378.48
    clat percentiles (usec):
     |  1.00th=[  709],  5.00th=[  824], 10.00th=[  865], 20.00th=[  922],
     | 30.00th=[  988], 40.00th=[ 1057], 50.00th=[ 1188], 60.00th=[ 1352],
     | 70.00th=[ 1532], 80.00th=[ 2024], 90.00th=[ 3163], 95.00th=[ 6980],
     | 99.00th=[20055], 99.50th=[25822], 99.90th=[26870], 99.95th=[26870],
     | 99.99th=[26870]
   bw (  KiB/s): min=  136, max=  312, per=25.03%, avg=196.50, stdev=51.17, samples=14
   iops        : min=   34, max=   78, avg=49.07, stdev=12.74, samples=14
  write: IOPS=53, BW=213KiB/s (218kB/s)(1592KiB/7471msec)
    clat (usec): min=8949, max=35416, avg=16706.21, stdev=4904.57
     lat (usec): min=8951, max=35417, avg=16707.25, stdev=4904.60
    clat percentiles (usec):
     |  1.00th=[ 9110],  5.00th=[10290], 10.00th=[11076], 20.00th=[11994],
     | 30.00th=[13435], 40.00th=[15008], 50.00th=[16188], 60.00th=[17171],
     | 70.00th=[19006], 80.00th=[20579], 90.00th=[22938], 95.00th=[25822],
     | 99.00th=[33162], 99.50th=[33424], 99.90th=[35390], 99.95th=[35390],
     | 99.99th=[35390]
   bw (  KiB/s): min=  136, max=  256, per=25.66%, avg=211.93, stdev=37.84, samples=14
   iops        : min=   34, max=   64, avg=52.93, stdev= 9.43, samples=14
  lat (usec)   : 750=1.04%, 1000=14.19%
  lat (msec)   : 2=22.66%, 4=6.64%, 10=3.65%, 20=40.36%, 50=11.46%
  cpu          : usr=0.17%, sys=1.70%, ctx=835, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23361: Fri May 16 10:01:13 2025
   read: IOPS=47, BW=188KiB/s (193kB/s)(1436KiB/7625msec)
    clat (usec): min=726, max=27043, avg=1950.00, stdev=2881.97
     lat (usec): min=727, max=27044, avg=1950.81, stdev=2881.98
    clat percentiles (usec):
     |  1.00th=[  758],  5.00th=[  824], 10.00th=[  873], 20.00th=[  955],
     | 30.00th=[ 1012], 40.00th=[ 1090], 50.00th=[ 1188], 60.00th=[ 1303],
     | 70.00th=[ 1500], 80.00th=[ 1827], 90.00th=[ 2802], 95.00th=[ 4293],
     | 99.00th=[16909], 99.50th=[20317], 99.90th=[27132], 99.95th=[27132],
     | 99.99th=[27132]
   bw (  KiB/s): min=   80, max=  288, per=23.91%, avg=187.67, stdev=52.43, samples=15
   iops        : min=   20, max=   72, avg=46.87, stdev=13.03, samples=15
  write: IOPS=53, BW=215KiB/s (220kB/s)(1636KiB/7625msec)
    clat (usec): min=9054, max=42402, avg=16885.75, stdev=5020.20
     lat (usec): min=9055, max=42402, avg=16886.77, stdev=5020.19
    clat percentiles (usec):
     |  1.00th=[ 9372],  5.00th=[10552], 10.00th=[11207], 20.00th=[12387],
     | 30.00th=[13829], 40.00th=[15401], 50.00th=[16909], 60.00th=[17957],
     | 70.00th=[18744], 80.00th=[19792], 90.00th=[22414], 95.00th=[24773],
     | 99.00th=[36963], 99.50th=[37487], 99.90th=[42206], 99.95th=[42206],
     | 99.99th=[42206]
   bw (  KiB/s): min=  144, max=  256, per=25.63%, avg=211.67, stdev=35.11, samples=15
   iops        : min=   36, max=   64, avg=52.87, stdev= 8.77, samples=15
  lat (usec)   : 750=0.26%, 1000=12.50%
  lat (msec)   : 2=26.30%, 4=5.21%, 10=2.60%, 20=42.97%, 50=10.16%
  cpu          : usr=0.16%, sys=1.65%, ctx=807, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23362: Fri May 16 10:01:13 2025
   read: IOPS=53, BW=213KiB/s (218kB/s)(1564KiB/7332msec)
    clat (usec): min=723, max=31062, avg=1922.07, stdev=2832.69
     lat (usec): min=724, max=31062, avg=1922.90, stdev=2832.71
    clat percentiles (usec):
     |  1.00th=[  750],  5.00th=[  824], 10.00th=[  865], 20.00th=[  922],
     | 30.00th=[  996], 40.00th=[ 1090], 50.00th=[ 1205], 60.00th=[ 1319],
     | 70.00th=[ 1467], 80.00th=[ 1745], 90.00th=[ 2671], 95.00th=[ 5997],
     | 99.00th=[17171], 99.50th=[20317], 99.90th=[31065], 99.95th=[31065],
     | 99.99th=[31065]
   bw (  KiB/s): min=  104, max=  400, per=27.65%, avg=217.07, stdev=95.97, samples=14
   iops        : min=   26, max=  100, avg=54.21, stdev=24.05, samples=14
  write: IOPS=51, BW=206KiB/s (211kB/s)(1508KiB/7332msec)
    clat (usec): min=9005, max=44941, avg=17423.64, stdev=5583.11
     lat (usec): min=9006, max=44943, avg=17424.66, stdev=5583.18
    clat percentiles (usec):
     |  1.00th=[ 9634],  5.00th=[10552], 10.00th=[11207], 20.00th=[12125],
     | 30.00th=[14222], 40.00th=[16057], 50.00th=[17171], 60.00th=[18220],
     | 70.00th=[19530], 80.00th=[20579], 90.00th=[23462], 95.00th=[27132],
     | 99.00th=[39060], 99.50th=[42730], 99.90th=[44827], 99.95th=[44827],
     | 99.99th=[44827]
   bw (  KiB/s): min=  144, max=  239, per=24.69%, avg=203.93, stdev=33.82, samples=14
   iops        : min=   36, max=   59, avg=50.93, stdev= 8.40, samples=14
  lat (usec)   : 750=0.52%, 1000=14.97%
  lat (msec)   : 2=27.08%, 4=5.21%, 10=2.34%, 20=37.76%, 50=12.11%
  cpu          : usr=0.08%, sys=1.77%, ctx=818, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23363: Fri May 16 10:01:13 2025
   read: IOPS=49, BW=200KiB/s (205kB/s)(1508KiB/7550msec)
    clat (usec): min=697, max=51897, avg=2215.57, stdev=4287.93
     lat (usec): min=698, max=51898, avg=2216.39, stdev=4287.94
    clat percentiles (usec):
     |  1.00th=[  725],  5.00th=[  799], 10.00th=[  857], 20.00th=[  914],
     | 30.00th=[  971], 40.00th=[ 1029], 50.00th=[ 1139], 60.00th=[ 1352],
     | 70.00th=[ 1565], 80.00th=[ 2024], 90.00th=[ 2933], 95.00th=[ 8455],
     | 99.00th=[24511], 99.50th=[36963], 99.90th=[51643], 99.95th=[51643],
     | 99.99th=[51643]
   bw (  KiB/s): min=  112, max=  280, per=25.14%, avg=197.33, stdev=54.65, samples=15
   iops        : min=   28, max=   70, avg=49.33, stdev=13.66, samples=15
  write: IOPS=51, BW=207KiB/s (212kB/s)(1564KiB/7550msec)
    clat (usec): min=8595, max=47056, avg=17127.96, stdev=5351.15
     lat (usec): min=8596, max=47056, avg=17129.00, stdev=5351.20
    clat percentiles (usec):
     |  1.00th=[ 9241],  5.00th=[10290], 10.00th=[11207], 20.00th=[12256],
     | 30.00th=[13829], 40.00th=[15664], 50.00th=[16909], 60.00th=[17957],
     | 70.00th=[19006], 80.00th=[20317], 90.00th=[22414], 95.00th=[26084],
     | 99.00th=[38011], 99.50th=[39060], 99.90th=[46924], 99.95th=[46924],
     | 99.99th=[46924]
   bw (  KiB/s): min=  128, max=  256, per=24.92%, avg=205.87, stdev=37.70, samples=15
   iops        : min=   32, max=   64, avg=51.47, stdev= 9.43, samples=15
  lat (usec)   : 750=1.04%, 1000=16.15%
  lat (msec)   : 2=22.01%, 4=6.51%, 10=2.73%, 20=40.23%, 50=11.20%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.20%, sys=1.60%, ctx=829, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=785KiB/s (804kB/s), 188KiB/s-213KiB/s (193kB/s-218kB/s), io=5988KiB (6132kB), run=7332-7625msec
  WRITE: bw=826KiB/s (846kB/s), 206KiB/s-215KiB/s (211kB/s-220kB/s), io=6300KiB (6451kB), run=7332-7625msec