== sanity test 398b: DIO and buffer IO race ============== 16:02:55 (1715457775)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0753762 s, 167 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=21628: Sat May 11 16:02:58 2024
   read: IOPS=210, BW=842KiB/s (862kB/s)(1480KiB/1758msec)
    clat (usec): min=3, max=22116, avg=1205.16, stdev=2416.50
     lat (usec): min=3, max=22116, avg=1205.91, stdev=2416.59
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   16], 50.00th=[   25], 60.00th=[ 1004],
     | 70.00th=[ 1680], 80.00th=[ 2114], 90.00th=[ 2606], 95.00th=[ 3654],
     | 99.00th=[13829], 99.50th=[20317], 99.90th=[22152], 99.95th=[22152],
     | 99.99th=[22152]
   bw (  KiB/s): min=  680, max=  904, per=24.94%, avg=808.00, stdev=115.38, samples=3
   iops        : min=  170, max=  226, avg=202.00, stdev=28.84, samples=3
  write: IOPS=226, BW=906KiB/s (927kB/s)(1592KiB/1758msec)
    clat (usec): min=89, max=27011, avg=3265.40, stdev=5091.91
     lat (usec): min=90, max=27012, avg=3266.01, stdev=5091.91
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  103], 10.00th=[  112], 20.00th=[  126],
     | 30.00th=[  161], 40.00th=[  223], 50.00th=[  783], 60.00th=[ 1221],
     | 70.00th=[ 2278], 80.00th=[ 7111], 90.00th=[10814], 95.00th=[14615],
     | 99.00th=[20317], 99.50th=[25035], 99.90th=[27132], 99.95th=[27132],
     | 99.99th=[27132]
   bw (  KiB/s): min=  792, max=  960, per=25.97%, avg=885.33, stdev=85.54, samples=3
   iops        : min=  198, max=  240, avg=221.33, stdev=21.39, samples=3
  lat (usec)   : 4=0.65%, 10=12.89%, 20=7.94%, 50=3.65%, 100=2.60%
  lat (usec)   : 250=20.44%, 500=1.82%, 750=2.34%, 1000=5.73%
  lat (msec)   : 2=14.71%, 4=12.11%, 10=7.94%, 20=6.38%, 50=0.78%
  cpu          : usr=0.17%, sys=8.14%, ctx=835, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21629: Sat May 11 16:02:58 2024
   read: IOPS=194, BW=777KiB/s (796kB/s)(1436KiB/1848msec)
    clat (usec): min=3, max=27051, avg=1556.98, stdev=3357.94
     lat (usec): min=3, max=27052, avg=1558.23, stdev=3359.13
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    8], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   15], 50.00th=[   27], 60.00th=[ 1090],
     | 70.00th=[ 1729], 80.00th=[ 2442], 90.00th=[ 3163], 95.00th=[ 5538],
     | 99.00th=[22414], 99.50th=[26346], 99.90th=[27132], 99.95th=[27132],
     | 99.99th=[27132]
   bw (  KiB/s): min=  640, max=  912, per=23.54%, avg=762.67, stdev=137.95, samples=3
   iops        : min=  160, max=  228, avg=190.67, stdev=34.49, samples=3
  write: IOPS=221, BW=885KiB/s (907kB/s)(1636KiB/1848msec)
    clat (usec): min=84, max=33649, avg=3121.42, stdev=4734.30
     lat (usec): min=84, max=33650, avg=3122.22, stdev=4734.51
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  105], 10.00th=[  113], 20.00th=[  133],
     | 30.00th=[  178], 40.00th=[  400], 50.00th=[  996], 60.00th=[ 1565],
     | 70.00th=[ 2343], 80.00th=[ 6325], 90.00th=[10290], 95.00th=[13042],
     | 99.00th=[19792], 99.50th=[20055], 99.90th=[33817], 99.95th=[33817],
     | 99.99th=[33817]
   bw (  KiB/s): min=  680, max=  968, per=23.94%, avg=816.00, stdev=144.67, samples=3
   iops        : min=  170, max=  242, avg=204.00, stdev=36.17, samples=3
  lat (usec)   : 4=0.52%, 10=13.15%, 20=7.55%, 50=2.86%, 100=1.82%
  lat (usec)   : 250=18.10%, 500=2.60%, 750=2.99%, 1000=3.91%
  lat (msec)   : 2=17.06%, 4=13.54%, 10=8.20%, 20=6.77%, 50=0.91%
  cpu          : usr=0.27%, sys=9.26%, ctx=950, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21630: Sat May 11 16:02:58 2024
   read: IOPS=219, BW=877KiB/s (898kB/s)(1564KiB/1783msec)
    clat (usec): min=3, max=30680, avg=1319.06, stdev=3222.58
     lat (usec): min=3, max=30682, avg=1319.90, stdev=3222.60
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   10], 40.00th=[   13], 50.00th=[   22], 60.00th=[  881],
     | 70.00th=[ 1500], 80.00th=[ 1926], 90.00th=[ 2638], 95.00th=[ 3851],
     | 99.00th=[19530], 99.50th=[26870], 99.90th=[30802], 99.95th=[30802],
     | 99.99th=[30802]
   bw (  KiB/s): min=  672, max=  912, per=24.44%, avg=792.00, stdev=120.00, samples=3
   iops        : min=  168, max=  228, avg=198.00, stdev=30.00, samples=3
  write: IOPS=211, BW=846KiB/s (866kB/s)(1508KiB/1783msec)
    clat (usec): min=82, max=30349, avg=3341.39, stdev=5291.48
     lat (usec): min=83, max=30349, avg=3342.00, stdev=5291.48
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[   98], 10.00th=[  113], 20.00th=[  128],
     | 30.00th=[  163], 40.00th=[  249], 50.00th=[  824], 60.00th=[ 1532],
     | 70.00th=[ 2474], 80.00th=[ 5800], 90.00th=[10945], 95.00th=[15533],
     | 99.00th=[22414], 99.50th=[26870], 99.90th=[30278], 99.95th=[30278],
     | 99.99th=[30278]
   bw (  KiB/s): min=  720, max=  904, per=23.31%, avg=794.67, stdev=96.77, samples=3
   iops        : min=  180, max=  226, avg=198.67, stdev=24.19, samples=3
  lat (usec)   : 4=1.30%, 10=15.23%, 20=8.07%, 50=2.60%, 100=3.65%
  lat (usec)   : 250=17.32%, 500=1.95%, 750=2.34%, 1000=5.99%
  lat (msec)   : 2=14.58%, 4=12.37%, 10=6.38%, 20=7.16%, 50=1.04%
  cpu          : usr=0.11%, sys=8.47%, ctx=857, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21631: Sat May 11 16:02:58 2024
   read: IOPS=207, BW=829KiB/s (849kB/s)(1508KiB/1818msec)
    clat (usec): min=3, max=28994, avg=1069.55, stdev=2239.31
     lat (usec): min=3, max=28995, avg=1070.05, stdev=2239.33
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    6], 20.00th=[    8],
     | 30.00th=[   10], 40.00th=[   13], 50.00th=[   23], 60.00th=[  963],
     | 70.00th=[ 1500], 80.00th=[ 1909], 90.00th=[ 2442], 95.00th=[ 3326],
     | 99.00th=[11994], 99.50th=[13698], 99.90th=[28967], 99.95th=[28967],
     | 99.99th=[28967]
   bw (  KiB/s): min=  696, max=  800, per=23.29%, avg=754.67, stdev=53.27, samples=3
   iops        : min=  174, max=  200, avg=188.67, stdev=13.32, samples=3
  write: IOPS=215, BW=860KiB/s (881kB/s)(1564KiB/1818msec)
    clat (usec): min=91, max=40773, avg=3587.78, stdev=5832.32
     lat (usec): min=92, max=40774, avg=3588.70, stdev=5832.52
    clat percentiles (usec):
     |  1.00th=[   94],  5.00th=[  101], 10.00th=[  110], 20.00th=[  128],
     | 30.00th=[  167], 40.00th=[  330], 50.00th=[  947], 60.00th=[ 1549],
     | 70.00th=[ 2442], 80.00th=[ 7504], 90.00th=[11600], 95.00th=[16319],
     | 99.00th=[22152], 99.50th=[39584], 99.90th=[40633], 99.95th=[40633],
     | 99.99th=[40633]
   bw (  KiB/s): min=  720, max=  984, per=23.86%, avg=813.33, stdev=148.02, samples=3
   iops        : min=  180, max=  246, avg=203.33, stdev=37.00, samples=3
  lat (usec)   : 4=0.78%, 10=15.23%, 20=8.07%, 50=3.39%, 100=3.12%
  lat (usec)   : 250=17.19%, 500=1.69%, 750=1.43%, 1000=5.34%
  lat (msec)   : 2=17.32%, 4=11.98%, 10=6.90%, 20=6.25%, 50=1.30%
  cpu          : usr=0.28%, sys=7.26%, ctx=881, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3240KiB/s (3318kB/s), 777KiB/s-877KiB/s (796kB/s-898kB/s), io=5988KiB (6132kB), run=1758-1848msec
  WRITE: bw=3409KiB/s (3491kB/s), 846KiB/s-906KiB/s (866kB/s-927kB/s), io=6300KiB (6451kB), run=1758-1848msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=21632: Sat May 11 16:03:04 2024
   read: IOPS=50, BW=201KiB/s (206kB/s)(1480KiB/7354msec)
    clat (usec): min=536, max=41337, avg=2015.93, stdev=3340.98
     lat (usec): min=536, max=41338, avg=2016.58, stdev=3341.02
    clat percentiles (usec):
     |  1.00th=[  611],  5.00th=[  676], 10.00th=[  725], 20.00th=[  791],
     | 30.00th=[  865], 40.00th=[  979], 50.00th=[ 1090], 60.00th=[ 1237],
     | 70.00th=[ 1647], 80.00th=[ 2442], 90.00th=[ 2868], 95.00th=[ 6456],
     | 99.00th=[14877], 99.50th=[30278], 99.90th=[41157], 99.95th=[41157],
     | 99.99th=[41157]
   bw (  KiB/s): min=  128, max=  328, per=25.08%, avg=199.36, stdev=59.71, samples=14
   iops        : min=   32, max=   82, avg=49.79, stdev=14.91, samples=14
  write: IOPS=54, BW=216KiB/s (222kB/s)(1592KiB/7354msec)
    clat (usec): min=9429, max=41811, avg=16584.78, stdev=4774.18
     lat (usec): min=9430, max=41812, avg=16585.56, stdev=4774.21
    clat percentiles (usec):
     |  1.00th=[ 9634],  5.00th=[10290], 10.00th=[10814], 20.00th=[11731],
     | 30.00th=[13698], 40.00th=[15533], 50.00th=[16581], 60.00th=[17695],
     | 70.00th=[18482], 80.00th=[19530], 90.00th=[21365], 95.00th=[25035],
     | 99.00th=[32637], 99.50th=[38536], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=  136, max=  248, per=25.76%, avg=215.36, stdev=34.04, samples=14
   iops        : min=   34, max=   62, avg=53.79, stdev= 8.54, samples=14
  lat (usec)   : 750=6.12%, 1000=13.67%
  lat (msec)   : 2=16.54%, 4=8.46%, 10=3.12%, 20=43.36%, 50=8.72%
  cpu          : usr=0.16%, sys=1.47%, ctx=910, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21633: Sat May 11 16:03:04 2024
   read: IOPS=47, BW=191KiB/s (195kB/s)(1436KiB/7528msec)
    clat (usec): min=610, max=29539, avg=2234.97, stdev=3522.10
     lat (usec): min=611, max=29541, avg=2235.61, stdev=3522.10
    clat percentiles (usec):
     |  1.00th=[  652],  5.00th=[  717], 10.00th=[  758], 20.00th=[  807],
     | 30.00th=[  889], 40.00th=[  963], 50.00th=[ 1106], 60.00th=[ 1270],
     | 70.00th=[ 1713], 80.00th=[ 2442], 90.00th=[ 3359], 95.00th=[ 9372],
     | 99.00th=[20055], 99.50th=[22938], 99.90th=[29492], 99.95th=[29492],
     | 99.99th=[29492]
   bw (  KiB/s): min=   80, max=  296, per=23.78%, avg=189.07, stdev=60.26, samples=14
   iops        : min=   20, max=   74, avg=47.21, stdev=15.08, samples=14
  write: IOPS=54, BW=217KiB/s (223kB/s)(1636KiB/7528msec)
    clat (usec): min=8720, max=81875, avg=16424.05, stdev=6012.49
     lat (usec): min=8721, max=81877, avg=16424.90, stdev=6012.58
    clat percentiles (usec):
     |  1.00th=[ 8979],  5.00th=[ 9765], 10.00th=[10552], 20.00th=[11731],
     | 30.00th=[13042], 40.00th=[15139], 50.00th=[16188], 60.00th=[17171],
     | 70.00th=[17957], 80.00th=[19268], 90.00th=[21365], 95.00th=[23725],
     | 99.00th=[33162], 99.50th=[35390], 99.90th=[82314], 99.95th=[82314],
     | 99.99th=[82314]
   bw (  KiB/s): min=  136, max=  256, per=25.28%, avg=211.36, stdev=36.11, samples=14
   iops        : min=   34, max=   64, avg=52.79, stdev= 9.00, samples=14
  lat (usec)   : 750=4.04%, 1000=15.62%
  lat (msec)   : 2=14.84%, 4=8.46%, 10=5.08%, 20=42.97%, 50=8.72%
  lat (msec)   : 100=0.26%
  cpu          : usr=0.08%, sys=1.49%, ctx=894, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21634: Sat May 11 16:03:04 2024
   read: IOPS=54, BW=220KiB/s (225kB/s)(1564KiB/7116msec)
    clat (usec): min=630, max=26291, avg=2186.01, stdev=3523.12
     lat (usec): min=630, max=26291, avg=2186.72, stdev=3523.11
    clat percentiles (usec):
     |  1.00th=[  644],  5.00th=[  701], 10.00th=[  742], 20.00th=[  791],
     | 30.00th=[  857], 40.00th=[  938], 50.00th=[ 1045], 60.00th=[ 1221],
     | 70.00th=[ 1696], 80.00th=[ 2409], 90.00th=[ 3032], 95.00th=[ 9372],
     | 99.00th=[20055], 99.50th=[25822], 99.90th=[26346], 99.95th=[26346],
     | 99.99th=[26346]
   bw (  KiB/s): min=   96, max=  368, per=28.02%, avg=222.79, stdev=88.83, samples=14
   iops        : min=   24, max=   92, avg=55.64, stdev=22.28, samples=14
  write: IOPS=52, BW=212KiB/s (217kB/s)(1508KiB/7116msec)
    clat (usec): min=9148, max=65834, avg=16586.00, stdev=5732.31
     lat (usec): min=9149, max=65836, avg=16587.15, stdev=5731.96
    clat percentiles (usec):
     |  1.00th=[ 9503],  5.00th=[10159], 10.00th=[10683], 20.00th=[11731],
     | 30.00th=[13566], 40.00th=[14877], 50.00th=[16319], 60.00th=[17171],
     | 70.00th=[18220], 80.00th=[19530], 90.00th=[22152], 95.00th=[26084],
     | 99.00th=[37487], 99.50th=[41681], 99.90th=[65799], 99.95th=[65799],
     | 99.99th=[65799]
   bw (  KiB/s): min=  120, max=  240, per=25.28%, avg=211.36, stdev=39.08, samples=14
   iops        : min=   30, max=   60, avg=52.79, stdev= 9.82, samples=14
  lat (usec)   : 750=6.64%, 1000=17.19%
  lat (msec)   : 2=13.54%, 4=9.90%, 10=2.99%, 20=40.62%, 50=8.98%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.24%, sys=1.52%, ctx=949, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21635: Sat May 11 16:03:04 2024
   read: IOPS=51, BW=207KiB/s (212kB/s)(1508KiB/7299msec)
    clat (usec): min=596, max=24014, avg=1933.14, stdev=3057.97
     lat (usec): min=596, max=24015, avg=1933.83, stdev=3058.00
    clat percentiles (usec):
     |  1.00th=[  644],  5.00th=[  701], 10.00th=[  742], 20.00th=[  799],
     | 30.00th=[  865], 40.00th=[  922], 50.00th=[ 1012], 60.00th=[ 1139],
     | 70.00th=[ 1434], 80.00th=[ 2114], 90.00th=[ 2933], 95.00th=[ 5604],
     | 99.00th=[19792], 99.50th=[21365], 99.90th=[23987], 99.95th=[23987],
     | 99.99th=[23987]
   bw (  KiB/s): min=  112, max=  335, per=25.57%, avg=203.29, stdev=61.34, samples=14
   iops        : min=   28, max=   83, avg=50.71, stdev=15.24, samples=14
  write: IOPS=53, BW=214KiB/s (219kB/s)(1564KiB/7299msec)
    clat (usec): min=9185, max=77220, avg=16783.40, stdev=6652.33
     lat (usec): min=9186, max=77222, avg=16784.17, stdev=6652.37
    clat percentiles (usec):
     |  1.00th=[ 9634],  5.00th=[10552], 10.00th=[10945], 20.00th=[11731],
     | 30.00th=[13173], 40.00th=[14877], 50.00th=[16188], 60.00th=[17433],
     | 70.00th=[18220], 80.00th=[19530], 90.00th=[21627], 95.00th=[26084],
     | 99.00th=[41157], 99.50th=[70779], 99.90th=[77071], 99.95th=[77071],
     | 99.99th=[77071]
   bw (  KiB/s): min=  136, max=  256, per=25.34%, avg=211.86, stdev=38.72, samples=14
   iops        : min=   34, max=   64, avg=52.86, stdev= 9.64, samples=14
  lat (usec)   : 750=5.47%, 1000=18.23%
  lat (msec)   : 2=15.23%, 4=7.16%, 10=2.47%, 20=42.84%, 50=8.20%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.11%, sys=1.51%, ctx=906, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=795KiB/s (815kB/s), 191KiB/s-220KiB/s (195kB/s-225kB/s), io=5988KiB (6132kB), run=7116-7528msec
  WRITE: bw=837KiB/s (857kB/s), 212KiB/s-217KiB/s (217kB/s-223kB/s), io=6300KiB (6451kB), run=7116-7528msec