== sanity test 398b: DIO and buffer IO race ============== 11:32:02 (1736267522)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0728242 s, 173 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=21319: Tue Jan  7 11:32:06 2025
   read: IOPS=205, BW=820KiB/s (840kB/s)(1480KiB/1804msec)
    clat (usec): min=3, max=28908, avg=1351.78, stdev=2986.87
     lat (usec): min=3, max=28908, avg=1352.43, stdev=2986.90
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   17], 50.00th=[   30], 60.00th=[ 1037],
     | 70.00th=[ 1680], 80.00th=[ 2212], 90.00th=[ 3064], 95.00th=[ 3916],
     | 99.00th=[18220], 99.50th=[25560], 99.90th=[28967], 99.95th=[28967],
     | 99.99th=[28967]
   bw (  KiB/s): min=  616, max=  896, per=24.02%, avg=797.33, stdev=157.24, samples=3
   iops        : min=  154, max=  224, avg=199.33, stdev=39.31, samples=3
  write: IOPS=220, BW=882KiB/s (904kB/s)(1592KiB/1804msec)
    clat (usec): min=84, max=32993, avg=3223.15, stdev=4486.86
     lat (usec): min=84, max=32994, avg=3224.02, stdev=4486.76
    clat percentiles (usec):
     |  1.00th=[   97],  5.00th=[  114], 10.00th=[  129], 20.00th=[  174],
     | 30.00th=[  231], 40.00th=[  840], 50.00th=[ 1205], 60.00th=[ 1778],
     | 70.00th=[ 3261], 80.00th=[ 5997], 90.00th=[10159], 95.00th=[12256],
     | 99.00th=[18482], 99.50th=[22676], 99.90th=[32900], 99.95th=[32900],
     | 99.99th=[32900]
   bw (  KiB/s): min=  608, max= 1048, per=24.74%, avg=864.00, stdev=228.67, samples=3
   iops        : min=  152, max=  262, avg=216.00, stdev=57.17, samples=3
  lat (usec)   : 4=0.26%, 10=8.98%, 20=11.20%, 50=5.08%, 100=1.30%
  lat (usec)   : 250=15.76%, 500=2.86%, 750=1.56%, 1000=4.43%
  lat (msec)   : 2=17.71%, 4=14.45%, 10=10.29%, 20=5.47%, 50=0.65%
  cpu          : usr=0.17%, sys=9.82%, ctx=949, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21321: Tue Jan  7 11:32:06 2025
   read: IOPS=199, BW=800KiB/s (819kB/s)(1436KiB/1796msec)
    clat (usec): min=3, max=21349, avg=1286.31, stdev=2352.92
     lat (usec): min=4, max=21349, avg=1286.90, stdev=2352.93
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[   24], 50.00th=[   72], 60.00th=[ 1221],
     | 70.00th=[ 1795], 80.00th=[ 2147], 90.00th=[ 2835], 95.00th=[ 3982],
     | 99.00th=[15926], 99.50th=[16188], 99.90th=[21365], 99.95th=[21365],
     | 99.99th=[21365]
   bw (  KiB/s): min=  696, max=  896, per=24.02%, avg=797.33, stdev=100.03, samples=3
   iops        : min=  174, max=  224, avg=199.33, stdev=25.01, samples=3
  write: IOPS=227, BW=911KiB/s (933kB/s)(1636KiB/1796msec)
    clat (usec): min=93, max=38951, avg=3236.21, stdev=4742.29
     lat (usec): min=93, max=38953, avg=3236.94, stdev=4742.33
    clat percentiles (usec):
     |  1.00th=[  103],  5.00th=[  118], 10.00th=[  141], 20.00th=[  178],
     | 30.00th=[  343], 40.00th=[  938], 50.00th=[ 1450], 60.00th=[ 1958],
     | 70.00th=[ 2769], 80.00th=[ 5342], 90.00th=[ 9634], 95.00th=[12911],
     | 99.00th=[21627], 99.50th=[25035], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min=  760, max= 1040, per=25.66%, avg=896.00, stdev=140.17, samples=3
   iops        : min=  190, max=  260, avg=224.00, stdev=35.04, samples=3
  lat (usec)   : 4=0.13%, 10=7.68%, 20=9.64%, 50=5.60%, 100=1.04%
  lat (usec)   : 250=15.10%, 500=2.73%, 750=1.56%, 1000=4.95%
  lat (msec)   : 2=19.79%, 4=16.67%, 10=10.55%, 20=3.65%, 50=0.91%
  cpu          : usr=0.28%, sys=9.97%, ctx=1040, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21322: Tue Jan  7 11:32:06 2025
   read: IOPS=219, BW=877KiB/s (898kB/s)(1564KiB/1784msec)
    clat (usec): min=3, max=30796, avg=1325.29, stdev=2601.46
     lat (usec): min=3, max=30796, avg=1326.31, stdev=2601.26
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   17], 50.00th=[   31], 60.00th=[ 1156],
     | 70.00th=[ 1827], 80.00th=[ 2311], 90.00th=[ 3032], 95.00th=[ 3949],
     | 99.00th=[11994], 99.50th=[20055], 99.90th=[30802], 99.95th=[30802],
     | 99.99th=[30802]
   bw (  KiB/s): min=  576, max= 1000, per=24.83%, avg=824.00, stdev=220.98, samples=3
   iops        : min=  144, max=  250, avg=206.00, stdev=55.24, samples=3
  write: IOPS=211, BW=845KiB/s (866kB/s)(1508KiB/1784msec)
    clat (usec): min=86, max=39714, avg=3332.89, stdev=5187.47
     lat (usec): min=87, max=39715, avg=3333.59, stdev=5187.48
    clat percentiles (usec):
     |  1.00th=[   94],  5.00th=[  108], 10.00th=[  125], 20.00th=[  167],
     | 30.00th=[  204], 40.00th=[  742], 50.00th=[ 1287], 60.00th=[ 1958],
     | 70.00th=[ 3064], 80.00th=[ 5604], 90.00th=[ 9372], 95.00th=[13960],
     | 99.00th=[26084], 99.50th=[26870], 99.90th=[39584], 99.95th=[39584],
     | 99.99th=[39584]
   bw (  KiB/s): min=  688, max=  944, per=23.44%, avg=818.67, stdev=128.08, samples=3
   iops        : min=  172, max=  236, avg=204.67, stdev=32.02, samples=3
  lat (usec)   : 4=0.52%, 10=10.29%, 20=11.46%, 50=4.17%, 100=1.82%
  lat (usec)   : 250=15.23%, 500=1.82%, 750=2.08%, 1000=4.43%
  lat (msec)   : 2=15.76%, 4=17.71%, 10=9.37%, 20=4.04%, 50=1.30%
  cpu          : usr=0.45%, sys=8.75%, ctx=941, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21323: Tue Jan  7 11:32:06 2025
   read: IOPS=226, BW=907KiB/s (929kB/s)(1508KiB/1662msec)
    clat (usec): min=3, max=28110, avg=1173.71, stdev=2285.96
     lat (usec): min=4, max=28110, avg=1174.31, stdev=2285.96
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   16], 50.00th=[   25], 60.00th=[ 1074],
     | 70.00th=[ 1713], 80.00th=[ 2212], 90.00th=[ 2835], 95.00th=[ 3425],
     | 99.00th=[10421], 99.50th=[17957], 99.90th=[28181], 99.95th=[28181],
     | 99.99th=[28181]
   bw (  KiB/s): min=  776, max=  992, per=26.19%, avg=869.33, stdev=110.95, samples=3
   iops        : min=  194, max=  248, avg=217.33, stdev=27.74, samples=3
  write: IOPS=235, BW=941KiB/s (964kB/s)(1564KiB/1662msec)
    clat (usec): min=88, max=38040, avg=3065.32, stdev=4426.06
     lat (usec): min=88, max=38042, avg=3066.04, stdev=4426.12
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  119], 10.00th=[  139], 20.00th=[  163],
     | 30.00th=[  210], 40.00th=[  898], 50.00th=[ 1467], 60.00th=[ 2024],
     | 70.00th=[ 3032], 80.00th=[ 5211], 90.00th=[ 9110], 95.00th=[11338],
     | 99.00th=[17957], 99.50th=[32375], 99.90th=[38011], 99.95th=[38011],
     | 99.99th=[38011]
   bw (  KiB/s): min=  840, max= 1000, per=25.89%, avg=904.00, stdev=84.66, samples=3
   iops        : min=  210, max=  250, avg=226.00, stdev=21.17, samples=3
  lat (usec)   : 4=0.52%, 10=10.03%, 20=11.59%, 50=4.95%, 100=0.78%
  lat (usec)   : 250=16.15%, 500=1.43%, 750=0.78%, 1000=4.17%
  lat (msec)   : 2=17.06%, 4=18.75%, 10=9.11%, 20=4.17%, 50=0.52%
  cpu          : usr=0.24%, sys=9.75%, ctx=906, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3319KiB/s (3399kB/s), 800KiB/s-907KiB/s (819kB/s-929kB/s), io=5988KiB (6132kB), run=1662-1804msec
  WRITE: bw=3492KiB/s (3576kB/s), 845KiB/s-941KiB/s (866kB/s-964kB/s), io=6300KiB (6451kB), run=1662-1804msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=21316: Tue Jan  7 11:32:11 2025
   read: IOPS=53, BW=213KiB/s (218kB/s)(1480KiB/6953msec)
    clat (usec): min=626, max=25110, avg=2011.68, stdev=3019.55
     lat (usec): min=627, max=25110, avg=2012.67, stdev=3019.58
    clat percentiles (usec):
     |  1.00th=[  701],  5.00th=[  750], 10.00th=[  799], 20.00th=[  857],
     | 30.00th=[  930], 40.00th=[  988], 50.00th=[ 1074], 60.00th=[ 1205],
     | 70.00th=[ 1401], 80.00th=[ 1811], 90.00th=[ 3228], 95.00th=[ 7701],
     | 99.00th=[17957], 99.50th=[21365], 99.90th=[25035], 99.95th=[25035],
     | 99.99th=[25035]
   bw (  KiB/s): min=  135, max=  335, per=24.88%, avg=211.46, stdev=56.16, samples=13
   iops        : min=   33, max=   83, avg=52.69, stdev=13.98, samples=13
  write: IOPS=57, BW=229KiB/s (234kB/s)(1592KiB/6953msec)
    clat (usec): min=7714, max=48497, avg=15558.94, stdev=4989.77
     lat (usec): min=7715, max=48498, avg=15560.10, stdev=4990.04
    clat percentiles (usec):
     |  1.00th=[ 9110],  5.00th=[ 9765], 10.00th=[10552], 20.00th=[11731],
     | 30.00th=[12780], 40.00th=[13698], 50.00th=[14746], 60.00th=[15926],
     | 70.00th=[16712], 80.00th=[18482], 90.00th=[20579], 95.00th=[23200],
     | 99.00th=[38011], 99.50th=[39584], 99.90th=[48497], 99.95th=[48497],
     | 99.99th=[48497]
   bw (  KiB/s): min=  152, max=  272, per=25.48%, avg=228.08, stdev=40.41, samples=13
   iops        : min=   38, max=   68, avg=56.85, stdev=10.16, samples=13
  lat (usec)   : 750=2.21%, 1000=17.71%
  lat (msec)   : 2=20.44%, 4=3.39%, 10=5.86%, 20=43.23%, 50=7.16%
  cpu          : usr=0.16%, sys=1.71%, ctx=822, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21317: Tue Jan  7 11:32:11 2025
   read: IOPS=51, BW=204KiB/s (209kB/s)(1436KiB/7037msec)
    clat (usec): min=696, max=18623, avg=1805.73, stdev=2139.53
     lat (usec): min=696, max=18624, avg=1806.60, stdev=2139.54
    clat percentiles (usec):
     |  1.00th=[  717],  5.00th=[  783], 10.00th=[  832], 20.00th=[  898],
     | 30.00th=[  955], 40.00th=[ 1057], 50.00th=[ 1172], 60.00th=[ 1319],
     | 70.00th=[ 1516], 80.00th=[ 1795], 90.00th=[ 2540], 95.00th=[ 6849],
     | 99.00th=[12911], 99.50th=[15008], 99.90th=[18744], 99.95th=[18744],
     | 99.99th=[18744]
   bw (  KiB/s): min=  112, max=  272, per=24.11%, avg=204.92, stdev=50.34, samples=13
   iops        : min=   28, max=   68, avg=51.23, stdev=12.58, samples=13
  write: IOPS=58, BW=232KiB/s (238kB/s)(1636KiB/7037msec)
    clat (usec): min=7193, max=43408, avg=15592.25, stdev=4978.24
     lat (usec): min=7194, max=43410, avg=15593.30, stdev=4978.21
    clat percentiles (usec):
     |  1.00th=[ 8225],  5.00th=[ 9241], 10.00th=[10028], 20.00th=[11469],
     | 30.00th=[12780], 40.00th=[13960], 50.00th=[15270], 60.00th=[16319],
     | 70.00th=[17171], 80.00th=[18482], 90.00th=[20579], 95.00th=[24249],
     | 99.00th=[34866], 99.50th=[37487], 99.90th=[43254], 99.95th=[43254],
     | 99.99th=[43254]
   bw (  KiB/s): min=  176, max=  288, per=25.58%, avg=228.92, stdev=35.86, samples=13
   iops        : min=   44, max=   72, avg=57.23, stdev= 8.96, samples=13
  lat (usec)   : 750=1.30%, 1000=15.23%
  lat (msec)   : 2=22.40%, 4=4.43%, 10=7.55%, 20=42.84%, 50=6.25%
  cpu          : usr=0.20%, sys=1.65%, ctx=826, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21318: Tue Jan  7 11:32:11 2025
   read: IOPS=58, BW=233KiB/s (239kB/s)(1564KiB/6706msec)
    clat (usec): min=653, max=23193, avg=1697.91, stdev=2533.84
     lat (usec): min=654, max=23193, avg=1698.72, stdev=2533.86
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  758], 10.00th=[  799], 20.00th=[  840],
     | 30.00th=[  898], 40.00th=[  979], 50.00th=[ 1057], 60.00th=[ 1172],
     | 70.00th=[ 1319], 80.00th=[ 1614], 90.00th=[ 2114], 95.00th=[ 4047],
     | 99.00th=[16581], 99.50th=[22676], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  120, max=  368, per=27.87%, avg=236.92, stdev=90.01, samples=13
   iops        : min=   30, max=   92, avg=59.23, stdev=22.50, samples=13
  write: IOPS=56, BW=225KiB/s (230kB/s)(1508KiB/6706msec)
    clat (usec): min=6996, max=46182, avg=15999.02, stdev=5164.06
     lat (usec): min=6996, max=46184, avg=16000.01, stdev=5164.11
    clat percentiles (usec):
     |  1.00th=[ 8291],  5.00th=[ 9634], 10.00th=[10290], 20.00th=[11600],
     | 30.00th=[12780], 40.00th=[14484], 50.00th=[15533], 60.00th=[16712],
     | 70.00th=[17957], 80.00th=[19530], 90.00th=[21103], 95.00th=[23987],
     | 99.00th=[38011], 99.50th=[45351], 99.90th=[46400], 99.95th=[46400],
     | 99.99th=[46400]
   bw (  KiB/s): min=  152, max=  280, per=25.10%, avg=224.62, stdev=39.39, samples=13
   iops        : min=   38, max=   70, avg=56.15, stdev= 9.85, samples=13
  lat (usec)   : 750=2.47%, 1000=19.79%
  lat (msec)   : 2=22.40%, 4=3.65%, 10=5.34%, 20=38.54%, 50=7.81%
  cpu          : usr=0.13%, sys=1.73%, ctx=833, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21320: Tue Jan  7 11:32:11 2025
   read: IOPS=55, BW=222KiB/s (227kB/s)(1508KiB/6806msec)
    clat (usec): min=614, max=21831, avg=1784.03, stdev=2418.81
     lat (usec): min=614, max=21832, avg=1784.86, stdev=2418.81
    clat percentiles (usec):
     |  1.00th=[  660],  5.00th=[  742], 10.00th=[  799], 20.00th=[  840],
     | 30.00th=[  898], 40.00th=[  971], 50.00th=[ 1090], 60.00th=[ 1221],
     | 70.00th=[ 1467], 80.00th=[ 1778], 90.00th=[ 2573], 95.00th=[ 5342],
     | 99.00th=[13698], 99.50th=[20317], 99.90th=[21890], 99.95th=[21890],
     | 99.99th=[21890]
   bw (  KiB/s): min=  120, max=  328, per=25.76%, avg=218.92, stdev=61.85, samples=13
   iops        : min=   30, max=   82, avg=54.62, stdev=15.54, samples=13
  write: IOPS=57, BW=230KiB/s (235kB/s)(1564KiB/6806msec)
    clat (usec): min=7611, max=52575, avg=15657.66, stdev=5294.91
     lat (usec): min=7611, max=52576, avg=15658.72, stdev=5294.91
    clat percentiles (usec):
     |  1.00th=[ 8160],  5.00th=[ 9110], 10.00th=[10290], 20.00th=[11469],
     | 30.00th=[12518], 40.00th=[13960], 50.00th=[15270], 60.00th=[16450],
     | 70.00th=[17171], 80.00th=[18482], 90.00th=[20579], 95.00th=[24249],
     | 99.00th=[39584], 99.50th=[40633], 99.90th=[52691], 99.95th=[52691],
     | 99.99th=[52691]
   bw (  KiB/s): min=  152, max=  304, per=25.56%, avg=228.77, stdev=40.04, samples=13
   iops        : min=   38, max=   76, avg=57.08, stdev=10.10, samples=13
  lat (usec)   : 750=2.73%, 1000=17.71%
  lat (msec)   : 2=20.96%, 4=4.43%, 10=6.38%, 20=41.28%, 50=6.38%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.15%, sys=1.73%, ctx=847, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=851KiB/s (871kB/s), 204KiB/s-233KiB/s (209kB/s-239kB/s), io=5988KiB (6132kB), run=6706-7037msec
  WRITE: bw=895KiB/s (917kB/s), 225KiB/s-232KiB/s (230kB/s-238kB/s), io=6300KiB (6451kB), run=6706-7037msec