== sanity test 398b: DIO and buffer IO race ============== 18:21:16 (1747261276)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0657695 s, 191 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=23832: Wed May 14 18:21:20 2025
   read: IOPS=169, BW=679KiB/s (695kB/s)(1480KiB/2180msec)
    clat (usec): min=3, max=45112, avg=1310.13, stdev=2941.36
     lat (usec): min=3, max=45112, avg=1310.96, stdev=2941.38
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   20], 50.00th=[   37], 60.00th=[ 1221],
     | 70.00th=[ 1745], 80.00th=[ 2376], 90.00th=[ 3032], 95.00th=[ 3687],
     | 99.00th=[10683], 99.50th=[17695], 99.90th=[45351], 99.95th=[45351],
     | 99.99th=[45351]
   bw (  KiB/s): min=  488, max=  744, per=23.74%, avg=648.00, stdev=119.91, samples=4
   iops        : min=  122, max=  186, avg=162.00, stdev=29.98, samples=4
  write: IOPS=182, BW=730KiB/s (748kB/s)(1592KiB/2180msec)
    clat (usec): min=94, max=46954, avg=4241.33, stdev=6100.04
     lat (usec): min=95, max=46955, avg=4242.03, stdev=6100.05
    clat percentiles (usec):
     |  1.00th=[  103],  5.00th=[  120], 10.00th=[  133], 20.00th=[  172],
     | 30.00th=[  343], 40.00th=[  996], 50.00th=[ 1565], 60.00th=[ 2343],
     | 70.00th=[ 3949], 80.00th=[ 8094], 90.00th=[12518], 95.00th=[17433],
     | 99.00th=[27919], 99.50th=[32375], 99.90th=[46924], 99.95th=[46924],
     | 99.99th=[46924]
   bw (  KiB/s): min=  512, max=  968, per=24.65%, avg=708.00, stdev=193.16, samples=4
   iops        : min=  128, max=  242, avg=177.00, stdev=48.29, samples=4
  lat (usec)   : 4=0.13%, 10=8.59%, 20=10.68%, 50=4.82%, 100=1.04%
  lat (usec)   : 250=14.71%, 500=1.56%, 750=1.04%, 1000=5.34%
  lat (msec)   : 2=16.15%, 4=18.36%, 10=9.77%, 20=5.99%, 50=1.82%
  cpu          : usr=0.23%, sys=7.71%, ctx=1018, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23833: Wed May 14 18:21:20 2025
   read: IOPS=166, BW=668KiB/s (684kB/s)(1436KiB/2150msec)
    clat (usec): min=4, max=30996, avg=1229.76, stdev=2647.11
     lat (usec): min=4, max=30997, avg=1230.79, stdev=2646.92
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   12], 40.00th=[   17], 50.00th=[   30], 60.00th=[ 1172],
     | 70.00th=[ 1762], 80.00th=[ 2245], 90.00th=[ 2933], 95.00th=[ 3654],
     | 99.00th=[ 9896], 99.50th=[30540], 99.90th=[31065], 99.95th=[31065],
     | 99.99th=[31065]
   bw (  KiB/s): min=  416, max=  904, per=24.18%, avg=660.00, stdev=205.16, samples=4
   iops        : min=  104, max=  226, avg=165.00, stdev=51.29, samples=4
  write: IOPS=190, BW=761KiB/s (779kB/s)(1636KiB/2150msec)
    clat (usec): min=87, max=61800, avg=4160.41, stdev=6157.49
     lat (usec): min=87, max=61801, avg=4161.19, stdev=6157.45
    clat percentiles (usec):
     |  1.00th=[  100],  5.00th=[  121], 10.00th=[  151], 20.00th=[  184],
     | 30.00th=[  289], 40.00th=[ 1004], 50.00th=[ 1647], 60.00th=[ 2409],
     | 70.00th=[ 4293], 80.00th=[ 7832], 90.00th=[10945], 95.00th=[15664],
     | 99.00th=[23987], 99.50th=[25822], 99.90th=[61604], 99.95th=[61604],
     | 99.99th=[61604]
   bw (  KiB/s): min=  480, max=  888, per=25.70%, avg=738.00, stdev=178.33, samples=4
   iops        : min=  120, max=  222, avg=184.50, stdev=44.58, samples=4
  lat (usec)   : 10=9.24%, 20=10.94%, 50=4.17%, 100=1.56%, 250=15.10%
  lat (usec)   : 500=1.43%, 750=1.43%, 1000=3.91%
  lat (msec)   : 2=15.76%, 4=18.36%, 10=10.42%, 20=5.60%, 50=1.95%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.28%, sys=8.33%, ctx=949, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23834: Wed May 14 18:21:20 2025
   read: IOPS=186, BW=747KiB/s (765kB/s)(1564KiB/2093msec)
    clat (usec): min=3, max=25174, avg=1286.73, stdev=2272.62
     lat (usec): min=3, max=25174, avg=1287.34, stdev=2272.62
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    8], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[   23], 50.00th=[  873], 60.00th=[ 1319],
     | 70.00th=[ 1844], 80.00th=[ 2376], 90.00th=[ 2802], 95.00th=[ 3261],
     | 99.00th=[14484], 99.50th=[18744], 99.90th=[25297], 99.95th=[25297],
     | 99.99th=[25297]
   bw (  KiB/s): min=  480, max=  928, per=27.11%, avg=740.00, stdev=194.70, samples=4
   iops        : min=  120, max=  232, avg=185.00, stdev=48.68, samples=4
  write: IOPS=180, BW=720KiB/s (738kB/s)(1508KiB/2093msec)
    clat (usec): min=99, max=70464, avg=4198.79, stdev=6510.58
     lat (usec): min=99, max=70465, avg=4199.56, stdev=6510.65
    clat percentiles (usec):
     |  1.00th=[  109],  5.00th=[  128], 10.00th=[  147], 20.00th=[  184],
     | 30.00th=[  619], 40.00th=[ 1029], 50.00th=[ 1598], 60.00th=[ 2212],
     | 70.00th=[ 4555], 80.00th=[ 8225], 90.00th=[11600], 95.00th=[14746],
     | 99.00th=[25822], 99.50th=[41681], 99.90th=[70779], 99.95th=[70779],
     | 99.99th=[70779]
   bw (  KiB/s): min=  608, max=  848, per=24.09%, avg=692.00, stdev=113.42, samples=4
   iops        : min=  152, max=  212, avg=173.00, stdev=28.35, samples=4
  lat (usec)   : 4=0.13%, 10=7.68%, 20=11.59%, 50=4.69%, 100=0.65%
  lat (usec)   : 250=12.76%, 500=1.82%, 750=1.43%, 1000=4.95%
  lat (msec)   : 2=19.27%, 4=17.71%, 10=9.90%, 20=6.38%, 50=0.91%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.14%, sys=7.93%, ctx=987, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23835: Wed May 14 18:21:20 2025
   read: IOPS=171, BW=688KiB/s (704kB/s)(1508KiB/2193msec)
    clat (usec): min=4, max=25421, avg=1578.31, stdev=3008.04
     lat (usec): min=4, max=25422, avg=1578.91, stdev=3008.04
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[   22], 50.00th=[   61], 60.00th=[ 1614],
     | 70.00th=[ 2057], 80.00th=[ 2540], 90.00th=[ 3228], 95.00th=[ 4752],
     | 99.00th=[15139], 99.50th=[25297], 99.90th=[25297], 99.95th=[25297],
     | 99.99th=[25297]
   bw (  KiB/s): min=  576, max=  736, per=23.74%, avg=648.00, stdev=80.27, samples=4
   iops        : min=  144, max=  184, avg=162.00, stdev=20.07, samples=4
  write: IOPS=178, BW=713KiB/s (730kB/s)(1564KiB/2193msec)
    clat (usec): min=99, max=42587, avg=4064.61, stdev=6004.91
     lat (usec): min=99, max=42587, avg=4065.75, stdev=6004.71
    clat percentiles (usec):
     |  1.00th=[  106],  5.00th=[  118], 10.00th=[  145], 20.00th=[  178],
     | 30.00th=[  297], 40.00th=[ 1045], 50.00th=[ 1582], 60.00th=[ 2311],
     | 70.00th=[ 3589], 80.00th=[ 7373], 90.00th=[11731], 95.00th=[16712],
     | 99.00th=[24773], 99.50th=[36439], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min=  608, max=  784, per=23.47%, avg=674.00, stdev=77.94, samples=4
   iops        : min=  152, max=  196, avg=168.50, stdev=19.49, samples=4
  lat (usec)   : 10=9.24%, 20=9.51%, 50=5.73%, 100=0.65%, 250=14.45%
  lat (usec)   : 500=2.08%, 750=0.65%, 1000=4.17%
  lat (msec)   : 2=16.28%, 4=20.31%, 10=9.11%, 20=5.73%, 50=2.08%
  cpu          : usr=0.09%, sys=8.67%, ctx=1018, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2731KiB/s (2796kB/s), 668KiB/s-747KiB/s (684kB/s-765kB/s), io=5988KiB (6132kB), run=2093-2193msec
  WRITE: bw=2873KiB/s (2942kB/s), 713KiB/s-761KiB/s (730kB/s-779kB/s), io=6300KiB (6451kB), run=2093-2193msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=23828: Wed May 14 18:21:25 2025
   read: IOPS=46, BW=186KiB/s (190kB/s)(1480KiB/7959msec)
    clat (usec): min=669, max=23898, avg=2096.34, stdev=3214.08
     lat (usec): min=670, max=23899, avg=2097.12, stdev=3214.10
    clat percentiles (usec):
     |  1.00th=[  693],  5.00th=[  799], 10.00th=[  857], 20.00th=[  914],
     | 30.00th=[  979], 40.00th=[ 1057], 50.00th=[ 1156], 60.00th=[ 1270],
     | 70.00th=[ 1434], 80.00th=[ 1778], 90.00th=[ 3032], 95.00th=[ 8356],
     | 99.00th=[19268], 99.50th=[21627], 99.90th=[23987], 99.95th=[23987],
     | 99.99th=[23987]
   bw (  KiB/s): min=  112, max=  328, per=25.11%, avg=185.07, stdev=57.52, samples=15
   iops        : min=   28, max=   82, avg=46.27, stdev=14.38, samples=15
  write: IOPS=50, BW=200KiB/s (205kB/s)(1592KiB/7959msec)
    clat (usec): min=8252, max=70472, avg=18020.59, stdev=7116.64
     lat (usec): min=8253, max=70473, avg=18021.52, stdev=7116.66
    clat percentiles (usec):
     |  1.00th=[ 9110],  5.00th=[10552], 10.00th=[11338], 20.00th=[12387],
     | 30.00th=[13960], 40.00th=[15926], 50.00th=[17171], 60.00th=[18744],
     | 70.00th=[20055], 80.00th=[21365], 90.00th=[23200], 95.00th=[28705],
     | 99.00th=[48497], 99.50th=[69731], 99.90th=[70779], 99.95th=[70779],
     | 99.99th=[70779]
   bw (  KiB/s): min=  128, max=  232, per=25.57%, avg=198.40, stdev=35.67, samples=15
   iops        : min=   32, max=   58, avg=49.60, stdev= 8.92, samples=15
  lat (usec)   : 750=1.30%, 1000=14.71%
  lat (msec)   : 2=24.09%, 4=3.91%, 10=3.65%, 20=36.59%, 50=15.36%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.24%, sys=1.46%, ctx=830, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23829: Wed May 14 18:21:25 2025
   read: IOPS=44, BW=177KiB/s (181kB/s)(1436KiB/8114msec)
    clat (usec): min=663, max=29656, avg=2128.20, stdev=3401.96
     lat (usec): min=664, max=29657, avg=2128.98, stdev=3401.99
    clat percentiles (usec):
     |  1.00th=[  758],  5.00th=[  840], 10.00th=[  881], 20.00th=[  938],
     | 30.00th=[ 1004], 40.00th=[ 1074], 50.00th=[ 1172], 60.00th=[ 1287],
     | 70.00th=[ 1467], 80.00th=[ 1893], 90.00th=[ 2835], 95.00th=[ 9241],
     | 99.00th=[18482], 99.50th=[29492], 99.90th=[29754], 99.95th=[29754],
     | 99.99th=[29754]
   bw (  KiB/s): min=   96, max=  296, per=23.86%, avg=175.88, stdev=54.66, samples=16
   iops        : min=   24, max=   74, avg=43.88, stdev=13.68, samples=16
  write: IOPS=50, BW=202KiB/s (206kB/s)(1636KiB/8114msec)
    clat (usec): min=8334, max=66914, avg=17935.88, stdev=6344.48
     lat (usec): min=8335, max=66916, avg=17936.81, stdev=6344.49
    clat percentiles (usec):
     |  1.00th=[ 9241],  5.00th=[10421], 10.00th=[11076], 20.00th=[12518],
     | 30.00th=[14222], 40.00th=[16188], 50.00th=[17957], 60.00th=[19006],
     | 70.00th=[19792], 80.00th=[21365], 90.00th=[23987], 95.00th=[28967],
     | 99.00th=[41681], 99.50th=[45351], 99.90th=[66847], 99.95th=[66847],
     | 99.99th=[66847]
   bw (  KiB/s): min=  136, max=  240, per=25.63%, avg=198.88, stdev=32.80, samples=16
   iops        : min=   34, max=   60, avg=49.63, stdev= 8.23, samples=16
  lat (usec)   : 750=0.39%, 1000=13.28%
  lat (msec)   : 2=24.35%, 4=4.95%, 10=3.52%, 20=37.63%, 50=15.76%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.06%, sys=1.59%, ctx=836, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23830: Wed May 14 18:21:25 2025
   read: IOPS=50, BW=203KiB/s (207kB/s)(1564KiB/7723msec)
    clat (usec): min=674, max=18826, avg=1971.03, stdev=2574.97
     lat (usec): min=675, max=18827, avg=1971.85, stdev=2574.99
    clat percentiles (usec):
     |  1.00th=[  742],  5.00th=[  807], 10.00th=[  857], 20.00th=[  922],
     | 30.00th=[  979], 40.00th=[ 1045], 50.00th=[ 1156], 60.00th=[ 1319],
     | 70.00th=[ 1450], 80.00th=[ 1762], 90.00th=[ 2900], 95.00th=[ 8455],
     | 99.00th=[15008], 99.50th=[18482], 99.90th=[18744], 99.95th=[18744],
     | 99.99th=[18744]
   bw (  KiB/s): min=   96, max=  320, per=27.86%, avg=205.33, stdev=73.30, samples=15
   iops        : min=   24, max=   80, avg=51.33, stdev=18.33, samples=15
  write: IOPS=48, BW=195KiB/s (200kB/s)(1508KiB/7723msec)
    clat (usec): min=8638, max=81288, avg=18403.92, stdev=7130.26
     lat (usec): min=8639, max=81289, avg=18404.84, stdev=7130.30
    clat percentiles (usec):
     |  1.00th=[ 9110],  5.00th=[10683], 10.00th=[11469], 20.00th=[12649],
     | 30.00th=[14222], 40.00th=[16057], 50.00th=[17957], 60.00th=[19268],
     | 70.00th=[20317], 80.00th=[21890], 90.00th=[24511], 95.00th=[31065],
     | 99.00th=[46400], 99.50th=[56361], 99.90th=[81265], 99.95th=[81265],
     | 99.99th=[81265]
   bw (  KiB/s): min=  136, max=  264, per=25.15%, avg=195.20, stdev=35.75, samples=15
   iops        : min=   34, max=   66, avg=48.80, stdev= 8.94, samples=15
  lat (usec)   : 750=0.65%, 1000=16.15%
  lat (msec)   : 2=25.26%, 4=4.69%, 10=3.78%, 20=33.46%, 50=15.62%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.16%, sys=1.59%, ctx=835, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23831: Wed May 14 18:21:25 2025
   read: IOPS=47, BW=189KiB/s (194kB/s)(1508KiB/7963msec)
    clat (usec): min=700, max=34162, avg=2015.36, stdev=3161.57
     lat (usec): min=700, max=34162, avg=2016.13, stdev=3161.60
    clat percentiles (usec):
     |  1.00th=[  742],  5.00th=[  816], 10.00th=[  857], 20.00th=[  930],
     | 30.00th=[  979], 40.00th=[ 1057], 50.00th=[ 1172], 60.00th=[ 1319],
     | 70.00th=[ 1450], 80.00th=[ 1713], 90.00th=[ 2540], 95.00th=[ 8455],
     | 99.00th=[16909], 99.50th=[25297], 99.90th=[34341], 99.95th=[34341],
     | 99.99th=[34341]
   bw (  KiB/s): min=  104, max=  296, per=24.82%, avg=182.93, stdev=51.66, samples=15
   iops        : min=   26, max=   74, avg=45.73, stdev=12.91, samples=15
  write: IOPS=49, BW=196KiB/s (201kB/s)(1564KiB/7963msec)
    clat (usec): min=8052, max=85593, avg=18387.39, stdev=7062.67
     lat (usec): min=8053, max=85594, avg=18388.33, stdev=7062.68
    clat percentiles (usec):
     |  1.00th=[ 8979],  5.00th=[10290], 10.00th=[11338], 20.00th=[12518],
     | 30.00th=[14615], 40.00th=[16450], 50.00th=[18220], 60.00th=[19530],
     | 70.00th=[20579], 80.00th=[22152], 90.00th=[24249], 95.00th=[29492],
     | 99.00th=[42730], 99.50th=[55313], 99.90th=[85459], 99.95th=[85459],
     | 99.99th=[85459]
   bw (  KiB/s): min=  128, max=  224, per=24.74%, avg=192.00, stdev=33.94, samples=15
   iops        : min=   32, max=   56, avg=48.00, stdev= 8.49, samples=15
  lat (usec)   : 750=0.52%, 1000=15.76%
  lat (msec)   : 2=25.52%, 4=3.65%, 10=3.52%, 20=32.68%, 50=18.10%
  lat (msec)   : 100=0.26%
  cpu          : usr=0.19%, sys=1.52%, ctx=830, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=738KiB/s (756kB/s), 177KiB/s-203KiB/s (181kB/s-207kB/s), io=5988KiB (6132kB), run=7723-8114msec
  WRITE: bw=776KiB/s (795kB/s), 195KiB/s-202KiB/s (200kB/s-206kB/s), io=6300KiB (6451kB), run=7723-8114msec