== sanity test 398b: DIO and buffer IO race ============== 08:16:00 (1764940560)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.128681 s, 97.8 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=148184: Fri Dec  5 08:16:10 2025
  read: IOPS=107, BW=430KiB/s (440kB/s)(1480KiB/3444msec)
    clat (usec): min=6, max=38330, avg=4972.80, stdev=5839.38
     lat (usec): min=6, max=38331, avg=4973.43, stdev=5839.56
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   16], 20.00th=[   22],
     | 30.00th=[   28], 40.00th=[   53], 50.00th=[ 3589], 60.00th=[ 5800],
     | 70.00th=[ 6980], 80.00th=[ 9372], 90.00th=[12256], 95.00th=[15139],
     | 99.00th=[25822], 99.50th=[36439], 99.90th=[38536], 99.95th=[38536],
     | 99.99th=[38536]
   bw (  KiB/s): min=  295, max=  544, per=24.38%, avg=405.00, stdev=104.95, samples=6
   iops        : min=   73, max=  136, avg=101.00, stdev=26.29, samples=6
  write: IOPS=115, BW=462KiB/s (473kB/s)(1592KiB/3444msec); 0 zone resets
    clat (usec): min=157, max=35681, avg=3940.48, stdev=4918.92
     lat (usec): min=158, max=35682, avg=3941.18, stdev=4918.95
    clat percentiles (usec):
     |  1.00th=[  178],  5.00th=[  215], 10.00th=[  262], 20.00th=[  347],
     | 30.00th=[  482], 40.00th=[  775], 50.00th=[ 2540], 60.00th=[ 3425],
     | 70.00th=[ 4555], 80.00th=[ 6783], 90.00th=[10683], 95.00th=[14484],
     | 99.00th=[19792], 99.50th=[34866], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  360, max=  528, per=25.19%, avg=440.33, stdev=68.10, samples=6
   iops        : min=   90, max=  132, avg=109.83, stdev=17.24, samples=6
  lat (usec)   : 10=1.04%, 20=7.42%, 50=10.42%, 100=1.30%, 250=4.82%
  lat (usec)   : 500=11.85%, 750=4.17%, 1000=1.82%
  lat (msec)   : 2=2.34%, 4=14.06%, 10=26.69%, 20=12.89%, 50=1.17%
  cpu          : usr=0.20%, sys=9.61%, ctx=824, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148185: Fri Dec  5 08:16:10 2025
  read: IOPS=99, BW=398KiB/s (408kB/s)(1436KiB/3604msec)
    clat (usec): min=6, max=53365, avg=5668.80, stdev=6931.44
     lat (usec): min=7, max=53365, avg=5669.33, stdev=6931.46
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   14], 10.00th=[   18], 20.00th=[   24],
     | 30.00th=[   30], 40.00th=[   62], 50.00th=[ 4948], 60.00th=[ 6587],
     | 70.00th=[ 8291], 80.00th=[10159], 90.00th=[12387], 95.00th=[16581],
     | 99.00th=[31851], 99.50th=[49546], 99.90th=[53216], 99.95th=[53216],
     | 99.99th=[53216]
   bw (  KiB/s): min=  264, max=  520, per=23.80%, avg=395.29, stdev=82.02, samples=7
   iops        : min=   66, max=  130, avg=98.57, stdev=20.62, samples=7
  write: IOPS=113, BW=454KiB/s (465kB/s)(1636KiB/3604msec); 0 zone resets
    clat (usec): min=155, max=24867, avg=3791.84, stdev=4270.84
     lat (usec): min=155, max=24867, avg=3792.54, stdev=4270.86
    clat percentiles (usec):
     |  1.00th=[  180],  5.00th=[  217], 10.00th=[  245], 20.00th=[  318],
     | 30.00th=[  465], 40.00th=[  807], 50.00th=[ 2835], 60.00th=[ 3490],
     | 70.00th=[ 4490], 80.00th=[ 6652], 90.00th=[ 9765], 95.00th=[12911],
     | 99.00th=[17433], 99.50th=[20841], 99.90th=[24773], 99.95th=[24773],
     | 99.99th=[24773]
   bw (  KiB/s): min=  376, max=  632, per=25.92%, avg=453.14, stdev=90.51, samples=7
   iops        : min=   94, max=  158, avg=113.00, stdev=22.77, samples=7
  lat (usec)   : 10=0.91%, 20=5.73%, 50=11.72%, 100=0.52%, 250=5.86%
  lat (usec)   : 500=11.46%, 750=3.65%, 1000=1.82%
  lat (msec)   : 2=1.56%, 4=13.41%, 10=28.91%, 20=12.50%, 50=1.82%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.33%, sys=9.94%, ctx=893, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148186: Fri Dec  5 08:16:10 2025
  read: IOPS=111, BW=447KiB/s (458kB/s)(1564KiB/3499msec)
    clat (usec): min=5, max=59215, avg=4996.22, stdev=5978.76
     lat (usec): min=5, max=59216, avg=4996.81, stdev=5978.81
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   16], 20.00th=[   21],
     | 30.00th=[   28], 40.00th=[   45], 50.00th=[ 4424], 60.00th=[ 6259],
     | 70.00th=[ 7701], 80.00th=[ 9372], 90.00th=[11600], 95.00th=[13566],
     | 99.00th=[23200], 99.50th=[39584], 99.90th=[58983], 99.95th=[58983],
     | 99.99th=[58983]
   bw (  KiB/s): min=  272, max=  581, per=25.40%, avg=421.83, stdev=105.01, samples=6
   iops        : min=   68, max=  145, avg=105.17, stdev=26.07, samples=6
  write: IOPS=107, BW=431KiB/s (441kB/s)(1508KiB/3499msec); 0 zone resets
    clat (usec): min=146, max=44445, avg=4000.42, stdev=5438.32
     lat (usec): min=146, max=44445, avg=4001.62, stdev=5438.38
    clat percentiles (usec):
     |  1.00th=[  167],  5.00th=[  210], 10.00th=[  245], 20.00th=[  314],
     | 30.00th=[  412], 40.00th=[  510], 50.00th=[ 1172], 60.00th=[ 3130],
     | 70.00th=[ 4490], 80.00th=[ 6980], 90.00th=[10814], 95.00th=[16188],
     | 99.00th=[21627], 99.50th=[25297], 99.90th=[44303], 99.95th=[44303],
     | 99.99th=[44303]
   bw (  KiB/s): min=  287, max=  663, per=23.77%, avg=415.50, stdev=129.95, samples=6
   iops        : min=   71, max=  165, avg=103.50, stdev=32.39, samples=6
  lat (usec)   : 10=0.52%, 20=8.46%, 50=11.85%, 100=0.78%, 250=5.34%
  lat (usec)   : 500=13.93%, 750=3.65%, 1000=1.30%
  lat (msec)   : 2=1.43%, 4=10.03%, 10=29.30%, 20=11.85%, 50=1.43%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.26%, sys=9.81%, ctx=816, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148187: Fri Dec  5 08:16:10 2025
  read: IOPS=108, BW=436KiB/s (446kB/s)(1508KiB/3462msec)
    clat (usec): min=6, max=49871, avg=5438.46, stdev=6133.81
     lat (usec): min=7, max=49871, avg=5438.96, stdev=6133.83
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   15], 10.00th=[   17], 20.00th=[   22],
     | 30.00th=[   29], 40.00th=[  330], 50.00th=[ 4686], 60.00th=[ 6587],
     | 70.00th=[ 8356], 80.00th=[10028], 90.00th=[12125], 95.00th=[14222],
     | 99.00th=[26608], 99.50th=[32900], 99.90th=[50070], 99.95th=[50070],
     | 99.99th=[50070]
   bw (  KiB/s): min=  343, max=  520, per=24.94%, avg=414.33, stdev=68.24, samples=6
   iops        : min=   85, max=  130, avg=103.33, stdev=17.27, samples=6
  write: IOPS=112, BW=452KiB/s (463kB/s)(1564KiB/3462msec); 0 zone resets
    clat (usec): min=145, max=27720, avg=3543.36, stdev=4959.86
     lat (usec): min=145, max=27721, avg=3544.22, stdev=4960.15
    clat percentiles (usec):
     |  1.00th=[  180],  5.00th=[  206], 10.00th=[  233], 20.00th=[  297],
     | 30.00th=[  359], 40.00th=[  490], 50.00th=[  750], 60.00th=[ 2769],
     | 70.00th=[ 4015], 80.00th=[ 6783], 90.00th=[ 9765], 95.00th=[13960],
     | 99.00th=[23462], 99.50th=[27395], 99.90th=[27657], 99.95th=[27657],
     | 99.99th=[27657]
   bw (  KiB/s): min=  328, max=  560, per=24.63%, avg=430.50, stdev=91.66, samples=6
   iops        : min=   82, max=  140, avg=107.33, stdev=23.03, samples=6
  lat (usec)   : 10=0.91%, 20=7.03%, 50=10.94%, 100=0.26%, 250=6.64%
  lat (usec)   : 500=14.84%, 750=4.56%, 1000=1.95%
  lat (msec)   : 2=1.69%, 4=9.77%, 10=26.95%, 20=12.63%, 50=1.82%
  cpu          : usr=0.26%, sys=9.22%, ctx=812, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1661KiB/s (1701kB/s), 398KiB/s-447KiB/s (408kB/s-458kB/s), io=5988KiB (6132kB), run=3444-3604msec
  WRITE: bw=1748KiB/s (1790kB/s), 431KiB/s-462KiB/s (441kB/s-473kB/s), io=6300KiB (6451kB), run=3444-3604msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=148189: Fri Dec  5 08:16:14 2025
  read: IOPS=48, BW=194KiB/s (198kB/s)(1480KiB/7646msec)
    clat (usec): min=1847, max=61703, avg=7303.26, stdev=5911.71
     lat (usec): min=1848, max=61704, avg=7304.22, stdev=5911.69
    clat percentiles (usec):
     |  1.00th=[ 1958],  5.00th=[ 2474], 10.00th=[ 2737], 20.00th=[ 3261],
     | 30.00th=[ 3752], 40.00th=[ 4228], 50.00th=[ 5211], 60.00th=[ 6587],
     | 70.00th=[ 7963], 80.00th=[10552], 90.00th=[14353], 95.00th=[19530],
     | 99.00th=[25560], 99.50th=[29754], 99.90th=[61604], 99.95th=[61604],
     | 99.99th=[61604]
   bw (  KiB/s): min=  127, max=  312, per=24.70%, avg=193.40, stdev=55.97, samples=15
   iops        : min=   31, max=   78, avg=47.80, stdev=14.07, samples=15
  write: IOPS=52, BW=208KiB/s (213kB/s)(1592KiB/7646msec); 0 zone resets
    clat (usec): min=3965, max=36367, avg=12366.05, stdev=5053.14
     lat (usec): min=3966, max=36369, avg=12367.67, stdev=5053.13
    clat percentiles (usec):
     |  1.00th=[ 4621],  5.00th=[ 5800], 10.00th=[ 7046], 20.00th=[ 8356],
     | 30.00th=[ 9241], 40.00th=[10028], 50.00th=[11207], 60.00th=[12387],
     | 70.00th=[14222], 80.00th=[16450], 90.00th=[19268], 95.00th=[21627],
     | 99.00th=[29754], 99.50th=[31589], 99.90th=[36439], 99.95th=[36439],
     | 99.99th=[36439]
   bw (  KiB/s): min=  127, max=  311, per=25.28%, avg=208.07, stdev=57.15, samples=15
   iops        : min=   31, max=   77, avg=51.47, stdev=14.25, samples=15
  lat (msec)   : 2=0.52%, 4=16.15%, 10=41.02%, 20=35.81%, 50=6.38%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.25%, sys=3.02%, ctx=910, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148190: Fri Dec  5 08:16:14 2025
  read: IOPS=47, BW=190KiB/s (194kB/s)(1436KiB/7573msec)
    clat (usec): min=1777, max=61130, avg=7136.72, stdev=6154.95
     lat (usec): min=1778, max=61131, avg=7137.75, stdev=6154.92
    clat percentiles (usec):
     |  1.00th=[ 1958],  5.00th=[ 2540], 10.00th=[ 2769], 20.00th=[ 3195],
     | 30.00th=[ 3589], 40.00th=[ 4047], 50.00th=[ 4817], 60.00th=[ 5932],
     | 70.00th=[ 7570], 80.00th=[ 9896], 90.00th=[16188], 95.00th=[19006],
     | 99.00th=[28443], 99.50th=[34866], 99.90th=[61080], 99.95th=[61080],
     | 99.99th=[61080]
   bw (  KiB/s): min=  105, max=  303, per=24.16%, avg=189.14, stdev=66.31, samples=14
   iops        : min=   26, max=   75, avg=46.79, stdev=16.58, samples=14
  write: IOPS=54, BW=216KiB/s (221kB/s)(1636KiB/7573msec); 0 zone resets
    clat (usec): min=4450, max=39106, avg=12199.54, stdev=5030.84
     lat (usec): min=4451, max=39107, avg=12200.92, stdev=5030.90
    clat percentiles (usec):
     |  1.00th=[ 4883],  5.00th=[ 6390], 10.00th=[ 7242], 20.00th=[ 8160],
     | 30.00th=[ 9110], 40.00th=[10028], 50.00th=[11076], 60.00th=[12387],
     | 70.00th=[13566], 80.00th=[15533], 90.00th=[18744], 95.00th=[21365],
     | 99.00th=[29492], 99.50th=[32375], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min=  111, max=  335, per=25.78%, avg=212.14, stdev=54.11, samples=14
   iops        : min=   27, max=   83, avg=52.50, stdev=13.56, samples=14
  lat (msec)   : 2=0.78%, 4=17.32%, 10=40.49%, 20=36.20%, 50=5.08%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.15%, sys=3.04%, ctx=891, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148191: Fri Dec  5 08:16:14 2025
  read: IOPS=52, BW=209KiB/s (214kB/s)(1564KiB/7492msec)
    clat (usec): min=1871, max=34805, avg=6994.03, stdev=4839.63
     lat (usec): min=1872, max=34807, avg=6995.85, stdev=4839.64
    clat percentiles (usec):
     |  1.00th=[ 2040],  5.00th=[ 2540], 10.00th=[ 2802], 20.00th=[ 3294],
     | 30.00th=[ 3818], 40.00th=[ 4359], 50.00th=[ 5211], 60.00th=[ 6390],
     | 70.00th=[ 8586], 80.00th=[10421], 90.00th=[13829], 95.00th=[16319],
     | 99.00th=[24249], 99.50th=[29492], 99.90th=[34866], 99.95th=[34866],
     | 99.99th=[34866]
   bw (  KiB/s): min=  132, max=  343, per=27.25%, avg=213.36, stdev=66.74, samples=14
   iops        : min=   33, max=   85, avg=52.86, stdev=16.70, samples=14
  write: IOPS=50, BW=201KiB/s (206kB/s)(1508KiB/7492msec); 0 zone resets
    clat (usec): min=4363, max=61214, avg=12576.01, stdev=5752.78
     lat (usec): min=4365, max=61216, avg=12577.49, stdev=5752.89
    clat percentiles (usec):
     |  1.00th=[ 5080],  5.00th=[ 6325], 10.00th=[ 7242], 20.00th=[ 8356],
     | 30.00th=[ 9503], 40.00th=[10290], 50.00th=[11207], 60.00th=[12387],
     | 70.00th=[13829], 80.00th=[15795], 90.00th=[19530], 95.00th=[23200],
     | 99.00th=[33817], 99.50th=[39584], 99.90th=[61080], 99.95th=[61080],
     | 99.99th=[61080]
   bw (  KiB/s): min=  143, max=  287, per=24.13%, avg=198.57, stdev=48.48, samples=14
   iops        : min=   35, max=   71, avg=49.14, stdev=12.04, samples=14
  lat (msec)   : 2=0.39%, 4=17.58%, 10=39.84%, 20=36.59%, 50=5.47%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.31%, sys=2.98%, ctx=912, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148192: Fri Dec  5 08:16:14 2025
  read: IOPS=49, BW=199KiB/s (204kB/s)(1508KiB/7577msec)
    clat (usec): min=1547, max=40193, avg=6995.82, stdev=5475.85
     lat (usec): min=1547, max=40193, avg=6996.82, stdev=5475.79
    clat percentiles (usec):
     |  1.00th=[ 2057],  5.00th=[ 2606], 10.00th=[ 2769], 20.00th=[ 3064],
     | 30.00th=[ 3556], 40.00th=[ 4080], 50.00th=[ 4752], 60.00th=[ 5604],
     | 70.00th=[ 7767], 80.00th=[10290], 90.00th=[14746], 95.00th=[18482],
     | 99.00th=[24249], 99.50th=[39060], 99.90th=[40109], 99.95th=[40109],
     | 99.99th=[40109]
   bw (  KiB/s): min=  103, max=  335, per=24.91%, avg=195.07, stdev=58.82, samples=14
   iops        : min=   25, max=   83, avg=48.29, stdev=14.57, samples=14
  write: IOPS=51, BW=206KiB/s (211kB/s)(1564KiB/7577msec); 0 zone resets
    clat (usec): min=4246, max=38861, avg=12578.15, stdev=5268.02
     lat (usec): min=4248, max=38862, avg=12579.84, stdev=5268.25
    clat percentiles (usec):
     |  1.00th=[ 5080],  5.00th=[ 6587], 10.00th=[ 7504], 20.00th=[ 8586],
     | 30.00th=[ 9372], 40.00th=[10159], 50.00th=[11338], 60.00th=[12387],
     | 70.00th=[14091], 80.00th=[16319], 90.00th=[19006], 95.00th=[22938],
     | 99.00th=[32637], 99.50th=[36439], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min=  103, max=  288, per=24.94%, avg=205.29, stdev=52.61, samples=14
   iops        : min=   25, max=   72, avg=50.79, stdev=13.22, samples=14
  lat (msec)   : 2=0.39%, 4=18.49%, 10=38.28%, 20=37.24%, 50=5.60%
  cpu          : usr=0.25%, sys=3.01%, ctx=888, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=783KiB/s (802kB/s), 190KiB/s-209KiB/s (194kB/s-214kB/s), io=5988KiB (6132kB), run=7492-7646msec
  WRITE: bw=824KiB/s (844kB/s), 201KiB/s-216KiB/s (206kB/s-221kB/s), io=6300KiB (6451kB), run=7492-7646msec