== sanity test 398b: DIO and buffer IO race ============== 11:24:01 (1761319441)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.144423 s, 87.1 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=148182: Fri Oct 24 11:24:13 2025
  read: IOPS=73, BW=293KiB/s (300kB/s)(1480KiB/5055msec)
    clat (usec): min=7, max=78258, avg=7813.94, stdev=8572.93
     lat (usec): min=8, max=78258, avg=7814.60, stdev=8572.94
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   18], 10.00th=[   21], 20.00th=[   32],
     | 30.00th=[  611], 40.00th=[ 5211], 50.00th=[ 6915], 60.00th=[ 8455],
     | 70.00th=[10028], 80.00th=[12256], 90.00th=[15401], 95.00th=[22938],
     | 99.00th=[40109], 99.50th=[53740], 99.90th=[78119], 99.95th=[78119],
     | 99.99th=[78119]
   bw (  KiB/s): min=  238, max=  343, per=23.94%, avg=283.44, stdev=38.81, samples=9
   iops        : min=   59, max=   85, avg=70.44, stdev= 9.67, samples=9
  write: IOPS=78, BW=315KiB/s (322kB/s)(1592KiB/5055msec); 0 zone resets
    clat (usec): min=157, max=67032, avg=5388.76, stdev=6909.62
     lat (usec): min=157, max=67033, avg=5389.60, stdev=6909.62
    clat percentiles (usec):
     |  1.00th=[  192],  5.00th=[  219], 10.00th=[  260], 20.00th=[  359],
     | 30.00th=[  474], 40.00th=[ 1516], 50.00th=[ 3294], 60.00th=[ 4490],
     | 70.00th=[ 6652], 80.00th=[ 9241], 90.00th=[14353], 95.00th=[18744],
     | 99.00th=[32113], 99.50th=[35914], 99.90th=[66847], 99.95th=[66847],
     | 99.99th=[66847]
   bw (  KiB/s): min=  223, max=  407, per=24.64%, avg=307.00, stdev=62.53, samples=9
   iops        : min=   55, max=  101, avg=76.33, stdev=15.65, samples=9
  lat (usec)   : 10=0.65%, 20=3.39%, 50=9.38%, 100=0.52%, 250=4.82%
  lat (usec)   : 500=11.85%, 750=3.12%, 1000=0.91%
  lat (msec)   : 2=1.56%, 4=10.03%, 10=29.43%, 20=19.40%, 50=4.56%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.28%, sys=8.69%, ctx=1007, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148183: Fri Oct 24 11:24:13 2025
  read: IOPS=74, BW=297KiB/s (304kB/s)(1436KiB/4836msec)
    clat (usec): min=7, max=49658, avg=7280.84, stdev=7383.64
     lat (usec): min=8, max=49660, avg=7281.57, stdev=7383.69
    clat percentiles (usec):
     |  1.00th=[   11],  5.00th=[   17], 10.00th=[   22], 20.00th=[   30],
     | 30.00th=[   48], 40.00th=[ 4424], 50.00th=[ 6718], 60.00th=[ 8717],
     | 70.00th=[10683], 80.00th=[12649], 90.00th=[15401], 95.00th=[17433],
     | 99.00th=[35390], 99.50th=[47973], 99.90th=[49546], 99.95th=[49546],
     | 99.99th=[49546]
   bw (  KiB/s): min=  224, max=  391, per=24.47%, avg=289.67, stdev=54.82, samples=9
   iops        : min=   56, max=   97, avg=72.00, stdev=13.56, samples=9
  write: IOPS=84, BW=338KiB/s (346kB/s)(1636KiB/4836msec); 0 zone resets
    clat (usec): min=174, max=28869, avg=5361.41, stdev=6354.33
     lat (usec): min=175, max=28871, avg=5362.24, stdev=6354.36
    clat percentiles (usec):
     |  1.00th=[  188],  5.00th=[  231], 10.00th=[  265], 20.00th=[  330],
     | 30.00th=[  441], 40.00th=[  725], 50.00th=[ 3097], 60.00th=[ 4490],
     | 70.00th=[ 6915], 80.00th=[ 9896], 90.00th=[15008], 95.00th=[18744],
     | 99.00th=[26346], 99.50th=[27657], 99.90th=[28967], 99.95th=[28967],
     | 99.99th=[28967]
   bw (  KiB/s): min=  247, max=  558, per=26.22%, avg=326.67, stdev=98.64, samples=9
   iops        : min=   61, max=  139, avg=81.33, stdev=24.63, samples=9
  lat (usec)   : 10=0.39%, 20=3.52%, 50=10.29%, 100=0.65%, 250=4.82%
  lat (usec)   : 500=13.15%, 750=3.78%, 1000=0.39%
  lat (msec)   : 2=1.43%, 4=8.85%, 10=27.21%, 20=21.74%, 50=3.78%
  cpu          : usr=0.19%, sys=8.62%, ctx=962, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148184: Fri Oct 24 11:24:13 2025
  read: IOPS=82, BW=331KiB/s (339kB/s)(1564KiB/4719msec)
    clat (usec): min=7, max=55355, avg=7508.10, stdev=7670.73
     lat (usec): min=7, max=55355, avg=7508.82, stdev=7670.73
    clat percentiles (usec):
     |  1.00th=[   12],  5.00th=[   15], 10.00th=[   19], 20.00th=[   29],
     | 30.00th=[   43], 40.00th=[ 5014], 50.00th=[ 6652], 60.00th=[ 8356],
     | 70.00th=[10159], 80.00th=[12649], 90.00th=[16909], 95.00th=[21103],
     | 99.00th=[31851], 99.50th=[38536], 99.90th=[55313], 99.95th=[55313],
     | 99.99th=[55313]
   bw (  KiB/s): min=  200, max=  510, per=27.96%, avg=331.00, stdev=88.52, samples=9
   iops        : min=   50, max=  127, avg=82.44, stdev=21.94, samples=9
  write: IOPS=79, BW=320KiB/s (327kB/s)(1508KiB/4719msec); 0 zone resets
    clat (usec): min=154, max=39448, avg=4657.13, stdev=5869.58
     lat (usec): min=154, max=39449, avg=4658.40, stdev=5869.63
    clat percentiles (usec):
     |  1.00th=[  194],  5.00th=[  219], 10.00th=[  260], 20.00th=[  338],
     | 30.00th=[  437], 40.00th=[  873], 50.00th=[ 3130], 60.00th=[ 4293],
     | 70.00th=[ 5211], 80.00th=[ 8160], 90.00th=[12125], 95.00th=[16909],
     | 99.00th=[28705], 99.50th=[37487], 99.90th=[39584], 99.95th=[39584],
     | 99.99th=[39584]
   bw (  KiB/s): min=  200, max=  399, per=24.84%, avg=309.56, stdev=64.20, samples=9
   iops        : min=   50, max=   99, avg=77.00, stdev=15.97, samples=9
  lat (usec)   : 10=0.39%, 20=5.60%, 50=10.16%, 100=0.39%, 250=4.30%
  lat (usec)   : 500=12.37%, 750=2.47%, 1000=1.30%
  lat (msec)   : 2=0.78%, 4=8.72%, 10=30.99%, 20=18.23%, 50=4.17%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.32%, sys=8.90%, ctx=966, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148185: Fri Oct 24 11:24:13 2025
  read: IOPS=80, BW=322KiB/s (330kB/s)(1508KiB/4678msec)
    clat (usec): min=4, max=53738, avg=7245.18, stdev=7678.59
     lat (usec): min=5, max=53739, avg=7245.94, stdev=7678.56
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   14], 10.00th=[   19], 20.00th=[   26],
     | 30.00th=[   42], 40.00th=[ 4293], 50.00th=[ 6259], 60.00th=[ 8225],
     | 70.00th=[10421], 80.00th=[12387], 90.00th=[16188], 95.00th=[20317],
     | 99.00th=[35390], 99.50th=[38011], 99.90th=[53740], 99.95th=[53740],
     | 99.99th=[53740]
   bw (  KiB/s): min=  232, max=  495, per=27.14%, avg=321.33, stdev=74.23, samples=9
   iops        : min=   58, max=  123, avg=79.89, stdev=18.37, samples=9
  write: IOPS=83, BW=334KiB/s (342kB/s)(1564KiB/4678msec); 0 zone resets
    clat (usec): min=171, max=33887, avg=4922.17, stdev=6101.25
     lat (usec): min=172, max=33887, avg=4923.24, stdev=6101.34
    clat percentiles (usec):
     |  1.00th=[  180],  5.00th=[  217], 10.00th=[  243], 20.00th=[  314],
     | 30.00th=[  408], 40.00th=[  791], 50.00th=[ 2835], 60.00th=[ 4228],
     | 70.00th=[ 6259], 80.00th=[ 8848], 90.00th=[12649], 95.00th=[18482],
     | 99.00th=[28705], 99.50th=[30016], 99.90th=[33817], 99.95th=[33817],
     | 99.99th=[33817]
   bw (  KiB/s): min=  280, max=  471, per=26.90%, avg=335.22, stdev=61.08, samples=9
   iops        : min=   70, max=  117, avg=83.44, stdev=15.09, samples=9
  lat (usec)   : 10=0.91%, 20=5.08%, 50=10.03%, 100=0.52%, 250=6.64%
  lat (usec)   : 500=11.85%, 750=1.56%, 1000=1.56%
  lat (msec)   : 2=2.99%, 4=8.07%, 10=27.08%, 20=19.53%, 50=4.04%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.24%, sys=9.19%, ctx=936, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1185KiB/s (1213kB/s), 293KiB/s-331KiB/s (300kB/s-339kB/s), io=5988KiB (6132kB), run=4678-5055msec
  WRITE: bw=1246KiB/s (1276kB/s), 315KiB/s-338KiB/s (322kB/s-346kB/s), io=6300KiB (6451kB), run=4678-5055msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=148187: Fri Oct 24 11:24:15 2025
  read: IOPS=48, BW=193KiB/s (197kB/s)(1480KiB/7675msec)
    clat (usec): min=1690, max=43338, avg=7220.15, stdev=6734.27
     lat (usec): min=1690, max=43339, avg=7221.62, stdev=6733.85
    clat percentiles (usec):
     |  1.00th=[ 1729],  5.00th=[ 2278], 10.00th=[ 2474], 20.00th=[ 2835],
     | 30.00th=[ 3228], 40.00th=[ 3785], 50.00th=[ 4359], 60.00th=[ 5407],
     | 70.00th=[ 7635], 80.00th=[10290], 90.00th=[16319], 95.00th=[21890],
     | 99.00th=[34866], 99.50th=[42206], 99.90th=[43254], 99.95th=[43254],
     | 99.99th=[43254]
   bw (  KiB/s): min=   87, max=  384, per=24.61%, avg=191.93, stdev=92.71, samples=15
   iops        : min=   21, max=   96, avg=47.53, stdev=23.32, samples=15
  write: IOPS=51, BW=207KiB/s (212kB/s)(1592KiB/7675msec); 0 zone resets
    clat (usec): min=3406, max=54673, avg=12521.10, stdev=7441.60
     lat (usec): min=3406, max=54674, avg=12522.53, stdev=7441.57
    clat percentiles (usec):
     |  1.00th=[ 4146],  5.00th=[ 5538], 10.00th=[ 6194], 20.00th=[ 7308],
     | 30.00th=[ 8291], 40.00th=[ 9110], 50.00th=[10028], 60.00th=[11469],
     | 70.00th=[13435], 80.00th=[16909], 90.00th=[22676], 95.00th=[28181],
     | 99.00th=[46400], 99.50th=[52167], 99.90th=[54789], 99.95th=[54789],
     | 99.99th=[54789]
   bw (  KiB/s): min=   63, max=  360, per=25.27%, avg=207.20, stdev=97.85, samples=15
   iops        : min=   15, max=   90, avg=51.40, stdev=24.60, samples=15
  lat (msec)   : 2=0.91%, 4=20.83%, 10=41.93%, 20=26.82%, 50=9.11%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.29%, sys=2.83%, ctx=831, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148188: Fri Oct 24 11:24:15 2025
  read: IOPS=46, BW=187KiB/s (192kB/s)(1436KiB/7670msec)
    clat (usec): min=1608, max=41833, avg=6828.78, stdev=6480.24
     lat (usec): min=1609, max=41834, avg=6829.71, stdev=6480.21
    clat percentiles (usec):
     |  1.00th=[ 1844],  5.00th=[ 2278], 10.00th=[ 2507], 20.00th=[ 2933],
     | 30.00th=[ 3261], 40.00th=[ 3687], 50.00th=[ 4359], 60.00th=[ 5014],
     | 70.00th=[ 6390], 80.00th=[ 9241], 90.00th=[15401], 95.00th=[21627],
     | 99.00th=[34866], 99.50th=[38011], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=   91, max=  344, per=24.02%, avg=187.33, stdev=91.16, samples=15
   iops        : min=   22, max=   86, avg=46.40, stdev=22.94, samples=15
  write: IOPS=53, BW=213KiB/s (218kB/s)(1636KiB/7670msec); 0 zone resets
    clat (usec): min=3384, max=45582, avg=12715.90, stdev=7210.79
     lat (usec): min=3385, max=45585, avg=12717.18, stdev=7210.83
    clat percentiles (usec):
     |  1.00th=[ 4621],  5.00th=[ 5604], 10.00th=[ 6390], 20.00th=[ 7308],
     | 30.00th=[ 8225], 40.00th=[ 9110], 50.00th=[10421], 60.00th=[11731],
     | 70.00th=[13829], 80.00th=[16909], 90.00th=[22938], 95.00th=[27657],
     | 99.00th=[37487], 99.50th=[42206], 99.90th=[45351], 99.95th=[45351],
     | 99.99th=[45351]
   bw (  KiB/s): min=  111, max=  383, per=25.92%, avg=212.53, stdev=89.54, samples=15
   iops        : min=   27, max=   95, avg=52.73, stdev=22.51, samples=15
  lat (msec)   : 2=1.17%, 4=19.92%, 10=42.19%, 20=26.17%, 50=10.55%
  cpu          : usr=0.30%, sys=2.91%, ctx=848, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148189: Fri Oct 24 11:24:15 2025
  read: IOPS=51, BW=207KiB/s (212kB/s)(1564KiB/7546msec)
    clat (usec): min=1578, max=40369, avg=7013.83, stdev=6403.87
     lat (usec): min=1578, max=40370, avg=7015.02, stdev=6403.74
    clat percentiles (usec):
     |  1.00th=[ 1909],  5.00th=[ 2212], 10.00th=[ 2474], 20.00th=[ 2966],
     | 30.00th=[ 3359], 40.00th=[ 3818], 50.00th=[ 4293], 60.00th=[ 5145],
     | 70.00th=[ 6980], 80.00th=[ 9634], 90.00th=[16712], 95.00th=[21627],
     | 99.00th=[32637], 99.50th=[39060], 99.90th=[40109], 99.95th=[40109],
     | 99.99th=[40109]
   bw (  KiB/s): min=   95, max=  463, per=25.80%, avg=201.21, stdev=106.19, samples=14
   iops        : min=   23, max=  115, avg=49.86, stdev=26.60, samples=14
  write: IOPS=49, BW=200KiB/s (205kB/s)(1508KiB/7546msec); 0 zone resets
    clat (usec): min=3615, max=52184, avg=12691.24, stdev=7532.56
     lat (usec): min=3616, max=52184, avg=12692.71, stdev=7532.70
    clat percentiles (usec):
     |  1.00th=[ 4080],  5.00th=[ 5276], 10.00th=[ 5997], 20.00th=[ 7177],
     | 30.00th=[ 8160], 40.00th=[ 8848], 50.00th=[10159], 60.00th=[11994],
     | 70.00th=[13829], 80.00th=[17433], 90.00th=[23987], 95.00th=[28705],
     | 99.00th=[39584], 99.50th=[45876], 99.90th=[52167], 99.95th=[52167],
     | 99.99th=[52167]
   bw (  KiB/s): min=  104, max=  384, per=23.28%, avg=190.86, stdev=85.77, samples=14
   iops        : min=   26, max=   96, avg=47.29, stdev=21.54, samples=14
  lat (msec)   : 2=1.04%, 4=22.27%, 10=41.41%, 20=25.39%, 50=9.77%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.40%, sys=2.78%, ctx=854, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=148190: Fri Oct 24 11:24:15 2025
  read: IOPS=49, BW=197KiB/s (202kB/s)(1508KiB/7650msec)
    clat (usec): min=1684, max=63913, avg=7370.75, stdev=7258.99
     lat (usec): min=1685, max=63914, avg=7371.75, stdev=7259.00
    clat percentiles (usec):
     |  1.00th=[ 1844],  5.00th=[ 2212], 10.00th=[ 2507], 20.00th=[ 2835],
     | 30.00th=[ 3195], 40.00th=[ 3654], 50.00th=[ 4293], 60.00th=[ 5211],
     | 70.00th=[ 6783], 80.00th=[11600], 90.00th=[17433], 95.00th=[22152],
     | 99.00th=[32375], 99.50th=[41157], 99.90th=[63701], 99.95th=[63701],
     | 99.99th=[63701]
   bw (  KiB/s): min=   95, max=  391, per=25.21%, avg=196.60, stdev=92.14, samples=15
   iops        : min=   23, max=   97, avg=48.73, stdev=23.13, samples=15
  write: IOPS=51, BW=204KiB/s (209kB/s)(1564KiB/7650msec); 0 zone resets
    clat (usec): min=3957, max=49117, avg=12419.32, stdev=6995.06
     lat (usec): min=3959, max=49118, avg=12420.65, stdev=6995.03
    clat percentiles (usec):
     |  1.00th=[ 4146],  5.00th=[ 5342], 10.00th=[ 6194], 20.00th=[ 7177],
     | 30.00th=[ 8160], 40.00th=[ 9110], 50.00th=[10421], 60.00th=[11600],
     | 70.00th=[13304], 80.00th=[16581], 90.00th=[21627], 95.00th=[27657],
     | 99.00th=[39584], 99.50th=[43779], 99.90th=[49021], 99.95th=[49021],
     | 99.99th=[49021]
   bw (  KiB/s): min=   95, max=  376, per=24.98%, avg=204.87, stdev=98.18, samples=15
   iops        : min=   23, max=   94, avg=50.80, stdev=24.68, samples=15
  lat (msec)   : 2=1.30%, 4=21.48%, 10=39.71%, 20=27.21%, 50=10.16%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.22%, sys=2.89%, ctx=837, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=780KiB/s (799kB/s), 187KiB/s-207KiB/s (192kB/s-212kB/s), io=5988KiB (6132kB), run=7546-7675msec
  WRITE: bw=821KiB/s (841kB/s), 200KiB/s-213KiB/s (205kB/s-218kB/s), io=6300KiB (6451kB), run=7546-7675msec