== sanity test 398b: DIO and buffer IO race ============== 09:30:28 (1759843828)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.0727234 s, 173 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=122371: Tue Oct  7 09:30:36 2025
  read: IOPS=131, BW=527KiB/s (539kB/s)(1480KiB/2811msec)
    clat (usec): min=7, max=28817, avg=2222.69, stdev=3332.64
     lat (usec): min=7, max=28817, avg=2223.15, stdev=3332.65
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   15], 20.00th=[   20],
     | 30.00th=[   30], 40.00th=[   48], 50.00th=[ 1549], 60.00th=[ 2376],
     | 70.00th=[ 2966], 80.00th=[ 3916], 90.00th=[ 5276], 95.00th=[ 6718],
     | 99.00th=[19530], 99.50th=[26870], 99.90th=[28705], 99.95th=[28705],
     | 99.99th=[28705]
   bw (  KiB/s): min=  360, max=  576, per=23.66%, avg=500.00, stdev=89.71, samples=5
   iops        : min=   90, max=  144, avg=125.00, stdev=22.43, samples=5
  write: IOPS=141, BW=566KiB/s (580kB/s)(1592KiB/2811msec); 0 zone resets
    clat (usec): min=133, max=29666, avg=4966.08, stdev=5858.49
     lat (usec): min=134, max=29667, avg=4966.77, stdev=5858.61
    clat percentiles (usec):
     |  1.00th=[  159],  5.00th=[  198], 10.00th=[  237], 20.00th=[  347],
     | 30.00th=[  725], 40.00th=[ 1795], 50.00th=[ 2704], 60.00th=[ 3949],
     | 70.00th=[ 5669], 80.00th=[ 9110], 90.00th=[13435], 95.00th=[18482],
     | 99.00th=[23725], 99.50th=[27395], 99.90th=[29754], 99.95th=[29754],
     | 99.99th=[29754]
   bw (  KiB/s): min=  456, max=  664, per=24.48%, avg=544.20, stdev=75.84, samples=5
   iops        : min=  114, max=  166, avg=136.00, stdev=18.97, samples=5
  lat (usec)   : 10=1.17%, 20=9.11%, 50=9.64%, 100=1.69%, 250=6.12%
  lat (usec)   : 500=8.72%, 750=1.82%, 1000=0.13%
  lat (msec)   : 2=9.64%, 4=22.53%, 10=19.01%, 20=7.94%, 50=2.47%
  cpu          : usr=0.21%, sys=11.28%, ctx=1066, majf=0, minf=19
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=122373: Tue Oct  7 09:30:36 2025
  read: IOPS=128, BW=516KiB/s (528kB/s)(1436KiB/2784msec)
    clat (usec): min=5, max=23226, avg=2622.00, stdev=3521.66
     lat (usec): min=6, max=23226, avg=2622.94, stdev=3521.83
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   12], 10.00th=[   15], 20.00th=[   21],
     | 30.00th=[   36], 40.00th=[   96], 50.00th=[ 2057], 60.00th=[ 2769],
     | 70.00th=[ 3556], 80.00th=[ 4490], 90.00th=[ 5735], 95.00th=[ 6718],
     | 99.00th=[20841], 99.50th=[21365], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  368, max=  632, per=24.03%, avg=507.80, stdev=97.20, samples=5
   iops        : min=   92, max=  158, avg=126.80, stdev=24.27, samples=5
  write: IOPS=146, BW=588KiB/s (602kB/s)(1636KiB/2784msec); 0 zone resets
    clat (usec): min=119, max=24069, avg=4467.18, stdev=5211.43
     lat (usec): min=119, max=24069, avg=4467.98, stdev=5211.63
    clat percentiles (usec):
     |  1.00th=[  135],  5.00th=[  217], 10.00th=[  251], 20.00th=[  343],
     | 30.00th=[  578], 40.00th=[ 1467], 50.00th=[ 2311], 60.00th=[ 3654],
     | 70.00th=[ 5276], 80.00th=[ 8160], 90.00th=[12125], 95.00th=[15401],
     | 99.00th=[22676], 99.50th=[23462], 99.90th=[23987], 99.95th=[23987],
     | 99.99th=[23987]
   bw (  KiB/s): min=  512, max=  632, per=25.57%, avg=568.40, stdev=43.00, samples=5
   iops        : min=  128, max=  158, avg=142.00, stdev=10.77, samples=5
  lat (usec)   : 10=1.56%, 20=6.64%, 50=9.24%, 100=1.30%, 250=5.60%
  lat (usec)   : 500=9.64%, 750=2.08%, 1000=0.52%
  lat (msec)   : 2=11.33%, 4=21.22%, 10=20.57%, 20=8.72%, 50=1.56%
  cpu          : usr=0.22%, sys=10.42%, ctx=1062, majf=0, minf=18
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=122374: Tue Oct  7 09:30:36 2025
  read: IOPS=138, BW=552KiB/s (565kB/s)(1564KiB/2833msec)
    clat (usec): min=5, max=23203, avg=2415.94, stdev=3179.99
     lat (usec): min=5, max=23203, avg=2416.58, stdev=3179.88
    clat percentiles (usec):
     |  1.00th=[    8],  5.00th=[   13], 10.00th=[   16], 20.00th=[   23],
     | 30.00th=[   34], 40.00th=[   84], 50.00th=[ 1778], 60.00th=[ 2638],
     | 70.00th=[ 3392], 80.00th=[ 4293], 90.00th=[ 5342], 95.00th=[ 6521],
     | 99.00th=[19792], 99.50th=[22676], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  423, max=  608, per=24.60%, avg=519.80, stdev=84.00, samples=5
   iops        : min=  105, max=  152, avg=129.80, stdev=21.22, samples=5
  write: IOPS=133, BW=532KiB/s (545kB/s)(1508KiB/2833msec); 0 zone resets
    clat (usec): min=117, max=44549, avg=4969.29, stdev=6146.93
     lat (usec): min=117, max=44550, avg=4969.88, stdev=6146.95
    clat percentiles (usec):
     |  1.00th=[  149],  5.00th=[  182], 10.00th=[  243], 20.00th=[  363],
     | 30.00th=[ 1029], 40.00th=[ 1762], 50.00th=[ 2704], 60.00th=[ 3916],
     | 70.00th=[ 5669], 80.00th=[ 8717], 90.00th=[13042], 95.00th=[17433],
     | 99.00th=[24249], 99.50th=[43254], 99.90th=[44303], 99.95th=[44303],
     | 99.99th=[44303]
   bw (  KiB/s): min=  424, max=  616, per=22.83%, avg=507.40, stdev=75.67, samples=5
   iops        : min=  106, max=  154, avg=126.80, stdev=18.90, samples=5
  lat (usec)   : 10=1.56%, 20=7.55%, 50=10.16%, 100=1.17%, 250=5.99%
  lat (usec)   : 500=7.94%, 750=1.43%, 1000=0.26%
  lat (msec)   : 2=11.33%, 4=21.35%, 10=21.61%, 20=7.68%, 50=1.95%
  cpu          : usr=0.32%, sys=9.96%, ctx=1082, majf=0, minf=19
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=122375: Tue Oct  7 09:30:36 2025
  read: IOPS=144, BW=578KiB/s (592kB/s)(1508KiB/2608msec)
    clat (usec): min=6, max=27721, avg=2215.96, stdev=3240.82
     lat (usec): min=6, max=27721, avg=2216.62, stdev=3240.89
    clat percentiles (usec):
     |  1.00th=[    7],  5.00th=[   11], 10.00th=[   15], 20.00th=[   19],
     | 30.00th=[   28], 40.00th=[   41], 50.00th=[ 1450], 60.00th=[ 2409],
     | 70.00th=[ 3097], 80.00th=[ 4080], 90.00th=[ 5145], 95.00th=[ 6587],
     | 99.00th=[16188], 99.50th=[26608], 99.90th=[27657], 99.95th=[27657],
     | 99.99th=[27657]
   bw (  KiB/s): min=  504, max=  712, per=27.38%, avg=578.60, stdev=79.79, samples=5
   iops        : min=  126, max=  178, avg=144.60, stdev=19.97, samples=5
  write: IOPS=149, BW=600KiB/s (614kB/s)(1564KiB/2608msec); 0 zone resets
    clat (usec): min=136, max=24843, avg=4496.19, stdev=5284.35
     lat (usec): min=136, max=24844, avg=4496.79, stdev=5284.33
    clat percentiles (usec):
     |  1.00th=[  153],  5.00th=[  206], 10.00th=[  251], 20.00th=[  359],
     | 30.00th=[  635], 40.00th=[ 1647], 50.00th=[ 2540], 60.00th=[ 3589],
     | 70.00th=[ 5014], 80.00th=[ 8160], 90.00th=[11731], 95.00th=[15926],
     | 99.00th=[23200], 99.50th=[23987], 99.90th=[24773], 99.95th=[24773],
     | 99.99th=[24773]
   bw (  KiB/s): min=  504, max=  704, per=27.10%, avg=602.40, stdev=81.07, samples=5
   iops        : min=  126, max=  176, avg=150.60, stdev=20.27, samples=5
  lat (usec)   : 10=2.08%, 20=9.51%, 50=9.24%, 100=1.30%, 250=5.73%
  lat (usec)   : 500=9.11%, 750=2.08%, 1000=1.04%
  lat (msec)   : 2=9.24%, 4=22.27%, 10=20.05%, 20=6.64%, 50=1.69%
  cpu          : usr=0.08%, sys=10.78%, ctx=1081, majf=0, minf=18
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2114KiB/s (2164kB/s), 516KiB/s-578KiB/s (528kB/s-592kB/s), io=5988KiB (6132kB), run=2608-2833msec
  WRITE: bw=2224KiB/s (2277kB/s), 532KiB/s-600KiB/s (545kB/s-614kB/s), io=6300KiB (6451kB), run=2608-2833msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=122376: Tue Oct  7 09:30:41 2025
  read: IOPS=45, BW=180KiB/s (185kB/s)(1480KiB/8203msec)
    clat (usec): min=824, max=42558, avg=2693.24, stdev=3861.08
     lat (usec): min=825, max=42560, avg=2693.86, stdev=3861.11
    clat percentiles (usec):
     |  1.00th=[  930],  5.00th=[ 1012], 10.00th=[ 1074], 20.00th=[ 1188],
     | 30.00th=[ 1303], 40.00th=[ 1401], 50.00th=[ 1565], 60.00th=[ 1827],
     | 70.00th=[ 2180], 80.00th=[ 2737], 90.00th=[ 4146], 95.00th=[ 8160],
     | 99.00th=[23462], 99.50th=[28705], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min=  109, max=  304, per=25.01%, avg=180.31, stdev=54.28, samples=16
   iops        : min=   27, max=   76, avg=45.06, stdev=13.59, samples=16
  write: IOPS=48, BW=194KiB/s (199kB/s)(1592KiB/8203msec); 0 zone resets
    clat (usec): min=8220, max=62116, avg=18080.70, stdev=6580.45
     lat (usec): min=8220, max=62116, avg=18081.54, stdev=6580.50
    clat percentiles (usec):
     |  1.00th=[ 9241],  5.00th=[11076], 10.00th=[11994], 20.00th=[12911],
     | 30.00th=[14222], 40.00th=[15664], 50.00th=[16712], 60.00th=[17957],
     | 70.00th=[19530], 80.00th=[21365], 90.00th=[25822], 95.00th=[31327],
     | 99.00th=[42730], 99.50th=[45876], 99.90th=[62129], 99.95th=[62129],
     | 99.99th=[62129]
   bw (  KiB/s): min=  104, max=  256, per=25.63%, avg=194.50, stdev=49.98, samples=16
   iops        : min=   26, max=   64, avg=48.62, stdev=12.49, samples=16
  lat (usec)   : 1000=2.08%
  lat (msec)   : 2=29.82%, 4=10.55%, 10=4.56%, 20=38.02%, 50=14.84%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.07%, sys=1.99%, ctx=806, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=122377: Tue Oct  7 09:30:41 2025
  read: IOPS=43, BW=173KiB/s (177kB/s)(1436KiB/8297msec)
    clat (usec): min=858, max=31695, avg=2713.80, stdev=4016.03
     lat (usec): min=859, max=31696, avg=2714.43, stdev=4016.03
    clat percentiles (usec):
     |  1.00th=[  898],  5.00th=[  988], 10.00th=[ 1037], 20.00th=[ 1139],
     | 30.00th=[ 1270], 40.00th=[ 1369], 50.00th=[ 1516], 60.00th=[ 1745],
     | 70.00th=[ 1926], 80.00th=[ 2540], 90.00th=[ 4555], 95.00th=[ 8225],
     | 99.00th=[21890], 99.50th=[30016], 99.90th=[31589], 99.95th=[31589],
     | 99.99th=[31589]
   bw (  KiB/s): min=   88, max=  288, per=24.07%, avg=173.56, stdev=58.01, samples=16
   iops        : min=   22, max=   72, avg=43.38, stdev=14.53, samples=16
  write: IOPS=49, BW=197KiB/s (202kB/s)(1636KiB/8297msec); 0 zone resets
    clat (usec): min=7839, max=57474, avg=17878.58, stdev=7122.33
     lat (usec): min=7839, max=57476, avg=17879.42, stdev=7122.36
    clat percentiles (usec):
     |  1.00th=[ 8094],  5.00th=[10683], 10.00th=[11731], 20.00th=[12911],
     | 30.00th=[13829], 40.00th=[15139], 50.00th=[16450], 60.00th=[17695],
     | 70.00th=[19006], 80.00th=[21103], 90.00th=[25035], 95.00th=[32113],
     | 99.00th=[46400], 99.50th=[51119], 99.90th=[57410], 99.95th=[57410],
     | 99.99th=[57410]
   bw (  KiB/s): min=  104, max=  256, per=25.58%, avg=194.12, stdev=50.53, samples=16
   iops        : min=   26, max=   64, avg=48.50, stdev=12.66, samples=16
  lat (usec)   : 1000=2.73%
  lat (msec)   : 2=31.38%, 4=7.29%, 10=5.34%, 20=38.28%, 50=14.45%
  lat (msec)   : 100=0.52%
  cpu          : usr=0.10%, sys=1.93%, ctx=824, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=122378: Tue Oct  7 09:30:41 2025
  read: IOPS=48, BW=194KiB/s (199kB/s)(1564KiB/8043msec)
    clat (usec): min=819, max=32540, avg=2458.68, stdev=2650.37
     lat (usec): min=819, max=32540, avg=2459.50, stdev=2650.41
    clat percentiles (usec):
     |  1.00th=[  881],  5.00th=[  988], 10.00th=[ 1045], 20.00th=[ 1172],
     | 30.00th=[ 1287], 40.00th=[ 1434], 50.00th=[ 1631], 60.00th=[ 1811],
     | 70.00th=[ 2073], 80.00th=[ 2671], 90.00th=[ 5276], 95.00th=[ 7635],
     | 99.00th=[11994], 99.50th=[15401], 99.90th=[32637], 99.95th=[32637],
     | 99.99th=[32637]
   bw (  KiB/s): min=   88, max=  384, per=27.67%, avg=199.53, stdev=100.07, samples=15
   iops        : min=   22, max=   96, avg=49.87, stdev=25.03, samples=15
  write: IOPS=46, BW=187KiB/s (192kB/s)(1508KiB/8043msec); 0 zone resets
    clat (usec): min=8911, max=54195, avg=18756.91, stdev=7183.82
     lat (usec): min=8911, max=54196, avg=18757.89, stdev=7183.91
    clat percentiles (usec):
     |  1.00th=[ 9372],  5.00th=[11207], 10.00th=[11731], 20.00th=[12911],
     | 30.00th=[14222], 40.00th=[15795], 50.00th=[16909], 60.00th=[18744],
     | 70.00th=[20579], 80.00th=[22938], 90.00th=[29492], 95.00th=[32637],
     | 99.00th=[45351], 99.50th=[49546], 99.90th=[54264], 99.95th=[54264],
     | 99.99th=[54264]
   bw (  KiB/s): min=  120, max=  240, per=24.64%, avg=187.00, stdev=44.33, samples=15
   iops        : min=   30, max=   60, avg=46.73, stdev=11.10, samples=15
  lat (usec)   : 1000=3.39%
  lat (msec)   : 2=30.86%, 4=10.16%, 10=6.38%, 20=33.07%, 50=16.02%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.11%, sys=1.99%, ctx=812, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=122379: Tue Oct  7 09:30:41 2025
  read: IOPS=45, BW=184KiB/s (188kB/s)(1508KiB/8210msec)
    clat (usec): min=831, max=42556, avg=2929.04, stdev=4302.85
     lat (usec): min=831, max=42557, avg=2929.69, stdev=4302.86
    clat percentiles (usec):
     |  1.00th=[  889],  5.00th=[  963], 10.00th=[ 1037], 20.00th=[ 1188],
     | 30.00th=[ 1319], 40.00th=[ 1434], 50.00th=[ 1647], 60.00th=[ 1860],
     | 70.00th=[ 2147], 80.00th=[ 2769], 90.00th=[ 5342], 95.00th=[10290],
     | 99.00th=[24773], 99.50th=[33817], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min=  104, max=  320, per=25.34%, avg=182.69, stdev=60.22, samples=16
   iops        : min=   26, max=   80, avg=45.62, stdev=15.11, samples=16
  write: IOPS=47, BW=190KiB/s (195kB/s)(1564KiB/8210msec); 0 zone resets
    clat (usec): min=9269, max=54621, avg=18150.20, stdev=6521.56
     lat (usec): min=9271, max=54621, avg=18151.24, stdev=6521.53
    clat percentiles (usec):
     |  1.00th=[10028],  5.00th=[11207], 10.00th=[11731], 20.00th=[12780],
     | 30.00th=[14091], 40.00th=[15270], 50.00th=[17171], 60.00th=[18482],
     | 70.00th=[20055], 80.00th=[21890], 90.00th=[25560], 95.00th=[30016],
     | 99.00th=[45876], 99.50th=[52167], 99.90th=[54789], 99.95th=[54789],
     | 99.99th=[54789]
   bw (  KiB/s): min=   80, max=  240, per=25.10%, avg=190.50, stdev=48.37, samples=16
   iops        : min=   20, max=   60, avg=47.62, stdev=12.09, samples=16
  lat (usec)   : 1000=4.04%
  lat (msec)   : 2=27.99%, 4=9.64%, 10=5.34%, 20=36.46%, 50=16.15%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.17%, sys=1.86%, ctx=811, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=722KiB/s (739kB/s), 173KiB/s-194KiB/s (177kB/s-199kB/s), io=5988KiB (6132kB), run=8043-8297msec
  WRITE: bw=759KiB/s (778kB/s), 187KiB/s-197KiB/s (192kB/s-202kB/s), io=6300KiB (6451kB), run=8043-8297msec