== sanity test 398b: DIO and buffer IO race ============== 19:27:06 (1781047626)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.0920377 s, 137 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=121508: Tue Jun  9 19:27:15 2026
  read: IOPS=135, BW=542KiB/s (555kB/s)(1480KiB/2733msec)
    clat (usec): min=7, max=36129, avg=2103.53, stdev=3356.61
     lat (usec): min=7, max=36130, avg=2103.96, stdev=3356.64
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   11], 10.00th=[   13], 20.00th=[   18],
     | 30.00th=[   24], 40.00th=[   35], 50.00th=[  141], 60.00th=[ 2057],
     | 70.00th=[ 2999], 80.00th=[ 3949], 90.00th=[ 5211], 95.00th=[ 6521],
     | 99.00th=[15795], 99.50th=[20317], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  472, max=  624, per=24.08%, avg=527.40, stdev=74.47, samples=5
   iops        : min=  118, max=  156, avg=131.80, stdev=18.66, samples=5
  write: IOPS=145, BW=583KiB/s (596kB/s)(1592KiB/2733msec); 0 zone resets
    clat (usec): min=118, max=38474, avg=4875.41, stdev=6040.28
     lat (usec): min=118, max=38474, avg=4876.09, stdev=6040.32
    clat percentiles (usec):
     |  1.00th=[  147],  5.00th=[  206], 10.00th=[  262], 20.00th=[  379],
     | 30.00th=[ 1029], 40.00th=[ 1795], 50.00th=[ 2540], 60.00th=[ 3720],
     | 70.00th=[ 5276], 80.00th=[ 8356], 90.00th=[13304], 95.00th=[19006],
     | 99.00th=[23987], 99.50th=[34341], 99.90th=[38536], 99.95th=[38536],
     | 99.99th=[38536]
   bw (  KiB/s): min=  480, max=  664, per=24.81%, avg=571.80, stdev=76.63, samples=5
   iops        : min=  120, max=  166, avg=142.80, stdev=19.32, samples=5
  lat (usec)   : 10=1.69%, 20=9.77%, 50=12.11%, 100=0.39%, 250=4.82%
  lat (usec)   : 500=9.51%, 750=1.43%, 1000=0.65%
  lat (msec)   : 2=10.94%, 4=20.31%, 10=19.27%, 20=6.64%, 50=2.47%
  cpu          : usr=0.29%, sys=10.58%, ctx=1014, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121509: Tue Jun  9 19:27:15 2026
  read: IOPS=131, BW=528KiB/s (540kB/s)(1436KiB/2722msec)
    clat (usec): min=5, max=35843, avg=2516.87, stdev=4276.20
     lat (usec): min=5, max=35844, avg=2517.33, stdev=4276.20
    clat percentiles (usec):
     |  1.00th=[    7],  5.00th=[   11], 10.00th=[   14], 20.00th=[   18],
     | 30.00th=[   22], 40.00th=[   38], 50.00th=[ 1450], 60.00th=[ 2245],
     | 70.00th=[ 3228], 80.00th=[ 4080], 90.00th=[ 5538], 95.00th=[ 8586],
     | 99.00th=[23987], 99.50th=[26608], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  416, max=  728, per=23.86%, avg=522.60, stdev=130.76, samples=5
   iops        : min=  104, max=  182, avg=130.60, stdev=32.71, samples=5
  write: IOPS=150, BW=601KiB/s (615kB/s)(1636KiB/2722msec); 0 zone resets
    clat (usec): min=129, max=27477, avg=4400.93, stdev=5296.37
     lat (usec): min=129, max=27478, avg=4401.50, stdev=5296.37
    clat percentiles (usec):
     |  1.00th=[  149],  5.00th=[  208], 10.00th=[  251], 20.00th=[  363],
     | 30.00th=[  644], 40.00th=[ 1582], 50.00th=[ 2376], 60.00th=[ 3359],
     | 70.00th=[ 4883], 80.00th=[ 7898], 90.00th=[12125], 95.00th=[16188],
     | 99.00th=[23200], 99.50th=[27132], 99.90th=[27395], 99.95th=[27395],
     | 99.99th=[27395]
   bw (  KiB/s): min=  496, max=  808, per=25.26%, avg=582.20, stdev=129.71, samples=5
   iops        : min=  124, max=  202, avg=145.40, stdev=32.46, samples=5
  lat (usec)   : 10=1.69%, 20=10.16%, 50=9.38%, 100=0.39%, 250=5.99%
  lat (usec)   : 500=9.11%, 750=2.34%, 1000=0.52%
  lat (msec)   : 2=10.81%, 4=20.96%, 10=19.27%, 20=7.55%, 50=1.82%
  cpu          : usr=0.22%, sys=10.73%, ctx=1053, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121511: Tue Jun  9 19:27:15 2026
  read: IOPS=157, BW=630KiB/s (646kB/s)(1564KiB/2481msec)
    clat (usec): min=3, max=30587, avg=2096.72, stdev=3164.43
     lat (usec): min=3, max=30588, avg=2097.25, stdev=3164.46
    clat percentiles (usec):
     |  1.00th=[    8],  5.00th=[   11], 10.00th=[   13], 20.00th=[   17],
     | 30.00th=[   22], 40.00th=[   36], 50.00th=[ 1319], 60.00th=[ 2212],
     | 70.00th=[ 2900], 80.00th=[ 3884], 90.00th=[ 5080], 95.00th=[ 6390],
     | 99.00th=[13435], 99.50th=[28705], 99.90th=[30540], 99.95th=[30540],
     | 99.99th=[30540]
   bw (  KiB/s): min=  514, max=  672, per=26.69%, avg=584.50, stdev=76.11, samples=4
   iops        : min=  128, max=  168, avg=146.00, stdev=19.18, samples=4
  write: IOPS=151, BW=608KiB/s (622kB/s)(1508KiB/2481msec); 0 zone resets
    clat (usec): min=120, max=29136, avg=4371.68, stdev=5357.38
     lat (usec): min=121, max=29136, avg=4372.27, stdev=5357.38
    clat percentiles (usec):
     |  1.00th=[  143],  5.00th=[  194], 10.00th=[  233], 20.00th=[  351],
     | 30.00th=[  676], 40.00th=[ 1582], 50.00th=[ 2311], 60.00th=[ 3261],
     | 70.00th=[ 4883], 80.00th=[ 7570], 90.00th=[12387], 95.00th=[15926],
     | 99.00th=[24249], 99.50th=[25822], 99.90th=[29230], 99.95th=[29230],
     | 99.99th=[29230]
   bw (  KiB/s): min=  528, max=  608, per=25.30%, avg=583.25, stdev=37.12, samples=4
   iops        : min=  132, max=  152, avg=145.75, stdev= 9.25, samples=4
  lat (usec)   : 4=0.13%, 10=2.08%, 20=12.11%, 50=9.24%, 100=1.04%
  lat (usec)   : 250=5.73%, 500=7.94%, 750=1.82%, 1000=0.91%
  lat (msec)   : 2=10.68%, 4=20.57%, 10=19.66%, 20=6.64%, 50=1.43%
  cpu          : usr=0.40%, sys=10.85%, ctx=1002, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121513: Tue Jun  9 19:27:15 2026
  read: IOPS=141, BW=568KiB/s (582kB/s)(1508KiB/2655msec)
    clat (usec): min=4, max=30111, avg=2218.82, stdev=3679.74
     lat (usec): min=4, max=30111, avg=2219.26, stdev=3679.73
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[   10], 10.00th=[   12], 20.00th=[   17],
     | 30.00th=[   22], 40.00th=[   35], 50.00th=[   70], 60.00th=[ 2057],
     | 70.00th=[ 2737], 80.00th=[ 3818], 90.00th=[ 5407], 95.00th=[ 7635],
     | 99.00th=[20579], 99.50th=[22676], 99.90th=[30016], 99.95th=[30016],
     | 99.99th=[30016]
   bw (  KiB/s): min=  440, max=  712, per=25.28%, avg=553.60, stdev=109.46, samples=5
   iops        : min=  110, max=  178, avg=138.40, stdev=27.36, samples=5
  write: IOPS=147, BW=589KiB/s (603kB/s)(1564KiB/2655msec); 0 zone resets
    clat (usec): min=121, max=30383, avg=4604.65, stdev=5650.14
     lat (usec): min=121, max=30384, avg=4605.23, stdev=5650.14
    clat percentiles (usec):
     |  1.00th=[  176],  5.00th=[  251], 10.00th=[  310], 20.00th=[  371],
     | 30.00th=[  562], 40.00th=[ 1696], 50.00th=[ 2507], 60.00th=[ 3425],
     | 70.00th=[ 5080], 80.00th=[ 7373], 90.00th=[13173], 95.00th=[16909],
     | 99.00th=[25822], 99.50th=[28443], 99.90th=[30278], 99.95th=[30278],
     | 99.99th=[30278]
   bw (  KiB/s): min=  456, max=  704, per=25.23%, avg=581.60, stdev=110.11, samples=5
   iops        : min=  114, max=  176, avg=145.40, stdev=27.53, samples=5
  lat (usec)   : 10=2.73%, 20=11.07%, 50=9.64%, 100=1.43%, 250=2.86%
  lat (usec)   : 500=12.24%, 750=1.17%, 1000=0.91%
  lat (msec)   : 2=9.38%, 4=20.57%, 10=18.10%, 20=7.94%, 50=1.95%
  cpu          : usr=0.26%, sys=10.17%, ctx=1053, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2191KiB/s (2244kB/s), 528KiB/s-630KiB/s (540kB/s-646kB/s), io=5988KiB (6132kB), run=2481-2733msec
  WRITE: bw=2305KiB/s (2360kB/s), 583KiB/s-608KiB/s (596kB/s-622kB/s), io=6300KiB (6451kB), run=2481-2733msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=121507: Tue Jun  9 19:27:22 2026
  read: IOPS=38, BW=153KiB/s (157kB/s)(1480KiB/9679msec)
    clat (usec): min=909, max=58108, avg=3333.21, stdev=4986.76
     lat (usec): min=910, max=58108, avg=3333.84, stdev=4986.76
    clat percentiles (usec):
     |  1.00th=[  947],  5.00th=[ 1074], 10.00th=[ 1172], 20.00th=[ 1352],
     | 30.00th=[ 1516], 40.00th=[ 1713], 50.00th=[ 1909], 60.00th=[ 2212],
     | 70.00th=[ 2704], 80.00th=[ 3392], 90.00th=[ 5669], 95.00th=[11076],
     | 99.00th=[28443], 99.50th=[35390], 99.90th=[57934], 99.95th=[57934],
     | 99.99th=[57934]
   bw (  KiB/s): min=  104, max=  288, per=24.72%, avg=150.79, stdev=47.14, samples=19
   iops        : min=   26, max=   72, avg=37.68, stdev=11.80, samples=19
  write: IOPS=41, BW=164KiB/s (168kB/s)(1592KiB/9679msec); 0 zone resets
    clat (usec): min=9766, max=62495, avg=21183.20, stdev=6911.15
     lat (usec): min=9766, max=62496, avg=21184.04, stdev=6911.14
    clat percentiles (usec):
     |  1.00th=[10683],  5.00th=[12518], 10.00th=[13960], 20.00th=[15795],
     | 30.00th=[16909], 40.00th=[18220], 50.00th=[19530], 60.00th=[21627],
     | 70.00th=[23725], 80.00th=[26608], 90.00th=[30278], 95.00th=[33424],
     | 99.00th=[42206], 99.50th=[57934], 99.90th=[62653], 99.95th=[62653],
     | 99.99th=[62653]
   bw (  KiB/s): min=   97, max=  232, per=25.63%, avg=164.26, stdev=32.58, samples=19
   iops        : min=   24, max=   58, avg=41.05, stdev= 8.17, samples=19
  lat (usec)   : 1000=1.04%
  lat (msec)   : 2=25.39%, 4=14.45%, 10=4.69%, 20=29.17%, 50=24.87%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.11%, sys=1.61%, ctx=823, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121510: Tue Jun  9 19:27:22 2026
  read: IOPS=36, BW=146KiB/s (150kB/s)(1436KiB/9814msec)
    clat (usec): min=917, max=29341, avg=2810.70, stdev=3440.65
     lat (usec): min=918, max=29341, avg=2811.35, stdev=3440.66
    clat percentiles (usec):
     |  1.00th=[  938],  5.00th=[ 1074], 10.00th=[ 1172], 20.00th=[ 1319],
     | 30.00th=[ 1467], 40.00th=[ 1631], 50.00th=[ 1860], 60.00th=[ 2147],
     | 70.00th=[ 2474], 80.00th=[ 2999], 90.00th=[ 4424], 95.00th=[ 8717],
     | 99.00th=[21103], 99.50th=[26084], 99.90th=[29230], 99.95th=[29230],
     | 99.99th=[29230]
   bw (  KiB/s): min=   56, max=  256, per=23.77%, avg=145.00, stdev=49.79, samples=19
   iops        : min=   14, max=   64, avg=36.21, stdev=12.51, samples=19
  write: IOPS=41, BW=167KiB/s (171kB/s)(1636KiB/9814msec); 0 zone resets
    clat (usec): min=9178, max=80781, avg=21481.66, stdev=7695.12
     lat (usec): min=9179, max=80781, avg=21482.43, stdev=7695.13
    clat percentiles (usec):
     |  1.00th=[10159],  5.00th=[12387], 10.00th=[13435], 20.00th=[15664],
     | 30.00th=[17171], 40.00th=[18482], 50.00th=[20055], 60.00th=[21627],
     | 70.00th=[23987], 80.00th=[27395], 90.00th=[30016], 95.00th=[33162],
     | 99.00th=[46400], 99.50th=[56886], 99.90th=[81265], 99.95th=[81265],
     | 99.99th=[81265]
   bw (  KiB/s): min=  112, max=  224, per=25.54%, avg=163.74, stdev=30.96, samples=19
   iops        : min=   28, max=   56, avg=40.89, stdev= 7.78, samples=19
  lat (usec)   : 1000=1.30%
  lat (msec)   : 2=24.35%, 4=15.49%, 10=4.56%, 20=27.34%, 50=26.43%
  lat (msec)   : 100=0.52%
  cpu          : usr=0.12%, sys=1.56%, ctx=814, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121512: Tue Jun  9 19:27:22 2026
  read: IOPS=41, BW=167KiB/s (171kB/s)(1564KiB/9362msec)
    clat (usec): min=880, max=46502, avg=2937.21, stdev=3912.37
     lat (usec): min=880, max=46503, avg=2937.82, stdev=3912.39
    clat percentiles (usec):
     |  1.00th=[  930],  5.00th=[ 1074], 10.00th=[ 1156], 20.00th=[ 1319],
     | 30.00th=[ 1467], 40.00th=[ 1614], 50.00th=[ 1876], 60.00th=[ 2057],
     | 70.00th=[ 2409], 80.00th=[ 3032], 90.00th=[ 4817], 95.00th=[ 8848],
     | 99.00th=[20317], 99.50th=[21890], 99.90th=[46400], 99.95th=[46400],
     | 99.99th=[46400]
   bw (  KiB/s): min=   96, max=  280, per=27.84%, avg=169.83, stdev=60.21, samples=18
   iops        : min=   24, max=   70, avg=42.44, stdev=15.07, samples=18
  write: IOPS=40, BW=161KiB/s (165kB/s)(1508KiB/9362msec); 0 zone resets
    clat (usec): min=9314, max=78446, avg=21752.86, stdev=7200.38
     lat (usec): min=9314, max=78447, avg=21753.69, stdev=7200.42
    clat percentiles (usec):
     |  1.00th=[10159],  5.00th=[13698], 10.00th=[14746], 20.00th=[16319],
     | 30.00th=[17695], 40.00th=[19006], 50.00th=[20055], 60.00th=[22152],
     | 70.00th=[24249], 80.00th=[26608], 90.00th=[29754], 95.00th=[33424],
     | 99.00th=[44303], 99.50th=[62653], 99.90th=[78119], 99.95th=[78119],
     | 99.99th=[78119]
   bw (  KiB/s): min=  104, max=  224, per=25.17%, avg=161.33, stdev=28.81, samples=18
   iops        : min=   26, max=   56, avg=40.33, stdev= 7.20, samples=18
  lat (usec)   : 1000=1.17%
  lat (msec)   : 2=28.13%, 4=14.45%, 10=5.08%, 20=25.00%, 50=25.78%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.10%, sys=1.61%, ctx=833, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121514: Tue Jun  9 19:27:22 2026
  read: IOPS=38, BW=154KiB/s (158kB/s)(1508KiB/9767msec)
    clat (usec): min=870, max=41434, avg=3305.38, stdev=4661.74
     lat (usec): min=870, max=41435, avg=3306.05, stdev=4661.75
    clat percentiles (usec):
     |  1.00th=[  963],  5.00th=[ 1057], 10.00th=[ 1139], 20.00th=[ 1270],
     | 30.00th=[ 1418], 40.00th=[ 1598], 50.00th=[ 1778], 60.00th=[ 2180],
     | 70.00th=[ 2638], 80.00th=[ 3425], 90.00th=[ 5669], 95.00th=[13304],
     | 99.00th=[25035], 99.50th=[34341], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=   64, max=  256, per=24.79%, avg=151.21, stdev=52.73, samples=19
   iops        : min=   16, max=   64, avg=37.79, stdev=13.20, samples=19
  write: IOPS=40, BW=160KiB/s (164kB/s)(1564KiB/9767msec); 0 zone resets
    clat (usec): min=9294, max=72260, avg=21741.91, stdev=7186.89
     lat (usec): min=9294, max=72261, avg=21742.80, stdev=7186.88
    clat percentiles (usec):
     |  1.00th=[10552],  5.00th=[12649], 10.00th=[13960], 20.00th=[16450],
     | 30.00th=[17695], 40.00th=[19006], 50.00th=[20317], 60.00th=[22152],
     | 70.00th=[24249], 80.00th=[27132], 90.00th=[30540], 95.00th=[33162],
     | 99.00th=[46924], 99.50th=[53216], 99.90th=[71828], 99.95th=[71828],
     | 99.99th=[71828]
   bw (  KiB/s): min=  105, max=  224, per=24.71%, avg=158.37, stdev=30.02, samples=19
   iops        : min=   26, max=   56, avg=39.58, stdev= 7.53, samples=19
  lat (usec)   : 1000=1.17%
  lat (msec)   : 2=26.30%, 4=13.15%, 10=5.47%, 20=26.43%, 50=27.08%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.16%, sys=1.55%, ctx=831, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=610KiB/s (625kB/s), 146KiB/s-167KiB/s (150kB/s-171kB/s), io=5988KiB (6132kB), run=9362-9814msec
  WRITE: bw=642KiB/s (657kB/s), 160KiB/s-167KiB/s (164kB/s-171kB/s), io=6300KiB (6451kB), run=9362-9814msec