== sanity test 398b: DIO and buffer IO race ============== 00:40:04 (1722487204)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.12472 s, 101 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=27295: Thu Aug  1 00:40:08 2024
   read: IOPS=182, BW=731KiB/s (748kB/s)(1480KiB/2026msec)
    clat (usec): min=3, max=36084, avg=1091.96, stdev=2554.25
     lat (usec): min=3, max=36085, avg=1092.64, stdev=2554.33
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   14], 50.00th=[   22], 60.00th=[  889],
     | 70.00th=[ 1369], 80.00th=[ 1926], 90.00th=[ 2540], 95.00th=[ 3556],
     | 99.00th=[12518], 99.50th=[14353], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  616, max=  784, per=24.53%, avg=710.00, stdev=74.30, samples=4
   iops        : min=  154, max=  196, avg=177.50, stdev=18.57, samples=4
  write: IOPS=196, BW=786KiB/s (805kB/s)(1592KiB/2026msec)
    clat (usec): min=90, max=68500, avg=4050.70, stdev=6589.84
     lat (usec): min=90, max=68502, avg=4051.34, stdev=6589.85
    clat percentiles (usec):
     |  1.00th=[   98],  5.00th=[  113], 10.00th=[  120], 20.00th=[  151],
     | 30.00th=[  202], 40.00th=[  848], 50.00th=[ 1172], 60.00th=[ 2024],
     | 70.00th=[ 3228], 80.00th=[ 8455], 90.00th=[12125], 95.00th=[19006],
     | 99.00th=[25297], 99.50th=[28181], 99.90th=[68682], 99.95th=[68682],
     | 99.99th=[68682]
   bw (  KiB/s): min=  608, max=  928, per=25.43%, avg=774.00, stdev=139.69, samples=4
   iops        : min=  152, max=  232, avg=193.50, stdev=34.92, samples=4
  lat (usec)   : 4=0.39%, 10=13.15%, 20=9.24%, 50=4.43%, 100=1.17%
  lat (usec)   : 250=15.89%, 500=2.34%, 750=1.04%, 1000=6.51%
  lat (msec)   : 2=16.28%, 4=14.32%, 10=7.68%, 20=5.34%, 50=2.08%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.30%, sys=7.90%, ctx=952, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=27296: Thu Aug  1 00:40:08 2024
   read: IOPS=173, BW=694KiB/s (711kB/s)(1436KiB/2069msec)
    clat (usec): min=3, max=22821, avg=1399.37, stdev=3122.79
     lat (usec): min=3, max=22822, avg=1399.92, stdev=3122.83
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    8], 20.00th=[    9],
     | 30.00th=[   10], 40.00th=[   13], 50.00th=[   21], 60.00th=[  930],
     | 70.00th=[ 1516], 80.00th=[ 2040], 90.00th=[ 3359], 95.00th=[ 5014],
     | 99.00th=[20055], 99.50th=[22152], 99.90th=[22938], 99.95th=[22938],
     | 99.99th=[22938]
   bw (  KiB/s): min=  488, max=  840, per=23.84%, avg=690.00, stdev=162.04, samples=4
   iops        : min=  122, max=  210, avg=172.50, stdev=40.51, samples=4
  write: IOPS=197, BW=791KiB/s (810kB/s)(1636KiB/2069msec)
    clat (usec): min=92, max=66982, avg=3801.58, stdev=5952.22
     lat (usec): min=93, max=66984, avg=3802.33, stdev=5952.20
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  114], 10.00th=[  122], 20.00th=[  161],
     | 30.00th=[  217], 40.00th=[  865], 50.00th=[ 1336], 60.00th=[ 2024],
     | 70.00th=[ 3294], 80.00th=[ 8029], 90.00th=[11076], 95.00th=[15139],
     | 99.00th=[20055], 99.50th=[24773], 99.90th=[66847], 99.95th=[66847],
     | 99.99th=[66847]
   bw (  KiB/s): min=  672, max=  888, per=25.36%, avg=772.00, stdev=93.41, samples=4
   iops        : min=  168, max=  222, avg=193.00, stdev=23.35, samples=4
  lat (usec)   : 4=0.91%, 10=13.41%, 20=8.59%, 50=2.86%, 100=1.17%
  lat (usec)   : 250=16.80%, 500=1.69%, 750=1.04%, 1000=4.95%
  lat (msec)   : 2=16.93%, 4=13.15%, 10=10.29%, 20=7.03%, 50=1.04%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.24%, sys=7.69%, ctx=967, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=27297: Thu Aug  1 00:40:08 2024
   read: IOPS=194, BW=777KiB/s (795kB/s)(1564KiB/2014msec)
    clat (usec): min=3, max=23283, avg=1267.41, stdev=2470.40
     lat (usec): min=3, max=23284, avg=1268.00, stdev=2470.41
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   15], 50.00th=[   27], 60.00th=[  979],
     | 70.00th=[ 1696], 80.00th=[ 2180], 90.00th=[ 2933], 95.00th=[ 4228],
     | 99.00th=[12125], 99.50th=[22676], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  616, max=  920, per=26.81%, avg=776.00, stdev=124.62, samples=4
   iops        : min=  154, max=  230, avg=194.00, stdev=31.16, samples=4
  write: IOPS=187, BW=749KiB/s (767kB/s)(1508KiB/2014msec)
    clat (usec): min=88, max=68149, avg=3996.22, stdev=6211.76
     lat (usec): min=88, max=68151, avg=3996.87, stdev=6211.77
    clat percentiles (usec):
     |  1.00th=[   94],  5.00th=[  110], 10.00th=[  123], 20.00th=[  157],
     | 30.00th=[  198], 40.00th=[  807], 50.00th=[ 1418], 60.00th=[ 2180],
     | 70.00th=[ 3490], 80.00th=[ 8455], 90.00th=[11469], 95.00th=[14877],
     | 99.00th=[22938], 99.50th=[29492], 99.90th=[67634], 99.95th=[67634],
     | 99.99th=[67634]
   bw (  KiB/s): min=  552, max=  888, per=24.11%, avg=734.00, stdev=167.48, samples=4
   iops        : min=  138, max=  222, avg=183.50, stdev=41.87, samples=4
  lat (usec)   : 4=0.91%, 10=14.06%, 20=8.85%, 50=3.12%, 100=1.04%
  lat (usec)   : 250=15.49%, 500=2.60%, 750=1.30%, 1000=4.95%
  lat (msec)   : 2=14.45%, 4=16.41%, 10=8.07%, 20=7.55%, 50=1.04%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.25%, sys=7.85%, ctx=924, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=27298: Thu Aug  1 00:40:08 2024
   read: IOPS=185, BW=743KiB/s (761kB/s)(1508KiB/2030msec)
    clat (usec): min=3, max=27029, avg=1274.53, stdev=2472.85
     lat (usec): min=3, max=27031, avg=1275.24, stdev=2472.82
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   14], 50.00th=[   26], 60.00th=[ 1037],
     | 70.00th=[ 1729], 80.00th=[ 2147], 90.00th=[ 3097], 95.00th=[ 4228],
     | 99.00th=[13829], 99.50th=[17433], 99.90th=[27132], 99.95th=[27132],
     | 99.99th=[27132]
   bw (  KiB/s): min=  680, max=  792, per=25.57%, avg=740.00, stdev=52.86, samples=4
   iops        : min=  170, max=  198, avg=185.00, stdev=13.22, samples=4
  write: IOPS=192, BW=770KiB/s (789kB/s)(1564KiB/2030msec)
    clat (usec): min=92, max=68449, avg=3937.02, stdev=6332.15
     lat (usec): min=93, max=68451, avg=3937.75, stdev=6332.22
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  113], 10.00th=[  125], 20.00th=[  159],
     | 30.00th=[  247], 40.00th=[  848], 50.00th=[ 1319], 60.00th=[ 1958],
     | 70.00th=[ 3228], 80.00th=[ 7701], 90.00th=[11469], 95.00th=[15533],
     | 99.00th=[24511], 99.50th=[28443], 99.90th=[68682], 99.95th=[68682],
     | 99.99th=[68682]
   bw (  KiB/s): min=  632, max=  912, per=25.36%, avg=772.00, stdev=121.94, samples=4
   iops        : min=  158, max=  228, avg=193.00, stdev=30.48, samples=4
  lat (usec)   : 4=0.91%, 10=13.54%, 20=8.20%, 50=3.52%, 100=0.78%
  lat (usec)   : 250=15.49%, 500=2.73%, 750=1.30%, 1000=4.82%
  lat (msec)   : 2=16.41%, 4=15.49%, 10=8.85%, 20=6.25%, 50=1.56%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.39%, sys=7.79%, ctx=976, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2894KiB/s (2964kB/s), 694KiB/s-777KiB/s (711kB/s-795kB/s), io=5988KiB (6132kB), run=2014-2069msec
  WRITE: bw=3045KiB/s (3118kB/s), 749KiB/s-791KiB/s (767kB/s-810kB/s), io=6300KiB (6451kB), run=2014-2069msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=27300: Thu Aug  1 00:40:15 2024
   read: IOPS=41, BW=167KiB/s (171kB/s)(1480KiB/8845msec)
    clat (usec): min=631, max=88295, avg=2463.00, stdev=5473.20
     lat (usec): min=632, max=88297, avg=2463.65, stdev=5473.23
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  775], 10.00th=[  824], 20.00th=[  898],
     | 30.00th=[  963], 40.00th=[ 1106], 50.00th=[ 1303], 60.00th=[ 1598],
     | 70.00th=[ 2073], 80.00th=[ 2606], 90.00th=[ 3359], 95.00th=[ 6980],
     | 99.00th=[23462], 99.50th=[25560], 99.90th=[88605], 99.95th=[88605],
     | 99.99th=[88605]
   bw (  KiB/s): min=   96, max=  296, per=24.43%, avg=164.18, stdev=47.08, samples=17
   iops        : min=   24, max=   74, avg=41.00, stdev=11.83, samples=17
  write: IOPS=44, BW=180KiB/s (184kB/s)(1592KiB/8845msec)
    clat (usec): min=10938, max=59506, avg=19907.66, stdev=6271.79
     lat (usec): min=10939, max=59507, avg=19908.40, stdev=6271.80
    clat percentiles (usec):
     |  1.00th=[11207],  5.00th=[12387], 10.00th=[13304], 20.00th=[14353],
     | 30.00th=[15926], 40.00th=[17695], 50.00th=[19792], 60.00th=[21103],
     | 70.00th=[22414], 80.00th=[23725], 90.00th=[25822], 95.00th=[29230],
     | 99.00th=[41681], 99.50th=[58459], 99.90th=[59507], 99.95th=[59507],
     | 99.99th=[59507]
   bw (  KiB/s): min=   88, max=  216, per=25.28%, avg=178.76, stdev=33.06, samples=17
   iops        : min=   22, max=   54, avg=44.65, stdev= 8.33, samples=17
  lat (usec)   : 750=1.56%, 1000=14.58%
  lat (msec)   : 2=17.32%, 4=11.20%, 10=1.43%, 20=28.12%, 50=25.26%
  lat (msec)   : 100=0.52%
  cpu          : usr=0.08%, sys=1.36%, ctx=923, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=27301: Thu Aug  1 00:40:15 2024
   read: IOPS=40, BW=161KiB/s (165kB/s)(1436KiB/8905msec)
    clat (usec): min=609, max=88622, avg=2408.91, stdev=5588.29
     lat (usec): min=609, max=88624, avg=2409.55, stdev=5588.32
    clat percentiles (usec):
     |  1.00th=[  709],  5.00th=[  775], 10.00th=[  816], 20.00th=[  898],
     | 30.00th=[  971], 40.00th=[ 1123], 50.00th=[ 1303], 60.00th=[ 1500],
     | 70.00th=[ 1893], 80.00th=[ 2540], 90.00th=[ 3163], 95.00th=[ 7242],
     | 99.00th=[20317], 99.50th=[38011], 99.90th=[88605], 99.95th=[88605],
     | 99.99th=[88605]
   bw (  KiB/s): min=   80, max=  288, per=24.07%, avg=161.76, stdev=54.61, samples=17
   iops        : min=   20, max=   72, avg=40.35, stdev=13.61, samples=17
  write: IOPS=45, BW=184KiB/s (188kB/s)(1636KiB/8905msec)
    clat (usec): min=11042, max=74903, avg=19637.23, stdev=6095.38
     lat (usec): min=11043, max=74904, avg=19638.06, stdev=6095.34
    clat percentiles (usec):
     |  1.00th=[11207],  5.00th=[12125], 10.00th=[12780], 20.00th=[13960],
     | 30.00th=[16188], 40.00th=[18482], 50.00th=[19792], 60.00th=[20841],
     | 70.00th=[21890], 80.00th=[23200], 90.00th=[25297], 95.00th=[28967],
     | 99.00th=[36439], 99.50th=[40109], 99.90th=[74974], 99.95th=[74974],
     | 99.99th=[74974]
   bw (  KiB/s): min=  112, max=  224, per=25.54%, avg=180.59, stdev=28.53, samples=17
   iops        : min=   28, max=   56, avg=45.06, stdev= 7.10, samples=17
  lat (usec)   : 750=1.82%, 1000=13.67%
  lat (msec)   : 2=18.49%, 4=9.64%, 10=1.30%, 20=29.43%, 50=25.26%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.19%, sys=1.24%, ctx=920, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=27302: Thu Aug  1 00:40:15 2024
   read: IOPS=46, BW=185KiB/s (190kB/s)(1564KiB/8446msec)
    clat (usec): min=638, max=20743, avg=1869.73, stdev=2256.22
     lat (usec): min=638, max=20744, avg=1870.43, stdev=2256.23
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  758], 10.00th=[  816], 20.00th=[  889],
     | 30.00th=[  979], 40.00th=[ 1106], 50.00th=[ 1237], 60.00th=[ 1385],
     | 70.00th=[ 1762], 80.00th=[ 2278], 90.00th=[ 2933], 95.00th=[ 4113],
     | 99.00th=[15401], 99.50th=[18482], 99.90th=[20841], 99.95th=[20841],
     | 99.99th=[20841]
   bw (  KiB/s): min=   95, max=  312, per=28.10%, avg=188.81, stdev=73.52, samples=16
   iops        : min=   23, max=   78, avg=47.06, stdev=18.40, samples=16
  write: IOPS=44, BW=179KiB/s (183kB/s)(1508KiB/8446msec)
    clat (usec): min=10846, max=83310, avg=20436.63, stdev=7195.32
     lat (usec): min=10846, max=83311, avg=20437.46, stdev=7195.36
    clat percentiles (usec):
     |  1.00th=[11600],  5.00th=[12518], 10.00th=[13042], 20.00th=[14484],
     | 30.00th=[16450], 40.00th=[18220], 50.00th=[20055], 60.00th=[21365],
     | 70.00th=[22414], 80.00th=[23987], 90.00th=[26608], 95.00th=[32637],
     | 99.00th=[44303], 99.50th=[58983], 99.90th=[83362], 99.95th=[83362],
     | 99.99th=[83362]
   bw (  KiB/s): min=  104, max=  216, per=25.08%, avg=177.31, stdev=29.51, samples=16
   iops        : min=   26, max=   54, avg=44.19, stdev= 7.48, samples=16
  lat (usec)   : 750=2.21%, 1000=14.32%
  lat (msec)   : 2=21.87%, 4=9.90%, 10=1.56%, 20=25.91%, 50=23.96%
  lat (msec)   : 100=0.26%
  cpu          : usr=0.12%, sys=1.37%, ctx=911, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=27303: Thu Aug  1 00:40:15 2024
   read: IOPS=43, BW=175KiB/s (179kB/s)(1508KiB/8615msec)
    clat (usec): min=578, max=34002, avg=2209.75, stdev=3781.72
     lat (usec): min=578, max=34002, avg=2210.39, stdev=3781.73
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  758], 10.00th=[  799], 20.00th=[  873],
     | 30.00th=[  947], 40.00th=[ 1029], 50.00th=[ 1188], 60.00th=[ 1418],
     | 70.00th=[ 1713], 80.00th=[ 2278], 90.00th=[ 3064], 95.00th=[ 6063],
     | 99.00th=[25297], 99.50th=[28967], 99.90th=[33817], 99.95th=[33817],
     | 99.99th=[33817]
   bw (  KiB/s): min=   96, max=  272, per=25.83%, avg=173.59, stdev=53.24, samples=17
   iops        : min=   24, max=   68, avg=43.35, stdev=13.35, samples=17
  write: IOPS=45, BW=182KiB/s (186kB/s)(1564KiB/8615msec)
    clat (usec): min=10922, max=87554, avg=19879.48, stdev=6789.43
     lat (usec): min=10923, max=87556, avg=19880.42, stdev=6789.30
    clat percentiles (usec):
     |  1.00th=[11469],  5.00th=[12518], 10.00th=[13042], 20.00th=[14222],
     | 30.00th=[15926], 40.00th=[17957], 50.00th=[19792], 60.00th=[21103],
     | 70.00th=[21890], 80.00th=[23200], 90.00th=[26084], 95.00th=[28967],
     | 99.00th=[44303], 99.50th=[51119], 99.90th=[87557], 99.95th=[87557],
     | 99.99th=[87557]
   bw (  KiB/s): min=  104, max=  216, per=25.62%, avg=181.12, stdev=29.62, samples=17
   iops        : min=   26, max=   54, avg=45.24, stdev= 7.38, samples=17
  lat (usec)   : 750=1.95%, 1000=16.15%
  lat (msec)   : 2=19.66%, 4=8.33%, 10=0.91%, 20=27.86%, 50=24.87%
  lat (msec)   : 100=0.26%
  cpu          : usr=0.10%, sys=1.31%, ctx=885, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=672KiB/s (689kB/s), 161KiB/s-185KiB/s (165kB/s-190kB/s), io=5988KiB (6132kB), run=8446-8905msec
  WRITE: bw=707KiB/s (724kB/s), 179KiB/s-184KiB/s (183kB/s-188kB/s), io=6300KiB (6451kB), run=8446-8905msec