== sanity test 398b: DIO and buffer IO race ============== 10:00:10 (1747404010)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0631455 s, 199 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=23212: Fri May 16 10:00:14 2025
   read: IOPS=215, BW=863KiB/s (884kB/s)(1480KiB/1714msec)
    clat (usec): min=3, max=25303, avg=1158.78, stdev=2388.72
     lat (usec): min=3, max=25303, avg=1159.41, stdev=2388.69
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[   19], 50.00th=[   30], 60.00th=[  955],
     | 70.00th=[ 1516], 80.00th=[ 2147], 90.00th=[ 2704], 95.00th=[ 3458],
     | 99.00th=[14484], 99.50th=[17957], 99.90th=[25297], 99.95th=[25297],
     | 99.99th=[25297]
   bw (  KiB/s): min=  792, max=  912, per=25.16%, avg=840.00, stdev=63.50, samples=3
   iops        : min=  198, max=  228, avg=210.00, stdev=15.87, samples=3
  write: IOPS=232, BW=929KiB/s (951kB/s)(1592KiB/1714msec)
    clat (usec): min=91, max=23279, avg=3209.32, stdev=4268.75
     lat (usec): min=91, max=23280, avg=3210.32, stdev=4268.67
    clat percentiles (usec):
     |  1.00th=[   98],  5.00th=[  114], 10.00th=[  129], 20.00th=[  165],
     | 30.00th=[  227], 40.00th=[  906], 50.00th=[ 1254], 60.00th=[ 2024],
     | 70.00th=[ 3195], 80.00th=[ 6718], 90.00th=[ 9372], 95.00th=[12518],
     | 99.00th=[19530], 99.50th=[21365], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  816, max= 1016, per=26.04%, avg=914.67, stdev=100.03, samples=3
   iops        : min=  204, max=  254, avg=228.67, stdev=25.01, samples=3
  lat (usec)   : 4=0.39%, 10=10.55%, 20=8.72%, 50=5.60%, 100=2.47%
  lat (usec)   : 250=15.10%, 500=1.43%, 750=2.34%, 1000=4.95%
  lat (msec)   : 2=17.32%, 4=15.49%, 10=10.42%, 20=4.69%, 50=0.52%
  cpu          : usr=0.53%, sys=9.05%, ctx=959, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23213: Fri May 16 10:00:14 2025
   read: IOPS=200, BW=801KiB/s (820kB/s)(1436KiB/1793msec)
    clat (usec): min=3, max=13329, avg=1073.10, stdev=1634.07
     lat (usec): min=3, max=13330, avg=1073.67, stdev=1634.09
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   17], 50.00th=[   32], 60.00th=[ 1205],
     | 70.00th=[ 1631], 80.00th=[ 2008], 90.00th=[ 2769], 95.00th=[ 3294],
     | 99.00th=[ 9634], 99.50th=[11338], 99.90th=[13304], 99.95th=[13304],
     | 99.99th=[13304]
   bw (  KiB/s): min=  448, max= 1096, per=23.16%, avg=773.33, stdev=324.01, samples=3
   iops        : min=  112, max=  274, avg=193.33, stdev=81.00, samples=3
  write: IOPS=228, BW=912KiB/s (934kB/s)(1636KiB/1793msec)
    clat (usec): min=91, max=32642, avg=3423.70, stdev=4838.29
     lat (usec): min=91, max=32642, avg=3424.52, stdev=4838.25
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  115], 10.00th=[  133], 20.00th=[  174],
     | 30.00th=[  367], 40.00th=[  955], 50.00th=[ 1401], 60.00th=[ 2073],
     | 70.00th=[ 3294], 80.00th=[ 6652], 90.00th=[ 9503], 95.00th=[13698],
     | 99.00th=[19530], 99.50th=[25297], 99.90th=[32637], 99.95th=[32637],
     | 99.99th=[32637]
   bw (  KiB/s): min=  528, max=  992, per=23.68%, avg=832.00, stdev=263.39, samples=3
   iops        : min=  132, max=  248, avg=208.00, stdev=65.85, samples=3
  lat (usec)   : 4=0.78%, 10=10.81%, 20=8.33%, 50=4.30%, 100=0.65%
  lat (usec)   : 250=14.32%, 500=2.08%, 750=2.99%, 1000=4.30%
  lat (msec)   : 2=20.31%, 4=14.84%, 10=11.33%, 20=4.43%, 50=0.52%
  cpu          : usr=0.22%, sys=8.65%, ctx=1004, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23214: Fri May 16 10:00:14 2025
   read: IOPS=223, BW=896KiB/s (917kB/s)(1564KiB/1746msec)
    clat (usec): min=3, max=14335, avg=1148.14, stdev=1647.40
     lat (usec): min=3, max=14335, avg=1148.79, stdev=1647.38
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   23], 50.00th=[  174], 60.00th=[ 1369],
     | 70.00th=[ 1778], 80.00th=[ 2147], 90.00th=[ 2704], 95.00th=[ 3523],
     | 99.00th=[ 7767], 99.50th=[12649], 99.90th=[14353], 99.95th=[14353],
     | 99.99th=[14353]
   bw (  KiB/s): min=  776, max=  880, per=25.24%, avg=842.67, stdev=57.87, samples=3
   iops        : min=  194, max=  220, avg=210.67, stdev=14.47, samples=3
  write: IOPS=215, BW=864KiB/s (884kB/s)(1508KiB/1746msec)
    clat (usec): min=90, max=21308, avg=3421.15, stdev=4316.51
     lat (usec): min=91, max=21309, avg=3421.86, stdev=4316.52
    clat percentiles (usec):
     |  1.00th=[   97],  5.00th=[  110], 10.00th=[  133], 20.00th=[  167],
     | 30.00th=[  314], 40.00th=[  996], 50.00th=[ 1450], 60.00th=[ 2343],
     | 70.00th=[ 3982], 80.00th=[ 6587], 90.00th=[ 9372], 95.00th=[13173],
     | 99.00th=[18744], 99.50th=[20579], 99.90th=[21365], 99.95th=[21365],
     | 99.99th=[21365]
   bw (  KiB/s): min=  760, max=  912, per=23.91%, avg=840.00, stdev=76.32, samples=3
   iops        : min=  190, max=  228, avg=210.00, stdev=19.08, samples=3
  lat (usec)   : 4=0.65%, 10=8.46%, 20=9.77%, 50=5.60%, 100=1.43%
  lat (usec)   : 250=14.19%, 500=1.17%, 750=1.56%, 1000=4.56%
  lat (msec)   : 2=19.14%, 4=17.19%, 10=11.59%, 20=4.43%, 50=0.26%
  cpu          : usr=0.00%, sys=9.40%, ctx=1023, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23215: Fri May 16 10:00:14 2025
   read: IOPS=220, BW=883KiB/s (904kB/s)(1508KiB/1708msec)
    clat (usec): min=3, max=28026, avg=1201.87, stdev=2546.45
     lat (usec): min=4, max=28026, avg=1203.03, stdev=2548.22
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   21], 50.00th=[   41], 60.00th=[ 1303],
     | 70.00th=[ 1745], 80.00th=[ 2057], 90.00th=[ 2671], 95.00th=[ 3228],
     | 99.00th=[10421], 99.50th=[27132], 99.90th=[27919], 99.95th=[27919],
     | 99.99th=[27919]
   bw (  KiB/s): min=  816, max=  904, per=25.96%, avg=866.67, stdev=45.49, samples=3
   iops        : min=  204, max=  226, avg=216.67, stdev=11.37, samples=3
  write: IOPS=228, BW=916KiB/s (938kB/s)(1564KiB/1708msec)
    clat (usec): min=97, max=23911, avg=3191.21, stdev=4354.09
     lat (usec): min=98, max=23912, avg=3192.51, stdev=4354.28
    clat percentiles (usec):
     |  1.00th=[  104],  5.00th=[  122], 10.00th=[  133], 20.00th=[  169],
     | 30.00th=[  289], 40.00th=[  898], 50.00th=[ 1500], 60.00th=[ 2147],
     | 70.00th=[ 3261], 80.00th=[ 5735], 90.00th=[ 8979], 95.00th=[13042],
     | 99.00th=[21103], 99.50th=[23725], 99.90th=[23987], 99.95th=[23987],
     | 99.99th=[23987]
   bw (  KiB/s): min=  800, max=  960, per=25.58%, avg=898.67, stdev=86.29, samples=3
   iops        : min=  200, max=  240, avg=224.67, stdev=21.57, samples=3
  lat (usec)   : 4=0.26%, 10=8.98%, 20=10.29%, 50=5.21%, 100=1.04%
  lat (usec)   : 250=14.32%, 500=1.95%, 750=2.47%, 1000=4.69%
  lat (msec)   : 2=19.14%, 4=16.93%, 10=10.29%, 20=3.39%, 50=1.04%
  cpu          : usr=0.12%, sys=10.25%, ctx=993, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3340KiB/s (3420kB/s), 801KiB/s-896KiB/s (820kB/s-917kB/s), io=5988KiB (6132kB), run=1708-1793msec
  WRITE: bw=3514KiB/s (3598kB/s), 864KiB/s-929KiB/s (884kB/s-951kB/s), io=6300KiB (6451kB), run=1708-1793msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=23208: Fri May 16 10:00:18 2025
   read: IOPS=56, BW=226KiB/s (231kB/s)(1480KiB/6553msec)
    clat (usec): min=631, max=31193, avg=2019.22, stdev=3438.63
     lat (usec): min=632, max=31194, avg=2019.91, stdev=3438.64
    clat percentiles (usec):
     |  1.00th=[  668],  5.00th=[  725], 10.00th=[  775], 20.00th=[  816],
     | 30.00th=[  865], 40.00th=[  906], 50.00th=[  963], 60.00th=[ 1090],
     | 70.00th=[ 1270], 80.00th=[ 1663], 90.00th=[ 2900], 95.00th=[ 8848],
     | 99.00th=[17433], 99.50th=[29230], 99.90th=[31065], 99.95th=[31065],
     | 99.99th=[31065]
   bw (  KiB/s): min=  136, max=  328, per=24.84%, avg=223.85, stdev=61.76, samples=13
   iops        : min=   34, max=   82, avg=55.85, stdev=15.42, samples=13
  write: IOPS=60, BW=243KiB/s (249kB/s)(1592KiB/6553msec)
    clat (usec): min=7436, max=39276, avg=14557.34, stdev=4965.13
     lat (usec): min=7437, max=39277, avg=14558.17, stdev=4965.16
    clat percentiles (usec):
     |  1.00th=[ 7832],  5.00th=[ 8291], 10.00th=[ 8979], 20.00th=[ 9765],
     | 30.00th=[11338], 40.00th=[13304], 50.00th=[14615], 60.00th=[15664],
     | 70.00th=[16581], 80.00th=[17433], 90.00th=[19268], 95.00th=[21627],
     | 99.00th=[33424], 99.50th=[38536], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min=  152, max=  295, per=25.49%, avg=241.69, stdev=43.88, samples=13
   iops        : min=   38, max=   73, avg=60.31, stdev=10.91, samples=13
  lat (usec)   : 750=3.78%, 1000=21.48%
  lat (msec)   : 2=15.36%, 4=3.52%, 10=13.28%, 20=38.41%, 50=4.17%
  cpu          : usr=0.12%, sys=1.66%, ctx=810, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23209: Fri May 16 10:00:18 2025
   read: IOPS=54, BW=216KiB/s (221kB/s)(1436KiB/6642msec)
    clat (usec): min=632, max=21667, avg=1900.16, stdev=2739.30
     lat (usec): min=633, max=21667, avg=1900.89, stdev=2739.29
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  717], 10.00th=[  766], 20.00th=[  816],
     | 30.00th=[  881], 40.00th=[  947], 50.00th=[ 1057], 60.00th=[ 1156],
     | 70.00th=[ 1287], 80.00th=[ 1762], 90.00th=[ 3392], 95.00th=[ 7832],
     | 99.00th=[16057], 99.50th=[19530], 99.90th=[21627], 99.95th=[21627],
     | 99.99th=[21627]
   bw (  KiB/s): min=  112, max=  304, per=23.89%, avg=215.23, stdev=50.13, samples=13
   iops        : min=   28, max=   76, avg=53.69, stdev=12.55, samples=13
  write: IOPS=61, BW=246KiB/s (252kB/s)(1636KiB/6642msec)
    clat (usec): min=6734, max=34892, avg=14549.06, stdev=4703.75
     lat (usec): min=6735, max=34893, avg=14550.00, stdev=4703.76
    clat percentiles (usec):
     |  1.00th=[ 7504],  5.00th=[ 8291], 10.00th=[ 8979], 20.00th=[10028],
     | 30.00th=[11469], 40.00th=[13435], 50.00th=[14746], 60.00th=[15533],
     | 70.00th=[16319], 80.00th=[17433], 90.00th=[19268], 95.00th=[22676],
     | 99.00th=[30016], 99.50th=[34341], 99.90th=[34866], 99.95th=[34866],
     | 99.99th=[34866]
   bw (  KiB/s): min=  184, max=  280, per=25.56%, avg=242.31, stdev=31.51, samples=13
   iops        : min=   46, max=   70, avg=60.46, stdev= 7.85, samples=13
  lat (usec)   : 750=3.91%, 1000=17.32%
  lat (msec)   : 2=17.58%, 4=3.91%, 10=12.89%, 20=40.10%, 50=4.30%
  cpu          : usr=0.15%, sys=1.63%, ctx=830, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23210: Fri May 16 10:00:18 2025
   read: IOPS=61, BW=246KiB/s (252kB/s)(1564KiB/6348msec)
    clat (usec): min=613, max=21387, avg=1764.81, stdev=2609.40
     lat (usec): min=613, max=21388, avg=1765.55, stdev=2609.42
    clat percentiles (usec):
     |  1.00th=[  668],  5.00th=[  725], 10.00th=[  750], 20.00th=[  816],
     | 30.00th=[  865], 40.00th=[  906], 50.00th=[ 1004], 60.00th=[ 1123],
     | 70.00th=[ 1254], 80.00th=[ 1647], 90.00th=[ 2409], 95.00th=[ 7046],
     | 99.00th=[16057], 99.50th=[18482], 99.90th=[21365], 99.95th=[21365],
     | 99.99th=[21365]
   bw (  KiB/s): min=  144, max=  408, per=27.75%, avg=250.00, stdev=76.36, samples=12
   iops        : min=   36, max=  102, avg=62.50, stdev=19.09, samples=12
  write: IOPS=59, BW=238KiB/s (243kB/s)(1508KiB/6348msec)
    clat (usec): min=7169, max=36159, avg=14976.86, stdev=4802.75
     lat (usec): min=7169, max=36160, avg=14977.76, stdev=4802.77
    clat percentiles (usec):
     |  1.00th=[ 7439],  5.00th=[ 8717], 10.00th=[ 9372], 20.00th=[10552],
     | 30.00th=[11731], 40.00th=[13566], 50.00th=[14746], 60.00th=[15664],
     | 70.00th=[16909], 80.00th=[17957], 90.00th=[20841], 95.00th=[25297],
     | 99.00th=[28443], 99.50th=[33424], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  176, max=  272, per=24.75%, avg=234.67, stdev=33.48, samples=12
   iops        : min=   44, max=   68, avg=58.67, stdev= 8.37, samples=12
  lat (usec)   : 750=4.95%, 1000=20.44%
  lat (msec)   : 2=18.23%, 4=3.78%, 10=9.24%, 20=37.63%, 50=5.73%
  cpu          : usr=0.09%, sys=1.80%, ctx=825, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23211: Fri May 16 10:00:18 2025
   read: IOPS=58, BW=234KiB/s (240kB/s)(1508KiB/6442msec)
    clat (usec): min=662, max=26392, avg=1733.61, stdev=2776.20
     lat (usec): min=663, max=26394, avg=1734.35, stdev=2776.36
    clat percentiles (usec):
     |  1.00th=[  709],  5.00th=[  742], 10.00th=[  775], 20.00th=[  824],
     | 30.00th=[  865], 40.00th=[  914], 50.00th=[ 1004], 60.00th=[ 1139],
     | 70.00th=[ 1237], 80.00th=[ 1549], 90.00th=[ 2474], 95.00th=[ 6325],
     | 99.00th=[18482], 99.50th=[26346], 99.90th=[26346], 99.95th=[26346],
     | 99.99th=[26346]
   bw (  KiB/s): min=  144, max=  320, per=25.21%, avg=227.17, stdev=57.06, samples=12
   iops        : min=   36, max=   80, avg=56.67, stdev=14.30, samples=12
  write: IOPS=60, BW=243KiB/s (249kB/s)(1564KiB/6442msec)
    clat (usec): min=6924, max=43213, avg=14779.15, stdev=5214.66
     lat (usec): min=6925, max=43215, avg=14779.99, stdev=5214.68
    clat percentiles (usec):
     |  1.00th=[ 7504],  5.00th=[ 8586], 10.00th=[ 8979], 20.00th=[10028],
     | 30.00th=[11076], 40.00th=[13435], 50.00th=[14877], 60.00th=[15926],
     | 70.00th=[16909], 80.00th=[17695], 90.00th=[19268], 95.00th=[22938],
     | 99.00th=[38011], 99.50th=[40633], 99.90th=[43254], 99.95th=[43254],
     | 99.99th=[43254]
   bw (  KiB/s): min=  160, max=  304, per=25.16%, avg=238.50, stdev=44.17, samples=12
   iops        : min=   40, max=   76, avg=59.50, stdev=11.13, samples=12
  lat (usec)   : 750=3.26%, 1000=21.22%
  lat (msec)   : 2=17.71%, 4=4.17%, 10=11.98%, 20=36.98%, 50=4.69%
  cpu          : usr=0.06%, sys=1.75%, ctx=827, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=902KiB/s (923kB/s), 216KiB/s-246KiB/s (221kB/s-252kB/s), io=5988KiB (6132kB), run=6348-6642msec
  WRITE: bw=949KiB/s (971kB/s), 238KiB/s-246KiB/s (243kB/s-252kB/s), io=6300KiB (6451kB), run=6348-6642msec