== sanity test 398b: DIO and buffer IO race ============== 07:06:51 (1747825611)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.05856 s, 215 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=4126: Wed May 21 07:06:54 2025
   read: IOPS=185, BW=740KiB/s (758kB/s)(1480KiB/1999msec)
    clat (usec): min=3, max=24266, avg=1435.54, stdev=2825.81
     lat (usec): min=3, max=24266, avg=1436.20, stdev=2825.84
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   18], 50.00th=[   32], 60.00th=[ 1139],
     | 70.00th=[ 1762], 80.00th=[ 2311], 90.00th=[ 3195], 95.00th=[ 4359],
     | 99.00th=[16909], 99.50th=[19268], 99.90th=[24249], 99.95th=[24249],
     | 99.99th=[24249]
   bw (  KiB/s): min=  622, max=  736, per=22.67%, avg=663.33, stdev=63.13, samples=3
   iops        : min=  155, max=  184, avg=165.67, stdev=15.95, samples=3
  write: IOPS=199, BW=796KiB/s (816kB/s)(1592KiB/1999msec)
    clat (usec): min=85, max=32557, avg=3670.26, stdev=5189.39
     lat (usec): min=86, max=32558, avg=3671.12, stdev=5189.32
    clat percentiles (usec):
     |  1.00th=[   97],  5.00th=[  118], 10.00th=[  135], 20.00th=[  169],
     | 30.00th=[  249], 40.00th=[  963], 50.00th=[ 1450], 60.00th=[ 2180],
     | 70.00th=[ 3785], 80.00th=[ 6718], 90.00th=[10683], 95.00th=[14091],
     | 99.00th=[24773], 99.50th=[29754], 99.90th=[32637], 99.95th=[32637],
     | 99.99th=[32637]
   bw (  KiB/s): min=  630, max=  816, per=23.97%, avg=738.00, stdev=96.56, samples=3
   iops        : min=  157, max=  204, avg=184.33, stdev=24.42, samples=3
  lat (usec)   : 4=0.13%, 10=8.98%, 20=11.59%, 50=4.82%, 100=1.17%
  lat (usec)   : 250=15.49%, 500=1.95%, 750=1.04%, 1000=4.04%
  lat (msec)   : 2=16.28%, 4=16.28%, 10=11.07%, 20=5.99%, 50=1.17%
  cpu          : usr=0.05%, sys=8.86%, ctx=979, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=4127: Wed May 21 07:06:54 2025
   read: IOPS=175, BW=702KiB/s (719kB/s)(1436KiB/2046msec)
    clat (usec): min=3, max=32990, avg=1355.83, stdev=2795.71
     lat (usec): min=3, max=32990, avg=1356.44, stdev=2795.72
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[   23], 50.00th=[   77], 60.00th=[ 1270],
     | 70.00th=[ 1713], 80.00th=[ 2212], 90.00th=[ 3261], 95.00th=[ 4424],
     | 99.00th=[16188], 99.50th=[21365], 99.90th=[32900], 99.95th=[32900],
     | 99.99th=[32900]
   bw (  KiB/s): min=  520, max=  824, per=23.58%, avg=690.00, stdev=126.89, samples=4
   iops        : min=  130, max=  206, avg=172.50, stdev=31.72, samples=4
  write: IOPS=199, BW=800KiB/s (819kB/s)(1636KiB/2046msec)
    clat (usec): min=95, max=34225, avg=3796.85, stdev=5428.24
     lat (usec): min=96, max=34228, avg=3797.61, stdev=5428.26
    clat percentiles (usec):
     |  1.00th=[  106],  5.00th=[  118], 10.00th=[  139], 20.00th=[  169],
     | 30.00th=[  355], 40.00th=[ 1020], 50.00th=[ 1631], 60.00th=[ 2376],
     | 70.00th=[ 3720], 80.00th=[ 6587], 90.00th=[10421], 95.00th=[14877],
     | 99.00th=[26084], 99.50th=[30278], 99.90th=[34341], 99.95th=[34341],
     | 99.99th=[34341]
   bw (  KiB/s): min=  592, max=  944, per=25.20%, avg=776.00, stdev=170.58, samples=4
   iops        : min=  148, max=  236, avg=194.00, stdev=42.65, samples=4
  lat (usec)   : 4=0.39%, 10=8.07%, 20=8.72%, 50=5.47%, 100=1.43%
  lat (usec)   : 250=15.62%, 500=1.69%, 750=0.52%, 1000=4.69%
  lat (msec)   : 2=19.27%, 4=16.41%, 10=11.33%, 20=4.82%, 50=1.56%
  cpu          : usr=0.24%, sys=8.65%, ctx=943, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=4128: Wed May 21 07:06:54 2025
   read: IOPS=200, BW=802KiB/s (822kB/s)(1564KiB/1949msec)
    clat (usec): min=3, max=36253, avg=1441.01, stdev=2868.96
     lat (usec): min=3, max=36254, avg=1441.67, stdev=2868.94
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    9], 20.00th=[   12],
     | 30.00th=[   17], 40.00th=[   29], 50.00th=[  881], 60.00th=[ 1631],
     | 70.00th=[ 1975], 80.00th=[ 2343], 90.00th=[ 3064], 95.00th=[ 3982],
     | 99.00th=[19268], 99.50th=[22414], 99.90th=[36439], 99.95th=[36439],
     | 99.99th=[36439]
   bw (  KiB/s): min=  616, max=  864, per=25.97%, avg=760.00, stdev=128.75, samples=3
   iops        : min=  154, max=  216, avg=190.00, stdev=32.19, samples=3
  write: IOPS=193, BW=774KiB/s (792kB/s)(1508KiB/1949msec)
    clat (usec): min=92, max=34676, avg=3654.83, stdev=5014.41
     lat (usec): min=92, max=34693, avg=3655.71, stdev=5014.73
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  115], 10.00th=[  135], 20.00th=[  163],
     | 30.00th=[  215], 40.00th=[  938], 50.00th=[ 1319], 60.00th=[ 2114],
     | 70.00th=[ 3785], 80.00th=[ 7308], 90.00th=[10814], 95.00th=[14353],
     | 99.00th=[19268], 99.50th=[30802], 99.90th=[34866], 99.95th=[34866],
     | 99.99th=[34866]
   bw (  KiB/s): min=  704, max=  768, per=23.90%, avg=736.00, stdev=32.00, samples=3
   iops        : min=  176, max=  192, avg=184.00, stdev= 8.00, samples=3
  lat (usec)   : 4=0.52%, 10=8.33%, 20=7.81%, 50=6.38%, 100=0.91%
  lat (usec)   : 250=15.76%, 500=1.17%, 750=1.69%, 1000=5.08%
  lat (msec)   : 2=17.19%, 4=18.49%, 10=10.42%, 20=5.60%, 50=0.65%
  cpu          : usr=0.31%, sys=8.78%, ctx=974, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=4129: Wed May 21 07:06:54 2025
   read: IOPS=188, BW=754KiB/s (772kB/s)(1508KiB/2001msec)
    clat (usec): min=4, max=20098, avg=1440.21, stdev=2490.28
     lat (usec): min=4, max=20099, avg=1440.86, stdev=2490.30
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   15], 40.00th=[   21], 50.00th=[  498], 60.00th=[ 1614],
     | 70.00th=[ 2024], 80.00th=[ 2474], 90.00th=[ 3163], 95.00th=[ 3654],
     | 99.00th=[17695], 99.50th=[19268], 99.90th=[20055], 99.95th=[20055],
     | 99.99th=[20055]
   bw (  KiB/s): min=  576, max=  792, per=23.22%, avg=679.33, stdev=108.30, samples=3
   iops        : min=  144, max=  198, avg=169.67, stdev=27.10, samples=3
  write: IOPS=195, BW=782KiB/s (800kB/s)(1564KiB/2001msec)
    clat (usec): min=91, max=38445, avg=3711.23, stdev=5421.65
     lat (usec): min=92, max=38446, avg=3712.24, stdev=5421.50
    clat percentiles (usec):
     |  1.00th=[  109],  5.00th=[  126], 10.00th=[  147], 20.00th=[  176],
     | 30.00th=[  302], 40.00th=[  922], 50.00th=[ 1369], 60.00th=[ 2245],
     | 70.00th=[ 3687], 80.00th=[ 6587], 90.00th=[10290], 95.00th=[15533],
     | 99.00th=[25297], 99.50th=[31851], 99.90th=[38536], 99.95th=[38536],
     | 99.99th=[38536]
   bw (  KiB/s): min=  664, max=  768, per=22.76%, avg=700.67, stdev=58.39, samples=3
   iops        : min=  166, max=  192, avg=175.00, stdev=14.73, samples=3
  lat (usec)   : 10=7.94%, 20=11.46%, 50=4.17%, 100=0.52%, 250=14.84%
  lat (usec)   : 500=2.08%, 750=1.56%, 1000=4.69%
  lat (msec)   : 2=16.67%, 4=19.92%, 10=10.03%, 20=4.82%, 50=1.30%
  cpu          : usr=0.30%, sys=9.25%, ctx=1009, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2927KiB/s (2997kB/s), 702KiB/s-802KiB/s (719kB/s-822kB/s), io=5988KiB (6132kB), run=1949-2046msec
  WRITE: bw=3079KiB/s (3153kB/s), 774KiB/s-800KiB/s (792kB/s-819kB/s), io=6300KiB (6451kB), run=1949-2046msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=4122: Wed May 21 07:06:58 2025
   read: IOPS=57, BW=231KiB/s (236kB/s)(1480KiB/6418msec)
    clat (usec): min=657, max=23260, avg=1956.74, stdev=2831.54
     lat (usec): min=658, max=23260, avg=1957.70, stdev=2831.55
    clat percentiles (usec):
     |  1.00th=[  717],  5.00th=[  783], 10.00th=[  807], 20.00th=[  873],
     | 30.00th=[  930], 40.00th=[  996], 50.00th=[ 1090], 60.00th=[ 1205],
     | 70.00th=[ 1369], 80.00th=[ 1795], 90.00th=[ 3097], 95.00th=[ 7177],
     | 99.00th=[16319], 99.50th=[21627], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  136, max=  344, per=24.94%, avg=227.17, stdev=61.70, samples=12
   iops        : min=   34, max=   86, avg=56.67, stdev=15.27, samples=12
  write: IOPS=62, BW=248KiB/s (254kB/s)(1592KiB/6418msec)
    clat (usec): min=7249, max=42252, avg=14279.43, stdev=5211.79
     lat (usec): min=7249, max=42253, avg=14280.38, stdev=5211.76
    clat percentiles (usec):
     |  1.00th=[ 7701],  5.00th=[ 8160], 10.00th=[ 8717], 20.00th=[ 9634],
     | 30.00th=[10814], 40.00th=[12518], 50.00th=[13960], 60.00th=[15008],
     | 70.00th=[16057], 80.00th=[17171], 90.00th=[20317], 95.00th=[23725],
     | 99.00th=[33424], 99.50th=[39060], 99.90th=[42206], 99.95th=[42206],
     | 99.99th=[42206]
   bw (  KiB/s): min=  168, max=  312, per=25.73%, avg=246.50, stdev=53.47, samples=12
   iops        : min=   42, max=   78, avg=61.50, stdev=13.36, samples=12
  lat (usec)   : 750=1.30%, 1000=18.23%
  lat (msec)   : 2=20.31%, 4=4.43%, 10=14.06%, 20=35.81%, 50=5.86%
  cpu          : usr=0.08%, sys=1.90%, ctx=823, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=4123: Wed May 21 07:06:58 2025
   read: IOPS=54, BW=219KiB/s (224kB/s)(1436KiB/6571msec)
    clat (usec): min=691, max=23679, avg=1820.44, stdev=2722.12
     lat (usec): min=692, max=23679, avg=1821.20, stdev=2722.12
    clat percentiles (usec):
     |  1.00th=[  709],  5.00th=[  783], 10.00th=[  832], 20.00th=[  889],
     | 30.00th=[  955], 40.00th=[ 1004], 50.00th=[ 1074], 60.00th=[ 1172],
     | 70.00th=[ 1319], 80.00th=[ 1745], 90.00th=[ 2474], 95.00th=[ 5997],
     | 99.00th=[16057], 99.50th=[21103], 99.90th=[23725], 99.95th=[23725],
     | 99.99th=[23725]
   bw (  KiB/s): min=  112, max=  328, per=23.83%, avg=217.08, stdev=55.69, samples=13
   iops        : min=   28, max=   82, avg=54.15, stdev=13.92, samples=13
  write: IOPS=62, BW=249KiB/s (255kB/s)(1636KiB/6571msec)
    clat (usec): min=7151, max=40304, avg=14436.17, stdev=4908.41
     lat (usec): min=7152, max=40305, avg=14437.10, stdev=4908.43
    clat percentiles (usec):
     |  1.00th=[ 7898],  5.00th=[ 8455], 10.00th=[ 9110], 20.00th=[10290],
     | 30.00th=[11600], 40.00th=[13042], 50.00th=[14222], 60.00th=[15139],
     | 70.00th=[15795], 80.00th=[17171], 90.00th=[19268], 95.00th=[22676],
     | 99.00th=[33424], 99.50th=[37487], 99.90th=[40109], 99.95th=[40109],
     | 99.99th=[40109]
   bw (  KiB/s): min=  168, max=  288, per=25.81%, avg=247.23, stdev=44.04, samples=13
   iops        : min=   42, max=   72, avg=61.69, stdev=10.96, samples=13
  lat (usec)   : 750=1.69%, 1000=16.54%
  lat (msec)   : 2=21.09%, 4=4.82%, 10=10.68%, 20=40.76%, 50=4.43%
  cpu          : usr=0.14%, sys=1.84%, ctx=817, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=4124: Wed May 21 07:06:58 2025
   read: IOPS=62, BW=248KiB/s (254kB/s)(1564KiB/6301msec)
    clat (usec): min=697, max=24961, avg=1841.26, stdev=2769.48
     lat (usec): min=697, max=24962, avg=1842.08, stdev=2769.49
    clat percentiles (usec):
     |  1.00th=[  717],  5.00th=[  783], 10.00th=[  824], 20.00th=[  873],
     | 30.00th=[  922], 40.00th=[  979], 50.00th=[ 1057], 60.00th=[ 1172],
     | 70.00th=[ 1319], 80.00th=[ 1614], 90.00th=[ 2376], 95.00th=[ 7308],
     | 99.00th=[16712], 99.50th=[21890], 99.90th=[25035], 99.95th=[25035],
     | 99.99th=[25035]
   bw (  KiB/s): min=  120, max=  399, per=27.79%, avg=253.17, stdev=91.83, samples=12
   iops        : min=   30, max=   99, avg=63.17, stdev=22.83, samples=12
  write: IOPS=59, BW=239KiB/s (245kB/s)(1508KiB/6301msec)
    clat (usec): min=6721, max=50439, avg=14776.35, stdev=5724.01
     lat (usec): min=6722, max=50440, avg=14777.36, stdev=5724.22
    clat percentiles (usec):
     |  1.00th=[ 7832],  5.00th=[ 8356], 10.00th=[ 8979], 20.00th=[10159],
     | 30.00th=[11600], 40.00th=[12911], 50.00th=[14091], 60.00th=[14746],
     | 70.00th=[15926], 80.00th=[17171], 90.00th=[20841], 95.00th=[27132],
     | 99.00th=[34866], 99.50th=[39060], 99.90th=[50594], 99.95th=[50594],
     | 99.99th=[50594]
   bw (  KiB/s): min=  160, max=  288, per=24.97%, avg=239.17, stdev=49.29, samples=12
   iops        : min=   40, max=   72, avg=59.67, stdev=12.27, samples=12
  lat (usec)   : 750=1.17%, 1000=21.61%
  lat (msec)   : 2=20.83%, 4=3.78%, 10=11.59%, 20=35.03%, 50=5.86%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.14%, sys=1.86%, ctx=827, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=4125: Wed May 21 07:06:58 2025
   read: IOPS=57, BW=232KiB/s (237kB/s)(1508KiB/6508msec)
    clat (usec): min=725, max=28640, avg=2094.15, stdev=3359.59
     lat (usec): min=726, max=28641, avg=2094.94, stdev=3359.62
    clat percentiles (usec):
     |  1.00th=[  750],  5.00th=[  791], 10.00th=[  824], 20.00th=[  865],
     | 30.00th=[  922], 40.00th=[  979], 50.00th=[ 1045], 60.00th=[ 1188],
     | 70.00th=[ 1336], 80.00th=[ 1762], 90.00th=[ 3294], 95.00th=[ 9241],
     | 99.00th=[19006], 99.50th=[27132], 99.90th=[28705], 99.95th=[28705],
     | 99.99th=[28705]
   bw (  KiB/s): min=  144, max=  344, per=25.18%, avg=229.38, stdev=60.11, samples=13
   iops        : min=   36, max=   86, avg=57.23, stdev=15.05, samples=13
  write: IOPS=60, BW=240KiB/s (246kB/s)(1564KiB/6508msec)
    clat (usec): min=7809, max=46636, avg=14595.33, stdev=5367.29
     lat (usec): min=7810, max=46637, avg=14596.21, stdev=5367.32
    clat percentiles (usec):
     |  1.00th=[ 7898],  5.00th=[ 8586], 10.00th=[ 9110], 20.00th=[10028],
     | 30.00th=[11863], 40.00th=[13173], 50.00th=[14222], 60.00th=[15008],
     | 70.00th=[15926], 80.00th=[16909], 90.00th=[19530], 95.00th=[23987],
     | 99.00th=[39584], 99.50th=[42206], 99.90th=[46400], 99.95th=[46400],
     | 99.99th=[46400]
   bw (  KiB/s): min=  160, max=  288, per=25.04%, avg=239.85, stdev=46.76, samples=13
   iops        : min=   40, max=   72, avg=59.85, stdev=11.70, samples=13
  lat (usec)   : 750=0.65%, 1000=20.70%
  lat (msec)   : 2=19.66%, 4=3.52%, 10=12.63%, 20=38.02%, 50=4.82%
  cpu          : usr=0.15%, sys=1.83%, ctx=845, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=911KiB/s (933kB/s), 219KiB/s-248KiB/s (224kB/s-254kB/s), io=5988KiB (6132kB), run=6301-6571msec
  WRITE: bw=959KiB/s (982kB/s), 239KiB/s-249KiB/s (245kB/s-255kB/s), io=6300KiB (6451kB), run=6301-6571msec