== sanity test 398b: DIO and buffer IO race ============== 10:12:26 (1747404746)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0898039 s, 140 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=21014: Fri May 16 10:12:29 2025
   read: IOPS=355, BW=1423KiB/s (1457kB/s)(1480KiB/1040msec)
    clat (usec): min=3, max=34784, avg=1639.50, stdev=3301.99
     lat (usec): min=3, max=34785, avg=1641.25, stdev=3302.29
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   19], 50.00th=[ 1029], 60.00th=[ 1549],
     | 70.00th=[ 1942], 80.00th=[ 2474], 90.00th=[ 3458], 95.00th=[ 4490],
     | 99.00th=[19006], 99.50th=[30802], 99.90th=[34866], 99.95th=[34866],
     | 99.99th=[34866]
   bw (  KiB/s): min=  808, max= 1944, per=24.89%, avg=1376.00, stdev=803.27, samples=2
   iops        : min=  202, max=  486, avg=344.00, stdev=200.82, samples=2
  write: IOPS=382, BW=1531KiB/s (1568kB/s)(1592KiB/1040msec)
    clat (usec): min=88, max=8511, avg=1051.64, stdev=1374.16
     lat (usec): min=88, max=8512, avg=1052.79, stdev=1375.30
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[  101], 10.00th=[  109], 20.00th=[  120],
     | 30.00th=[  143], 40.00th=[  188], 50.00th=[  619], 60.00th=[  889],
     | 70.00th=[ 1106], 80.00th=[ 1827], 90.00th=[ 2638], 95.00th=[ 3884],
     | 99.00th=[ 7177], 99.50th=[ 8094], 99.90th=[ 8455], 99.95th=[ 8455],
     | 99.99th=[ 8455]
   bw (  KiB/s): min=  856, max= 2112, per=25.51%, avg=1484.00, stdev=888.13, samples=2
   iops        : min=  214, max=  528, avg=371.00, stdev=222.03, samples=2
  lat (usec)   : 4=0.52%, 10=12.76%, 20=5.99%, 50=0.65%, 100=2.86%
  lat (usec)   : 250=21.61%, 500=1.82%, 750=2.86%, 1000=8.85%
  lat (msec)   : 2=19.14%, 4=16.93%, 10=5.34%, 20=0.26%, 50=0.39%
  cpu          : usr=0.77%, sys=16.94%, ctx=884, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21016: Fri May 16 10:12:29 2025
   read: IOPS=331, BW=1326KiB/s (1358kB/s)(1436KiB/1083msec)
    clat (usec): min=3, max=34820, avg=1612.73, stdev=2658.50
     lat (usec): min=3, max=34821, avg=1613.63, stdev=2658.61
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   11], 40.00th=[   24], 50.00th=[ 1336], 60.00th=[ 1696],
     | 70.00th=[ 2147], 80.00th=[ 2540], 90.00th=[ 3359], 95.00th=[ 4817],
     | 99.00th=[ 9372], 99.50th=[17171], 99.90th=[34866], 99.95th=[34866],
     | 99.99th=[34866]
   bw (  KiB/s): min=  720, max= 1832, per=23.08%, avg=1276.00, stdev=786.30, samples=2
   iops        : min=  180, max=  458, avg=319.00, stdev=196.58, samples=2
  write: IOPS=377, BW=1511KiB/s (1547kB/s)(1636KiB/1083msec)
    clat (usec): min=85, max=36776, avg=1169.75, stdev=2762.33
     lat (usec): min=85, max=36778, avg=1170.51, stdev=2762.47
    clat percentiles (usec):
     |  1.00th=[   89],  5.00th=[   99], 10.00th=[  108], 20.00th=[  120],
     | 30.00th=[  139], 40.00th=[  169], 50.00th=[  586], 60.00th=[  857],
     | 70.00th=[ 1090], 80.00th=[ 1680], 90.00th=[ 2638], 95.00th=[ 4015],
     | 99.00th=[ 7308], 99.50th=[ 8848], 99.90th=[36963], 99.95th=[36963],
     | 99.99th=[36963]
   bw (  KiB/s): min=  808, max= 2072, per=24.76%, avg=1440.00, stdev=893.78, samples=2
   iops        : min=  202, max=  518, avg=360.00, stdev=223.45, samples=2
  lat (usec)   : 4=0.39%, 10=12.76%, 20=5.21%, 50=0.78%, 100=2.86%
  lat (usec)   : 250=22.40%, 500=1.04%, 750=3.39%, 1000=7.68%
  lat (msec)   : 2=19.40%, 4=18.36%, 10=5.08%, 20=0.26%, 50=0.39%
  cpu          : usr=0.18%, sys=15.25%, ctx=898, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21018: Fri May 16 10:12:29 2025
   read: IOPS=364, BW=1459KiB/s (1494kB/s)(1564KiB/1072msec)
    clat (usec): min=3, max=30166, avg=1740.63, stdev=2734.44
     lat (usec): min=3, max=30167, avg=1742.30, stdev=2735.91
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[  586], 50.00th=[ 1467], 60.00th=[ 1844],
     | 70.00th=[ 2212], 80.00th=[ 2606], 90.00th=[ 3621], 95.00th=[ 4948],
     | 99.00th=[16581], 99.50th=[18744], 99.90th=[30278], 99.95th=[30278],
     | 99.99th=[30278]
   bw (  KiB/s): min=  808, max= 1904, per=24.53%, avg=1356.00, stdev=774.99, samples=2
   iops        : min=  202, max=  476, avg=339.00, stdev=193.75, samples=2
  write: IOPS=351, BW=1407KiB/s (1440kB/s)(1508KiB/1072msec)
    clat (usec): min=88, max=5530, avg=1005.21, stdev=1128.09
     lat (usec): min=88, max=5532, avg=1005.88, stdev=1128.12
    clat percentiles (usec):
     |  1.00th=[   93],  5.00th=[  102], 10.00th=[  112], 20.00th=[  124],
     | 30.00th=[  151], 40.00th=[  206], 50.00th=[  676], 60.00th=[  840],
     | 70.00th=[ 1270], 80.00th=[ 1844], 90.00th=[ 2671], 95.00th=[ 3523],
     | 99.00th=[ 4555], 99.50th=[ 5473], 99.90th=[ 5538], 99.95th=[ 5538],
     | 99.99th=[ 5538]
   bw (  KiB/s): min=  888, max= 1776, per=22.90%, avg=1332.00, stdev=627.91, samples=2
   iops        : min=  222, max=  444, avg=333.00, stdev=156.98, samples=2
  lat (usec)   : 4=0.52%, 10=11.72%, 20=6.90%, 50=0.65%, 100=1.69%
  lat (usec)   : 250=19.40%, 500=2.08%, 750=4.04%, 1000=7.29%
  lat (msec)   : 2=20.31%, 4=19.40%, 10=5.21%, 20=0.65%, 50=0.13%
  cpu          : usr=0.47%, sys=15.78%, ctx=932, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21019: Fri May 16 10:12:29 2025
   read: IOPS=359, BW=1438KiB/s (1472kB/s)(1508KiB/1049msec)
    clat (usec): min=4, max=30486, avg=1570.87, stdev=2378.64
     lat (usec): min=4, max=30487, avg=1571.39, stdev=2378.70
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[  832], 50.00th=[ 1385], 60.00th=[ 1696],
     | 70.00th=[ 1991], 80.00th=[ 2409], 90.00th=[ 3326], 95.00th=[ 4228],
     | 99.00th=[11731], 99.50th=[14615], 99.90th=[30540], 99.95th=[30540],
     | 99.99th=[30540]
   bw (  KiB/s): min=  816, max= 1960, per=25.10%, avg=1388.00, stdev=808.93, samples=2
   iops        : min=  204, max=  490, avg=347.00, stdev=202.23, samples=2
  write: IOPS=372, BW=1491KiB/s (1527kB/s)(1564KiB/1049msec)
    clat (usec): min=86, max=27770, avg=1101.52, stdev=2136.61
     lat (usec): min=86, max=27772, avg=1102.13, stdev=2136.72
    clat percentiles (usec):
     |  1.00th=[   90],  5.00th=[  101], 10.00th=[  109], 20.00th=[  123],
     | 30.00th=[  139], 40.00th=[  182], 50.00th=[  594], 60.00th=[  799],
     | 70.00th=[ 1106], 80.00th=[ 1713], 90.00th=[ 2474], 95.00th=[ 3621],
     | 99.00th=[10028], 99.50th=[19006], 99.90th=[27657], 99.95th=[27657],
     | 99.99th=[27657]
   bw (  KiB/s): min=  872, max= 2056, per=25.17%, avg=1464.00, stdev=837.21, samples=2
   iops        : min=  218, max=  514, avg=366.00, stdev=209.30, samples=2
  lat (usec)   : 10=12.50%, 20=5.34%, 50=0.26%, 100=2.21%, 250=21.74%
  lat (usec)   : 500=1.56%, 750=4.56%, 1000=7.55%
  lat (msec)   : 2=21.48%, 4=17.84%, 10=3.78%, 20=0.91%, 50=0.26%
  cpu          : usr=0.38%, sys=15.94%, ctx=945, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5529KiB/s (5662kB/s), 1326KiB/s-1459KiB/s (1358kB/s-1494kB/s), io=5988KiB (6132kB), run=1040-1083msec
  WRITE: bw=5817KiB/s (5957kB/s), 1407KiB/s-1531KiB/s (1440kB/s-1568kB/s), io=6300KiB (6451kB), run=1040-1083msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=21012: Fri May 16 10:12:30 2025
   read: IOPS=215, BW=862KiB/s (883kB/s)(1480KiB/1716msec)
    clat (usec): min=541, max=35312, avg=1529.16, stdev=2430.04
     lat (usec): min=541, max=35314, avg=1529.75, stdev=2430.11
    clat percentiles (usec):
     |  1.00th=[  570],  5.00th=[  627], 10.00th=[  668], 20.00th=[  725],
     | 30.00th=[  783], 40.00th=[  840], 50.00th=[  889], 60.00th=[  988],
     | 70.00th=[ 1287], 80.00th=[ 1860], 90.00th=[ 2704], 95.00th=[ 3851],
     | 99.00th=[ 8848], 99.50th=[23987], 99.90th=[35390], 99.95th=[35390],
     | 99.99th=[35390]
   bw (  KiB/s): min=  408, max= 1176, per=23.01%, avg=802.67, stdev=384.44, samples=3
   iops        : min=  102, max=  294, avg=200.67, stdev=96.11, samples=3
  write: IOPS=231, BW=928KiB/s (950kB/s)(1592KiB/1716msec)
    clat (usec): min=1025, max=31775, avg=2843.77, stdev=2509.78
     lat (usec): min=1026, max=31777, avg=2844.58, stdev=2509.80
    clat percentiles (usec):
     |  1.00th=[ 1139],  5.00th=[ 1418], 10.00th=[ 1565], 20.00th=[ 1762],
     | 30.00th=[ 1876], 40.00th=[ 1975], 50.00th=[ 2089], 60.00th=[ 2278],
     | 70.00th=[ 2737], 80.00th=[ 3556], 90.00th=[ 4817], 95.00th=[ 5997],
     | 99.00th=[10814], 99.50th=[29492], 99.90th=[31851], 99.95th=[31851],
     | 99.99th=[31851]
   bw (  KiB/s): min=  448, max= 1424, per=23.90%, avg=877.33, stdev=498.47, samples=3
   iops        : min=  112, max=  356, avg=219.33, stdev=124.62, samples=3
  lat (usec)   : 750=11.59%, 1000=17.32%
  lat (msec)   : 2=32.94%, 4=27.73%, 10=9.51%, 20=0.39%, 50=0.52%
  cpu          : usr=0.23%, sys=5.95%, ctx=821, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21013: Fri May 16 10:12:30 2025
   read: IOPS=213, BW=853KiB/s (874kB/s)(1436KiB/1683msec)
    clat (usec): min=573, max=37638, avg=1406.28, stdev=2218.19
     lat (usec): min=573, max=37669, avg=1406.94, stdev=2219.57
    clat percentiles (usec):
     |  1.00th=[  594],  5.00th=[  644], 10.00th=[  668], 20.00th=[  717],
     | 30.00th=[  758], 40.00th=[  816], 50.00th=[  881], 60.00th=[  996],
     | 70.00th=[ 1156], 80.00th=[ 1614], 90.00th=[ 2540], 95.00th=[ 3720],
     | 99.00th=[ 6783], 99.50th=[ 9241], 99.90th=[37487], 99.95th=[37487],
     | 99.99th=[37487]
   bw (  KiB/s): min=  408, max= 1296, per=23.16%, avg=808.00, stdev=450.49, samples=3
   iops        : min=  102, max=  324, avg=202.00, stdev=112.62, samples=3
  write: IOPS=243, BW=972KiB/s (995kB/s)(1636KiB/1683msec)
    clat (usec): min=1105, max=35666, avg=2839.86, stdev=2888.17
     lat (usec): min=1106, max=35667, avg=2840.60, stdev=2888.25
    clat percentiles (usec):
     |  1.00th=[ 1172],  5.00th=[ 1352], 10.00th=[ 1549], 20.00th=[ 1729],
     | 30.00th=[ 1844], 40.00th=[ 1958], 50.00th=[ 2057], 60.00th=[ 2245],
     | 70.00th=[ 2737], 80.00th=[ 3359], 90.00th=[ 4686], 95.00th=[ 5735],
     | 99.00th=[12649], 99.50th=[21103], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  456, max= 1344, per=24.84%, avg=912.00, stdev=444.49, samples=3
   iops        : min=  114, max=  336, avg=228.00, stdev=111.12, samples=3
  lat (usec)   : 750=13.15%, 1000=15.10%
  lat (msec)   : 2=36.46%, 4=25.91%, 10=8.59%, 20=0.26%, 50=0.52%
  cpu          : usr=0.24%, sys=6.00%, ctx=813, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21015: Fri May 16 10:12:30 2025
   read: IOPS=236, BW=946KiB/s (969kB/s)(1564KiB/1653msec)
    clat (usec): min=548, max=21716, avg=1489.12, stdev=1776.84
     lat (usec): min=549, max=21717, avg=1490.25, stdev=1777.22
    clat percentiles (usec):
     |  1.00th=[  562],  5.00th=[  652], 10.00th=[  685], 20.00th=[  734],
     | 30.00th=[  799], 40.00th=[  848], 50.00th=[  906], 60.00th=[ 1004],
     | 70.00th=[ 1237], 80.00th=[ 1762], 90.00th=[ 3097], 95.00th=[ 4113],
     | 99.00th=[ 7832], 99.50th=[17171], 99.90th=[21627], 99.95th=[21627],
     | 99.99th=[21627]
   bw (  KiB/s): min=  432, max= 1352, per=25.07%, avg=874.67, stdev=460.98, samples=3
   iops        : min=  108, max=  338, avg=218.67, stdev=115.24, samples=3
  write: IOPS=228, BW=912KiB/s (934kB/s)(1508KiB/1653msec)
    clat (usec): min=1124, max=33501, avg=2763.38, stdev=2346.38
     lat (usec): min=1124, max=33503, avg=2764.12, stdev=2346.47
    clat percentiles (usec):
     |  1.00th=[ 1156],  5.00th=[ 1303], 10.00th=[ 1532], 20.00th=[ 1729],
     | 30.00th=[ 1844], 40.00th=[ 1926], 50.00th=[ 2040], 60.00th=[ 2180],
     | 70.00th=[ 2606], 80.00th=[ 3425], 90.00th=[ 4883], 95.00th=[ 6128],
     | 99.00th=[12256], 99.50th=[15926], 99.90th=[33424], 99.95th=[33424],
     | 99.99th=[33424]
   bw (  KiB/s): min=  496, max= 1336, per=23.68%, avg=869.33, stdev=427.71, samples=3
   iops        : min=  124, max=  334, avg=217.33, stdev=106.93, samples=3
  lat (usec)   : 750=11.85%, 1000=18.62%
  lat (msec)   : 2=34.64%, 4=24.61%, 10=9.24%, 20=0.78%, 50=0.26%
  cpu          : usr=0.30%, sys=5.93%, ctx=814, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=21017: Fri May 16 10:12:30 2025
   read: IOPS=227, BW=908KiB/s (930kB/s)(1508KiB/1660msec)
    clat (usec): min=535, max=35923, avg=1605.54, stdev=2344.50
     lat (usec): min=535, max=35924, avg=1606.12, stdev=2344.56
    clat percentiles (usec):
     |  1.00th=[  586],  5.00th=[  627], 10.00th=[  676], 20.00th=[  734],
     | 30.00th=[  783], 40.00th=[  840], 50.00th=[  906], 60.00th=[ 1037],
     | 70.00th=[ 1336], 80.00th=[ 1860], 90.00th=[ 3458], 95.00th=[ 4228],
     | 99.00th=[ 9503], 99.50th=[13566], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  472, max= 1232, per=24.61%, avg=858.67, stdev=380.18, samples=3
   iops        : min=  118, max=  308, avg=214.67, stdev=95.04, samples=3
  write: IOPS=235, BW=942KiB/s (965kB/s)(1564KiB/1660msec)
    clat (usec): min=1103, max=35855, avg=2670.66, stdev=2394.26
     lat (usec): min=1103, max=35858, avg=2671.46, stdev=2394.37
    clat percentiles (usec):
     |  1.00th=[ 1188],  5.00th=[ 1319], 10.00th=[ 1450], 20.00th=[ 1696],
     | 30.00th=[ 1778], 40.00th=[ 1909], 50.00th=[ 1991], 60.00th=[ 2147],
     | 70.00th=[ 2474], 80.00th=[ 3163], 90.00th=[ 4555], 95.00th=[ 5604],
     | 99.00th=[12911], 99.50th=[15926], 99.90th=[35914], 99.95th=[35914],
     | 99.99th=[35914]
   bw (  KiB/s): min=  512, max= 1376, per=24.26%, avg=890.67, stdev=441.77, samples=3
   iops        : min=  128, max=  344, avg=222.67, stdev=110.44, samples=3
  lat (usec)   : 750=11.59%, 1000=16.54%
  lat (msec)   : 2=37.76%, 4=24.09%, 10=8.85%, 20=0.91%, 50=0.26%
  cpu          : usr=0.24%, sys=6.09%, ctx=814, majf=0, minf=30
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3490KiB/s (3573kB/s), 853KiB/s-946KiB/s (874kB/s-969kB/s), io=5988KiB (6132kB), run=1653-1716msec
  WRITE: bw=3671KiB/s (3759kB/s), 912KiB/s-972KiB/s (934kB/s-995kB/s), io=6300KiB (6451kB), run=1653-1716msec