== sanity test 398b: DIO and buffer IO race ============== 09:59:34 (1747403974)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0587427 s, 214 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=23436: Fri May 16 09:59:37 2025
   read: IOPS=212, BW=848KiB/s (868kB/s)(1480KiB/1745msec)
    clat (usec): min=3, max=41112, avg=1473.51, stdev=3197.87
     lat (usec): min=4, max=41113, avg=1474.11, stdev=3197.88
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    8], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   21], 50.00th=[   33], 60.00th=[ 1254],
     | 70.00th=[ 1762], 80.00th=[ 2212], 90.00th=[ 3163], 95.00th=[ 5014],
     | 99.00th=[15270], 99.50th=[20841], 99.90th=[41157], 99.95th=[41157],
     | 99.99th=[41157]
   bw (  KiB/s): min=  688, max=  902, per=22.20%, avg=759.33, stdev=123.55, samples=3
   iops        : min=  172, max=  225, avg=189.67, stdev=30.60, samples=3
  write: IOPS=228, BW=912KiB/s (934kB/s)(1592KiB/1745msec)
    clat (usec): min=90, max=24088, avg=2983.48, stdev=4117.23
     lat (usec): min=91, max=24089, avg=2984.22, stdev=4117.27
    clat percentiles (usec):
     |  1.00th=[   97],  5.00th=[  113], 10.00th=[  126], 20.00th=[  167],
     | 30.00th=[  229], 40.00th=[  947], 50.00th=[ 1303], 60.00th=[ 1893],
     | 70.00th=[ 2737], 80.00th=[ 5604], 90.00th=[ 8586], 95.00th=[10945],
     | 99.00th=[19530], 99.50th=[22938], 99.90th=[23987], 99.95th=[23987],
     | 99.99th=[23987]
   bw (  KiB/s): min=  696, max= 1021, per=22.79%, avg=820.33, stdev=175.43, samples=3
   iops        : min=  174, max=  255, avg=205.00, stdev=43.71, samples=3
  lat (usec)   : 4=0.26%, 10=8.85%, 20=9.77%, 50=5.60%, 100=1.69%
  lat (usec)   : 250=15.62%, 500=1.69%, 750=1.17%, 1000=4.17%
  lat (msec)   : 2=19.01%, 4=16.28%, 10=11.46%, 20=3.78%, 50=0.65%
  cpu          : usr=0.40%, sys=8.89%, ctx=937, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23437: Fri May 16 09:59:37 2025
   read: IOPS=205, BW=821KiB/s (840kB/s)(1436KiB/1750msec)
    clat (usec): min=3, max=26618, avg=1598.16, stdev=3529.59
     lat (usec): min=3, max=26619, avg=1599.16, stdev=3529.68
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   12], 40.00th=[   18], 50.00th=[   38], 60.00th=[ 1106],
     | 70.00th=[ 1926], 80.00th=[ 2540], 90.00th=[ 3130], 95.00th=[ 4228],
     | 99.00th=[21627], 99.50th=[25560], 99.90th=[26608], 99.95th=[26608],
     | 99.99th=[26608]
   bw (  KiB/s): min=  640, max=  990, per=22.66%, avg=775.33, stdev=188.00, samples=3
   iops        : min=  160, max=  247, avg=193.67, stdev=46.72, samples=3
  write: IOPS=233, BW=935KiB/s (957kB/s)(1636KiB/1750msec)
    clat (usec): min=86, max=28285, avg=2841.12, stdev=3899.20
     lat (usec): min=86, max=28286, avg=2842.62, stdev=3898.72
    clat percentiles (usec):
     |  1.00th=[   91],  5.00th=[  105], 10.00th=[  119], 20.00th=[  163],
     | 30.00th=[  237], 40.00th=[  865], 50.00th=[ 1418], 60.00th=[ 2057],
     | 70.00th=[ 2769], 80.00th=[ 4752], 90.00th=[ 8160], 95.00th=[11469],
     | 99.00th=[15926], 99.50th=[18220], 99.90th=[28181], 99.95th=[28181],
     | 99.99th=[28181]
   bw (  KiB/s): min=  688, max=  928, per=23.39%, avg=842.00, stdev=133.67, samples=3
   iops        : min=  172, max=  232, avg=210.33, stdev=33.29, samples=3
  lat (usec)   : 4=0.91%, 10=10.42%, 20=8.59%, 50=3.78%, 100=2.47%
  lat (usec)   : 250=15.49%, 500=2.47%, 750=1.69%, 1000=3.65%
  lat (msec)   : 2=15.49%, 4=20.44%, 10=9.64%, 20=4.04%, 50=0.91%
  cpu          : usr=0.40%, sys=11.09%, ctx=993, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23438: Fri May 16 09:59:37 2025
   read: IOPS=228, BW=916KiB/s (938kB/s)(1564KiB/1708msec)
    clat (usec): min=3, max=24620, avg=1384.12, stdev=2566.05
     lat (usec): min=3, max=24620, avg=1385.27, stdev=2567.46
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   19], 50.00th=[   53], 60.00th=[ 1385],
     | 70.00th=[ 1876], 80.00th=[ 2376], 90.00th=[ 3032], 95.00th=[ 3720],
     | 99.00th=[15139], 99.50th=[21365], 99.90th=[24511], 99.95th=[24511],
     | 99.99th=[24511]
   bw (  KiB/s): min=  632, max= 1077, per=24.76%, avg=847.00, stdev=222.88, samples=3
   iops        : min=  158, max=  269, avg=211.67, stdev=55.59, samples=3
  write: IOPS=220, BW=883KiB/s (904kB/s)(1508KiB/1708msec)
    clat (usec): min=91, max=28756, avg=3068.86, stdev=4462.11
     lat (usec): min=91, max=28757, avg=3069.53, stdev=4462.11
    clat percentiles (usec):
     |  1.00th=[   99],  5.00th=[  111], 10.00th=[  119], 20.00th=[  143],
     | 30.00th=[  217], 40.00th=[  824], 50.00th=[ 1303], 60.00th=[ 1827],
     | 70.00th=[ 2737], 80.00th=[ 4948], 90.00th=[ 9634], 95.00th=[13304],
     | 99.00th=[20579], 99.50th=[28181], 99.90th=[28705], 99.95th=[28705],
     | 99.99th=[28705]
   bw (  KiB/s): min=  712, max= 1077, per=23.53%, avg=847.00, stdev=200.19, samples=3
   iops        : min=  178, max=  269, avg=211.67, stdev=49.90, samples=3
  lat (usec)   : 4=0.78%, 10=10.03%, 20=10.29%, 50=4.30%, 100=1.17%
  lat (usec)   : 250=14.97%, 500=2.08%, 750=1.30%, 1000=4.43%
  lat (msec)   : 2=18.10%, 4=18.36%, 10=8.72%, 20=4.69%, 50=0.78%
  cpu          : usr=0.12%, sys=9.72%, ctx=963, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23439: Fri May 16 09:59:37 2025
   read: IOPS=230, BW=921KiB/s (943kB/s)(1508KiB/1638msec)
    clat (usec): min=3, max=38285, avg=1383.30, stdev=3224.85
     lat (usec): min=3, max=38286, avg=1384.03, stdev=3224.82
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   17], 50.00th=[   48], 60.00th=[ 1188],
     | 70.00th=[ 1762], 80.00th=[ 2180], 90.00th=[ 2900], 95.00th=[ 3851],
     | 99.00th=[16909], 99.50th=[24249], 99.90th=[38536], 99.95th=[38536],
     | 99.99th=[38536]
   bw (  KiB/s): min=  752, max=  982, per=25.39%, avg=868.67, stdev=115.04, samples=3
   iops        : min=  188, max=  245, avg=217.00, stdev=28.51, samples=3
  write: IOPS=238, BW=955KiB/s (978kB/s)(1564KiB/1638msec)
    clat (usec): min=88, max=23746, avg=2828.03, stdev=3970.08
     lat (usec): min=89, max=23747, avg=2829.04, stdev=3970.43
    clat percentiles (usec):
     |  1.00th=[   93],  5.00th=[  111], 10.00th=[  121], 20.00th=[  147],
     | 30.00th=[  190], 40.00th=[  742], 50.00th=[ 1123], 60.00th=[ 1860],
     | 70.00th=[ 2737], 80.00th=[ 5080], 90.00th=[ 8848], 95.00th=[11338],
     | 99.00th=[17171], 99.50th=[20055], 99.90th=[23725], 99.95th=[23725],
     | 99.99th=[23725]
   bw (  KiB/s): min=  792, max= 1101, per=25.16%, avg=905.67, stdev=169.92, samples=3
   iops        : min=  198, max=  275, avg=226.33, stdev=42.34, samples=3
  lat (usec)   : 4=0.52%, 10=11.98%, 20=8.46%, 50=4.04%, 100=1.82%
  lat (usec)   : 250=16.67%, 500=1.95%, 750=2.08%, 1000=4.17%
  lat (msec)   : 2=18.36%, 4=15.76%, 10=9.11%, 20=4.43%, 50=0.65%
  cpu          : usr=0.31%, sys=10.20%, ctx=953, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3422KiB/s (3504kB/s), 821KiB/s-921KiB/s (840kB/s-943kB/s), io=5988KiB (6132kB), run=1638-1750msec
  WRITE: bw=3600KiB/s (3686kB/s), 883KiB/s-955KiB/s (904kB/s-978kB/s), io=6300KiB (6451kB), run=1638-1750msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=23440: Fri May 16 09:59:42 2025
   read: IOPS=59, BW=237KiB/s (243kB/s)(1480KiB/6232msec)
    clat (usec): min=655, max=38975, avg=2235.33, stdev=4023.45
     lat (usec): min=656, max=38975, avg=2236.14, stdev=4023.42
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  758], 10.00th=[  807], 20.00th=[  865],
     | 30.00th=[  914], 40.00th=[  996], 50.00th=[ 1139], 60.00th=[ 1254],
     | 70.00th=[ 1401], 80.00th=[ 1663], 90.00th=[ 3425], 95.00th=[ 9241],
     | 99.00th=[22676], 99.50th=[28967], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min=  136, max=  360, per=24.33%, avg=232.58, stdev=64.60, samples=12
   iops        : min=   34, max=   90, avg=58.08, stdev=16.09, samples=12
  write: IOPS=63, BW=255KiB/s (262kB/s)(1592KiB/6232msec)
    clat (usec): min=6578, max=42711, avg=13561.12, stdev=5172.32
     lat (usec): min=6579, max=42712, avg=13562.17, stdev=5172.24
    clat percentiles (usec):
     |  1.00th=[ 6652],  5.00th=[ 7439], 10.00th=[ 7963], 20.00th=[ 8979],
     | 30.00th=[10290], 40.00th=[11731], 50.00th=[13042], 60.00th=[14353],
     | 70.00th=[15401], 80.00th=[16581], 90.00th=[19268], 95.00th=[22152],
     | 99.00th=[33162], 99.50th=[40109], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min=  176, max=  336, per=25.17%, avg=253.25, stdev=53.03, samples=12
   iops        : min=   44, max=   84, avg=63.25, stdev=13.21, samples=12
  lat (usec)   : 750=1.95%, 1000=17.45%
  lat (msec)   : 2=20.83%, 4=3.65%, 10=16.67%, 20=34.51%, 50=4.95%
  cpu          : usr=0.19%, sys=1.81%, ctx=826, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23441: Fri May 16 09:59:42 2025
   read: IOPS=57, BW=229KiB/s (235kB/s)(1436KiB/6260msec)
    clat (usec): min=666, max=27769, avg=1690.23, stdev=2388.07
     lat (usec): min=666, max=27770, avg=1690.98, stdev=2388.06
    clat percentiles (usec):
     |  1.00th=[  709],  5.00th=[  766], 10.00th=[  807], 20.00th=[  881],
     | 30.00th=[  930], 40.00th=[  988], 50.00th=[ 1106], 60.00th=[ 1254],
     | 70.00th=[ 1434], 80.00th=[ 1663], 90.00th=[ 2442], 95.00th=[ 4490],
     | 99.00th=[14877], 99.50th=[19006], 99.90th=[27657], 99.95th=[27657],
     | 99.99th=[27657]
   bw (  KiB/s): min=  104, max=  376, per=24.06%, avg=230.00, stdev=71.97, samples=12
   iops        : min=   26, max=   94, avg=57.50, stdev=17.99, samples=12
  write: IOPS=65, BW=261KiB/s (268kB/s)(1636KiB/6260msec)
    clat (usec): min=6890, max=64611, avg=13799.22, stdev=5464.38
     lat (usec): min=6891, max=64612, avg=13800.15, stdev=5464.35
    clat percentiles (usec):
     |  1.00th=[ 7046],  5.00th=[ 7767], 10.00th=[ 8225], 20.00th=[ 9503],
     | 30.00th=[10945], 40.00th=[12256], 50.00th=[13304], 60.00th=[14222],
     | 70.00th=[15270], 80.00th=[16581], 90.00th=[18744], 95.00th=[21627],
     | 99.00th=[33817], 99.50th=[36439], 99.90th=[64750], 99.95th=[64750],
     | 99.99th=[64750]
   bw (  KiB/s): min=  160, max=  320, per=25.71%, avg=258.67, stdev=45.68, samples=12
   iops        : min=   40, max=   80, avg=64.67, stdev=11.42, samples=12
  lat (usec)   : 750=1.82%, 1000=18.10%
  lat (msec)   : 2=20.31%, 4=4.17%, 10=13.93%, 20=38.15%, 50=3.39%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.10%, sys=1.93%, ctx=812, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23442: Fri May 16 09:59:42 2025
   read: IOPS=64, BW=257KiB/s (263kB/s)(1564KiB/6087msec)
    clat (usec): min=560, max=22821, avg=1950.02, stdev=2993.16
     lat (usec): min=560, max=22821, avg=1950.79, stdev=2993.16
    clat percentiles (usec):
     |  1.00th=[  660],  5.00th=[  758], 10.00th=[  816], 20.00th=[  881],
     | 30.00th=[  947], 40.00th=[ 1020], 50.00th=[ 1123], 60.00th=[ 1237],
     | 70.00th=[ 1369], 80.00th=[ 1680], 90.00th=[ 2671], 95.00th=[ 7570],
     | 99.00th=[17433], 99.50th=[22152], 99.90th=[22938], 99.95th=[22938],
     | 99.99th=[22938]
   bw (  KiB/s): min=  112, max=  408, per=27.20%, avg=260.00, stdev=93.58, samples=12
   iops        : min=   28, max=  102, avg=65.00, stdev=23.39, samples=12
  write: IOPS=61, BW=248KiB/s (254kB/s)(1508KiB/6087msec)
    clat (usec): min=6957, max=65712, avg=14101.83, stdev=5615.57
     lat (usec): min=6958, max=65714, avg=14102.81, stdev=5615.58
    clat percentiles (usec):
     |  1.00th=[ 7308],  5.00th=[ 7832], 10.00th=[ 8455], 20.00th=[ 9634],
     | 30.00th=[11207], 40.00th=[12387], 50.00th=[13698], 60.00th=[14484],
     | 70.00th=[15533], 80.00th=[16712], 90.00th=[19792], 95.00th=[23200],
     | 99.00th=[34341], 99.50th=[36439], 99.90th=[65799], 99.95th=[65799],
     | 99.99th=[65799]
   bw (  KiB/s): min=  144, max=  320, per=24.59%, avg=247.33, stdev=54.09, samples=12
   iops        : min=   36, max=   80, avg=61.83, stdev=13.52, samples=12
  lat (usec)   : 750=1.95%, 1000=17.45%
  lat (msec)   : 2=23.57%, 4=4.69%, 10=12.63%, 20=34.90%, 50=4.69%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.13%, sys=1.92%, ctx=815, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23443: Fri May 16 09:59:42 2025
   read: IOPS=61, BW=244KiB/s (250kB/s)(1508KiB/6170msec)
    clat (usec): min=600, max=25744, avg=1859.52, stdev=2673.21
     lat (usec): min=601, max=25745, avg=1860.31, stdev=2673.23
    clat percentiles (usec):
     |  1.00th=[  668],  5.00th=[  766], 10.00th=[  807], 20.00th=[  889],
     | 30.00th=[  955], 40.00th=[ 1029], 50.00th=[ 1106], 60.00th=[ 1221],
     | 70.00th=[ 1319], 80.00th=[ 1598], 90.00th=[ 2671], 95.00th=[ 7111],
     | 99.00th=[15270], 99.50th=[22938], 99.90th=[25822], 99.95th=[25822],
     | 99.99th=[25822]
   bw (  KiB/s): min=  112, max=  344, per=25.10%, avg=239.92, stdev=67.03, samples=12
   iops        : min=   28, max=   86, avg=59.92, stdev=16.77, samples=12
  write: IOPS=63, BW=253KiB/s (260kB/s)(1564KiB/6170msec)
    clat (usec): min=6436, max=47774, avg=13966.06, stdev=5825.44
     lat (usec): min=6437, max=47775, avg=13966.97, stdev=5825.44
    clat percentiles (usec):
     |  1.00th=[ 6980],  5.00th=[ 7373], 10.00th=[ 8225], 20.00th=[ 9241],
     | 30.00th=[10683], 40.00th=[12125], 50.00th=[13173], 60.00th=[14222],
     | 70.00th=[15401], 80.00th=[16909], 90.00th=[19530], 95.00th=[23462],
     | 99.00th=[38536], 99.50th=[44303], 99.90th=[47973], 99.95th=[47973],
     | 99.99th=[47973]
   bw (  KiB/s): min=  136, max=  320, per=24.91%, avg=250.58, stdev=55.88, samples=12
   iops        : min=   34, max=   80, avg=62.58, stdev=13.98, samples=12
  lat (usec)   : 750=1.69%, 1000=16.80%
  lat (msec)   : 2=23.83%, 4=2.60%, 10=15.62%, 20=34.51%, 50=4.95%
  cpu          : usr=0.19%, sys=1.91%, ctx=827, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=957KiB/s (980kB/s), 229KiB/s-257KiB/s (235kB/s-263kB/s), io=5988KiB (6132kB), run=6087-6260msec
  WRITE: bw=1006KiB/s (1031kB/s), 248KiB/s-261KiB/s (254kB/s-268kB/s), io=6300KiB (6451kB), run=6087-6260msec