== sanity test 398b: DIO and buffer IO race ============== 09:07:19 (1774530439)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.116569 s, 108 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=121820: Thu Mar 26 09:07:29 2026
  read: IOPS=105, BW=421KiB/s (431kB/s)(1480KiB/3515msec)
    clat (usec): min=6, max=44131, avg=4149.26, stdev=6224.01
     lat (usec): min=6, max=44131, avg=4150.01, stdev=6223.93
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   12], 10.00th=[   15], 20.00th=[   21],
     | 30.00th=[   29], 40.00th=[   43], 50.00th=[ 2180], 60.00th=[ 3687],
     | 70.00th=[ 5342], 80.00th=[ 7177], 90.00th=[10421], 95.00th=[16581],
     | 99.00th=[31327], 99.50th=[38536], 99.90th=[44303], 99.95th=[44303],
     | 99.99th=[44303]
   bw (  KiB/s): min=  344, max=  536, per=25.10%, avg=410.67, stdev=68.25, samples=6
   iops        : min=   86, max=  134, avg=102.50, stdev=17.11, samples=6
  write: IOPS=113, BW=453KiB/s (464kB/s)(1592KiB/3515msec); 0 zone resets
    clat (usec): min=154, max=38171, avg=4924.07, stdev=6446.22
     lat (usec): min=154, max=38173, avg=4924.82, stdev=6446.29
    clat percentiles (usec):
     |  1.00th=[  161],  5.00th=[  215], 10.00th=[  265], 20.00th=[  355],
     | 30.00th=[  529], 40.00th=[ 1303], 50.00th=[ 2442], 60.00th=[ 3556],
     | 70.00th=[ 5145], 80.00th=[ 8356], 90.00th=[14484], 95.00th=[19792],
     | 99.00th=[26870], 99.50th=[32113], 99.90th=[38011], 99.95th=[38011],
     | 99.99th=[38011]
   bw (  KiB/s): min=  351, max=  568, per=26.00%, avg=447.50, stdev=86.76, samples=6
   iops        : min=   87, max=  142, avg=111.67, stdev=21.88, samples=6
  lat (usec)   : 10=1.30%, 20=7.68%, 50=11.20%, 100=2.34%, 250=5.08%
  lat (usec)   : 500=10.68%, 750=3.65%, 1000=1.56%
  lat (msec)   : 2=3.91%, 4=14.45%, 10=24.35%, 20=9.90%, 50=3.91%
  cpu          : usr=0.37%, sys=12.46%, ctx=941, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121821: Thu Mar 26 09:07:29 2026
  read: IOPS=98, BW=392KiB/s (402kB/s)(1436KiB/3660msec)
    clat (usec): min=6, max=43579, avg=4071.00, stdev=6336.21
     lat (usec): min=6, max=43579, avg=4071.65, stdev=6336.21
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   17], 20.00th=[   24],
     | 30.00th=[   34], 40.00th=[   49], 50.00th=[ 1876], 60.00th=[ 4113],
     | 70.00th=[ 5145], 80.00th=[ 7111], 90.00th=[10290], 95.00th=[12780],
     | 99.00th=[34866], 99.50th=[40109], 99.90th=[43779], 99.95th=[43779],
     | 99.99th=[43779]
   bw (  KiB/s): min=  288, max=  600, per=24.06%, avg=393.57, stdev=106.08, samples=7
   iops        : min=   72, max=  150, avg=98.29, stdev=26.60, samples=7
  write: IOPS=111, BW=447KiB/s (458kB/s)(1636KiB/3660msec); 0 zone resets
    clat (usec): min=125, max=42539, avg=5318.65, stdev=6897.47
     lat (usec): min=126, max=42540, avg=5319.51, stdev=6897.52
    clat percentiles (usec):
     |  1.00th=[  153],  5.00th=[  194], 10.00th=[  221], 20.00th=[  293],
     | 30.00th=[  416], 40.00th=[ 1401], 50.00th=[ 2343], 60.00th=[ 3982],
     | 70.00th=[ 5997], 80.00th=[ 9241], 90.00th=[15664], 95.00th=[21103],
     | 99.00th=[26346], 99.50th=[33162], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min=  382, max=  544, per=26.07%, avg=448.71, stdev=52.54, samples=7
   iops        : min=   95, max=  136, avg=112.00, stdev=13.23, samples=7
  lat (usec)   : 10=0.91%, 20=5.60%, 50=12.37%, 100=2.60%, 250=8.20%
  lat (usec)   : 500=11.07%, 750=1.30%, 1000=1.04%
  lat (msec)   : 2=4.30%, 4=12.37%, 10=25.13%, 20=10.55%, 50=4.56%
  cpu          : usr=0.27%, sys=11.62%, ctx=1011, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121822: Thu Mar 26 09:07:29 2026
  read: IOPS=112, BW=452KiB/s (463kB/s)(1564KiB/3461msec)
    clat (usec): min=4, max=62917, avg=3660.14, stdev=6246.51
     lat (usec): min=4, max=62918, avg=3661.10, stdev=6246.38
    clat percentiles (usec):
     |  1.00th=[    7],  5.00th=[   12], 10.00th=[   16], 20.00th=[   24],
     | 30.00th=[   31], 40.00th=[   40], 50.00th=[ 1647], 60.00th=[ 3261],
     | 70.00th=[ 4817], 80.00th=[ 6980], 90.00th=[ 8848], 95.00th=[10683],
     | 99.00th=[25560], 99.50th=[59507], 99.90th=[63177], 99.95th=[63177],
     | 99.99th=[63177]
   bw (  KiB/s): min=  336, max=  504, per=26.13%, avg=427.50, stdev=66.69, samples=6
   iops        : min=   84, max=  126, avg=106.67, stdev=16.82, samples=6
  write: IOPS=108, BW=436KiB/s (446kB/s)(1508KiB/3461msec); 0 zone resets
    clat (usec): min=136, max=42026, avg=5296.66, stdev=6889.29
     lat (usec): min=137, max=42027, avg=5297.49, stdev=6889.33
    clat percentiles (usec):
     |  1.00th=[  151],  5.00th=[  190], 10.00th=[  239], 20.00th=[  310],
     | 30.00th=[  433], 40.00th=[ 1221], 50.00th=[ 2900], 60.00th=[ 4293],
     | 70.00th=[ 5866], 80.00th=[ 8717], 90.00th=[16057], 95.00th=[20841],
     | 99.00th=[28705], 99.50th=[38011], 99.90th=[42206], 99.95th=[42206],
     | 99.99th=[42206]
   bw (  KiB/s): min=  327, max=  547, per=24.58%, avg=423.00, stdev=88.89, samples=6
   iops        : min=   81, max=  136, avg=105.50, stdev=22.18, samples=6
  lat (usec)   : 10=1.43%, 20=5.99%, 50=14.97%, 100=0.65%, 250=6.38%
  lat (usec)   : 500=11.98%, 750=1.69%, 1000=0.78%
  lat (msec)   : 2=4.43%, 4=13.54%, 10=25.13%, 20=9.64%, 50=3.12%
  lat (msec)   : 100=0.26%
  cpu          : usr=0.32%, sys=11.59%, ctx=942, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121823: Thu Mar 26 09:07:29 2026
  read: IOPS=244, BW=977KiB/s (1001kB/s)(1508KiB/1543msec)
    clat (usec): min=4, max=39599, avg=1498.02, stdev=4381.63
     lat (usec): min=4, max=39602, avg=1498.48, stdev=4381.74
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[    9], 10.00th=[   11], 20.00th=[   13],
     | 30.00th=[   16], 40.00th=[   18], 50.00th=[   21], 60.00th=[   26],
     | 70.00th=[   30], 80.00th=[   53], 90.00th=[ 5669], 95.00th=[ 9503],
     | 99.00th=[23725], 99.50th=[29230], 99.90th=[39584], 99.95th=[39584],
     | 99.99th=[39584]
   bw (  KiB/s): min=  400, max= 1924, per=71.03%, avg=1162.00, stdev=1077.63, samples=2
   iops        : min=  100, max=  481, avg=290.50, stdev=269.41, samples=2
  write: IOPS=253, BW=1014KiB/s (1038kB/s)(1564KiB/1543msec); 0 zone resets
    clat (usec): min=112, max=43347, avg=2455.16, stdev=5269.46
     lat (usec): min=113, max=43348, avg=2455.66, stdev=5269.57
    clat percentiles (usec):
     |  1.00th=[  116],  5.00th=[  135], 10.00th=[  153], 20.00th=[  186],
     | 30.00th=[  210], 40.00th=[  258], 50.00th=[  326], 60.00th=[  445],
     | 70.00th=[  594], 80.00th=[ 3261], 90.00th=[ 9110], 95.00th=[11994],
     | 99.00th=[25822], 99.50th=[33424], 99.90th=[43254], 99.95th=[43254],
     | 99.99th=[43254]
   bw (  KiB/s): min=  376, max= 2075, per=71.21%, avg=1225.50, stdev=1201.37, samples=2
   iops        : min=   94, max=  518, avg=306.00, stdev=299.81, samples=2
  lat (usec)   : 10=3.78%, 20=19.40%, 50=15.76%, 100=1.17%, 250=20.83%
  lat (usec)   : 500=12.37%, 750=5.60%, 1000=0.65%
  lat (msec)   : 2=1.43%, 4=3.12%, 10=9.51%, 20=4.69%, 50=1.69%
  cpu          : usr=0.19%, sys=12.26%, ctx=335, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1636KiB/s (1675kB/s), 392KiB/s-977KiB/s (402kB/s-1001kB/s), io=5988KiB (6132kB), run=1543-3660msec
  WRITE: bw=1721KiB/s (1763kB/s), 436KiB/s-1014KiB/s (446kB/s-1038kB/s), io=6300KiB (6451kB), run=1543-3660msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=121825: Thu Mar 26 09:07:38 2026
  read: IOPS=31, BW=126KiB/s (129kB/s)(1480KiB/11782msec)
    clat (usec): min=1134, max=60217, avg=4398.03, stdev=6066.65
     lat (usec): min=1135, max=60219, avg=4399.00, stdev=6066.70
    clat percentiles (usec):
     |  1.00th=[ 1254],  5.00th=[ 1516], 10.00th=[ 1647], 20.00th=[ 1876],
     | 30.00th=[ 2147], 40.00th=[ 2343], 50.00th=[ 2671], 60.00th=[ 2966],
     | 70.00th=[ 3621], 80.00th=[ 4621], 90.00th=[ 8225], 95.00th=[12256],
     | 99.00th=[37487], 99.50th=[49021], 99.90th=[60031], 99.95th=[60031],
     | 99.99th=[60031]
   bw (  KiB/s): min=   56, max=  208, per=24.70%, avg=124.00, stdev=40.15, samples=23
   iops        : min=   14, max=   52, avg=30.74, stdev=10.17, samples=23
  write: IOPS=33, BW=135KiB/s (138kB/s)(1592KiB/11782msec); 0 zone resets
    clat (msec): min=11, max=109, avg=25.46, stdev= 9.97
     lat (msec): min=11, max=109, avg=25.46, stdev= 9.97
    clat percentiles (msec):
     |  1.00th=[   13],  5.00th=[   15], 10.00th=[   16], 20.00th=[   18],
     | 30.00th=[   21], 40.00th=[   22], 50.00th=[   24], 60.00th=[   26],
     | 70.00th=[   28], 80.00th=[   32], 90.00th=[   37], 95.00th=[   43],
     | 99.00th=[   67], 99.50th=[   70], 99.90th=[  110], 99.95th=[  110],
     | 99.99th=[  110]
   bw (  KiB/s): min=   45, max=  192, per=25.47%, avg=134.48, stdev=35.34, samples=23
   iops        : min=   11, max=   48, avg=33.39, stdev= 8.89, samples=23
  lat (msec)   : 2=11.59%, 4=24.09%, 10=8.72%, 20=17.97%, 50=36.20%
  lat (msec)   : 100=1.30%, 250=0.13%
  cpu          : usr=0.25%, sys=1.72%, ctx=823, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121826: Thu Mar 26 09:07:38 2026
  read: IOPS=30, BW=120KiB/s (123kB/s)(1436KiB/11921msec)
    clat (usec): min=1041, max=51402, avg=4440.50, stdev=5856.63
     lat (usec): min=1041, max=51404, avg=4441.42, stdev=5856.64
    clat percentiles (usec):
     |  1.00th=[ 1303],  5.00th=[ 1467], 10.00th=[ 1614], 20.00th=[ 1876],
     | 30.00th=[ 2114], 40.00th=[ 2376], 50.00th=[ 2606], 60.00th=[ 3032],
     | 70.00th=[ 3687], 80.00th=[ 4817], 90.00th=[ 8225], 95.00th=[12649],
     | 99.00th=[32900], 99.50th=[49546], 99.90th=[51643], 99.95th=[51643],
     | 99.99th=[51643]
   bw (  KiB/s): min=   22, max=  240, per=23.83%, avg=119.61, stdev=44.20, samples=23
   iops        : min=    5, max=   60, avg=29.65, stdev=11.15, samples=23
  write: IOPS=34, BW=137KiB/s (141kB/s)(1636KiB/11921msec); 0 zone resets
    clat (usec): min=10929, max=74503, avg=25191.16, stdev=9360.42
     lat (usec): min=10931, max=74503, avg=25192.36, stdev=9360.41
    clat percentiles (usec):
     |  1.00th=[12387],  5.00th=[13566], 10.00th=[14615], 20.00th=[17695],
     | 30.00th=[19792], 40.00th=[21890], 50.00th=[23725], 60.00th=[25297],
     | 70.00th=[27919], 80.00th=[31327], 90.00th=[35914], 95.00th=[42206],
     | 99.00th=[54264], 99.50th=[67634], 99.90th=[74974], 99.95th=[74974],
     | 99.99th=[74974]
   bw (  KiB/s): min=   79, max=  184, per=25.51%, avg=134.70, stdev=32.29, samples=23
   iops        : min=   19, max=   46, avg=33.43, stdev= 8.16, samples=23
  lat (msec)   : 2=11.46%, 4=22.66%, 10=8.98%, 20=18.62%, 50=36.85%
  lat (msec)   : 100=1.43%
  cpu          : usr=0.21%, sys=1.69%, ctx=833, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121827: Thu Mar 26 09:07:38 2026
  read: IOPS=34, BW=140KiB/s (143kB/s)(1564KiB/11186msec)
    clat (usec): min=1110, max=50387, avg=4140.95, stdev=4727.65
     lat (usec): min=1110, max=50388, avg=4141.90, stdev=4727.60
    clat percentiles (usec):
     |  1.00th=[ 1188],  5.00th=[ 1418], 10.00th=[ 1631], 20.00th=[ 1876],
     | 30.00th=[ 2114], 40.00th=[ 2376], 50.00th=[ 2671], 60.00th=[ 3064],
     | 70.00th=[ 3621], 80.00th=[ 4686], 90.00th=[ 8160], 95.00th=[12256],
     | 99.00th=[27919], 99.50th=[32637], 99.90th=[50594], 99.95th=[50594],
     | 99.99th=[50594]
   bw (  KiB/s): min=   48, max=  336, per=28.12%, avg=141.18, stdev=64.55, samples=22
   iops        : min=   12, max=   84, avg=35.05, stdev=16.20, samples=22
  write: IOPS=33, BW=135KiB/s (138kB/s)(1508KiB/11186msec); 0 zone resets
    clat (usec): min=11928, max=71765, avg=25329.38, stdev=9402.43
     lat (usec): min=11929, max=71766, avg=25330.69, stdev=9402.40
    clat percentiles (usec):
     |  1.00th=[13042],  5.00th=[14353], 10.00th=[15926], 20.00th=[18482],
     | 30.00th=[20055], 40.00th=[21365], 50.00th=[23200], 60.00th=[25035],
     | 70.00th=[27395], 80.00th=[31065], 90.00th=[36963], 95.00th=[45351],
     | 99.00th=[58983], 99.50th=[67634], 99.90th=[71828], 99.95th=[71828],
     | 99.99th=[71828]
   bw (  KiB/s): min=   83, max=  184, per=25.37%, avg=133.95, stdev=31.03, samples=22
   iops        : min=   20, max=   46, avg=33.23, stdev= 7.86, samples=22
  lat (msec)   : 2=12.63%, 4=24.87%, 10=9.51%, 20=17.84%, 50=33.59%
  lat (msec)   : 100=1.56%
  cpu          : usr=0.20%, sys=1.78%, ctx=807, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121828: Thu Mar 26 09:07:38 2026
  read: IOPS=32, BW=129KiB/s (132kB/s)(1508KiB/11670msec)
    clat (usec): min=1160, max=56099, avg=4518.24, stdev=5494.98
     lat (usec): min=1160, max=56100, avg=4519.23, stdev=5494.92
    clat percentiles (usec):
     |  1.00th=[ 1270],  5.00th=[ 1467], 10.00th=[ 1614], 20.00th=[ 1827],
     | 30.00th=[ 2089], 40.00th=[ 2343], 50.00th=[ 2573], 60.00th=[ 2900],
     | 70.00th=[ 3720], 80.00th=[ 5014], 90.00th=[10290], 95.00th=[15270],
     | 99.00th=[28181], 99.50th=[31327], 99.90th=[56361], 99.95th=[56361],
     | 99.99th=[56361]
   bw (  KiB/s): min=   64, max=  224, per=25.53%, avg=128.17, stdev=45.02, samples=23
   iops        : min=   16, max=   56, avg=31.83, stdev=11.31, samples=23
  write: IOPS=33, BW=134KiB/s (137kB/s)(1564KiB/11670msec); 0 zone resets
    clat (usec): min=10618, max=78645, avg=25450.92, stdev=9195.78
     lat (usec): min=10619, max=78646, avg=25452.15, stdev=9195.85
    clat percentiles (usec):
     |  1.00th=[12387],  5.00th=[14091], 10.00th=[15008], 20.00th=[17957],
     | 30.00th=[19792], 40.00th=[22414], 50.00th=[23987], 60.00th=[25822],
     | 70.00th=[28443], 80.00th=[31851], 90.00th=[36439], 95.00th=[42206],
     | 99.00th=[56361], 99.50th=[66323], 99.90th=[79168], 99.95th=[79168],
     | 99.99th=[79168]
   bw (  KiB/s): min=   83, max=  192, per=25.33%, avg=133.74, stdev=32.85, samples=23
   iops        : min=   20, max=   48, avg=33.17, stdev= 8.32, samples=23
  lat (msec)   : 2=13.28%, 4=22.01%, 10=8.72%, 20=19.40%, 50=35.55%
  lat (msec)   : 100=1.04%
  cpu          : usr=0.21%, sys=1.70%, ctx=823, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=502KiB/s (514kB/s), 120KiB/s-140KiB/s (123kB/s-143kB/s), io=5988KiB (6132kB), run=11186-11921msec
  WRITE: bw=528KiB/s (541kB/s), 134KiB/s-137KiB/s (137kB/s-141kB/s), io=6300KiB (6451kB), run=11186-11921msec