== sanity test 398b: DIO and buffer IO race ============== 19:51:32 (1736988692)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0717506 s, 175 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=22766: Wed Jan 15 19:51:35 2025
   read: IOPS=200, BW=800KiB/s (820kB/s)(1480KiB/1849msec)
    clat (usec): min=3, max=23752, avg=1211.48, stdev=2225.93
     lat (usec): min=3, max=23753, avg=1212.36, stdev=2225.80
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   20], 50.00th=[   36], 60.00th=[ 1074],
     | 70.00th=[ 1713], 80.00th=[ 2114], 90.00th=[ 2802], 95.00th=[ 3916],
     | 99.00th=[12125], 99.50th=[13566], 99.90th=[23725], 99.95th=[23725],
     | 99.99th=[23725]
   bw (  KiB/s): min=  704, max=  872, per=23.70%, avg=767.33, stdev=91.31, samples=3
   iops        : min=  176, max=  218, avg=191.67, stdev=22.94, samples=3
  write: IOPS=215, BW=861KiB/s (882kB/s)(1592KiB/1849msec)
    clat (usec): min=89, max=26636, avg=3485.54, stdev=4870.93
     lat (usec): min=89, max=26636, avg=3486.40, stdev=4870.84
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  111], 10.00th=[  135], 20.00th=[  178],
     | 30.00th=[  241], 40.00th=[  840], 50.00th=[ 1139], 60.00th=[ 1860],
     | 70.00th=[ 3490], 80.00th=[ 7046], 90.00th=[10159], 95.00th=[14222],
     | 99.00th=[21103], 99.50th=[26084], 99.90th=[26608], 99.95th=[26608],
     | 99.99th=[26608]
   bw (  KiB/s): min=  728, max=  888, per=24.40%, avg=831.33, stdev=89.63, samples=3
   iops        : min=  182, max=  222, avg=207.67, stdev=22.28, samples=3
  lat (usec)   : 4=0.39%, 10=8.85%, 20=10.55%, 50=4.95%, 100=1.82%
  lat (usec)   : 250=15.36%, 500=2.86%, 750=1.69%, 1000=5.73%
  lat (msec)   : 2=16.54%, 4=14.19%, 10=10.94%, 20=5.47%, 50=0.65%
  cpu          : usr=0.43%, sys=9.09%, ctx=977, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=22767: Wed Jan 15 19:51:35 2025
   read: IOPS=197, BW=788KiB/s (807kB/s)(1436KiB/1822msec)
    clat (usec): min=3, max=23760, avg=1163.83, stdev=2466.70
     lat (usec): min=4, max=23760, avg=1164.55, stdev=2466.74
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   17], 50.00th=[   31], 60.00th=[ 1074],
     | 70.00th=[ 1582], 80.00th=[ 2024], 90.00th=[ 2606], 95.00th=[ 3130],
     | 99.00th=[10552], 99.50th=[22938], 99.90th=[23725], 99.95th=[23725],
     | 99.99th=[23725]
   bw (  KiB/s): min=  632, max=  904, per=24.29%, avg=786.67, stdev=139.79, samples=3
   iops        : min=  158, max=  226, avg=196.67, stdev=34.95, samples=3
  write: IOPS=224, BW=898KiB/s (919kB/s)(1636KiB/1822msec)
    clat (usec): min=88, max=33834, avg=3408.46, stdev=5254.62
     lat (usec): min=89, max=33835, avg=3409.66, stdev=5254.53
    clat percentiles (usec):
     |  1.00th=[   98],  5.00th=[  118], 10.00th=[  133], 20.00th=[  172],
     | 30.00th=[  225], 40.00th=[  824], 50.00th=[ 1172], 60.00th=[ 1860],
     | 70.00th=[ 2606], 80.00th=[ 5932], 90.00th=[10683], 95.00th=[14615],
     | 99.00th=[23987], 99.50th=[26346], 99.90th=[33817], 99.95th=[33817],
     | 99.99th=[33817]
   bw (  KiB/s): min=  664, max= 1000, per=25.28%, avg=861.33, stdev=175.51, samples=3
   iops        : min=  166, max=  250, avg=215.33, stdev=43.88, samples=3
  lat (usec)   : 4=0.39%, 10=10.03%, 20=9.90%, 50=3.78%, 100=1.17%
  lat (usec)   : 250=15.89%, 500=2.99%, 750=1.43%, 1000=5.73%
  lat (msec)   : 2=18.62%, 4=15.23%, 10=8.85%, 20=4.43%, 50=1.56%
  cpu          : usr=0.27%, sys=9.94%, ctx=950, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=22768: Wed Jan 15 19:51:35 2025
   read: IOPS=219, BW=879KiB/s (900kB/s)(1564KiB/1779msec)
    clat (usec): min=3, max=24398, avg=1293.45, stdev=2558.19
     lat (usec): min=3, max=24399, avg=1294.15, stdev=2558.25
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   22], 50.00th=[   90], 60.00th=[ 1319],
     | 70.00th=[ 1745], 80.00th=[ 2114], 90.00th=[ 2704], 95.00th=[ 3589],
     | 99.00th=[17433], 99.50th=[21627], 99.90th=[24511], 99.95th=[24511],
     | 99.99th=[24511]
   bw (  KiB/s): min=  760, max=  848, per=25.02%, avg=810.00, stdev=45.21, samples=3
   iops        : min=  190, max=  212, avg=202.33, stdev=11.24, samples=3
  write: IOPS=211, BW=848KiB/s (868kB/s)(1508KiB/1779msec)
    clat (usec): min=86, max=28647, avg=3352.93, stdev=4781.83
     lat (usec): min=86, max=28648, avg=3353.66, stdev=4781.84
    clat percentiles (usec):
     |  1.00th=[   97],  5.00th=[  114], 10.00th=[  126], 20.00th=[  169],
     | 30.00th=[  239], 40.00th=[  816], 50.00th=[ 1221], 60.00th=[ 1975],
     | 70.00th=[ 3261], 80.00th=[ 6259], 90.00th=[10028], 95.00th=[13173],
     | 99.00th=[23462], 99.50th=[28181], 99.90th=[28705], 99.95th=[28705],
     | 99.99th=[28705]
   bw (  KiB/s): min=  766, max=  856, per=23.70%, avg=807.33, stdev=45.45, samples=3
   iops        : min=  191, max=  214, avg=201.67, stdev=11.59, samples=3
  lat (usec)   : 4=0.39%, 10=9.77%, 20=9.37%, 50=5.21%, 100=1.69%
  lat (usec)   : 250=15.23%, 500=1.95%, 750=1.95%, 1000=5.34%
  lat (msec)   : 2=17.84%, 4=16.15%, 10=9.51%, 20=4.56%, 50=1.04%
  cpu          : usr=0.22%, sys=9.51%, ctx=951, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=22770: Wed Jan 15 19:51:35 2025
   read: IOPS=205, BW=820KiB/s (840kB/s)(1508KiB/1838msec)
    clat (usec): min=3, max=19300, avg=983.47, stdev=1787.72
     lat (usec): min=3, max=19300, avg=984.14, stdev=1787.67
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   14], 50.00th=[   24], 60.00th=[  840],
     | 70.00th=[ 1614], 80.00th=[ 2040], 90.00th=[ 2507], 95.00th=[ 3163],
     | 99.00th=[ 7308], 99.50th=[16057], 99.90th=[19268], 99.95th=[19268],
     | 99.99th=[19268]
   bw (  KiB/s): min=  638, max=  904, per=23.04%, avg=746.00, stdev=139.87, samples=3
   iops        : min=  159, max=  226, avg=186.33, stdev=35.16, samples=3
  write: IOPS=212, BW=851KiB/s (871kB/s)(1564KiB/1838msec)
    clat (usec): min=86, max=34077, avg=3719.62, stdev=5107.62
     lat (usec): min=86, max=34077, avg=3720.59, stdev=5107.84
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  113], 10.00th=[  139], 20.00th=[  172],
     | 30.00th=[  262], 40.00th=[  988], 50.00th=[ 1450], 60.00th=[ 2089],
     | 70.00th=[ 3720], 80.00th=[ 7373], 90.00th=[10683], 95.00th=[15139],
     | 99.00th=[21103], 99.50th=[27919], 99.90th=[33817], 99.95th=[33817],
     | 99.99th=[33817]
   bw (  KiB/s): min=  720, max=  872, per=23.70%, avg=807.33, stdev=78.49, samples=3
   iops        : min=  180, max=  218, avg=201.67, stdev=19.55, samples=3
  lat (usec)   : 4=0.65%, 10=11.59%, 20=10.29%, 50=4.95%, 100=1.69%
  lat (usec)   : 250=14.58%, 500=2.34%, 750=1.30%, 1000=3.78%
  lat (msec)   : 2=17.58%, 4=15.49%, 10=9.24%, 20=5.86%, 50=0.65%
  cpu          : usr=0.05%, sys=8.38%, ctx=939, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3239KiB/s (3316kB/s), 788KiB/s-879KiB/s (807kB/s-900kB/s), io=5988KiB (6132kB), run=1779-1849msec
  WRITE: bw=3407KiB/s (3489kB/s), 848KiB/s-898KiB/s (868kB/s-919kB/s), io=6300KiB (6451kB), run=1779-1849msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=22769: Wed Jan 15 19:51:41 2025
   read: IOPS=50, BW=202KiB/s (206kB/s)(1480KiB/7344msec)
    clat (usec): min=678, max=40490, avg=2227.98, stdev=3870.58
     lat (usec): min=679, max=40491, avg=2229.11, stdev=3870.76
    clat percentiles (usec):
     |  1.00th=[  734],  5.00th=[  799], 10.00th=[  840], 20.00th=[  930],
     | 30.00th=[  971], 40.00th=[ 1074], 50.00th=[ 1188], 60.00th=[ 1319],
     | 70.00th=[ 1500], 80.00th=[ 1795], 90.00th=[ 2802], 95.00th=[ 9241],
     | 99.00th=[19006], 99.50th=[32900], 99.90th=[40633], 99.95th=[40633],
     | 99.99th=[40633]
   bw (  KiB/s): min=  112, max=  320, per=25.24%, avg=199.43, stdev=57.90, samples=14
   iops        : min=   28, max=   80, avg=49.86, stdev=14.47, samples=14
  write: IOPS=54, BW=217KiB/s (222kB/s)(1592KiB/7344msec)
    clat (usec): min=7877, max=41498, avg=16358.11, stdev=5318.54
     lat (usec): min=7877, max=41499, avg=16359.15, stdev=5318.53
    clat percentiles (usec):
     |  1.00th=[ 8455],  5.00th=[ 9634], 10.00th=[10290], 20.00th=[11076],
     | 30.00th=[12256], 40.00th=[14353], 50.00th=[16450], 60.00th=[17695],
     | 70.00th=[19006], 80.00th=[20055], 90.00th=[22152], 95.00th=[25822],
     | 99.00th=[33817], 99.50th=[39060], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=  136, max=  264, per=25.96%, avg=216.00, stdev=34.09, samples=14
   iops        : min=   34, max=   66, avg=54.00, stdev= 8.52, samples=14
  lat (usec)   : 750=1.17%, 1000=15.10%
  lat (msec)   : 2=24.09%, 4=3.65%, 10=5.99%, 20=38.15%, 50=11.85%
  cpu          : usr=0.14%, sys=1.68%, ctx=828, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=22771: Wed Jan 15 19:51:41 2025
   read: IOPS=47, BW=190KiB/s (194kB/s)(1436KiB/7572msec)
    clat (usec): min=590, max=32132, avg=2141.89, stdev=3595.71
     lat (usec): min=590, max=32132, avg=2142.80, stdev=3595.68
    clat percentiles (usec):
     |  1.00th=[  717],  5.00th=[  799], 10.00th=[  848], 20.00th=[  914],
     | 30.00th=[ 1004], 40.00th=[ 1090], 50.00th=[ 1188], 60.00th=[ 1287],
     | 70.00th=[ 1450], 80.00th=[ 1795], 90.00th=[ 2606], 95.00th=[ 9765],
     | 99.00th=[22676], 99.50th=[23462], 99.90th=[32113], 99.95th=[32113],
     | 99.99th=[32113]
   bw (  KiB/s): min=   88, max=  280, per=24.01%, avg=189.64, stdev=53.91, samples=14
   iops        : min=   22, max=   70, avg=47.36, stdev=13.53, samples=14
  write: IOPS=54, BW=216KiB/s (221kB/s)(1636KiB/7572msec)
    clat (usec): min=7920, max=63524, avg=16610.78, stdev=5430.54
     lat (usec): min=7921, max=63524, avg=16611.88, stdev=5430.55
    clat percentiles (usec):
     |  1.00th=[ 8356],  5.00th=[ 9765], 10.00th=[10552], 20.00th=[11600],
     | 30.00th=[13173], 40.00th=[15139], 50.00th=[16909], 60.00th=[17957],
     | 70.00th=[19006], 80.00th=[19792], 90.00th=[21890], 95.00th=[25035],
     | 99.00th=[30802], 99.50th=[35390], 99.90th=[63701], 99.95th=[63701],
     | 99.99th=[63701]
   bw (  KiB/s): min=  168, max=  272, per=25.47%, avg=211.93, stdev=32.96, samples=14
   iops        : min=   42, max=   68, avg=52.93, stdev= 8.31, samples=14
  lat (usec)   : 750=0.78%, 1000=13.28%
  lat (msec)   : 2=25.26%, 4=4.04%, 10=4.69%, 20=41.28%, 50=10.55%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.16%, sys=1.61%, ctx=807, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=22772: Wed Jan 15 19:51:41 2025
   read: IOPS=54, BW=219KiB/s (224kB/s)(1564KiB/7147msec)
    clat (usec): min=721, max=28331, avg=2224.69, stdev=3601.98
     lat (usec): min=722, max=28332, avg=2225.61, stdev=3602.12
    clat percentiles (usec):
     |  1.00th=[  734],  5.00th=[  799], 10.00th=[  857], 20.00th=[  922],
     | 30.00th=[  988], 40.00th=[ 1057], 50.00th=[ 1156], 60.00th=[ 1237],
     | 70.00th=[ 1467], 80.00th=[ 1860], 90.00th=[ 3228], 95.00th=[ 9634],
     | 99.00th=[19530], 99.50th=[27919], 99.90th=[28443], 99.95th=[28443],
     | 99.99th=[28443]
   bw (  KiB/s): min=  136, max=  367, per=28.12%, avg=222.14, stdev=68.10, samples=14
   iops        : min=   34, max=   91, avg=55.43, stdev=16.86, samples=14
  write: IOPS=52, BW=211KiB/s (216kB/s)(1508KiB/7147msec)
    clat (usec): min=8123, max=45836, avg=16628.98, stdev=5234.58
     lat (usec): min=8124, max=45837, avg=16630.01, stdev=5234.60
    clat percentiles (usec):
     |  1.00th=[ 8586],  5.00th=[ 9634], 10.00th=[10552], 20.00th=[11600],
     | 30.00th=[13042], 40.00th=[15533], 50.00th=[16909], 60.00th=[18220],
     | 70.00th=[19006], 80.00th=[20055], 90.00th=[21627], 95.00th=[24511],
     | 99.00th=[36963], 99.50th=[41157], 99.90th=[45876], 99.95th=[45876],
     | 99.99th=[45876]
   bw (  KiB/s): min=  168, max=  248, per=25.33%, avg=210.71, stdev=20.75, samples=14
   iops        : min=   42, max=   62, avg=52.57, stdev= 5.21, samples=14
  lat (usec)   : 750=1.17%, 1000=14.97%
  lat (msec)   : 2=25.91%, 4=4.43%, 10=5.99%, 20=37.11%, 50=10.42%
  cpu          : usr=0.22%, sys=1.64%, ctx=819, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=22773: Wed Jan 15 19:51:41 2025
   read: IOPS=51, BW=206KiB/s (211kB/s)(1508KiB/7330msec)
    clat (usec): min=654, max=36373, avg=2009.30, stdev=3349.35
     lat (usec): min=654, max=36373, avg=2010.18, stdev=3349.34
    clat percentiles (usec):
     |  1.00th=[  742],  5.00th=[  824], 10.00th=[  857], 20.00th=[  930],
     | 30.00th=[  979], 40.00th=[ 1045], 50.00th=[ 1139], 60.00th=[ 1270],
     | 70.00th=[ 1434], 80.00th=[ 1745], 90.00th=[ 2835], 95.00th=[ 7832],
     | 99.00th=[17695], 99.50th=[32375], 99.90th=[36439], 99.95th=[36439],
     | 99.99th=[36439]
   bw (  KiB/s): min=  112, max=  296, per=25.73%, avg=203.29, stdev=53.35, samples=14
   iops        : min=   28, max=   74, avg=50.71, stdev=13.44, samples=14
  write: IOPS=53, BW=213KiB/s (218kB/s)(1564KiB/7330msec)
    clat (usec): min=8007, max=48575, avg=16781.51, stdev=5562.54
     lat (usec): min=8008, max=48576, avg=16782.62, stdev=5562.45
    clat percentiles (usec):
     |  1.00th=[ 8717],  5.00th=[ 9765], 10.00th=[10421], 20.00th=[11863],
     | 30.00th=[13173], 40.00th=[15270], 50.00th=[16712], 60.00th=[17957],
     | 70.00th=[19006], 80.00th=[20055], 90.00th=[22152], 95.00th=[25560],
     | 99.00th=[33817], 99.50th=[46400], 99.90th=[48497], 99.95th=[48497],
     | 99.99th=[48497]
   bw (  KiB/s): min=  144, max=  248, per=25.39%, avg=211.29, stdev=27.17, samples=14
   iops        : min=   36, max=   62, avg=52.71, stdev= 6.83, samples=14
  lat (usec)   : 750=0.91%, 1000=16.02%
  lat (msec)   : 2=24.09%, 4=4.69%, 10=4.82%, 20=39.06%, 50=10.42%
  cpu          : usr=0.11%, sys=1.79%, ctx=824, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=791KiB/s (810kB/s), 190KiB/s-219KiB/s (194kB/s-224kB/s), io=5988KiB (6132kB), run=7147-7572msec
  WRITE: bw=832KiB/s (852kB/s), 211KiB/s-217KiB/s (216kB/s-222kB/s), io=6300KiB (6451kB), run=7147-7572msec