== sanity test 398b: DIO and buffer IO race ============== 12:08:03 (1761322083)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.175587 s, 71.7 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=147763: Fri Oct 24 12:08:15 2025
  read: IOPS=63, BW=253KiB/s (259kB/s)(1480KiB/5861msec)
    clat (usec): min=5, max=90721, avg=8740.80, stdev=10861.41
     lat (usec): min=5, max=90722, avg=8741.48, stdev=10861.44
    clat percentiles (usec):
     |  1.00th=[    8],  5.00th=[   12], 10.00th=[   17], 20.00th=[   25],
     | 30.00th=[   31], 40.00th=[ 4113], 50.00th=[ 7570], 60.00th=[10028],
     | 70.00th=[11863], 80.00th=[14746], 90.00th=[19268], 95.00th=[23987],
     | 99.00th=[54264], 99.50th=[77071], 99.90th=[90702], 99.95th=[90702],
     | 99.99th=[90702]
   bw (  KiB/s): min=  163, max=  310, per=23.78%, avg=242.36, stdev=45.12, samples=11
   iops        : min=   40, max=   77, avg=60.09, stdev=11.43, samples=11
  write: IOPS=67, BW=272KiB/s (278kB/s)(1592KiB/5861msec); 0 zone resets
    clat (usec): min=145, max=50153, avg=6535.44, stdev=7654.68
     lat (usec): min=145, max=50153, avg=6536.39, stdev=7654.66
    clat percentiles (usec):
     |  1.00th=[  174],  5.00th=[  206], 10.00th=[  223], 20.00th=[  281],
     | 30.00th=[  355], 40.00th=[ 1221], 50.00th=[ 4228], 60.00th=[ 6259],
     | 70.00th=[ 8455], 80.00th=[12256], 90.00th=[18482], 95.00th=[22152],
     | 99.00th=[30016], 99.50th=[31851], 99.90th=[50070], 99.95th=[50070],
     | 99.99th=[50070]
   bw (  KiB/s): min=  191, max=  416, per=24.53%, avg=263.00, stdev=69.69, samples=11
   iops        : min=   47, max=  104, avg=65.27, stdev=17.54, samples=11
  lat (usec)   : 10=1.30%, 20=5.73%, 50=10.16%, 100=0.52%, 250=7.68%
  lat (usec)   : 500=11.33%, 750=1.43%, 1000=0.78%
  lat (msec)   : 2=1.69%, 4=4.17%, 10=23.18%, 20=23.96%, 50=7.42%
  lat (msec)   : 100=0.65%
  cpu          : usr=0.26%, sys=6.86%, ctx=836, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=147764: Fri Oct 24 12:08:15 2025
  read: IOPS=68, BW=273KiB/s (279kB/s)(1436KiB/5265msec)
    clat (usec): min=7, max=58105, avg=8159.74, stdev=8519.37
     lat (usec): min=7, max=58106, avg=8160.41, stdev=8519.37
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   13], 10.00th=[   18], 20.00th=[   25],
     | 30.00th=[   31], 40.00th=[ 4621], 50.00th=[ 7242], 60.00th=[ 9765],
     | 70.00th=[11731], 80.00th=[13698], 90.00th=[18744], 95.00th=[23987],
     | 99.00th=[32637], 99.50th=[55313], 99.90th=[57934], 99.95th=[57934],
     | 99.99th=[57934]
   bw (  KiB/s): min=  223, max=  344, per=26.69%, avg=272.00, stdev=42.78, samples=10
   iops        : min=   55, max=   86, avg=67.50, stdev=10.79, samples=10
  write: IOPS=77, BW=311KiB/s (318kB/s)(1636KiB/5265msec); 0 zone resets
    clat (usec): min=161, max=56446, avg=5642.35, stdev=7444.63
     lat (usec): min=161, max=56447, avg=5644.36, stdev=7445.20
    clat percentiles (usec):
     |  1.00th=[  178],  5.00th=[  200], 10.00th=[  229], 20.00th=[  281],
     | 30.00th=[  355], 40.00th=[  766], 50.00th=[ 3458], 60.00th=[ 4686],
     | 70.00th=[ 6390], 80.00th=[ 9634], 90.00th=[16450], 95.00th=[20055],
     | 99.00th=[27657], 99.50th=[36963], 99.90th=[56361], 99.95th=[56361],
     | 99.99th=[56361]
   bw (  KiB/s): min=  222, max=  406, per=28.40%, avg=304.50, stdev=57.80, samples=10
   iops        : min=   55, max=  101, avg=75.60, stdev=14.51, samples=10
  lat (usec)   : 10=0.78%, 20=5.34%, 50=10.29%, 100=0.13%, 250=8.07%
  lat (usec)   : 500=11.46%, 750=1.95%, 1000=1.30%
  lat (msec)   : 2=1.69%, 4=5.34%, 10=25.13%, 20=22.14%, 50=5.99%
  lat (msec)   : 100=0.39%
  cpu          : usr=0.25%, sys=6.36%, ctx=810, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=147765: Fri Oct 24 12:08:15 2025
  read: IOPS=66, BW=266KiB/s (273kB/s)(1564KiB/5873msec)
    clat (usec): min=4, max=51153, avg=9154.03, stdev=9112.25
     lat (usec): min=5, max=51155, avg=9154.73, stdev=9112.30
    clat percentiles (usec):
     |  1.00th=[    7],  5.00th=[   13], 10.00th=[   18], 20.00th=[   25],
     | 30.00th=[   38], 40.00th=[ 5932], 50.00th=[ 8160], 60.00th=[10814],
     | 70.00th=[12911], 80.00th=[16319], 90.00th=[20579], 95.00th=[24773],
     | 99.00th=[42730], 99.50th=[48497], 99.90th=[51119], 99.95th=[51119],
     | 99.99th=[51119]
   bw (  KiB/s): min=  142, max=  359, per=26.02%, avg=265.18, stdev=63.76, samples=11
   iops        : min=   35, max=   89, avg=65.82, stdev=15.96, samples=11
  write: IOPS=64, BW=257KiB/s (263kB/s)(1508KiB/5873msec); 0 zone resets
    clat (usec): min=155, max=67903, avg=6002.50, stdev=7479.89
     lat (usec): min=156, max=67906, avg=6003.37, stdev=7479.97
    clat percentiles (usec):
     |  1.00th=[  182],  5.00th=[  212], 10.00th=[  229], 20.00th=[  269],
     | 30.00th=[  351], 40.00th=[  775], 50.00th=[ 3785], 60.00th=[ 5604],
     | 70.00th=[ 7373], 80.00th=[11207], 90.00th=[16450], 95.00th=[20841],
     | 99.00th=[28181], 99.50th=[31327], 99.90th=[67634], 99.95th=[67634],
     | 99.99th=[67634]
   bw (  KiB/s): min=  160, max=  335, per=23.19%, avg=248.64, stdev=48.96, samples=11
   iops        : min=   40, max=   83, avg=61.73, stdev=12.06, samples=11
  lat (usec)   : 10=1.43%, 20=6.77%, 50=8.33%, 100=0.39%, 250=7.55%
  lat (usec)   : 500=10.94%, 750=1.43%, 1000=0.65%
  lat (msec)   : 2=1.56%, 4=4.04%, 10=24.22%, 20=23.96%, 50=8.46%
  lat (msec)   : 100=0.26%
  cpu          : usr=0.20%, sys=6.13%, ctx=886, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=147766: Fri Oct 24 12:08:15 2025
  read: IOPS=65, BW=260KiB/s (266kB/s)(1508KiB/5797msec)
    clat (usec): min=6, max=54822, avg=9049.90, stdev=9662.77
     lat (usec): min=6, max=54823, avg=9050.60, stdev=9662.78
    clat percentiles (usec):
     |  1.00th=[    8],  5.00th=[   14], 10.00th=[   17], 20.00th=[   23],
     | 30.00th=[   33], 40.00th=[ 5669], 50.00th=[ 8029], 60.00th=[10290],
     | 70.00th=[12518], 80.00th=[15664], 90.00th=[20841], 95.00th=[26346],
     | 99.00th=[46924], 99.50th=[53216], 99.90th=[54789], 99.95th=[54789],
     | 99.99th=[54789]
   bw (  KiB/s): min=  150, max=  351, per=25.02%, avg=255.00, stdev=51.98, samples=11
   iops        : min=   37, max=   87, avg=63.27, stdev=12.99, samples=11
  write: IOPS=67, BW=270KiB/s (276kB/s)(1564KiB/5797msec); 0 zone resets
    clat (usec): min=181, max=62932, avg=6015.26, stdev=7626.76
     lat (usec): min=181, max=62933, avg=6016.09, stdev=7626.79
    clat percentiles (usec):
     |  1.00th=[  190],  5.00th=[  208], 10.00th=[  237], 20.00th=[  297],
     | 30.00th=[  408], 40.00th=[ 1172], 50.00th=[ 3982], 60.00th=[ 5473],
     | 70.00th=[ 7504], 80.00th=[10290], 90.00th=[16319], 95.00th=[19792],
     | 99.00th=[34866], 99.50th=[43779], 99.90th=[63177], 99.95th=[63177],
     | 99.99th=[63177]
   bw (  KiB/s): min=  172, max=  392, per=24.79%, avg=265.73, stdev=69.98, samples=11
   iops        : min=   43, max=   98, avg=66.00, stdev=17.56, samples=11
  lat (usec)   : 10=1.17%, 20=5.99%, 50=10.42%, 100=0.13%, 250=6.25%
  lat (usec)   : 500=10.94%, 750=2.08%, 1000=0.91%
  lat (msec)   : 2=1.82%, 4=4.30%, 10=25.26%, 20=23.05%, 50=7.16%
  lat (msec)   : 100=0.52%
  cpu          : usr=0.24%, sys=5.92%, ctx=866, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1020KiB/s (1044kB/s), 253KiB/s-273KiB/s (259kB/s-279kB/s), io=5988KiB (6132kB), run=5265-5873msec
  WRITE: bw=1073KiB/s (1098kB/s), 257KiB/s-311KiB/s (263kB/s-318kB/s), io=6300KiB (6451kB), run=5265-5873msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=147759: Fri Oct 24 12:08:20 2025
  read: IOPS=35, BW=144KiB/s (147kB/s)(1480KiB/10283msec)
    clat (usec): min=2363, max=62738, avg=9582.55, stdev=8413.53
     lat (usec): min=2364, max=62741, avg=9583.52, stdev=8413.49
    clat percentiles (usec):
     |  1.00th=[ 2671],  5.00th=[ 3130], 10.00th=[ 3916], 20.00th=[ 4424],
     | 30.00th=[ 5145], 40.00th=[ 5997], 50.00th=[ 6652], 60.00th=[ 7570],
     | 70.00th=[ 9110], 80.00th=[12649], 90.00th=[19792], 95.00th=[26870],
     | 99.00th=[47973], 99.50th=[56361], 99.90th=[62653], 99.95th=[62653],
     | 99.99th=[62653]
   bw (  KiB/s): min=   71, max=  240, per=24.74%, avg=142.00, stdev=48.36, samples=20
   iops        : min=   17, max=   60, avg=35.15, stdev=12.18, samples=20
  write: IOPS=38, BW=155KiB/s (159kB/s)(1592KiB/10283msec); 0 zone resets
    clat (usec): min=5382, max=76632, avg=16830.13, stdev=8088.24
     lat (usec): min=5382, max=76634, avg=16832.70, stdev=8088.60
    clat percentiles (usec):
     |  1.00th=[ 5800],  5.00th=[ 8160], 10.00th=[ 9241], 20.00th=[10683],
     | 30.00th=[11994], 40.00th=[13566], 50.00th=[14877], 60.00th=[16909],
     | 70.00th=[19006], 80.00th=[21365], 90.00th=[27132], 95.00th=[32900],
     | 99.00th=[43254], 99.50th=[60556], 99.90th=[77071], 99.95th=[77071],
     | 99.99th=[77071]
   bw (  KiB/s): min=   71, max=  240, per=25.56%, avg=154.40, stdev=55.14, samples=20
   iops        : min=   17, max=   60, avg=38.25, stdev=13.84, samples=20
  lat (msec)   : 4=5.73%, 10=37.50%, 20=39.06%, 50=17.19%, 100=0.52%
  cpu          : usr=0.26%, sys=1.95%, ctx=821, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=147760: Fri Oct 24 12:08:20 2025
  read: IOPS=34, BW=138KiB/s (141kB/s)(1436KiB/10425msec)
    clat (usec): min=2008, max=55565, avg=9024.22, stdev=7810.27
     lat (usec): min=2009, max=55565, avg=9025.14, stdev=7810.21
    clat percentiles (usec):
     |  1.00th=[ 2737],  5.00th=[ 3261], 10.00th=[ 3621], 20.00th=[ 4359],
     | 30.00th=[ 4948], 40.00th=[ 5538], 50.00th=[ 6259], 60.00th=[ 7308],
     | 70.00th=[ 8848], 80.00th=[11600], 90.00th=[17957], 95.00th=[25822],
     | 99.00th=[46400], 99.50th=[53740], 99.90th=[55313], 99.95th=[55313],
     | 99.99th=[55313]
   bw (  KiB/s): min=   55, max=  263, per=23.85%, avg=136.90, stdev=60.12, samples=20
   iops        : min=   13, max=   65, avg=33.90, stdev=15.02, samples=20
  write: IOPS=39, BW=157KiB/s (161kB/s)(1636KiB/10425msec); 0 zone resets
    clat (usec): min=5205, max=55456, avg=17447.41, stdev=8447.52
     lat (usec): min=5206, max=55457, avg=17450.46, stdev=8451.18
    clat percentiles (usec):
     |  1.00th=[ 6521],  5.00th=[ 8160], 10.00th=[ 8848], 20.00th=[10683],
     | 30.00th=[11994], 40.00th=[13566], 50.00th=[15270], 60.00th=[17433],
     | 70.00th=[19268], 80.00th=[22938], 90.00th=[29230], 95.00th=[35914],
     | 99.00th=[44827], 99.50th=[46924], 99.90th=[55313], 99.95th=[55313],
     | 99.99th=[55313]
   bw (  KiB/s): min=   87, max=  256, per=25.62%, avg=154.75, stdev=48.57, samples=20
   iops        : min=   21, max=   64, avg=38.35, stdev=12.18, samples=20
  lat (msec)   : 4=6.77%, 10=36.98%, 20=38.54%, 50=17.32%, 100=0.39%
  cpu          : usr=0.27%, sys=1.90%, ctx=821, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=147761: Fri Oct 24 12:08:20 2025
  read: IOPS=38, BW=154KiB/s (158kB/s)(1564KiB/10161msec)
    clat (usec): min=1550, max=64471, avg=8861.84, stdev=7936.60
     lat (usec): min=1551, max=64473, avg=8862.92, stdev=7936.61
    clat percentiles (usec):
     |  1.00th=[ 2311],  5.00th=[ 2966], 10.00th=[ 3556], 20.00th=[ 4113],
     | 30.00th=[ 4817], 40.00th=[ 5473], 50.00th=[ 6259], 60.00th=[ 7242],
     | 70.00th=[ 8586], 80.00th=[10552], 90.00th=[18220], 95.00th=[24511],
     | 99.00th=[46400], 99.50th=[57410], 99.90th=[64226], 99.95th=[64226],
     | 99.99th=[64226]
   bw (  KiB/s): min=   71, max=  328, per=26.97%, avg=154.80, stdev=67.07, samples=20
   iops        : min=   17, max=   82, avg=38.35, stdev=16.80, samples=20
  write: IOPS=37, BW=148KiB/s (152kB/s)(1508KiB/10161msec); 0 zone resets
    clat (usec): min=5089, max=63546, avg=17649.93, stdev=8639.96
     lat (usec): min=5090, max=63550, avg=17655.49, stdev=8638.11
    clat percentiles (usec):
     |  1.00th=[ 6587],  5.00th=[ 8356], 10.00th=[ 9503], 20.00th=[11076],
     | 30.00th=[12518], 40.00th=[13960], 50.00th=[15664], 60.00th=[16909],
     | 70.00th=[19006], 80.00th=[22676], 90.00th=[29230], 95.00th=[34866],
     | 99.00th=[46924], 99.50th=[60556], 99.90th=[63701], 99.95th=[63701],
     | 99.99th=[63701]
   bw (  KiB/s): min=   71, max=  216, per=24.37%, avg=147.20, stdev=46.50, samples=20
   iops        : min=   17, max=   54, avg=36.45, stdev=11.69, samples=20
  lat (msec)   : 2=0.13%, 4=8.46%, 10=37.24%, 20=36.07%, 50=17.58%
  lat (msec)   : 100=0.52%
  cpu          : usr=0.23%, sys=2.05%, ctx=836, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=147762: Fri Oct 24 12:08:20 2025
  read: IOPS=36, BW=146KiB/s (149kB/s)(1508KiB/10337msec)
    clat (usec): min=1983, max=43570, avg=9220.26, stdev=7768.52
     lat (usec): min=1984, max=43572, avg=9221.18, stdev=7768.50
    clat percentiles (usec):
     |  1.00th=[ 2671],  5.00th=[ 3228], 10.00th=[ 3556], 20.00th=[ 4293],
     | 30.00th=[ 4948], 40.00th=[ 5604], 50.00th=[ 6194], 60.00th=[ 7242],
     | 70.00th=[ 8586], 80.00th=[12518], 90.00th=[20055], 95.00th=[28181],
     | 99.00th=[38536], 99.50th=[40109], 99.90th=[43779], 99.95th=[43779],
     | 99.99th=[43779]
   bw (  KiB/s): min=   71, max=  247, per=24.96%, avg=143.25, stdev=51.91, samples=20
   iops        : min=   17, max=   61, avg=35.50, stdev=13.07, samples=20
  write: IOPS=37, BW=151KiB/s (155kB/s)(1564KiB/10337msec); 0 zone resets
    clat (usec): min=4040, max=78519, avg=17406.56, stdev=9022.94
     lat (usec): min=4042, max=78519, avg=17408.62, stdev=9022.25
    clat percentiles (usec):
     |  1.00th=[ 6390],  5.00th=[ 8225], 10.00th=[ 9241], 20.00th=[10814],
     | 30.00th=[11863], 40.00th=[13304], 50.00th=[14877], 60.00th=[16581],
     | 70.00th=[19268], 80.00th=[23200], 90.00th=[28705], 95.00th=[34341],
     | 99.00th=[51119], 99.50th=[57410], 99.90th=[78119], 99.95th=[78119],
     | 99.99th=[78119]
   bw (  KiB/s): min=   79, max=  239, per=25.04%, avg=151.25, stdev=56.95, samples=20
   iops        : min=   19, max=   59, avg=37.45, stdev=14.28, samples=20
  lat (msec)   : 2=0.13%, 4=7.42%, 10=35.81%, 20=38.28%, 50=17.84%
  lat (msec)   : 100=0.52%
  cpu          : usr=0.15%, sys=2.06%, ctx=832, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=574KiB/s (588kB/s), 138KiB/s-154KiB/s (141kB/s-158kB/s), io=5988KiB (6132kB), run=10161-10425msec
  WRITE: bw=604KiB/s (619kB/s), 148KiB/s-157KiB/s (152kB/s-161kB/s), io=6300KiB (6451kB), run=10161-10425msec