== sanity test 398b: DIO and buffer IO race ============== 10:44:42 (1760453082)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.0867028 s, 145 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=121602: Tue Oct 14 10:44:50 2025
  read: IOPS=156, BW=627KiB/s (642kB/s)(1480KiB/2361msec)
    clat (usec): min=4, max=22620, avg=1958.38, stdev=2992.90
     lat (usec): min=4, max=22621, avg=1958.83, stdev=2992.84
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[   10], 10.00th=[   12], 20.00th=[   16],
     | 30.00th=[   23], 40.00th=[   33], 50.00th=[  388], 60.00th=[ 2024],
     | 70.00th=[ 2868], 80.00th=[ 3556], 90.00th=[ 4359], 95.00th=[ 5866],
     | 99.00th=[16057], 99.50th=[20841], 99.90th=[22676], 99.95th=[22676],
     | 99.99th=[22676]
   bw (  KiB/s): min=  557, max=  688, per=23.79%, avg=603.25, stdev=58.28, samples=4
   iops        : min=  139, max=  172, avg=150.75, stdev=14.64, samples=4
  write: IOPS=168, BW=674KiB/s (690kB/s)(1592KiB/2361msec); 0 zone resets
    clat (usec): min=110, max=29190, avg=4092.49, stdev=4875.77
     lat (usec): min=110, max=29190, avg=4093.18, stdev=4875.61
    clat percentiles (usec):
     |  1.00th=[  124],  5.00th=[  176], 10.00th=[  225], 20.00th=[  318],
     | 30.00th=[  652], 40.00th=[ 1565], 50.00th=[ 2212], 60.00th=[ 3195],
     | 70.00th=[ 4621], 80.00th=[ 7439], 90.00th=[10814], 95.00th=[15008],
     | 99.00th=[22414], 99.50th=[28443], 99.90th=[29230], 99.95th=[29230],
     | 99.99th=[29230]
   bw (  KiB/s): min=  564, max=  752, per=24.85%, avg=663.00, stdev=94.90, samples=4
   iops        : min=  141, max=  188, avg=165.75, stdev=23.73, samples=4
  lat (usec)   : 10=3.52%, 20=9.77%, 50=9.24%, 100=0.65%, 250=6.77%
  lat (usec)   : 500=8.85%, 750=0.91%, 1000=0.39%
  lat (msec)   : 2=12.63%, 4=24.35%, 10=14.97%, 20=7.16%, 50=0.78%
  cpu          : usr=0.30%, sys=10.42%, ctx=1030, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121603: Tue Oct 14 10:44:50 2025
  read: IOPS=152, BW=608KiB/s (623kB/s)(1436KiB/2361msec)
    clat (usec): min=5, max=31281, avg=2072.16, stdev=3485.86
     lat (usec): min=5, max=31281, avg=2072.51, stdev=3485.86
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   10], 10.00th=[   13], 20.00th=[   17],
     | 30.00th=[   22], 40.00th=[   35], 50.00th=[ 1221], 60.00th=[ 2089],
     | 70.00th=[ 2802], 80.00th=[ 3556], 90.00th=[ 4621], 95.00th=[ 5735],
     | 99.00th=[22414], 99.50th=[27132], 99.90th=[31327], 99.95th=[31327],
     | 99.99th=[31327]
   bw (  KiB/s): min=  464, max=  776, per=23.62%, avg=599.00, stdev=130.49, samples=4
   iops        : min=  116, max=  194, avg=149.75, stdev=32.62, samples=4
  write: IOPS=173, BW=693KiB/s (710kB/s)(1636KiB/2361msec); 0 zone resets
    clat (usec): min=114, max=34829, avg=3934.91, stdev=4769.04
     lat (usec): min=115, max=34829, avg=3935.41, stdev=4769.14
    clat percentiles (usec):
     |  1.00th=[  151],  5.00th=[  200], 10.00th=[  253], 20.00th=[  338],
     | 30.00th=[  938], 40.00th=[ 1532], 50.00th=[ 2147], 60.00th=[ 3032],
     | 70.00th=[ 4228], 80.00th=[ 7308], 90.00th=[10028], 95.00th=[13173],
     | 99.00th=[20841], 99.50th=[22152], 99.90th=[34866], 99.95th=[34866],
     | 99.99th=[34866]
   bw (  KiB/s): min=  648, max=  720, per=25.23%, avg=673.25, stdev=31.93, samples=4
   iops        : min=  162, max=  180, avg=168.25, stdev= 8.02, samples=4
  lat (usec)   : 10=2.34%, 20=10.55%, 50=8.59%, 100=0.39%, 250=5.60%
  lat (usec)   : 500=9.24%, 750=1.17%, 1000=1.17%
  lat (msec)   : 2=13.41%, 4=23.44%, 10=17.58%, 20=5.08%, 50=1.43%
  cpu          : usr=0.30%, sys=11.06%, ctx=1048, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121604: Tue Oct 14 10:44:50 2025
  read: IOPS=184, BW=736KiB/s (754kB/s)(1564KiB/2125msec)
    clat (usec): min=6, max=28048, avg=1725.00, stdev=2308.79
     lat (usec): min=6, max=28048, avg=1725.36, stdev=2308.79
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   11], 10.00th=[   14], 20.00th=[   18],
     | 30.00th=[   25], 40.00th=[   36], 50.00th=[ 1434], 60.00th=[ 2073],
     | 70.00th=[ 2638], 80.00th=[ 3195], 90.00th=[ 3982], 95.00th=[ 5014],
     | 99.00th=[ 6718], 99.50th=[14615], 99.90th=[27919], 99.95th=[27919],
     | 99.99th=[27919]
   bw (  KiB/s): min=  694, max=  800, per=29.24%, avg=741.50, stdev=43.74, samples=4
   iops        : min=  173, max=  200, avg=185.25, stdev=11.12, samples=4
  write: IOPS=177, BW=710KiB/s (727kB/s)(1508KiB/2125msec); 0 zone resets
    clat (usec): min=116, max=27253, avg=3828.25, stdev=4648.26
     lat (usec): min=116, max=27254, avg=3828.93, stdev=4648.24
    clat percentiles (usec):
     |  1.00th=[  151],  5.00th=[  182], 10.00th=[  215], 20.00th=[  297],
     | 30.00th=[  644], 40.00th=[ 1483], 50.00th=[ 2212], 60.00th=[ 2999],
     | 70.00th=[ 4113], 80.00th=[ 6587], 90.00th=[10159], 95.00th=[13304],
     | 99.00th=[22938], 99.50th=[26346], 99.90th=[27132], 99.95th=[27132],
     | 99.99th=[27132]
   bw (  KiB/s): min=  672, max=  744, per=26.53%, avg=707.75, stdev=33.43, samples=4
   iops        : min=  168, max=  186, avg=176.75, stdev= 8.22, samples=4
  lat (usec)   : 10=1.56%, 20=10.94%, 50=9.11%, 100=0.39%, 250=7.81%
  lat (usec)   : 500=7.16%, 750=1.30%, 1000=1.17%
  lat (msec)   : 2=14.06%, 4=25.91%, 10=15.10%, 20=4.69%, 50=0.78%
  cpu          : usr=0.42%, sys=11.06%, ctx=1022, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121605: Tue Oct 14 10:44:50 2025
  read: IOPS=171, BW=688KiB/s (704kB/s)(1508KiB/2192msec)
    clat (usec): min=4, max=37316, avg=1757.04, stdev=3244.02
     lat (usec): min=4, max=37317, avg=1757.39, stdev=3244.04
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[   11], 10.00th=[   13], 20.00th=[   16],
     | 30.00th=[   19], 40.00th=[   28], 50.00th=[   51], 60.00th=[ 1680],
     | 70.00th=[ 2376], 80.00th=[ 3064], 90.00th=[ 4424], 95.00th=[ 5735],
     | 99.00th=[13698], 99.50th=[29492], 99.90th=[37487], 99.95th=[37487],
     | 99.99th=[37487]
   bw (  KiB/s): min=  571, max=  792, per=27.16%, avg=688.75, stdev=101.49, samples=4
   iops        : min=  142, max=  198, avg=172.00, stdev=25.66, samples=4
  write: IOPS=178, BW=714KiB/s (731kB/s)(1564KiB/2192msec); 0 zone resets
    clat (usec): min=133, max=28408, avg=3892.97, stdev=4699.32
     lat (usec): min=133, max=28409, avg=3893.45, stdev=4699.32
    clat percentiles (usec):
     |  1.00th=[  157],  5.00th=[  212], 10.00th=[  262], 20.00th=[  359],
     | 30.00th=[  668], 40.00th=[ 1303], 50.00th=[ 1942], 60.00th=[ 2999],
     | 70.00th=[ 4228], 80.00th=[ 6915], 90.00th=[10421], 95.00th=[13304],
     | 99.00th=[20841], 99.50th=[23200], 99.90th=[28443], 99.95th=[28443],
     | 99.99th=[28443]
   bw (  KiB/s): min=  603, max=  840, per=27.16%, avg=724.75, stdev=97.70, samples=4
   iops        : min=  150, max=  210, avg=181.00, stdev=24.74, samples=4
  lat (usec)   : 10=2.34%, 20=13.02%, 50=9.11%, 100=0.78%, 250=5.47%
  lat (usec)   : 500=9.38%, 750=2.21%, 1000=1.56%
  lat (msec)   : 2=13.15%, 4=20.44%, 10=15.76%, 20=5.86%, 50=0.91%
  cpu          : usr=0.32%, sys=11.64%, ctx=977, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2536KiB/s (2597kB/s), 608KiB/s-736KiB/s (623kB/s-754kB/s), io=5988KiB (6132kB), run=2125-2361msec
  WRITE: bw=2668KiB/s (2732kB/s), 674KiB/s-714KiB/s (690kB/s-731kB/s), io=6300KiB (6451kB), run=2125-2361msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=121597: Tue Oct 14 10:44:56 2025
  read: IOPS=45, BW=182KiB/s (186kB/s)(1480KiB/8136msec)
    clat (usec): min=863, max=37452, avg=2823.06, stdev=4061.04
     lat (usec): min=863, max=37453, avg=2823.64, stdev=4061.06
    clat percentiles (usec):
     |  1.00th=[  955],  5.00th=[ 1037], 10.00th=[ 1123], 20.00th=[ 1221],
     | 30.00th=[ 1369], 40.00th=[ 1500], 50.00th=[ 1631], 60.00th=[ 1827],
     | 70.00th=[ 2180], 80.00th=[ 2606], 90.00th=[ 4293], 95.00th=[10290],
     | 99.00th=[21103], 99.50th=[36439], 99.90th=[37487], 99.95th=[37487],
     | 99.99th=[37487]
   bw (  KiB/s): min=  120, max=  312, per=25.08%, avg=182.31, stdev=54.17, samples=16
   iops        : min=   30, max=   78, avg=45.56, stdev=13.56, samples=16
  write: IOPS=48, BW=196KiB/s (200kB/s)(1592KiB/8136msec); 0 zone resets
    clat (usec): min=9028, max=55958, avg=17788.11, stdev=5243.27
     lat (usec): min=9029, max=55958, avg=17788.86, stdev=5243.26
    clat percentiles (usec):
     |  1.00th=[10552],  5.00th=[11731], 10.00th=[12518], 20.00th=[13435],
     | 30.00th=[14353], 40.00th=[15664], 50.00th=[16712], 60.00th=[17957],
     | 70.00th=[19792], 80.00th=[21627], 90.00th=[24249], 95.00th=[27132],
     | 99.00th=[33817], 99.50th=[35390], 99.90th=[55837], 99.95th=[55837],
     | 99.99th=[55837]
   bw (  KiB/s): min=  138, max=  240, per=25.64%, avg=196.12, stdev=30.94, samples=16
   iops        : min=   34, max=   60, avg=49.00, stdev= 7.80, samples=16
  lat (usec)   : 1000=0.91%
  lat (msec)   : 2=30.99%, 4=10.81%, 10=3.26%, 20=39.32%, 50=14.58%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.09%, sys=1.92%, ctx=820, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121598: Tue Oct 14 10:44:56 2025
  read: IOPS=43, BW=174KiB/s (179kB/s)(1436KiB/8232msec)
    clat (usec): min=919, max=32188, avg=2581.50, stdev=3145.32
     lat (usec): min=919, max=32189, avg=2582.05, stdev=3145.31
    clat percentiles (usec):
     |  1.00th=[  996],  5.00th=[ 1037], 10.00th=[ 1106], 20.00th=[ 1221],
     | 30.00th=[ 1369], 40.00th=[ 1450], 50.00th=[ 1647], 60.00th=[ 1942],
     | 70.00th=[ 2212], 80.00th=[ 2638], 90.00th=[ 4228], 95.00th=[ 9110],
     | 99.00th=[16319], 99.50th=[21103], 99.90th=[32113], 99.95th=[32113],
     | 99.99th=[32113]
   bw (  KiB/s): min=   88, max=  280, per=24.01%, avg=174.56, stdev=55.59, samples=16
   iops        : min=   22, max=   70, avg=43.62, stdev=13.92, samples=16
  write: IOPS=49, BW=199KiB/s (204kB/s)(1636KiB/8232msec); 0 zone resets
    clat (usec): min=9034, max=47572, avg=17819.80, stdev=5496.18
     lat (usec): min=9035, max=47573, avg=17820.55, stdev=5496.13
    clat percentiles (usec):
     |  1.00th=[ 9634],  5.00th=[11469], 10.00th=[12518], 20.00th=[13566],
     | 30.00th=[14353], 40.00th=[15795], 50.00th=[16712], 60.00th=[18220],
     | 70.00th=[19530], 80.00th=[21365], 90.00th=[24249], 95.00th=[26608],
     | 99.00th=[39584], 99.50th=[46924], 99.90th=[47449], 99.95th=[47449],
     | 99.99th=[47449]
   bw (  KiB/s): min=  136, max=  240, per=25.78%, avg=197.25, stdev=31.42, samples=16
   iops        : min=   34, max=   60, avg=49.31, stdev= 7.85, samples=16
  lat (usec)   : 1000=0.78%
  lat (msec)   : 2=28.39%, 4=12.76%, 10=4.04%, 20=39.06%, 50=14.97%
  cpu          : usr=0.15%, sys=1.91%, ctx=827, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121599: Tue Oct 14 10:44:56 2025
  read: IOPS=48, BW=195KiB/s (200kB/s)(1564KiB/8011msec)
    clat (usec): min=916, max=23167, avg=2611.44, stdev=2926.30
     lat (usec): min=916, max=23167, avg=2612.05, stdev=2926.31
    clat percentiles (usec):
     |  1.00th=[  955],  5.00th=[ 1045], 10.00th=[ 1139], 20.00th=[ 1287],
     | 30.00th=[ 1385], 40.00th=[ 1500], 50.00th=[ 1614], 60.00th=[ 1860],
     | 70.00th=[ 2089], 80.00th=[ 2638], 90.00th=[ 4752], 95.00th=[ 8979],
     | 99.00th=[16909], 99.50th=[19268], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=   98, max=  320, per=27.60%, avg=200.67, stdev=72.08, samples=15
   iops        : min=   24, max=   80, avg=50.13, stdev=18.07, samples=15
  write: IOPS=47, BW=188KiB/s (193kB/s)(1508KiB/8011msec); 0 zone resets
    clat (usec): min=8745, max=42600, avg=18495.36, stdev=5654.91
     lat (usec): min=8746, max=42601, avg=18496.18, stdev=5654.91
    clat percentiles (usec):
     |  1.00th=[ 9110],  5.00th=[11338], 10.00th=[12649], 20.00th=[13566],
     | 30.00th=[15139], 40.00th=[16450], 50.00th=[17695], 60.00th=[18744],
     | 70.00th=[20579], 80.00th=[22414], 90.00th=[25297], 95.00th=[28181],
     | 99.00th=[40109], 99.50th=[42206], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min=  131, max=  232, per=24.57%, avg=187.93, stdev=32.02, samples=15
   iops        : min=   32, max=   58, avg=46.93, stdev= 8.10, samples=15
  lat (usec)   : 1000=1.56%
  lat (msec)   : 2=32.29%, 4=11.20%, 10=4.95%, 20=34.11%, 50=15.89%
  cpu          : usr=0.16%, sys=1.90%, ctx=823, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=121601: Tue Oct 14 10:44:56 2025
  read: IOPS=46, BW=186KiB/s (190kB/s)(1508KiB/8119msec)
    clat (usec): min=909, max=52406, avg=2731.22, stdev=3956.23
     lat (usec): min=910, max=52406, avg=2731.77, stdev=3956.23
    clat percentiles (usec):
     |  1.00th=[  963],  5.00th=[ 1029], 10.00th=[ 1106], 20.00th=[ 1237],
     | 30.00th=[ 1369], 40.00th=[ 1500], 50.00th=[ 1663], 60.00th=[ 1827],
     | 70.00th=[ 2073], 80.00th=[ 2540], 90.00th=[ 4686], 95.00th=[ 9896],
     | 99.00th=[18744], 99.50th=[22152], 99.90th=[52167], 99.95th=[52167],
     | 99.99th=[52167]
   bw (  KiB/s): min=   98, max=  288, per=25.67%, avg=186.63, stdev=47.00, samples=16
   iops        : min=   24, max=   72, avg=46.62, stdev=11.81, samples=16
  write: IOPS=48, BW=193KiB/s (197kB/s)(1564KiB/8119msec); 0 zone resets
    clat (usec): min=9394, max=50244, avg=18094.06, stdev=5654.63
     lat (usec): min=9394, max=50244, avg=18094.84, stdev=5654.61
    clat percentiles (usec):
     |  1.00th=[10421],  5.00th=[12256], 10.00th=[12911], 20.00th=[13698],
     | 30.00th=[14615], 40.00th=[15533], 50.00th=[16909], 60.00th=[17957],
     | 70.00th=[19792], 80.00th=[21627], 90.00th=[24773], 95.00th=[27132],
     | 99.00th=[42730], 99.50th=[45876], 99.90th=[50070], 99.95th=[50070],
     | 99.99th=[50070]
   bw (  KiB/s): min=  125, max=  240, per=25.33%, avg=193.81, stdev=32.35, samples=16
   iops        : min=   31, max=   60, avg=48.44, stdev= 8.12, samples=16
  lat (usec)   : 1000=1.30%
  lat (msec)   : 2=31.51%, 4=10.94%, 10=3.26%, 20=37.63%, 50=15.10%
  lat (msec)   : 100=0.26%
  cpu          : usr=0.15%, sys=1.85%, ctx=823, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=727KiB/s (745kB/s), 174KiB/s-195KiB/s (179kB/s-200kB/s), io=5988KiB (6132kB), run=8011-8232msec
  WRITE: bw=765KiB/s (784kB/s), 188KiB/s-199KiB/s (193kB/s-204kB/s), io=6300KiB (6451kB), run=8011-8232msec