== sanity test 398b: DIO and buffer IO race ============== 10:00:40 (1747404040)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.107411 s, 117 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=24179: Fri May 16 10:00:43 2025
   read: IOPS=233, BW=933KiB/s (956kB/s)(1480KiB/1586msec)
    clat (usec): min=3, max=25823, avg=1082.75, stdev=2081.66
     lat (usec): min=3, max=25824, avg=1083.42, stdev=2081.73
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   15], 50.00th=[   26], 60.00th=[  922],
     | 70.00th=[ 1549], 80.00th=[ 2089], 90.00th=[ 2737], 95.00th=[ 3523],
     | 99.00th=[10159], 99.50th=[14091], 99.90th=[25822], 99.95th=[25822],
     | 99.99th=[25822]
   bw (  KiB/s): min=  872, max=  920, per=24.07%, avg=890.00, stdev=26.15, samples=3
   iops        : min=  218, max=  230, avg=222.33, stdev= 6.66, samples=3
  write: IOPS=250, BW=1004KiB/s (1028kB/s)(1592KiB/1586msec)
    clat (usec): min=91, max=38103, avg=2954.84, stdev=4320.42
     lat (usec): min=92, max=38103, avg=2956.29, stdev=4319.99
    clat percentiles (usec):
     |  1.00th=[  100],  5.00th=[  113], 10.00th=[  131], 20.00th=[  180],
     | 30.00th=[  285], 40.00th=[  922], 50.00th=[ 1303], 60.00th=[ 1713],
     | 70.00th=[ 2573], 80.00th=[ 5276], 90.00th=[ 8160], 95.00th=[10421],
     | 99.00th=[20055], 99.50th=[26084], 99.90th=[38011], 99.95th=[38011],
     | 99.99th=[38011]
   bw (  KiB/s): min=  904, max= 1088, per=24.86%, avg=967.33, stdev=104.54, samples=3
   iops        : min=  226, max=  272, avg=241.67, stdev=26.27, samples=3
  lat (usec)   : 4=0.26%, 10=11.85%, 20=9.11%, 50=5.08%, 100=0.78%
  lat (usec)   : 250=14.71%, 500=2.73%, 750=1.43%, 1000=6.12%
  lat (msec)   : 2=18.75%, 4=14.71%, 10=10.81%, 20=2.99%, 50=0.65%
  cpu          : usr=0.32%, sys=9.84%, ctx=946, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=24180: Fri May 16 10:00:43 2025
   read: IOPS=221, BW=887KiB/s (908kB/s)(1436KiB/1619msec)
    clat (usec): min=3, max=24587, avg=1056.91, stdev=2204.26
     lat (usec): min=3, max=24588, avg=1057.46, stdev=2204.30
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   14], 50.00th=[   22], 60.00th=[  865],
     | 70.00th=[ 1352], 80.00th=[ 2024], 90.00th=[ 2704], 95.00th=[ 3228],
     | 99.00th=[11600], 99.50th=[16581], 99.90th=[24511], 99.95th=[24511],
     | 99.99th=[24511]
   bw (  KiB/s): min=  696, max= 1040, per=23.22%, avg=858.67, stdev=172.76, samples=3
   iops        : min=  174, max=  260, avg=214.67, stdev=43.19, samples=3
  write: IOPS=252, BW=1011KiB/s (1035kB/s)(1636KiB/1619msec)
    clat (usec): min=93, max=19770, avg=3000.92, stdev=4051.91
     lat (usec): min=93, max=19771, avg=3001.79, stdev=4051.77
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  113], 10.00th=[  123], 20.00th=[  165],
     | 30.00th=[  243], 40.00th=[  816], 50.00th=[ 1385], 60.00th=[ 1860],
     | 70.00th=[ 2671], 80.00th=[ 5669], 90.00th=[ 8848], 95.00th=[11994],
     | 99.00th=[17433], 99.50th=[19006], 99.90th=[19792], 99.95th=[19792],
     | 99.99th=[19792]
   bw (  KiB/s): min=  760, max= 1208, per=24.88%, avg=968.00, stdev=225.71, samples=3
   iops        : min=  190, max=  302, avg=242.00, stdev=56.43, samples=3
  lat (usec)   : 4=1.04%, 10=11.33%, 20=10.42%, 50=3.78%, 100=0.52%
  lat (usec)   : 250=16.02%, 500=1.95%, 750=2.08%, 1000=6.12%
  lat (msec)   : 2=17.58%, 4=14.45%, 10=10.68%, 20=3.91%, 50=0.13%
  cpu          : usr=0.25%, sys=10.51%, ctx=975, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=24181: Fri May 16 10:00:43 2025
   read: IOPS=241, BW=967KiB/s (990kB/s)(1564KiB/1618msec)
    clat (usec): min=3, max=18108, avg=1257.99, stdev=2299.06
     lat (usec): min=3, max=18108, avg=1258.54, stdev=2299.07
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   15], 50.00th=[   30], 60.00th=[ 1090],
     | 70.00th=[ 1713], 80.00th=[ 2114], 90.00th=[ 2769], 95.00th=[ 3654],
     | 99.00th=[13829], 99.50th=[15270], 99.90th=[18220], 99.95th=[18220],
     | 99.99th=[18220]
   bw (  KiB/s): min=  784, max= 1048, per=25.00%, avg=924.67, stdev=132.85, samples=3
   iops        : min=  196, max=  262, avg=231.00, stdev=33.18, samples=3
  write: IOPS=233, BW=932KiB/s (954kB/s)(1508KiB/1618msec)
    clat (usec): min=90, max=42086, avg=2956.88, stdev=4387.39
     lat (usec): min=90, max=42087, avg=2957.58, stdev=4387.41
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  110], 10.00th=[  123], 20.00th=[  153],
     | 30.00th=[  190], 40.00th=[  750], 50.00th=[ 1221], 60.00th=[ 1942],
     | 70.00th=[ 2933], 80.00th=[ 5604], 90.00th=[ 8455], 95.00th=[11469],
     | 99.00th=[17433], 99.50th=[26870], 99.90th=[42206], 99.95th=[42206],
     | 99.99th=[42206]
   bw (  KiB/s): min=  870, max=  920, per=22.87%, avg=890.00, stdev=26.46, samples=3
   iops        : min=  217, max=  230, avg=222.33, stdev= 6.81, samples=3
  lat (usec)   : 4=1.04%, 10=12.63%, 20=8.98%, 50=3.26%, 100=1.95%
  lat (usec)   : 250=15.10%, 500=2.08%, 750=1.56%, 1000=5.60%
  lat (msec)   : 2=16.93%, 4=16.28%, 10=10.29%, 20=4.04%, 50=0.26%
  cpu          : usr=0.12%, sys=9.89%, ctx=979, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=24182: Fri May 16 10:00:43 2025
   read: IOPS=240, BW=961KiB/s (984kB/s)(1508KiB/1569msec)
    clat (usec): min=3, max=23372, avg=1068.48, stdev=2354.17
     lat (usec): min=3, max=23373, avg=1069.26, stdev=2354.06
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   10], 40.00th=[   12], 50.00th=[   19], 60.00th=[  824],
     | 70.00th=[ 1319], 80.00th=[ 1876], 90.00th=[ 2606], 95.00th=[ 3228],
     | 99.00th=[16581], 99.50th=[19530], 99.90th=[23462], 99.95th=[23462],
     | 99.99th=[23462]
   bw (  KiB/s): min=  688, max= 1080, per=24.72%, avg=914.00, stdev=202.77, samples=3
   iops        : min=  172, max=  270, avg=228.33, stdev=50.62, samples=3
  write: IOPS=249, BW=997KiB/s (1021kB/s)(1564KiB/1569msec)
    clat (usec): min=94, max=35142, avg=2949.94, stdev=4427.97
     lat (usec): min=95, max=35143, avg=2950.65, stdev=4427.99
    clat percentiles (usec):
     |  1.00th=[  104],  5.00th=[  117], 10.00th=[  131], 20.00th=[  165],
     | 30.00th=[  202], 40.00th=[  791], 50.00th=[ 1156], 60.00th=[ 1680],
     | 70.00th=[ 2343], 80.00th=[ 5604], 90.00th=[ 8848], 95.00th=[10159],
     | 99.00th=[21365], 99.50th=[28443], 99.90th=[35390], 99.95th=[35390],
     | 99.99th=[35390]
   bw (  KiB/s): min=  712, max= 1096, per=24.72%, avg=961.67, stdev=216.43, samples=3
   iops        : min=  178, max=  274, avg=240.33, stdev=54.04, samples=3
  lat (usec)   : 4=1.04%, 10=14.84%, 20=9.37%, 50=2.73%, 100=0.26%
  lat (usec)   : 250=17.06%, 500=0.91%, 750=2.73%, 1000=6.25%
  lat (msec)   : 2=17.71%, 4=13.54%, 10=10.03%, 20=2.86%, 50=0.65%
  cpu          : usr=0.00%, sys=9.82%, ctx=872, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3699KiB/s (3787kB/s), 887KiB/s-967KiB/s (908kB/s-990kB/s), io=5988KiB (6132kB), run=1569-1619msec
  WRITE: bw=3891KiB/s (3985kB/s), 932KiB/s-1011KiB/s (954kB/s-1035kB/s), io=6300KiB (6451kB), run=1569-1619msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=24183: Fri May 16 10:00:48 2025
   read: IOPS=57, BW=231KiB/s (237kB/s)(1480KiB/6399msec)
    clat (usec): min=619, max=17002, avg=1728.09, stdev=2407.31
     lat (usec): min=620, max=17003, avg=1728.91, stdev=2407.33
    clat percentiles (usec):
     |  1.00th=[  652],  5.00th=[  734], 10.00th=[  775], 20.00th=[  824],
     | 30.00th=[  873], 40.00th=[  930], 50.00th=[ 1004], 60.00th=[ 1123],
     | 70.00th=[ 1287], 80.00th=[ 1582], 90.00th=[ 2474], 95.00th=[ 6390],
     | 99.00th=[14615], 99.50th=[16450], 99.90th=[16909], 99.95th=[16909],
     | 99.99th=[16909]
   bw (  KiB/s): min=  128, max=  384, per=24.86%, avg=229.25, stdev=84.28, samples=12
   iops        : min=   32, max=   96, avg=57.25, stdev=21.13, samples=12
  write: IOPS=62, BW=249KiB/s (255kB/s)(1592KiB/6399msec)
    clat (usec): min=7376, max=45973, avg=14447.98, stdev=5472.65
     lat (usec): min=7377, max=45974, avg=14448.93, stdev=5472.66
    clat percentiles (usec):
     |  1.00th=[ 7767],  5.00th=[ 8717], 10.00th=[ 9241], 20.00th=[10159],
     | 30.00th=[11076], 40.00th=[12518], 50.00th=[13698], 60.00th=[14877],
     | 70.00th=[15926], 80.00th=[16909], 90.00th=[19268], 95.00th=[24511],
     | 99.00th=[39584], 99.50th=[42206], 99.90th=[45876], 99.95th=[45876],
     | 99.99th=[45876]
   bw (  KiB/s): min=  144, max=  312, per=25.46%, avg=247.25, stdev=53.09, samples=12
   iops        : min=   36, max=   78, avg=61.75, stdev=13.25, samples=12
  lat (usec)   : 750=2.99%, 1000=20.70%
  lat (msec)   : 2=17.58%, 4=4.04%, 10=11.33%, 20=38.67%, 50=4.69%
  cpu          : usr=0.14%, sys=1.81%, ctx=826, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=24184: Fri May 16 10:00:48 2025
   read: IOPS=55, BW=221KiB/s (227kB/s)(1436KiB/6488msec)
    clat (usec): min=600, max=47624, avg=1627.83, stdev=3123.76
     lat (usec): min=601, max=47624, avg=1628.62, stdev=3123.75
    clat percentiles (usec):
     |  1.00th=[  660],  5.00th=[  734], 10.00th=[  766], 20.00th=[  816],
     | 30.00th=[  865], 40.00th=[  930], 50.00th=[ 1004], 60.00th=[ 1090],
     | 70.00th=[ 1188], 80.00th=[ 1434], 90.00th=[ 1844], 95.00th=[ 3425],
     | 99.00th=[12125], 99.50th=[18482], 99.90th=[47449], 99.95th=[47449],
     | 99.99th=[47449]
   bw (  KiB/s): min=  112, max=  312, per=24.07%, avg=221.92, stdev=68.94, samples=12
   iops        : min=   28, max=   78, avg=55.42, stdev=17.20, samples=12
  write: IOPS=63, BW=252KiB/s (258kB/s)(1636KiB/6488msec)
    clat (usec): min=6951, max=52495, avg=14412.19, stdev=5261.92
     lat (usec): min=6952, max=52495, avg=14413.13, stdev=5261.88
    clat percentiles (usec):
     |  1.00th=[ 7701],  5.00th=[ 8586], 10.00th=[ 9110], 20.00th=[10159],
     | 30.00th=[11469], 40.00th=[13042], 50.00th=[14353], 60.00th=[14877],
     | 70.00th=[15926], 80.00th=[16909], 90.00th=[19268], 95.00th=[21627],
     | 99.00th=[33162], 99.50th=[45876], 99.90th=[52691], 99.95th=[52691],
     | 99.99th=[52691]
   bw (  KiB/s): min=  176, max=  288, per=25.53%, avg=247.92, stdev=37.35, samples=12
   iops        : min=   44, max=   72, avg=61.92, stdev= 9.33, samples=12
  lat (usec)   : 750=3.91%, 1000=19.53%
  lat (msec)   : 2=19.27%, 4=1.95%, 10=10.81%, 20=40.10%, 50=4.30%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.18%, sys=1.71%, ctx=808, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=24185: Fri May 16 10:00:48 2025
   read: IOPS=63, BW=252KiB/s (258kB/s)(1564KiB/6198msec)
    clat (usec): min=562, max=29760, avg=1682.53, stdev=2627.67
     lat (usec): min=562, max=29761, avg=1683.30, stdev=2627.66
    clat percentiles (usec):
     |  1.00th=[  660],  5.00th=[  734], 10.00th=[  766], 20.00th=[  807],
     | 30.00th=[  865], 40.00th=[  922], 50.00th=[  988], 60.00th=[ 1074],
     | 70.00th=[ 1221], 80.00th=[ 1434], 90.00th=[ 2343], 95.00th=[ 6194],
     | 99.00th=[14353], 99.50th=[17695], 99.90th=[29754], 99.95th=[29754],
     | 99.99th=[29754]
   bw (  KiB/s): min=  119, max=  408, per=27.82%, avg=256.50, stdev=95.51, samples=12
   iops        : min=   29, max=  102, avg=64.00, stdev=24.03, samples=12
  write: IOPS=60, BW=243KiB/s (249kB/s)(1508KiB/6198msec)
    clat (usec): min=7321, max=49829, avg=14671.43, stdev=5016.12
     lat (usec): min=7323, max=49831, avg=14672.43, stdev=5016.21
    clat percentiles (usec):
     |  1.00th=[ 7767],  5.00th=[ 8979], 10.00th=[ 9503], 20.00th=[10421],
     | 30.00th=[12125], 40.00th=[13173], 50.00th=[14484], 60.00th=[15533],
     | 70.00th=[16188], 80.00th=[17171], 90.00th=[19268], 95.00th=[23200],
     | 99.00th=[32900], 99.50th=[46924], 99.90th=[50070], 99.95th=[50070],
     | 99.99th=[50070]
   bw (  KiB/s): min=  151, max=  288, per=25.11%, avg=243.83, stdev=38.95, samples=12
   iops        : min=   37, max=   72, avg=60.83, stdev= 9.84, samples=12
  lat (usec)   : 750=3.39%, 1000=22.66%
  lat (msec)   : 2=18.75%, 4=3.12%, 10=9.64%, 20=38.54%, 50=3.91%
  cpu          : usr=0.19%, sys=1.74%, ctx=813, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=24186: Fri May 16 10:00:48 2025
   read: IOPS=59, BW=239KiB/s (245kB/s)(1508KiB/6314msec)
    clat (usec): min=553, max=19939, avg=1545.73, stdev=2202.54
     lat (usec): min=554, max=19939, avg=1546.47, stdev=2202.56
    clat percentiles (usec):
     |  1.00th=[  603],  5.00th=[  709], 10.00th=[  750], 20.00th=[  807],
     | 30.00th=[  857], 40.00th=[  906], 50.00th=[  988], 60.00th=[ 1106],
     | 70.00th=[ 1221], 80.00th=[ 1385], 90.00th=[ 2040], 95.00th=[ 4490],
     | 99.00th=[15795], 99.50th=[16909], 99.90th=[20055], 99.95th=[20055],
     | 99.99th=[20055]
   bw (  KiB/s): min=  152, max=  360, per=25.66%, avg=236.58, stdev=69.57, samples=12
   iops        : min=   38, max=   90, avg=59.08, stdev=17.36, samples=12
  write: IOPS=61, BW=248KiB/s (254kB/s)(1564KiB/6314msec)
    clat (usec): min=7404, max=41301, avg=14631.67, stdev=4876.73
     lat (usec): min=7405, max=41302, avg=14632.55, stdev=4876.74
    clat percentiles (usec):
     |  1.00th=[ 7898],  5.00th=[ 8848], 10.00th=[ 9503], 20.00th=[10552],
     | 30.00th=[11863], 40.00th=[13173], 50.00th=[14091], 60.00th=[15008],
     | 70.00th=[15926], 80.00th=[17433], 90.00th=[19530], 95.00th=[23462],
     | 99.00th=[35914], 99.50th=[40109], 99.90th=[41157], 99.95th=[41157],
     | 99.99th=[41157]
   bw (  KiB/s): min=  176, max=  272, per=25.33%, avg=245.92, stdev=35.08, samples=12
   iops        : min=   44, max=   68, avg=61.42, stdev= 8.72, samples=12
  lat (usec)   : 750=4.82%, 1000=20.18%
  lat (msec)   : 2=18.88%, 4=2.60%, 10=9.24%, 20=39.71%, 50=4.56%
  cpu          : usr=0.03%, sys=1.88%, ctx=806, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=923KiB/s (945kB/s), 221KiB/s-252KiB/s (227kB/s-258kB/s), io=5988KiB (6132kB), run=6198-6488msec
  WRITE: bw=971KiB/s (994kB/s), 243KiB/s-252KiB/s (249kB/s-258kB/s), io=6300KiB (6451kB), run=6198-6488msec