== sanity test 398b: DIO and buffer IO race ============== 17:46:11 (1751319971)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0697659 s, 180 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=3347: Mon Jun 30 17:46:14 2025
   read: IOPS=228, BW=915KiB/s (937kB/s)(1480KiB/1618msec)
    clat (usec): min=3, max=23320, avg=1366.94, stdev=2640.85
     lat (usec): min=3, max=23320, avg=1367.46, stdev=2640.87
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   17], 50.00th=[  807], 60.00th=[ 1336],
     | 70.00th=[ 1762], 80.00th=[ 2147], 90.00th=[ 2737], 95.00th=[ 3359],
     | 99.00th=[13698], 99.50th=[23200], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  688, max= 1000, per=23.21%, avg=858.67, stdev=158.05, samples=3
   iops        : min=  172, max=  250, avg=214.67, stdev=39.51, samples=3
  write: IOPS=245, BW=984KiB/s (1008kB/s)(1592KiB/1618msec)
    clat (usec): min=89, max=18668, avg=2775.66, stdev=3593.51
     lat (usec): min=90, max=18669, avg=2776.30, stdev=3593.49
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  106], 10.00th=[  118], 20.00th=[  147],
     | 30.00th=[  273], 40.00th=[  791], 50.00th=[ 1172], 60.00th=[ 1942],
     | 70.00th=[ 2737], 80.00th=[ 5211], 90.00th=[ 8356], 95.00th=[11469],
     | 99.00th=[15139], 99.50th=[16319], 99.90th=[18744], 99.95th=[18744],
     | 99.99th=[18744]
   bw (  KiB/s): min=  696, max= 1176, per=24.04%, avg=936.00, stdev=240.00, samples=3
   iops        : min=  174, max=  294, avg=234.00, stdev=60.00, samples=3
  lat (usec)   : 4=0.13%, 10=12.24%, 20=7.55%, 50=2.73%, 100=1.56%
  lat (usec)   : 250=14.97%, 500=2.08%, 750=2.47%, 1000=7.16%
  lat (msec)   : 2=17.19%, 4=16.67%, 10=11.46%, 20=3.39%, 50=0.39%
  cpu          : usr=0.31%, sys=10.70%, ctx=1042, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=3348: Mon Jun 30 17:46:14 2025
   read: IOPS=239, BW=959KiB/s (982kB/s)(1436KiB/1498msec)
    clat (usec): min=3, max=11976, avg=979.30, stdev=1480.10
     lat (usec): min=3, max=11977, avg=980.34, stdev=1480.16
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   14], 50.00th=[   25], 60.00th=[  988],
     | 70.00th=[ 1500], 80.00th=[ 1958], 90.00th=[ 2540], 95.00th=[ 3097],
     | 99.00th=[ 7767], 99.50th=[ 9634], 99.90th=[11994], 99.95th=[11994],
     | 99.99th=[11994]
   bw (  KiB/s): min=  720, max= 1096, per=24.54%, avg=908.00, stdev=265.87, samples=2
   iops        : min=  180, max=  274, avg=227.00, stdev=66.47, samples=2
  write: IOPS=273, BW=1092KiB/s (1118kB/s)(1636KiB/1498msec)
    clat (usec): min=91, max=34346, avg=2784.85, stdev=4282.20
     lat (usec): min=91, max=34347, avg=2785.86, stdev=4281.98
    clat percentiles (usec):
     |  1.00th=[   98],  5.00th=[  106], 10.00th=[  114], 20.00th=[  149],
     | 30.00th=[  200], 40.00th=[  685], 50.00th=[ 1074], 60.00th=[ 1827],
     | 70.00th=[ 2704], 80.00th=[ 5145], 90.00th=[ 7570], 95.00th=[10552],
     | 99.00th=[16909], 99.50th=[29492], 99.90th=[34341], 99.95th=[34341],
     | 99.99th=[34341]
   bw (  KiB/s): min=  816, max= 1248, per=26.51%, avg=1032.00, stdev=305.47, samples=2
   iops        : min=  204, max=  312, avg=258.00, stdev=76.37, samples=2
  lat (usec)   : 4=0.65%, 10=12.50%, 20=9.11%, 50=2.86%, 100=1.43%
  lat (usec)   : 250=17.32%, 500=2.21%, 750=2.21%, 1000=5.73%
  lat (msec)   : 2=17.19%, 4=14.71%, 10=11.07%, 20=2.60%, 50=0.39%
  cpu          : usr=0.13%, sys=10.09%, ctx=939, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=3349: Mon Jun 30 17:46:14 2025
   read: IOPS=265, BW=1063KiB/s (1089kB/s)(1564KiB/1471msec)
    clat (usec): min=3, max=18837, avg=1165.28, stdev=2227.05
     lat (usec): min=3, max=18838, avg=1166.24, stdev=2227.49
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   18], 50.00th=[   81], 60.00th=[ 1090],
     | 70.00th=[ 1500], 80.00th=[ 1958], 90.00th=[ 2606], 95.00th=[ 3228],
     | 99.00th=[12256], 99.50th=[17433], 99.90th=[18744], 99.95th=[18744],
     | 99.99th=[18744]
   bw (  KiB/s): min=  784, max= 1144, per=26.05%, avg=964.00, stdev=254.56, samples=2
   iops        : min=  196, max=  286, avg=241.00, stdev=63.64, samples=2
  write: IOPS=256, BW=1025KiB/s (1050kB/s)(1508KiB/1471msec)
    clat (usec): min=90, max=30482, avg=2667.60, stdev=3750.70
     lat (usec): min=90, max=30483, avg=2668.52, stdev=3750.54
    clat percentiles (usec):
     |  1.00th=[   96],  5.00th=[  112], 10.00th=[  122], 20.00th=[  151],
     | 30.00th=[  273], 40.00th=[  824], 50.00th=[ 1106], 60.00th=[ 1729],
     | 70.00th=[ 2442], 80.00th=[ 4490], 90.00th=[ 7767], 95.00th=[10421],
     | 99.00th=[15401], 99.50th=[22938], 99.90th=[30540], 99.95th=[30540],
     | 99.99th=[30540]
   bw (  KiB/s): min=  872, max=  992, per=23.94%, avg=932.00, stdev=84.85, samples=2
   iops        : min=  218, max=  248, avg=233.00, stdev=21.21, samples=2
  lat (usec)   : 4=1.04%, 10=13.28%, 20=7.16%, 50=2.86%, 100=2.47%
  lat (usec)   : 250=14.06%, 500=1.30%, 750=2.21%, 1000=8.72%
  lat (msec)   : 2=20.44%, 4=13.80%, 10=9.11%, 20=3.12%, 50=0.39%
  cpu          : usr=0.00%, sys=10.13%, ctx=981, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=3350: Mon Jun 30 17:46:14 2025
   read: IOPS=249, BW=998KiB/s (1022kB/s)(1508KiB/1511msec)
    clat (usec): min=3, max=19908, avg=923.97, stdev=1483.60
     lat (usec): min=3, max=19909, avg=924.50, stdev=1483.61
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    4], 10.00th=[    7], 20.00th=[    8],
     | 30.00th=[   10], 40.00th=[   14], 50.00th=[   27], 60.00th=[ 1057],
     | 70.00th=[ 1516], 80.00th=[ 1844], 90.00th=[ 2409], 95.00th=[ 2802],
     | 99.00th=[ 4424], 99.50th=[ 6587], 99.90th=[19792], 99.95th=[19792],
     | 99.99th=[19792]
   bw (  KiB/s): min=  776, max= 1168, per=26.38%, avg=976.00, stdev=196.12, samples=3
   iops        : min=  194, max=  292, avg=244.00, stdev=49.03, samples=3
  write: IOPS=258, BW=1035KiB/s (1060kB/s)(1564KiB/1511msec)
    clat (usec): min=92, max=22877, avg=2947.65, stdev=3865.85
     lat (usec): min=92, max=22880, avg=2949.74, stdev=3865.00
    clat percentiles (usec):
     |  1.00th=[   99],  5.00th=[  109], 10.00th=[  123], 20.00th=[  167],
     | 30.00th=[  285], 40.00th=[  832], 50.00th=[ 1369], 60.00th=[ 1958],
     | 70.00th=[ 2868], 80.00th=[ 5735], 90.00th=[ 8160], 95.00th=[11207],
     | 99.00th=[16909], 99.50th=[19006], 99.90th=[22938], 99.95th=[22938],
     | 99.99th=[22938]
   bw (  KiB/s): min=  808, max= 1256, per=26.10%, avg=1016.00, stdev=225.71, samples=3
   iops        : min=  202, max=  314, avg=254.00, stdev=56.43, samples=3
  lat (usec)   : 4=2.47%, 10=13.67%, 20=6.51%, 50=3.26%, 100=1.17%
  lat (usec)   : 250=14.06%, 500=2.47%, 750=2.99%, 1000=4.56%
  lat (msec)   : 2=20.70%, 4=14.84%, 10=9.64%, 20=3.52%, 50=0.13%
  cpu          : usr=0.07%, sys=10.46%, ctx=973, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3701KiB/s (3790kB/s), 915KiB/s-1063KiB/s (937kB/s-1089kB/s), io=5988KiB (6132kB), run=1471-1618msec
  WRITE: bw=3894KiB/s (3987kB/s), 984KiB/s-1092KiB/s (1008kB/s-1118kB/s), io=6300KiB (6451kB), run=1471-1618msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=3343: Mon Jun 30 17:46:18 2025
   read: IOPS=68, BW=275KiB/s (282kB/s)(1480KiB/5377msec)
    clat (usec): min=626, max=13669, avg=1517.53, stdev=1630.86
     lat (usec): min=627, max=13670, avg=1518.28, stdev=1630.89
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  742], 10.00th=[  783], 20.00th=[  848],
     | 30.00th=[  889], 40.00th=[  938], 50.00th=[ 1029], 60.00th=[ 1156],
     | 70.00th=[ 1270], 80.00th=[ 1532], 90.00th=[ 2147], 95.00th=[ 3982],
     | 99.00th=[ 9503], 99.50th=[11994], 99.90th=[13698], 99.95th=[13698],
     | 99.99th=[13698]
   bw (  KiB/s): min=  175, max=  384, per=25.25%, avg=272.70, stdev=72.05, samples=10
   iops        : min=   43, max=   96, avg=68.10, stdev=18.13, samples=10
  write: IOPS=74, BW=296KiB/s (303kB/s)(1592KiB/5377msec)
    clat (usec): min=6823, max=36517, avg=12069.82, stdev=4169.18
     lat (usec): min=6824, max=36518, avg=12070.64, stdev=4169.18
    clat percentiles (usec):
     |  1.00th=[ 6915],  5.00th=[ 7570], 10.00th=[ 7898], 20.00th=[ 8586],
     | 30.00th=[ 9765], 40.00th=[10552], 50.00th=[11338], 60.00th=[12518],
     | 70.00th=[13304], 80.00th=[14091], 90.00th=[15926], 95.00th=[19006],
     | 99.00th=[30802], 99.50th=[34866], 99.90th=[36439], 99.95th=[36439],
     | 99.99th=[36439]
   bw (  KiB/s): min=  184, max=  360, per=25.91%, avg=294.30, stdev=59.74, samples=10
   iops        : min=   46, max=   90, avg=73.50, stdev=15.04, samples=10
  lat (usec)   : 750=3.12%, 1000=19.79%
  lat (msec)   : 2=19.53%, 4=3.39%, 10=19.40%, 20=32.55%, 50=2.21%
  cpu          : usr=0.13%, sys=2.08%, ctx=809, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=3344: Mon Jun 30 17:46:18 2025
   read: IOPS=64, BW=259KiB/s (265kB/s)(1436KiB/5544msec)
    clat (usec): min=564, max=23799, avg=1579.76, stdev=2073.41
     lat (usec): min=564, max=23799, avg=1580.44, stdev=2073.42
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  734], 10.00th=[  783], 20.00th=[  832],
     | 30.00th=[  881], 40.00th=[  955], 50.00th=[ 1045], 60.00th=[ 1139],
     | 70.00th=[ 1270], 80.00th=[ 1532], 90.00th=[ 2245], 95.00th=[ 4752],
     | 99.00th=[10945], 99.50th=[14615], 99.90th=[23725], 99.95th=[23725],
     | 99.99th=[23725]
   bw (  KiB/s): min=  111, max=  376, per=23.90%, avg=258.09, stdev=73.96, samples=11
   iops        : min=   27, max=   94, avg=64.45, stdev=18.64, samples=11
  write: IOPS=73, BW=295KiB/s (302kB/s)(1636KiB/5544msec)
    clat (usec): min=6679, max=45200, avg=12128.95, stdev=4111.02
     lat (usec): min=6680, max=45202, avg=12129.76, stdev=4111.04
    clat percentiles (usec):
     |  1.00th=[ 6980],  5.00th=[ 7439], 10.00th=[ 7832], 20.00th=[ 8979],
     | 30.00th=[10028], 40.00th=[10814], 50.00th=[11731], 60.00th=[12518],
     | 70.00th=[13042], 80.00th=[13829], 90.00th=[15926], 95.00th=[19268],
     | 99.00th=[25822], 99.50th=[34866], 99.90th=[45351], 99.95th=[45351],
     | 99.99th=[45351]
   bw (  KiB/s): min=  183, max=  368, per=25.86%, avg=293.73, stdev=57.56, samples=11
   iops        : min=   45, max=   92, avg=73.36, stdev=14.53, samples=11
  lat (usec)   : 750=2.34%, 1000=19.01%
  lat (msec)   : 2=19.79%, 4=2.99%, 10=17.71%, 20=35.68%, 50=2.47%
  cpu          : usr=0.14%, sys=2.04%, ctx=813, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=3345: Mon Jun 30 17:46:18 2025
   read: IOPS=73, BW=294KiB/s (301kB/s)(1564KiB/5326msec)
    clat (usec): min=629, max=19191, avg=1469.44, stdev=1696.90
     lat (usec): min=630, max=19192, avg=1470.12, stdev=1696.90
    clat percentiles (usec):
     |  1.00th=[  660],  5.00th=[  734], 10.00th=[  766], 20.00th=[  824],
     | 30.00th=[  889], 40.00th=[  938], 50.00th=[  996], 60.00th=[ 1074],
     | 70.00th=[ 1205], 80.00th=[ 1369], 90.00th=[ 2180], 95.00th=[ 4228],
     | 99.00th=[10028], 99.50th=[10552], 99.90th=[19268], 99.95th=[19268],
     | 99.99th=[19268]
   bw (  KiB/s): min=  152, max=  472, per=27.77%, avg=299.90, stdev=117.23, samples=10
   iops        : min=   38, max=  118, avg=74.90, stdev=29.40, samples=10
  write: IOPS=70, BW=283KiB/s (290kB/s)(1508KiB/5326msec)
    clat (usec): min=6513, max=40194, avg=12559.63, stdev=4491.33
     lat (usec): min=6514, max=40195, avg=12560.50, stdev=4491.37
    clat percentiles (usec):
     |  1.00th=[ 6849],  5.00th=[ 7439], 10.00th=[ 8029], 20.00th=[ 9241],
     | 30.00th=[10159], 40.00th=[11207], 50.00th=[11994], 60.00th=[12780],
     | 70.00th=[13435], 80.00th=[14353], 90.00th=[17433], 95.00th=[21103],
     | 99.00th=[35390], 99.50th=[36963], 99.90th=[40109], 99.95th=[40109],
     | 99.99th=[40109]
   bw (  KiB/s): min=  176, max=  336, per=24.78%, avg=281.50, stdev=55.03, samples=10
   iops        : min=   44, max=   84, avg=70.30, stdev=13.87, samples=10
  lat (usec)   : 750=3.39%, 1000=22.27%
  lat (msec)   : 2=19.27%, 4=3.26%, 10=15.49%, 20=33.46%, 50=2.86%
  cpu          : usr=0.19%, sys=2.07%, ctx=824, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=3346: Mon Jun 30 17:46:18 2025
   read: IOPS=69, BW=279KiB/s (286kB/s)(1508KiB/5398msec)
    clat (usec): min=627, max=23451, avg=1597.52, stdev=2055.01
     lat (usec): min=628, max=23452, avg=1598.20, stdev=2055.01
    clat percentiles (usec):
     |  1.00th=[  685],  5.00th=[  750], 10.00th=[  791], 20.00th=[  848],
     | 30.00th=[  906], 40.00th=[  955], 50.00th=[ 1029], 60.00th=[ 1139],
     | 70.00th=[ 1254], 80.00th=[ 1565], 90.00th=[ 2442], 95.00th=[ 4752],
     | 99.00th=[10814], 99.50th=[17695], 99.90th=[23462], 99.95th=[23462],
     | 99.99th=[23462]
   bw (  KiB/s): min=  152, max=  424, per=25.41%, avg=274.40, stdev=82.71, samples=10
   iops        : min=   38, max=  106, avg=68.60, stdev=20.68, samples=10
  write: IOPS=72, BW=290KiB/s (297kB/s)(1564KiB/5398msec)
    clat (usec): min=6705, max=45476, avg=12223.53, stdev=4262.85
     lat (usec): min=6705, max=45477, avg=12224.45, stdev=4262.79
    clat percentiles (usec):
     |  1.00th=[ 6783],  5.00th=[ 7373], 10.00th=[ 7963], 20.00th=[ 8848],
     | 30.00th=[ 9765], 40.00th=[11076], 50.00th=[11863], 60.00th=[12649],
     | 70.00th=[13304], 80.00th=[14091], 90.00th=[16188], 95.00th=[18482],
     | 99.00th=[30540], 99.50th=[36963], 99.90th=[45351], 99.95th=[45351],
     | 99.99th=[45351]
   bw (  KiB/s): min=  168, max=  336, per=25.35%, avg=288.00, stdev=59.63, samples=10
   iops        : min=   42, max=   84, avg=72.00, stdev=14.91, samples=10
  lat (usec)   : 750=2.34%, 1000=19.92%
  lat (msec)   : 2=20.70%, 4=3.39%, 10=18.10%, 20=33.59%, 50=1.95%
  cpu          : usr=0.13%, sys=2.06%, ctx=826, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1080KiB/s (1106kB/s), 259KiB/s-294KiB/s (265kB/s-301kB/s), io=5988KiB (6132kB), run=5326-5544msec
  WRITE: bw=1136KiB/s (1164kB/s), 283KiB/s-296KiB/s (290kB/s-303kB/s), io=6300KiB (6451kB), run=5326-5544msec