== sanity test 398b: DIO and buffer IO race ============== 09:37:32 (1759844252)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB, 12 MiB) copied, 0.0983841 s, 128 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=146852: Tue Oct  7 09:37:41 2025
  read: IOPS=179, BW=717KiB/s (734kB/s)(1480KiB/2064msec)
    clat (usec): min=6, max=41221, avg=3136.82, stdev=4130.00
     lat (usec): min=6, max=41221, avg=3137.29, stdev=4130.01
    clat percentiles (usec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   16], 20.00th=[   20],
     | 30.00th=[   26], 40.00th=[ 1909], 50.00th=[ 2835], 60.00th=[ 3556],
     | 70.00th=[ 4178], 80.00th=[ 5145], 90.00th=[ 6194], 95.00th=[ 7701],
     | 99.00th=[14615], 99.50th=[35390], 99.90th=[41157], 99.95th=[41157],
     | 99.99th=[41157]
   bw (  KiB/s): min=  628, max=  728, per=27.07%, avg=691.00, stdev=43.50, samples=4
   iops        : min=  157, max=  182, avg=172.75, stdev=10.87, samples=4
  write: IOPS=192, BW=771KiB/s (790kB/s)(1592KiB/2064msec); 0 zone resets
    clat (usec): min=145, max=22703, avg=2238.05, stdev=2698.40
     lat (usec): min=145, max=22704, avg=2238.60, stdev=2698.41
    clat percentiles (usec):
     |  1.00th=[  165],  5.00th=[  217], 10.00th=[  255], 20.00th=[  330],
     | 30.00th=[  441], 40.00th=[  676], 50.00th=[ 1450], 60.00th=[ 1958],
     | 70.00th=[ 2573], 80.00th=[ 3589], 90.00th=[ 5473], 95.00th=[ 7046],
     | 99.00th=[16057], 99.50th=[16909], 99.90th=[22676], 99.95th=[22676],
     | 99.99th=[22676]
   bw (  KiB/s): min=  636, max=  864, per=28.03%, avg=753.00, stdev=93.20, samples=4
   iops        : min=  159, max=  216, avg=188.25, stdev=23.30, samples=4
  lat (usec)   : 10=0.52%, 20=9.24%, 50=5.99%, 100=0.78%, 250=5.47%
  lat (usec)   : 500=13.93%, 750=2.73%, 1000=0.52%
  lat (msec)   : 2=12.24%, 4=23.96%, 10=22.27%, 20=1.82%, 50=0.52%
  cpu          : usr=0.19%, sys=17.69%, ctx=1000, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146854: Tue Oct  7 09:37:41 2025
  read: IOPS=168, BW=674KiB/s (690kB/s)(1436KiB/2132msec)
    clat (usec): min=8, max=41557, avg=3288.11, stdev=4115.90
     lat (usec): min=8, max=41557, avg=3288.60, stdev=4115.93
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   15], 10.00th=[   17], 20.00th=[   22],
     | 30.00th=[   41], 40.00th=[ 2073], 50.00th=[ 2966], 60.00th=[ 3720],
     | 70.00th=[ 4359], 80.00th=[ 5145], 90.00th=[ 6390], 95.00th=[ 8455],
     | 99.00th=[19006], 99.50th=[35390], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=  523, max= 1000, per=26.51%, avg=676.75, stdev=224.12, samples=4
   iops        : min=  130, max=  250, avg=169.00, stdev=56.20, samples=4
  write: IOPS=191, BW=767KiB/s (786kB/s)(1636KiB/2132msec); 0 zone resets
    clat (usec): min=141, max=21270, avg=2278.55, stdev=2550.32
     lat (usec): min=141, max=21271, avg=2279.10, stdev=2550.33
    clat percentiles (usec):
     |  1.00th=[  161],  5.00th=[  229], 10.00th=[  273], 20.00th=[  351],
     | 30.00th=[  465], 40.00th=[  898], 50.00th=[ 1565], 60.00th=[ 2040],
     | 70.00th=[ 2737], 80.00th=[ 3752], 90.00th=[ 5407], 95.00th=[ 7570],
     | 99.00th=[12256], 99.50th=[13173], 99.90th=[21365], 99.95th=[21365],
     | 99.99th=[21365]
   bw (  KiB/s): min=  584, max=  920, per=28.22%, avg=758.00, stdev=166.84, samples=4
   iops        : min=  146, max=  230, avg=189.50, stdev=41.71, samples=4
  lat (usec)   : 10=0.65%, 20=6.64%, 50=6.90%, 100=0.65%, 250=4.04%
  lat (usec)   : 500=13.80%, 750=3.12%, 1000=1.30%
  lat (msec)   : 2=13.15%, 4=23.83%, 10=23.70%, 20=1.69%, 50=0.52%
  cpu          : usr=0.28%, sys=18.02%, ctx=1037, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146855: Tue Oct  7 09:37:41 2025
  read: IOPS=182, BW=729KiB/s (746kB/s)(1564KiB/2146msec)
    clat (usec): min=4, max=20154, avg=3027.52, stdev=2939.83
     lat (usec): min=4, max=20154, avg=3027.96, stdev=2939.84
    clat percentiles (usec):
     |  1.00th=[    9],  5.00th=[   14], 10.00th=[   16], 20.00th=[   21],
     | 30.00th=[   28], 40.00th=[ 2008], 50.00th=[ 3032], 60.00th=[ 3687],
     | 70.00th=[ 4228], 80.00th=[ 5014], 90.00th=[ 6325], 95.00th=[ 7701],
     | 99.00th=[12518], 99.50th=[17695], 99.90th=[20055], 99.95th=[20055],
     | 99.99th=[20055]
   bw (  KiB/s): min=  561, max=  864, per=28.21%, avg=720.25, stdev=128.25, samples=4
   iops        : min=  140, max=  216, avg=180.00, stdev=32.17, samples=4
  write: IOPS=175, BW=703KiB/s (720kB/s)(1508KiB/2146msec); 0 zone resets
    clat (usec): min=145, max=21952, avg=2497.02, stdev=2734.10
     lat (usec): min=145, max=21954, avg=2497.57, stdev=2734.13
    clat percentiles (usec):
     |  1.00th=[  167],  5.00th=[  217], 10.00th=[  262], 20.00th=[  334],
     | 30.00th=[  545], 40.00th=[ 1319], 50.00th=[ 1696], 60.00th=[ 2040],
     | 70.00th=[ 2933], 80.00th=[ 4228], 90.00th=[ 6390], 95.00th=[ 8029],
     | 99.00th=[10159], 99.50th=[17433], 99.90th=[21890], 99.95th=[21890],
     | 99.99th=[21890]
   bw (  KiB/s): min=  616, max=  776, per=25.29%, avg=679.25, stdev=68.33, samples=4
   iops        : min=  154, max=  194, avg=169.75, stdev=17.10, samples=4
  lat (usec)   : 10=0.78%, 20=8.33%, 50=7.42%, 100=0.39%, 250=4.43%
  lat (usec)   : 500=10.29%, 750=3.12%, 1000=0.78%
  lat (msec)   : 2=13.54%, 4=22.53%, 10=26.56%, 20=1.56%, 50=0.26%
  cpu          : usr=0.56%, sys=15.71%, ctx=1113, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146857: Tue Oct  7 09:37:41 2025
  read: IOPS=160, BW=643KiB/s (659kB/s)(1508KiB/2345msec)
    clat (usec): min=5, max=39257, avg=3444.66, stdev=4211.10
     lat (usec): min=5, max=39258, avg=3445.15, stdev=4211.05
    clat percentiles (usec):
     |  1.00th=[    7],  5.00th=[   14], 10.00th=[   16], 20.00th=[   22],
     | 30.00th=[  200], 40.00th=[ 2376], 50.00th=[ 3032], 60.00th=[ 3720],
     | 70.00th=[ 4359], 80.00th=[ 5276], 90.00th=[ 6456], 95.00th=[ 8291],
     | 99.00th=[24511], 99.50th=[27132], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min=  446, max=  752, per=24.27%, avg=619.50, stdev=140.08, samples=4
   iops        : min=  111, max=  188, avg=154.75, stdev=35.23, samples=4
  write: IOPS=166, BW=667KiB/s (683kB/s)(1564KiB/2345msec); 0 zone resets
    clat (usec): min=141, max=42720, avg=2623.48, stdev=3843.06
     lat (usec): min=141, max=42720, avg=2624.12, stdev=3843.07
    clat percentiles (usec):
     |  1.00th=[  167],  5.00th=[  251], 10.00th=[  293], 20.00th=[  359],
     | 30.00th=[  486], 40.00th=[ 1172], 50.00th=[ 1598], 60.00th=[ 1876],
     | 70.00th=[ 2671], 80.00th=[ 4015], 90.00th=[ 6259], 95.00th=[ 8848],
     | 99.00th=[14615], 99.50th=[35390], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min=  476, max=  840, per=24.39%, avg=655.00, stdev=152.92, samples=4
   iops        : min=  119, max=  210, avg=163.75, stdev=38.23, samples=4
  lat (usec)   : 10=1.17%, 20=7.42%, 50=5.60%, 100=0.39%, 250=2.73%
  lat (usec)   : 500=13.54%, 750=2.73%, 1000=0.91%
  lat (msec)   : 2=14.97%, 4=22.92%, 10=23.96%, 20=2.60%, 50=1.04%
  cpu          : usr=0.30%, sys=17.79%, ctx=1163, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2554KiB/s (2615kB/s), 643KiB/s-729KiB/s (659kB/s-746kB/s), io=5988KiB (6132kB), run=2064-2345msec
  WRITE: bw=2687KiB/s (2751kB/s), 667KiB/s-771KiB/s (683kB/s-790kB/s), io=6300KiB (6451kB), run=2064-2345msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=146851: Tue Oct  7 09:37:41 2025
  read: IOPS=120, BW=480KiB/s (492kB/s)(1480KiB/3081msec)
    clat (usec): min=1018, max=30977, avg=2859.83, stdev=2824.07
     lat (usec): min=1019, max=30978, avg=2860.32, stdev=2824.09
    clat percentiles (usec):
     |  1.00th=[ 1057],  5.00th=[ 1156], 10.00th=[ 1237], 20.00th=[ 1319],
     | 30.00th=[ 1418], 40.00th=[ 1532], 50.00th=[ 1631], 60.00th=[ 1909],
     | 70.00th=[ 2540], 80.00th=[ 3851], 90.00th=[ 6849], 95.00th=[ 7963],
     | 99.00th=[13173], 99.50th=[14615], 99.90th=[31065], 99.95th=[31065],
     | 99.99th=[31065]
   bw (  KiB/s): min=  288, max=  880, per=24.51%, avg=471.67, stdev=213.29, samples=6
   iops        : min=   72, max=  220, avg=117.67, stdev=53.47, samples=6
  write: IOPS=129, BW=517KiB/s (529kB/s)(1592KiB/3081msec); 0 zone resets
    clat (usec): min=1841, max=24649, avg=5049.08, stdev=3279.53
     lat (usec): min=1842, max=24649, avg=5049.86, stdev=3279.67
    clat percentiles (usec):
     |  1.00th=[ 2008],  5.00th=[ 2212], 10.00th=[ 2573], 20.00th=[ 2868],
     | 30.00th=[ 3130], 40.00th=[ 3359], 50.00th=[ 3720], 60.00th=[ 4293],
     | 70.00th=[ 5538], 80.00th=[ 6718], 90.00th=[ 9372], 95.00th=[11338],
     | 99.00th=[19006], 99.50th=[22414], 99.90th=[24773], 99.95th=[24773],
     | 99.99th=[24773]
   bw (  KiB/s): min=  320, max=  912, per=25.32%, avg=512.67, stdev=229.03, samples=6
   iops        : min=   80, max=  228, avg=128.00, stdev=57.37, samples=6
  lat (msec)   : 2=30.34%, 4=37.11%, 10=27.47%, 20=4.56%, 50=0.52%
  cpu          : usr=0.26%, sys=5.62%, ctx=810, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146853: Tue Oct  7 09:37:41 2025
  read: IOPS=115, BW=462KiB/s (473kB/s)(1436KiB/3111msec)
    clat (usec): min=1034, max=25689, avg=2864.65, stdev=2790.77
     lat (usec): min=1035, max=25690, avg=2865.12, stdev=2790.79
    clat percentiles (usec):
     |  1.00th=[ 1045],  5.00th=[ 1139], 10.00th=[ 1205], 20.00th=[ 1303],
     | 30.00th=[ 1385], 40.00th=[ 1500], 50.00th=[ 1647], 60.00th=[ 1975],
     | 70.00th=[ 2638], 80.00th=[ 4015], 90.00th=[ 6259], 95.00th=[ 8455],
     | 99.00th=[14615], 99.50th=[19006], 99.90th=[25560], 99.95th=[25560],
     | 99.99th=[25560]
   bw (  KiB/s): min=  264, max=  792, per=23.71%, avg=456.17, stdev=227.09, samples=6
   iops        : min=   66, max=  198, avg=113.83, stdev=56.89, samples=6
  write: IOPS=131, BW=526KiB/s (538kB/s)(1636KiB/3111msec); 0 zone resets
    clat (usec): min=1800, max=21613, avg=5035.21, stdev=3042.12
     lat (usec): min=1800, max=21614, avg=5035.83, stdev=3042.12
    clat percentiles (usec):
     |  1.00th=[ 1958],  5.00th=[ 2245], 10.00th=[ 2573], 20.00th=[ 2900],
     | 30.00th=[ 3097], 40.00th=[ 3392], 50.00th=[ 3720], 60.00th=[ 4686],
     | 70.00th=[ 5669], 80.00th=[ 7046], 90.00th=[ 9110], 95.00th=[10683],
     | 99.00th=[16909], 99.50th=[19006], 99.90th=[21627], 99.95th=[21627],
     | 99.99th=[21627]
   bw (  KiB/s): min=  335, max=  888, per=25.14%, avg=509.00, stdev=213.22, samples=6
   iops        : min=   83, max=  222, avg=127.00, stdev=53.49, samples=6
  lat (msec)   : 2=29.69%, 4=36.98%, 10=28.65%, 20=4.43%, 50=0.26%
  cpu          : usr=0.26%, sys=5.50%, ctx=829, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146856: Tue Oct  7 09:37:41 2025
  read: IOPS=127, BW=508KiB/s (520kB/s)(1564KiB/3077msec)
    clat (usec): min=1036, max=23405, avg=2775.04, stdev=2504.82
     lat (usec): min=1036, max=23405, avg=2775.55, stdev=2504.82
    clat percentiles (usec):
     |  1.00th=[ 1090],  5.00th=[ 1188], 10.00th=[ 1254], 20.00th=[ 1319],
     | 30.00th=[ 1401], 40.00th=[ 1532], 50.00th=[ 1696], 60.00th=[ 1975],
     | 70.00th=[ 2474], 80.00th=[ 3982], 90.00th=[ 6128], 95.00th=[ 7701],
     | 99.00th=[12125], 99.50th=[17433], 99.90th=[23462], 99.95th=[23462],
     | 99.99th=[23462]
   bw (  KiB/s): min=  288, max=  944, per=26.39%, avg=507.83, stdev=252.09, samples=6
   iops        : min=   72, max=  236, avg=126.83, stdev=63.09, samples=6
  write: IOPS=122, BW=490KiB/s (502kB/s)(1508KiB/3077msec); 0 zone resets
    clat (usec): min=1805, max=30188, avg=5222.77, stdev=3357.54
     lat (usec): min=1805, max=30190, avg=5223.66, stdev=3357.42
    clat percentiles (usec):
     |  1.00th=[ 1991],  5.00th=[ 2245], 10.00th=[ 2606], 20.00th=[ 2933],
     | 30.00th=[ 3163], 40.00th=[ 3425], 50.00th=[ 3785], 60.00th=[ 4555],
     | 70.00th=[ 6063], 80.00th=[ 7635], 90.00th=[ 9896], 95.00th=[11469],
     | 99.00th=[17171], 99.50th=[19006], 99.90th=[30278], 99.95th=[30278],
     | 99.99th=[30278]
   bw (  KiB/s): min=  280, max=  832, per=23.80%, avg=482.00, stdev=206.91, samples=6
   iops        : min=   70, max=  208, avg=120.33, stdev=51.79, samples=6
  lat (msec)   : 2=31.25%, 4=36.20%, 10=27.08%, 20=5.21%, 50=0.26%
  cpu          : usr=0.36%, sys=5.49%, ctx=825, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=146858: Tue Oct  7 09:37:41 2025
  read: IOPS=123, BW=492KiB/s (504kB/s)(1508KiB/3063msec)
    clat (usec): min=995, max=18651, avg=2820.20, stdev=2643.52
     lat (usec): min=996, max=18652, avg=2820.96, stdev=2643.39
    clat percentiles (usec):
     |  1.00th=[ 1045],  5.00th=[ 1139], 10.00th=[ 1205], 20.00th=[ 1319],
     | 30.00th=[ 1434], 40.00th=[ 1549], 50.00th=[ 1729], 60.00th=[ 2024],
     | 70.00th=[ 2376], 80.00th=[ 3556], 90.00th=[ 6456], 95.00th=[ 8455],
     | 99.00th=[12387], 99.50th=[17695], 99.90th=[18744], 99.95th=[18744],
     | 99.99th=[18744]
   bw (  KiB/s): min=  283, max=  864, per=25.45%, avg=489.67, stdev=209.06, samples=6
   iops        : min=   70, max=  216, avg=122.17, stdev=52.48, samples=6
  write: IOPS=127, BW=511KiB/s (523kB/s)(1564KiB/3063msec); 0 zone resets
    clat (usec): min=1860, max=34325, avg=5061.21, stdev=3525.07
     lat (usec): min=1861, max=34326, avg=5061.94, stdev=3525.03
    clat percentiles (usec):
     |  1.00th=[ 2008],  5.00th=[ 2311], 10.00th=[ 2704], 20.00th=[ 2900],
     | 30.00th=[ 3097], 40.00th=[ 3326], 50.00th=[ 3621], 60.00th=[ 4293],
     | 70.00th=[ 5473], 80.00th=[ 6718], 90.00th=[ 9241], 95.00th=[11469],
     | 99.00th=[18220], 99.50th=[27657], 99.90th=[34341], 99.95th=[34341],
     | 99.99th=[34341]
   bw (  KiB/s): min=  351, max=  888, per=25.08%, avg=507.83, stdev=235.81, samples=6
   iops        : min=   87, max=  222, avg=126.83, stdev=59.05, samples=6
  lat (usec)   : 1000=0.13%
  lat (msec)   : 2=29.04%, 4=39.19%, 10=26.04%, 20=5.21%, 50=0.39%
  cpu          : usr=0.13%, sys=5.72%, ctx=834, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=1925KiB/s (1971kB/s), 462KiB/s-508KiB/s (473kB/s-520kB/s), io=5988KiB (6132kB), run=3063-3111msec
  WRITE: bw=2025KiB/s (2074kB/s), 490KiB/s-526KiB/s (502kB/s-538kB/s), io=6300KiB (6451kB), run=3063-3111msec