== sanity test 398b: DIO and buffer IO race ============== 17:48:55 (1722548935)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.077111 s, 163 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=23269: Thu Aug  1 17:48:57 2024
   read: IOPS=244, BW=978KiB/s (1002kB/s)(1480KiB/1513msec)
    clat (usec): min=3, max=22755, avg=2329.31, stdev=2580.41
     lat (usec): min=3, max=22756, avg=2329.99, stdev=2580.42
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    8], 10.00th=[   10], 20.00th=[   12],
     | 30.00th=[   15], 40.00th=[   48], 50.00th=[ 2245], 60.00th=[ 2868],
     | 70.00th=[ 3556], 80.00th=[ 4228], 90.00th=[ 5145], 95.00th=[ 6390],
     | 99.00th=[10683], 99.50th=[11731], 99.90th=[22676], 99.95th=[22676],
     | 99.99th=[22676]
   bw (  KiB/s): min=  760, max= 1149, per=24.87%, avg=975.00, stdev=197.71, samples=3
   iops        : min=  190, max=  287, avg=243.67, stdev=49.32, samples=3
  write: IOPS=263, BW=1052KiB/s (1077kB/s)(1592KiB/1513msec)
    clat (usec): min=80, max=10185, avg=1597.71, stdev=1907.48
     lat (usec): min=81, max=10187, avg=1599.08, stdev=1907.79
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[  122], 10.00th=[  139], 20.00th=[  155],
     | 30.00th=[  172], 40.00th=[  229], 50.00th=[  889], 60.00th=[ 1450],
     | 70.00th=[ 2008], 80.00th=[ 2933], 90.00th=[ 4424], 95.00th=[ 5473],
     | 99.00th=[ 8291], 99.50th=[ 8979], 99.90th=[10159], 99.95th=[10159],
     | 99.99th=[10159]
   bw (  KiB/s): min=  800, max= 1181, per=25.51%, avg=1052.33, stdev=218.54, samples=3
   iops        : min=  200, max=  295, avg=263.00, stdev=54.56, samples=3
  lat (usec)   : 4=0.39%, 10=5.99%, 20=11.33%, 50=1.56%, 100=1.04%
  lat (usec)   : 250=20.70%, 500=3.26%, 750=0.65%, 1000=1.69%
  lat (msec)   : 2=12.76%, 4=23.05%, 10=16.93%, 20=0.52%, 50=0.13%
  cpu          : usr=0.26%, sys=14.02%, ctx=805, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23270: Thu Aug  1 17:48:57 2024
   read: IOPS=243, BW=974KiB/s (998kB/s)(1436KiB/1474msec)
    clat (usec): min=4, max=20302, avg=2197.70, stdev=2590.57
     lat (usec): min=4, max=20303, avg=2198.39, stdev=2590.65
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[    7], 10.00th=[   10], 20.00th=[   12],
     | 30.00th=[   15], 40.00th=[  717], 50.00th=[ 1860], 60.00th=[ 2573],
     | 70.00th=[ 3064], 80.00th=[ 3884], 90.00th=[ 5014], 95.00th=[ 6259],
     | 99.00th=[11994], 99.50th=[16319], 99.90th=[20317], 99.95th=[20317],
     | 99.99th=[20317]
   bw (  KiB/s): min=  872, max= 1000, per=23.87%, avg=936.00, stdev=90.51, samples=2
   iops        : min=  218, max=  250, avg=234.00, stdev=22.63, samples=2
  write: IOPS=277, BW=1110KiB/s (1137kB/s)(1636KiB/1474msec)
    clat (usec): min=91, max=11450, avg=1651.45, stdev=2195.67
     lat (usec): min=91, max=11450, avg=1653.03, stdev=2195.23
    clat percentiles (usec):
     |  1.00th=[  100],  5.00th=[  124], 10.00th=[  137], 20.00th=[  153],
     | 30.00th=[  163], 40.00th=[  184], 50.00th=[  408], 60.00th=[ 1418],
     | 70.00th=[ 1827], 80.00th=[ 2900], 90.00th=[ 5145], 95.00th=[ 6456],
     | 99.00th=[ 9110], 99.50th=[ 9765], 99.90th=[11469], 99.95th=[11469],
     | 99.99th=[11469]
   bw (  KiB/s): min=  976, max= 1152, per=25.79%, avg=1064.00, stdev=124.45, samples=2
   iops        : min=  244, max=  288, avg=266.00, stdev=31.11, samples=2
  lat (usec)   : 10=6.64%, 20=10.55%, 50=0.91%, 100=0.65%, 250=23.83%
  lat (usec)   : 500=2.73%, 750=0.65%, 1000=1.82%
  lat (msec)   : 2=15.23%, 4=21.09%, 10=15.10%, 20=0.65%, 50=0.13%
  cpu          : usr=0.48%, sys=12.63%, ctx=782, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23271: Thu Aug  1 17:48:57 2024
   read: IOPS=256, BW=1026KiB/s (1050kB/s)(1564KiB/1525msec)
    clat (usec): min=4, max=14512, avg=2219.07, stdev=2447.15
     lat (usec): min=4, max=14513, avg=2219.74, stdev=2447.21
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    8], 10.00th=[    9], 20.00th=[   12],
     | 30.00th=[   14], 40.00th=[  515], 50.00th=[ 1876], 60.00th=[ 2671],
     | 70.00th=[ 3228], 80.00th=[ 3949], 90.00th=[ 5276], 95.00th=[ 6325],
     | 99.00th=[10814], 99.50th=[12125], 99.90th=[14484], 99.95th=[14484],
     | 99.99th=[14484]
   bw (  KiB/s): min=  728, max= 1285, per=25.41%, avg=996.33, stdev=279.06, samples=3
   iops        : min=  182, max=  321, avg=249.00, stdev=69.63, samples=3
  write: IOPS=247, BW=989KiB/s (1013kB/s)(1508KiB/1525msec)
    clat (usec): min=83, max=51557, avg=1705.28, stdev=3236.70
     lat (usec): min=84, max=51558, avg=1706.19, stdev=3236.75
    clat percentiles (usec):
     |  1.00th=[   94],  5.00th=[  127], 10.00th=[  137], 20.00th=[  151],
     | 30.00th=[  167], 40.00th=[  190], 50.00th=[  758], 60.00th=[ 1401],
     | 70.00th=[ 1893], 80.00th=[ 2966], 90.00th=[ 4359], 95.00th=[ 5538],
     | 99.00th=[ 8717], 99.50th=[11469], 99.90th=[51643], 99.95th=[51643],
     | 99.99th=[51643]
   bw (  KiB/s): min=  824, max= 1053, per=22.60%, avg=932.33, stdev=115.00, samples=3
   iops        : min=  206, max=  263, avg=233.00, stdev=28.62, samples=3
  lat (usec)   : 10=7.81%, 20=11.07%, 50=0.91%, 100=0.52%, 250=22.14%
  lat (usec)   : 500=1.43%, 750=1.17%, 1000=1.69%
  lat (msec)   : 2=14.71%, 4=22.53%, 10=15.23%, 20=0.65%, 100=0.13%
  cpu          : usr=0.59%, sys=12.27%, ctx=838, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23272: Thu Aug  1 17:48:57 2024
   read: IOPS=246, BW=988KiB/s (1011kB/s)(1508KiB/1527msec)
    clat (usec): min=3, max=20114, avg=2421.19, stdev=2646.31
     lat (usec): min=3, max=20114, avg=2421.85, stdev=2646.31
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[    8], 10.00th=[    9], 20.00th=[   12],
     | 30.00th=[   15], 40.00th=[ 1254], 50.00th=[ 2278], 60.00th=[ 2966],
     | 70.00th=[ 3621], 80.00th=[ 4228], 90.00th=[ 5211], 95.00th=[ 6128],
     | 99.00th=[11338], 99.50th=[19006], 99.90th=[20055], 99.95th=[20055],
     | 99.99th=[20055]
   bw (  KiB/s): min=  808, max= 1101, per=24.19%, avg=948.33, stdev=146.89, samples=3
   iops        : min=  202, max=  275, avg=237.00, stdev=36.59, samples=3
  write: IOPS=256, BW=1024KiB/s (1049kB/s)(1564KiB/1527msec)
    clat (usec): min=90, max=11604, avg=1544.21, stdev=1962.72
     lat (usec): min=91, max=11605, avg=1545.73, stdev=1962.60
    clat percentiles (usec):
     |  1.00th=[   99],  5.00th=[  127], 10.00th=[  139], 20.00th=[  151],
     | 30.00th=[  172], 40.00th=[  215], 50.00th=[  482], 60.00th=[ 1319],
     | 70.00th=[ 1762], 80.00th=[ 2835], 90.00th=[ 4424], 95.00th=[ 5866],
     | 99.00th=[ 7701], 99.50th=[ 9503], 99.90th=[11600], 99.95th=[11600],
     | 99.99th=[11600]
   bw (  KiB/s): min=  864, max= 1173, per=23.89%, avg=985.67, stdev=164.63, samples=3
   iops        : min=  216, max=  293, avg=246.33, stdev=41.02, samples=3
  lat (usec)   : 4=0.26%, 10=6.90%, 20=10.55%, 50=0.39%, 100=1.04%
  lat (usec)   : 250=22.14%, 500=3.12%, 750=1.30%, 1000=0.91%
  lat (msec)   : 2=13.80%, 4=20.31%, 10=18.62%, 20=0.52%, 50=0.13%
  cpu          : usr=0.52%, sys=12.98%, ctx=847, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3921KiB/s (4016kB/s), 974KiB/s-1026KiB/s (998kB/s-1050kB/s), io=5988KiB (6132kB), run=1474-1527msec
  WRITE: bw=4126KiB/s (4225kB/s), 989KiB/s-1110KiB/s (1013kB/s-1137kB/s), io=6300KiB (6451kB), run=1474-1527msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=23273: Thu Aug  1 17:48:58 2024
   read: IOPS=158, BW=634KiB/s (650kB/s)(1480KiB/2333msec)
    clat (usec): min=623, max=40053, avg=2283.57, stdev=2995.58
     lat (usec): min=624, max=40054, avg=2284.25, stdev=2995.61
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  725], 10.00th=[  783], 20.00th=[  848],
     | 30.00th=[  938], 40.00th=[ 1037], 50.00th=[ 1205], 60.00th=[ 1532],
     | 70.00th=[ 1975], 80.00th=[ 2802], 90.00th=[ 5538], 95.00th=[ 7111],
     | 99.00th=[12125], 99.50th=[12780], 99.90th=[40109], 99.95th=[40109],
     | 99.99th=[40109]
   bw (  KiB/s): min=  336, max= 1000, per=21.35%, avg=547.75, stdev=305.95, samples=4
   iops        : min=   84, max=  250, avg=136.75, stdev=76.56, samples=4
  write: IOPS=170, BW=682KiB/s (699kB/s)(1592KiB/2333msec)
    clat (usec): min=1167, max=14338, avg=3716.42, stdev=2570.37
     lat (usec): min=1167, max=14339, avg=3717.43, stdev=2570.46
    clat percentiles (usec):
     |  1.00th=[ 1254],  5.00th=[ 1532], 10.00th=[ 1745], 20.00th=[ 1942],
     | 30.00th=[ 2114], 40.00th=[ 2278], 50.00th=[ 2540], 60.00th=[ 2999],
     | 70.00th=[ 3884], 80.00th=[ 5735], 90.00th=[ 7308], 95.00th=[ 9503],
     | 99.00th=[12780], 99.50th=[13698], 99.90th=[14353], 99.95th=[14353],
     | 99.99th=[14353]
   bw (  KiB/s): min=  320, max= 1184, per=21.62%, avg=583.75, stdev=402.74, samples=4
   iops        : min=   80, max=  296, avg=145.75, stdev=100.78, samples=4
  lat (usec)   : 750=3.39%, 1000=14.45%
  lat (msec)   : 2=28.26%, 4=31.25%, 10=19.92%, 20=2.60%, 50=0.13%
  cpu          : usr=0.60%, sys=4.67%, ctx=840, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23274: Thu Aug  1 17:48:58 2024
   read: IOPS=155, BW=622KiB/s (637kB/s)(1436KiB/2310msec)
    clat (usec): min=575, max=40350, avg=2204.95, stdev=2893.97
     lat (usec): min=575, max=40351, avg=2205.64, stdev=2894.03
    clat percentiles (usec):
     |  1.00th=[  693],  5.00th=[  742], 10.00th=[  783], 20.00th=[  865],
     | 30.00th=[  922], 40.00th=[ 1004], 50.00th=[ 1221], 60.00th=[ 1467],
     | 70.00th=[ 2008], 80.00th=[ 2802], 90.00th=[ 4883], 95.00th=[ 7242],
     | 99.00th=[10814], 99.50th=[12125], 99.90th=[40109], 99.95th=[40109],
     | 99.99th=[40109]
   bw (  KiB/s): min=  359, max= 1160, per=22.04%, avg=565.50, stdev=396.49, samples=4
   iops        : min=   89, max=  290, avg=141.00, stdev=99.37, samples=4
  write: IOPS=177, BW=708KiB/s (725kB/s)(1636KiB/2310msec)
    clat (usec): min=1165, max=14790, avg=3693.59, stdev=2355.86
     lat (usec): min=1166, max=14791, avg=3694.51, stdev=2355.93
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1647], 10.00th=[ 1795], 20.00th=[ 1975],
     | 30.00th=[ 2180], 40.00th=[ 2343], 50.00th=[ 2704], 60.00th=[ 3326],
     | 70.00th=[ 4178], 80.00th=[ 5145], 90.00th=[ 7177], 95.00th=[ 8979],
     | 99.00th=[11338], 99.50th=[11600], 99.90th=[14746], 99.95th=[14746],
     | 99.99th=[14746]
   bw (  KiB/s): min=  391, max= 1120, per=22.57%, avg=609.50, stdev=342.12, samples=4
   iops        : min=   97, max=  280, avg=152.00, stdev=85.80, samples=4
  lat (usec)   : 750=2.86%, 1000=15.49%
  lat (msec)   : 2=25.26%, 4=32.16%, 10=21.74%, 20=2.34%, 50=0.13%
  cpu          : usr=0.26%, sys=4.94%, ctx=852, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23275: Thu Aug  1 17:48:58 2024
   read: IOPS=172, BW=688KiB/s (705kB/s)(1564KiB/2273msec)
    clat (usec): min=669, max=12077, avg=2126.39, stdev=2163.72
     lat (usec): min=670, max=12077, avg=2127.22, stdev=2163.70
    clat percentiles (usec):
     |  1.00th=[  693],  5.00th=[  750], 10.00th=[  791], 20.00th=[  873],
     | 30.00th=[  938], 40.00th=[ 1037], 50.00th=[ 1237], 60.00th=[ 1450],
     | 70.00th=[ 1811], 80.00th=[ 2704], 90.00th=[ 5407], 95.00th=[ 7046],
     | 99.00th=[10814], 99.50th=[11731], 99.90th=[12125], 99.95th=[12125],
     | 99.99th=[12125]
   bw (  KiB/s): min=  352, max= 1128, per=23.15%, avg=594.00, stdev=359.81, samples=4
   iops        : min=   88, max=  282, avg=148.50, stdev=89.95, samples=4
  write: IOPS=165, BW=663KiB/s (679kB/s)(1508KiB/2273msec)
    clat (usec): min=1043, max=37961, avg=3800.70, stdev=3112.80
     lat (usec): min=1043, max=37961, avg=3801.56, stdev=3112.89
    clat percentiles (usec):
     |  1.00th=[ 1270],  5.00th=[ 1647], 10.00th=[ 1795], 20.00th=[ 2040],
     | 30.00th=[ 2147], 40.00th=[ 2311], 50.00th=[ 2573], 60.00th=[ 2966],
     | 70.00th=[ 3949], 80.00th=[ 5473], 90.00th=[ 7242], 95.00th=[ 9634],
     | 99.00th=[13173], 99.50th=[14091], 99.90th=[38011], 99.95th=[38011],
     | 99.99th=[38011]
   bw (  KiB/s): min=  368, max= 1152, per=22.00%, avg=594.00, stdev=373.20, samples=4
   iops        : min=   92, max=  288, avg=148.50, stdev=93.30, samples=4
  lat (usec)   : 750=2.73%, 1000=16.67%
  lat (msec)   : 2=26.95%, 4=32.16%, 10=18.88%, 20=2.47%, 50=0.13%
  cpu          : usr=0.62%, sys=4.97%, ctx=831, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=23276: Thu Aug  1 17:48:58 2024
   read: IOPS=164, BW=657KiB/s (672kB/s)(1508KiB/2297msec)
    clat (usec): min=569, max=12884, avg=2009.18, stdev=1959.17
     lat (usec): min=569, max=12885, avg=2009.91, stdev=1959.21
    clat percentiles (usec):
     |  1.00th=[  627],  5.00th=[  709], 10.00th=[  750], 20.00th=[  848],
     | 30.00th=[  914], 40.00th=[ 1004], 50.00th=[ 1172], 60.00th=[ 1434],
     | 70.00th=[ 1827], 80.00th=[ 2671], 90.00th=[ 4752], 95.00th=[ 6587],
     | 99.00th=[ 9765], 99.50th=[10814], 99.90th=[12911], 99.95th=[12911],
     | 99.99th=[12911]
   bw (  KiB/s): min=  312, max= 1000, per=21.82%, avg=560.00, stdev=302.03, samples=4
   iops        : min=   78, max=  250, avg=140.00, stdev=75.51, samples=4
  write: IOPS=170, BW=681KiB/s (697kB/s)(1564KiB/2297msec)
    clat (usec): min=1122, max=39173, avg=3912.59, stdev=3144.74
     lat (usec): min=1122, max=39174, avg=3913.48, stdev=3144.82
    clat percentiles (usec):
     |  1.00th=[ 1237],  5.00th=[ 1516], 10.00th=[ 1778], 20.00th=[ 2024],
     | 30.00th=[ 2212], 40.00th=[ 2376], 50.00th=[ 2704], 60.00th=[ 3261],
     | 70.00th=[ 4228], 80.00th=[ 5800], 90.00th=[ 7439], 95.00th=[ 9241],
     | 99.00th=[13566], 99.50th=[15270], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min=  368, max= 1200, per=22.37%, avg=604.00, stdev=398.42, samples=4
   iops        : min=   92, max=  300, avg=151.00, stdev=99.61, samples=4
  lat (usec)   : 750=4.95%, 1000=14.45%
  lat (msec)   : 2=25.91%, 4=32.29%, 10=20.18%, 20=2.08%, 50=0.13%
  cpu          : usr=0.00%, sys=5.40%, ctx=835, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2567KiB/s (2628kB/s), 622KiB/s-688KiB/s (637kB/s-705kB/s), io=5988KiB (6132kB), run=2273-2333msec
  WRITE: bw=2700KiB/s (2765kB/s), 663KiB/s-708KiB/s (679kB/s-725kB/s), io=6300KiB (6451kB), run=2273-2333msec