== sanity test 398b: DIO and buffer IO race ============== 19:38:16 (1736987896)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0817406 s, 154 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=20413: Wed Jan 15 19:38:19 2025
   read: IOPS=342, BW=1370KiB/s (1403kB/s)(1480KiB/1080msec)
    clat (usec): min=3, max=30060, avg=1717.32, stdev=2696.22
     lat (usec): min=3, max=30061, avg=1719.26, stdev=2695.49
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   18], 50.00th=[ 1237], 60.00th=[ 1975],
     | 70.00th=[ 2311], 80.00th=[ 2933], 90.00th=[ 3490], 95.00th=[ 5473],
     | 99.00th=[10290], 99.50th=[25297], 99.90th=[30016], 99.95th=[30016],
     | 99.99th=[30016]
   bw (  KiB/s): min= 1072, max= 1536, per=25.81%, avg=1304.00, stdev=328.10, samples=2
   iops        : min=  268, max=  384, avg=326.00, stdev=82.02, samples=2
  write: IOPS=368, BW=1474KiB/s (1509kB/s)(1592KiB/1080msec)
    clat (usec): min=93, max=7775, avg=1093.22, stdev=1293.82
     lat (usec): min=93, max=7775, avg=1093.96, stdev=1293.82
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  113], 10.00th=[  123], 20.00th=[  155],
     | 30.00th=[  182], 40.00th=[  233], 50.00th=[  766], 60.00th=[  996],
     | 70.00th=[ 1287], 80.00th=[ 1876], 90.00th=[ 2737], 95.00th=[ 3752],
     | 99.00th=[ 6456], 99.50th=[ 6980], 99.90th=[ 7767], 99.95th=[ 7767],
     | 99.99th=[ 7767]
   bw (  KiB/s): min= 1000, max= 1848, per=26.79%, avg=1424.00, stdev=599.63, samples=2
   iops        : min=  250, max=  462, avg=356.00, stdev=149.91, samples=2
  lat (usec)   : 4=0.26%, 10=7.94%, 20=12.11%, 50=0.78%, 100=0.39%
  lat (usec)   : 250=21.87%, 500=2.21%, 750=1.69%, 1000=6.38%
  lat (msec)   : 2=17.84%, 4=22.79%, 10=5.08%, 20=0.39%, 50=0.26%
  cpu          : usr=0.00%, sys=18.16%, ctx=859, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20414: Wed Jan 15 19:38:19 2025
   read: IOPS=303, BW=1215KiB/s (1244kB/s)(1436KiB/1182msec)
    clat (usec): min=3, max=20292, avg=1779.12, stdev=2718.33
     lat (usec): min=3, max=20292, avg=1779.68, stdev=2718.35
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[   20], 50.00th=[ 1221], 60.00th=[ 1811],
     | 70.00th=[ 2311], 80.00th=[ 2966], 90.00th=[ 3720], 95.00th=[ 5538],
     | 99.00th=[18482], 99.50th=[19268], 99.90th=[20317], 99.95th=[20317],
     | 99.99th=[20317]
   bw (  KiB/s): min=  840, max= 1512, per=23.27%, avg=1176.00, stdev=475.18, samples=2
   iops        : min=  210, max=  378, avg=294.00, stdev=118.79, samples=2
  write: IOPS=346, BW=1384KiB/s (1417kB/s)(1636KiB/1182msec)
    clat (usec): min=86, max=17846, avg=1305.73, stdev=1788.45
     lat (usec): min=86, max=17846, avg=1307.81, stdev=1787.75
    clat percentiles (usec):
     |  1.00th=[  101],  5.00th=[  113], 10.00th=[  125], 20.00th=[  145],
     | 30.00th=[  165], 40.00th=[  198], 50.00th=[  783], 60.00th=[ 1029],
     | 70.00th=[ 1418], 80.00th=[ 2278], 90.00th=[ 3621], 95.00th=[ 4621],
     | 99.00th=[ 6849], 99.50th=[ 8225], 99.90th=[17957], 99.95th=[17957],
     | 99.99th=[17957]
   bw (  KiB/s): min=  936, max= 1616, per=24.00%, avg=1276.00, stdev=480.83, samples=2
   iops        : min=  234, max=  404, avg=319.00, stdev=120.21, samples=2
  lat (usec)   : 4=0.13%, 10=9.77%, 20=8.85%, 50=0.52%, 100=0.91%
  lat (usec)   : 250=23.83%, 500=1.69%, 750=1.04%, 1000=5.21%
  lat (msec)   : 2=18.88%, 4=20.44%, 10=7.55%, 20=1.04%, 50=0.13%
  cpu          : usr=0.42%, sys=16.34%, ctx=869, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20415: Wed Jan 15 19:38:19 2025
   read: IOPS=329, BW=1320KiB/s (1352kB/s)(1564KiB/1185msec)
    clat (usec): min=3, max=30329, avg=1878.13, stdev=2712.49
     lat (usec): min=4, max=30329, avg=1878.71, stdev=2712.50
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    8], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   15], 40.00th=[  816], 50.00th=[ 1582], 60.00th=[ 1975],
     | 70.00th=[ 2442], 80.00th=[ 2933], 90.00th=[ 3982], 95.00th=[ 5800],
     | 99.00th=[10814], 99.50th=[24511], 99.90th=[30278], 99.95th=[30278],
     | 99.99th=[30278]
   bw (  KiB/s): min=  928, max= 1456, per=23.59%, avg=1192.00, stdev=373.35, samples=2
   iops        : min=  232, max=  364, avg=298.00, stdev=93.34, samples=2
  write: IOPS=318, BW=1273KiB/s (1303kB/s)(1508KiB/1185msec)
    clat (usec): min=90, max=16690, avg=1169.23, stdev=1742.14
     lat (usec): min=91, max=16692, avg=1169.99, stdev=1742.13
    clat percentiles (usec):
     |  1.00th=[   99],  5.00th=[  117], 10.00th=[  131], 20.00th=[  157],
     | 30.00th=[  182], 40.00th=[  208], 50.00th=[  832], 60.00th=[  996],
     | 70.00th=[ 1205], 80.00th=[ 1844], 90.00th=[ 2868], 95.00th=[ 4015],
     | 99.00th=[ 7963], 99.50th=[15533], 99.90th=[16712], 99.95th=[16712],
     | 99.99th=[16712]
   bw (  KiB/s): min=  992, max= 1416, per=22.65%, avg=1204.00, stdev=299.81, samples=2
   iops        : min=  248, max=  354, avg=301.00, stdev=74.95, samples=2
  lat (usec)   : 4=0.13%, 10=8.46%, 20=10.68%, 50=0.65%, 100=0.52%
  lat (usec)   : 250=21.22%, 500=1.43%, 750=1.17%, 1000=6.51%
  lat (msec)   : 2=20.31%, 4=21.48%, 10=6.38%, 20=0.78%, 50=0.26%
  cpu          : usr=0.25%, sys=16.81%, ctx=886, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20416: Wed Jan 15 19:38:19 2025
   read: IOPS=331, BW=1325KiB/s (1357kB/s)(1508KiB/1138msec)
    clat (usec): min=4, max=20201, avg=1773.04, stdev=2315.07
     lat (usec): min=4, max=20202, avg=1774.13, stdev=2314.75
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[    8], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[  449], 50.00th=[ 1483], 60.00th=[ 1991],
     | 70.00th=[ 2474], 80.00th=[ 2933], 90.00th=[ 3621], 95.00th=[ 4817],
     | 99.00th=[11076], 99.50th=[16450], 99.90th=[20317], 99.95th=[20317],
     | 99.99th=[20317]
   bw (  KiB/s): min=  896, max= 1584, per=24.54%, avg=1240.00, stdev=486.49, samples=2
   iops        : min=  224, max=  396, avg=310.00, stdev=121.62, samples=2
  write: IOPS=343, BW=1374KiB/s (1407kB/s)(1564KiB/1138msec)
    clat (usec): min=87, max=23233, avg=1182.83, stdev=1775.19
     lat (usec): min=88, max=23235, avg=1184.01, stdev=1775.12
    clat percentiles (usec):
     |  1.00th=[   98],  5.00th=[  112], 10.00th=[  125], 20.00th=[  153],
     | 30.00th=[  178], 40.00th=[  204], 50.00th=[  734], 60.00th=[  947],
     | 70.00th=[ 1221], 80.00th=[ 2147], 90.00th=[ 2835], 95.00th=[ 3916],
     | 99.00th=[ 6915], 99.50th=[10028], 99.90th=[23200], 99.95th=[23200],
     | 99.99th=[23200]
   bw (  KiB/s): min=  952, max= 1672, per=24.68%, avg=1312.00, stdev=509.12, samples=2
   iops        : min=  238, max=  418, avg=328.00, stdev=127.28, samples=2
  lat (usec)   : 10=9.37%, 20=9.11%, 50=0.65%, 100=1.04%, 250=22.27%
  lat (usec)   : 500=1.95%, 750=1.04%, 1000=7.03%
  lat (msec)   : 2=17.06%, 4=24.35%, 10=4.95%, 20=0.91%, 50=0.26%
  cpu          : usr=0.62%, sys=15.22%, ctx=810, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5053KiB/s (5174kB/s), 1215KiB/s-1370KiB/s (1244kB/s-1403kB/s), io=5988KiB (6132kB), run=1080-1185msec
  WRITE: bw=5316KiB/s (5444kB/s), 1273KiB/s-1474KiB/s (1303kB/s-1509kB/s), io=6300KiB (6451kB), run=1080-1185msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=20409: Wed Jan 15 19:38:20 2025
   read: IOPS=198, BW=794KiB/s (813kB/s)(1480KiB/1863msec)
    clat (usec): min=645, max=32941, avg=1793.40, stdev=2351.92
     lat (usec): min=646, max=32942, avg=1794.10, stdev=2352.06
    clat percentiles (usec):
     |  1.00th=[  652],  5.00th=[  758], 10.00th=[  799], 20.00th=[  857],
     | 30.00th=[  898], 40.00th=[  947], 50.00th=[ 1012], 60.00th=[ 1106],
     | 70.00th=[ 1385], 80.00th=[ 2057], 90.00th=[ 4228], 95.00th=[ 5080],
     | 99.00th=[11076], 99.50th=[11994], 99.90th=[32900], 99.95th=[32900],
     | 99.99th=[32900]
   bw (  KiB/s): min=  584, max=  856, per=21.97%, avg=696.00, stdev=142.21, samples=3
   iops        : min=  146, max=  214, avg=174.00, stdev=35.55, samples=3
  write: IOPS=213, BW=855KiB/s (875kB/s)(1592KiB/1863msec)
    clat (usec): min=1250, max=11141, avg=2980.06, stdev=1500.12
     lat (usec): min=1251, max=11142, avg=2980.82, stdev=1500.13
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1598], 10.00th=[ 1844], 20.00th=[ 2008],
     | 30.00th=[ 2114], 40.00th=[ 2245], 50.00th=[ 2409], 60.00th=[ 2606],
     | 70.00th=[ 3261], 80.00th=[ 3949], 90.00th=[ 5014], 95.00th=[ 5866],
     | 99.00th=[ 9634], 99.50th=[10552], 99.90th=[11207], 99.95th=[11207],
     | 99.99th=[11207]
   bw (  KiB/s): min=  584, max= 1056, per=22.56%, avg=752.00, stdev=263.76, samples=3
   iops        : min=  146, max=  264, avg=188.00, stdev=65.94, samples=3
  lat (usec)   : 750=2.21%, 1000=21.22%
  lat (msec)   : 2=24.35%, 4=37.37%, 10=13.93%, 20=0.78%, 50=0.13%
  cpu          : usr=0.21%, sys=5.91%, ctx=825, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20410: Wed Jan 15 19:38:20 2025
   read: IOPS=189, BW=760KiB/s (778kB/s)(1436KiB/1890msec)
    clat (usec): min=653, max=20456, avg=1802.11, stdev=2046.54
     lat (usec): min=654, max=20457, avg=1802.87, stdev=2046.55
    clat percentiles (usec):
     |  1.00th=[  693],  5.00th=[  750], 10.00th=[  799], 20.00th=[  848],
     | 30.00th=[  906], 40.00th=[  971], 50.00th=[ 1037], 60.00th=[ 1156],
     | 70.00th=[ 1516], 80.00th=[ 2278], 90.00th=[ 3818], 95.00th=[ 5211],
     | 99.00th=[12518], 99.50th=[13829], 99.90th=[20579], 99.95th=[20579],
     | 99.99th=[20579]
   bw (  KiB/s): min=  496, max=  968, per=20.88%, avg=661.33, stdev=265.85, samples=3
   iops        : min=  124, max=  242, avg=165.33, stdev=66.46, samples=3
  write: IOPS=216, BW=866KiB/s (886kB/s)(1636KiB/1890msec)
    clat (usec): min=1253, max=15846, avg=3005.69, stdev=1731.42
     lat (usec): min=1254, max=15847, avg=3007.00, stdev=1733.78
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1483], 10.00th=[ 1647], 20.00th=[ 1958],
     | 30.00th=[ 2114], 40.00th=[ 2212], 50.00th=[ 2376], 60.00th=[ 2573],
     | 70.00th=[ 3064], 80.00th=[ 3720], 90.00th=[ 5342], 95.00th=[ 6390],
     | 99.00th=[ 9634], 99.50th=[10814], 99.90th=[15795], 99.95th=[15795],
     | 99.99th=[15795]
   bw (  KiB/s): min=  600, max=  976, per=22.16%, avg=738.67, stdev=206.51, samples=3
   iops        : min=  150, max=  244, avg=184.67, stdev=51.63, samples=3
  lat (usec)   : 750=2.21%, 1000=18.23%
  lat (msec)   : 2=26.69%, 4=39.32%, 10=12.50%, 20=0.91%, 50=0.13%
  cpu          : usr=0.53%, sys=5.61%, ctx=822, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20411: Wed Jan 15 19:38:20 2025
   read: IOPS=211, BW=845KiB/s (866kB/s)(1564KiB/1850msec)
    clat (usec): min=649, max=32392, avg=1772.16, stdev=2244.11
     lat (usec): min=649, max=32393, avg=1772.88, stdev=2244.10
    clat percentiles (usec):
     |  1.00th=[  685],  5.00th=[  750], 10.00th=[  799], 20.00th=[  865],
     | 30.00th=[  922], 40.00th=[  963], 50.00th=[ 1045], 60.00th=[ 1156],
     | 70.00th=[ 1434], 80.00th=[ 2147], 90.00th=[ 3752], 95.00th=[ 4817],
     | 99.00th=[ 8979], 99.50th=[15795], 99.90th=[32375], 99.95th=[32375],
     | 99.99th=[32375]
   bw (  KiB/s): min=  480, max= 1032, per=23.23%, avg=736.00, stdev=278.17, samples=3
   iops        : min=  120, max=  258, avg=184.00, stdev=69.54, samples=3
  write: IOPS=203, BW=815KiB/s (835kB/s)(1508KiB/1850msec)
    clat (usec): min=1294, max=22332, avg=3043.85, stdev=2110.10
     lat (usec): min=1295, max=22335, avg=3044.68, stdev=2110.13
    clat percentiles (usec):
     |  1.00th=[ 1319],  5.00th=[ 1467], 10.00th=[ 1647], 20.00th=[ 1991],
     | 30.00th=[ 2089], 40.00th=[ 2180], 50.00th=[ 2311], 60.00th=[ 2507],
     | 70.00th=[ 2868], 80.00th=[ 3752], 90.00th=[ 5407], 95.00th=[ 6587],
     | 99.00th=[10683], 99.50th=[19006], 99.90th=[22414], 99.95th=[22414],
     | 99.99th=[22414]
   bw (  KiB/s): min=  504, max= 1008, per=21.20%, avg=706.67, stdev=266.09, samples=3
   iops        : min=  126, max=  252, avg=176.67, stdev=66.52, samples=3
  lat (usec)   : 750=2.60%, 1000=19.79%
  lat (msec)   : 2=27.86%, 4=35.94%, 10=12.89%, 20=0.65%, 50=0.26%
  cpu          : usr=0.65%, sys=5.62%, ctx=826, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20412: Wed Jan 15 19:38:20 2025
   read: IOPS=203, BW=812KiB/s (832kB/s)(1508KiB/1857msec)
    clat (usec): min=683, max=22178, avg=1670.28, stdev=1969.14
     lat (usec): min=683, max=22179, avg=1670.94, stdev=1969.15
    clat percentiles (usec):
     |  1.00th=[  701],  5.00th=[  758], 10.00th=[  807], 20.00th=[  857],
     | 30.00th=[  898], 40.00th=[  955], 50.00th=[ 1037], 60.00th=[ 1106],
     | 70.00th=[ 1336], 80.00th=[ 1893], 90.00th=[ 3195], 95.00th=[ 5276],
     | 99.00th=[10552], 99.50th=[16057], 99.90th=[22152], 99.95th=[22152],
     | 99.99th=[22152]
   bw (  KiB/s): min=  526, max=  896, per=21.95%, avg=695.33, stdev=186.98, samples=3
   iops        : min=  131, max=  224, avg=173.67, stdev=46.97, samples=3
  write: IOPS=210, BW=842KiB/s (862kB/s)(1564KiB/1857msec)
    clat (usec): min=1291, max=26815, avg=3115.33, stdev=2317.68
     lat (usec): min=1292, max=26816, avg=3116.11, stdev=2317.70
    clat percentiles (usec):
     |  1.00th=[ 1369],  5.00th=[ 1532], 10.00th=[ 1745], 20.00th=[ 2008],
     | 30.00th=[ 2089], 40.00th=[ 2212], 50.00th=[ 2376], 60.00th=[ 2671],
     | 70.00th=[ 3228], 80.00th=[ 3949], 90.00th=[ 5211], 95.00th=[ 6259],
     | 99.00th=[10814], 99.50th=[25822], 99.90th=[26870], 99.95th=[26870],
     | 99.99th=[26870]
   bw (  KiB/s): min=  574, max= 1024, per=22.22%, avg=740.67, stdev=246.64, samples=3
   iops        : min=  143, max=  256, avg=185.00, stdev=61.83, samples=3
  lat (usec)   : 750=1.95%, 1000=20.96%
  lat (msec)   : 2=27.34%, 4=36.59%, 10=11.98%, 20=0.78%, 50=0.39%
  cpu          : usr=0.54%, sys=5.76%, ctx=823, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3168KiB/s (3244kB/s), 760KiB/s-845KiB/s (778kB/s-866kB/s), io=5988KiB (6132kB), run=1850-1890msec
  WRITE: bw=3333KiB/s (3413kB/s), 815KiB/s-866KiB/s (835kB/s-886kB/s), io=6300KiB (6451kB), run=1850-1890msec