== sanity test 398b: DIO and buffer IO race ============== 17:51:46 (1751320306)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0843189 s, 149 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=29403: Mon Jun 30 17:51:48 2025
   read: IOPS=381, BW=1527KiB/s (1564kB/s)(1480KiB/969msec)
    clat (usec): min=3, max=42829, avg=1576.01, stdev=3273.19
     lat (usec): min=3, max=42830, avg=1576.62, stdev=3273.22
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   16], 50.00th=[ 1123], 60.00th=[ 1696],
     | 70.00th=[ 2114], 80.00th=[ 2638], 90.00th=[ 3163], 95.00th=[ 4228],
     | 99.00th=[11994], 99.50th=[33162], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min= 1256, max= 1256, per=21.63%, avg=1256.00, stdev= 0.00, samples=1
   iops        : min=  314, max=  314, avg=314.00, stdev= 0.00, samples=1
  write: IOPS=410, BW=1643KiB/s (1682kB/s)(1592KiB/969msec)
    clat (usec): min=83, max=13057, avg=942.55, stdev=1299.71
     lat (usec): min=83, max=13058, avg=944.10, stdev=1299.92
    clat percentiles (usec):
     |  1.00th=[   91],  5.00th=[  103], 10.00th=[  113], 20.00th=[  133],
     | 30.00th=[  167], 40.00th=[  200], 50.00th=[  273], 60.00th=[  799],
     | 70.00th=[ 1037], 80.00th=[ 1663], 90.00th=[ 2474], 95.00th=[ 3261],
     | 99.00th=[ 6063], 99.50th=[ 6456], 99.90th=[13042], 99.95th=[13042],
     | 99.99th=[13042]
   bw (  KiB/s): min= 1288, max= 1288, per=21.08%, avg=1288.00, stdev= 0.00, samples=1
   iops        : min=  322, max=  322, avg=322.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.26%, 10=11.07%, 20=9.37%, 50=0.65%, 100=2.47%
  lat (usec)   : 250=22.66%, 500=4.56%, 750=1.95%, 1000=6.77%
  lat (msec)   : 2=16.28%, 4=20.18%, 10=3.12%, 20=0.39%, 50=0.26%
  cpu          : usr=1.14%, sys=15.50%, ctx=788, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=29404: Mon Jun 30 17:51:48 2025
   read: IOPS=348, BW=1393KiB/s (1426kB/s)(1436KiB/1031msec)
    clat (usec): min=3, max=31680, avg=1608.45, stdev=2681.98
     lat (usec): min=3, max=31681, avg=1609.00, stdev=2682.02
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[   25], 50.00th=[ 1237], 60.00th=[ 1795],
     | 70.00th=[ 2180], 80.00th=[ 2606], 90.00th=[ 3228], 95.00th=[ 4228],
     | 99.00th=[16057], 99.50th=[19006], 99.90th=[31589], 99.95th=[31589],
     | 99.99th=[31589]
   bw (  KiB/s): min=  896, max= 1788, per=23.11%, avg=1342.00, stdev=630.74, samples=2
   iops        : min=  224, max=  447, avg=335.50, stdev=157.68, samples=2
  write: IOPS=396, BW=1587KiB/s (1625kB/s)(1636KiB/1031msec)
    clat (usec): min=90, max=38979, avg=1081.20, stdev=2286.51
     lat (usec): min=91, max=38980, avg=1082.32, stdev=2286.54
    clat percentiles (usec):
     |  1.00th=[   94],  5.00th=[  103], 10.00th=[  111], 20.00th=[  133],
     | 30.00th=[  161], 40.00th=[  200], 50.00th=[  396], 60.00th=[  840],
     | 70.00th=[ 1057], 80.00th=[ 1729], 90.00th=[ 2474], 95.00th=[ 3523],
     | 99.00th=[ 5997], 99.50th=[ 8094], 99.90th=[39060], 99.95th=[39060],
     | 99.99th=[39060]
   bw (  KiB/s): min= 1056, max= 1988, per=24.91%, avg=1522.00, stdev=659.02, samples=2
   iops        : min=  264, max=  497, avg=380.50, stdev=164.76, samples=2
  lat (usec)   : 4=0.26%, 10=10.16%, 20=7.42%, 50=1.43%, 100=2.47%
  lat (usec)   : 250=21.22%, 500=4.04%, 750=3.39%, 1000=7.55%
  lat (msec)   : 2=17.58%, 4=19.66%, 10=3.91%, 20=0.65%, 50=0.26%
  cpu          : usr=0.49%, sys=15.92%, ctx=848, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=29405: Mon Jun 30 17:51:48 2025
   read: IOPS=380, BW=1523KiB/s (1559kB/s)(1564KiB/1027msec)
    clat (usec): min=3, max=41720, avg=1669.06, stdev=3085.81
     lat (usec): min=3, max=41721, avg=1669.67, stdev=3085.86
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[   31], 50.00th=[ 1156], 60.00th=[ 1647],
     | 70.00th=[ 2073], 80.00th=[ 2802], 90.00th=[ 3523], 95.00th=[ 4424],
     | 99.00th=[15926], 99.50th=[23200], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min= 1080, max= 1940, per=26.00%, avg=1510.00, stdev=608.11, samples=2
   iops        : min=  270, max=  485, avg=377.50, stdev=152.03, samples=2
  write: IOPS=367, BW=1468KiB/s (1504kB/s)(1508KiB/1027msec)
    clat (usec): min=83, max=12148, avg=966.53, stdev=1268.32
     lat (usec): min=83, max=12150, avg=967.64, stdev=1268.22
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[  100], 10.00th=[  112], 20.00th=[  128],
     | 30.00th=[  167], 40.00th=[  227], 50.00th=[  359], 60.00th=[  816],
     | 70.00th=[ 1074], 80.00th=[ 1663], 90.00th=[ 2638], 95.00th=[ 3654],
     | 99.00th=[ 5211], 99.50th=[ 6325], 99.90th=[12125], 99.95th=[12125],
     | 99.99th=[12125]
   bw (  KiB/s): min= 1056, max= 1772, per=23.14%, avg=1414.00, stdev=506.29, samples=2
   iops        : min=  264, max=  443, avg=353.50, stdev=126.57, samples=2
  lat (usec)   : 4=1.04%, 10=11.59%, 20=5.99%, 50=1.95%, 100=2.99%
  lat (usec)   : 250=18.36%, 500=5.99%, 750=2.99%, 1000=6.77%
  lat (msec)   : 2=18.23%, 4=19.53%, 10=3.65%, 20=0.65%, 50=0.26%
  cpu          : usr=0.10%, sys=17.45%, ctx=844, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=29406: Mon Jun 30 17:51:48 2025
   read: IOPS=383, BW=1533KiB/s (1569kB/s)(1508KiB/984msec)
    clat (usec): min=3, max=41067, avg=1571.50, stdev=2870.91
     lat (usec): min=3, max=41068, avg=1572.09, stdev=2870.90
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[   18], 50.00th=[ 1004], 60.00th=[ 1713],
     | 70.00th=[ 2180], 80.00th=[ 2704], 90.00th=[ 3392], 95.00th=[ 4555],
     | 99.00th=[12911], 99.50th=[17957], 99.90th=[41157], 99.95th=[41157],
     | 99.99th=[41157]
   bw (  KiB/s): min= 1240, max= 1240, per=21.35%, avg=1240.00, stdev= 0.00, samples=1
   iops        : min=  310, max=  310, avg=310.00, stdev= 0.00, samples=1
  write: IOPS=397, BW=1589KiB/s (1628kB/s)(1564KiB/984msec)
    clat (usec): min=90, max=12288, avg=970.71, stdev=1322.23
     lat (usec): min=90, max=12289, avg=971.42, stdev=1322.25
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  104], 10.00th=[  115], 20.00th=[  137],
     | 30.00th=[  165], 40.00th=[  198], 50.00th=[  310], 60.00th=[  857],
     | 70.00th=[ 1123], 80.00th=[ 1762], 90.00th=[ 2376], 95.00th=[ 2966],
     | 99.00th=[ 7701], 99.50th=[ 9503], 99.90th=[12256], 99.95th=[12256],
     | 99.99th=[12256]
   bw (  KiB/s): min= 1224, max= 1224, per=20.03%, avg=1224.00, stdev= 0.00, samples=1
   iops        : min=  306, max=  306, avg=306.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.78%, 10=11.85%, 20=7.55%, 50=1.43%, 100=2.21%
  lat (usec)   : 250=22.27%, 500=3.78%, 750=1.69%, 1000=6.64%
  lat (msec)   : 2=16.80%, 4=20.96%, 10=3.39%, 20=0.52%, 50=0.13%
  cpu          : usr=0.61%, sys=15.77%, ctx=784, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5808KiB/s (5947kB/s), 1393KiB/s-1533KiB/s (1426kB/s-1569kB/s), io=5988KiB (6132kB), run=969-1031msec
  WRITE: bw=6111KiB/s (6257kB/s), 1468KiB/s-1643KiB/s (1504kB/s-1682kB/s), io=6300KiB (6451kB), run=969-1031msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=29408: Mon Jun 30 17:51:49 2025
   read: IOPS=220, BW=881KiB/s (903kB/s)(1480KiB/1679msec)
    clat (usec): min=523, max=42201, avg=1612.27, stdev=2618.94
     lat (usec): min=524, max=42203, avg=1612.87, stdev=2619.01
    clat percentiles (usec):
     |  1.00th=[  603],  5.00th=[  668], 10.00th=[  701], 20.00th=[  742],
     | 30.00th=[  791], 40.00th=[  832], 50.00th=[  889], 60.00th=[  955],
     | 70.00th=[ 1188], 80.00th=[ 1893], 90.00th=[ 3556], 95.00th=[ 4424],
     | 99.00th=[ 7832], 99.50th=[14484], 99.90th=[42206], 99.95th=[42206],
     | 99.99th=[42206]
   bw (  KiB/s): min=  504, max= 1200, per=22.81%, avg=813.33, stdev=354.39, samples=3
   iops        : min=  126, max=  300, avg=203.33, stdev=88.60, samples=3
  write: IOPS=237, BW=948KiB/s (971kB/s)(1592KiB/1679msec)
    clat (usec): min=1146, max=14952, avg=2689.41, stdev=1525.94
     lat (usec): min=1146, max=14954, avg=2690.13, stdev=1525.95
    clat percentiles (usec):
     |  1.00th=[ 1188],  5.00th=[ 1418], 10.00th=[ 1582], 20.00th=[ 1778],
     | 30.00th=[ 1909], 40.00th=[ 2008], 50.00th=[ 2114], 60.00th=[ 2245],
     | 70.00th=[ 2573], 80.00th=[ 3392], 90.00th=[ 4883], 95.00th=[ 5997],
     | 99.00th=[ 8291], 99.50th=[ 9765], 99.90th=[15008], 99.95th=[15008],
     | 99.99th=[15008]
   bw (  KiB/s): min=  536, max= 1464, per=24.02%, avg=901.33, stdev=494.47, samples=3
   iops        : min=  134, max=  366, avg=225.33, stdev=123.62, samples=3
  lat (usec)   : 750=10.03%, 1000=20.57%
  lat (msec)   : 2=28.52%, 4=29.82%, 10=10.55%, 20=0.39%, 50=0.13%
  cpu          : usr=0.42%, sys=5.90%, ctx=815, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=29409: Mon Jun 30 17:51:49 2025
   read: IOPS=217, BW=871KiB/s (892kB/s)(1436KiB/1649msec)
    clat (usec): min=521, max=43436, avg=1462.37, stdev=2517.74
     lat (usec): min=522, max=43438, avg=1463.10, stdev=2517.75
    clat percentiles (usec):
     |  1.00th=[  586],  5.00th=[  644], 10.00th=[  701], 20.00th=[  758],
     | 30.00th=[  807], 40.00th=[  857], 50.00th=[  914], 60.00th=[ 1004],
     | 70.00th=[ 1188], 80.00th=[ 1549], 90.00th=[ 2638], 95.00th=[ 3916],
     | 99.00th=[ 7242], 99.50th=[12649], 99.90th=[43254], 99.95th=[43254],
     | 99.99th=[43254]
   bw (  KiB/s): min=  496, max= 1333, per=23.30%, avg=831.00, stdev=442.79, samples=3
   iops        : min=  124, max=  333, avg=207.67, stdev=110.55, samples=3
  write: IOPS=248, BW=992KiB/s (1016kB/s)(1636KiB/1649msec)
    clat (usec): min=1079, max=20156, avg=2726.25, stdev=1766.91
     lat (usec): min=1080, max=20158, avg=2727.12, stdev=1767.12
    clat percentiles (usec):
     |  1.00th=[ 1205],  5.00th=[ 1385], 10.00th=[ 1582], 20.00th=[ 1811],
     | 30.00th=[ 1909], 40.00th=[ 2008], 50.00th=[ 2147], 60.00th=[ 2245],
     | 70.00th=[ 2573], 80.00th=[ 3490], 90.00th=[ 4817], 95.00th=[ 5932],
     | 99.00th=[ 7898], 99.50th=[ 8455], 99.90th=[20055], 99.95th=[20055],
     | 99.99th=[20055]
   bw (  KiB/s): min=  584, max= 1373, per=25.13%, avg=943.00, stdev=399.26, samples=3
   iops        : min=  146, max=  343, avg=235.67, stdev=99.68, samples=3
  lat (usec)   : 750=8.33%, 1000=19.40%
  lat (msec)   : 2=32.94%, 4=29.17%, 10=9.64%, 20=0.26%, 50=0.26%
  cpu          : usr=0.49%, sys=5.58%, ctx=847, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=29410: Mon Jun 30 17:51:49 2025
   read: IOPS=241, BW=966KiB/s (989kB/s)(1564KiB/1619msec)
    clat (usec): min=537, max=27428, avg=1495.32, stdev=1797.23
     lat (usec): min=537, max=27428, avg=1495.91, stdev=1797.24
    clat percentiles (usec):
     |  1.00th=[  578],  5.00th=[  676], 10.00th=[  725], 20.00th=[  775],
     | 30.00th=[  816], 40.00th=[  865], 50.00th=[  914], 60.00th=[  988],
     | 70.00th=[ 1205], 80.00th=[ 1631], 90.00th=[ 3195], 95.00th=[ 4359],
     | 99.00th=[ 6783], 99.50th=[10028], 99.90th=[27395], 99.95th=[27395],
     | 99.99th=[27395]
   bw (  KiB/s): min=  496, max= 1416, per=26.02%, avg=928.00, stdev=462.55, samples=3
   iops        : min=  124, max=  354, avg=232.00, stdev=115.64, samples=3
  write: IOPS=232, BW=931KiB/s (954kB/s)(1508KiB/1619msec)
    clat (usec): min=1115, max=50882, avg=2722.70, stdev=2883.76
     lat (usec): min=1116, max=50884, avg=2723.38, stdev=2883.85
    clat percentiles (usec):
     |  1.00th=[ 1172],  5.00th=[ 1401], 10.00th=[ 1631], 20.00th=[ 1811],
     | 30.00th=[ 1893], 40.00th=[ 1975], 50.00th=[ 2114], 60.00th=[ 2278],
     | 70.00th=[ 2540], 80.00th=[ 3032], 90.00th=[ 4424], 95.00th=[ 5407],
     | 99.00th=[10028], 99.50th=[14877], 99.90th=[51119], 99.95th=[51119],
     | 99.99th=[51119]
   bw (  KiB/s): min=  624, max= 1312, per=23.81%, avg=893.33, stdev=367.51, samples=3
   iops        : min=  156, max=  328, avg=223.33, stdev=91.88, samples=3
  lat (usec)   : 750=7.29%, 1000=23.57%
  lat (msec)   : 2=32.03%, 4=27.60%, 10=8.98%, 20=0.26%, 50=0.13%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.49%, sys=5.50%, ctx=817, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=29411: Mon Jun 30 17:51:49 2025
   read: IOPS=230, BW=922KiB/s (944kB/s)(1508KiB/1636msec)
    clat (usec): min=482, max=25915, avg=1461.91, stdev=1737.74
     lat (usec): min=483, max=25916, avg=1462.50, stdev=1737.77
    clat percentiles (usec):
     |  1.00th=[  594],  5.00th=[  668], 10.00th=[  701], 20.00th=[  750],
     | 30.00th=[  791], 40.00th=[  848], 50.00th=[  914], 60.00th=[ 1012],
     | 70.00th=[ 1188], 80.00th=[ 1778], 90.00th=[ 3032], 95.00th=[ 4228],
     | 99.00th=[ 6652], 99.50th=[10290], 99.90th=[25822], 99.95th=[25822],
     | 99.99th=[25822]
   bw (  KiB/s): min=  528, max= 1264, per=24.60%, avg=877.33, stdev=369.42, samples=3
   iops        : min=  132, max=  316, avg=219.33, stdev=92.35, samples=3
  write: IOPS=238, BW=956KiB/s (979kB/s)(1564KiB/1636msec)
    clat (usec): min=1094, max=50896, avg=2744.41, stdev=2792.72
     lat (usec): min=1095, max=50898, avg=2745.10, stdev=2792.80
    clat percentiles (usec):
     |  1.00th=[ 1237],  5.00th=[ 1450], 10.00th=[ 1631], 20.00th=[ 1844],
     | 30.00th=[ 1926], 40.00th=[ 2008], 50.00th=[ 2114], 60.00th=[ 2278],
     | 70.00th=[ 2638], 80.00th=[ 3261], 90.00th=[ 4490], 95.00th=[ 5669],
     | 99.00th=[ 8717], 99.50th=[11731], 99.90th=[51119], 99.95th=[51119],
     | 99.99th=[51119]
   bw (  KiB/s): min=  568, max= 1392, per=24.45%, avg=917.33, stdev=426.06, samples=3
   iops        : min=  142, max=  348, avg=229.33, stdev=106.51, samples=3
  lat (usec)   : 500=0.13%, 750=9.64%, 1000=19.40%
  lat (msec)   : 2=32.03%, 4=29.56%, 10=8.72%, 20=0.26%, 50=0.13%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.31%, sys=6.06%, ctx=803, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3566KiB/s (3652kB/s), 871KiB/s-966KiB/s (892kB/s-989kB/s), io=5988KiB (6132kB), run=1619-1679msec
  WRITE: bw=3752KiB/s (3842kB/s), 931KiB/s-992KiB/s (954kB/s-1016kB/s), io=6300KiB (6451kB), run=1619-1679msec