== sanity test 398b: DIO and buffer IO race ============== 19:43:54 (1736988234)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0823554 s, 153 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=20073: Wed Jan 15 19:43:57 2025
   read: IOPS=341, BW=1368KiB/s (1401kB/s)(1480KiB/1082msec)
    clat (usec): min=3, max=29028, avg=1705.95, stdev=2472.72
     lat (usec): min=3, max=29029, avg=1706.53, stdev=2472.75
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[  734], 50.00th=[ 1385], 60.00th=[ 1778],
     | 70.00th=[ 2343], 80.00th=[ 2835], 90.00th=[ 3523], 95.00th=[ 4817],
     | 99.00th=[11076], 99.50th=[17433], 99.90th=[28967], 99.95th=[28967],
     | 99.99th=[28967]
   bw (  KiB/s): min=  912, max= 1744, per=24.02%, avg=1328.00, stdev=588.31, samples=2
   iops        : min=  228, max=  436, avg=332.00, stdev=147.08, samples=2
  write: IOPS=367, BW=1471KiB/s (1507kB/s)(1592KiB/1082msec)
    clat (usec): min=81, max=12848, avg=1117.06, stdev=1431.01
     lat (usec): min=81, max=12849, avg=1117.97, stdev=1431.17
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  109], 10.00th=[  117], 20.00th=[  147],
     | 30.00th=[  178], 40.00th=[  241], 50.00th=[  775], 60.00th=[  988],
     | 70.00th=[ 1254], 80.00th=[ 1860], 90.00th=[ 2769], 95.00th=[ 3589],
     | 99.00th=[ 7111], 99.50th=[ 8225], 99.90th=[12911], 99.95th=[12911],
     | 99.99th=[12911]
   bw (  KiB/s): min=  912, max= 1976, per=24.82%, avg=1444.00, stdev=752.36, samples=2
   iops        : min=  228, max=  494, avg=361.00, stdev=188.09, samples=2
  lat (usec)   : 4=0.26%, 10=9.64%, 20=7.68%, 50=0.26%, 100=1.82%
  lat (usec)   : 250=20.31%, 500=3.39%, 750=1.04%, 1000=7.55%
  lat (msec)   : 2=22.01%, 4=20.70%, 10=4.69%, 20=0.52%, 50=0.13%
  cpu          : usr=0.19%, sys=17.48%, ctx=946, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20074: Wed Jan 15 19:43:57 2025
   read: IOPS=331, BW=1326KiB/s (1358kB/s)(1436KiB/1083msec)
    clat (usec): min=3, max=24401, avg=1853.82, stdev=2885.61
     lat (usec): min=3, max=24401, avg=1854.41, stdev=2885.62
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   15], 40.00th=[  906], 50.00th=[ 1549], 60.00th=[ 1926],
     | 70.00th=[ 2311], 80.00th=[ 2737], 90.00th=[ 3458], 95.00th=[ 5080],
     | 99.00th=[19006], 99.50th=[24249], 99.90th=[24511], 99.95th=[24511],
     | 99.99th=[24511]
   bw (  KiB/s): min=  904, max= 1728, per=23.80%, avg=1316.00, stdev=582.66, samples=2
   iops        : min=  226, max=  432, avg=329.00, stdev=145.66, samples=2
  write: IOPS=377, BW=1511KiB/s (1547kB/s)(1636KiB/1083msec)
    clat (usec): min=83, max=8503, avg=1003.13, stdev=1240.98
     lat (usec): min=83, max=8504, avg=1003.94, stdev=1240.92
    clat percentiles (usec):
     |  1.00th=[   96],  5.00th=[  106], 10.00th=[  117], 20.00th=[  147],
     | 30.00th=[  167], 40.00th=[  202], 50.00th=[  545], 60.00th=[  881],
     | 70.00th=[ 1090], 80.00th=[ 1811], 90.00th=[ 2606], 95.00th=[ 3294],
     | 99.00th=[ 5342], 99.50th=[ 7111], 99.90th=[ 8455], 99.95th=[ 8455],
     | 99.99th=[ 8455]
   bw (  KiB/s): min= 1056, max= 1888, per=25.31%, avg=1472.00, stdev=588.31, samples=2
   iops        : min=  264, max=  472, avg=368.00, stdev=147.08, samples=2
  lat (usec)   : 4=0.52%, 10=8.46%, 20=7.16%, 50=0.39%, 100=1.69%
  lat (usec)   : 250=22.53%, 500=2.73%, 750=1.69%, 1000=9.51%
  lat (msec)   : 2=18.36%, 4=21.74%, 10=4.30%, 20=0.52%, 50=0.39%
  cpu          : usr=0.83%, sys=20.33%, ctx=934, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20075: Wed Jan 15 19:43:57 2025
   read: IOPS=375, BW=1501KiB/s (1537kB/s)(1564KiB/1042msec)
    clat (usec): min=3, max=14148, avg=1493.15, stdev=1778.02
     lat (usec): min=3, max=14149, avg=1493.72, stdev=1778.04
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    7], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   69], 50.00th=[ 1319], 60.00th=[ 1745],
     | 70.00th=[ 2147], 80.00th=[ 2671], 90.00th=[ 3326], 95.00th=[ 3884],
     | 99.00th=[ 8094], 99.50th=[12911], 99.90th=[14091], 99.95th=[14091],
     | 99.99th=[14091]
   bw (  KiB/s): min= 1112, max= 1840, per=26.70%, avg=1476.00, stdev=514.77, samples=2
   iops        : min=  278, max=  460, avg=369.00, stdev=128.69, samples=2
  write: IOPS=361, BW=1447KiB/s (1482kB/s)(1508KiB/1042msec)
    clat (usec): min=83, max=19056, avg=1195.53, stdev=1642.55
     lat (usec): min=84, max=19058, avg=1196.19, stdev=1642.57
    clat percentiles (usec):
     |  1.00th=[   93],  5.00th=[  108], 10.00th=[  115], 20.00th=[  149],
     | 30.00th=[  178], 40.00th=[  318], 50.00th=[  807], 60.00th=[ 1004],
     | 70.00th=[ 1319], 80.00th=[ 2114], 90.00th=[ 2769], 95.00th=[ 3884],
     | 99.00th=[ 7767], 99.50th=[ 9503], 99.90th=[19006], 99.95th=[19006],
     | 99.99th=[19006]
   bw (  KiB/s): min= 1064, max= 1704, per=23.79%, avg=1384.00, stdev=452.55, samples=2
   iops        : min=  266, max=  426, avg=346.00, stdev=113.14, samples=2
  lat (usec)   : 4=0.65%, 10=10.03%, 20=8.98%, 50=0.52%, 100=1.56%
  lat (usec)   : 250=17.32%, 500=3.52%, 750=2.08%, 1000=7.29%
  lat (msec)   : 2=19.92%, 4=23.70%, 10=3.91%, 20=0.52%
  cpu          : usr=0.96%, sys=16.41%, ctx=927, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20076: Wed Jan 15 19:43:57 2025
   read: IOPS=376, BW=1505KiB/s (1541kB/s)(1508KiB/1002msec)
    clat (usec): min=3, max=24146, avg=1443.05, stdev=2041.47
     lat (usec): min=3, max=24146, avg=1443.61, stdev=2041.48
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   16], 50.00th=[ 1287], 60.00th=[ 1729],
     | 70.00th=[ 2114], 80.00th=[ 2507], 90.00th=[ 3163], 95.00th=[ 3884],
     | 99.00th=[ 8291], 99.50th=[14615], 99.90th=[24249], 99.95th=[24249],
     | 99.99th=[24249]
   bw (  KiB/s): min=  984, max= 2000, per=26.98%, avg=1492.00, stdev=718.42, samples=2
   iops        : min=  246, max=  500, avg=373.00, stdev=179.61, samples=2
  write: IOPS=390, BW=1561KiB/s (1598kB/s)(1564KiB/1002msec)
    clat (usec): min=92, max=17927, avg=1151.11, stdev=1741.01
     lat (usec): min=92, max=17928, avg=1154.54, stdev=1740.45
    clat percentiles (usec):
     |  1.00th=[   94],  5.00th=[  110], 10.00th=[  118], 20.00th=[  145],
     | 30.00th=[  172], 40.00th=[  219], 50.00th=[  486], 60.00th=[  930],
     | 70.00th=[ 1254], 80.00th=[ 1893], 90.00th=[ 2933], 95.00th=[ 3851],
     | 99.00th=[ 8291], 99.50th=[15008], 99.90th=[17957], 99.95th=[17957],
     | 99.99th=[17957]
   bw (  KiB/s): min= 1008, max= 2112, per=26.82%, avg=1560.00, stdev=780.65, samples=2
   iops        : min=  252, max=  528, avg=390.00, stdev=195.16, samples=2
  lat (usec)   : 4=0.91%, 10=11.98%, 20=7.03%, 50=0.78%, 100=1.43%
  lat (usec)   : 250=21.22%, 500=3.52%, 750=1.95%, 1000=6.51%
  lat (msec)   : 2=19.53%, 4=20.83%, 10=3.65%, 20=0.52%, 50=0.13%
  cpu          : usr=0.70%, sys=16.78%, ctx=821, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5529KiB/s (5662kB/s), 1326KiB/s-1505KiB/s (1358kB/s-1541kB/s), io=5988KiB (6132kB), run=1002-1083msec
  WRITE: bw=5817KiB/s (5957kB/s), 1447KiB/s-1561KiB/s (1482kB/s-1598kB/s), io=6300KiB (6451kB), run=1002-1083msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=20069: Wed Jan 15 19:43:57 2025
   read: IOPS=217, BW=870KiB/s (891kB/s)(1480KiB/1701msec)
    clat (usec): min=629, max=17103, avg=1458.12, stdev=1365.70
     lat (usec): min=630, max=17104, avg=1459.33, stdev=1366.96
    clat percentiles (usec):
     |  1.00th=[  644],  5.00th=[  693], 10.00th=[  725], 20.00th=[  783],
     | 30.00th=[  832], 40.00th=[  889], 50.00th=[  947], 60.00th=[ 1057],
     | 70.00th=[ 1303], 80.00th=[ 1745], 90.00th=[ 3097], 95.00th=[ 4080],
     | 99.00th=[ 5866], 99.50th=[ 7504], 99.90th=[17171], 99.95th=[17171],
     | 99.99th=[17171]
   bw (  KiB/s): min=  520, max= 1160, per=23.19%, avg=805.33, stdev=325.58, samples=3
   iops        : min=  130, max=  290, avg=201.33, stdev=81.40, samples=3
  write: IOPS=233, BW=936KiB/s (958kB/s)(1592KiB/1701msec)
    clat (usec): min=1133, max=31548, avg=2888.64, stdev=2315.10
     lat (usec): min=1134, max=31549, avg=2889.45, stdev=2315.10
    clat percentiles (usec):
     |  1.00th=[ 1205],  5.00th=[ 1352], 10.00th=[ 1631], 20.00th=[ 1778],
     | 30.00th=[ 1893], 40.00th=[ 1991], 50.00th=[ 2147], 60.00th=[ 2376],
     | 70.00th=[ 2900], 80.00th=[ 3589], 90.00th=[ 4883], 95.00th=[ 6194],
     | 99.00th=[12649], 99.50th=[19006], 99.90th=[31589], 99.95th=[31589],
     | 99.99th=[31589]
   bw (  KiB/s): min=  544, max= 1360, per=24.16%, avg=882.67, stdev=425.31, samples=3
   iops        : min=  136, max=  340, avg=220.67, stdev=106.33, samples=3
  lat (usec)   : 750=6.64%, 1000=20.05%
  lat (msec)   : 2=34.51%, 4=28.26%, 10=9.64%, 20=0.78%, 50=0.13%
  cpu          : usr=0.47%, sys=6.06%, ctx=820, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20070: Wed Jan 15 19:43:57 2025
   read: IOPS=208, BW=835KiB/s (855kB/s)(1436KiB/1719msec)
    clat (usec): min=571, max=24544, avg=1601.23, stdev=2139.62
     lat (usec): min=572, max=24545, avg=1601.89, stdev=2139.62
    clat percentiles (usec):
     |  1.00th=[  627],  5.00th=[  668], 10.00th=[  734], 20.00th=[  775],
     | 30.00th=[  816], 40.00th=[  873], 50.00th=[  930], 60.00th=[ 1037],
     | 70.00th=[ 1237], 80.00th=[ 1729], 90.00th=[ 3425], 95.00th=[ 4686],
     | 99.00th=[ 9503], 99.50th=[20579], 99.90th=[24511], 99.95th=[24511],
     | 99.99th=[24511]
   bw (  KiB/s): min=  512, max= 1272, per=22.88%, avg=794.67, stdev=415.72, samples=3
   iops        : min=  128, max=  318, avg=198.67, stdev=103.93, samples=3
  write: IOPS=237, BW=952KiB/s (975kB/s)(1636KiB/1719msec)
    clat (usec): min=1192, max=24956, avg=2769.18, stdev=1801.77
     lat (usec): min=1193, max=24957, avg=2769.93, stdev=1801.78
    clat percentiles (usec):
     |  1.00th=[ 1270],  5.00th=[ 1401], 10.00th=[ 1598], 20.00th=[ 1827],
     | 30.00th=[ 1942], 40.00th=[ 2073], 50.00th=[ 2212], 60.00th=[ 2442],
     | 70.00th=[ 2900], 80.00th=[ 3425], 90.00th=[ 4424], 95.00th=[ 5473],
     | 99.00th=[ 8455], 99.50th=[10028], 99.90th=[25035], 99.95th=[25035],
     | 99.99th=[25035]
   bw (  KiB/s): min=  584, max= 1272, per=24.01%, avg=877.33, stdev=355.02, samples=3
   iops        : min=  146, max=  318, avg=219.33, stdev=88.75, samples=3
  lat (usec)   : 750=6.25%, 1000=20.83%
  lat (msec)   : 2=30.21%, 4=31.51%, 10=10.55%, 20=0.26%, 50=0.39%
  cpu          : usr=0.12%, sys=6.00%, ctx=822, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20071: Wed Jan 15 19:43:57 2025
   read: IOPS=233, BW=934KiB/s (956kB/s)(1564KiB/1675msec)
    clat (usec): min=565, max=13768, avg=1529.77, stdev=1529.16
     lat (usec): min=565, max=13769, avg=1530.42, stdev=1529.19
    clat percentiles (usec):
     |  1.00th=[  603],  5.00th=[  668], 10.00th=[  734], 20.00th=[  783],
     | 30.00th=[  824], 40.00th=[  865], 50.00th=[  930], 60.00th=[ 1037],
     | 70.00th=[ 1221], 80.00th=[ 1844], 90.00th=[ 3163], 95.00th=[ 4621],
     | 99.00th=[ 7635], 99.50th=[12125], 99.90th=[13829], 99.95th=[13829],
     | 99.99th=[13829]
   bw (  KiB/s): min=  472, max= 1296, per=24.80%, avg=861.33, stdev=413.87, samples=3
   iops        : min=  118, max=  324, avg=215.33, stdev=103.47, samples=3
  write: IOPS=225, BW=900KiB/s (922kB/s)(1508KiB/1675msec)
    clat (usec): min=1131, max=19315, avg=2823.07, stdev=1741.72
     lat (usec): min=1132, max=19317, avg=2823.96, stdev=1741.75
    clat percentiles (usec):
     |  1.00th=[ 1254],  5.00th=[ 1401], 10.00th=[ 1647], 20.00th=[ 1795],
     | 30.00th=[ 1909], 40.00th=[ 2040], 50.00th=[ 2180], 60.00th=[ 2376],
     | 70.00th=[ 2868], 80.00th=[ 3720], 90.00th=[ 5014], 95.00th=[ 5932],
     | 99.00th=[ 8455], 99.50th=[11863], 99.90th=[19268], 99.95th=[19268],
     | 99.99th=[19268]
   bw (  KiB/s): min=  584, max= 1272, per=23.43%, avg=856.00, stdev=365.91, samples=3
   iops        : min=  146, max=  318, avg=214.00, stdev=91.48, samples=3
  lat (usec)   : 750=6.77%, 1000=22.14%
  lat (msec)   : 2=30.21%, 4=28.52%, 10=11.72%, 20=0.65%
  cpu          : usr=0.12%, sys=6.15%, ctx=819, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20072: Wed Jan 15 19:43:57 2025
   read: IOPS=218, BW=875KiB/s (896kB/s)(1508KiB/1724msec)
    clat (usec): min=585, max=26043, avg=1669.99, stdev=2158.59
     lat (usec): min=586, max=26044, avg=1670.65, stdev=2158.59
    clat percentiles (usec):
     |  1.00th=[  644],  5.00th=[  693], 10.00th=[  742], 20.00th=[  791],
     | 30.00th=[  832], 40.00th=[  889], 50.00th=[  955], 60.00th=[ 1090],
     | 70.00th=[ 1352], 80.00th=[ 1991], 90.00th=[ 3556], 95.00th=[ 4948],
     | 99.00th=[12125], 99.50th=[16909], 99.90th=[26084], 99.95th=[26084],
     | 99.99th=[26084]
   bw (  KiB/s): min=  496, max= 1104, per=22.50%, avg=781.33, stdev=305.71, samples=3
   iops        : min=  124, max=  276, avg=195.33, stdev=76.43, samples=3
  write: IOPS=226, BW=907KiB/s (929kB/s)(1564KiB/1724msec)
    clat (usec): min=1088, max=22271, avg=2774.96, stdev=1785.64
     lat (usec): min=1088, max=22273, avg=2775.85, stdev=1785.82
    clat percentiles (usec):
     |  1.00th=[ 1221],  5.00th=[ 1369], 10.00th=[ 1631], 20.00th=[ 1795],
     | 30.00th=[ 1893], 40.00th=[ 1975], 50.00th=[ 2114], 60.00th=[ 2311],
     | 70.00th=[ 2704], 80.00th=[ 3785], 90.00th=[ 4817], 95.00th=[ 5800],
     | 99.00th=[ 8225], 99.50th=[13042], 99.90th=[22152], 99.95th=[22152],
     | 99.99th=[22152]
   bw (  KiB/s): min=  552, max= 1304, per=23.28%, avg=850.67, stdev=399.15, samples=3
   iops        : min=  138, max=  326, avg=212.67, stdev=99.79, samples=3
  lat (usec)   : 750=5.73%, 1000=21.22%
  lat (msec)   : 2=33.07%, 4=27.21%, 10=11.98%, 20=0.52%, 50=0.26%
  cpu          : usr=0.46%, sys=5.75%, ctx=826, majf=0, minf=31
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3473KiB/s (3557kB/s), 835KiB/s-934KiB/s (855kB/s-956kB/s), io=5988KiB (6132kB), run=1675-1724msec
  WRITE: bw=3654KiB/s (3742kB/s), 900KiB/s-952KiB/s (922kB/s-975kB/s), io=6300KiB (6451kB), run=1675-1724msec