== sanity test 398b: DIO and buffer IO race ============== 12:05:31 (1747411531)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0677001 s, 186 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=17469: Fri May 16 12:05:33 2025
   read: IOPS=374, BW=1496KiB/s (1532kB/s)(1480KiB/989msec)
    clat (usec): min=3, max=27912, avg=1502.33, stdev=2190.81
     lat (usec): min=3, max=27912, avg=1503.08, stdev=2190.96
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   18], 50.00th=[ 1156], 60.00th=[ 1729],
     | 70.00th=[ 2278], 80.00th=[ 2606], 90.00th=[ 3064], 95.00th=[ 4146],
     | 99.00th=[ 7963], 99.50th=[16188], 99.90th=[27919], 99.95th=[27919],
     | 99.99th=[27919]
   bw (  KiB/s): min= 1184, max= 1184, per=20.15%, avg=1184.00, stdev= 0.00, samples=1
   iops        : min=  296, max=  296, avg=296.00, stdev= 0.00, samples=1
  write: IOPS=402, BW=1610KiB/s (1648kB/s)(1592KiB/989msec)
    clat (usec): min=79, max=11878, avg=1073.88, stdev=1378.91
     lat (usec): min=80, max=11879, avg=1074.50, stdev=1378.93
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[  116], 10.00th=[  127], 20.00th=[  141],
     | 30.00th=[  155], 40.00th=[  188], 50.00th=[  603], 60.00th=[  938],
     | 70.00th=[ 1205], 80.00th=[ 1893], 90.00th=[ 2704], 95.00th=[ 3818],
     | 99.00th=[ 6128], 99.50th=[ 7308], 99.90th=[11863], 99.95th=[11863],
     | 99.99th=[11863]
   bw (  KiB/s): min= 1136, max= 1136, per=18.38%, avg=1136.00, stdev= 0.00, samples=1
   iops        : min=  284, max=  284, avg=284.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.26%, 10=10.42%, 20=8.59%, 50=0.39%, 100=1.69%
  lat (usec)   : 250=22.01%, 500=2.73%, 750=1.04%, 1000=8.72%
  lat (msec)   : 2=18.49%, 4=20.96%, 10=4.30%, 20=0.26%, 50=0.13%
  cpu          : usr=0.20%, sys=16.89%, ctx=838, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17470: Fri May 16 12:05:33 2025
   read: IOPS=352, BW=1412KiB/s (1446kB/s)(1436KiB/1017msec)
    clat (usec): min=3, max=15314, avg=1463.29, stdev=1978.92
     lat (usec): min=3, max=15314, avg=1464.84, stdev=1980.51
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[   14], 50.00th=[ 1074], 60.00th=[ 1713],
     | 70.00th=[ 2114], 80.00th=[ 2540], 90.00th=[ 3163], 95.00th=[ 4228],
     | 99.00th=[ 9372], 99.50th=[14091], 99.90th=[15270], 99.95th=[15270],
     | 99.99th=[15270]
   bw (  KiB/s): min=  960, max= 1872, per=24.10%, avg=1416.00, stdev=644.88, samples=2
   iops        : min=  240, max=  468, avg=354.00, stdev=161.22, samples=2
  write: IOPS=402, BW=1609KiB/s (1647kB/s)(1636KiB/1017msec)
    clat (usec): min=79, max=32315, avg=1186.34, stdev=2026.72
     lat (usec): min=79, max=32316, avg=1187.30, stdev=2026.58
    clat percentiles (usec):
     |  1.00th=[   91],  5.00th=[  100], 10.00th=[  117], 20.00th=[  139],
     | 30.00th=[  157], 40.00th=[  251], 50.00th=[  791], 60.00th=[  996],
     | 70.00th=[ 1287], 80.00th=[ 2008], 90.00th=[ 2704], 95.00th=[ 3490],
     | 99.00th=[ 6128], 99.50th=[ 6849], 99.90th=[32375], 99.95th=[32375],
     | 99.99th=[32375]
   bw (  KiB/s): min= 1184, max= 2040, per=26.08%, avg=1612.00, stdev=605.28, samples=2
   iops        : min=  296, max=  510, avg=403.00, stdev=151.32, samples=2
  lat (usec)   : 4=0.52%, 10=11.20%, 20=8.20%, 50=0.39%, 100=2.60%
  lat (usec)   : 250=18.62%, 500=2.86%, 750=2.21%, 1000=7.94%
  lat (msec)   : 2=19.79%, 4=21.09%, 10=3.91%, 20=0.52%, 50=0.13%
  cpu          : usr=0.10%, sys=15.55%, ctx=840, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17471: Fri May 16 12:05:33 2025
   read: IOPS=383, BW=1535KiB/s (1572kB/s)(1564KiB/1019msec)
    clat (usec): min=3, max=24655, avg=1394.31, stdev=2035.11
     lat (usec): min=3, max=24655, avg=1395.06, stdev=2035.26
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   13], 50.00th=[  938], 60.00th=[ 1565],
     | 70.00th=[ 2040], 80.00th=[ 2507], 90.00th=[ 3261], 95.00th=[ 3818],
     | 99.00th=[ 8717], 99.50th=[10159], 99.90th=[24773], 99.95th=[24773],
     | 99.99th=[24773]
   bw (  KiB/s): min=  968, max=  968, per=16.47%, avg=968.00, stdev= 0.00, samples=1
   iops        : min=  242, max=  242, avg=242.00, stdev= 0.00, samples=1
  write: IOPS=369, BW=1480KiB/s (1515kB/s)(1508KiB/1019msec)
    clat (usec): min=76, max=30308, avg=1243.19, stdev=2107.73
     lat (usec): min=76, max=30308, avg=1243.82, stdev=2107.75
    clat percentiles (usec):
     |  1.00th=[   94],  5.00th=[  112], 10.00th=[  131], 20.00th=[  143],
     | 30.00th=[  157], 40.00th=[  184], 50.00th=[  717], 60.00th=[  930],
     | 70.00th=[ 1319], 80.00th=[ 2147], 90.00th=[ 2999], 95.00th=[ 4555],
     | 99.00th=[ 6849], 99.50th=[ 9765], 99.90th=[30278], 99.95th=[30278],
     | 99.99th=[30278]
   bw (  KiB/s): min= 1000, max= 1000, per=16.18%, avg=1000.00, stdev= 0.00, samples=1
   iops        : min=  250, max=  250, avg=250.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.65%, 10=14.45%, 20=7.42%, 50=0.39%, 100=1.43%
  lat (usec)   : 250=20.57%, 500=2.60%, 750=1.30%, 1000=8.85%
  lat (msec)   : 2=15.62%, 4=21.35%, 10=4.95%, 20=0.13%, 50=0.26%
  cpu          : usr=0.29%, sys=16.70%, ctx=819, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17472: Fri May 16 12:05:33 2025
   read: IOPS=391, BW=1568KiB/s (1605kB/s)(1508KiB/962msec)
    clat (usec): min=2, max=16108, avg=1408.68, stdev=1877.07
     lat (usec): min=3, max=16108, avg=1409.51, stdev=1877.12
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   13], 50.00th=[ 1004], 60.00th=[ 1565],
     | 70.00th=[ 2040], 80.00th=[ 2540], 90.00th=[ 3458], 95.00th=[ 4228],
     | 99.00th=[ 9765], 99.50th=[11207], 99.90th=[16057], 99.95th=[16057],
     | 99.99th=[16057]
   bw (  KiB/s): min= 1120, max= 1120, per=19.06%, avg=1120.00, stdev= 0.00, samples=1
   iops        : min=  280, max=  280, avg=280.00, stdev= 0.00, samples=1
  write: IOPS=406, BW=1626KiB/s (1665kB/s)(1564KiB/962msec)
    clat (usec): min=78, max=34050, avg=1085.88, stdev=2084.10
     lat (usec): min=78, max=34051, avg=1086.54, stdev=2084.14
    clat percentiles (usec):
     |  1.00th=[   93],  5.00th=[  110], 10.00th=[  122], 20.00th=[  137],
     | 30.00th=[  151], 40.00th=[  174], 50.00th=[  424], 60.00th=[  881],
     | 70.00th=[ 1074], 80.00th=[ 1893], 90.00th=[ 2671], 95.00th=[ 3785],
     | 99.00th=[ 6390], 99.50th=[ 7111], 99.90th=[33817], 99.95th=[33817],
     | 99.99th=[33817]
   bw (  KiB/s): min= 1080, max= 1080, per=17.47%, avg=1080.00, stdev= 0.00, samples=1
   iops        : min=  270, max=  270, avg=270.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.91%, 10=12.76%, 20=7.68%, 50=0.39%, 100=1.56%
  lat (usec)   : 250=23.31%, 500=1.56%, 750=1.43%, 1000=8.72%
  lat (msec)   : 2=18.23%, 4=18.10%, 10=4.82%, 20=0.39%, 50=0.13%
  cpu          : usr=0.21%, sys=16.65%, ctx=772, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5876KiB/s (6017kB/s), 1412KiB/s-1568KiB/s (1446kB/s-1605kB/s), io=5988KiB (6132kB), run=962-1019msec
  WRITE: bw=6183KiB/s (6331kB/s), 1480KiB/s-1626KiB/s (1515kB/s-1665kB/s), io=6300KiB (6451kB), run=962-1019msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=17464: Fri May 16 12:05:34 2025
   read: IOPS=209, BW=836KiB/s (856kB/s)(1480KiB/1770msec)
    clat (usec): min=600, max=9577, avg=1466.37, stdev=1201.17
     lat (usec): min=600, max=9578, avg=1467.12, stdev=1201.12
    clat percentiles (usec):
     |  1.00th=[  635],  5.00th=[  693], 10.00th=[  734], 20.00th=[  807],
     | 30.00th=[  857], 40.00th=[  930], 50.00th=[  988], 60.00th=[ 1090],
     | 70.00th=[ 1319], 80.00th=[ 1778], 90.00th=[ 3064], 95.00th=[ 4178],
     | 99.00th=[ 6456], 99.50th=[ 8586], 99.90th=[ 9634], 99.95th=[ 9634],
     | 99.99th=[ 9634]
   bw (  KiB/s): min=  616, max= 1040, per=23.10%, avg=781.33, stdev=226.89, samples=3
   iops        : min=  154, max=  260, avg=195.33, stdev=56.72, samples=3
  write: IOPS=224, BW=899KiB/s (921kB/s)(1592KiB/1770msec)
    clat (usec): min=1270, max=30767, avg=3055.66, stdev=2069.29
     lat (usec): min=1271, max=30768, avg=3056.43, stdev=2069.28
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1565], 10.00th=[ 1811], 20.00th=[ 1991],
     | 30.00th=[ 2147], 40.00th=[ 2278], 50.00th=[ 2442], 60.00th=[ 2671],
     | 70.00th=[ 3064], 80.00th=[ 3720], 90.00th=[ 5211], 95.00th=[ 6325],
     | 99.00th=[ 9241], 99.50th=[11207], 99.90th=[30802], 99.95th=[30802],
     | 99.99th=[30802]
   bw (  KiB/s): min=  600, max= 1200, per=23.60%, avg=840.00, stdev=317.49, samples=3
   iops        : min=  150, max=  300, avg=210.00, stdev=79.37, samples=3
  lat (usec)   : 750=5.86%, 1000=18.75%
  lat (msec)   : 2=26.04%, 4=37.37%, 10=11.72%, 20=0.13%, 50=0.13%
  cpu          : usr=0.34%, sys=5.99%, ctx=814, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17465: Fri May 16 12:05:34 2025
   read: IOPS=204, BW=817KiB/s (836kB/s)(1436KiB/1758msec)
    clat (usec): min=586, max=27631, avg=1590.63, stdev=1951.89
     lat (usec): min=587, max=27631, avg=1591.49, stdev=1951.80
    clat percentiles (usec):
     |  1.00th=[  627],  5.00th=[  709], 10.00th=[  750], 20.00th=[  807],
     | 30.00th=[  865], 40.00th=[  930], 50.00th=[ 1004], 60.00th=[ 1123],
     | 70.00th=[ 1352], 80.00th=[ 1778], 90.00th=[ 2933], 95.00th=[ 4621],
     | 99.00th=[ 8455], 99.50th=[12649], 99.90th=[27657], 99.95th=[27657],
     | 99.99th=[27657]
   bw (  KiB/s): min=  576, max= 1208, per=23.33%, avg=789.33, stdev=362.60, samples=3
   iops        : min=  144, max=  302, avg=197.33, stdev=90.65, samples=3
  write: IOPS=232, BW=931KiB/s (953kB/s)(1636KiB/1758msec)
    clat (usec): min=1276, max=9800, avg=2880.53, stdev=1376.56
     lat (usec): min=1277, max=9800, avg=2881.24, stdev=1376.56
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1467], 10.00th=[ 1729], 20.00th=[ 1958],
     | 30.00th=[ 2114], 40.00th=[ 2278], 50.00th=[ 2409], 60.00th=[ 2671],
     | 70.00th=[ 3032], 80.00th=[ 3556], 90.00th=[ 4752], 95.00th=[ 5932],
     | 99.00th=[ 8029], 99.50th=[ 8225], 99.90th=[ 9765], 99.95th=[ 9765],
     | 99.99th=[ 9765]
   bw (  KiB/s): min=  648, max= 1136, per=24.28%, avg=864.00, stdev=248.77, samples=3
   iops        : min=  162, max=  284, avg=216.00, stdev=62.19, samples=3
  lat (usec)   : 750=4.30%, 1000=19.01%
  lat (msec)   : 2=27.73%, 4=38.41%, 10=10.29%, 20=0.13%, 50=0.13%
  cpu          : usr=0.23%, sys=5.75%, ctx=823, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17466: Fri May 16 12:05:34 2025
   read: IOPS=221, BW=885KiB/s (906kB/s)(1564KiB/1767msec)
    clat (usec): min=536, max=25228, avg=1530.16, stdev=1654.04
     lat (usec): min=537, max=25229, avg=1530.79, stdev=1654.06
    clat percentiles (usec):
     |  1.00th=[  635],  5.00th=[  693], 10.00th=[  750], 20.00th=[  824],
     | 30.00th=[  873], 40.00th=[  922], 50.00th=[  988], 60.00th=[ 1123],
     | 70.00th=[ 1369], 80.00th=[ 1844], 90.00th=[ 2999], 95.00th=[ 4359],
     | 99.00th=[ 6390], 99.50th=[ 8094], 99.90th=[25297], 99.95th=[25297],
     | 99.99th=[25297]
   bw (  KiB/s): min=  480, max= 1128, per=23.57%, avg=797.33, stdev=324.21, samples=3
   iops        : min=  120, max=  282, avg=199.33, stdev=81.05, samples=3
  write: IOPS=213, BW=853KiB/s (874kB/s)(1508KiB/1767msec)
    clat (usec): min=1061, max=17455, avg=3072.69, stdev=1762.94
     lat (usec): min=1062, max=17455, avg=3073.61, stdev=1762.89
    clat percentiles (usec):
     |  1.00th=[ 1287],  5.00th=[ 1582], 10.00th=[ 1762], 20.00th=[ 1991],
     | 30.00th=[ 2147], 40.00th=[ 2278], 50.00th=[ 2507], 60.00th=[ 2802],
     | 70.00th=[ 3163], 80.00th=[ 4015], 90.00th=[ 5211], 95.00th=[ 6063],
     | 99.00th=[ 9765], 99.50th=[14877], 99.90th=[17433], 99.95th=[17433],
     | 99.99th=[17433]
   bw (  KiB/s): min=  608, max= 1168, per=22.55%, avg=802.67, stdev=316.62, samples=3
   iops        : min=  152, max=  292, avg=200.67, stdev=79.15, samples=3
  lat (usec)   : 750=4.95%, 1000=21.61%
  lat (msec)   : 2=25.26%, 4=35.03%, 10=12.63%, 20=0.39%, 50=0.13%
  cpu          : usr=0.62%, sys=5.32%, ctx=824, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17467: Fri May 16 12:05:34 2025
   read: IOPS=216, BW=864KiB/s (885kB/s)(1508KiB/1745msec)
    clat (usec): min=528, max=24946, avg=1694.54, stdev=1902.12
     lat (usec): min=529, max=24947, avg=1695.16, stdev=1902.12
    clat percentiles (usec):
     |  1.00th=[  660],  5.00th=[  717], 10.00th=[  758], 20.00th=[  832],
     | 30.00th=[  881], 40.00th=[  947], 50.00th=[ 1045], 60.00th=[ 1172],
     | 70.00th=[ 1418], 80.00th=[ 2008], 90.00th=[ 3851], 95.00th=[ 4883],
     | 99.00th=[ 8455], 99.50th=[11994], 99.90th=[25035], 99.95th=[25035],
     | 99.99th=[25035]
   bw (  KiB/s): min=  576, max= 1072, per=23.57%, avg=797.33, stdev=252.26, samples=3
   iops        : min=  144, max=  268, avg=199.33, stdev=63.07, samples=3
  write: IOPS=224, BW=896KiB/s (918kB/s)(1564KiB/1745msec)
    clat (usec): min=1189, max=19131, avg=2800.07, stdev=1513.10
     lat (usec): min=1190, max=19132, avg=2801.11, stdev=1512.95
    clat percentiles (usec):
     |  1.00th=[ 1287],  5.00th=[ 1500], 10.00th=[ 1696], 20.00th=[ 1909],
     | 30.00th=[ 2024], 40.00th=[ 2180], 50.00th=[ 2343], 60.00th=[ 2540],
     | 70.00th=[ 2900], 80.00th=[ 3392], 90.00th=[ 4555], 95.00th=[ 5604],
     | 99.00th=[ 8225], 99.50th=[ 8848], 99.90th=[19006], 99.95th=[19006],
     | 99.99th=[19006]
   bw (  KiB/s): min=  608, max= 1272, per=23.98%, avg=853.33, stdev=364.36, samples=3
   iops        : min=  152, max=  318, avg=213.33, stdev=91.09, samples=3
  lat (usec)   : 750=4.43%, 1000=18.49%
  lat (msec)   : 2=30.34%, 4=35.55%, 10=10.68%, 20=0.39%, 50=0.13%
  cpu          : usr=0.17%, sys=6.08%, ctx=845, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3383KiB/s (3464kB/s), 817KiB/s-885KiB/s (836kB/s-906kB/s), io=5988KiB (6132kB), run=1745-1770msec
  WRITE: bw=3559KiB/s (3645kB/s), 853KiB/s-931KiB/s (874kB/s-953kB/s), io=6300KiB (6451kB), run=1745-1770msec