== sanity test 398b: DIO and buffer IO race ============== 19:32:18 (1736987538)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0711426 s, 177 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=17266: Wed Jan 15 19:32:20 2025
   read: IOPS=349, BW=1396KiB/s (1430kB/s)(1480KiB/1060msec)
    clat (usec): min=3, max=18511, avg=1576.74, stdev=1932.34
     lat (usec): min=4, max=18511, avg=1577.39, stdev=1932.32
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   11],
     | 30.00th=[   13], 40.00th=[   70], 50.00th=[ 1418], 60.00th=[ 1795],
     | 70.00th=[ 2212], 80.00th=[ 2769], 90.00th=[ 3523], 95.00th=[ 4686],
     | 99.00th=[ 7635], 99.50th=[15139], 99.90th=[18482], 99.95th=[18482],
     | 99.99th=[18482]
   bw (  KiB/s): min= 1064, max= 1616, per=24.42%, avg=1340.00, stdev=390.32, samples=2
   iops        : min=  266, max=  404, avg=335.00, stdev=97.58, samples=2
  write: IOPS=375, BW=1502KiB/s (1538kB/s)(1592KiB/1060msec)
    clat (usec): min=92, max=11909, avg=1179.33, stdev=1416.79
     lat (usec): min=93, max=11909, avg=1180.22, stdev=1416.73
    clat percentiles (usec):
     |  1.00th=[  104],  5.00th=[  117], 10.00th=[  133], 20.00th=[  155],
     | 30.00th=[  174], 40.00th=[  231], 50.00th=[  766], 60.00th=[  996],
     | 70.00th=[ 1418], 80.00th=[ 2089], 90.00th=[ 2999], 95.00th=[ 4146],
     | 99.00th=[ 5997], 99.50th=[ 7570], 99.90th=[11863], 99.95th=[11863],
     | 99.99th=[11863]
   bw (  KiB/s): min=  992, max= 1936, per=25.36%, avg=1464.00, stdev=667.51, samples=2
   iops        : min=  248, max=  484, avg=366.00, stdev=166.88, samples=2
  lat (usec)   : 4=0.13%, 10=9.51%, 20=8.72%, 50=0.52%, 100=0.91%
  lat (usec)   : 250=21.22%, 500=2.47%, 750=1.95%, 1000=6.77%
  lat (msec)   : 2=19.53%, 4=21.74%, 10=6.12%, 20=0.39%
  cpu          : usr=1.13%, sys=16.15%, ctx=930, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17267: Wed Jan 15 19:32:20 2025
   read: IOPS=337, BW=1350KiB/s (1382kB/s)(1436KiB/1064msec)
    clat (usec): min=3, max=24822, avg=1689.79, stdev=2196.64
     lat (usec): min=3, max=24823, avg=1690.63, stdev=2196.69
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[  963], 50.00th=[ 1582], 60.00th=[ 1991],
     | 70.00th=[ 2409], 80.00th=[ 2802], 90.00th=[ 3326], 95.00th=[ 4752],
     | 99.00th=[10814], 99.50th=[14746], 99.90th=[24773], 99.95th=[24773],
     | 99.99th=[24773]
   bw (  KiB/s): min= 1000, max= 1644, per=24.09%, avg=1322.00, stdev=455.38, samples=2
   iops        : min=  250, max=  411, avg=330.50, stdev=113.84, samples=2
  write: IOPS=384, BW=1538KiB/s (1574kB/s)(1636KiB/1064msec)
    clat (usec): min=91, max=12423, avg=1102.95, stdev=1315.07
     lat (usec): min=92, max=12424, avg=1103.88, stdev=1315.06
    clat percentiles (usec):
     |  1.00th=[   97],  5.00th=[  116], 10.00th=[  127], 20.00th=[  157],
     | 30.00th=[  174], 40.00th=[  206], 50.00th=[  824], 60.00th=[ 1012],
     | 70.00th=[ 1270], 80.00th=[ 1975], 90.00th=[ 2737], 95.00th=[ 3720],
     | 99.00th=[ 5276], 99.50th=[ 5800], 99.90th=[12387], 99.95th=[12387],
     | 99.99th=[12387]
   bw (  KiB/s): min= 1224, max= 1732, per=25.60%, avg=1478.00, stdev=359.21, samples=2
   iops        : min=  306, max=  433, avg=369.50, stdev=89.80, samples=2
  lat (usec)   : 4=0.65%, 10=6.90%, 20=8.72%, 50=0.91%, 100=1.17%
  lat (usec)   : 250=22.01%, 500=2.08%, 750=0.78%, 1000=7.81%
  lat (msec)   : 2=20.18%, 4=23.96%, 10=4.17%, 20=0.52%, 50=0.13%
  cpu          : usr=0.56%, sys=17.50%, ctx=912, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17268: Wed Jan 15 19:32:20 2025
   read: IOPS=367, BW=1471KiB/s (1507kB/s)(1564KiB/1063msec)
    clat (usec): min=3, max=19874, avg=1535.03, stdev=1978.61
     lat (usec): min=3, max=19874, avg=1535.61, stdev=1978.64
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    9], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[   66], 50.00th=[ 1352], 60.00th=[ 1893],
     | 70.00th=[ 2311], 80.00th=[ 2638], 90.00th=[ 3130], 95.00th=[ 3818],
     | 99.00th=[ 7111], 99.50th=[15139], 99.90th=[19792], 99.95th=[19792],
     | 99.99th=[19792]
   bw (  KiB/s): min= 1032, max= 1848, per=26.24%, avg=1440.00, stdev=577.00, samples=2
   iops        : min=  258, max=  462, avg=360.00, stdev=144.25, samples=2
  write: IOPS=354, BW=1419KiB/s (1453kB/s)(1508KiB/1063msec)
    clat (usec): min=94, max=14977, avg=1204.88, stdev=1576.60
     lat (usec): min=95, max=14979, avg=1205.55, stdev=1576.62
    clat percentiles (usec):
     |  1.00th=[  100],  5.00th=[  115], 10.00th=[  139], 20.00th=[  161],
     | 30.00th=[  178], 40.00th=[  251], 50.00th=[  848], 60.00th=[  988],
     | 70.00th=[ 1352], 80.00th=[ 2073], 90.00th=[ 2769], 95.00th=[ 4080],
     | 99.00th=[ 8586], 99.50th=[11076], 99.90th=[15008], 99.95th=[15008],
     | 99.99th=[15008]
   bw (  KiB/s): min= 1040, max= 1680, per=23.55%, avg=1360.00, stdev=452.55, samples=2
   iops        : min=  260, max=  420, avg=340.00, stdev=113.14, samples=2
  lat (usec)   : 4=0.39%, 10=11.07%, 20=8.20%, 50=0.65%, 100=0.65%
  lat (usec)   : 250=19.27%, 500=2.34%, 750=0.78%, 1000=9.11%
  lat (msec)   : 2=17.32%, 4=25.13%, 10=4.30%, 20=0.78%
  cpu          : usr=0.47%, sys=16.48%, ctx=885, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17269: Wed Jan 15 19:32:20 2025
   read: IOPS=345, BW=1382KiB/s (1415kB/s)(1508KiB/1091msec)
    clat (usec): min=4, max=14937, avg=1671.81, stdev=1894.57
     lat (usec): min=4, max=14938, avg=1672.45, stdev=1894.54
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    8], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[  988], 50.00th=[ 1549], 60.00th=[ 1958],
     | 70.00th=[ 2376], 80.00th=[ 2868], 90.00th=[ 3458], 95.00th=[ 4424],
     | 99.00th=[11207], 99.50th=[13173], 99.90th=[14877], 99.95th=[14877],
     | 99.99th=[14877]
   bw (  KiB/s): min=  928, max= 1664, per=23.62%, avg=1296.00, stdev=520.43, samples=2
   iops        : min=  232, max=  416, avg=324.00, stdev=130.11, samples=2
  write: IOPS=358, BW=1434KiB/s (1468kB/s)(1564KiB/1091msec)
    clat (usec): min=93, max=25689, avg=1156.93, stdev=1905.89
     lat (usec): min=93, max=25690, avg=1157.74, stdev=1905.84
    clat percentiles (usec):
     |  1.00th=[   98],  5.00th=[  114], 10.00th=[  129], 20.00th=[  151],
     | 30.00th=[  167], 40.00th=[  196], 50.00th=[  594], 60.00th=[  971],
     | 70.00th=[ 1254], 80.00th=[ 2008], 90.00th=[ 2671], 95.00th=[ 3326],
     | 99.00th=[ 9765], 99.50th=[12780], 99.90th=[25560], 99.95th=[25560],
     | 99.99th=[25560]
   bw (  KiB/s): min=  968, max= 1728, per=23.35%, avg=1348.00, stdev=537.40, samples=2
   iops        : min=  242, max=  432, avg=337.00, stdev=134.35, samples=2
  lat (usec)   : 10=8.46%, 20=8.59%, 50=0.52%, 100=0.78%, 250=22.01%
  lat (usec)   : 500=2.73%, 750=0.78%, 1000=6.51%
  lat (msec)   : 2=20.18%, 4=23.96%, 10=4.56%, 20=0.78%, 50=0.13%
  cpu          : usr=0.64%, sys=15.50%, ctx=892, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5489KiB/s (5620kB/s), 1350KiB/s-1471KiB/s (1382kB/s-1507kB/s), io=5988KiB (6132kB), run=1060-1091msec
  WRITE: bw=5775KiB/s (5913kB/s), 1419KiB/s-1538KiB/s (1453kB/s-1574kB/s), io=6300KiB (6451kB), run=1060-1091msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=17262: Wed Jan 15 19:32:21 2025
   read: IOPS=216, BW=865KiB/s (886kB/s)(1480KiB/1711msec)
    clat (usec): min=604, max=14438, avg=1590.11, stdev=1681.01
     lat (usec): min=605, max=14439, avg=1590.79, stdev=1681.01
    clat percentiles (usec):
     |  1.00th=[  652],  5.00th=[  717], 10.00th=[  750], 20.00th=[  816],
     | 30.00th=[  848], 40.00th=[  881], 50.00th=[  922], 60.00th=[ 1045],
     | 70.00th=[ 1270], 80.00th=[ 1893], 90.00th=[ 3687], 95.00th=[ 4555],
     | 99.00th=[ 9241], 99.50th=[14484], 99.90th=[14484], 99.95th=[14484],
     | 99.99th=[14484]
   bw (  KiB/s): min=  608, max= 1080, per=23.09%, avg=794.67, stdev=250.99, samples=3
   iops        : min=  152, max=  270, avg=198.67, stdev=62.75, samples=3
  write: IOPS=232, BW=930KiB/s (953kB/s)(1592KiB/1711msec)
    clat (usec): min=1119, max=24178, avg=2797.02, stdev=1762.51
     lat (usec): min=1119, max=24179, avg=2797.79, stdev=1762.52
    clat percentiles (usec):
     |  1.00th=[ 1287],  5.00th=[ 1500], 10.00th=[ 1729], 20.00th=[ 1860],
     | 30.00th=[ 1958], 40.00th=[ 2057], 50.00th=[ 2180], 60.00th=[ 2442],
     | 70.00th=[ 2868], 80.00th=[ 3392], 90.00th=[ 4883], 95.00th=[ 6063],
     | 99.00th=[ 8160], 99.50th=[10683], 99.90th=[24249], 99.95th=[24249],
     | 99.99th=[24249]
   bw (  KiB/s): min=  592, max= 1264, per=23.87%, avg=864.00, stdev=353.81, samples=3
   iops        : min=  148, max=  316, avg=216.00, stdev=88.45, samples=3
  lat (usec)   : 750=4.17%, 1000=22.79%
  lat (msec)   : 2=29.43%, 4=32.55%, 10=10.42%, 20=0.52%, 50=0.13%
  cpu          : usr=0.53%, sys=5.91%, ctx=822, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17263: Wed Jan 15 19:32:21 2025
   read: IOPS=206, BW=825KiB/s (845kB/s)(1436KiB/1740msec)
    clat (usec): min=647, max=13400, avg=1537.45, stdev=1392.04
     lat (usec): min=647, max=13401, avg=1538.35, stdev=1392.19
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  717], 10.00th=[  750], 20.00th=[  807],
     | 30.00th=[  848], 40.00th=[  914], 50.00th=[  971], 60.00th=[ 1074],
     | 70.00th=[ 1303], 80.00th=[ 1811], 90.00th=[ 3425], 95.00th=[ 4293],
     | 99.00th=[ 7046], 99.50th=[ 7635], 99.90th=[13435], 99.95th=[13435],
     | 99.99th=[13435]
   bw (  KiB/s): min=  518, max= 1216, per=22.53%, avg=775.33, stdev=383.42, samples=3
   iops        : min=  129, max=  304, avg=193.67, stdev=96.02, samples=3
  write: IOPS=235, BW=940KiB/s (963kB/s)(1636KiB/1740msec)
    clat (usec): min=1077, max=29540, avg=2876.46, stdev=2052.85
     lat (usec): min=1078, max=29541, avg=2877.23, stdev=2052.86
    clat percentiles (usec):
     |  1.00th=[ 1287],  5.00th=[ 1418], 10.00th=[ 1516], 20.00th=[ 1844],
     | 30.00th=[ 1975], 40.00th=[ 2073], 50.00th=[ 2212], 60.00th=[ 2409],
     | 70.00th=[ 2999], 80.00th=[ 3654], 90.00th=[ 5145], 95.00th=[ 5997],
     | 99.00th=[ 7308], 99.50th=[10945], 99.90th=[29492], 99.95th=[29492],
     | 99.99th=[29492]
   bw (  KiB/s): min=  598, max= 1152, per=23.26%, avg=842.00, stdev=282.84, samples=3
   iops        : min=  149, max=  288, avg=210.33, stdev=70.92, samples=3
  lat (usec)   : 750=4.30%, 1000=20.83%
  lat (msec)   : 2=30.34%, 4=32.55%, 10=11.46%, 20=0.39%, 50=0.13%
  cpu          : usr=0.63%, sys=5.64%, ctx=826, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17264: Wed Jan 15 19:32:21 2025
   read: IOPS=228, BW=914KiB/s (935kB/s)(1564KiB/1712msec)
    clat (usec): min=626, max=16553, avg=1523.00, stdev=1422.71
     lat (usec): min=626, max=16554, avg=1523.74, stdev=1422.69
    clat percentiles (usec):
     |  1.00th=[  676],  5.00th=[  709], 10.00th=[  758], 20.00th=[  799],
     | 30.00th=[  848], 40.00th=[  906], 50.00th=[  971], 60.00th=[ 1057],
     | 70.00th=[ 1237], 80.00th=[ 1876], 90.00th=[ 3654], 95.00th=[ 4555],
     | 99.00th=[ 6390], 99.50th=[ 7177], 99.90th=[16581], 99.95th=[16581],
     | 99.99th=[16581]
   bw (  KiB/s): min=  544, max= 1208, per=23.95%, avg=824.00, stdev=344.00, samples=3
   iops        : min=  136, max=  302, avg=206.00, stdev=86.00, samples=3
  write: IOPS=220, BW=881KiB/s (902kB/s)(1508KiB/1712msec)
    clat (usec): min=1273, max=18234, avg=2939.31, stdev=1796.40
     lat (usec): min=1274, max=18235, avg=2940.07, stdev=1796.43
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1450], 10.00th=[ 1745], 20.00th=[ 1909],
     | 30.00th=[ 1991], 40.00th=[ 2089], 50.00th=[ 2245], 60.00th=[ 2540],
     | 70.00th=[ 2999], 80.00th=[ 3752], 90.00th=[ 4883], 95.00th=[ 6325],
     | 99.00th=[10028], 99.50th=[13698], 99.90th=[18220], 99.95th=[18220],
     | 99.99th=[18220]
   bw (  KiB/s): min=  616, max= 1192, per=22.54%, avg=816.00, stdev=325.85, samples=3
   iops        : min=  154, max=  298, avg=204.00, stdev=81.46, samples=3
  lat (usec)   : 750=4.82%, 1000=22.79%
  lat (msec)   : 2=28.91%, 4=30.73%, 10=12.11%, 20=0.65%
  cpu          : usr=0.35%, sys=5.90%, ctx=820, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=17265: Wed Jan 15 19:32:21 2025
   read: IOPS=221, BW=888KiB/s (909kB/s)(1508KiB/1699msec)
    clat (usec): min=564, max=13525, avg=1578.93, stdev=1551.05
     lat (usec): min=564, max=13525, avg=1579.78, stdev=1551.49
    clat percentiles (usec):
     |  1.00th=[  644],  5.00th=[  709], 10.00th=[  758], 20.00th=[  799],
     | 30.00th=[  857], 40.00th=[  906], 50.00th=[  988], 60.00th=[ 1123],
     | 70.00th=[ 1270], 80.00th=[ 2024], 90.00th=[ 3523], 95.00th=[ 4490],
     | 99.00th=[ 6259], 99.50th=[13435], 99.90th=[13566], 99.95th=[13566],
     | 99.99th=[13566]
   bw (  KiB/s): min=  576, max= 1056, per=23.33%, avg=802.67, stdev=241.11, samples=3
   iops        : min=  144, max=  264, avg=200.67, stdev=60.28, samples=3
  write: IOPS=230, BW=921KiB/s (943kB/s)(1564KiB/1699msec)
    clat (usec): min=1115, max=21993, avg=2789.37, stdev=1641.95
     lat (usec): min=1116, max=21994, avg=2790.43, stdev=1642.13
    clat percentiles (usec):
     |  1.00th=[ 1270],  5.00th=[ 1385], 10.00th=[ 1582], 20.00th=[ 1876],
     | 30.00th=[ 1975], 40.00th=[ 2114], 50.00th=[ 2245], 60.00th=[ 2507],
     | 70.00th=[ 2900], 80.00th=[ 3654], 90.00th=[ 4752], 95.00th=[ 5604],
     | 99.00th=[ 8029], 99.50th=[ 8356], 99.90th=[21890], 99.95th=[21890],
     | 99.99th=[21890]
   bw (  KiB/s): min=  608, max= 1248, per=23.72%, avg=858.67, stdev=341.79, samples=3
   iops        : min=  152, max=  312, avg=214.67, stdev=85.45, samples=3
  lat (usec)   : 750=4.17%, 1000=20.83%
  lat (msec)   : 2=30.08%, 4=33.72%, 10=10.68%, 20=0.39%, 50=0.13%
  cpu          : usr=0.53%, sys=5.95%, ctx=833, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3441KiB/s (3524kB/s), 825KiB/s-914KiB/s (845kB/s-935kB/s), io=5988KiB (6132kB), run=1699-1740msec
  WRITE: bw=3621KiB/s (3708kB/s), 881KiB/s-940KiB/s (902kB/s-963kB/s), io=6300KiB (6451kB), run=1699-1740msec