== sanity test 398b: DIO and buffer IO race ============== 10:08:49 (1747404529)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0658052 s, 191 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=20758: Fri May 16 10:08:51 2025
   read: IOPS=379, BW=1520KiB/s (1556kB/s)(1480KiB/974msec)
    clat (usec): min=3, max=42635, avg=1479.68, stdev=2985.10
     lat (usec): min=3, max=42636, avg=1480.24, stdev=2985.11
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   10], 40.00th=[   14], 50.00th=[  930], 60.00th=[ 1483],
     | 70.00th=[ 2040], 80.00th=[ 2573], 90.00th=[ 3097], 95.00th=[ 4080],
     | 99.00th=[ 8848], 99.50th=[27919], 99.90th=[42730], 99.95th=[42730],
     | 99.99th=[42730]
   bw (  KiB/s): min= 1008, max= 1008, per=16.90%, avg=1008.00, stdev= 0.00, samples=1
   iops        : min=  252, max=  252, avg=252.00, stdev= 0.00, samples=1
  write: IOPS=408, BW=1634KiB/s (1674kB/s)(1592KiB/974msec)
    clat (usec): min=77, max=7024, avg=1045.84, stdev=1310.68
     lat (usec): min=77, max=7025, avg=1046.49, stdev=1310.66
    clat percentiles (usec):
     |  1.00th=[   89],  5.00th=[   96], 10.00th=[  104], 20.00th=[  122],
     | 30.00th=[  153], 40.00th=[  184], 50.00th=[  322], 60.00th=[  865],
     | 70.00th=[ 1123], 80.00th=[ 1942], 90.00th=[ 2868], 95.00th=[ 4047],
     | 99.00th=[ 5669], 99.50th=[ 6128], 99.90th=[ 7046], 99.95th=[ 7046],
     | 99.99th=[ 7046]
   bw (  KiB/s): min=  928, max=  928, per=14.79%, avg=928.00, stdev= 0.00, samples=1
   iops        : min=  232, max=  232, avg=232.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.78%, 10=14.45%, 20=6.25%, 50=0.39%, 100=3.52%
  lat (usec)   : 250=21.22%, 500=2.60%, 750=1.43%, 1000=8.07%
  lat (msec)   : 2=16.15%, 4=20.05%, 10=4.82%, 50=0.26%
  cpu          : usr=0.31%, sys=17.16%, ctx=836, majf=0, minf=36
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20759: Fri May 16 10:08:51 2025
   read: IOPS=372, BW=1491KiB/s (1527kB/s)(1436KiB/963msec)
    clat (usec): min=3, max=27531, avg=1565.57, stdev=2461.09
     lat (usec): min=3, max=27532, avg=1566.14, stdev=2461.14
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    7], 10.00th=[    7], 20.00th=[   10],
     | 30.00th=[   11], 40.00th=[  490], 50.00th=[ 1319], 60.00th=[ 1713],
     | 70.00th=[ 2180], 80.00th=[ 2606], 90.00th=[ 3195], 95.00th=[ 4080],
     | 99.00th=[ 9634], 99.50th=[21103], 99.90th=[27657], 99.95th=[27657],
     | 99.99th=[27657]
   bw (  KiB/s): min= 1024, max= 1024, per=17.17%, avg=1024.00, stdev= 0.00, samples=1
   iops        : min=  256, max=  256, avg=256.00, stdev= 0.00, samples=1
  write: IOPS=424, BW=1699KiB/s (1740kB/s)(1636KiB/963msec)
    clat (usec): min=81, max=8891, avg=959.07, stdev=1235.50
     lat (usec): min=82, max=8892, avg=960.45, stdev=1235.10
    clat percentiles (usec):
     |  1.00th=[   89],  5.00th=[   99], 10.00th=[  106], 20.00th=[  120],
     | 30.00th=[  141], 40.00th=[  169], 50.00th=[  212], 60.00th=[  840],
     | 70.00th=[ 1123], 80.00th=[ 1795], 90.00th=[ 2638], 95.00th=[ 3490],
     | 99.00th=[ 5800], 99.50th=[ 6456], 99.90th=[ 8848], 99.95th=[ 8848],
     | 99.99th=[ 8848]
   bw (  KiB/s): min= 1272, max= 1272, per=20.27%, avg=1272.00, stdev= 0.00, samples=1
   iops        : min=  318, max=  318, avg=318.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.52%, 10=11.46%, 20=5.73%, 50=0.26%, 100=3.39%
  lat (usec)   : 250=24.87%, 500=1.04%, 750=1.43%, 1000=7.68%
  lat (msec)   : 2=20.18%, 4=19.14%, 10=3.91%, 20=0.13%, 50=0.26%
  cpu          : usr=0.21%, sys=17.15%, ctx=822, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20760: Fri May 16 10:08:51 2025
   read: IOPS=399, BW=1598KiB/s (1636kB/s)(1564KiB/979msec)
    clat (usec): min=3, max=14925, avg=1336.02, stdev=1650.36
     lat (usec): min=3, max=14926, avg=1337.02, stdev=1650.01
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   16], 50.00th=[ 1221], 60.00th=[ 1647],
     | 70.00th=[ 1975], 80.00th=[ 2409], 90.00th=[ 2966], 95.00th=[ 3392],
     | 99.00th=[ 8160], 99.50th=[13960], 99.90th=[14877], 99.95th=[14877],
     | 99.99th=[14877]
   bw (  KiB/s): min= 1072, max= 1072, per=17.97%, avg=1072.00, stdev= 0.00, samples=1
   iops        : min=  268, max=  268, avg=268.00, stdev= 0.00, samples=1
  write: IOPS=385, BW=1540KiB/s (1577kB/s)(1508KiB/979msec)
    clat (usec): min=88, max=36338, avg=1184.17, stdev=2331.46
     lat (usec): min=88, max=36339, avg=1184.83, stdev=2331.48
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[  100], 10.00th=[  109], 20.00th=[  128],
     | 30.00th=[  163], 40.00th=[  223], 50.00th=[  832], 60.00th=[  988],
     | 70.00th=[ 1237], 80.00th=[ 1844], 90.00th=[ 2671], 95.00th=[ 3589],
     | 99.00th=[ 6521], 99.50th=[18744], 99.90th=[36439], 99.95th=[36439],
     | 99.99th=[36439]
   bw (  KiB/s): min= 1040, max= 1040, per=16.58%, avg=1040.00, stdev= 0.00, samples=1
   iops        : min=  260, max=  260, avg=260.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.78%, 10=13.93%, 20=6.25%, 50=0.39%, 100=2.47%
  lat (usec)   : 250=18.10%, 500=1.56%, 750=1.82%, 1000=7.94%
  lat (msec)   : 2=23.05%, 4=20.44%, 10=2.73%, 20=0.39%, 50=0.13%
  cpu          : usr=0.51%, sys=15.34%, ctx=797, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20761: Fri May 16 10:08:51 2025
   read: IOPS=375, BW=1502KiB/s (1538kB/s)(1508KiB/1004msec)
    clat (usec): min=3, max=16934, avg=1502.31, stdev=1958.92
     lat (usec): min=3, max=16934, avg=1503.37, stdev=1959.03
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    5], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   10], 40.00th=[   14], 50.00th=[ 1057], 60.00th=[ 1745],
     | 70.00th=[ 2147], 80.00th=[ 2737], 90.00th=[ 3490], 95.00th=[ 5080],
     | 99.00th=[ 7439], 99.50th=[14746], 99.90th=[16909], 99.95th=[16909],
     | 99.99th=[16909]
   bw (  KiB/s): min= 1032, max= 1944, per=24.95%, avg=1488.00, stdev=644.88, samples=2
   iops        : min=  258, max=  486, avg=372.00, stdev=161.22, samples=2
  write: IOPS=389, BW=1558KiB/s (1595kB/s)(1564KiB/1004msec)
    clat (usec): min=89, max=14621, avg=1091.67, stdev=1609.78
     lat (usec): min=89, max=14622, avg=1092.35, stdev=1609.87
    clat percentiles (usec):
     |  1.00th=[   91],  5.00th=[   99], 10.00th=[  108], 20.00th=[  123],
     | 30.00th=[  151], 40.00th=[  194], 50.00th=[  359], 60.00th=[  832],
     | 70.00th=[ 1139], 80.00th=[ 1827], 90.00th=[ 2900], 95.00th=[ 3785],
     | 99.00th=[ 6521], 99.50th=[12780], 99.90th=[14615], 99.95th=[14615],
     | 99.99th=[14615]
   bw (  KiB/s): min= 1048, max= 2064, per=24.80%, avg=1556.00, stdev=718.42, samples=2
   iops        : min=  262, max=  516, avg=389.00, stdev=179.61, samples=2
  lat (usec)   : 4=1.04%, 10=14.32%, 20=5.34%, 50=0.39%, 100=3.12%
  lat (usec)   : 250=20.44%, 500=3.65%, 750=2.60%, 1000=6.12%
  lat (msec)   : 2=17.58%, 4=19.66%, 10=5.21%, 20=0.52%
  cpu          : usr=0.70%, sys=15.05%, ctx=861, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5964KiB/s (6107kB/s), 1491KiB/s-1598KiB/s (1527kB/s-1636kB/s), io=5988KiB (6132kB), run=963-1004msec
  WRITE: bw=6275KiB/s (6425kB/s), 1540KiB/s-1699KiB/s (1577kB/s-1740kB/s), io=6300KiB (6451kB), run=963-1004msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=20754: Fri May 16 10:08:52 2025
   read: IOPS=223, BW=894KiB/s (916kB/s)(1480KiB/1655msec)
    clat (usec): min=596, max=35583, avg=1569.15, stdev=2382.95
     lat (usec): min=596, max=35584, avg=1569.83, stdev=2382.96
    clat percentiles (usec):
     |  1.00th=[  611],  5.00th=[  676], 10.00th=[  725], 20.00th=[  791],
     | 30.00th=[  840], 40.00th=[  889], 50.00th=[  947], 60.00th=[ 1045],
     | 70.00th=[ 1205], 80.00th=[ 1778], 90.00th=[ 3228], 95.00th=[ 4047],
     | 99.00th=[ 8291], 99.50th=[17433], 99.90th=[35390], 99.95th=[35390],
     | 99.99th=[35390]
   bw (  KiB/s): min=  544, max= 1232, per=23.36%, avg=845.33, stdev=351.85, samples=3
   iops        : min=  136, max=  308, avg=211.33, stdev=87.96, samples=3
  write: IOPS=240, BW=962KiB/s (985kB/s)(1592KiB/1655msec)
    clat (usec): min=1129, max=12486, avg=2665.30, stdev=1398.70
     lat (usec): min=1129, max=12486, avg=2666.15, stdev=1398.63
    clat percentiles (usec):
     |  1.00th=[ 1156],  5.00th=[ 1336], 10.00th=[ 1565], 20.00th=[ 1778],
     | 30.00th=[ 1893], 40.00th=[ 1991], 50.00th=[ 2114], 60.00th=[ 2343],
     | 70.00th=[ 2704], 80.00th=[ 3425], 90.00th=[ 4621], 95.00th=[ 5735],
     | 99.00th=[ 7177], 99.50th=[ 9110], 99.90th=[12518], 99.95th=[12518],
     | 99.99th=[12518]
   bw (  KiB/s): min=  576, max= 1432, per=24.10%, avg=917.33, stdev=453.56, samples=3
   iops        : min=  144, max=  358, avg=229.33, stdev=113.39, samples=3
  lat (usec)   : 750=6.51%, 1000=20.44%
  lat (msec)   : 2=33.98%, 4=28.65%, 10=9.90%, 20=0.39%, 50=0.13%
  cpu          : usr=0.48%, sys=5.74%, ctx=829, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20755: Fri May 16 10:08:52 2025
   read: IOPS=218, BW=875KiB/s (896kB/s)(1436KiB/1642msec)
    clat (usec): min=553, max=16518, avg=1447.26, stdev=1693.21
     lat (usec): min=554, max=16519, avg=1447.88, stdev=1693.23
    clat percentiles (usec):
     |  1.00th=[  619],  5.00th=[  676], 10.00th=[  717], 20.00th=[  766],
     | 30.00th=[  816], 40.00th=[  848], 50.00th=[  906], 60.00th=[  971],
     | 70.00th=[ 1172], 80.00th=[ 1549], 90.00th=[ 2737], 95.00th=[ 3982],
     | 99.00th=[ 9634], 99.50th=[15664], 99.90th=[16581], 99.95th=[16581],
     | 99.99th=[16581]
   bw (  KiB/s): min=  544, max= 1344, per=23.44%, avg=848.00, stdev=433.18, samples=3
   iops        : min=  136, max=  336, avg=212.00, stdev=108.30, samples=3
  write: IOPS=249, BW=996KiB/s (1020kB/s)(1636KiB/1642msec)
    clat (usec): min=1148, max=12352, avg=2708.65, stdev=1434.39
     lat (usec): min=1149, max=12353, avg=2709.35, stdev=1434.40
    clat percentiles (usec):
     |  1.00th=[ 1254],  5.00th=[ 1418], 10.00th=[ 1614], 20.00th=[ 1795],
     | 30.00th=[ 1909], 40.00th=[ 2024], 50.00th=[ 2180], 60.00th=[ 2376],
     | 70.00th=[ 2835], 80.00th=[ 3490], 90.00th=[ 4555], 95.00th=[ 5866],
     | 99.00th=[ 7832], 99.50th=[ 8356], 99.90th=[12387], 99.95th=[12387],
     | 99.99th=[12387]
   bw (  KiB/s): min=  624, max= 1392, per=25.08%, avg=954.67, stdev=394.95, samples=3
   iops        : min=  156, max=  348, avg=238.67, stdev=98.74, samples=3
  lat (usec)   : 750=7.42%, 1000=21.09%
  lat (msec)   : 2=30.99%, 4=31.38%, 10=8.59%, 20=0.52%
  cpu          : usr=0.43%, sys=5.97%, ctx=818, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20756: Fri May 16 10:08:52 2025
   read: IOPS=238, BW=952KiB/s (975kB/s)(1564KiB/1642msec)
    clat (usec): min=606, max=14089, avg=1413.54, stdev=1393.41
     lat (usec): min=607, max=14090, avg=1414.15, stdev=1393.42
    clat percentiles (usec):
     |  1.00th=[  635],  5.00th=[  676], 10.00th=[  717], 20.00th=[  775],
     | 30.00th=[  816], 40.00th=[  865], 50.00th=[  930], 60.00th=[ 1020],
     | 70.00th=[ 1172], 80.00th=[ 1598], 90.00th=[ 2442], 95.00th=[ 4293],
     | 99.00th=[ 7898], 99.50th=[ 9896], 99.90th=[14091], 99.95th=[14091],
     | 99.99th=[14091]
   bw (  KiB/s): min=  464, max= 1424, per=24.99%, avg=904.00, stdev=484.97, samples=3
   iops        : min=  116, max=  356, avg=226.00, stdev=121.24, samples=3
  write: IOPS=229, BW=918KiB/s (940kB/s)(1508KiB/1642msec)
    clat (usec): min=1188, max=35575, avg=2852.39, stdev=2384.96
     lat (usec): min=1189, max=35576, avg=2853.38, stdev=2384.91
    clat percentiles (usec):
     |  1.00th=[ 1254],  5.00th=[ 1352], 10.00th=[ 1647], 20.00th=[ 1795],
     | 30.00th=[ 1876], 40.00th=[ 1991], 50.00th=[ 2147], 60.00th=[ 2311],
     | 70.00th=[ 2868], 80.00th=[ 3654], 90.00th=[ 4948], 95.00th=[ 5866],
     | 99.00th=[ 8979], 99.50th=[19268], 99.90th=[35390], 99.95th=[35390],
     | 99.99th=[35390]
   bw (  KiB/s): min=  568, max= 1368, per=23.26%, avg=885.33, stdev=424.85, samples=3
   iops        : min=  142, max=  342, avg=221.33, stdev=106.21, samples=3
  lat (usec)   : 750=8.33%, 1000=21.22%
  lat (msec)   : 2=34.11%, 4=25.52%, 10=10.29%, 20=0.39%, 50=0.13%
  cpu          : usr=0.85%, sys=5.36%, ctx=830, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20757: Fri May 16 10:08:52 2025
   read: IOPS=228, BW=916KiB/s (938kB/s)(1508KiB/1647msec)
    clat (usec): min=546, max=16376, avg=1545.40, stdev=1702.01
     lat (usec): min=547, max=16377, avg=1546.01, stdev=1702.03
    clat percentiles (usec):
     |  1.00th=[  627],  5.00th=[  685], 10.00th=[  717], 20.00th=[  775],
     | 30.00th=[  824], 40.00th=[  873], 50.00th=[  930], 60.00th=[ 1029],
     | 70.00th=[ 1205], 80.00th=[ 1811], 90.00th=[ 2933], 95.00th=[ 4948],
     | 99.00th=[ 8979], 99.50th=[13304], 99.90th=[16319], 99.95th=[16319],
     | 99.99th=[16319]
   bw (  KiB/s): min=  472, max= 1264, per=24.10%, avg=872.00, stdev=396.06, samples=3
   iops        : min=  118, max=  316, avg=218.00, stdev=99.02, samples=3
  write: IOPS=237, BW=950KiB/s (972kB/s)(1564KiB/1647msec)
    clat (usec): min=1163, max=20041, avg=2698.20, stdev=1700.68
     lat (usec): min=1163, max=20043, avg=2698.92, stdev=1700.73
    clat percentiles (usec):
     |  1.00th=[ 1172],  5.00th=[ 1401], 10.00th=[ 1663], 20.00th=[ 1778],
     | 30.00th=[ 1876], 40.00th=[ 1958], 50.00th=[ 2114], 60.00th=[ 2278],
     | 70.00th=[ 2638], 80.00th=[ 3294], 90.00th=[ 4621], 95.00th=[ 5800],
     | 99.00th=[ 8455], 99.50th=[12125], 99.90th=[20055], 99.95th=[20055],
     | 99.99th=[20055]
   bw (  KiB/s): min=  528, max= 1424, per=23.82%, avg=906.67, stdev=463.82, samples=3
   iops        : min=  132, max=  356, avg=226.67, stdev=115.95, samples=3
  lat (usec)   : 750=7.03%, 1000=20.57%
  lat (msec)   : 2=34.64%, 4=26.95%, 10=10.16%, 20=0.52%, 50=0.13%
  cpu          : usr=0.61%, sys=5.71%, ctx=840, majf=0, minf=30
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3618KiB/s (3705kB/s), 875KiB/s-952KiB/s (896kB/s-975kB/s), io=5988KiB (6132kB), run=1642-1655msec
  WRITE: bw=3807KiB/s (3898kB/s), 918KiB/s-996KiB/s (940kB/s-1020kB/s), io=6300KiB (6451kB), run=1642-1655msec