== sanity test 398b: DIO and buffer IO race ============== 10:17:49 (1747405069)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0582225 s, 216 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=18101: Fri May 16 10:17:51 2025
   read: IOPS=379, BW=1520KiB/s (1556kB/s)(1480KiB/974msec)
    clat (usec): min=3, max=23490, avg=1420.84, stdev=2009.24
     lat (usec): min=3, max=23492, avg=1421.38, stdev=2009.30
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    7], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[   49], 50.00th=[ 1221], 60.00th=[ 1549],
     | 70.00th=[ 1926], 80.00th=[ 2343], 90.00th=[ 2802], 95.00th=[ 4424],
     | 99.00th=[ 8160], 99.50th=[13566], 99.90th=[23462], 99.95th=[23462],
     | 99.99th=[23462]
   bw (  KiB/s): min= 1072, max= 1072, per=18.32%, avg=1072.00, stdev= 0.00, samples=1
   iops        : min=  268, max=  268, avg=268.00, stdev= 0.00, samples=1
  write: IOPS=408, BW=1634KiB/s (1674kB/s)(1592KiB/974msec)
    clat (usec): min=84, max=28381, avg=1088.26, stdev=1930.38
     lat (usec): min=85, max=28382, avg=1088.90, stdev=1930.39
    clat percentiles (usec):
     |  1.00th=[   90],  5.00th=[  101], 10.00th=[  109], 20.00th=[  119],
     | 30.00th=[  137], 40.00th=[  202], 50.00th=[  619], 60.00th=[  832],
     | 70.00th=[ 1106], 80.00th=[ 1811], 90.00th=[ 2540], 95.00th=[ 3949],
     | 99.00th=[ 7046], 99.50th=[11994], 99.90th=[28443], 99.95th=[28443],
     | 99.99th=[28443]
   bw (  KiB/s): min= 1000, max= 1000, per=16.24%, avg=1000.00, stdev= 0.00, samples=1
   iops        : min=  250, max=  250, avg=250.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.52%, 10=13.15%, 20=4.95%, 50=0.65%, 100=2.47%
  lat (usec)   : 250=19.53%, 500=2.73%, 750=5.34%, 1000=7.29%
  lat (msec)   : 2=21.22%, 4=16.80%, 10=4.69%, 20=0.39%, 50=0.26%
  cpu          : usr=0.41%, sys=17.06%, ctx=921, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=18104: Fri May 16 10:17:51 2025
   read: IOPS=350, BW=1404KiB/s (1437kB/s)(1436KiB/1023msec)
    clat (usec): min=3, max=34518, avg=1512.15, stdev=2675.64
     lat (usec): min=4, max=34519, avg=1512.67, stdev=2675.67
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   11], 40.00th=[  709], 50.00th=[ 1352], 60.00th=[ 1680],
     | 70.00th=[ 2008], 80.00th=[ 2376], 90.00th=[ 3064], 95.00th=[ 3589],
     | 99.00th=[ 6849], 99.50th=[24511], 99.90th=[34341], 99.95th=[34341],
     | 99.99th=[34341]
   bw (  KiB/s): min=  912, max= 1824, per=23.37%, avg=1368.00, stdev=644.88, samples=2
   iops        : min=  228, max=  456, avg=342.00, stdev=161.22, samples=2
  write: IOPS=399, BW=1599KiB/s (1638kB/s)(1636KiB/1023msec)
    clat (usec): min=84, max=27962, avg=1125.58, stdev=1999.33
     lat (usec): min=84, max=27964, avg=1126.15, stdev=1999.41
    clat percentiles (usec):
     |  1.00th=[   92],  5.00th=[  101], 10.00th=[  109], 20.00th=[  119],
     | 30.00th=[  141], 40.00th=[  208], 50.00th=[  652], 60.00th=[  816],
     | 70.00th=[ 1106], 80.00th=[ 1811], 90.00th=[ 2606], 95.00th=[ 3916],
     | 99.00th=[ 7832], 99.50th=[ 9503], 99.90th=[27919], 99.95th=[27919],
     | 99.99th=[27919]
   bw (  KiB/s): min= 1064, max= 2000, per=24.88%, avg=1532.00, stdev=661.85, samples=2
   iops        : min=  266, max=  500, avg=383.00, stdev=165.46, samples=2
  lat (usec)   : 4=0.13%, 10=11.59%, 20=4.82%, 50=0.39%, 100=3.12%
  lat (usec)   : 250=20.96%, 500=1.82%, 750=7.03%, 1000=6.25%
  lat (msec)   : 2=21.09%, 4=18.75%, 10=3.39%, 20=0.13%, 50=0.52%
  cpu          : usr=0.29%, sys=17.61%, ctx=894, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=18106: Fri May 16 10:17:51 2025
   read: IOPS=387, BW=1550KiB/s (1587kB/s)(1564KiB/1009msec)
    clat (usec): min=3, max=17978, avg=1456.38, stdev=1747.18
     lat (usec): min=4, max=17979, avg=1457.11, stdev=1747.16
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   11], 40.00th=[  832], 50.00th=[ 1319], 60.00th=[ 1713],
     | 70.00th=[ 2057], 80.00th=[ 2409], 90.00th=[ 3032], 95.00th=[ 3752],
     | 99.00th=[ 6980], 99.50th=[13435], 99.90th=[17957], 99.95th=[17957],
     | 99.99th=[17957]
   bw (  KiB/s): min= 1072, max= 2032, per=26.52%, avg=1552.00, stdev=678.82, samples=2
   iops        : min=  268, max=  508, avg=388.00, stdev=169.71, samples=2
  write: IOPS=373, BW=1495KiB/s (1530kB/s)(1508KiB/1009msec)
    clat (usec): min=91, max=22694, avg=1115.43, stdev=1943.99
     lat (usec): min=92, max=22696, avg=1116.70, stdev=1944.82
    clat percentiles (usec):
     |  1.00th=[   95],  5.00th=[  102], 10.00th=[  112], 20.00th=[  123],
     | 30.00th=[  141], 40.00th=[  217], 50.00th=[  676], 60.00th=[  873],
     | 70.00th=[ 1106], 80.00th=[ 1696], 90.00th=[ 2606], 95.00th=[ 3654],
     | 99.00th=[ 8979], 99.50th=[19006], 99.90th=[22676], 99.95th=[22676],
     | 99.99th=[22676]
   bw (  KiB/s): min= 1040, max= 1904, per=23.90%, avg=1472.00, stdev=610.94, samples=2
   iops        : min=  260, max=  476, avg=368.00, stdev=152.74, samples=2
  lat (usec)   : 4=0.13%, 10=12.11%, 20=5.21%, 50=0.26%, 100=1.56%
  lat (usec)   : 250=19.14%, 500=2.86%, 750=4.69%, 1000=8.72%
  lat (msec)   : 2=21.09%, 4=20.18%, 10=3.26%, 20=0.65%, 50=0.13%
  cpu          : usr=0.60%, sys=17.16%, ctx=972, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=18107: Fri May 16 10:17:51 2025
   read: IOPS=387, BW=1548KiB/s (1585kB/s)(1508KiB/974msec)
    clat (usec): min=3, max=40750, avg=1557.34, stdev=3029.21
     lat (usec): min=3, max=40752, avg=1557.99, stdev=3029.29
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[    9],
     | 30.00th=[   11], 40.00th=[  429], 50.00th=[ 1221], 60.00th=[ 1647],
     | 70.00th=[ 1991], 80.00th=[ 2343], 90.00th=[ 2999], 95.00th=[ 4490],
     | 99.00th=[ 8979], 99.50th=[32113], 99.90th=[40633], 99.95th=[40633],
     | 99.99th=[40633]
   bw (  KiB/s): min= 1008, max= 1008, per=17.22%, avg=1008.00, stdev= 0.00, samples=1
   iops        : min=  252, max=  252, avg=252.00, stdev= 0.00, samples=1
  write: IOPS=401, BW=1606KiB/s (1644kB/s)(1564KiB/974msec)
    clat (usec): min=88, max=6539, avg=968.53, stdev=1167.48
     lat (usec): min=88, max=6540, avg=969.33, stdev=1167.36
    clat percentiles (usec):
     |  1.00th=[   89],  5.00th=[   99], 10.00th=[  106], 20.00th=[  115],
     | 30.00th=[  127], 40.00th=[  180], 50.00th=[  371], 60.00th=[  799],
     | 70.00th=[ 1221], 80.00th=[ 1762], 90.00th=[ 2638], 95.00th=[ 3556],
     | 99.00th=[ 5407], 99.50th=[ 6063], 99.90th=[ 6521], 99.95th=[ 6521],
     | 99.99th=[ 6521]
   bw (  KiB/s): min= 1024, max= 1024, per=16.63%, avg=1024.00, stdev= 0.00, samples=1
   iops        : min=  256, max=  256, avg=256.00, stdev= 0.00, samples=1
  lat (usec)   : 4=0.26%, 10=14.19%, 20=4.04%, 50=0.65%, 100=2.99%
  lat (usec)   : 250=21.22%, 500=2.21%, 750=3.91%, 1000=6.51%
  lat (msec)   : 2=21.61%, 4=17.71%, 10=4.30%, 20=0.13%, 50=0.26%
  cpu          : usr=0.31%, sys=19.63%, ctx=885, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5853KiB/s (5994kB/s), 1404KiB/s-1550KiB/s (1437kB/s-1587kB/s), io=5988KiB (6132kB), run=974-1023msec
  WRITE: bw=6158KiB/s (6306kB/s), 1495KiB/s-1634KiB/s (1530kB/s-1674kB/s), io=6300KiB (6451kB), run=974-1023msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=18102: Fri May 16 10:17:52 2025
   read: IOPS=230, BW=923KiB/s (945kB/s)(1480KiB/1603msec)
    clat (usec): min=520, max=21235, avg=1448.52, stdev=1588.44
     lat (usec): min=520, max=21236, avg=1449.29, stdev=1588.41
    clat percentiles (usec):
     |  1.00th=[  537],  5.00th=[  603], 10.00th=[  635], 20.00th=[  701],
     | 30.00th=[  758], 40.00th=[  832], 50.00th=[  914], 60.00th=[  996],
     | 70.00th=[ 1254], 80.00th=[ 1696], 90.00th=[ 3130], 95.00th=[ 4080],
     | 99.00th=[ 6456], 99.50th=[ 9372], 99.90th=[21365], 99.95th=[21365],
     | 99.99th=[21365]
   bw (  KiB/s): min=  624, max= 1296, per=24.11%, avg=890.67, stdev=356.82, samples=3
   iops        : min=  156, max=  324, avg=222.67, stdev=89.20, samples=3
  write: IOPS=248, BW=993KiB/s (1017kB/s)(1592KiB/1603msec)
    clat (usec): min=998, max=16493, avg=2641.03, stdev=1839.43
     lat (usec): min=998, max=16494, avg=2641.79, stdev=1839.45
    clat percentiles (usec):
     |  1.00th=[ 1074],  5.00th=[ 1270], 10.00th=[ 1467], 20.00th=[ 1663],
     | 30.00th=[ 1795], 40.00th=[ 1893], 50.00th=[ 2008], 60.00th=[ 2180],
     | 70.00th=[ 2507], 80.00th=[ 3130], 90.00th=[ 4817], 95.00th=[ 5997],
     | 99.00th=[11076], 99.50th=[16450], 99.90th=[16450], 99.95th=[16450],
     | 99.99th=[16450]
   bw (  KiB/s): min=  624, max= 1456, per=24.91%, avg=968.00, stdev=434.29, samples=3
   iops        : min=  156, max=  364, avg=242.00, stdev=108.57, samples=3
  lat (usec)   : 750=13.28%, 1000=16.02%
  lat (msec)   : 2=36.07%, 4=25.13%, 10=8.72%, 20=0.65%, 50=0.13%
  cpu          : usr=0.25%, sys=6.18%, ctx=854, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=18103: Fri May 16 10:17:52 2025
   read: IOPS=221, BW=886KiB/s (907kB/s)(1436KiB/1621msec)
    clat (usec): min=516, max=45576, avg=1522.23, stdev=2978.19
     lat (usec): min=516, max=45576, avg=1522.85, stdev=2978.19
    clat percentiles (usec):
     |  1.00th=[  562],  5.00th=[  627], 10.00th=[  668], 20.00th=[  717],
     | 30.00th=[  775], 40.00th=[  848], 50.00th=[  922], 60.00th=[ 1012],
     | 70.00th=[ 1205], 80.00th=[ 1647], 90.00th=[ 2540], 95.00th=[ 3654],
     | 99.00th=[ 8356], 99.50th=[28443], 99.90th=[45351], 99.95th=[45351],
     | 99.99th=[45351]
   bw (  KiB/s): min=  520, max= 1389, per=23.72%, avg=876.33, stdev=455.10, samples=3
   iops        : min=  130, max=  347, avg=219.00, stdev=113.64, samples=3
  write: IOPS=252, BW=1009KiB/s (1033kB/s)(1636KiB/1621msec)
    clat (usec): min=1047, max=17436, avg=2606.45, stdev=1609.06
     lat (usec): min=1048, max=17438, avg=2607.29, stdev=1609.09
    clat percentiles (usec):
     |  1.00th=[ 1139],  5.00th=[ 1336], 10.00th=[ 1549], 20.00th=[ 1729],
     | 30.00th=[ 1844], 40.00th=[ 1942], 50.00th=[ 2114], 60.00th=[ 2278],
     | 70.00th=[ 2704], 80.00th=[ 3228], 90.00th=[ 4228], 95.00th=[ 5145],
     | 99.00th=[ 8455], 99.50th=[12387], 99.90th=[17433], 99.95th=[17433],
     | 99.99th=[17433]
   bw (  KiB/s): min=  600, max= 1397, per=25.16%, avg=977.67, stdev=400.13, samples=3
   iops        : min=  150, max=  349, avg=244.33, stdev=99.90, samples=3
  lat (usec)   : 750=12.11%, 1000=15.76%
  lat (msec)   : 2=36.33%, 4=27.60%, 10=7.29%, 20=0.65%, 50=0.26%
  cpu          : usr=0.43%, sys=5.93%, ctx=830, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=18105: Fri May 16 10:17:52 2025
   read: IOPS=243, BW=976KiB/s (999kB/s)(1564KiB/1603msec)
    clat (usec): min=529, max=16538, avg=1462.78, stdev=1459.85
     lat (usec): min=530, max=16539, avg=1463.40, stdev=1459.85
    clat percentiles (usec):
     |  1.00th=[  537],  5.00th=[  619], 10.00th=[  660], 20.00th=[  717],
     | 30.00th=[  775], 40.00th=[  824], 50.00th=[  898], 60.00th=[ 1029],
     | 70.00th=[ 1369], 80.00th=[ 1762], 90.00th=[ 3195], 95.00th=[ 4146],
     | 99.00th=[ 7177], 99.50th=[ 8717], 99.90th=[16581], 99.95th=[16581],
     | 99.99th=[16581]
   bw (  KiB/s): min=  560, max= 1528, per=25.99%, avg=960.00, stdev=505.39, samples=3
   iops        : min=  140, max=  382, avg=240.00, stdev=126.35, samples=3
  write: IOPS=235, BW=941KiB/s (963kB/s)(1508KiB/1603msec)
    clat (usec): min=1070, max=22092, avg=2688.79, stdev=2001.12
     lat (usec): min=1071, max=22095, avg=2689.49, stdev=2001.23
    clat percentiles (usec):
     |  1.00th=[ 1172],  5.00th=[ 1287], 10.00th=[ 1516], 20.00th=[ 1713],
     | 30.00th=[ 1811], 40.00th=[ 1926], 50.00th=[ 2057], 60.00th=[ 2245],
     | 70.00th=[ 2671], 80.00th=[ 3261], 90.00th=[ 4359], 95.00th=[ 5866],
     | 99.00th=[10814], 99.50th=[19268], 99.90th=[22152], 99.95th=[22152],
     | 99.99th=[22152]
   bw (  KiB/s): min=  656, max= 1376, per=23.33%, avg=906.67, stdev=406.77, samples=3
   iops        : min=  164, max=  344, avg=226.67, stdev=101.69, samples=3
  lat (usec)   : 750=13.54%, 1000=16.41%
  lat (msec)   : 2=35.68%, 4=25.00%, 10=8.72%, 20=0.52%, 50=0.13%
  cpu          : usr=0.56%, sys=5.87%, ctx=838, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=18108: Fri May 16 10:17:52 2025
   read: IOPS=237, BW=949KiB/s (972kB/s)(1508KiB/1589msec)
    clat (usec): min=493, max=11134, avg=1437.44, stdev=1340.02
     lat (usec): min=494, max=11135, avg=1438.07, stdev=1340.02
    clat percentiles (usec):
     |  1.00th=[  537],  5.00th=[  594], 10.00th=[  644], 20.00th=[  701],
     | 30.00th=[  791], 40.00th=[  848], 50.00th=[  922], 60.00th=[ 1020],
     | 70.00th=[ 1287], 80.00th=[ 1713], 90.00th=[ 3130], 95.00th=[ 3851],
     | 99.00th=[ 6915], 99.50th=[ 8979], 99.90th=[11076], 99.95th=[11076],
     | 99.99th=[11076]
   bw (  KiB/s): min=  584, max= 1296, per=24.74%, avg=914.00, stdev=358.84, samples=3
   iops        : min=  146, max=  324, avg=228.33, stdev=89.75, samples=3
  write: IOPS=246, BW=984KiB/s (1008kB/s)(1564KiB/1589msec)
    clat (usec): min=983, max=31264, avg=2631.30, stdev=2068.37
     lat (usec): min=983, max=31266, avg=2632.00, stdev=2068.44
    clat percentiles (usec):
     |  1.00th=[ 1123],  5.00th=[ 1303], 10.00th=[ 1467], 20.00th=[ 1680],
     | 30.00th=[ 1778], 40.00th=[ 1893], 50.00th=[ 2024], 60.00th=[ 2180],
     | 70.00th=[ 2573], 80.00th=[ 3195], 90.00th=[ 4424], 95.00th=[ 5932],
     | 99.00th=[ 9110], 99.50th=[10683], 99.90th=[31327], 99.95th=[31327],
     | 99.99th=[31327]
   bw (  KiB/s): min=  616, max= 1464, per=24.82%, avg=964.67, stdev=443.62, samples=3
   iops        : min=  154, max=  366, avg=241.00, stdev=110.99, samples=3
  lat (usec)   : 500=0.13%, 750=12.63%, 1000=16.15%
  lat (msec)   : 2=36.33%, 4=26.17%, 10=8.07%, 20=0.39%, 50=0.13%
  cpu          : usr=0.44%, sys=5.79%, ctx=820, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3694KiB/s (3783kB/s), 886KiB/s-976KiB/s (907kB/s-999kB/s), io=5988KiB (6132kB), run=1589-1621msec
  WRITE: bw=3886KiB/s (3980kB/s), 941KiB/s-1009KiB/s (963kB/s-1033kB/s), io=6300KiB (6451kB), run=1589-1621msec