== sanity test 398b: DIO and buffer IO race ============== 10:03:49 (1747404229)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0711048 s, 177 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=13794: Fri May 16 10:03:51 2025
   read: IOPS=348, BW=1392KiB/s (1426kB/s)(1480KiB/1063msec)
    clat (usec): min=3, max=37041, avg=1592.57, stdev=3162.82
     lat (usec): min=4, max=37041, avg=1593.09, stdev=3162.83
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   11], 40.00th=[   15], 50.00th=[ 1106], 60.00th=[ 1729],
     | 70.00th=[ 2114], 80.00th=[ 2540], 90.00th=[ 3195], 95.00th=[ 4490],
     | 99.00th=[15926], 99.50th=[32113], 99.90th=[36963], 99.95th=[36963],
     | 99.99th=[36963]
   bw (  KiB/s): min= 1152, max= 1432, per=24.28%, avg=1292.00, stdev=197.99, samples=2
   iops        : min=  288, max=  358, avg=323.00, stdev=49.50, samples=2
  write: IOPS=374, BW=1498KiB/s (1534kB/s)(1592KiB/1063msec)
    clat (usec): min=82, max=10003, avg=1165.03, stdev=1534.53
     lat (usec): min=82, max=10004, avg=1167.52, stdev=1536.88
    clat percentiles (usec):
     |  1.00th=[   86],  5.00th=[   98], 10.00th=[  109], 20.00th=[  128],
     | 30.00th=[  155], 40.00th=[  198], 50.00th=[  562], 60.00th=[  922],
     | 70.00th=[ 1369], 80.00th=[ 2057], 90.00th=[ 3228], 95.00th=[ 3949],
     | 99.00th=[ 8455], 99.50th=[ 9896], 99.90th=[10028], 99.95th=[10028],
     | 99.99th=[10028]
   bw (  KiB/s): min= 1104, max= 1704, per=25.07%, avg=1404.00, stdev=424.26, samples=2
   iops        : min=  276, max=  426, avg=351.00, stdev=106.07, samples=2
  lat (usec)   : 4=0.13%, 10=12.50%, 20=8.72%, 50=0.52%, 100=3.12%
  lat (usec)   : 250=20.44%, 500=2.47%, 750=2.21%, 1000=5.34%
  lat (msec)   : 2=18.49%, 4=20.70%, 10=4.69%, 20=0.26%, 50=0.39%
  cpu          : usr=0.28%, sys=16.48%, ctx=870, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=13795: Fri May 16 10:03:51 2025
   read: IOPS=335, BW=1342KiB/s (1374kB/s)(1436KiB/1070msec)
    clat (usec): min=3, max=31438, avg=1611.35, stdev=2429.93
     lat (usec): min=4, max=31438, avg=1613.37, stdev=2429.14
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[  375], 50.00th=[ 1287], 60.00th=[ 1811],
     | 70.00th=[ 2212], 80.00th=[ 2606], 90.00th=[ 3556], 95.00th=[ 4621],
     | 99.00th=[10421], 99.50th=[15533], 99.90th=[31327], 99.95th=[31327],
     | 99.99th=[31327]
   bw (  KiB/s): min= 1032, max= 1544, per=24.20%, avg=1288.00, stdev=362.04, samples=2
   iops        : min=  258, max=  386, avg=322.00, stdev=90.51, samples=2
  write: IOPS=382, BW=1529KiB/s (1566kB/s)(1636KiB/1070msec)
    clat (usec): min=86, max=27210, avg=1176.86, stdev=1993.63
     lat (usec): min=87, max=27211, avg=1177.50, stdev=1993.65
    clat percentiles (usec):
     |  1.00th=[   90],  5.00th=[  100], 10.00th=[  109], 20.00th=[  133],
     | 30.00th=[  169], 40.00th=[  235], 50.00th=[  766], 60.00th=[  955],
     | 70.00th=[ 1270], 80.00th=[ 1876], 90.00th=[ 2868], 95.00th=[ 3589],
     | 99.00th=[ 6259], 99.50th=[ 9503], 99.90th=[27132], 99.95th=[27132],
     | 99.99th=[27132]
   bw (  KiB/s): min= 1288, max= 1624, per=26.00%, avg=1456.00, stdev=237.59, samples=2
   iops        : min=  322, max=  406, avg=364.00, stdev=59.40, samples=2
  lat (usec)   : 4=0.26%, 10=10.16%, 20=7.81%, 50=0.39%, 100=2.47%
  lat (usec)   : 250=19.40%, 500=2.60%, 750=2.21%, 1000=9.11%
  lat (msec)   : 2=18.49%, 4=22.27%, 10=4.04%, 20=0.52%, 50=0.26%
  cpu          : usr=0.56%, sys=15.34%, ctx=899, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=13796: Fri May 16 10:03:51 2025
   read: IOPS=347, BW=1390KiB/s (1424kB/s)(1564KiB/1125msec)
    clat (usec): min=3, max=33789, avg=1722.22, stdev=2854.91
     lat (usec): min=3, max=33790, avg=1723.11, stdev=2855.03
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   12], 40.00th=[  865], 50.00th=[ 1450], 60.00th=[ 1795],
     | 70.00th=[ 2278], 80.00th=[ 2704], 90.00th=[ 3261], 95.00th=[ 4359],
     | 99.00th=[20055], 99.50th=[23725], 99.90th=[33817], 99.95th=[33817],
     | 99.99th=[33817]
   bw (  KiB/s): min=  920, max= 1544, per=23.15%, avg=1232.00, stdev=441.23, samples=2
   iops        : min=  230, max=  386, avg=308.00, stdev=110.31, samples=2
  write: IOPS=335, BW=1340KiB/s (1373kB/s)(1508KiB/1125msec)
    clat (usec): min=86, max=9798, avg=1164.05, stdev=1596.68
     lat (usec): min=87, max=9799, avg=1165.17, stdev=1596.49
    clat percentiles (usec):
     |  1.00th=[   93],  5.00th=[  101], 10.00th=[  110], 20.00th=[  123],
     | 30.00th=[  151], 40.00th=[  184], 50.00th=[  668], 60.00th=[  848],
     | 70.00th=[ 1237], 80.00th=[ 1926], 90.00th=[ 3032], 95.00th=[ 4817],
     | 99.00th=[ 7242], 99.50th=[ 9241], 99.90th=[ 9765], 99.95th=[ 9765],
     | 99.99th=[ 9765]
   bw (  KiB/s): min=  984, max= 1464, per=21.86%, avg=1224.00, stdev=339.41, samples=2
   iops        : min=  246, max=  366, avg=306.00, stdev=84.85, samples=2
  lat (usec)   : 4=0.26%, 10=11.85%, 20=6.38%, 50=0.39%, 100=1.95%
  lat (usec)   : 250=20.05%, 500=1.82%, 750=3.12%, 1000=8.07%
  lat (msec)   : 2=18.88%, 4=21.48%, 10=5.21%, 50=0.52%
  cpu          : usr=0.27%, sys=15.75%, ctx=942, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=13797: Fri May 16 10:03:51 2025
   read: IOPS=349, BW=1396KiB/s (1430kB/s)(1508KiB/1080msec)
    clat (usec): min=3, max=20450, avg=1619.46, stdev=2133.48
     lat (usec): min=4, max=20452, avg=1620.05, stdev=2133.55
    clat percentiles (usec):
     |  1.00th=[    4],  5.00th=[    6], 10.00th=[    8], 20.00th=[   10],
     | 30.00th=[   13], 40.00th=[  619], 50.00th=[ 1352], 60.00th=[ 1860],
     | 70.00th=[ 2311], 80.00th=[ 2704], 90.00th=[ 3359], 95.00th=[ 4555],
     | 99.00th=[ 9765], 99.50th=[16057], 99.90th=[20579], 99.95th=[20579],
     | 99.99th=[20579]
   bw (  KiB/s): min= 1088, max= 1512, per=24.43%, avg=1300.00, stdev=299.81, samples=2
   iops        : min=  272, max=  378, avg=325.00, stdev=74.95, samples=2
  write: IOPS=362, BW=1448KiB/s (1483kB/s)(1564KiB/1080msec)
    clat (usec): min=82, max=37100, avg=1168.98, stdev=2470.67
     lat (usec): min=83, max=37100, avg=1169.79, stdev=2470.65
    clat percentiles (usec):
     |  1.00th=[   91],  5.00th=[  101], 10.00th=[  112], 20.00th=[  133],
     | 30.00th=[  163], 40.00th=[  210], 50.00th=[  461], 60.00th=[  840],
     | 70.00th=[ 1139], 80.00th=[ 1795], 90.00th=[ 2671], 95.00th=[ 3818],
     | 99.00th=[ 9765], 99.50th=[17695], 99.90th=[36963], 99.95th=[36963],
     | 99.99th=[36963]
   bw (  KiB/s): min= 1056, max= 1640, per=24.07%, avg=1348.00, stdev=412.95, samples=2
   iops        : min=  264, max=  410, avg=337.00, stdev=103.24, samples=2
  lat (usec)   : 4=0.52%, 10=10.68%, 20=7.16%, 50=0.52%, 100=2.60%
  lat (usec)   : 250=19.92%, 500=3.65%, 750=2.47%, 1000=7.94%
  lat (msec)   : 2=17.97%, 4=21.09%, 10=4.69%, 20=0.52%, 50=0.26%
  cpu          : usr=0.46%, sys=16.96%, ctx=863, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5323KiB/s (5450kB/s), 1342KiB/s-1396KiB/s (1374kB/s-1430kB/s), io=5988KiB (6132kB), run=1063-1125msec
  WRITE: bw=5600KiB/s (5734kB/s), 1340KiB/s-1529KiB/s (1373kB/s-1566kB/s), io=6300KiB (6451kB), run=1063-1125msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=13799: Fri May 16 10:03:52 2025
   read: IOPS=219, BW=878KiB/s (899kB/s)(1480KiB/1686msec)
    clat (usec): min=566, max=42267, avg=1658.81, stdev=3302.72
     lat (usec): min=566, max=42268, avg=1659.38, stdev=3302.74
    clat percentiles (usec):
     |  1.00th=[  578],  5.00th=[  668], 10.00th=[  701], 20.00th=[  758],
     | 30.00th=[  807], 40.00th=[  857], 50.00th=[  922], 60.00th=[ 1037],
     | 70.00th=[ 1254], 80.00th=[ 1745], 90.00th=[ 2900], 95.00th=[ 3785],
     | 99.00th=[15008], 99.50th=[40109], 99.90th=[42206], 99.95th=[42206],
     | 99.99th=[42206]
   bw (  KiB/s): min=  512, max= 1120, per=22.95%, avg=805.33, stdev=304.56, samples=3
   iops        : min=  128, max=  280, avg=201.33, stdev=76.14, samples=3
  write: IOPS=236, BW=944KiB/s (967kB/s)(1592KiB/1686msec)
    clat (usec): min=1072, max=12159, avg=2676.97, stdev=1459.01
     lat (usec): min=1072, max=12160, avg=2677.77, stdev=1459.05
    clat percentiles (usec):
     |  1.00th=[ 1139],  5.00th=[ 1319], 10.00th=[ 1549], 20.00th=[ 1745],
     | 30.00th=[ 1876], 40.00th=[ 1975], 50.00th=[ 2089], 60.00th=[ 2311],
     | 70.00th=[ 2999], 80.00th=[ 3458], 90.00th=[ 4686], 95.00th=[ 5407],
     | 99.00th=[ 7242], 99.50th=[11338], 99.90th=[12125], 99.95th=[12125],
     | 99.99th=[12125]
   bw (  KiB/s): min=  544, max= 1344, per=23.98%, avg=885.33, stdev=412.70, samples=3
   iops        : min=  136, max=  336, avg=221.33, stdev=103.18, samples=3
  lat (usec)   : 750=8.85%, 1000=18.75%
  lat (msec)   : 2=35.03%, 4=27.86%, 10=8.59%, 20=0.65%, 50=0.26%
  cpu          : usr=0.36%, sys=5.93%, ctx=815, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=13800: Fri May 16 10:03:52 2025
   read: IOPS=210, BW=842KiB/s (862kB/s)(1436KiB/1706msec)
    clat (usec): min=568, max=41614, avg=1528.12, stdev=2403.95
     lat (usec): min=568, max=41616, avg=1528.71, stdev=2404.01
    clat percentiles (usec):
     |  1.00th=[  635],  5.00th=[  668], 10.00th=[  709], 20.00th=[  766],
     | 30.00th=[  816], 40.00th=[  865], 50.00th=[  922], 60.00th=[  988],
     | 70.00th=[ 1221], 80.00th=[ 1778], 90.00th=[ 3425], 95.00th=[ 3982],
     | 99.00th=[ 6194], 99.50th=[ 6980], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=  471, max= 1280, per=22.64%, avg=794.33, stdev=428.23, samples=3
   iops        : min=  117, max=  320, avg=198.33, stdev=107.34, samples=3
  write: IOPS=239, BW=959KiB/s (982kB/s)(1636KiB/1706msec)
    clat (usec): min=1117, max=29705, avg=2812.26, stdev=2372.26
     lat (usec): min=1118, max=29706, avg=2812.96, stdev=2372.31
    clat percentiles (usec):
     |  1.00th=[ 1221],  5.00th=[ 1336], 10.00th=[ 1565], 20.00th=[ 1762],
     | 30.00th=[ 1860], 40.00th=[ 1991], 50.00th=[ 2089], 60.00th=[ 2311],
     | 70.00th=[ 2802], 80.00th=[ 3490], 90.00th=[ 4686], 95.00th=[ 5800],
     | 99.00th=[ 9503], 99.50th=[14091], 99.90th=[29754], 99.95th=[29754],
     | 99.99th=[29754]
   bw (  KiB/s): min=  550, max= 1304, per=23.67%, avg=874.00, stdev=388.02, samples=3
   iops        : min=  137, max=  326, avg=218.33, stdev=97.21, samples=3
  lat (usec)   : 750=8.07%, 1000=20.05%
  lat (msec)   : 2=31.77%, 4=30.08%, 10=9.37%, 20=0.26%, 50=0.39%
  cpu          : usr=0.47%, sys=6.10%, ctx=821, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=13801: Fri May 16 10:03:52 2025
   read: IOPS=234, BW=938KiB/s (960kB/s)(1564KiB/1668msec)
    clat (usec): min=560, max=13263, avg=1412.01, stdev=1312.10
     lat (usec): min=561, max=13264, avg=1412.73, stdev=1312.09
    clat percentiles (usec):
     |  1.00th=[  578],  5.00th=[  652], 10.00th=[  685], 20.00th=[  742],
     | 30.00th=[  791], 40.00th=[  832], 50.00th=[  881], 60.00th=[  988],
     | 70.00th=[ 1205], 80.00th=[ 1729], 90.00th=[ 2933], 95.00th=[ 4293],
     | 99.00th=[ 6325], 99.50th=[ 8455], 99.90th=[13304], 99.95th=[13304],
     | 99.99th=[13304]
   bw (  KiB/s): min=  439, max= 1336, per=24.54%, avg=861.00, stdev=450.84, samples=3
   iops        : min=  109, max=  334, avg=215.00, stdev=113.06, samples=3
  write: IOPS=226, BW=904KiB/s (926kB/s)(1508KiB/1668msec)
    clat (usec): min=1044, max=50380, avg=2937.90, stdev=3755.12
     lat (usec): min=1045, max=50381, avg=2938.64, stdev=3755.16
    clat percentiles (usec):
     |  1.00th=[ 1156],  5.00th=[ 1303], 10.00th=[ 1467], 20.00th=[ 1713],
     | 30.00th=[ 1844], 40.00th=[ 1942], 50.00th=[ 2057], 60.00th=[ 2245],
     | 70.00th=[ 2704], 80.00th=[ 3720], 90.00th=[ 4883], 95.00th=[ 5735],
     | 99.00th=[10814], 99.50th=[48497], 99.90th=[50594], 99.95th=[50594],
     | 99.99th=[50594]
   bw (  KiB/s): min=  534, max= 1320, per=23.02%, avg=850.00, stdev=415.01, samples=3
   iops        : min=  133, max=  330, avg=212.33, stdev=103.94, samples=3
  lat (usec)   : 750=11.59%, 1000=19.14%
  lat (msec)   : 2=34.64%, 4=23.70%, 10=10.29%, 20=0.39%, 50=0.13%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.66%, sys=5.52%, ctx=813, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=13802: Fri May 16 10:03:52 2025
   read: IOPS=226, BW=907KiB/s (929kB/s)(1508KiB/1662msec)
    clat (usec): min=560, max=14730, avg=1430.30, stdev=1491.83
     lat (usec): min=560, max=14730, avg=1430.87, stdev=1491.85
    clat percentiles (usec):
     |  1.00th=[  603],  5.00th=[  668], 10.00th=[  709], 20.00th=[  750],
     | 30.00th=[  807], 40.00th=[  840], 50.00th=[  906], 60.00th=[  996],
     | 70.00th=[ 1172], 80.00th=[ 1631], 90.00th=[ 2769], 95.00th=[ 4113],
     | 99.00th=[ 9241], 99.50th=[10945], 99.90th=[14746], 99.95th=[14746],
     | 99.99th=[14746]
   bw (  KiB/s): min=  504, max= 1192, per=24.17%, avg=848.00, stdev=344.00, samples=3
   iops        : min=  126, max=  298, avg=212.00, stdev=86.00, samples=3
  write: IOPS=235, BW=941KiB/s (964kB/s)(1564KiB/1662msec)
    clat (usec): min=1050, max=46915, avg=2851.99, stdev=3138.95
     lat (usec): min=1050, max=46916, avg=2852.91, stdev=3138.99
    clat percentiles (usec):
     |  1.00th=[ 1172],  5.00th=[ 1352], 10.00th=[ 1549], 20.00th=[ 1745],
     | 30.00th=[ 1860], 40.00th=[ 1975], 50.00th=[ 2089], 60.00th=[ 2311],
     | 70.00th=[ 2737], 80.00th=[ 3294], 90.00th=[ 4424], 95.00th=[ 5866],
     | 99.00th=[11863], 99.50th=[29754], 99.90th=[46924], 99.95th=[46924],
     | 99.99th=[46924]
   bw (  KiB/s): min=  560, max= 1352, per=23.98%, avg=885.33, stdev=414.48, samples=3
   iops        : min=  140, max=  338, avg=221.33, stdev=103.62, samples=3
  lat (usec)   : 750=9.37%, 1000=20.70%
  lat (msec)   : 2=33.46%, 4=26.30%, 10=9.11%, 20=0.65%, 50=0.39%
  cpu          : usr=0.54%, sys=5.78%, ctx=810, majf=0, minf=33
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3510KiB/s (3594kB/s), 842KiB/s-938KiB/s (862kB/s-960kB/s), io=5988KiB (6132kB), run=1662-1706msec
  WRITE: bw=3693KiB/s (3781kB/s), 904KiB/s-959KiB/s (926kB/s-982kB/s), io=6300KiB (6451kB), run=1662-1706msec