== sanity test 398b: DIO and buffer IO race ============== 21:44:52 (1736995492)
/usr/bin/fio
12+0 records in
12+0 records out
12582912 bytes (13 MB) copied, 0.0863453 s, 146 MB/s
mix direct rw 12M to OST0 by fio with 4 jobs...
mix buffer rw 12M to OST0 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.7
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=20942: Wed Jan 15 21:44:55 2025
   read: IOPS=274, BW=1097KiB/s (1123kB/s)(1480KiB/1349msec)
    clat (usec): min=4, max=37778, avg=2141.04, stdev=3479.56
     lat (usec): min=4, max=37779, avg=2142.21, stdev=3479.35
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    8], 10.00th=[    9], 20.00th=[   12],
     | 30.00th=[   15], 40.00th=[  359], 50.00th=[ 1811], 60.00th=[ 2278],
     | 70.00th=[ 2769], 80.00th=[ 3228], 90.00th=[ 4293], 95.00th=[ 5735],
     | 99.00th=[20579], 99.50th=[30278], 99.90th=[38011], 99.95th=[38011],
     | 99.99th=[38011]
   bw (  KiB/s): min=  784, max= 1048, per=21.17%, avg=916.00, stdev=186.68, samples=2
   iops        : min=  196, max=  262, avg=229.00, stdev=46.67, samples=2
  write: IOPS=295, BW=1180KiB/s (1208kB/s)(1592KiB/1349msec)
    clat (usec): min=83, max=8447, avg=1384.05, stdev=1556.73
     lat (usec): min=84, max=8447, avg=1384.81, stdev=1556.79
    clat percentiles (usec):
     |  1.00th=[  104],  5.00th=[  121], 10.00th=[  137], 20.00th=[  163],
     | 30.00th=[  190], 40.00th=[  334], 50.00th=[  963], 60.00th=[ 1188],
     | 70.00th=[ 1532], 80.00th=[ 2474], 90.00th=[ 3556], 95.00th=[ 4752],
     | 99.00th=[ 6915], 99.50th=[ 7439], 99.90th=[ 8455], 99.95th=[ 8455],
     | 99.99th=[ 8455]
   bw (  KiB/s): min=  808, max= 1224, per=22.32%, avg=1016.00, stdev=294.16, samples=2
   iops        : min=  202, max=  306, avg=254.00, stdev=73.54, samples=2
  lat (usec)   : 10=6.64%, 20=11.98%, 50=0.26%, 100=0.39%, 250=19.66%
  lat (usec)   : 500=2.21%, 750=0.78%, 1000=3.78%
  lat (msec)   : 2=18.75%, 4=25.13%, 10=9.64%, 20=0.26%, 50=0.52%
  cpu          : usr=0.15%, sys=16.25%, ctx=894, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20943: Wed Jan 15 21:44:55 2025
   read: IOPS=268, BW=1073KiB/s (1099kB/s)(1436KiB/1338msec)
    clat (usec): min=4, max=22920, avg=1924.62, stdev=2194.77
     lat (usec): min=4, max=22921, avg=1925.50, stdev=2194.84
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[    9], 10.00th=[   10], 20.00th=[   13],
     | 30.00th=[   17], 40.00th=[ 1156], 50.00th=[ 1860], 60.00th=[ 2376],
     | 70.00th=[ 2835], 80.00th=[ 3294], 90.00th=[ 3982], 95.00th=[ 4948],
     | 99.00th=[ 8160], 99.50th=[15270], 99.90th=[22938], 99.95th=[22938],
     | 99.99th=[22938]
   bw (  KiB/s): min=  840, max= 1120, per=22.65%, avg=980.00, stdev=197.99, samples=2
   iops        : min=  210, max=  280, avg=245.00, stdev=49.50, samples=2
  write: IOPS=305, BW=1223KiB/s (1252kB/s)(1636KiB/1338msec)
    clat (usec): min=88, max=35393, avg=1562.99, stdev=2552.02
     lat (usec): min=89, max=35394, avg=1563.98, stdev=2552.00
    clat percentiles (usec):
     |  1.00th=[  106],  5.00th=[  123], 10.00th=[  151], 20.00th=[  174],
     | 30.00th=[  204], 40.00th=[  392], 50.00th=[  947], 60.00th=[ 1254],
     | 70.00th=[ 1614], 80.00th=[ 2638], 90.00th=[ 3720], 95.00th=[ 4817],
     | 99.00th=[ 8848], 99.50th=[ 9765], 99.90th=[35390], 99.95th=[35390],
     | 99.99th=[35390]
   bw (  KiB/s): min=  944, max= 1256, per=24.17%, avg=1100.00, stdev=220.62, samples=2
   iops        : min=  236, max=  314, avg=275.00, stdev=55.15, samples=2
  lat (usec)   : 10=4.95%, 20=10.68%, 50=0.91%, 100=0.78%, 250=17.97%
  lat (usec)   : 500=4.69%, 750=1.04%, 1000=4.30%
  lat (msec)   : 2=19.92%, 4=25.78%, 10=8.46%, 20=0.13%, 50=0.39%
  cpu          : usr=0.37%, sys=15.48%, ctx=947, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20944: Wed Jan 15 21:44:55 2025
   read: IOPS=287, BW=1152KiB/s (1179kB/s)(1564KiB/1358msec)
    clat (usec): min=4, max=34913, avg=2045.36, stdev=2864.12
     lat (usec): min=4, max=34914, avg=2046.06, stdev=2864.18
    clat percentiles (usec):
     |  1.00th=[    5],  5.00th=[    7], 10.00th=[    9], 20.00th=[   11],
     | 30.00th=[   14], 40.00th=[ 1172], 50.00th=[ 1909], 60.00th=[ 2311],
     | 70.00th=[ 2900], 80.00th=[ 3261], 90.00th=[ 3818], 95.00th=[ 5211],
     | 99.00th=[11207], 99.50th=[28181], 99.90th=[34866], 99.95th=[34866],
     | 99.99th=[34866]
   bw (  KiB/s): min=  720, max= 1144, per=21.54%, avg=932.00, stdev=299.81, samples=2
   iops        : min=  180, max=  286, avg=233.00, stdev=74.95, samples=2
  write: IOPS=277, BW=1110KiB/s (1137kB/s)(1508KiB/1358msec)
    clat (usec): min=97, max=41925, avg=1456.72, stdev=2804.36
     lat (usec): min=98, max=41926, avg=1457.45, stdev=2804.39
    clat percentiles (usec):
     |  1.00th=[  106],  5.00th=[  121], 10.00th=[  141], 20.00th=[  167],
     | 30.00th=[  184], 40.00th=[  221], 50.00th=[  963], 60.00th=[ 1172],
     | 70.00th=[ 1532], 80.00th=[ 2311], 90.00th=[ 3228], 95.00th=[ 4228],
     | 99.00th=[ 9896], 99.50th=[20317], 99.90th=[41681], 99.95th=[41681],
     | 99.99th=[41681]
   bw (  KiB/s): min=  816, max=  984, per=19.77%, avg=900.00, stdev=118.79, samples=2
   iops        : min=  204, max=  246, avg=225.00, stdev=29.70, samples=2
  lat (usec)   : 10=8.46%, 20=9.37%, 50=0.26%, 100=0.65%, 250=20.44%
  lat (usec)   : 500=1.82%, 750=0.65%, 1000=2.86%
  lat (msec)   : 2=19.14%, 4=29.17%, 10=6.12%, 20=0.52%, 50=0.52%
  cpu          : usr=0.15%, sys=16.14%, ctx=915, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20945: Wed Jan 15 21:44:55 2025
   read: IOPS=272, BW=1090KiB/s (1116kB/s)(1508KiB/1384msec)
    clat (usec): min=4, max=34103, avg=2172.47, stdev=2978.29
     lat (usec): min=4, max=34104, avg=2173.10, stdev=2978.29
    clat percentiles (usec):
     |  1.00th=[    6],  5.00th=[    9], 10.00th=[   10], 20.00th=[   12],
     | 30.00th=[   16], 40.00th=[ 1172], 50.00th=[ 1876], 60.00th=[ 2442],
     | 70.00th=[ 2966], 80.00th=[ 3458], 90.00th=[ 4293], 95.00th=[ 6325],
     | 99.00th=[18220], 99.50th=[19006], 99.90th=[34341], 99.95th=[34341],
     | 99.99th=[34341]
   bw (  KiB/s): min=  832, max= 1160, per=23.02%, avg=996.00, stdev=231.93, samples=2
   iops        : min=  208, max=  290, avg=249.00, stdev=57.98, samples=2
  write: IOPS=282, BW=1130KiB/s (1157kB/s)(1564KiB/1384msec)
    clat (usec): min=89, max=43385, avg=1426.85, stdev=2821.55
     lat (usec): min=89, max=43386, avg=1428.38, stdev=2821.58
    clat percentiles (usec):
     |  1.00th=[   96],  5.00th=[  115], 10.00th=[  135], 20.00th=[  163],
     | 30.00th=[  186], 40.00th=[  237], 50.00th=[  906], 60.00th=[ 1172],
     | 70.00th=[ 1483], 80.00th=[ 2278], 90.00th=[ 3392], 95.00th=[ 4293],
     | 99.00th=[ 6783], 99.50th=[25297], 99.90th=[43254], 99.95th=[43254],
     | 99.99th=[43254]
   bw (  KiB/s): min=  872, max= 1184, per=22.58%, avg=1028.00, stdev=220.62, samples=2
   iops        : min=  218, max=  296, avg=257.00, stdev=55.15, samples=2
  lat (usec)   : 10=5.60%, 20=12.11%, 50=0.26%, 100=1.17%, 250=20.05%
  lat (usec)   : 500=2.21%, 750=0.65%, 1000=3.39%
  lat (msec)   : 2=18.62%, 4=26.43%, 10=8.72%, 20=0.39%, 50=0.39%
  cpu          : usr=0.36%, sys=15.11%, ctx=900, majf=0, minf=35
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=4327KiB/s (4430kB/s), 1073KiB/s-1152KiB/s (1099kB/s-1179kB/s), io=5988KiB (6132kB), run=1338-1384msec
  WRITE: bw=4552KiB/s (4661kB/s), 1110KiB/s-1223KiB/s (1137kB/s-1252kB/s), io=6300KiB (6451kB), run=1338-1384msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=20937: Wed Jan 15 21:44:55 2025
   read: IOPS=180, BW=720KiB/s (737kB/s)(1480KiB/2055msec)
    clat (usec): min=714, max=19523, avg=1840.80, stdev=1946.90
     lat (usec): min=715, max=19524, avg=1841.62, stdev=1946.88
    clat percentiles (usec):
     |  1.00th=[  725],  5.00th=[  816], 10.00th=[  848], 20.00th=[  922],
     | 30.00th=[  971], 40.00th=[ 1029], 50.00th=[ 1123], 60.00th=[ 1237],
     | 70.00th=[ 1516], 80.00th=[ 2278], 90.00th=[ 4113], 95.00th=[ 5145],
     | 99.00th=[10814], 99.50th=[17171], 99.90th=[19530], 99.95th=[19530],
     | 99.99th=[19530]
   bw (  KiB/s): min=  408, max= 1160, per=24.53%, avg=702.00, stdev=327.21, samples=4
   iops        : min=  102, max=  290, avg=175.50, stdev=81.80, samples=4
  write: IOPS=193, BW=775KiB/s (793kB/s)(1592KiB/2055msec)
    clat (usec): min=1213, max=62833, avg=3417.58, stdev=3473.45
     lat (usec): min=1214, max=62834, avg=3418.59, stdev=3473.45
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1631], 10.00th=[ 1844], 20.00th=[ 2040],
     | 30.00th=[ 2212], 40.00th=[ 2343], 50.00th=[ 2540], 60.00th=[ 2900],
     | 70.00th=[ 3523], 80.00th=[ 4228], 90.00th=[ 5932], 95.00th=[ 7111],
     | 99.00th=[ 9896], 99.50th=[11469], 99.90th=[62653], 99.95th=[62653],
     | 99.99th=[62653]
   bw (  KiB/s): min=  456, max= 1280, per=25.44%, avg=766.00, stdev=364.94, samples=4
   iops        : min=  114, max=  320, avg=191.50, stdev=91.23, samples=4
  lat (usec)   : 750=0.91%, 1000=16.54%
  lat (msec)   : 2=27.73%, 4=37.50%, 10=16.41%, 20=0.78%, 100=0.13%
  cpu          : usr=0.68%, sys=5.74%, ctx=823, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20938: Wed Jan 15 21:44:55 2025
   read: IOPS=171, BW=686KiB/s (703kB/s)(1436KiB/2092msec)
    clat (usec): min=632, max=55014, avg=2099.17, stdev=3641.87
     lat (usec): min=633, max=55015, avg=2099.88, stdev=3641.90
    clat percentiles (usec):
     |  1.00th=[  709],  5.00th=[  783], 10.00th=[  840], 20.00th=[  906],
     | 30.00th=[  971], 40.00th=[ 1037], 50.00th=[ 1139], 60.00th=[ 1352],
     | 70.00th=[ 1762], 80.00th=[ 2507], 90.00th=[ 4047], 95.00th=[ 5800],
     | 99.00th=[20055], 99.50th=[23725], 99.90th=[54789], 99.95th=[54789],
     | 99.99th=[54789]
   bw (  KiB/s): min=  400, max= 1144, per=23.32%, avg=667.50, stdev=328.07, samples=4
   iops        : min=  100, max=  286, avg=166.75, stdev=82.05, samples=4
  write: IOPS=195, BW=782KiB/s (801kB/s)(1636KiB/2092msec)
    clat (usec): min=1156, max=21378, avg=3242.31, stdev=1996.22
     lat (usec): min=1156, max=21379, avg=3243.19, stdev=1996.27
    clat percentiles (usec):
     |  1.00th=[ 1336],  5.00th=[ 1549], 10.00th=[ 1745], 20.00th=[ 2040],
     | 30.00th=[ 2180], 40.00th=[ 2376], 50.00th=[ 2507], 60.00th=[ 2802],
     | 70.00th=[ 3359], 80.00th=[ 4047], 90.00th=[ 5735], 95.00th=[ 7177],
     | 99.00th=[ 9765], 99.50th=[11207], 99.90th=[21365], 99.95th=[21365],
     | 99.99th=[21365]
   bw (  KiB/s): min=  448, max= 1232, per=24.83%, avg=747.50, stdev=337.50, samples=4
   iops        : min=  112, max=  308, avg=186.75, stdev=84.43, samples=4
  lat (usec)   : 750=0.91%, 1000=14.97%
  lat (msec)   : 2=28.12%, 4=40.10%, 10=14.71%, 20=0.52%, 50=0.52%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.48%, sys=5.60%, ctx=822, majf=0, minf=34
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20939: Wed Jan 15 21:44:55 2025
   read: IOPS=191, BW=765KiB/s (784kB/s)(1564KiB/2044msec)
    clat (usec): min=644, max=40442, avg=1996.34, stdev=2973.33
     lat (usec): min=645, max=40443, avg=1997.08, stdev=2973.35
    clat percentiles (usec):
     |  1.00th=[  725],  5.00th=[  816], 10.00th=[  857], 20.00th=[  930],
     | 30.00th=[  996], 40.00th=[ 1057], 50.00th=[ 1156], 60.00th=[ 1303],
     | 70.00th=[ 1663], 80.00th=[ 2442], 90.00th=[ 4047], 95.00th=[ 5342],
     | 99.00th=[10290], 99.50th=[33424], 99.90th=[40633], 99.95th=[40633],
     | 99.99th=[40633]
   bw (  KiB/s): min=  432, max= 1320, per=26.62%, avg=762.00, stdev=385.74, samples=4
   iops        : min=  108, max=  330, avg=190.50, stdev=96.43, samples=4
  write: IOPS=184, BW=738KiB/s (755kB/s)(1508KiB/2044msec)
    clat (usec): min=1328, max=25962, avg=3321.82, stdev=2234.05
     lat (usec): min=1329, max=25966, avg=3322.78, stdev=2234.18
    clat percentiles (usec):
     |  1.00th=[ 1450],  5.00th=[ 1647], 10.00th=[ 1860], 20.00th=[ 2114],
     | 30.00th=[ 2245], 40.00th=[ 2409], 50.00th=[ 2606], 60.00th=[ 2900],
     | 70.00th=[ 3294], 80.00th=[ 4146], 90.00th=[ 5866], 95.00th=[ 6980],
     | 99.00th=[ 9896], 99.50th=[22676], 99.90th=[26084], 99.95th=[26084],
     | 99.99th=[26084]
   bw (  KiB/s): min=  504, max= 1136, per=23.98%, avg=722.00, stdev=290.76, samples=4
   iops        : min=  126, max=  284, avg=180.50, stdev=72.69, samples=4
  lat (usec)   : 750=1.04%, 1000=14.97%
  lat (msec)   : 2=29.30%, 4=38.80%, 10=14.97%, 20=0.39%, 50=0.52%
  cpu          : usr=0.39%, sys=6.02%, ctx=818, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=20940: Wed Jan 15 21:44:55 2025
   read: IOPS=181, BW=727KiB/s (744kB/s)(1508KiB/2075msec)
    clat (usec): min=677, max=52727, avg=2070.48, stdev=3486.37
     lat (usec): min=677, max=52727, avg=2071.34, stdev=3486.33
    clat percentiles (usec):
     |  1.00th=[  717],  5.00th=[  799], 10.00th=[  840], 20.00th=[  906],
     | 30.00th=[  963], 40.00th=[ 1037], 50.00th=[ 1106], 60.00th=[ 1270],
     | 70.00th=[ 1647], 80.00th=[ 2311], 90.00th=[ 4293], 95.00th=[ 5407],
     | 99.00th=[16450], 99.50th=[25560], 99.90th=[52691], 99.95th=[52691],
     | 99.99th=[52691]
   bw (  KiB/s): min=  400, max= 1136, per=24.39%, avg=698.00, stdev=311.17, samples=4
   iops        : min=  100, max=  284, avg=174.50, stdev=77.79, samples=4
  write: IOPS=188, BW=754KiB/s (772kB/s)(1564KiB/2075msec)
    clat (usec): min=1271, max=25658, avg=3282.98, stdev=2009.77
     lat (usec): min=1272, max=25659, avg=3283.85, stdev=2009.85
    clat percentiles (usec):
     |  1.00th=[ 1434],  5.00th=[ 1598], 10.00th=[ 1860], 20.00th=[ 2089],
     | 30.00th=[ 2212], 40.00th=[ 2343], 50.00th=[ 2507], 60.00th=[ 2835],
     | 70.00th=[ 3392], 80.00th=[ 4424], 90.00th=[ 5866], 95.00th=[ 6783],
     | 99.00th=[ 8979], 99.50th=[ 9896], 99.90th=[25560], 99.95th=[25560],
     | 99.99th=[25560]
   bw (  KiB/s): min=  456, max= 1240, per=24.38%, avg=734.00, stdev=347.33, samples=4
   iops        : min=  114, max=  310, avg=183.50, stdev=86.83, samples=4
  lat (usec)   : 750=0.65%, 1000=16.28%
  lat (msec)   : 2=26.56%, 4=38.54%, 10=17.32%, 20=0.13%, 50=0.39%
  lat (msec)   : 100=0.13%
  cpu          : usr=0.43%, sys=5.59%, ctx=814, majf=0, minf=32
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=2862KiB/s (2931kB/s), 686KiB/s-765KiB/s (703kB/s-784kB/s), io=5988KiB (6132kB), run=2044-2092msec
  WRITE: bw=3011KiB/s (3084kB/s), 738KiB/s-782KiB/s (755kB/s-801kB/s), io=6300KiB (6451kB), run=2044-2092msec