== sanity test 398b: DIO and buffer IO race ============== 07:54:58 (1788868498)
/usr/bin/fio
48+0 records in
48+0 records out
50331648 bytes (50 MB, 48 MiB) copied, 5.24835 s, 9.6 MB/s
mix direct rw 4096 by fio with 4 jobs...
mix buffer rw 4096 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=145227: Tue Sep  8 07:57:21 2026
  read: IOPS=12, BW=48.1KiB/s (49.2kB/s)(5992KiB/124590msec)
    clat (usec): min=33, max=368976, avg=40069.54, stdev=34828.18
     lat (usec): min=34, max=368978, avg=40072.28, stdev=34827.59
    clat percentiles (usec):
     |  1.00th=[    52],  5.00th=[    67], 10.00th=[    96], 20.00th=[ 17171],
     | 30.00th=[ 22414], 40.00th=[ 26608], 50.00th=[ 32113], 60.00th=[ 39584],
     | 70.00th=[ 49021], 80.00th=[ 60556], 90.00th=[ 80217], 95.00th=[ 99091],
     | 99.00th=[156238], 99.50th=[223347], 99.90th=[316670], 99.95th=[367002],
     | 99.99th=[367002]
   bw (  KiB/s): min=    7, max=  143, per=25.15%, avg=48.03, stdev=22.12, samples=243
   iops        : min=    1, max=   35, avg=11.37, stdev= 5.56, samples=243
  write: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6296KiB/124590msec); 0 zone resets
    clat (usec): min=932, max=306961, avg=40903.08, stdev=41892.08
     lat (usec): min=933, max=306963, avg=40906.12, stdev=41891.90
    clat percentiles (usec):
     |  1.00th=[  1123],  5.00th=[  1369], 10.00th=[  2024], 20.00th=[  4555],
     | 30.00th=[  8160], 40.00th=[ 18744], 50.00th=[ 29492], 60.00th=[ 41157],
     | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[ 94897], 95.00th=[120062],
     | 99.00th=[200279], 99.50th=[221250], 99.90th=[287310], 99.95th=[308282],
     | 99.99th=[308282]
   bw (  KiB/s): min=    7, max=  119, per=25.02%, avg=50.04, stdev=21.18, samples=245
   iops        : min=    1, max=   29, avg=11.87, stdev= 5.32, samples=245
  lat (usec)   : 50=0.36%, 100=4.62%, 250=0.94%, 500=0.10%, 750=0.10%
  lat (usec)   : 1000=0.16%
  lat (msec)   : 2=5.08%, 4=3.84%, 10=7.81%, 20=10.19%, 50=35.68%
  lat (msec)   : 100=24.45%, 250=6.45%, 500=0.23%
  cpu          : usr=0.10%, sys=5.95%, ctx=6727, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145228: Tue Sep  8 07:57:21 2026
  read: IOPS=12, BW=48.1KiB/s (49.3kB/s)(5940KiB/123439msec)
    clat (usec): min=36, max=284998, avg=38965.23, stdev=31199.80
     lat (usec): min=36, max=285000, avg=38968.33, stdev=31198.57
    clat percentiles (usec):
     |  1.00th=[    56],  5.00th=[    68], 10.00th=[   114], 20.00th=[ 16909],
     | 30.00th=[ 22152], 40.00th=[ 26608], 50.00th=[ 32637], 60.00th=[ 38536],
     | 70.00th=[ 46924], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[ 93848],
     | 99.00th=[149947], 99.50th=[168821], 99.90th=[278922], 99.95th=[283116],
     | 99.99th=[283116]
   bw (  KiB/s): min=    5, max=  119, per=25.20%, avg=48.13, stdev=22.39, samples=241
   iops        : min=    1, max=   29, avg=11.39, stdev= 5.63, samples=241
  write: IOPS=12, BW=51.4KiB/s (52.7kB/s)(6348KiB/123439msec); 0 zone resets
    clat (usec): min=976, max=521457, avg=41187.91, stdev=45715.27
     lat (usec): min=976, max=521459, avg=41196.68, stdev=45727.29
    clat percentiles (usec):
     |  1.00th=[  1156],  5.00th=[  1418], 10.00th=[  2442], 20.00th=[  4883],
     | 30.00th=[  8586], 40.00th=[ 16909], 50.00th=[ 27657], 60.00th=[ 40633],
     | 70.00th=[ 52691], 80.00th=[ 70779], 90.00th=[ 96994], 95.00th=[125305],
     | 99.00th=[193987], 99.50th=[233833], 99.90th=[367002], 99.95th=[522191],
     | 99.99th=[522191]
   bw (  KiB/s): min=    7, max=  135, per=25.51%, avg=51.02, stdev=21.52, samples=243
   iops        : min=    1, max=   33, avg=12.12, stdev= 5.41, samples=243
  lat (usec)   : 50=0.23%, 100=4.17%, 250=0.94%, 500=0.20%, 750=0.10%
  lat (usec)   : 1000=0.16%
  lat (msec)   : 2=3.91%, 4=5.11%, 10=8.30%, 20=11.04%, 50=36.23%
  lat (msec)   : 100=22.69%, 250=6.64%, 500=0.26%, 750=0.03%
  cpu          : usr=0.09%, sys=6.14%, ctx=6706, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145229: Tue Sep  8 07:57:21 2026
  read: IOPS=12, BW=48.8KiB/s (49.9kB/s)(6028KiB/123639msec)
    clat (usec): min=33, max=419697, avg=38376.01, stdev=33719.07
     lat (usec): min=33, max=419699, avg=38392.73, stdev=33720.86
    clat percentiles (usec):
     |  1.00th=[    49],  5.00th=[    65], 10.00th=[    88], 20.00th=[ 16057],
     | 30.00th=[ 21890], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 38536],
     | 70.00th=[ 46924], 80.00th=[ 57410], 90.00th=[ 77071], 95.00th=[ 92799],
     | 99.00th=[143655], 99.50th=[158335], 99.90th=[396362], 99.95th=[421528],
     | 99.99th=[421528]
   bw (  KiB/s): min=    5, max=  119, per=25.40%, avg=48.51, stdev=22.70, samples=243
   iops        : min=    1, max=   29, avg=11.49, stdev= 5.69, samples=243
  write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6260KiB/123639msec); 0 zone resets
    clat (usec): min=1020, max=461389, avg=41906.92, stdev=43564.73
     lat (usec): min=1021, max=461391, avg=41912.27, stdev=43562.67
    clat percentiles (usec):
     |  1.00th=[  1188],  5.00th=[  1467], 10.00th=[  2606], 20.00th=[  4948],
     | 30.00th=[  9110], 40.00th=[ 20317], 50.00th=[ 31327], 60.00th=[ 41157],
     | 70.00th=[ 54264], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[122160],
     | 99.00th=[191890], 99.50th=[227541], 99.90th=[261096], 99.95th=[463471],
     | 99.99th=[463471]
   bw (  KiB/s): min=    7, max=  103, per=25.07%, avg=50.15, stdev=19.88, samples=244
   iops        : min=    1, max=   25, avg=11.90, stdev= 4.97, samples=244
  lat (usec)   : 50=0.59%, 100=4.82%, 250=0.98%, 500=0.20%, 750=0.03%
  lat (usec)   : 1000=0.07%
  lat (msec)   : 2=3.97%, 4=4.46%, 10=7.81%, 20=10.42%, 50=36.91%
  lat (msec)   : 100=23.11%, 250=6.35%, 500=0.29%
  cpu          : usr=0.10%, sys=6.11%, ctx=6775, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145230: Tue Sep  8 07:57:21 2026
  read: IOPS=12, BW=48.3KiB/s (49.4kB/s)(6052KiB/125359msec)
    clat (usec): min=36, max=330158, avg=39339.88, stdev=33486.23
     lat (usec): min=37, max=330160, avg=39347.86, stdev=33488.82
    clat percentiles (usec):
     |  1.00th=[    48],  5.00th=[    65], 10.00th=[   100], 20.00th=[ 16909],
     | 30.00th=[ 22152], 40.00th=[ 26608], 50.00th=[ 32375], 60.00th=[ 39060],
     | 70.00th=[ 47449], 80.00th=[ 58983], 90.00th=[ 77071], 95.00th=[ 94897],
     | 99.00th=[162530], 99.50th=[191890], 99.90th=[316670], 99.95th=[329253],
     | 99.99th=[329253]
   bw (  KiB/s): min=    7, max=  111, per=25.20%, avg=48.13, stdev=21.80, samples=245
   iops        : min=    1, max=   27, avg=11.39, stdev= 5.49, samples=245
  write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6236KiB/125359msec); 0 zone resets
    clat (usec): min=937, max=456757, avg=42115.38, stdev=45628.45
     lat (usec): min=939, max=456759, avg=42126.06, stdev=45631.39
    clat percentiles (usec):
     |  1.00th=[  1139],  5.00th=[  1450], 10.00th=[  2245], 20.00th=[  4359],
     | 30.00th=[  8717], 40.00th=[ 16188], 50.00th=[ 30540], 60.00th=[ 41681],
     | 70.00th=[ 55313], 80.00th=[ 71828], 90.00th=[ 99091], 95.00th=[125305],
     | 99.00th=[198181], 99.50th=[242222], 99.90th=[367002], 99.95th=[455082],
     | 99.99th=[455082]
   bw (  KiB/s): min=    7, max=  111, per=24.52%, avg=49.04, stdev=20.47, samples=247
   iops        : min=    1, max=   27, avg=11.62, stdev= 5.14, samples=247
  lat (usec)   : 50=0.59%, 100=4.33%, 250=0.52%, 500=0.23%, 750=0.13%
  lat (usec)   : 1000=0.10%
  lat (msec)   : 2=4.43%, 4=5.11%, 10=7.39%, 20=11.13%, 50=35.29%
  lat (msec)   : 100=23.89%, 250=6.58%, 500=0.29%
  cpu          : usr=0.09%, sys=6.00%, ctx=6745, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=192KiB/s (196kB/s), 48.1KiB/s-48.8KiB/s (49.2kB/s-49.9kB/s), io=23.4MiB (24.6MB), run=123439-125359msec
  WRITE: bw=201KiB/s (205kB/s), 49.7KiB/s-51.4KiB/s (50.9kB/s-52.7kB/s), io=24.6MiB (25.7MB), run=123439-125359msec