== sanity test 398b: DIO and buffer IO race ============== 03:24:14 (1789025054)
/usr/bin/fio
48+0 records in
48+0 records out
50331648 bytes (50 MB, 48 MiB) copied, 5.2178 s, 9.6 MB/s
mix direct rw 4096 by fio with 4 jobs...
mix buffer rw 4096 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=145544: Thu Sep 10 03:26:31 2026
  read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(5992KiB/118378msec)
    clat (usec): min=33, max=930202, avg=39066.91, stdev=40342.65
     lat (usec): min=34, max=930205, avg=39069.47, stdev=40342.14
    clat percentiles (usec):
     |  1.00th=[    45],  5.00th=[    59], 10.00th=[    78], 20.00th=[ 15008],
     | 30.00th=[ 20579], 40.00th=[ 26084], 50.00th=[ 31851], 60.00th=[ 39584],
     | 70.00th=[ 46400], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 98042],
     | 99.00th=[143655], 99.50th=[170918], 99.90th=[467665], 99.95th=[926942],
     | 99.99th=[926942]
   bw (  KiB/s): min=    7, max=  119, per=25.41%, avg=50.83, stdev=22.71, samples=229
   iops        : min=    1, max=   29, avg=12.09, stdev= 5.70, samples=229
  write: IOPS=13, BW=53.2KiB/s (54.5kB/s)(6296KiB/118378msec); 0 zone resets
    clat (usec): min=899, max=279238, avg=37757.78, stdev=39158.94
     lat (usec): min=900, max=279240, avg=37760.84, stdev=39159.15
    clat percentiles (usec):
     |  1.00th=[  1020],  5.00th=[  1139], 10.00th=[  1287], 20.00th=[  3326],
     | 30.00th=[  7701], 40.00th=[ 17957], 50.00th=[ 27395], 60.00th=[ 38011],
     | 70.00th=[ 49546], 80.00th=[ 63701], 90.00th=[ 88605], 95.00th=[115868],
     | 99.00th=[170918], 99.50th=[198181], 99.90th=[261096], 99.95th=[278922],
     | 99.99th=[278922]
   bw (  KiB/s): min=    7, max=  143, per=25.47%, avg=53.23, stdev=23.41, samples=230
   iops        : min=    1, max=   35, avg=12.68, stdev= 5.91, samples=230
  lat (usec)   : 50=0.75%, 100=4.30%, 250=0.29%, 500=0.07%, 750=0.07%
  lat (usec)   : 1000=0.52%
  lat (msec)   : 2=7.23%, 4=3.61%, 10=6.61%, 20=12.21%, 50=36.49%
  lat (msec)   : 100=21.97%, 250=5.70%, 500=0.16%, 1000=0.03%
  cpu          : usr=0.07%, sys=5.31%, ctx=6351, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145545: Thu Sep 10 03:26:31 2026
  read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(5940KiB/119840msec)
    clat (usec): min=30, max=427486, avg=38950.08, stdev=34502.34
     lat (usec): min=31, max=427487, avg=38951.39, stdev=34502.29
    clat percentiles (usec):
     |  1.00th=[    50],  5.00th=[    59], 10.00th=[   137], 20.00th=[ 16909],
     | 30.00th=[ 21627], 40.00th=[ 25822], 50.00th=[ 31327], 60.00th=[ 38536],
     | 70.00th=[ 45876], 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 98042],
     | 99.00th=[175113], 99.50th=[221250], 99.90th=[329253], 99.95th=[425722],
     | 99.99th=[425722]
   bw (  KiB/s): min=    6, max=  126, per=24.85%, avg=49.70, stdev=23.73, samples=232
   iops        : min=    1, max=   31, avg=11.80, stdev= 5.99, samples=232
  write: IOPS=13, BW=52.0KiB/s (54.2kB/s)(6348KiB/119840msec); 0 zone resets
    clat (usec): min=706, max=915701, avg=38822.35, stdev=47207.43
     lat (usec): min=707, max=915703, avg=38823.91, stdev=47207.35
    clat percentiles (usec):
     |  1.00th=[   988],  5.00th=[  1139], 10.00th=[  1303], 20.00th=[  3163],
     | 30.00th=[  7373], 40.00th=[ 16450], 50.00th=[ 25822], 60.00th=[ 36439],
     | 70.00th=[ 48497], 80.00th=[ 65274], 90.00th=[ 94897], 95.00th=[126354],
     | 99.00th=[185598], 99.50th=[198181], 99.90th=[387974], 99.95th=[918553],
     | 99.99th=[918553]
   bw (  KiB/s): min=    7, max=  171, per=25.22%, avg=52.71, stdev=25.80, samples=233
   iops        : min=    1, max=   42, avg=12.56, stdev= 6.49, samples=233
  lat (usec)   : 50=0.55%, 100=4.23%, 250=0.16%, 500=0.10%, 750=0.07%
  lat (usec)   : 1000=0.49%
  lat (msec)   : 2=7.13%, 4=4.00%, 10=6.54%, 20=11.72%, 50=37.50%
  lat (msec)   : 100=20.80%, 250=6.51%, 500=0.16%, 1000=0.03%
  cpu          : usr=0.08%, sys=5.27%, ctx=6348, majf=0, minf=18
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145546: Thu Sep 10 03:26:31 2026
  read: IOPS=12, BW=51.8KiB/s (53.0kB/s)(6028KiB/116403msec)
    clat (usec): min=20, max=322638, avg=36575.58, stdev=29822.30
     lat (usec): min=20, max=322639, avg=36577.64, stdev=29822.57
    clat percentiles (usec):
     |  1.00th=[    43],  5.00th=[    57], 10.00th=[   143], 20.00th=[ 15401],
     | 30.00th=[ 20317], 40.00th=[ 25035], 50.00th=[ 30278], 60.00th=[ 36439],
     | 70.00th=[ 44827], 80.00th=[ 54789], 90.00th=[ 72877], 95.00th=[ 90702],
     | 99.00th=[139461], 99.50th=[170918], 99.90th=[240124], 99.95th=[320865],
     | 99.99th=[320865]
   bw (  KiB/s): min=    7, max=  134, per=25.99%, avg=51.99, stdev=25.35, samples=226
   iops        : min=    1, max=   33, avg=12.37, stdev= 6.39, samples=226
  write: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6260KiB/116403msec); 0 zone resets
    clat (usec): min=700, max=812513, avg=38861.01, stdev=46046.71
     lat (usec): min=702, max=812516, avg=38865.06, stdev=46046.54
    clat percentiles (usec):
     |  1.00th=[  1037],  5.00th=[  1156], 10.00th=[  1270], 20.00th=[  3195],
     | 30.00th=[  8225], 40.00th=[ 18482], 50.00th=[ 27657], 60.00th=[ 37487],
     | 70.00th=[ 48497], 80.00th=[ 64750], 90.00th=[ 90702], 95.00th=[117965],
     | 99.00th=[181404], 99.50th=[210764], 99.90th=[455082], 99.95th=[809501],
     | 99.99th=[809501]
   bw (  KiB/s): min=    7, max=  120, per=25.65%, avg=53.60, stdev=22.36, samples=227
   iops        : min=    1, max=   30, avg=12.78, stdev= 5.63, samples=227
  lat (usec)   : 50=1.04%, 100=3.68%, 250=0.26%, 500=0.10%, 750=0.07%
  lat (usec)   : 1000=0.33%
  lat (msec)   : 2=7.81%, 4=3.48%, 10=5.66%, 20=13.61%, 50=37.47%
  lat (msec)   : 100=20.83%, 250=5.47%, 500=0.16%, 1000=0.03%
  cpu          : usr=0.07%, sys=5.29%, ctx=6221, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145547: Thu Sep 10 03:26:31 2026
  read: IOPS=12, BW=51.8KiB/s (53.1kB/s)(6052KiB/116808msec)
    clat (usec): min=31, max=269859, avg=37586.09, stdev=30693.47
     lat (usec): min=31, max=269861, avg=37588.47, stdev=30693.24
    clat percentiles (usec):
     |  1.00th=[    44],  5.00th=[    57], 10.00th=[    81], 20.00th=[ 15795],
     | 30.00th=[ 21103], 40.00th=[ 26084], 50.00th=[ 31327], 60.00th=[ 38011],
     | 70.00th=[ 45876], 80.00th=[ 55837], 90.00th=[ 72877], 95.00th=[ 92799],
     | 99.00th=[147850], 99.50th=[168821], 99.90th=[250610], 99.95th=[270533],
     | 99.99th=[270533]
   bw (  KiB/s): min=    7, max=  135, per=26.04%, avg=52.07, stdev=23.05, samples=227
   iops        : min=    1, max=   33, avg=12.40, stdev= 5.83, samples=227
  write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6236KiB/116808msec); 0 zone resets
    clat (usec): min=657, max=790308, avg=38211.71, stdev=45246.65
     lat (usec): min=658, max=790310, avg=38217.95, stdev=45244.45
    clat percentiles (usec):
     |  1.00th=[   996],  5.00th=[  1139], 10.00th=[  1270], 20.00th=[  3392],
     | 30.00th=[  6456], 40.00th=[ 15533], 50.00th=[ 25297], 60.00th=[ 36963],
     | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 93848], 95.00th=[116917],
     | 99.00th=[191890], 99.50th=[227541], 99.90th=[362808], 99.95th=[792724],
     | 99.99th=[792724]
   bw (  KiB/s): min=    7, max=  152, per=25.23%, avg=52.73, stdev=24.58, samples=230
   iops        : min=    1, max=   38, avg=12.57, stdev= 6.20, samples=230
  lat (usec)   : 50=0.88%, 100=4.33%, 250=0.29%, 500=0.16%, 750=0.16%
  lat (usec)   : 1000=0.46%
  lat (msec)   : 2=7.39%, 4=3.65%, 10=7.03%, 20=11.82%, 50=36.46%
  lat (msec)   : 100=21.26%, 250=5.92%, 500=0.16%, 1000=0.03%
  cpu          : usr=0.07%, sys=5.42%, ctx=6358, majf=0, minf=18
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=200KiB/s (205kB/s), 49.6KiB/s-51.8KiB/s (50.8kB/s-53.1kB/s), io=23.4MiB (24.6MB), run=116403-119840msec
  WRITE: bw=210KiB/s (215kB/s), 52.0KiB/s-53.8KiB/s (54.2kB/s-55.1kB/s), io=24.6MiB (25.7MB), run=116403-119840msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=145539: Thu Sep 10 03:28:44 2026
  read: IOPS=5, BW=23.8KiB/s (24.3kB/s)(5992KiB/252042msec)
    clat (msec): min=4, max=962, avg=32.10, stdev=40.46
     lat (msec): min=4, max=962, avg=32.11, stdev=40.46
    clat percentiles (msec):
     |  1.00th=[    7],  5.00th=[    9], 10.00th=[   10], 20.00th=[   13],
     | 30.00th=[   15], 40.00th=[   17], 50.00th=[   20], 60.00th=[   24],
     | 70.00th=[   31], 80.00th=[   42], 90.00th=[   70], 95.00th=[  103],
     | 99.00th=[  165], 99.50th=[  215], 99.90th=[  321], 99.95th=[  961],
     | 99.99th=[  961]
   bw (  KiB/s): min=    7, max=   95, per=27.63%, avg=26.25, stdev=18.25, samples=442
   iops        : min=    1, max=   23, avg= 5.93, stdev= 4.61, samples=442
  write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6296KiB/252042msec); 0 zone resets
    clat (msec): min=33, max=633, avg=129.29, stdev=65.78
     lat (msec): min=33, max=633, avg=129.30, stdev=65.78
    clat percentiles (msec):
     |  1.00th=[   44],  5.00th=[   57], 10.00th=[   65], 20.00th=[   78],
     | 30.00th=[   90], 40.00th=[  103], 50.00th=[  115], 60.00th=[  130],
     | 70.00th=[  146], 80.00th=[  171], 90.00th=[  207], 95.00th=[  257],
     | 99.00th=[  363], 99.50th=[  418], 99.90th=[  617], 99.95th=[  634],
     | 99.99th=[  634]
   bw (  KiB/s): min=    7, max=   56, per=24.78%, avg=24.53, stdev=11.42, samples=495
   iops        : min=    1, max=   14, avg= 5.50, stdev= 2.89, samples=495
  lat (msec)   : 10=5.96%, 20=18.62%, 50=17.48%, 100=23.86%, 250=31.18%
  lat (msec)   : 500=2.77%, 750=0.10%, 1000=0.03%
  cpu          : usr=0.04%, sys=1.19%, ctx=5183, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145540: Thu Sep 10 03:28:44 2026
  read: IOPS=5, BW=23.5KiB/s (24.1kB/s)(5940KiB/252343msec)
    clat (msec): min=3, max=807, avg=31.55, stdev=40.41
     lat (msec): min=3, max=807, avg=31.56, stdev=40.41
    clat percentiles (msec):
     |  1.00th=[    6],  5.00th=[    9], 10.00th=[   10], 20.00th=[   12],
     | 30.00th=[   15], 40.00th=[   17], 50.00th=[   20], 60.00th=[   23],
     | 70.00th=[   29], 80.00th=[   41], 90.00th=[   66], 95.00th=[   95],
     | 99.00th=[  180], 99.50th=[  226], 99.90th=[  447], 99.95th=[  810],
     | 99.99th=[  810]
   bw (  KiB/s): min=    7, max=  111, per=28.30%, avg=26.88, stdev=18.07, samples=428
   iops        : min=    1, max=   27, avg= 6.08, stdev= 4.55, samples=428
  write: IOPS=6, BW=25.2KiB/s (25.8kB/s)(6348KiB/252343msec); 0 zone resets
    clat (msec): min=31, max=510, avg=129.22, stdev=65.50
     lat (msec): min=31, max=510, avg=129.23, stdev=65.50
    clat percentiles (msec):
     |  1.00th=[   42],  5.00th=[   55], 10.00th=[   64], 20.00th=[   78],
     | 30.00th=[   90], 40.00th=[  103], 50.00th=[  116], 60.00th=[  130],
     | 70.00th=[  146], 80.00th=[  171], 90.00th=[  209], 95.00th=[  257],
     | 99.00th=[  372], 99.50th=[  422], 99.90th=[  481], 99.95th=[  510],
     | 99.99th=[  510]
   bw (  KiB/s): min=    7, max=   64, per=25.07%, avg=24.82, stdev=11.49, samples=494
   iops        : min=    1, max=   16, avg= 5.57, stdev= 2.93, samples=494
  lat (msec)   : 4=0.07%, 10=5.83%, 20=19.40%, 50=17.61%, 100=23.01%
  lat (msec)   : 250=30.83%, 500=3.19%, 750=0.03%, 1000=0.03%
  cpu          : usr=0.05%, sys=1.19%, ctx=5206, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145541: Thu Sep 10 03:28:44 2026
  read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(6028KiB/251953msec)
    clat (msec): min=5, max=329, avg=31.96, stdev=33.08
     lat (msec): min=5, max=329, avg=31.96, stdev=33.08
    clat percentiles (msec):
     |  1.00th=[    7],  5.00th=[    9], 10.00th=[   10], 20.00th=[   12],
     | 30.00th=[   15], 40.00th=[   18], 50.00th=[   21], 60.00th=[   26],
     | 70.00th=[   32], 80.00th=[   46], 90.00th=[   70], 95.00th=[   97],
     | 99.00th=[  159], 99.50th=[  192], 99.90th=[  317], 99.95th=[  330],
     | 99.99th=[  330]
   bw (  KiB/s): min=    7, max=  110, per=27.54%, avg=26.16, stdev=18.07, samples=446
   iops        : min=    1, max=   27, avg= 5.91, stdev= 4.56, samples=446
  write: IOPS=6, BW=24.8KiB/s (25.4kB/s)(6260KiB/251953msec); 0 zone resets
    clat (msec): min=34, max=865, avg=129.92, stdev=67.79
     lat (msec): min=34, max=865, avg=129.92, stdev=67.79
    clat percentiles (msec):
     |  1.00th=[   45],  5.00th=[   57], 10.00th=[   65], 20.00th=[   79],
     | 30.00th=[   90], 40.00th=[  100], 50.00th=[  114], 60.00th=[  129],
     | 70.00th=[  146], 80.00th=[  171], 90.00th=[  218], 95.00th=[  253],
     | 99.00th=[  376], 99.50th=[  439], 99.90th=[  535], 99.95th=[  869],
     | 99.99th=[  869]
   bw (  KiB/s): min=    7, max=   70, per=24.75%, avg=24.51, stdev=11.44, samples=493
   iops        : min=    1, max=   17, avg= 5.49, stdev= 2.89, samples=493
  lat (msec)   : 10=5.79%, 20=18.07%, 50=17.71%, 100=25.88%, 250=29.72%
  lat (msec)   : 500=2.73%, 750=0.07%, 1000=0.03%
  cpu          : usr=0.04%, sys=1.20%, ctx=5177, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145542: Thu Sep 10 03:28:44 2026
  read: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6052KiB/252227msec)
    clat (msec): min=4, max=324, avg=31.39, stdev=32.68
     lat (msec): min=4, max=324, avg=31.39, stdev=32.68
    clat percentiles (msec):
     |  1.00th=[    7],  5.00th=[    8], 10.00th=[   10], 20.00th=[   13],
     | 30.00th=[   15], 40.00th=[   17], 50.00th=[   21], 60.00th=[   24],
     | 70.00th=[   31], 80.00th=[   43], 90.00th=[   69], 95.00th=[   97],
     | 99.00th=[  176], 99.50th=[  197], 99.90th=[  300], 99.95th=[  326],
     | 99.99th=[  326]
   bw (  KiB/s): min=    7, max=  120, per=28.53%, avg=27.10, stdev=18.53, samples=432
   iops        : min=    1, max=   30, avg= 6.15, stdev= 4.69, samples=432
  write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6236KiB/252227msec); 0 zone resets
    clat (msec): min=32, max=921, avg=131.05, stdev=70.76
     lat (msec): min=32, max=921, avg=131.06, stdev=70.76
    clat percentiles (msec):
     |  1.00th=[   44],  5.00th=[   55], 10.00th=[   66], 20.00th=[   80],
     | 30.00th=[   91], 40.00th=[  102], 50.00th=[  114], 60.00th=[  129],
     | 70.00th=[  148], 80.00th=[  174], 90.00th=[  220], 95.00th=[  259],
     | 99.00th=[  393], 99.50th=[  435], 99.90th=[  617], 99.95th=[  919],
     | 99.99th=[  919]
   bw (  KiB/s): min=    7, max=   70, per=24.60%, avg=24.35, stdev=11.40, samples=493
   iops        : min=    1, max=   17, avg= 5.46, stdev= 2.90, samples=493
  lat (msec)   : 10=5.92%, 20=18.39%, 50=18.46%, 100=24.06%, 250=30.08%
  lat (msec)   : 500=2.96%, 750=0.10%, 1000=0.03%
  cpu          : usr=0.04%, sys=1.13%, ctx=5224, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=95.2KiB/s (97.4kB/s), 23.5KiB/s-23.0KiB/s (24.1kB/s-24.6kB/s), io=23.4MiB (24.6MB), run=251953-252343msec
  WRITE: bw=99.6KiB/s (102kB/s), 24.7KiB/s-25.2KiB/s (25.3kB/s-25.8kB/s), io=24.6MiB (25.7MB), run=251953-252343msec
mix direct rw 16384 by fio with 4 jobs...
mix buffer rw 16384 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=145596: Thu Sep 10 03:29:28 2026
  read: IOPS=11, BW=179KiB/s (184kB/s)(5920KiB/33005msec)
    clat (usec): min=27, max=436790, avg=42102.62, stdev=46027.83
     lat (usec): min=28, max=436792, avg=42103.99, stdev=46027.93
    clat percentiles (usec):
     |  1.00th=[    34],  5.00th=[    57], 10.00th=[    64], 20.00th=[    82],
     | 30.00th=[ 20841], 40.00th=[ 29492], 50.00th=[ 36439], 60.00th=[ 41681],
     | 70.00th=[ 51643], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[105382],
     | 99.00th=[274727], 99.50th=[417334], 99.90th=[438305], 99.95th=[438305],
     | 99.99th=[438305]
   bw (  KiB/s): min=   31, max=  509, per=25.02%, avg=181.39, stdev=99.74, samples=64
   iops        : min=    1, max=   31, avg=10.56, stdev= 6.22, samples=64
  write: IOPS=12, BW=193KiB/s (198kB/s)(6368KiB/33005msec); 0 zone resets
    clat (usec): min=1354, max=354372, avg=43224.37, stdev=52905.38
     lat (usec): min=1355, max=354374, avg=43227.02, stdev=52905.06
    clat percentiles (usec):
     |  1.00th=[  1434],  5.00th=[  1713], 10.00th=[  2573], 20.00th=[  5932],
     | 30.00th=[  9765], 40.00th=[ 15139], 50.00th=[ 25297], 60.00th=[ 36963],
     | 70.00th=[ 49546], 80.00th=[ 69731], 90.00th=[105382], 95.00th=[154141],
     | 99.00th=[274727], 99.50th=[278922], 99.90th=[354419], 99.95th=[354419],
     | 99.99th=[354419]
   bw (  KiB/s): min=   31, max=  448, per=26.84%, avg=204.82, stdev=101.15, samples=61
   iops        : min=    1, max=   28, avg=12.05, stdev= 6.38, samples=61
  lat (usec)   : 50=1.17%, 100=9.11%, 250=0.39%, 500=0.13%, 750=0.13%
  lat (usec)   : 1000=0.13%
  lat (msec)   : 2=4.43%, 4=3.78%, 10=8.07%, 20=8.72%, 50=32.81%
  lat (msec)   : 100=22.92%, 250=6.90%, 500=1.30%
  cpu          : usr=0.09%, sys=5.25%, ctx=1367, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145597: Thu Sep 10 03:29:28 2026
  read: IOPS=11, BW=180KiB/s (184kB/s)(5744KiB/31980msec)
    clat (usec): min=38, max=231605, avg=45619.32, stdev=36897.02
     lat (usec): min=38, max=231606, avg=45620.71, stdev=36897.14
    clat percentiles (usec):
     |  1.00th=[    40],  5.00th=[    55], 10.00th=[    64], 20.00th=[ 10552],
     | 30.00th=[ 26346], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 50594],
     | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 89654], 95.00th=[107480],
     | 99.00th=[152044], 99.50th=[202376], 99.90th=[231736], 99.95th=[231736],
     | 99.99th=[231736]
   bw (  KiB/s): min=   31, max=  414, per=25.18%, avg=182.56, stdev=80.78, samples=62
   iops        : min=    1, max=   25, avg=10.63, stdev= 5.04, samples=62
  write: IOPS=12, BW=205KiB/s (210kB/s)(6544KiB/31980msec); 0 zone resets
    clat (usec): min=950, max=361565, avg=37571.23, stdev=45083.13
     lat (usec): min=953, max=361567, avg=37575.34, stdev=45083.55
    clat percentiles (usec):
     |  1.00th=[  1450],  5.00th=[  1647], 10.00th=[  1958], 20.00th=[  4883],
     | 30.00th=[  8291], 40.00th=[ 15008], 50.00th=[ 22676], 60.00th=[ 32375],
     | 70.00th=[ 44303], 80.00th=[ 63701], 90.00th=[ 91751], 95.00th=[122160],
     | 99.00th=[206570], 99.50th=[274727], 99.90th=[362808], 99.95th=[362808],
     | 99.99th=[362808]
   bw (  KiB/s): min=   31, max=  504, per=26.79%, avg=204.41, stdev=95.85, samples=63
   iops        : min=    1, max=   31, avg=12.00, stdev= 5.99, samples=63
  lat (usec)   : 50=1.69%, 100=6.51%, 250=0.26%, 750=0.13%, 1000=0.26%
  lat (msec)   : 2=5.47%, 4=3.78%, 10=8.98%, 20=9.77%, 50=30.47%
  lat (msec)   : 100=24.87%, 250=7.42%, 500=0.39%
  cpu          : usr=0.08%, sys=5.53%, ctx=1406, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145599: Thu Sep 10 03:29:28 2026
  read: IOPS=12, BW=200KiB/s (205kB/s)(6256KiB/31323msec)
    clat (usec): min=36, max=201519, avg=44857.72, stdev=36747.64
     lat (usec): min=36, max=201521, avg=44863.39, stdev=36749.45
    clat percentiles (usec):
     |  1.00th=[    43],  5.00th=[    58], 10.00th=[    67], 20.00th=[   371],
     | 30.00th=[ 24249], 40.00th=[ 31851], 50.00th=[ 41157], 60.00th=[ 50594],
     | 70.00th=[ 58459], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[109577],
     | 99.00th=[156238], 99.50th=[193987], 99.90th=[202376], 99.95th=[202376],
     | 99.99th=[202376]
   bw (  KiB/s): min=   31, max=  415, per=28.25%, avg=204.80, stdev=92.31, samples=60
   iops        : min=    1, max=   25, avg=12.02, stdev= 5.82, samples=60
  write: IOPS=12, BW=193KiB/s (197kB/s)(6032KiB/31323msec); 0 zone resets
    clat (usec): min=1387, max=313836, avg=35552.84, stdev=45629.50
     lat (usec): min=1389, max=313839, avg=35555.32, stdev=45629.35
    clat percentiles (usec):
     |  1.00th=[  1467],  5.00th=[  1745], 10.00th=[  2376], 20.00th=[  4359],
     | 30.00th=[  6980], 40.00th=[ 10683], 50.00th=[ 18220], 60.00th=[ 30016],
     | 70.00th=[ 40109], 80.00th=[ 60556], 90.00th=[ 88605], 95.00th=[109577],
     | 99.00th=[229639], 99.50th=[308282], 99.90th=[312476], 99.95th=[312476],
     | 99.99th=[312476]
   bw (  KiB/s): min=   29, max=  415, per=25.02%, avg=190.87, stdev=99.08, samples=61
   iops        : min=    1, max=   25, avg=11.15, stdev= 6.18, samples=61
  lat (usec)   : 50=1.43%, 100=8.20%, 250=0.52%, 500=0.26%
  lat (msec)   : 2=3.78%, 4=5.08%, 10=10.29%, 20=8.85%, 50=28.26%
  lat (msec)   : 100=25.52%, 250=7.42%, 500=0.39%
  cpu          : usr=0.08%, sys=5.36%, ctx=1438, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145600: Thu Sep 10 03:29:28 2026
  read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30867msec)
    clat (usec): min=35, max=242247, avg=45336.40, stdev=40904.66
     lat (usec): min=36, max=242248, avg=45338.11, stdev=40904.40
    clat percentiles (usec):
     |  1.00th=[    40],  5.00th=[    56], 10.00th=[    65], 20.00th=[   424],
     | 30.00th=[ 24511], 40.00th=[ 31851], 50.00th=[ 39060], 60.00th=[ 46924],
     | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 95945], 95.00th=[125305],
     | 99.00th=[198181], 99.50th=[217056], 99.90th=[242222], 99.95th=[242222],
     | 99.99th=[242222]
   bw (  KiB/s): min=   31, max=  415, per=26.81%, avg=194.40, stdev=94.89, samples=60
   iops        : min=    1, max=   25, avg=11.38, stdev= 5.95, samples=60
  write: IOPS=12, BW=203KiB/s (208kB/s)(6256KiB/30867msec); 0 zone resets
    clat (usec): min=1301, max=278292, avg=35096.75, stdev=40948.78
     lat (usec): min=1303, max=278295, avg=35105.17, stdev=40946.53
    clat percentiles (usec):
     |  1.00th=[  1369],  5.00th=[  1631], 10.00th=[  1811], 20.00th=[  3752],
     | 30.00th=[  7177], 40.00th=[ 11731], 50.00th=[ 19268], 60.00th=[ 29230],
     | 70.00th=[ 43254], 80.00th=[ 60556], 90.00th=[ 95945], 95.00th=[120062],
     | 99.00th=[173016], 99.50th=[200279], 99.90th=[278922], 99.95th=[278922],
     | 99.99th=[278922]
   bw (  KiB/s): min=   31, max=  504, per=26.54%, avg=202.52, stdev=100.05, samples=60
   iops        : min=    1, max=   31, avg=11.90, stdev= 6.30, samples=60
  lat (usec)   : 50=1.69%, 100=7.42%, 250=0.65%, 500=0.26%
  lat (msec)   : 2=5.99%, 4=4.43%, 10=8.59%, 20=9.90%, 50=30.60%
  lat (msec)   : 100=21.35%, 250=8.98%, 500=0.13%
  cpu          : usr=0.06%, sys=5.83%, ctx=1408, majf=0, minf=17
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=726KiB/s (743kB/s), 179KiB/s-200KiB/s (184kB/s-205kB/s), io=23.4MiB (24.5MB), run=30867-33005msec
  WRITE: bw=764KiB/s (782kB/s), 193KiB/s-205KiB/s (197kB/s-210kB/s), io=24.6MiB (25.8MB), run=30867-33005msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=145598: Thu Sep 10 03:30:17 2026
  read: IOPS=4, BW=72.4KiB/s (74.2kB/s)(5920KiB/81752msec)
    clat (msec): min=6, max=410, avg=46.96, stdev=45.29
     lat (msec): min=6, max=410, avg=46.96, stdev=45.29
    clat percentiles (msec):
     |  1.00th=[    7],  5.00th=[   11], 10.00th=[   13], 20.00th=[   17],
     | 30.00th=[   23], 40.00th=[   29], 50.00th=[   34], 60.00th=[   41],
     | 70.00th=[   50], 80.00th=[   64], 90.00th=[   94], 95.00th=[  132],
     | 99.00th=[  241], 99.50th=[  292], 99.90th=[  409], 99.95th=[  409],
     | 99.99th=[  409]
   bw (  KiB/s): min=   30, max=  378, per=29.78%, avg=86.96, stdev=56.27, samples=132
   iops        : min=    1, max=   23, avg= 4.70, stdev= 3.66, samples=132
  write: IOPS=4, BW=77.9KiB/s (79.8kB/s)(6368KiB/81752msec); 0 zone resets
    clat (msec): min=41, max=565, avg=161.36, stdev=79.24
     lat (msec): min=41, max=565, avg=161.36, stdev=79.24
    clat percentiles (msec):
     |  1.00th=[   48],  5.00th=[   71], 10.00th=[   79], 20.00th=[   97],
     | 30.00th=[  111], 40.00th=[  129], 50.00th=[  144], 60.00th=[  163],
     | 70.00th=[  182], 80.00th=[  220], 90.00th=[  271], 95.00th=[  321],
     | 99.00th=[  418], 99.50th=[  422], 99.90th=[  567], 99.95th=[  567],
     | 99.99th=[  567]
   bw (  KiB/s): min=   29, max=  192, per=25.39%, avg=78.19, stdev=37.86, samples=159
   iops        : min=    1, max=   12, avg= 4.14, stdev= 2.45, samples=159
  lat (msec)   : 10=2.08%, 20=10.68%, 50=21.61%, 100=20.70%, 250=37.89%
  lat (msec)   : 500=6.90%, 750=0.13%
  cpu          : usr=0.03%, sys=1.15%, ctx=1411, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145601: Thu Sep 10 03:30:17 2026
  read: IOPS=4, BW=70.9KiB/s (72.6kB/s)(5744KiB/80991msec)
    clat (msec): min=7, max=278, avg=42.93, stdev=35.67
     lat (msec): min=7, max=278, avg=42.93, stdev=35.67
    clat percentiles (msec):
     |  1.00th=[   10],  5.00th=[   11], 10.00th=[   14], 20.00th=[   20],
     | 30.00th=[   23], 40.00th=[   27], 50.00th=[   32], 60.00th=[   38],
     | 70.00th=[   47], 80.00th=[   57], 90.00th=[   86], 95.00th=[  116],
     | 99.00th=[  190], 99.50th=[  218], 99.90th=[  279], 99.95th=[  279],
     | 99.99th=[  279]
   bw (  KiB/s): min=   30, max=  320, per=29.42%, avg=85.90, stdev=59.28, samples=132
   iops        : min=    1, max=   20, avg= 4.65, stdev= 3.83, samples=132
  write: IOPS=5, BW=80.8KiB/s (82.7kB/s)(6544KiB/80991msec); 0 zone resets
    clat (msec): min=40, max=441, avg=159.37, stdev=76.71
     lat (msec): min=40, max=441, avg=159.37, stdev=76.71
    clat percentiles (msec):
     |  1.00th=[   55],  5.00th=[   70], 10.00th=[   82], 20.00th=[   96],
     | 30.00th=[  114], 40.00th=[  128], 50.00th=[  142], 60.00th=[  159],
     | 70.00th=[  180], 80.00th=[  209], 90.00th=[  264], 95.00th=[  300],
     | 99.00th=[  422], 99.50th=[  439], 99.90th=[  443], 99.95th=[  443],
     | 99.99th=[  443]
   bw (  KiB/s): min=   30, max=  160, per=26.75%, avg=82.38, stdev=36.26, samples=156
   iops        : min=    1, max=   10, avg= 4.41, stdev= 2.39, samples=156
  lat (msec)   : 10=1.43%, 20=8.46%, 50=25.13%, 100=19.40%, 250=39.06%
  lat (msec)   : 500=6.51%
  cpu          : usr=0.03%, sys=1.21%, ctx=1374, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145602: Thu Sep 10 03:30:17 2026
  read: IOPS=4, BW=79.3KiB/s (81.2kB/s)(6256KiB/78877msec)
    clat (msec): min=7, max=278, avg=43.40, stdev=39.18
     lat (msec): min=7, max=278, avg=43.40, stdev=39.18
    clat percentiles (msec):
     |  1.00th=[    9],  5.00th=[   12], 10.00th=[   14], 20.00th=[   20],
     | 30.00th=[   22], 40.00th=[   27], 50.00th=[   31], 60.00th=[   37],
     | 70.00th=[   45], 80.00th=[   55], 90.00th=[   88], 95.00th=[  129],
     | 99.00th=[  228], 99.50th=[  275], 99.90th=[  279], 99.95th=[  279],
     | 99.99th=[  279]
   bw (  KiB/s): min=   30, max=  319, per=30.88%, avg=90.16, stdev=63.23, samples=137
   iops        : min=    1, max=   19, avg= 4.90, stdev= 4.03, samples=137
  write: IOPS=4, BW=76.5KiB/s (78.3kB/s)(6032KiB/78877msec); 0 zone resets
    clat (msec): min=53, max=583, avg=163.59, stdev=77.20
     lat (msec): min=53, max=583, avg=163.60, stdev=77.21
    clat percentiles (msec):
     |  1.00th=[   59],  5.00th=[   77], 10.00th=[   89], 20.00th=[  104],
     | 30.00th=[  121], 40.00th=[  134], 50.00th=[  146], 60.00th=[  161],
     | 70.00th=[  180], 80.00th=[  209], 90.00th=[  264], 95.00th=[  309],
     | 99.00th=[  430], 99.50th=[  567], 99.90th=[  584], 99.95th=[  584],
     | 99.99th=[  584]
   bw (  KiB/s): min=   29, max=  192, per=25.49%, avg=78.52, stdev=31.98, samples=151
   iops        : min=    1, max=   12, avg= 4.16, stdev= 2.09, samples=151
  lat (msec)   : 10=1.69%, 20=9.51%, 50=27.21%, 100=17.06%, 250=38.41%
  lat (msec)   : 500=5.73%, 750=0.39%
  cpu          : usr=0.02%, sys=1.16%, ctx=1351, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145603: Thu Sep 10 03:30:17 2026
  read: IOPS=4, BW=74.4KiB/s (76.2kB/s)(6032KiB/81099msec)
    clat (msec): min=7, max=346, avg=43.59, stdev=39.63
     lat (msec): min=7, max=346, avg=43.59, stdev=39.63
    clat percentiles (msec):
     |  1.00th=[    9],  5.00th=[   12], 10.00th=[   14], 20.00th=[   18],
     | 30.00th=[   23], 40.00th=[   28], 50.00th=[   32], 60.00th=[   39],
     | 70.00th=[   44], 80.00th=[   59], 90.00th=[   87], 95.00th=[  115],
     | 99.00th=[  220], 99.50th=[  230], 99.90th=[  347], 99.95th=[  347],
     | 99.99th=[  347]
   bw (  KiB/s): min=   30, max=  288, per=30.36%, avg=88.65, stdev=57.35, samples=133
   iops        : min=    1, max=   18, avg= 4.81, stdev= 3.68, samples=133
  write: IOPS=4, BW=77.1KiB/s (78.0kB/s)(6256KiB/81099msec); 0 zone resets
    clat (msec): min=45, max=615, avg=164.70, stdev=87.63
     lat (msec): min=45, max=615, avg=164.71, stdev=87.64
    clat percentiles (msec):
     |  1.00th=[   54],  5.00th=[   73], 10.00th=[   84], 20.00th=[  101],
     | 30.00th=[  114], 40.00th=[  128], 50.00th=[  144], 60.00th=[  159],
     | 70.00th=[  182], 80.00th=[  213], 90.00th=[  275], 95.00th=[  347],
     | 99.00th=[  535], 99.50th=[  575], 99.90th=[  617], 99.95th=[  617],
     | 99.99th=[  617]
   bw (  KiB/s): min=   30, max=  160, per=25.87%, avg=79.68, stdev=33.83, samples=154
   iops        : min=    1, max=   10, avg= 4.24, stdev= 2.22, samples=154
  lat (msec)   : 10=1.43%, 20=10.68%, 50=25.39%, 100=18.10%, 250=38.15%
  lat (msec)   : 500=5.73%, 750=0.52%
  cpu          : usr=0.04%, sys=1.08%, ctx=1409, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=293KiB/s (300kB/s), 70.9KiB/s-79.3KiB/s (72.6kB/s-81.2kB/s), io=23.4MiB (24.5MB), run=78877-81752msec
  WRITE: bw=308KiB/s (316kB/s), 76.5KiB/s-80.8KiB/s (78.3kB/s-82.7kB/s), io=24.6MiB (25.8MB), run=78877-81752msec
mix direct rw 1048576 by fio with 4 jobs...
mix buffer rw 1048576 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=145622: Thu Sep 10 03:30:34 2026
  read: IOPS=2, BW=2241KiB/s (2294kB/s)(7168KiB/3199msec)
    clat (msec): min=13, max=340, avg=208.22, stdev=97.62
     lat (msec): min=13, max=340, avg=208.22, stdev=97.62
    clat percentiles (msec):
     |  1.00th=[   14],  5.00th=[   14], 10.00th=[   14], 20.00th=[  207],
     | 30.00th=[  211], 40.00th=[  211], 50.00th=[  215], 60.00th=[  226],
     | 70.00th=[  226], 80.00th=[  249], 90.00th=[  342], 95.00th=[  342],
     | 99.00th=[  342], 99.50th=[  342], 99.90th=[  342], 99.95th=[  342],
     | 99.99th=[  342]
   bw (  KiB/s): min= 1935, max= 3778, per=58.18%, avg=2637.25, stdev=850.85, samples=4
   iops        : min=    1, max=    3, avg= 1.75, stdev= 0.96, samples=4
  write: IOPS=1, BW=1601KiB/s (1639kB/s)(5120KiB/3199msec); 0 zone resets
    clat (msec): min=122, max=442, avg=340.38, stdev=126.50
     lat (msec): min=122, max=442, avg=340.50, stdev=126.52
    clat percentiles (msec):
     |  1.00th=[  123],  5.00th=[  123], 10.00th=[  123], 20.00th=[  123],
     | 30.00th=[  347], 40.00th=[  347], 50.00th=[  388], 60.00th=[  388],
     | 70.00th=[  401], 80.00th=[  401], 90.00th=[  443], 95.00th=[  443],
     | 99.00th=[  443], 99.50th=[  443], 99.90th=[  443], 99.95th=[  443],
     | 99.99th=[  443]
   bw (  KiB/s): min= 1924, max= 4087, per=41.73%, avg=2648.67, stdev=1245.65, samples=3
   iops        : min=    1, max=    3, avg= 1.67, stdev= 1.15, samples=3
  lat (msec)   : 20=8.33%, 250=50.00%, 500=41.67%
  cpu          : usr=0.03%, sys=10.16%, ctx=178, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145623: Thu Sep 10 03:30:34 2026
  read: IOPS=0, BW=453KiB/s (464kB/s)(2048KiB/4517msec)
    clat (msec): min=202, max=318, avg=260.29, stdev=81.66
     lat (msec): min=202, max=318, avg=260.29, stdev=81.66
    clat percentiles (msec):
     |  1.00th=[  203],  5.00th=[  203], 10.00th=[  203], 20.00th=[  203],
     | 30.00th=[  203], 40.00th=[  203], 50.00th=[  203], 60.00th=[  317],
     | 70.00th=[  317], 80.00th=[  317], 90.00th=[  317], 95.00th=[  317],
     | 99.00th=[  317], 99.50th=[  317], 99.90th=[  317], 99.95th=[  317],
     | 99.99th=[  317]
   bw (  KiB/s): min= 1422, max= 2035, per=38.13%, avg=1728.50, stdev=433.46, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  write: IOPS=2, BW=2267KiB/s (2321kB/s)(10.0MiB/4517msec); 0 zone resets
    clat (msec): min=84, max=915, avg=390.99, stdev=245.42
     lat (msec): min=84, max=915, avg=391.15, stdev=245.34
    clat percentiles (msec):
     |  1.00th=[   85],  5.00th=[   85], 10.00th=[   85], 20.00th=[   97],
     | 30.00th=[  209], 40.00th=[  305], 50.00th=[  376], 60.00th=[  409],
     | 70.00th=[  447], 80.00th=[  527], 90.00th=[  550], 95.00th=[  919],
     | 99.00th=[  919], 99.50th=[  919], 99.90th=[  919], 99.95th=[  919],
     | 99.99th=[  919]
   bw (  KiB/s): min= 1889, max= 6107, per=46.90%, avg=2977.00, stdev=1707.57, samples=6
   iops        : min=    1, max=    5, avg= 2.00, stdev= 1.67, samples=6
  lat (msec)   : 100=16.67%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33%
  cpu          : usr=0.04%, sys=11.82%, ctx=144, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145624: Thu Sep 10 03:30:34 2026
  read: IOPS=1, BW=1577KiB/s (1615kB/s)(6144KiB/3895msec)
    clat (usec): min=328, max=547257, avg=153421.71, stdev=216745.58
     lat (usec): min=329, max=547258, avg=153422.84, stdev=216745.72
    clat percentiles (usec):
     |  1.00th=[   330],  5.00th=[   330], 10.00th=[   330], 20.00th=[   545],
     | 30.00th=[   545], 40.00th=[  3621], 50.00th=[  3621], 60.00th=[119014],
     | 70.00th=[250610], 80.00th=[250610], 90.00th=[549454], 95.00th=[549454],
     | 99.00th=[549454], 99.50th=[549454], 99.90th=[549454], 99.95th=[549454],
     | 99.99th=[549454]
   bw (  KiB/s): min= 3849, max= 6107, per=100.00%, avg=4978.00, stdev=1596.65, samples=2
   iops        : min=    3, max=    5, avg= 4.00, stdev= 1.41, samples=2
  write: IOPS=1, BW=1577KiB/s (1615kB/s)(6144KiB/3895msec); 0 zone resets
    clat (msec): min=108, max=1047, avg=490.44, stdev=315.12
     lat (msec): min=108, max=1047, avg=490.57, stdev=315.16
    clat percentiles (msec):
     |  1.00th=[  109],  5.00th=[  109], 10.00th=[  109], 20.00th=[  355],
     | 30.00th=[  355], 40.00th=[  393], 50.00th=[  393], 60.00th=[  447],
     | 70.00th=[  592], 80.00th=[  592], 90.00th=[ 1045], 95.00th=[ 1045],
     | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045],
     | 99.99th=[ 1045]
   bw (  KiB/s): min= 1544, max= 2043, per=30.25%, avg=1920.00, stdev=191.90, samples=6
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=6
  lat (usec)   : 500=8.33%, 750=8.33%
  lat (msec)   : 4=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, 2000=8.33%
  cpu          : usr=0.08%, sys=8.76%, ctx=105, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145625: Thu Sep 10 03:30:34 2026
  read: IOPS=1, BW=1601KiB/s (1639kB/s)(5120KiB/3198msec)
    clat (usec): min=553, max=251136, avg=121381.92, stdev=114789.43
     lat (usec): min=555, max=251138, avg=121383.85, stdev=114789.02
    clat percentiles (usec):
     |  1.00th=[   553],  5.00th=[   553], 10.00th=[   553], 20.00th=[   553],
     | 30.00th=[  1139], 40.00th=[  1139], 50.00th=[160433], 60.00th=[160433],
     | 70.00th=[193987], 80.00th=[193987], 90.00th=[250610], 95.00th=[250610],
     | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610],
     | 99.99th=[250610]
   bw (  KiB/s): min= 1889, max= 5774, per=84.52%, avg=3831.50, stdev=2747.11, samples=2
   iops        : min=    1, max=    5, avg= 3.00, stdev= 2.83, samples=2
  write: IOPS=2, BW=2241KiB/s (2295kB/s)(7168KiB/3198msec); 0 zone resets
    clat (msec): min=88, max=598, avg=358.07, stdev=179.03
     lat (msec): min=89, max=598, avg=358.29, stdev=178.82
    clat percentiles (msec):
     |  1.00th=[   89],  5.00th=[   89], 10.00th=[   89], 20.00th=[  199],
     | 30.00th=[  317], 40.00th=[  317], 50.00th=[  368], 60.00th=[  401],
     | 70.00th=[  401], 80.00th=[  542], 90.00th=[  600], 95.00th=[  600],
     | 99.00th=[  600], 99.50th=[  600], 99.90th=[  600], 99.95th=[  600],
     | 99.99th=[  600]
   bw (  KiB/s): min= 1430, max= 3778, per=36.18%, avg=2296.50, stdev=1023.17, samples=4
   iops        : min=    1, max=    3, avg= 1.50, stdev= 1.00, samples=4
  lat (usec)   : 750=8.33%
  lat (msec)   : 2=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%
  cpu          : usr=0.09%, sys=12.61%, ctx=163, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=4534KiB/s (4643kB/s), 453KiB/s-2241KiB/s (464kB/s-2294kB/s), io=20.0MiB (20.0MB), run=3198-4517msec
  WRITE: bw=6348KiB/s (6500kB/s), 1577KiB/s-2267KiB/s (1615kB/s-2321kB/s), io=28.0MiB (29.4MB), run=3198-4517msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=145627: Thu Sep 10 03:30:35 2026
  read: IOPS=1, BW=1683KiB/s (1723kB/s)(7168KiB/4259msec)
    clat (msec): min=146, max=761, avg=338.94, stdev=222.18
     lat (msec): min=146, max=761, avg=338.94, stdev=222.18
    clat percentiles (msec):
     |  1.00th=[  146],  5.00th=[  146], 10.00th=[  146], 20.00th=[  153],
     | 30.00th=[  201], 40.00th=[  201], 50.00th=[  292], 60.00th=[  330],
     | 70.00th=[  330], 80.00th=[  493], 90.00th=[  760], 95.00th=[  760],
     | 99.00th=[  760], 99.50th=[  760], 99.90th=[  760], 99.95th=[  760],
     | 99.99th=[  760]
   bw (  KiB/s): min= 1458, max= 4071, per=61.98%, avg=2324.40, stdev=1007.52, samples=5
   iops        : min=    1, max=    3, avg= 1.40, stdev= 0.89, samples=5
  write: IOPS=1, BW=1202KiB/s (1231kB/s)(5120KiB/4259msec); 0 zone resets
    clat (msec): min=276, max=405, avg=356.14, stdev=49.05
     lat (msec): min=276, max=406, avg=356.42, stdev=49.29
    clat percentiles (msec):
     |  1.00th=[  275],  5.00th=[  275], 10.00th=[  275], 20.00th=[  275],
     | 30.00th=[  347], 40.00th=[  347], 50.00th=[  376], 60.00th=[  376],
     | 70.00th=[  376], 80.00th=[  376], 90.00th=[  405], 95.00th=[  405],
     | 99.00th=[  405], 99.50th=[  405], 99.90th=[  405], 99.95th=[  405],
     | 99.99th=[  405]
   bw (  KiB/s): min= 2019, max= 4039, per=48.29%, avg=2535.00, stdev=1002.72, samples=4
   iops        : min=    1, max=    3, avg= 1.50, stdev= 1.00, samples=4
  lat (msec)   : 250=25.00%, 500=66.67%, 1000=8.33%
  cpu          : usr=0.02%, sys=3.71%, ctx=83, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145628: Thu Sep 10 03:30:35 2026
  read: IOPS=0, BW=430KiB/s (440kB/s)(2048KiB/4764msec)
    clat (msec): min=185, max=187, avg=186.79, stdev= 1.16
     lat (msec): min=185, max=187, avg=186.79, stdev= 1.16
    clat percentiles (msec):
     |  1.00th=[  186],  5.00th=[  186], 10.00th=[  186], 20.00th=[  186],
     | 30.00th=[  186], 40.00th=[  186], 50.00th=[  186], 60.00th=[  188],
     | 70.00th=[  188], 80.00th=[  188], 90.00th=[  188], 95.00th=[  188],
     | 99.00th=[  188], 99.50th=[  188], 99.90th=[  188], 99.95th=[  188],
     | 99.99th=[  188]
   bw (  KiB/s): min= 1436, max= 2039, per=46.33%, avg=1737.50, stdev=426.39, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  write: IOPS=2, BW=2149KiB/s (2201kB/s)(10.0MiB/4764msec); 0 zone resets
    clat (msec): min=173, max=1014, avg=428.98, stdev=281.73
     lat (msec): min=173, max=1014, avg=429.26, stdev=281.66
    clat percentiles (msec):
     |  1.00th=[  174],  5.00th=[  174], 10.00th=[  174], 20.00th=[  211],
     | 30.00th=[  247], 40.00th=[  255], 50.00th=[  317], 60.00th=[  321],
     | 70.00th=[  368], 80.00th=[  567], 90.00th=[  810], 95.00th=[ 1011],
     | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011],
     | 99.99th=[ 1011]
   bw (  KiB/s): min= 1996, max= 4087, per=58.05%, avg=3047.83, stdev=1135.46, samples=6
   iops        : min=    1, max=    3, avg= 2.00, stdev= 1.10, samples=6
  lat (msec)   : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33%
  cpu          : usr=0.04%, sys=4.89%, ctx=100, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145629: Thu Sep 10 03:30:35 2026
  read: IOPS=1, BW=1436KiB/s (1471kB/s)(6144KiB/4278msec)
    clat (msec): min=96, max=418, avg=185.93, stdev=118.23
     lat (msec): min=96, max=418, avg=185.93, stdev=118.23
    clat percentiles (msec):
     |  1.00th=[   96],  5.00th=[   96], 10.00th=[   96], 20.00th=[  128],
     | 30.00th=[  128], 40.00th=[  138], 50.00th=[  138], 60.00th=[  142],
     | 70.00th=[  197], 80.00th=[  197], 90.00th=[  418], 95.00th=[  418],
     | 99.00th=[  418], 99.50th=[  418], 99.90th=[  418], 99.95th=[  418],
     | 99.99th=[  418]
   bw (  KiB/s): min= 2039, max= 4039, per=89.93%, avg=3372.33, stdev=1154.70, samples=3
   iops        : min=    1, max=    3, avg= 2.33, stdev= 1.15, samples=3
  write: IOPS=1, BW=1436KiB/s (1471kB/s)(6144KiB/4278msec); 0 zone resets
    clat (msec): min=238, max=961, avg=507.19, stdev=251.69
     lat (msec): min=238, max=961, avg=507.34, stdev=251.69
    clat percentiles (msec):
     |  1.00th=[  239],  5.00th=[  239], 10.00th=[  239], 20.00th=[  388],
     | 30.00th=[  388], 40.00th=[  397], 50.00th=[  397], 60.00th=[  456],
     | 70.00th=[  600], 80.00th=[  600], 90.00th=[  961], 95.00th=[  961],
     | 99.00th=[  961], 99.50th=[  961], 99.90th=[  961], 99.95th=[  961],
     | 99.99th=[  961]
   bw (  KiB/s): min= 2007, max= 2043, per=38.62%, avg=2027.67, stdev=14.84, samples=6
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=6
  lat (msec)   : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%
  cpu          : usr=0.02%, sys=3.44%, ctx=60, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145630: Thu Sep 10 03:30:35 2026
  read: IOPS=0, BW=938KiB/s (960kB/s)(5120KiB/5461msec)
    clat (msec): min=96, max=236, avg=152.24, stdev=65.43
     lat (msec): min=96, max=236, avg=152.24, stdev=65.43
    clat percentiles (msec):
     |  1.00th=[   97],  5.00th=[   97], 10.00th=[   97], 20.00th=[   97],
     | 30.00th=[   99], 40.00th=[   99], 50.00th=[  124], 60.00th=[  124],
     | 70.00th=[  207], 80.00th=[  207], 90.00th=[  236], 95.00th=[  236],
     | 99.00th=[  236], 99.50th=[  236], 99.90th=[  236], 99.95th=[  236],
     | 99.99th=[  236]
   bw (  KiB/s): min= 4007, max= 4031, per=100.00%, avg=4019.00, stdev=16.97, samples=2
   iops        : min=    3, max=    3, avg= 3.00, stdev= 0.00, samples=2
  write: IOPS=1, BW=1313KiB/s (1344kB/s)(7168KiB/5461msec); 0 zone resets
    clat (msec): min=156, max=1588, avg=650.63, stdev=484.71
     lat (msec): min=156, max=1588, avg=650.74, stdev=484.72
    clat percentiles (msec):
     |  1.00th=[  157],  5.00th=[  157], 10.00th=[  157], 20.00th=[  326],
     | 30.00th=[  409], 40.00th=[  409], 50.00th=[  439], 60.00th=[  709],
     | 70.00th=[  709], 80.00th=[  919], 90.00th=[ 1586], 95.00th=[ 1586],
     | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586],
     | 99.99th=[ 1586]
   bw (  KiB/s): min= 1976, max= 4071, per=57.70%, avg=3029.25, stdev=1193.80, samples=4
   iops        : min=    1, max=    3, avg= 2.00, stdev= 1.15, samples=4
  lat (msec)   : 100=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33%
  lat (msec)   : 2000=8.33%
  cpu          : usr=0.02%, sys=3.72%, ctx=110, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3750KiB/s (3840kB/s), 430KiB/s-1683KiB/s (440kB/s-1723kB/s), io=20.0MiB (20.0MB), run=4259-5461msec
  WRITE: bw=5250KiB/s (5376kB/s), 1202KiB/s-2149KiB/s (1231kB/s-2201kB/s), io=28.0MiB (29.4MB), run=4259-5461msec
mix direct rw 4194304 by fio with 4 jobs...
mix buffer rw 4194304 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=145636: Thu Sep 10 03:30:46 2026
  read: IOPS=1, BW=5826KiB/s (5966kB/s)(12.0MiB/2109msec)
    clat (msec): min=389, max=1087, avg=657.16, stdev=376.20
     lat (msec): min=389, max=1087, avg=657.16, stdev=376.20
    clat percentiles (msec):
     |  1.00th=[  388],  5.00th=[  388], 10.00th=[  388], 20.00th=[  388],
     | 30.00th=[  388], 40.00th=[  493], 50.00th=[  493], 60.00th=[  493],
     | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083],
     | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083],
     | 99.99th=[ 1083]
   bw (  KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1
   iops        : min=    4, max=    4, avg= 4.00, stdev= 0.00, samples=1
  lat (msec)   : 500=66.67%, 2000=33.33%
  cpu          : usr=0.00%, sys=4.03%, ctx=68, majf=0, minf=9
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145637: Thu Sep 10 03:30:46 2026
  read: IOPS=0, BW=1990KiB/s (2038kB/s)(4096KiB/2058msec)
    clat (nsec): min=645026k, max=645026k, avg=645026035.00, stdev= 0.00
     lat (nsec): min=645029k, max=645029k, avg=645028864.00, stdev= 0.00
    clat percentiles (msec):
     |  1.00th=[  642],  5.00th=[  642], 10.00th=[  642], 20.00th=[  642],
     | 30.00th=[  642], 40.00th=[  642], 50.00th=[  642], 60.00th=[  642],
     | 70.00th=[  642], 80.00th=[  642], 90.00th=[  642], 95.00th=[  642],
     | 99.00th=[  642], 99.50th=[  642], 99.90th=[  642], 99.95th=[  642],
     | 99.99th=[  642]
   bw (  KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  write: IOPS=0, BW=3981KiB/s (4076kB/s)(8192KiB/2058msec); 0 zone resets
    clat (msec): min=532, max=724, avg=628.86, stdev=135.63
     lat (msec): min=533, max=725, avg=629.23, stdev=135.55
    clat percentiles (msec):
     |  1.00th=[  535],  5.00th=[  535], 10.00th=[  535], 20.00th=[  535],
     | 30.00th=[  535], 40.00th=[  535], 50.00th=[  535], 60.00th=[  726],
     | 70.00th=[  726], 80.00th=[  726], 90.00th=[  726], 95.00th=[  726],
     | 99.00th=[  726], 99.50th=[  726], 99.90th=[  726], 99.95th=[  726],
     | 99.99th=[  726]
   bw (  KiB/s): min= 8192, max= 8192, per=51.45%, avg=8192.00, stdev= 0.00, samples=1
   iops        : min=    2, max=    2, avg= 2.00, stdev= 0.00, samples=1
  lat (msec)   : 750=100.00%
  cpu          : usr=0.15%, sys=6.17%, ctx=45, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145638: Thu Sep 10 03:30:46 2026
  write: IOPS=1, BW=6998KiB/s (7166kB/s)(12.0MiB/1756msec); 0 zone resets
    clat (msec): min=334, max=759, avg=551.83, stdev=212.58
     lat (msec): min=335, max=759, avg=552.08, stdev=212.59
    clat percentiles (msec):
     |  1.00th=[  334],  5.00th=[  334], 10.00th=[  334], 20.00th=[  334],
     | 30.00th=[  334], 40.00th=[  558], 50.00th=[  558], 60.00th=[  558],
     | 70.00th=[  760], 80.00th=[  760], 90.00th=[  760], 95.00th=[  760],
     | 99.00th=[  760], 99.50th=[  760], 99.90th=[  760], 99.95th=[  760],
     | 99.99th=[  760]
   bw (  KiB/s): min= 6253, max= 8000, per=44.76%, avg=7126.50, stdev=1235.32, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  lat (msec)   : 500=33.33%, 750=33.33%, 1000=33.33%
  cpu          : usr=0.00%, sys=7.24%, ctx=40, majf=0, minf=9
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145639: Thu Sep 10 03:30:46 2026
  write: IOPS=1, BW=6927KiB/s (7093kB/s)(12.0MiB/1774msec); 0 zone resets
    clat (msec): min=282, max=835, avg=541.15, stdev=278.60
     lat (msec): min=282, max=836, avg=541.66, stdev=278.45
    clat percentiles (msec):
     |  1.00th=[  284],  5.00th=[  284], 10.00th=[  284], 20.00th=[  284],
     | 30.00th=[  284], 40.00th=[  506], 50.00th=[  506], 60.00th=[  506],
     | 70.00th=[  835], 80.00th=[  835], 90.00th=[  835], 95.00th=[  835],
     | 99.00th=[  835], 99.50th=[  835], 99.90th=[  835], 99.95th=[  835],
     | 99.99th=[  835]
   bw (  KiB/s): min= 6460, max= 8192, per=46.01%, avg=7326.00, stdev=1224.71, samples=2
   iops        : min=    1, max=    2, avg= 1.50, stdev= 0.71, samples=2
  lat (msec)   : 500=33.33%, 750=33.33%, 1000=33.33%
  cpu          : usr=0.00%, sys=7.22%, ctx=43, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=7769KiB/s (7955kB/s), 1990KiB/s-5826KiB/s (2038kB/s-5966kB/s), io=16.0MiB (16.8MB), run=2058-2109msec
  WRITE: bw=15.5MiB/s (16.3MB/s), 3981KiB/s-6998KiB/s (4076kB/s-7166kB/s), io=32.0MiB (33.6MB), run=1756-2058msec
rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=145641: Thu Sep 10 03:30:50 2026
  read: IOPS=1, BW=4947KiB/s (5066kB/s)(12.0MiB/2484msec)
    clat (msec): min=645, max=826, avg=765.42, stdev=104.18
     lat (msec): min=645, max=826, avg=765.42, stdev=104.18
    clat percentiles (msec):
     |  1.00th=[  642],  5.00th=[  642], 10.00th=[  642], 20.00th=[  642],
     | 30.00th=[  642], 40.00th=[  827], 50.00th=[  827], 60.00th=[  827],
     | 70.00th=[  827], 80.00th=[  827], 90.00th=[  827], 95.00th=[  827],
     | 99.00th=[  827], 99.50th=[  827], 99.90th=[  827], 99.95th=[  827],
     | 99.99th=[  827]
   bw (  KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2
   iops        : min=    1, max=    2, avg= 1.50, stdev= 0.71, samples=2
  lat (msec)   : 750=33.33%, 1000=66.67%
  cpu          : usr=0.32%, sys=11.20%, ctx=282, majf=0, minf=8
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145642: Thu Sep 10 03:30:50 2026
  read: IOPS=0, BW=1490KiB/s (1526kB/s)(4096KiB/2749msec)
    clat (nsec): min=988451k, max=988451k, avg=988451475.00, stdev= 0.00
     lat (nsec): min=988454k, max=988454k, avg=988454395.00, stdev= 0.00
    clat percentiles (msec):
     |  1.00th=[  986],  5.00th=[  986], 10.00th=[  986], 20.00th=[  986],
     | 30.00th=[  986], 40.00th=[  986], 50.00th=[  986], 60.00th=[  986],
     | 70.00th=[  986], 80.00th=[  986], 90.00th=[  986], 95.00th=[  986],
     | 99.00th=[  986], 99.50th=[  986], 99.90th=[  986], 99.95th=[  986],
     | 99.99th=[  986]
   bw (  KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  write: IOPS=0, BW=2980KiB/s (3052kB/s)(8192KiB/2749msec); 0 zone resets
    clat (msec): min=462, max=1260, avg=861.26, stdev=563.94
     lat (msec): min=462, max=1260, avg=861.65, stdev=564.00
    clat percentiles (msec):
     |  1.00th=[  464],  5.00th=[  464], 10.00th=[  464], 20.00th=[  464],
     | 30.00th=[  464], 40.00th=[  464], 50.00th=[  464], 60.00th=[ 1267],
     | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267],
     | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267],
     | 99.99th=[ 1267]
   bw (  KiB/s): min= 8192, max= 8192, per=68.73%, avg=8192.00, stdev= 0.00, samples=1
   iops        : min=    2, max=    2, avg= 2.00, stdev= 0.00, samples=1
  lat (msec)   : 500=33.33%, 1000=33.33%, 2000=33.33%
  cpu          : usr=0.11%, sys=4.95%, ctx=83, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145643: Thu Sep 10 03:30:50 2026
  write: IOPS=1, BW=4483KiB/s (4591kB/s)(12.0MiB/2741msec); 0 zone resets
    clat (msec): min=368, max=1348, avg=872.13, stdev=490.45
     lat (msec): min=369, max=1348, avg=872.52, stdev=490.34
    clat percentiles (msec):
     |  1.00th=[  368],  5.00th=[  368], 10.00th=[  368], 20.00th=[  368],
     | 30.00th=[  368], 40.00th=[  902], 50.00th=[  902], 60.00th=[  902],
     | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351],
     | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351],
     | 99.99th=[ 1351]
   bw (  KiB/s): min= 8094, max= 8175, per=68.25%, avg=8134.50, stdev=57.28, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  lat (msec)   : 500=33.33%, 1000=33.33%, 2000=33.33%
  cpu          : usr=0.33%, sys=5.36%, ctx=75, majf=0, minf=8
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=145644: Thu Sep 10 03:30:50 2026
  write: IOPS=1, BW=5357KiB/s (5485kB/s)(12.0MiB/2294msec); 0 zone resets
    clat (msec): min=439, max=860, avg=699.66, stdev=227.05
     lat (msec): min=444, max=861, avg=701.62, stdev=224.84
    clat percentiles (msec):
     |  1.00th=[  439],  5.00th=[  439], 10.00th=[  439], 20.00th=[  439],
     | 30.00th=[  439], 40.00th=[  802], 50.00th=[  802], 60.00th=[  802],
     | 70.00th=[  860], 80.00th=[  860], 90.00th=[  860], 95.00th=[  860],
     | 99.00th=[  860], 99.50th=[  860], 99.90th=[  860], 99.95th=[  860],
     | 99.99th=[  860]
   bw (  KiB/s): min= 8094, max= 8192, per=68.32%, avg=8143.00, stdev=69.30, samples=2
   iops        : min=    1, max=    2, avg= 1.50, stdev= 0.71, samples=2
  lat (msec)   : 500=33.33%, 1000=66.67%
  cpu          : usr=0.17%, sys=5.80%, ctx=58, majf=0, minf=9
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=5960KiB/s (6103kB/s), 1490KiB/s-4947KiB/s (1526kB/s-5066kB/s), io=16.0MiB (16.8MB), run=2484-2749msec
  WRITE: bw=11.6MiB/s (12.2MB/s), 2980KiB/s-5357KiB/s (3052kB/s-5485kB/s), io=32.0MiB (33.6MB), run=2294-2749msec