== sanity test 398b: DIO and buffer IO race ============== 07:44:36 (1787744676)
/usr/bin/fio
48+0 records in
48+0 records out
50331648 bytes (50 MB, 48 MiB) copied, 8.59444 s, 5.9 MB/s
mix direct rw 4096 by fio with 4 jobs...
mix buffer rw 4096 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=144124: Wed Aug 26 07:47:43 2026
  read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(5992KiB/161221msec)
    clat (usec): min=29, max=867201, avg=49917.33, stdev=46449.22
     lat (usec): min=29, max=867201, avg=49921.07, stdev=46451.90
    clat percentiles (usec):
     |  1.00th=[    48],  5.00th=[    59], 10.00th=[   102], 20.00th=[ 20317],
     | 30.00th=[ 26084], 40.00th=[ 32637], 50.00th=[ 40109], 60.00th=[ 48497],
     | 70.00th=[ 61080], 80.00th=[ 76022], 90.00th=[100140], 95.00th=[122160],
     | 99.00th=[185598], 99.50th=[242222], 99.90th=[549454], 99.95th=[868221],
     | 99.99th=[868221]
   bw (  KiB/s): min=    7, max=  112, per=25.75%, avg=38.11, stdev=19.83, samples=305
   iops        : min=    1, max=   28, avg= 8.89, stdev= 5.01, samples=305
  write: IOPS=9, BW=39.1KiB/s (39.0kB/s)(6296KiB/161221msec); 0 zone resets
    clat (usec): min=786, max=765083, avg=54656.00, stdev=63460.77
     lat (usec): min=788, max=765085, avg=54659.77, stdev=63462.04
    clat percentiles (usec):
     |  1.00th=[  1012],  5.00th=[  1139], 10.00th=[  1254], 20.00th=[  4080],
     | 30.00th=[ 10945], 40.00th=[ 23987], 50.00th=[ 38011], 60.00th=[ 51119],
     | 70.00th=[ 68682], 80.00th=[ 92799], 90.00th=[135267], 95.00th=[173016],
     | 99.00th=[274727], 99.50th=[350225], 99.90th=[522191], 99.95th=[767558],
     | 99.99th=[767558]
   bw (  KiB/s): min=    5, max=  102, per=25.37%, avg=39.32, stdev=19.87, samples=311
   iops        : min=    1, max=   25, avg= 9.19, stdev= 5.01, samples=311
  lat (usec)   : 50=0.72%, 100=4.13%, 250=0.26%, 500=0.03%, 1000=0.46%
  lat (msec)   : 2=7.13%, 4=2.80%, 10=5.01%, 20=8.11%, 50=31.48%
  lat (msec)   : 100=26.24%, 250=12.76%, 500=0.75%, 750=0.07%, 1000=0.07%
  cpu          : usr=0.07%, sys=4.01%, ctx=6123, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144125: Wed Aug 26 07:47:43 2026
  read: IOPS=9, BW=38.1KiB/s (38.0kB/s)(5940KiB/155979msec)
    clat (usec): min=29, max=281835, avg=46705.74, stdev=39461.26
     lat (usec): min=29, max=281836, avg=46707.98, stdev=39463.82
    clat percentiles (usec):
     |  1.00th=[    47],  5.00th=[    57], 10.00th=[    76], 20.00th=[ 18220],
     | 30.00th=[ 25035], 40.00th=[ 31327], 50.00th=[ 38011], 60.00th=[ 45351],
     | 70.00th=[ 55313], 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[126354],
     | 99.00th=[189793], 99.50th=[204473], 99.90th=[278922], 99.95th=[283116],
     | 99.99th=[283116]
   bw (  KiB/s): min=    6, max=  109, per=26.32%, avg=38.96, stdev=20.25, samples=296
   iops        : min=    1, max=   27, avg= 9.09, stdev= 5.09, samples=296
  write: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6348KiB/155979msec); 0 zone resets
    clat (usec): min=733, max=549559, avg=54373.33, stdev=61184.78
     lat (usec): min=735, max=549561, avg=54377.37, stdev=61186.23
    clat percentiles (usec):
     |  1.00th=[  1037],  5.00th=[  1123], 10.00th=[  1254], 20.00th=[  4015],
     | 30.00th=[ 10028], 40.00th=[ 23725], 50.00th=[ 36439], 60.00th=[ 50594],
     | 70.00th=[ 70779], 80.00th=[ 94897], 90.00th=[130548], 95.00th=[170918],
     | 99.00th=[263193], 99.50th=[316670], 99.90th=[549454], 99.95th=[549454],
     | 99.99th=[549454]
   bw (  KiB/s): min=    6, max=  134, per=26.01%, avg=40.32, stdev=20.16, samples=305
   iops        : min=    1, max=   33, avg= 9.45, stdev= 5.08, samples=305
  lat (usec)   : 50=0.88%, 100=4.46%, 250=0.10%, 750=0.07%, 1000=0.29%
  lat (msec)   : 2=7.39%, 4=2.73%, 10=5.53%, 20=9.02%, 50=31.71%
  lat (msec)   : 100=24.09%, 250=13.05%, 500=0.62%, 750=0.07%
  cpu          : usr=0.06%, sys=4.08%, ctx=6171, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144126: Wed Aug 26 07:47:43 2026
  read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6028KiB/161009msec)
    clat (usec): min=30, max=598244, avg=50298.44, stdev=44727.58
     lat (usec): min=31, max=598245, avg=50301.14, stdev=44726.74
    clat percentiles (usec):
     |  1.00th=[    48],  5.00th=[    56], 10.00th=[    81], 20.00th=[ 21103],
     | 30.00th=[ 27132], 40.00th=[ 33424], 50.00th=[ 41157], 60.00th=[ 50070],
     | 70.00th=[ 61080], 80.00th=[ 74974], 90.00th=[101188], 95.00th=[121111],
     | 99.00th=[179307], 99.50th=[270533], 99.90th=[509608], 99.95th=[599786],
     | 99.99th=[599786]
   bw (  KiB/s): min=    7, max=  110, per=25.75%, avg=38.11, stdev=18.68, samples=307
   iops        : min=    1, max=   27, avg= 8.88, stdev= 4.72, samples=307
  write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6260KiB/161009msec); 0 zone resets
    clat (usec): min=680, max=831161, avg=54200.54, stdev=61987.02
     lat (usec): min=681, max=831162, avg=54203.01, stdev=61987.21
    clat percentiles (usec):
     |  1.00th=[  1057],  5.00th=[  1156], 10.00th=[  1319], 20.00th=[  4146],
     | 30.00th=[ 10421], 40.00th=[ 25035], 50.00th=[ 38011], 60.00th=[ 51643],
     | 70.00th=[ 67634], 80.00th=[ 92799], 90.00th=[127402], 95.00th=[162530],
     | 99.00th=[267387], 99.50th=[329253], 99.90th=[505414], 99.95th=[834667],
     | 99.99th=[834667]
   bw (  KiB/s): min=    7, max=  118, per=25.08%, avg=38.87, stdev=19.46, samples=312
   iops        : min=    1, max=   29, avg= 9.09, stdev= 4.91, samples=312
  lat (usec)   : 50=0.78%, 100=4.33%, 250=0.46%, 500=0.10%, 750=0.10%
  lat (usec)   : 1000=0.13%
  lat (msec)   : 2=6.90%, 4=2.99%, 10=5.34%, 20=6.48%, 50=31.67%
  lat (msec)   : 100=26.63%, 250=13.09%, 500=0.88%, 750=0.10%, 1000=0.03%
  cpu          : usr=0.06%, sys=4.07%, ctx=6213, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144127: Wed Aug 26 07:47:43 2026
  read: IOPS=9, BW=37.9KiB/s (38.8kB/s)(6052KiB/159540msec)
    clat (usec): min=32, max=649504, avg=50643.33, stdev=46103.28
     lat (usec): min=32, max=649505, avg=50649.01, stdev=46103.63
    clat percentiles (usec):
     |  1.00th=[    49],  5.00th=[    58], 10.00th=[   137], 20.00th=[ 20579],
     | 30.00th=[ 27132], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 50070],
     | 70.00th=[ 61080], 80.00th=[ 73925], 90.00th=[ 98042], 95.00th=[123208],
     | 99.00th=[189793], 99.50th=[261096], 99.90th=[574620], 99.95th=[650118],
     | 99.99th=[650118]
   bw (  KiB/s): min=    5, max=   87, per=25.62%, avg=37.92, stdev=19.21, samples=308
   iops        : min=    1, max=   21, avg= 8.84, stdev= 4.84, samples=308
  write: IOPS=9, BW=39.1KiB/s (40.0kB/s)(6236KiB/159540msec); 0 zone resets
    clat (usec): min=673, max=996540, avg=52890.36, stdev=63571.23
     lat (usec): min=674, max=996542, avg=52904.01, stdev=63625.01
    clat percentiles (usec):
     |  1.00th=[  1004],  5.00th=[  1139], 10.00th=[  1254], 20.00th=[  3752],
     | 30.00th=[  8848], 40.00th=[ 21890], 50.00th=[ 35390], 60.00th=[ 50594],
     | 70.00th=[ 66847], 80.00th=[ 91751], 90.00th=[127402], 95.00th=[164627],
     | 99.00th=[256902], 99.50th=[346031], 99.90th=[574620], 99.95th=[994051],
     | 99.99th=[994051]
   bw (  KiB/s): min=    7, max=  103, per=25.20%, avg=39.06, stdev=19.73, samples=308
   iops        : min=    1, max=   25, avg= 9.12, stdev= 4.96, samples=308
  lat (usec)   : 50=0.59%, 100=4.17%, 250=0.33%, 500=0.03%, 750=0.16%
  lat (usec)   : 1000=0.39%
  lat (msec)   : 2=6.87%, 4=3.35%, 10=5.53%, 20=7.45%, 50=30.89%
  lat (msec)   : 100=27.38%, 250=12.04%, 500=0.68%, 750=0.10%, 1000=0.03%
  cpu          : usr=0.07%, sys=4.11%, ctx=6231, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=149KiB/s (153kB/s), 37.2KiB/s-38.1KiB/s (38.1kB/s-38.0kB/s), io=23.4MiB (24.6MB), run=155979-161221msec
  WRITE: bw=156KiB/s (160kB/s), 38.9KiB/s-40.7KiB/s (39.8kB/s-41.7kB/s), io=24.6MiB (25.7MB), run=155979-161221msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=144129: Wed Aug 26 07:50:36 2026
  read: IOPS=4, BW=17.9KiB/s (18.4kB/s)(5992KiB/333886msec)
    clat (msec): min=5, max=607, avg=41.20, stdev=47.65
     lat (msec): min=5, max=607, avg=41.21, stdev=47.65
    clat percentiles (msec):
     |  1.00th=[    8],  5.00th=[   10], 10.00th=[   12], 20.00th=[   15],
     | 30.00th=[   18], 40.00th=[   21], 50.00th=[   26], 60.00th=[   31],
     | 70.00th=[   41], 80.00th=[   55], 90.00th=[   92], 95.00th=[  130],
     | 99.00th=[  222], 99.50th=[  313], 99.90th=[  558], 99.95th=[  609],
     | 99.99th=[  609]
   bw (  KiB/s): min=    5, max=   95, per=31.43%, avg=22.32, stdev=15.67, samples=516
   iops        : min=    1, max=   23, avg= 4.95, stdev= 3.96, samples=516
  write: IOPS=4, BW=18.9KiB/s (19.3kB/s)(6296KiB/333886msec); 0 zone resets
    clat (msec): min=35, max=1575, avg=172.84, stdev=113.91
     lat (msec): min=35, max=1575, avg=172.84, stdev=113.91
    clat percentiles (msec):
     |  1.00th=[   50],  5.00th=[   66], 10.00th=[   77], 20.00th=[   91],
     | 30.00th=[  107], 40.00th=[  125], 50.00th=[  142], 60.00th=[  165],
     | 70.00th=[  194], 80.00th=[  236], 90.00th=[  309], 95.00th=[  380],
     | 99.00th=[  550], 99.50th=[  651], 99.90th=[ 1267], 99.95th=[ 1569],
     | 99.99th=[ 1569]
   bw (  KiB/s): min=    5, max=   56, per=25.46%, avg=19.10, stdev=10.53, samples=629
   iops        : min=    1, max=   14, avg= 4.14, stdev= 2.69, samples=629
  lat (msec)   : 10=2.80%, 20=15.79%, 50=19.60%, 100=20.08%, 250=32.36%
  lat (msec)   : 500=8.56%, 750=0.68%, 1000=0.03%, 2000=0.10%
  cpu          : usr=0.03%, sys=0.89%, ctx=5022, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144130: Wed Aug 26 07:50:36 2026
  read: IOPS=4, BW=17.8KiB/s (18.3kB/s)(5940KiB/333083msec)
    clat (msec): min=5, max=1581, avg=42.54, stdev=65.37
     lat (msec): min=5, max=1581, avg=42.54, stdev=65.37
    clat percentiles (msec):
     |  1.00th=[    7],  5.00th=[   10], 10.00th=[   12], 20.00th=[   15],
     | 30.00th=[   18], 40.00th=[   21], 50.00th=[   24], 60.00th=[   30],
     | 70.00th=[   37], 80.00th=[   57], 90.00th=[   95], 95.00th=[  129],
     | 99.00th=[  271], 99.50th=[  384], 99.90th=[  592], 99.95th=[ 1586],
     | 99.99th=[ 1586]
   bw (  KiB/s): min=    5, max=   95, per=30.94%, avg=21.97, stdev=16.04, samples=519
   iops        : min=    1, max=   23, avg= 4.86, stdev= 4.05, samples=519
  write: IOPS=4, BW=19.1KiB/s (19.5kB/s)(6348KiB/333083msec); 0 zone resets
    clat (msec): min=37, max=1207, avg=169.98, stdev=103.55
     lat (msec): min=37, max=1207, avg=169.99, stdev=103.55
    clat percentiles (msec):
     |  1.00th=[   54],  5.00th=[   66], 10.00th=[   77], 20.00th=[   92],
     | 30.00th=[  106], 40.00th=[  123], 50.00th=[  142], 60.00th=[  163],
     | 70.00th=[  194], 80.00th=[  239], 90.00th=[  305], 95.00th=[  355],
     | 99.00th=[  535], 99.50th=[  600], 99.90th=[  978], 99.95th=[ 1200],
     | 99.99th=[ 1200]
   bw (  KiB/s): min=    5, max=   55, per=25.95%, avg=19.46, stdev=10.37, samples=623
   iops        : min=    1, max=   13, avg= 4.23, stdev= 2.63, samples=623
  lat (msec)   : 10=3.22%, 20=15.79%, 50=18.68%, 100=19.73%, 250=32.88%
  lat (msec)   : 500=8.89%, 750=0.65%, 1000=0.10%, 2000=0.07%
  cpu          : usr=0.04%, sys=0.90%, ctx=4958, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144131: Wed Aug 26 07:50:36 2026
  read: IOPS=4, BW=18.1KiB/s (18.6kB/s)(6028KiB/332127msec)
    clat (msec): min=5, max=1584, avg=43.71, stdev=64.18
     lat (msec): min=5, max=1584, avg=43.71, stdev=64.18
    clat percentiles (msec):
     |  1.00th=[    8],  5.00th=[   11], 10.00th=[   12], 20.00th=[   15],
     | 30.00th=[   18], 40.00th=[   21], 50.00th=[   26], 60.00th=[   32],
     | 70.00th=[   40], 80.00th=[   58], 90.00th=[   96], 95.00th=[  133],
     | 99.00th=[  271], 99.50th=[  326], 99.90th=[  567], 99.95th=[ 1586],
     | 99.99th=[ 1586]
   bw (  KiB/s): min=    6, max=  120, per=31.17%, avg=22.13, stdev=16.26, samples=524
   iops        : min=    1, max=   30, avg= 4.89, stdev= 4.10, samples=524
  write: IOPS=4, BW=18.8KiB/s (19.3kB/s)(6260KiB/332127msec); 0 zone resets
    clat (msec): min=37, max=1295, avg=170.04, stdev=106.88
     lat (msec): min=37, max=1295, avg=170.04, stdev=106.89
    clat percentiles (msec):
     |  1.00th=[   51],  5.00th=[   67], 10.00th=[   77], 20.00th=[   92],
     | 30.00th=[  106], 40.00th=[  122], 50.00th=[  140], 60.00th=[  161],
     | 70.00th=[  192], 80.00th=[  236], 90.00th=[  305], 95.00th=[  368],
     | 99.00th=[  542], 99.50th=[  659], 99.90th=[  894], 99.95th=[ 1301],
     | 99.99th=[ 1301]
   bw (  KiB/s): min=    5, max=   56, per=25.88%, avg=19.41, stdev=10.49, samples=617
   iops        : min=    1, max=   14, avg= 4.22, stdev= 2.68, samples=617
  lat (msec)   : 10=2.38%, 20=16.08%, 50=19.60%, 100=19.89%, 250=32.71%
  lat (msec)   : 500=8.37%, 750=0.81%, 1000=0.10%, 2000=0.07%
  cpu          : usr=0.05%, sys=1.31%, ctx=5035, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144132: Wed Aug 26 07:50:36 2026
  read: IOPS=4, BW=18.2KiB/s (18.6kB/s)(6052KiB/332755msec)
    clat (msec): min=5, max=706, avg=42.16, stdev=52.02
     lat (msec): min=5, max=706, avg=42.17, stdev=52.03
    clat percentiles (msec):
     |  1.00th=[    8],  5.00th=[   10], 10.00th=[   12], 20.00th=[   15],
     | 30.00th=[   17], 40.00th=[   21], 50.00th=[   24], 60.00th=[   30],
     | 70.00th=[   39], 80.00th=[   55], 90.00th=[  100], 95.00th=[  140],
     | 99.00th=[  266], 99.50th=[  313], 99.90th=[  518], 99.95th=[  709],
     | 99.99th=[  709]
   bw (  KiB/s): min=    6, max=   95, per=31.67%, avg=22.48, stdev=16.31, samples=518
   iops        : min=    1, max=   23, avg= 4.99, stdev= 4.12, samples=518
  write: IOPS=4, BW=18.7KiB/s (19.2kB/s)(6236KiB/332755msec); 0 zone resets
    clat (msec): min=35, max=1660, avg=172.43, stdev=118.22
     lat (msec): min=35, max=1660, avg=172.43, stdev=118.22
    clat percentiles (msec):
     |  1.00th=[   50],  5.00th=[   65], 10.00th=[   74], 20.00th=[   91],
     | 30.00th=[  105], 40.00th=[  120], 50.00th=[  138], 60.00th=[  163],
     | 70.00th=[  194], 80.00th=[  234], 90.00th=[  313], 95.00th=[  384],
     | 99.00th=[  575], 99.50th=[  693], 99.90th=[ 1519], 99.95th=[ 1670],
     | 99.99th=[ 1670]
   bw (  KiB/s): min=    5, max=   64, per=25.45%, avg=19.09, stdev=10.75, samples=624
   iops        : min=    1, max=   16, avg= 4.14, stdev= 2.75, samples=624
  lat (msec)   : 10=2.86%, 20=16.57%, 50=19.30%, 100=19.27%, 250=32.29%
  lat (msec)   : 500=8.76%, 750=0.75%, 1000=0.13%, 2000=0.07%
  cpu          : usr=0.04%, sys=0.87%, ctx=5229, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=71.9KiB/s (73.6kB/s), 17.8KiB/s-18.2KiB/s (18.3kB/s-18.6kB/s), io=23.4MiB (24.6MB), run=332127-333886msec
  WRITE: bw=75.3KiB/s (77.1kB/s), 18.7KiB/s-19.1KiB/s (19.2kB/s-19.5kB/s), io=24.6MiB (25.7MB), run=332127-333886msec
mix direct rw 16384 by fio with 4 jobs...
mix buffer rw 16384 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=144208: Wed Aug 26 07:51:20 2026
  read: IOPS=11, BW=192KiB/s (196kB/s)(5920KiB/30864msec)
    clat (usec): min=29, max=223652, avg=37409.04, stdev=37343.41
     lat (usec): min=29, max=223653, avg=37410.19, stdev=37343.36
    clat percentiles (usec):
     |  1.00th=[    38],  5.00th=[    43], 10.00th=[    57], 20.00th=[    64],
     | 30.00th=[    87], 40.00th=[ 22152], 50.00th=[ 34341], 60.00th=[ 42730],
     | 70.00th=[ 52167], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[104334],
     | 99.00th=[168821], 99.50th=[181404], 99.90th=[223347], 99.95th=[223347],
     | 99.99th=[223347]
   bw (  KiB/s): min=   63, max=  415, per=26.70%, avg=191.97, stdev=82.63, samples=60
   iops        : min=    3, max=   25, avg=11.23, stdev= 5.26, samples=60
  write: IOPS=12, BW=206KiB/s (211kB/s)(6368KiB/30864msec); 0 zone resets
    clat (usec): min=1294, max=240166, avg=42237.23, stdev=44628.78
     lat (usec): min=1295, max=240167, avg=42239.05, stdev=44628.76
    clat percentiles (usec):
     |  1.00th=[  1418],  5.00th=[  1631], 10.00th=[  1778], 20.00th=[  5014],
     | 30.00th=[ 10290], 40.00th=[ 16909], 50.00th=[ 26870], 60.00th=[ 40109],
     | 70.00th=[ 55313], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[133694],
     | 99.00th=[214959], 99.50th=[219153], 99.90th=[240124], 99.95th=[240124],
     | 99.99th=[240124]
   bw (  KiB/s): min=   63, max=  404, per=27.30%, avg=206.68, stdev=75.10, samples=60
   iops        : min=    3, max=   25, avg=12.18, stdev= 4.76, samples=60
  lat (usec)   : 50=3.78%, 100=11.07%, 250=1.17%, 750=0.13%
  lat (msec)   : 2=6.12%, 4=3.12%, 10=5.99%, 20=10.55%, 50=25.26%
  lat (msec)   : 100=24.22%, 250=8.59%
  cpu          : usr=0.07%, sys=4.77%, ctx=1313, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144209: Wed Aug 26 07:51:20 2026
  read: IOPS=10, BW=175KiB/s (180kB/s)(5744KiB/32755msec)
    clat (usec): min=32, max=187738, avg=40994.11, stdev=37674.56
     lat (usec): min=32, max=187739, avg=40998.97, stdev=37671.75
    clat percentiles (usec):
     |  1.00th=[    40],  5.00th=[    47], 10.00th=[    59], 20.00th=[    68],
     | 30.00th=[  1188], 40.00th=[ 31327], 50.00th=[ 39060], 60.00th=[ 47973],
     | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[114820],
     | 99.00th=[154141], 99.50th=[170918], 99.90th=[187696], 99.95th=[187696],
     | 99.99th=[187696]
   bw (  KiB/s): min=   31, max=  345, per=24.18%, avg=173.83, stdev=78.86, samples=64
   iops        : min=    1, max=   21, avg=10.09, stdev= 5.02, samples=64
  write: IOPS=12, BW=200KiB/s (205kB/s)(6544KiB/32755msec); 0 zone resets
    clat (usec): min=1309, max=249072, avg=43914.59, stdev=46968.02
     lat (usec): min=1311, max=249074, avg=43921.59, stdev=46964.04
    clat percentiles (usec):
     |  1.00th=[  1450],  5.00th=[  1631], 10.00th=[  2409], 20.00th=[  5735],
     | 30.00th=[ 10290], 40.00th=[ 17957], 50.00th=[ 28181], 60.00th=[ 40109],
     | 70.00th=[ 56361], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[137364],
     | 99.00th=[212861], 99.50th=[229639], 99.90th=[248513], 99.95th=[248513],
     | 99.99th=[248513]
   bw (  KiB/s): min=   31, max=  508, per=26.29%, avg=198.98, stdev=85.30, samples=64
   iops        : min=    1, max=   31, avg=11.69, stdev= 5.42, samples=64
  lat (usec)   : 50=2.34%, 100=10.68%, 250=0.78%, 1000=0.13%
  lat (msec)   : 2=5.21%, 4=3.26%, 10=8.20%, 20=7.55%, 50=26.56%
  lat (msec)   : 100=25.39%, 250=9.90%
  cpu          : usr=0.05%, sys=4.74%, ctx=1357, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144211: Wed Aug 26 07:51:20 2026
  read: IOPS=11, BW=188KiB/s (192kB/s)(6256KiB/33282msec)
    clat (usec): min=35, max=210917, avg=44929.37, stdev=39473.75
     lat (usec): min=35, max=210918, avg=44930.42, stdev=39473.78
    clat percentiles (usec):
     |  1.00th=[    39],  5.00th=[    51], 10.00th=[    57], 20.00th=[    69],
     | 30.00th=[ 18482], 40.00th=[ 31851], 50.00th=[ 41157], 60.00th=[ 50594],
     | 70.00th=[ 62653], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[114820],
     | 99.00th=[152044], 99.50th=[193987], 99.90th=[210764], 99.95th=[210764],
     | 99.99th=[210764]
   bw (  KiB/s): min=   30, max=  471, per=26.72%, avg=192.14, stdev=79.21, samples=64
   iops        : min=    1, max=   29, avg=11.25, stdev= 5.00, samples=64
  write: IOPS=11, BW=181KiB/s (186kB/s)(6032KiB/33282msec); 0 zone resets
    clat (usec): min=1392, max=393791, avg=41007.35, stdev=49225.60
     lat (usec): min=1394, max=393795, avg=41017.04, stdev=49221.92
    clat percentiles (usec):
     |  1.00th=[  1434],  5.00th=[  1680], 10.00th=[  1893], 20.00th=[  3982],
     | 30.00th=[  7439], 40.00th=[ 12387], 50.00th=[ 20579], 60.00th=[ 33817],
     | 70.00th=[ 50070], 80.00th=[ 74974], 90.00th=[108528], 95.00th=[139461],
     | 99.00th=[202376], 99.50th=[227541], 99.90th=[392168], 99.95th=[392168],
     | 99.99th=[392168]
   bw (  KiB/s): min=   60, max=  428, per=24.53%, avg=185.67, stdev=88.14, samples=63
   iops        : min=    3, max=   26, avg=10.84, stdev= 5.60, samples=63
  lat (usec)   : 50=2.21%, 100=10.81%, 250=0.39%, 750=0.13%, 1000=0.26%
  lat (msec)   : 2=5.73%, 4=4.43%, 10=8.07%, 20=8.20%, 50=23.96%
  lat (msec)   : 100=23.96%, 250=11.72%, 500=0.13%
  cpu          : usr=0.08%, sys=4.71%, ctx=1364, majf=0, minf=15
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144212: Wed Aug 26 07:51:20 2026
  read: IOPS=11, BW=189KiB/s (193kB/s)(6032KiB/31952msec)
    clat (usec): min=36, max=196641, avg=40751.74, stdev=38911.59
     lat (usec): min=36, max=196642, avg=40752.72, stdev=38911.61
    clat percentiles (usec):
     |  1.00th=[    39],  5.00th=[    45], 10.00th=[    57], 20.00th=[    65],
     | 30.00th=[    99], 40.00th=[ 24773], 50.00th=[ 38011], 60.00th=[ 49546],
     | 70.00th=[ 58983], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[114820],
     | 99.00th=[152044], 99.50th=[173016], 99.90th=[196084], 99.95th=[196084],
     | 99.99th=[196084]
   bw (  KiB/s): min=   61, max=  478, per=26.59%, avg=191.21, stdev=84.79, samples=61
   iops        : min=    3, max=   29, avg=11.18, stdev= 5.37, samples=61
  write: IOPS=12, BW=196KiB/s (200kB/s)(6256KiB/31952msec); 0 zone resets
    clat (usec): min=1256, max=278143, avg=41905.92, stdev=44973.67
     lat (usec): min=1257, max=278143, avg=41912.95, stdev=44971.28
    clat percentiles (usec):
     |  1.00th=[  1434],  5.00th=[  1614], 10.00th=[  1844], 20.00th=[  5145],
     | 30.00th=[  8356], 40.00th=[ 14484], 50.00th=[ 25297], 60.00th=[ 43779],
     | 70.00th=[ 55837], 80.00th=[ 74974], 90.00th=[101188], 95.00th=[129500],
     | 99.00th=[206570], 99.50th=[229639], 99.90th=[278922], 99.95th=[278922],
     | 99.99th=[278922]
   bw (  KiB/s): min=   61, max=  352, per=25.96%, avg=196.55, stdev=76.37, samples=62
   iops        : min=    3, max=   22, avg=11.52, stdev= 4.87, samples=62
  lat (usec)   : 50=2.73%, 100=12.11%, 250=0.52%, 500=0.39%, 750=0.13%
  lat (usec)   : 1000=0.26%
  lat (msec)   : 2=5.21%, 4=3.65%, 10=9.24%, 20=7.42%, 50=21.61%
  lat (msec)   : 100=27.73%, 250=8.85%, 500=0.13%
  cpu          : usr=0.06%, sys=4.66%, ctx=1243, majf=0, minf=16
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=720KiB/s (737kB/s), 175KiB/s-192KiB/s (180kB/s-196kB/s), io=23.4MiB (24.5MB), run=30864-33282msec
  WRITE: bw=757KiB/s (775kB/s), 181KiB/s-206KiB/s (186kB/s-211kB/s), io=24.6MiB (25.8MB), run=30864-33282msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=144205: Wed Aug 26 07:52:14 2026
  read: IOPS=4, BW=69.7KiB/s (71.4kB/s)(5920KiB/84938msec)
    clat (msec): min=6, max=466, avg=47.95, stdev=44.61
     lat (msec): min=6, max=466, avg=47.96, stdev=44.61
    clat percentiles (msec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   17], 20.00th=[   22],
     | 30.00th=[   26], 40.00th=[   29], 50.00th=[   35], 60.00th=[   40],
     | 70.00th=[   47], 80.00th=[   62], 90.00th=[  105], 95.00th=[  130],
     | 99.00th=[  211], 99.50th=[  259], 99.90th=[  468], 99.95th=[  468],
     | 99.99th=[  468]
   bw (  KiB/s): min=   31, max=  254, per=30.46%, avg=83.76, stdev=51.32, samples=139
   iops        : min=    1, max=   15, avg= 4.50, stdev= 3.25, samples=139
  write: IOPS=4, BW=74.0KiB/s (76.8kB/s)(6368KiB/84938msec); 0 zone resets
    clat (msec): min=55, max=544, avg=168.59, stdev=78.96
     lat (msec): min=55, max=544, avg=168.59, stdev=78.96
    clat percentiles (msec):
     |  1.00th=[   66],  5.00th=[   80], 10.00th=[   91], 20.00th=[  110],
     | 30.00th=[  122], 40.00th=[  136], 50.00th=[  153], 60.00th=[  169],
     | 70.00th=[  186], 80.00th=[  211], 90.00th=[  275], 95.00th=[  334],
     | 99.00th=[  506], 99.50th=[  527], 99.90th=[  542], 99.95th=[  542],
     | 99.99th=[  542]
   bw (  KiB/s): min=   30, max=  159, per=26.19%, avg=75.96, stdev=33.14, samples=165
   iops        : min=    1, max=    9, avg= 3.97, stdev= 2.16, samples=165
  lat (msec)   : 10=0.65%, 20=8.20%, 50=25.91%, 100=15.10%, 250=44.27%
  lat (msec)   : 500=5.34%, 750=0.52%
  cpu          : usr=0.05%, sys=1.03%, ctx=1297, majf=0, minf=14
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144206: Wed Aug 26 07:52:14 2026
  read: IOPS=4, BW=66.1KiB/s (67.7kB/s)(5744KiB/86847msec)
    clat (msec): min=8, max=271, avg=49.98, stdev=43.85
     lat (msec): min=8, max=271, avg=49.98, stdev=43.85
    clat percentiles (msec):
     |  1.00th=[   10],  5.00th=[   13], 10.00th=[   16], 20.00th=[   21],
     | 30.00th=[   25], 40.00th=[   30], 50.00th=[   35], 60.00th=[   42],
     | 70.00th=[   52], 80.00th=[   75], 90.00th=[  109], 95.00th=[  144],
     | 99.00th=[  226], 99.50th=[  236], 99.90th=[  271], 99.95th=[  271],
     | 99.99th=[  271]
   bw (  KiB/s): min=   30, max=  349, per=30.55%, avg=84.01, stdev=55.25, samples=135
   iops        : min=    1, max=   21, avg= 4.48, stdev= 3.47, samples=135
  write: IOPS=4, BW=75.4KiB/s (77.2kB/s)(6544KiB/86847msec); 0 zone resets
    clat (msec): min=38, max=533, avg=167.97, stdev=77.39
     lat (msec): min=38, max=533, avg=167.98, stdev=77.39
    clat percentiles (msec):
     |  1.00th=[   56],  5.00th=[   72], 10.00th=[   86], 20.00th=[  111],
     | 30.00th=[  126], 40.00th=[  138], 50.00th=[  148], 60.00th=[  165],
     | 70.00th=[  190], 80.00th=[  220], 90.00th=[  271], 95.00th=[  321],
     | 99.00th=[  422], 99.50th=[  456], 99.90th=[  535], 99.95th=[  535],
     | 99.99th=[  535]
   bw (  KiB/s): min=   30, max=  222, per=26.60%, avg=77.15, stdev=34.88, samples=167
   iops        : min=    1, max=   13, avg= 4.07, stdev= 2.28, samples=167
  lat (msec)   : 10=0.65%, 20=7.81%, 50=24.22%, 100=16.80%, 250=43.36%
  lat (msec)   : 500=7.03%, 750=0.13%
  cpu          : usr=0.04%, sys=1.01%, ctx=1279, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144207: Wed Aug 26 07:52:14 2026
  read: IOPS=4, BW=75.7KiB/s (77.5kB/s)(6256KiB/82687msec)
    clat (msec): min=7, max=223, avg=45.30, stdev=36.06
     lat (msec): min=7, max=223, avg=45.31, stdev=36.06
    clat percentiles (msec):
     |  1.00th=[   11],  5.00th=[   13], 10.00th=[   17], 20.00th=[   22],
     | 30.00th=[   26], 40.00th=[   29], 50.00th=[   33], 60.00th=[   41],
     | 70.00th=[   50], 80.00th=[   61], 90.00th=[   88], 95.00th=[  132],
     | 99.00th=[  194], 99.50th=[  211], 99.90th=[  224], 99.95th=[  224],
     | 99.99th=[  224]
   bw (  KiB/s): min=   30, max=  256, per=31.89%, avg=87.71, stdev=57.80, samples=141
   iops        : min=    1, max=   16, avg= 4.72, stdev= 3.65, samples=141
  write: IOPS=4, BW=72.9KiB/s (74.7kB/s)(6032KiB/82687msec); 0 zone resets
    clat (msec): min=47, max=615, avg=171.76, stdev=87.39
     lat (msec): min=47, max=615, avg=171.77, stdev=87.39
    clat percentiles (msec):
     |  1.00th=[   62],  5.00th=[   78], 10.00th=[   92], 20.00th=[  108],
     | 30.00th=[  123], 40.00th=[  136], 50.00th=[  150], 60.00th=[  167],
     | 70.00th=[  192], 80.00th=[  215], 90.00th=[  279], 95.00th=[  363],
     | 99.00th=[  514], 99.50th=[  550], 99.90th=[  617], 99.95th=[  617],
     | 99.99th=[  617]
   bw (  KiB/s): min=   30, max=  159, per=25.38%, avg=73.60, stdev=31.04, samples=160
   iops        : min=    1, max=    9, avg= 3.82, stdev= 2.01, samples=160
  lat (msec)   : 10=0.52%, 20=8.46%, 50=27.34%, 100=17.45%, 250=38.93%
  lat (msec)   : 500=6.77%, 750=0.52%
  cpu          : usr=0.03%, sys=1.16%, ctx=1361, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144210: Wed Aug 26 07:52:14 2026
  read: IOPS=4, BW=70.2KiB/s (71.9kB/s)(6032KiB/85966msec)
    clat (msec): min=7, max=306, avg=51.09, stdev=46.92
     lat (msec): min=7, max=306, avg=51.09, stdev=46.92
    clat percentiles (msec):
     |  1.00th=[    9],  5.00th=[   14], 10.00th=[   17], 20.00th=[   21],
     | 30.00th=[   24], 40.00th=[   29], 50.00th=[   34], 60.00th=[   44],
     | 70.00th=[   53], 80.00th=[   70], 90.00th=[  109], 95.00th=[  161],
     | 99.00th=[  232], 99.50th=[  239], 99.90th=[  309], 99.95th=[  309],
     | 99.99th=[  309]
   bw (  KiB/s): min=   30, max=  287, per=30.63%, avg=84.23, stdev=54.94, samples=140
   iops        : min=    1, max=   17, avg= 4.50, stdev= 3.47, samples=140
  write: IOPS=4, BW=72.8KiB/s (74.5kB/s)(6256KiB/85966msec); 0 zone resets
    clat (msec): min=51, max=563, avg=170.17, stdev=86.33
     lat (msec): min=51, max=563, avg=170.17, stdev=86.33
    clat percentiles (msec):
     |  1.00th=[   58],  5.00th=[   79], 10.00th=[   91], 20.00th=[  107],
     | 30.00th=[  120], 40.00th=[  133], 50.00th=[  146], 60.00th=[  159],
     | 70.00th=[  190], 80.00th=[  220], 90.00th=[  279], 95.00th=[  363],
     | 99.00th=[  485], 99.50th=[  558], 99.90th=[  567], 99.95th=[  567],
     | 99.99th=[  567]
   bw (  KiB/s): min=   30, max=  160, per=25.68%, avg=74.47, stdev=32.99, samples=165
   iops        : min=    1, max=   10, avg= 3.88, stdev= 2.16, samples=165
  lat (msec)   : 10=0.91%, 20=8.07%, 50=24.48%, 100=17.06%, 250=42.19%
  lat (msec)   : 500=6.90%, 750=0.39%
  cpu          : usr=0.02%, sys=1.11%, ctx=1357, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=276KiB/s (282kB/s), 66.1KiB/s-75.7KiB/s (67.7kB/s-77.5kB/s), io=23.4MiB (24.5MB), run=82687-86847msec
  WRITE: bw=290KiB/s (297kB/s), 72.8KiB/s-75.4KiB/s (74.5kB/s-77.2kB/s), io=24.6MiB (25.8MB), run=82687-86847msec
mix direct rw 1048576 by fio with 4 jobs...
mix buffer rw 1048576 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=144240: Wed Aug 26 07:52:32 2026
  read: IOPS=1, BW=1987KiB/s (2034kB/s)(7168KiB/3608msec)
    clat (usec): min=513, max=420385, avg=233570.29, stdev=154787.24
     lat (usec): min=514, max=420387, avg=233571.71, stdev=154787.36
    clat percentiles (usec):
     |  1.00th=[   515],  5.00th=[   515], 10.00th=[   515], 20.00th=[ 62129],
     | 30.00th=[238027], 40.00th=[238027], 50.00th=[238027], 60.00th=[299893],
     | 70.00th=[299893], 80.00th=[375391], 90.00th=[421528], 95.00th=[421528],
     | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528],
     | 99.99th=[421528]
   bw (  KiB/s): min= 1841, max= 4087, per=63.16%, avg=3001.50, stdev=1241.64, samples=4
   iops        : min=    1, max=    3, avg= 2.00, stdev= 1.15, samples=4
  write: IOPS=1, BW=1419KiB/s (1453kB/s)(5120KiB/3608msec); 0 zone resets
    clat (msec): min=274, max=511, avg=394.09, stdev=98.97
     lat (msec): min=274, max=511, avg=394.15, stdev=98.95
    clat percentiles (msec):
     |  1.00th=[  275],  5.00th=[  275], 10.00th=[  275], 20.00th=[  275],
     | 30.00th=[  321], 40.00th=[  321], 50.00th=[  393], 60.00th=[  393],
     | 70.00th=[  472], 80.00th=[  472], 90.00th=[  510], 95.00th=[  510],
     | 99.00th=[  510], 99.50th=[  510], 99.90th=[  510], 99.95th=[  510],
     | 99.99th=[  510]
   bw (  KiB/s): min= 2023, max= 4087, per=40.83%, avg=2716.33, stdev=1187.06, samples=3
   iops        : min=    1, max=    3, avg= 1.67, stdev= 1.15, samples=3
  lat (usec)   : 750=8.33%
  lat (msec)   : 100=8.33%, 250=16.67%, 500=58.33%, 750=8.33%
  cpu          : usr=0.00%, sys=11.64%, ctx=179, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144241: Wed Aug 26 07:52:32 2026
  read: IOPS=0, BW=475KiB/s (487kB/s)(2048KiB/4309msec)
    clat (usec): min=322481, max=323331, avg=322906.31, stdev=600.77
     lat (usec): min=322483, max=323332, avg=322908.01, stdev=600.69
    clat percentiles (msec):
     |  1.00th=[  321],  5.00th=[  321], 10.00th=[  321], 20.00th=[  321],
     | 30.00th=[  321], 40.00th=[  321], 50.00th=[  321], 60.00th=[  326],
     | 70.00th=[  326], 80.00th=[  326], 90.00th=[  326], 95.00th=[  326],
     | 99.00th=[  326], 99.50th=[  326], 99.90th=[  326], 99.95th=[  326],
     | 99.99th=[  326]
   bw (  KiB/s): min= 1762, max= 2043, per=40.04%, avg=1902.50, stdev=198.70, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  write: IOPS=2, BW=2376KiB/s (2433kB/s)(10.0MiB/4309msec); 0 zone resets
    clat (msec): min=135, max=844, avg=366.02, stdev=271.42
     lat (msec): min=135, max=844, avg=366.18, stdev=271.40
    clat percentiles (msec):
     |  1.00th=[  136],  5.00th=[  136], 10.00th=[  136], 20.00th=[  136],
     | 30.00th=[  182], 40.00th=[  205], 50.00th=[  220], 60.00th=[  236],
     | 70.00th=[  300], 80.00th=[  701], 90.00th=[  709], 95.00th=[  844],
     | 99.00th=[  844], 99.50th=[  844], 99.90th=[  844], 99.95th=[  844],
     | 99.99th=[  844]
   bw (  KiB/s): min= 1762, max= 4087, per=45.17%, avg=3004.83, stdev=1172.03, samples=6
   iops        : min=    1, max=    3, avg= 2.00, stdev= 1.10, samples=6
  lat (msec)   : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33%
  cpu          : usr=0.00%, sys=10.24%, ctx=114, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144242: Wed Aug 26 07:52:32 2026
  read: IOPS=1, BW=1544KiB/s (1581kB/s)(6144KiB/3980msec)
    clat (usec): min=734, max=470776, avg=199452.06, stdev=191917.93
     lat (usec): min=735, max=470777, avg=199453.24, stdev=191917.82
    clat percentiles (usec):
     |  1.00th=[   734],  5.00th=[   734], 10.00th=[   734], 20.00th=[  2900],
     | 30.00th=[  2900], 40.00th=[117965], 50.00th=[117965], 60.00th=[254804],
     | 70.00th=[350225], 80.00th=[350225], 90.00th=[471860], 95.00th=[471860],
     | 99.00th=[471860], 99.50th=[471860], 99.90th=[471860], 99.95th=[471860],
     | 99.99th=[471860]
   bw (  KiB/s): min= 2015, max= 4087, per=53.49%, avg=2542.00, stdev=1030.07, samples=4
   iops        : min=    1, max=    3, avg= 1.50, stdev= 1.00, samples=4
  write: IOPS=1, BW=1544KiB/s (1581kB/s)(6144KiB/3980msec); 0 zone resets
    clat (msec): min=294, max=786, avg=463.56, stdev=183.74
     lat (msec): min=295, max=786, avg=463.64, stdev=183.74
    clat percentiles (msec):
     |  1.00th=[  296],  5.00th=[  296], 10.00th=[  296], 20.00th=[  296],
     | 30.00th=[  296], 40.00th=[  414], 50.00th=[  414], 60.00th=[  460],
     | 70.00th=[  535], 80.00th=[  535], 90.00th=[  785], 95.00th=[  785],
     | 99.00th=[  785], 99.50th=[  785], 99.90th=[  785], 99.95th=[  785],
     | 99.99th=[  785]
   bw (  KiB/s): min= 1796, max= 2039, per=29.77%, avg=1980.80, stdev=103.69, samples=5
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=5
  lat (usec)   : 750=8.33%
  lat (msec)   : 4=8.33%, 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33%
  cpu          : usr=0.00%, sys=8.82%, ctx=120, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144243: Wed Aug 26 07:52:32 2026
  read: IOPS=1, BW=1380KiB/s (1413kB/s)(5120KiB/3710msec)
    clat (usec): min=1040, max=240130, avg=77081.07, stdev=109320.09
     lat (usec): min=1042, max=240132, avg=77082.33, stdev=109320.25
    clat percentiles (usec):
     |  1.00th=[  1045],  5.00th=[  1045], 10.00th=[  1045], 20.00th=[  1045],
     | 30.00th=[  1483], 40.00th=[  1483], 50.00th=[  1893], 60.00th=[  1893],
     | 70.00th=[141558], 80.00th=[141558], 90.00th=[240124], 95.00th=[240124],
     | 99.00th=[240124], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124],
     | 99.99th=[240124]
   bw (  KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1
   iops        : min=    7, max=    7, avg= 7.00, stdev= 0.00, samples=1
  write: IOPS=1, BW=1932KiB/s (1978kB/s)(7168KiB/3710msec); 0 zone resets
    clat (msec): min=222, max=924, avg=474.72, stdev=255.38
     lat (msec): min=222, max=925, avg=474.79, stdev=255.40
    clat percentiles (msec):
     |  1.00th=[  224],  5.00th=[  224], 10.00th=[  224], 20.00th=[  236],
     | 30.00th=[  305], 40.00th=[  305], 50.00th=[  418], 60.00th=[  609],
     | 70.00th=[  609], 80.00th=[  609], 90.00th=[  927], 95.00th=[  927],
     | 99.00th=[  927], 99.50th=[  927], 99.90th=[  927], 99.95th=[  927],
     | 99.99th=[  927]
   bw (  KiB/s): min= 1889, max= 4031, per=36.21%, avg=2409.00, stdev=909.13, samples=5
   iops        : min=    1, max=    3, avg= 1.40, stdev= 0.89, samples=5
  lat (msec)   : 2=25.00%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=8.33%
  cpu          : usr=0.00%, sys=10.03%, ctx=110, majf=0, minf=13
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=4753KiB/s (4867kB/s), 475KiB/s-1987KiB/s (487kB/s-2034kB/s), io=20.0MiB (20.0MB), run=3608-4309msec
  WRITE: bw=6654KiB/s (6814kB/s), 1419KiB/s-2376KiB/s (1453kB/s-2433kB/s), io=28.0MiB (29.4MB), run=3608-4309msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=144235: Wed Aug 26 07:52:32 2026
  read: IOPS=2, BW=2123KiB/s (2174kB/s)(7168KiB/3376msec)
    clat (msec): min=103, max=419, avg=189.35, stdev=113.81
     lat (msec): min=103, max=419, avg=189.35, stdev=113.81
    clat percentiles (msec):
     |  1.00th=[  105],  5.00th=[  105], 10.00th=[  105], 20.00th=[  105],
     | 30.00th=[  118], 40.00th=[  118], 50.00th=[  153], 60.00th=[  176],
     | 70.00th=[  176], 80.00th=[  251], 90.00th=[  418], 95.00th=[  418],
     | 99.00th=[  418], 99.50th=[  418], 99.90th=[  418], 99.95th=[  418],
     | 99.99th=[  418]
   bw (  KiB/s): min= 1783, max= 4101, per=63.47%, avg=2462.75, stdev=1097.32, samples=4
   iops        : min=    1, max=    4, avg= 1.75, stdev= 1.50, samples=4
  write: IOPS=1, BW=1517KiB/s (1553kB/s)(5120KiB/3376msec); 0 zone resets
    clat (msec): min=266, max=642, avg=396.24, stdev=144.31
     lat (msec): min=266, max=642, avg=396.32, stdev=144.32
    clat percentiles (msec):
     |  1.00th=[  268],  5.00th=[  268], 10.00th=[  268], 20.00th=[  268],
     | 30.00th=[  330], 40.00th=[  330], 50.00th=[  359], 60.00th=[  359],
     | 70.00th=[  388], 80.00th=[  388], 90.00th=[  642], 95.00th=[  642],
     | 99.00th=[  642], 99.50th=[  642], 99.90th=[  642], 99.95th=[  642],
     | 99.99th=[  642]
   bw (  KiB/s): min= 1783, max= 2043, per=35.99%, avg=1955.40, stdev=106.94, samples=5
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=5
  lat (msec)   : 250=41.67%, 500=50.00%, 750=8.33%
  cpu          : usr=0.06%, sys=4.18%, ctx=58, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144236: Wed Aug 26 07:52:32 2026
  read: IOPS=0, BW=399KiB/s (409kB/s)(2048KiB/5127msec)
    clat (msec): min=125, max=627, avg=376.17, stdev=355.01
     lat (msec): min=125, max=627, avg=376.17, stdev=355.01
    clat percentiles (msec):
     |  1.00th=[  126],  5.00th=[  126], 10.00th=[  126], 20.00th=[  126],
     | 30.00th=[  126], 40.00th=[  126], 50.00th=[  126], 60.00th=[  625],
     | 70.00th=[  625], 80.00th=[  625], 90.00th=[  625], 95.00th=[  625],
     | 99.00th=[  625], 99.50th=[  625], 99.90th=[  625], 99.95th=[  625],
     | 99.99th=[  625]
   bw (  KiB/s): min= 1595, max= 2031, per=46.73%, avg=1813.00, stdev=308.30, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  write: IOPS=1, BW=1997KiB/s (2045kB/s)(10.0MiB/5127msec); 0 zone resets
    clat (msec): min=232, max=788, avg=437.04, stdev=187.77
     lat (msec): min=233, max=788, avg=437.14, stdev=187.77
    clat percentiles (msec):
     |  1.00th=[  234],  5.00th=[  234], 10.00th=[  234], 20.00th=[  266],
     | 30.00th=[  288], 40.00th=[  296], 50.00th=[  300], 60.00th=[  485],
     | 70.00th=[  510], 80.00th=[  584], 90.00th=[  617], 95.00th=[  785],
     | 99.00th=[  785], 99.50th=[  785], 99.90th=[  785], 99.95th=[  785],
     | 99.99th=[  785]
   bw (  KiB/s): min= 1595, max= 3849, per=40.20%, avg=2184.14, stdev=752.23, samples=7
   iops        : min=    1, max=    3, avg= 1.29, stdev= 0.76, samples=7
  lat (msec)   : 250=16.67%, 500=41.67%, 750=33.33%, 1000=8.33%
  cpu          : usr=0.00%, sys=3.43%, ctx=73, majf=0, minf=12
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144237: Wed Aug 26 07:52:32 2026
  read: IOPS=1, BW=1287KiB/s (1318kB/s)(6144KiB/4774msec)
    clat (msec): min=168, max=552, avg=345.14, stdev=175.31
     lat (msec): min=168, max=552, avg=345.14, stdev=175.31
    clat percentiles (msec):
     |  1.00th=[  169],  5.00th=[  169], 10.00th=[  169], 20.00th=[  182],
     | 30.00th=[  182], 40.00th=[  241], 50.00th=[  241], 60.00th=[  384],
     | 70.00th=[  542], 80.00th=[  542], 90.00th=[  550], 95.00th=[  550],
     | 99.00th=[  550], 99.50th=[  550], 99.90th=[  550], 99.95th=[  550],
     | 99.99th=[  550]
   bw (  KiB/s): min= 1924, max= 2031, per=51.43%, avg=1995.60, stdev=43.68, samples=5
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=5
  write: IOPS=1, BW=1287KiB/s (1318kB/s)(6144KiB/4774msec); 0 zone resets
    clat (msec): min=223, max=844, avg=447.76, stdev=248.17
     lat (msec): min=223, max=844, avg=447.99, stdev=248.12
    clat percentiles (msec):
     |  1.00th=[  224],  5.00th=[  224], 10.00th=[  224], 20.00th=[  296],
     | 30.00th=[  296], 40.00th=[  296], 50.00th=[  296], 60.00th=[  363],
     | 70.00th=[  667], 80.00th=[  667], 90.00th=[  844], 95.00th=[  844],
     | 99.00th=[  844], 99.50th=[  844], 99.90th=[  844], 99.95th=[  844],
     | 99.99th=[  844]
   bw (  KiB/s): min= 1783, max= 3079, per=40.41%, avg=2195.50, stdev=595.61, samples=4
   iops        : min=    1, max=    3, avg= 1.50, stdev= 1.00, samples=4
  lat (msec)   : 250=33.33%, 500=33.33%, 750=25.00%, 1000=8.33%
  cpu          : usr=0.00%, sys=2.98%, ctx=79, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144238: Wed Aug 26 07:52:32 2026
  read: IOPS=0, BW=970KiB/s (994kB/s)(5120KiB/5277msec)
    clat (msec): min=141, max=671, avg=322.16, stdev=231.30
     lat (msec): min=141, max=671, avg=322.16, stdev=231.30
    clat percentiles (msec):
     |  1.00th=[  142],  5.00th=[  142], 10.00th=[  142], 20.00th=[  142],
     | 30.00th=[  165], 40.00th=[  165], 50.00th=[  186], 60.00th=[  186],
     | 70.00th=[  447], 80.00th=[  447], 90.00th=[  676], 95.00th=[  676],
     | 99.00th=[  676], 99.50th=[  676], 99.90th=[  676], 99.95th=[  676],
     | 99.99th=[  676]
   bw (  KiB/s): min= 4063, max= 4063, per=100.00%, avg=4063.00, stdev= 0.00, samples=2
   iops        : min=    3, max=    3, avg= 3.00, stdev= 0.00, samples=2
  write: IOPS=1, BW=1358KiB/s (1391kB/s)(7168KiB/5277msec); 0 zone resets
    clat (msec): min=176, max=1017, avg=516.78, stdev=332.53
     lat (msec): min=176, max=1017, avg=517.07, stdev=332.77
    clat percentiles (msec):
     |  1.00th=[  178],  5.00th=[  178], 10.00th=[  178], 20.00th=[  228],
     | 30.00th=[  338], 40.00th=[  338], 50.00th=[  372], 60.00th=[  575],
     | 70.00th=[  575], 80.00th=[  911], 90.00th=[ 1020], 95.00th=[ 1020],
     | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020],
     | 99.99th=[ 1020]
   bw (  KiB/s): min= 1481, max= 2043, per=34.12%, avg=1854.00, stdev=234.00, samples=5
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=5
  lat (msec)   : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33%
  cpu          : usr=0.02%, sys=2.10%, ctx=49, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3881KiB/s (3974kB/s), 399KiB/s-2123KiB/s (409kB/s-2174kB/s), io=20.0MiB (20.0MB), run=3376-5277msec
  WRITE: bw=5433KiB/s (5564kB/s), 1287KiB/s-1997KiB/s (1318kB/s-2045kB/s), io=28.0MiB (29.4MB), run=3376-5277msec
mix direct rw 4194304 by fio with 4 jobs...
mix buffer rw 4194304 by fio with 4 jobs...
rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes
rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16
...
fio-3.19
Starting 4 processes

rand-rw: (groupid=0, jobs=1): err= 0: pid=144254: Wed Aug 26 07:52:53 2026
  read: IOPS=0, BW=2668KiB/s (2732kB/s)(12.0MiB/4606msec)
    clat (msec): min=382, max=2381, avg=1512.78, stdev=1024.55
     lat (msec): min=382, max=2381, avg=1512.78, stdev=1024.55
    clat percentiles (msec):
     |  1.00th=[  384],  5.00th=[  384], 10.00th=[  384], 20.00th=[  384],
     | 30.00th=[  384], 40.00th=[ 1770], 50.00th=[ 1770], 60.00th=[ 1770],
     | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366],
     | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366],
     | 99.99th=[ 2366]
   bw (  KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  lat (msec)   : 500=33.33%, 2000=33.33%, >=2000=33.33%
  cpu          : usr=0.00%, sys=1.56%, ctx=52, majf=0, minf=9
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144255: Wed Aug 26 07:52:53 2026
  read: IOPS=0, BW=800KiB/s (819kB/s)(4096KiB/5119msec)
    clat (nsec): min=2007.2M, max=2007.2M, avg=2007246206.00, stdev= 0.00
     lat (nsec): min=2007.2M, max=2007.2M, avg=2007249166.00, stdev= 0.00
    clat percentiles (msec):
     |  1.00th=[ 2005],  5.00th=[ 2005], 10.00th=[ 2005], 20.00th=[ 2005],
     | 30.00th=[ 2005], 40.00th=[ 2005], 50.00th=[ 2005], 60.00th=[ 2005],
     | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005],
     | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005],
     | 99.99th=[ 2005]
   bw (  KiB/s): min= 7420, max= 7420, per=100.00%, avg=7420.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  write: IOPS=0, BW=1600KiB/s (1639kB/s)(8192KiB/5119msec); 0 zone resets
    clat (msec): min=636, max=2279, avg=1458.06, stdev=1162.25
     lat (msec): min=636, max=2280, avg=1458.63, stdev=1162.35
    clat percentiles (msec):
     |  1.00th=[  634],  5.00th=[  634], 10.00th=[  634], 20.00th=[  634],
     | 30.00th=[  634], 40.00th=[  634], 50.00th=[  634], 60.00th=[ 2265],
     | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265],
     | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265],
     | 99.99th=[ 2265]
   bw (  KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  lat (msec)   : 750=33.33%, >=2000=66.67%
  cpu          : usr=0.00%, sys=2.19%, ctx=65, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144256: Wed Aug 26 07:52:53 2026
  write: IOPS=0, BW=2063KiB/s (2113kB/s)(12.0MiB/5955msec); 0 zone resets
    clat (msec): min=487, max=2730, avg=1924.43, stdev=1247.78
     lat (msec): min=487, max=2731, avg=1926.06, stdev=1248.42
    clat percentiles (msec):
     |  1.00th=[  489],  5.00th=[  489], 10.00th=[  489], 20.00th=[  489],
     | 30.00th=[  489], 40.00th=[ 2567], 50.00th=[ 2567], 60.00th=[ 2567],
     | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735],
     | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735],
     | 99.99th=[ 2735]
   bw (  KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  lat (msec)   : 500=33.33%, >=2000=66.67%
  cpu          : usr=0.00%, sys=2.65%, ctx=60, majf=0, minf=8
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144257: Wed Aug 26 07:52:53 2026
  write: IOPS=0, BW=2439KiB/s (2498kB/s)(12.0MiB/5038msec); 0 zone resets
    clat (msec): min=1546, max=1739, avg=1628.70, stdev=99.72
     lat (msec): min=1547, max=1740, avg=1629.05, stdev=99.70
    clat percentiles (msec):
     |  1.00th=[ 1552],  5.00th=[ 1552], 10.00th=[ 1552], 20.00th=[ 1552],
     | 30.00th=[ 1552], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603],
     | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737],
     | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737],
     | 99.99th=[ 1737]
   bw (  KiB/s): min= 8126, max= 8159, per=100.00%, avg=8142.50, stdev=23.33, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  lat (msec)   : 2000=100.00%
  cpu          : usr=0.00%, sys=3.63%, ctx=73, majf=0, minf=8
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3201KiB/s (3277kB/s), 800KiB/s-2668KiB/s (819kB/s-2732kB/s), io=16.0MiB (16.8MB), run=4606-5119msec
  WRITE: bw=5503KiB/s (5635kB/s), 1600KiB/s-2439KiB/s (1639kB/s-2498kB/s), io=32.0MiB (33.6MB), run=5038-5955msec

rand-rw: (groupid=0, jobs=1): err= 0: pid=144249: Wed Aug 26 07:52:53 2026
  read: IOPS=0, BW=2733KiB/s (2799kB/s)(12.0MiB/4496msec)
    clat (msec): min=1162, max=1919, avg=1487.58, stdev=389.35
     lat (msec): min=1162, max=1919, avg=1487.58, stdev=389.35
    clat percentiles (msec):
     |  1.00th=[ 1167],  5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167],
     | 30.00th=[ 1167], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385],
     | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921],
     | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921],
     | 99.99th=[ 1921]
   bw (  KiB/s): min= 7846, max= 8175, per=100.00%, avg=8010.50, stdev=232.64, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  lat (msec)   : 2000=100.00%
  cpu          : usr=0.00%, sys=6.52%, ctx=219, majf=0, minf=9
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144250: Wed Aug 26 07:52:53 2026
  read: IOPS=0, BW=805KiB/s (824kB/s)(4096KiB/5090msec)
    clat (nsec): min=1943.5M, max=1943.5M, avg=1943487624.00, stdev= 0.00
     lat (nsec): min=1943.5M, max=1943.5M, avg=1943489772.00, stdev= 0.00
    clat percentiles (msec):
     |  1.00th=[ 1938],  5.00th=[ 1938], 10.00th=[ 1938], 20.00th=[ 1938],
     | 30.00th=[ 1938], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938],
     | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938],
     | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938],
     | 99.99th=[ 1938]
   bw (  KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  write: IOPS=0, BW=1609KiB/s (1648kB/s)(8192KiB/5090msec); 0 zone resets
    clat (msec): min=614, max=2452, avg=1533.43, stdev=1300.03
     lat (msec): min=614, max=2472, avg=1543.70, stdev=1313.94
    clat percentiles (msec):
     |  1.00th=[  617],  5.00th=[  617], 10.00th=[  617], 20.00th=[  617],
     | 30.00th=[  617], 40.00th=[  617], 50.00th=[  617], 60.00th=[ 2467],
     | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467],
     | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467],
     | 99.99th=[ 2467]
   bw (  KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  lat (msec)   : 750=33.33%, 2000=33.33%, >=2000=33.33%
  cpu          : usr=0.00%, sys=3.65%, ctx=126, majf=0, minf=11
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144252: Wed Aug 26 07:52:53 2026
  write: IOPS=0, BW=1844KiB/s (1888kB/s)(12.0MiB/6663msec); 0 zone resets
    clat (msec): min=339, max=4262, avg=2170.01, stdev=1974.77
     lat (msec): min=340, max=4263, avg=2170.64, stdev=1974.75
    clat percentiles (msec):
     |  1.00th=[  342],  5.00th=[  342], 10.00th=[  342], 20.00th=[  342],
     | 30.00th=[  342], 40.00th=[ 1905], 50.00th=[ 1905], 60.00th=[ 1905],
     | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279],
     | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279],
     | 99.99th=[ 4279]
   bw (  KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=1
  lat (msec)   : 500=33.33%, 2000=33.33%, >=2000=33.33%
  cpu          : usr=0.00%, sys=1.82%, ctx=49, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16
rand-rw: (groupid=0, jobs=1): err= 0: pid=144253: Wed Aug 26 07:52:53 2026
  write: IOPS=0, BW=2507KiB/s (2567kB/s)(12.0MiB/4901msec); 0 zone resets
    clat (msec): min=587, max=2899, avg=1593.87, stdev=1184.55
     lat (msec): min=587, max=2899, avg=1594.26, stdev=1184.54
    clat percentiles (msec):
     |  1.00th=[  592],  5.00th=[  592], 10.00th=[  592], 20.00th=[  592],
     | 30.00th=[  592], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301],
     | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903],
     | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903],
     | 99.99th=[ 2903]
   bw (  KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=2
   iops        : min=    1, max=    1, avg= 1.00, stdev= 0.00, samples=2
  lat (msec)   : 750=33.33%, 2000=33.33%, >=2000=33.33%
  cpu          : usr=0.02%, sys=2.69%, ctx=53, majf=0, minf=10
  IO depths    : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0%
     submit    : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     complete  : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0%
     issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0
     latency   : target=0, window=0, percentile=100.00%, depth=16

Run status group 0 (all jobs):
   READ: bw=3219KiB/s (3296kB/s), 805KiB/s-2733KiB/s (824kB/s-2799kB/s), io=16.0MiB (16.8MB), run=4496-5090msec
  WRITE: bw=4918KiB/s (5036kB/s), 1609KiB/s-2507KiB/s (1648kB/s-2567kB/s), io=32.0MiB (33.6MB), run=4901-6663msec