== sanity test 398b: DIO and buffer IO race ============== 21:53:54 (1767322434) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.46487 s, 9.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185588: Thu Jan 1 21:55:41 2026 read: IOPS=16, BW=66.4KiB/s (67.0kB/s)(5992KiB/90239msec) clat (usec): min=80, max=409753, avg=33858.78, stdev=22980.81 lat (usec): min=80, max=409754, avg=33860.58, stdev=22981.76 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 9241], 10.00th=[ 13829], 20.00th=[ 17957], | 30.00th=[ 21365], 40.00th=[ 25560], 50.00th=[ 30016], 60.00th=[ 34866], | 70.00th=[ 39584], 80.00th=[ 47973], 90.00th=[ 58459], 95.00th=[ 68682], | 99.00th=[110625], 99.50th=[121111], 99.90th=[242222], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 15, max= 119, per=24.93%, avg=65.81, stdev=19.98, samples=178 iops : min= 3, max= 29, avg=15.82, stdev= 5.03, samples=178 write: IOPS=17, BW=69.8KiB/s (71.4kB/s)(6296KiB/90239msec); 0 zone resets clat (usec): min=709, max=212198, avg=25025.09, stdev=25723.87 lat (usec): min=709, max=212198, avg=25031.37, stdev=25724.73 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 1106], 10.00th=[ 1237], 20.00th=[ 2278], | 30.00th=[ 5080], 40.00th=[ 12518], 50.00th=[ 19006], 60.00th=[ 24511], | 70.00th=[ 32375], 80.00th=[ 43254], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[116917], 99.50th=[128451], 99.90th=[158335], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 167, per=24.97%, avg=69.17, stdev=25.32, samples=178 iops : min= 1, max= 41, avg=16.67, stdev= 6.38, samples=178 lat (usec) : 100=0.03%, 250=1.53%, 500=0.16%, 750=0.10%, 1000=0.78% lat (msec) : 2=8.30%, 4=4.75%, 10=6.22%, 20=17.55%, 50=44.37% lat (msec) : 100=14.58%, 250=1.60%, 500=0.03% cpu : usr=0.08%, sys=6.08%, ctx=6425, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185589: Thu Jan 1 21:55:41 2026 read: IOPS=16, BW=66.4KiB/s (67.0kB/s)(5940KiB/89502msec) clat (usec): min=80, max=386607, avg=33906.23, stdev=22747.53 lat (usec): min=80, max=386609, avg=33910.42, stdev=22747.09 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 10290], 10.00th=[ 13698], 20.00th=[ 17957], | 30.00th=[ 21627], 40.00th=[ 25035], 50.00th=[ 29492], 60.00th=[ 33817], | 70.00th=[ 40109], 80.00th=[ 47973], 90.00th=[ 58459], 95.00th=[ 68682], | 99.00th=[106431], 99.50th=[133694], 99.90th=[185598], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 112, per=24.93%, avg=65.81, stdev=20.56, samples=177 iops : min= 1, max= 28, avg=15.82, stdev= 5.19, samples=177 write: IOPS=17, BW=70.9KiB/s (72.6kB/s)(6348KiB/89502msec); 0 zone resets clat (usec): min=700, max=237803, avg=24590.15, stdev=25518.11 lat (usec): min=701, max=237803, avg=24592.02, stdev=25518.69 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 1123], 10.00th=[ 1237], 20.00th=[ 2671], | 30.00th=[ 4817], 40.00th=[ 11338], 50.00th=[ 18220], 60.00th=[ 24249], | 70.00th=[ 31327], 80.00th=[ 41681], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[108528], 99.50th=[128451], 99.90th=[158335], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 165, per=25.33%, avg=70.17, stdev=25.44, samples=177 iops : min= 1, max= 41, avg=16.93, stdev= 6.44, samples=177 lat (usec) : 100=0.07%, 250=1.14%, 500=0.16%, 750=0.07%, 1000=0.68% lat (msec) : 2=7.91%, 4=5.37%, 10=6.61%, 20=17.61%, 50=43.59% lat (msec) : 100=15.53%, 250=1.24%, 500=0.03% cpu : usr=0.09%, sys=6.10%, ctx=6407, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185590: Thu Jan 1 21:55:41 2026 read: IOPS=16, BW=66.5KiB/s (68.1kB/s)(6028KiB/90619msec) clat (usec): min=102, max=231259, avg=32917.76, stdev=21228.52 lat (usec): min=102, max=231259, avg=32918.93, stdev=21228.54 clat percentiles (usec): | 1.00th=[ 161], 5.00th=[ 9634], 10.00th=[ 13173], 20.00th=[ 16909], | 30.00th=[ 20317], 40.00th=[ 23987], 50.00th=[ 28967], 60.00th=[ 33817], | 70.00th=[ 39060], 80.00th=[ 46924], 90.00th=[ 58459], 95.00th=[ 68682], | 99.00th=[109577], 99.50th=[127402], 99.90th=[185598], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 23, max= 151, per=24.98%, avg=65.94, stdev=21.07, samples=178 iops : min= 5, max= 37, avg=15.87, stdev= 5.30, samples=178 write: IOPS=17, BW=69.1KiB/s (70.7kB/s)(6260KiB/90619msec); 0 zone resets clat (usec): min=762, max=412642, avg=26147.01, stdev=27962.12 lat (usec): min=762, max=412643, avg=26149.71, stdev=27961.62 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1139], 10.00th=[ 1303], 20.00th=[ 2638], | 30.00th=[ 5604], 40.00th=[ 12649], 50.00th=[ 20055], 60.00th=[ 25297], | 70.00th=[ 34341], 80.00th=[ 45351], 90.00th=[ 60031], 95.00th=[ 77071], | 99.00th=[115868], 99.50th=[126354], 99.90th=[235930], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 15, max= 175, per=24.56%, avg=68.03, stdev=25.29, samples=179 iops : min= 3, max= 43, avg=16.39, stdev= 6.35, samples=179 lat (usec) : 250=1.24%, 500=0.39%, 750=0.07%, 1000=0.55% lat (msec) : 2=7.91%, 4=4.75%, 10=6.41%, 20=18.65%, 50=43.78% lat (msec) : 100=14.78%, 250=1.43%, 500=0.03% cpu : usr=0.10%, sys=6.25%, ctx=6542, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185591: Thu Jan 1 21:55:41 2026 read: IOPS=16, BW=67.9KiB/s (69.5kB/s)(6052KiB/89170msec) clat (usec): min=107, max=180008, avg=33371.50, stdev=21005.05 lat (usec): min=108, max=180009, avg=33373.76, stdev=21005.16 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 10159], 10.00th=[ 13829], 20.00th=[ 18220], | 30.00th=[ 21627], 40.00th=[ 25035], 50.00th=[ 28967], 60.00th=[ 33817], | 70.00th=[ 38536], 80.00th=[ 45876], 90.00th=[ 58459], 95.00th=[ 69731], | 99.00th=[115868], 99.50th=[126354], 99.90th=[170918], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 15, max= 151, per=25.66%, avg=67.74, stdev=21.31, samples=175 iops : min= 3, max= 37, avg=16.31, stdev= 5.36, samples=175 write: IOPS=17, BW=69.9KiB/s (71.6kB/s)(6236KiB/89170msec); 0 zone resets clat (usec): min=690, max=420033, avg=24721.27, stdev=27034.25 lat (usec): min=690, max=420035, avg=24728.61, stdev=27030.99 clat percentiles (usec): | 1.00th=[ 922], 5.00th=[ 1106], 10.00th=[ 1237], 20.00th=[ 2212], | 30.00th=[ 4228], 40.00th=[ 9896], 50.00th=[ 18744], 60.00th=[ 25035], | 70.00th=[ 32375], 80.00th=[ 43254], 90.00th=[ 59507], 95.00th=[ 72877], | 99.00th=[107480], 99.50th=[121111], 99.90th=[198181], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 142, per=25.02%, avg=69.32, stdev=24.26, samples=176 iops : min= 1, max= 35, avg=16.72, stdev= 6.11, samples=176 lat (usec) : 250=1.50%, 500=0.26%, 750=0.16%, 1000=0.68% lat (msec) : 2=8.46%, 4=5.50%, 10=6.09%, 20=16.28%, 50=45.74% lat (msec) : 100=13.80%, 250=1.50%, 500=0.03% cpu : usr=0.10%, sys=5.98%, ctx=6464, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=265KiB/s (271kB/s), 66.4KiB/s-67.9KiB/s (67.0kB/s-69.5kB/s), io=23.4MiB (24.6MB), run=89170-90619msec WRITE: bw=277KiB/s (284kB/s), 69.1KiB/s-70.9KiB/s (70.7kB/s-72.6kB/s), io=24.6MiB (25.7MB), run=89170-90619msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185583: Thu Jan 1 21:56:11 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(5992KiB/120319msec) clat (msec): min=4, max=767, avg=30.66, stdev=32.88 lat (msec): min=4, max=767, avg=30.66, stdev=32.88 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 88], | 99.00th=[ 131], 99.50th=[ 159], 99.90th=[ 226], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 181, per=25.23%, avg=49.96, stdev=32.83, samples=234 iops : min= 1, max= 45, avg=11.85, stdev= 8.25, samples=234 write: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6296KiB/120319msec); 0 zone resets clat (msec): min=8, max=270, avg=47.07, stdev=32.68 lat (msec): min=8, max=270, avg=47.07, stdev=32.68 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 70], 90.00th=[ 92], 95.00th=[ 111], | 99.00th=[ 163], 99.50th=[ 186], 99.90th=[ 266], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 143, per=25.06%, avg=52.13, stdev=30.30, samples=236 iops : min= 1, max= 35, avg=12.40, stdev= 7.63, samples=236 lat (msec) : 10=5.73%, 20=25.55%, 50=43.36%, 100=20.05%, 250=5.21% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=2.26%, ctx=4820, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185584: Thu Jan 1 21:56:11 2026 read: IOPS=12, BW=49.2KiB/s (50.4kB/s)(5940KiB/120711msec) clat (msec): min=4, max=722, avg=30.88, stdev=33.23 lat (msec): min=4, max=722, avg=30.88, stdev=33.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 90], | 99.00th=[ 132], 99.50th=[ 155], 99.90th=[ 309], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 167, per=24.90%, avg=49.30, stdev=34.60, samples=236 iops : min= 1, max= 41, avg=11.69, stdev= 8.71, samples=236 write: IOPS=13, BW=52.6KiB/s (53.8kB/s)(6348KiB/120711msec); 0 zone resets clat (msec): min=8, max=272, avg=46.96, stdev=32.47 lat (msec): min=8, max=272, avg=46.96, stdev=32.47 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 111], | 99.00th=[ 153], 99.50th=[ 174], 99.90th=[ 266], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 160, per=25.18%, avg=52.38, stdev=32.62, samples=237 iops : min= 1, max= 40, avg=12.46, stdev= 8.21, samples=237 lat (msec) : 10=6.35%, 20=26.37%, 50=41.47%, 100=20.51%, 250=5.14% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=2.31%, ctx=4813, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185585: Thu Jan 1 21:56:11 2026 read: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6028KiB/120314msec) clat (msec): min=3, max=307, avg=32.17, stdev=29.98 lat (msec): min=3, max=307, avg=32.17, stdev=29.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 48], 90.00th=[ 72], 95.00th=[ 94], | 99.00th=[ 140], 99.50th=[ 159], 99.90th=[ 259], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 176, per=25.22%, avg=49.94, stdev=31.61, samples=236 iops : min= 1, max= 44, avg=11.85, stdev= 7.96, samples=236 write: IOPS=13, BW=52.0KiB/s (53.3kB/s)(6260KiB/120314msec); 0 zone resets clat (msec): min=8, max=753, avg=45.71, stdev=35.15 lat (msec): min=8, max=753, avg=45.71, stdev=35.14 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 69], 90.00th=[ 87], 95.00th=[ 102], | 99.00th=[ 148], 99.50th=[ 182], 99.90th=[ 245], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 165, per=24.90%, avg=51.79, stdev=32.04, samples=236 iops : min= 1, max= 41, avg=12.31, stdev= 8.06, samples=236 lat (msec) : 4=0.03%, 10=5.53%, 20=25.20%, 50=43.46%, 100=20.80% lat (msec) : 250=4.88%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=2.29%, ctx=4827, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185586: Thu Jan 1 21:56:11 2026 read: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6052KiB/120522msec) clat (msec): min=4, max=219, avg=30.69, stdev=28.36 lat (msec): min=4, max=219, avg=30.69, stdev=28.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 91], | 99.00th=[ 134], 99.50th=[ 163], 99.90th=[ 194], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 7, max= 175, per=25.33%, avg=50.16, stdev=32.77, samples=234 iops : min= 1, max= 43, avg=11.91, stdev= 8.25, samples=234 write: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6236KiB/120522msec); 0 zone resets clat (msec): min=7, max=751, avg=47.33, stdev=36.42 lat (msec): min=7, max=751, avg=47.34, stdev=36.42 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 89], 95.00th=[ 109], | 99.00th=[ 161], 99.50th=[ 178], 99.90th=[ 251], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 135, per=24.61%, avg=51.20, stdev=30.47, samples=237 iops : min= 1, max= 33, avg=12.16, stdev= 7.68, samples=237 lat (msec) : 10=6.09%, 20=25.91%, 50=42.09%, 100=20.44%, 250=5.40% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=2.30%, ctx=4805, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=199KiB/s (204kB/s), 49.2KiB/s-50.2KiB/s (50.4kB/s-51.4kB/s), io=23.4MiB (24.6MB), run=120314-120711msec WRITE: bw=208KiB/s (213kB/s), 51.7KiB/s-52.6KiB/s (52.0kB/s-53.8kB/s), io=24.6MiB (25.7MB), run=120314-120711msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185626: Thu Jan 1 21:56:40 2026 read: IOPS=16, BW=258KiB/s (264kB/s)(5920KiB/22974msec) clat (usec): min=98, max=141453, avg=32768.54, stdev=22806.17 lat (usec): min=99, max=141454, avg=32769.71, stdev=22806.44 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 159], 10.00th=[ 570], 20.00th=[ 17171], | 30.00th=[ 21103], 40.00th=[ 24773], 50.00th=[ 28181], 60.00th=[ 33424], | 70.00th=[ 39584], 80.00th=[ 47973], 90.00th=[ 58983], 95.00th=[ 69731], | 99.00th=[126354], 99.50th=[137364], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 126, max= 446, per=25.24%, avg=257.49, stdev=75.05, samples=45 iops : min= 7, max= 27, avg=15.31, stdev= 4.74, samples=45 write: IOPS=17, BW=277KiB/s (284kB/s)(6368KiB/22974msec); 0 zone resets clat (usec): min=1234, max=155691, avg=26842.00, stdev=25264.03 lat (usec): min=1235, max=155692, avg=26854.81, stdev=25271.60 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1713], 10.00th=[ 2606], 20.00th=[ 4293], | 30.00th=[ 7373], 40.00th=[ 13960], 50.00th=[ 20841], 60.00th=[ 26084], | 70.00th=[ 35914], 80.00th=[ 45351], 90.00th=[ 63701], 95.00th=[ 79168], | 99.00th=[109577], 99.50th=[135267], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 126, max= 510, per=25.92%, avg=278.11, stdev=90.18, samples=45 iops : min= 7, max= 31, avg=16.60, stdev= 5.68, samples=45 lat (usec) : 100=0.13%, 250=3.91%, 500=0.65%, 750=0.13% lat (msec) : 2=4.17%, 4=5.21%, 10=9.77%, 20=13.15%, 50=45.31% lat (msec) : 100=16.02%, 250=1.56% cpu : usr=0.07%, sys=7.23%, ctx=1676, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185628: Thu Jan 1 21:56:40 2026 read: IOPS=15, BW=245KiB/s (251kB/s)(5744KiB/23465msec) clat (usec): min=115, max=144629, avg=33641.15, stdev=20503.18 lat (usec): min=115, max=144630, avg=33644.39, stdev=20500.97 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 174], 10.00th=[ 10159], 20.00th=[ 18482], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 31065], 60.00th=[ 36439], | 70.00th=[ 41681], 80.00th=[ 49021], 90.00th=[ 60031], 95.00th=[ 68682], | 99.00th=[ 92799], 99.50th=[106431], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 29, max= 410, per=23.90%, avg=243.78, stdev=85.90, samples=46 iops : min= 1, max= 25, avg=14.46, stdev= 5.37, samples=46 write: IOPS=17, BW=279KiB/s (286kB/s)(6544KiB/23465msec); 0 zone resets clat (usec): min=1190, max=138463, avg=27293.92, stdev=26947.69 lat (usec): min=1192, max=138464, avg=27312.13, stdev=26962.98 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1876], 10.00th=[ 2573], 20.00th=[ 3818], | 30.00th=[ 6783], 40.00th=[ 12256], 50.00th=[ 20055], 60.00th=[ 26346], | 70.00th=[ 34866], 80.00th=[ 47449], 90.00th=[ 65799], 95.00th=[ 82314], | 99.00th=[113771], 99.50th=[119014], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 94, max= 634, per=25.92%, avg=278.17, stdev=105.40, samples=46 iops : min= 5, max= 39, avg=16.63, stdev= 6.67, samples=46 lat (usec) : 250=3.12%, 500=0.65%, 750=0.26% lat (msec) : 2=3.26%, 4=8.20%, 10=8.98%, 20=12.89%, 50=44.01% lat (msec) : 100=16.80%, 250=1.82% cpu : usr=0.08%, sys=7.62%, ctx=1781, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185630: Thu Jan 1 21:56:40 2026 read: IOPS=16, BW=271KiB/s (278kB/s)(6256KiB/23077msec) clat (usec): min=91, max=104391, avg=31376.39, stdev=18964.93 lat (usec): min=92, max=104393, avg=31377.54, stdev=18965.03 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 176], 10.00th=[ 1352], 20.00th=[ 17957], | 30.00th=[ 22414], 40.00th=[ 25560], 50.00th=[ 29754], 60.00th=[ 34341], | 70.00th=[ 40109], 80.00th=[ 45351], 90.00th=[ 53216], 95.00th=[ 61604], | 99.00th=[ 95945], 99.50th=[103285], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 58, max= 446, per=26.73%, avg=272.67, stdev=82.27, samples=45 iops : min= 3, max= 27, avg=16.27, stdev= 5.16, samples=45 write: IOPS=16, BW=261KiB/s (268kB/s)(6032KiB/23077msec); 0 zone resets clat (usec): min=1329, max=151828, avg=27976.42, stdev=25142.44 lat (usec): min=1330, max=151830, avg=27978.58, stdev=25142.34 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1844], 10.00th=[ 2704], 20.00th=[ 4752], | 30.00th=[ 9503], 40.00th=[ 16450], 50.00th=[ 21627], 60.00th=[ 27657], | 70.00th=[ 35390], 80.00th=[ 47973], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[ 96994], 99.50th=[131597], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 116, max= 478, per=24.09%, avg=258.44, stdev=85.76, samples=45 iops : min= 7, max= 29, avg=15.38, stdev= 5.36, samples=45 lat (usec) : 100=0.13%, 250=4.17%, 500=0.78% lat (msec) : 2=3.26%, 4=6.25%, 10=6.51%, 20=14.19%, 50=48.05% lat (msec) : 100=16.02%, 250=0.65% cpu : usr=0.10%, sys=7.29%, ctx=1767, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185631: Thu Jan 1 21:56:40 2026 read: IOPS=17, BW=274KiB/s (281kB/s)(6032KiB/22012msec) clat (usec): min=111, max=141528, avg=30867.39, stdev=21701.17 lat (usec): min=113, max=141529, avg=30869.99, stdev=21700.24 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 172], 10.00th=[ 807], 20.00th=[ 16450], | 30.00th=[ 21103], 40.00th=[ 24249], 50.00th=[ 26870], 60.00th=[ 31851], | 70.00th=[ 36963], 80.00th=[ 44303], 90.00th=[ 55837], 95.00th=[ 68682], | 99.00th=[108528], 99.50th=[137364], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 116, max= 479, per=26.88%, avg=274.16, stdev=86.86, samples=43 iops : min= 7, max= 29, avg=16.37, stdev= 5.46, samples=43 write: IOPS=17, BW=284KiB/s (291kB/s)(6256KiB/22012msec); 0 zone resets clat (usec): min=1279, max=160180, avg=26262.02, stdev=26030.97 lat (usec): min=1281, max=160182, avg=26280.98, stdev=26021.90 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1745], 10.00th=[ 2212], 20.00th=[ 3884], | 30.00th=[ 7046], 40.00th=[ 11994], 50.00th=[ 19792], 60.00th=[ 25297], | 70.00th=[ 32637], 80.00th=[ 44303], 90.00th=[ 64226], 95.00th=[ 74974], | 99.00th=[114820], 99.50th=[139461], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 127, max= 478, per=26.70%, avg=286.44, stdev=83.04, samples=43 iops : min= 7, max= 29, avg=17.14, stdev= 5.26, samples=43 lat (usec) : 250=3.65%, 500=0.91%, 750=0.26%, 1000=0.39% lat (msec) : 2=4.30%, 4=6.64%, 10=8.59%, 20=14.19%, 50=44.92% lat (msec) : 100=14.58%, 250=1.56% cpu : usr=0.09%, sys=7.77%, ctx=1706, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1021KiB/s (1045kB/s), 245KiB/s-274KiB/s (251kB/s-281kB/s), io=23.4MiB (24.5MB), run=22012-23465msec WRITE: bw=1074KiB/s (1100kB/s), 261KiB/s-284KiB/s (268kB/s-291kB/s), io=24.6MiB (25.8MB), run=22012-23465msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185624: Thu Jan 1 21:56:48 2026 read: IOPS=11, BW=190KiB/s (195kB/s)(5920KiB/31107msec) clat (msec): min=5, max=145, avg=32.06, stdev=25.28 lat (msec): min=5, max=145, avg=32.06, stdev=25.28 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 70], 95.00th=[ 86], | 99.00th=[ 125], 99.50th=[ 142], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 31, max= 505, per=24.39%, avg=185.84, stdev=105.41, samples=61 iops : min= 1, max= 31, avg=10.89, stdev= 6.65, samples=61 write: IOPS=12, BW=205KiB/s (210kB/s)(6368KiB/31107msec); 0 zone resets clat (msec): min=11, max=193, avg=47.81, stdev=31.76 lat (msec): min=11, max=193, avg=47.81, stdev=31.76 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 92], 95.00th=[ 117], | 99.00th=[ 159], 99.50th=[ 167], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 30, max= 510, per=25.25%, avg=202.48, stdev=110.47, samples=61 iops : min= 1, max= 31, avg=11.93, stdev= 6.95, samples=61 lat (msec) : 10=3.78%, 20=22.53%, 50=47.53%, 100=20.96%, 250=5.21% cpu : usr=0.05%, sys=2.63%, ctx=1269, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185625: Thu Jan 1 21:56:48 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5744KiB/31406msec) clat (msec): min=6, max=145, avg=33.39, stdev=27.91 lat (msec): min=6, max=145, avg=33.39, stdev=27.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 132], 99.50th=[ 144], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 30, max= 632, per=23.73%, avg=180.85, stdev=114.43, samples=62 iops : min= 1, max= 39, avg=10.58, stdev= 7.23, samples=62 write: IOPS=13, BW=208KiB/s (213kB/s)(6544KiB/31406msec); 0 zone resets clat (msec): min=10, max=175, avg=47.07, stdev=29.91 lat (msec): min=10, max=175, avg=47.08, stdev=29.91 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 68], 90.00th=[ 90], 95.00th=[ 108], | 99.00th=[ 148], 99.50th=[ 159], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 31, max= 608, per=25.70%, avg=206.08, stdev=116.28, samples=62 iops : min= 1, max= 38, avg=12.16, stdev= 7.38, samples=62 lat (msec) : 10=3.78%, 20=21.88%, 50=45.83%, 100=22.66%, 250=5.86% cpu : usr=0.06%, sys=2.41%, ctx=1251, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185627: Thu Jan 1 21:56:48 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6256KiB/30840msec) clat (msec): min=5, max=147, avg=32.49, stdev=26.21 lat (msec): min=5, max=147, avg=32.49, stdev=26.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 49], 90.00th=[ 68], 95.00th=[ 87], | 99.00th=[ 132], 99.50th=[ 142], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 32, max= 605, per=26.64%, avg=203.00, stdev=125.36, samples=61 iops : min= 2, max= 37, avg=11.97, stdev= 7.89, samples=61 write: IOPS=12, BW=196KiB/s (200kB/s)(6032KiB/30840msec); 0 zone resets clat (msec): min=10, max=227, avg=47.60, stdev=29.71 lat (msec): min=10, max=227, avg=47.60, stdev=29.71 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 48], | 70.00th=[ 60], 80.00th=[ 69], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 134], 99.50th=[ 140], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 31, max= 512, per=24.28%, avg=194.75, stdev=104.25, samples=61 iops : min= 1, max= 32, avg=11.44, stdev= 6.59, samples=61 lat (msec) : 10=4.04%, 20=25.91%, 50=42.19%, 100=23.57%, 250=4.30% cpu : usr=0.09%, sys=2.56%, ctx=1272, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185629: Thu Jan 1 21:56:48 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30929msec) clat (msec): min=6, max=148, avg=32.60, stdev=26.24 lat (msec): min=6, max=148, avg=32.61, stdev=26.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 48], 90.00th=[ 72], 95.00th=[ 96], | 99.00th=[ 128], 99.50th=[ 144], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 31, max= 568, per=25.28%, avg=192.62, stdev=108.35, samples=61 iops : min= 1, max= 35, avg=11.31, stdev= 6.85, samples=61 write: IOPS=12, BW=202KiB/s (207kB/s)(6256KiB/30929msec); 0 zone resets clat (msec): min=7, max=224, avg=47.56, stdev=34.02 lat (msec): min=7, max=224, avg=47.56, stdev=34.02 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 71], 90.00th=[ 93], 95.00th=[ 117], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 62, max= 600, per=25.12%, avg=201.46, stdev=112.28, samples=61 iops : min= 3, max= 37, avg=11.87, stdev= 7.07, samples=61 lat (msec) : 10=3.52%, 20=22.14%, 50=48.96%, 100=19.27%, 250=6.12% cpu : usr=0.07%, sys=2.58%, ctx=1343, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=763KiB/s (781kB/s), 183KiB/s-203KiB/s (187kB/s-208kB/s), io=23.4MiB (24.5MB), run=30840-31406msec WRITE: bw=802KiB/s (822kB/s), 196KiB/s-208KiB/s (200kB/s-213kB/s), io=24.6MiB (25.8MB), run=30840-31406msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185643: Thu Jan 1 21:57:00 2026 read: IOPS=3, BW=3661KiB/s (3749kB/s)(7168KiB/1958msec) clat (usec): min=560, max=285997, avg=139117.09, stdev=92700.05 lat (usec): min=560, max=285998, avg=139118.33, stdev=92700.16 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 74974], | 30.00th=[109577], 40.00th=[109577], 50.00th=[139461], 60.00th=[147850], | 70.00th=[147850], 80.00th=[214959], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 4079, max= 5885, per=83.79%, avg=4982.00, stdev=1277.03, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2615KiB/s (2678kB/s)(5120KiB/1958msec); 0 zone resets clat (msec): min=75, max=342, avg=180.20, stdev=101.18 lat (msec): min=75, max=342, avg=180.33, stdev=101.27 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 157], 60.00th=[ 157], | 70.00th=[ 201], 80.00th=[ 201], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1996, max= 6119, per=48.74%, avg=4057.50, stdev=2915.40, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=16.67%, 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=23.97%, ctx=227, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185644: Thu Jan 1 21:57:00 2026 read: IOPS=0, BW=595KiB/s (609kB/s)(2048KiB/3444msec) clat (usec): min=643, max=165502, avg=83072.94, stdev=116573.00 lat (usec): min=644, max=165504, avg=83074.55, stdev=116574.00 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 644], 40.00th=[ 644], 50.00th=[ 644], 60.00th=[164627], | 70.00th=[164627], 80.00th=[164627], 90.00th=[164627], 95.00th=[164627], | 99.00th=[164627], 99.50th=[164627], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 1996, max= 2043, per=33.96%, avg=2019.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2973KiB/s (3045kB/s)(10.0MiB/3444msec); 0 zone resets clat (msec): min=118, max=577, avg=318.10, stdev=161.11 lat (msec): min=118, max=577, avg=318.41, stdev=160.85 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 125], | 30.00th=[ 142], 40.00th=[ 255], 50.00th=[ 305], 60.00th=[ 338], | 70.00th=[ 376], 80.00th=[ 451], 90.00th=[ 498], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1996, max= 6131, per=34.10%, avg=2839.20, stdev=1840.25, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=50.00%, 750=8.33% cpu : usr=0.03%, sys=18.24%, ctx=148, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185645: Thu Jan 1 21:57:00 2026 read: IOPS=2, BW=2612KiB/s (2675kB/s)(6144KiB/2352msec) clat (usec): min=572, max=220188, avg=124157.37, stdev=91457.04 lat (usec): min=573, max=220189, avg=124158.63, stdev=91457.04 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 23987], | 30.00th=[ 23987], 40.00th=[131597], 50.00th=[131597], 60.00th=[183501], | 70.00th=[185598], 80.00th=[185598], 90.00th=[219153], 95.00th=[219153], | 99.00th=[219153], 99.50th=[219153], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 4055, max= 4079, per=68.40%, avg=4067.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2612KiB/s (2675kB/s)(6144KiB/2352msec); 0 zone resets clat (msec): min=86, max=617, avg=263.64, stdev=216.07 lat (msec): min=86, max=617, avg=263.71, stdev=216.08 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1996, max= 3849, per=31.52%, avg=2624.00, stdev=1060.99, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=20.71%, ctx=187, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185646: Thu Jan 1 21:57:00 2026 read: IOPS=1, BW=2037KiB/s (2086kB/s)(5120KiB/2513msec) clat (msec): min=2, max=174, avg=44.83, stdev=73.20 lat (msec): min=2, max=174, avg=44.84, stdev=73.21 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 5], 40.00th=[ 5], 50.00th=[ 11], 60.00th=[ 11], | 70.00th=[ 33], 80.00th=[ 33], 90.00th=[ 176], 95.00th=[ 176], | 99.00th=[ 176], 99.50th=[ 176], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2852KiB/s (2921kB/s)(7168KiB/2513msec); 0 zone resets clat (msec): min=125, max=650, avg=277.29, stdev=180.56 lat (msec): min=125, max=650, avg=277.39, stdev=180.57 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 134], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 247], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 330], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1996, max= 4079, per=32.44%, avg=2700.67, stdev=1193.77, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 10=8.33%, 20=8.33%, 50=8.33%, 250=41.67% lat (msec) : 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=14.85%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5947KiB/s (6089kB/s), 595KiB/s-3661KiB/s (609kB/s-3749kB/s), io=20.0MiB (20.0MB), run=1958-3444msec WRITE: bw=8325KiB/s (8525kB/s), 2612KiB/s-2973KiB/s (2675kB/s-3045kB/s), io=28.0MiB (29.4MB), run=1958-3444msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185647: Thu Jan 1 21:57:01 2026 read: IOPS=1, BW=2019KiB/s (2067kB/s)(7168KiB/3551msec) clat (msec): min=57, max=780, avg=226.00, stdev=253.22 lat (msec): min=57, max=780, avg=226.00, stdev=253.22 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 58], 10.00th=[ 58], 20.00th=[ 79], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 136], 60.00th=[ 209], | 70.00th=[ 209], 80.00th=[ 232], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1492, max= 3976, per=42.53%, avg=2312.20, stdev=959.01, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1442KiB/s (1476kB/s)(5120KiB/3551msec); 0 zone resets clat (msec): min=94, max=491, avg=345.80, stdev=169.90 lat (msec): min=94, max=491, avg=345.91, stdev=169.88 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1988, max= 4096, per=35.58%, avg=2707.67, stdev=1202.60, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=33.33%, 250=25.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=7.18%, ctx=130, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185648: Thu Jan 1 21:57:01 2026 read: IOPS=0, BW=569KiB/s (583kB/s)(2048KiB/3600msec) clat (msec): min=68, max=461, avg=265.28, stdev=278.12 lat (msec): min=68, max=461, avg=265.28, stdev=278.12 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 69], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1424, max= 2048, per=31.94%, avg=1736.00, stdev=441.23, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2844KiB/s (2913kB/s)(10.0MiB/3600msec); 0 zone resets clat (msec): min=105, max=1015, avg=302.46, stdev=271.85 lat (msec): min=105, max=1015, avg=302.55, stdev=271.84 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 124], | 30.00th=[ 129], 40.00th=[ 178], 50.00th=[ 192], 60.00th=[ 213], | 70.00th=[ 279], 80.00th=[ 363], 90.00th=[ 426], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 2011, max= 6119, per=53.22%, avg=4050.50, stdev=1677.88, samples=4 iops : min= 1, max= 5, avg= 3.25, stdev= 1.71, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=6.42%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185649: Thu Jan 1 21:57:01 2026 read: IOPS=1, BW=1922KiB/s (1969kB/s)(6144KiB/3196msec) clat (msec): min=79, max=423, avg=205.90, stdev=133.00 lat (msec): min=79, max=423, avg=205.90, stdev=133.00 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 188], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1988, max= 4096, per=49.64%, avg=2698.33, stdev=1210.47, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1922KiB/s (1969kB/s)(6144KiB/3196msec); 0 zone resets clat (msec): min=124, max=729, avg=281.50, stdev=234.55 lat (msec): min=124, max=729, avg=281.59, stdev=234.53 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 167], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1426, max= 2043, per=24.53%, avg=1867.00, stdev=294.86, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=6.20%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185650: Thu Jan 1 21:57:01 2026 read: IOPS=1, BW=1359KiB/s (1392kB/s)(5120KiB/3767msec) clat (msec): min=67, max=248, avg=140.90, stdev=75.74 lat (msec): min=67, max=248, avg=140.90, stdev=75.74 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 95], 40.00th=[ 95], 50.00th=[ 104], 60.00th=[ 104], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 2011, max= 6119, per=74.78%, avg=4065.00, stdev=2904.79, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1903KiB/s (1949kB/s)(7168KiB/3767msec); 0 zone resets clat (msec): min=65, max=746, avg=393.75, stdev=316.06 lat (msec): min=65, max=746, avg=393.93, stdev=315.96 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 67], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 510], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 726], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2011, max= 6035, per=37.25%, avg=2835.20, stdev=1788.80, samples=5 iops : min= 1, max= 5, avg= 2.00, stdev= 1.73, samples=5 lat (msec) : 100=41.67%, 250=25.00%, 750=33.33% cpu : usr=0.08%, sys=5.87%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5437KiB/s (5567kB/s), 569KiB/s-2019KiB/s (583kB/s-2067kB/s), io=20.0MiB (20.0MB), run=3196-3767msec WRITE: bw=7611KiB/s (7794kB/s), 1442KiB/s-2844KiB/s (1476kB/s-2913kB/s), io=28.0MiB (29.4MB), run=3196-3767msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=185656: Thu Jan 1 21:57:10 2026 read: IOPS=1, BW=7516KiB/s (7696kB/s)(12.0MiB/1635msec) clat (msec): min=471, max=593, avg=532.89, stdev=60.90 lat (msec): min=471, max=593, avg=532.89, stdev=60.90 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 6095, max= 8192, per=100.00%, avg=7143.50, stdev=1482.80, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=20.01%, ctx=517, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185657: Thu Jan 1 21:57:10 2026 read: IOPS=0, BW=1735KiB/s (1776kB/s)(4096KiB/2361msec) clat (nsec): min=651125k, max=651125k, avg=651125031.00, stdev= 0.00 lat (nsec): min=651128k, max=651128k, avg=651127524.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3470KiB/s (3553kB/s)(8192KiB/2361msec); 0 zone resets clat (msec): min=671, max=940, avg=806.16, stdev=190.64 lat (msec): min=671, max=941, avg=806.43, stdev=190.78 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8175, max= 8175, per=58.91%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=5.08%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185658: Thu Jan 1 21:57:10 2026 write: IOPS=1, BW=5916KiB/s (6058kB/s)(12.0MiB/2077msec); 0 zone resets clat (msec): min=390, max=830, avg=650.03, stdev=230.57 lat (msec): min=391, max=830, avg=650.71, stdev=230.10 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8192, max= 8192, per=59.03%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.03%, ctx=63, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185659: Thu Jan 1 21:57:10 2026 write: IOPS=1, BW=6308KiB/s (6459kB/s)(12.0MiB/1948msec); 0 zone resets clat (msec): min=302, max=1023, avg=617.29, stdev=368.97 lat (msec): min=302, max=1023, avg=617.75, stdev=368.90 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 527], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min=16384, max=16384, per=100.00%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.08%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6939KiB/s (7106kB/s), 1735KiB/s-7516KiB/s (1776kB/s-7696kB/s), io=16.0MiB (16.8MB), run=1635-2361msec WRITE: bw=13.6MiB/s (14.2MB/s), 3470KiB/s-6308KiB/s (3553kB/s-6459kB/s), io=32.0MiB (33.6MB), run=1948-2361msec rand-rw: (groupid=0, jobs=1): err= 0: pid=185661: Thu Jan 1 21:57:11 2026 read: IOPS=1, BW=4546KiB/s (4655kB/s)(12.0MiB/2703msec) clat (msec): min=272, max=1303, avg=837.64, stdev=522.87 lat (msec): min=272, max=1303, avg=837.64, stdev=522.88 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.48%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185662: Thu Jan 1 21:57:11 2026 read: IOPS=0, BW=1540KiB/s (1577kB/s)(4096KiB/2659msec) clat (nsec): min=552804k, max=552804k, avg=552803721.00, stdev= 0.00 lat (nsec): min=552806k, max=552806k, avg=552806380.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3081KiB/s (3155kB/s)(8192KiB/2659msec); 0 zone resets clat (msec): min=858, max=1170, avg=1014.29, stdev=220.85 lat (msec): min=858, max=1172, avg=1015.53, stdev=221.95 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8047, max= 8047, per=65.30%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.27%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185663: Thu Jan 1 21:57:11 2026 write: IOPS=1, BW=4957KiB/s (5076kB/s)(12.0MiB/2479msec); 0 zone resets clat (msec): min=246, max=1050, avg=782.11, stdev=463.97 lat (msec): min=246, max=1050, avg=782.36, stdev=464.01 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8031, max= 8143, per=65.63%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.04%, sys=4.12%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=185664: Thu Jan 1 21:57:11 2026 write: IOPS=1, BW=5953KiB/s (6096kB/s)(12.0MiB/2064msec); 0 zone resets clat (msec): min=264, max=919, avg=641.51, stdev=338.35 lat (msec): min=264, max=919, avg=642.50, stdev=338.72 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8031, max= 8031, per=65.17%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.24%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6061KiB/s (6207kB/s), 1540KiB/s-4546KiB/s (1577kB/s-4655kB/s), io=16.0MiB (16.8MB), run=2659-2703msec WRITE: bw=12.0MiB/s (12.6MB/s), 3081KiB/s-5953KiB/s (3155kB/s-6096kB/s), io=32.0MiB (33.6MB), run=2064-2659msec