== sanity test 398b: DIO and buffer IO race ============== 12:02:36 (1779206556) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.43955 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145177: Tue May 19 12:04:49 2026 read: IOPS=13, BW=52.4KiB/s (53.6kB/s)(5992KiB/114458msec) clat (usec): min=35, max=439263, avg=37705.69, stdev=27779.45 lat (usec): min=35, max=439264, avg=37706.95, stdev=27779.46 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 11863], 20.00th=[ 18744], | 30.00th=[ 23987], 40.00th=[ 27919], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[137364], 99.50th=[164627], 99.90th=[200279], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 119, per=24.96%, avg=52.17, stdev=21.23, samples=223 iops : min= 1, max= 29, avg=12.41, stdev= 5.32, samples=223 write: IOPS=13, BW=55.0KiB/s (56.3kB/s)(6296KiB/114458msec); 0 zone resets clat (usec): min=869, max=936149, avg=36548.91, stdev=41756.55 lat (usec): min=870, max=936150, avg=36551.50, stdev=41757.45 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1582], 20.00th=[ 4047], | 30.00th=[ 9241], 40.00th=[ 18744], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 47449], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[100140], | 99.00th=[154141], 99.50th=[183501], 99.90th=[254804], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 155, per=25.20%, avg=55.19, stdev=20.30, samples=222 iops : min= 1, max= 38, avg=13.17, stdev= 5.12, samples=222 lat (usec) : 50=0.59%, 100=3.16%, 250=0.07%, 500=0.03%, 1000=0.10% lat (msec) : 2=6.28%, 4=3.78%, 10=6.15%, 20=11.75%, 50=41.67% lat (msec) : 100=22.66%, 250=3.68%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.21%, ctx=6443, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145179: Tue May 19 12:04:49 2026 read: IOPS=13, BW=52.3KiB/s (53.6kB/s)(5940KiB/113535msec) clat (usec): min=36, max=968191, avg=37756.23, stdev=36713.96 lat (usec): min=36, max=968195, avg=37757.65, stdev=36713.93 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 9896], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 82314], | 99.00th=[129500], 99.50th=[154141], 99.90th=[371196], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 116, per=25.50%, avg=53.30, stdev=22.16, samples=218 iops : min= 1, max= 29, avg=12.71, stdev= 5.56, samples=218 write: IOPS=13, BW=55.9KiB/s (57.3kB/s)(6348KiB/113535msec); 0 zone resets clat (usec): min=910, max=330092, avg=35875.85, stdev=39843.38 lat (usec): min=910, max=330093, avg=35877.83, stdev=39843.42 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1303], 10.00th=[ 1467], 20.00th=[ 3458], | 30.00th=[ 7111], 40.00th=[ 17171], 50.00th=[ 26084], 60.00th=[ 35914], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[204473], 99.50th=[246416], 99.90th=[304088], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 127, per=25.69%, avg=56.26, stdev=22.42, samples=221 iops : min= 1, max= 31, avg=13.45, stdev= 5.66, samples=221 lat (usec) : 50=0.55%, 100=3.55%, 250=0.10%, 500=0.03%, 1000=0.16% lat (msec) : 2=7.10%, 4=4.26%, 10=6.67%, 20=11.07%, 50=41.28% lat (msec) : 100=21.09%, 250=3.84%, 500=0.26%, 1000=0.03% cpu : usr=0.09%, sys=5.25%, ctx=6452, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145181: Tue May 19 12:04:49 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6028KiB/114754msec) clat (usec): min=33, max=266328, avg=37450.41, stdev=28213.74 lat (usec): min=33, max=266330, avg=37451.82, stdev=28213.76 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 9372], 20.00th=[ 17957], | 30.00th=[ 22676], 40.00th=[ 26608], 50.00th=[ 31851], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 54264], 90.00th=[ 70779], 95.00th=[ 84411], | 99.00th=[139461], 99.50th=[156238], 99.90th=[254804], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 119, per=25.23%, avg=52.74, stdev=21.42, samples=223 iops : min= 1, max= 29, avg=12.56, stdev= 5.38, samples=223 write: IOPS=13, BW=54.6KiB/s (55.9kB/s)(6260KiB/114754msec); 0 zone resets clat (usec): min=961, max=1028.6k, avg=36873.53, stdev=44774.71 lat (usec): min=961, max=1028.6k, avg=36882.59, stdev=44777.40 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1287], 10.00th=[ 1450], | 20.00th=[ 3589], 30.00th=[ 7963], 40.00th=[ 17957], | 50.00th=[ 27919], 60.00th=[ 37487], 70.00th=[ 47449], | 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[ 107480], | 99.00th=[ 166724], 99.50th=[ 210764], 99.90th=[ 283116], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 151, per=25.01%, avg=54.78, stdev=23.03, samples=223 iops : min= 1, max= 37, avg=13.08, stdev= 5.79, samples=223 lat (usec) : 50=0.75%, 100=3.39%, 250=0.33%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=7.19%, 4=3.42%, 10=6.64%, 20=11.52%, 50=40.40% lat (msec) : 100=21.81%, 250=4.20%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=4.96%, ctx=6425, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145183: Tue May 19 12:04:49 2026 read: IOPS=13, BW=52.9KiB/s (54.1kB/s)(6052KiB/114495msec) clat (usec): min=30, max=292019, avg=37290.80, stdev=26933.82 lat (usec): min=30, max=292020, avg=37292.42, stdev=26934.00 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 7570], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 85459], | 99.00th=[122160], 99.50th=[152044], 99.90th=[231736], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 126, per=25.30%, avg=52.88, stdev=21.18, samples=222 iops : min= 1, max= 31, avg=12.58, stdev= 5.35, samples=222 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6236KiB/114495msec); 0 zone resets clat (usec): min=895, max=994386, avg=36981.01, stdev=44075.62 lat (usec): min=896, max=994387, avg=36984.29, stdev=44075.21 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1483], 20.00th=[ 3949], | 30.00th=[ 8455], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 36963], | 70.00th=[ 48497], 80.00th=[ 62129], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[162530], 99.50th=[193987], 99.90th=[337642], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 126, per=24.67%, avg=54.02, stdev=21.02, samples=224 iops : min= 1, max= 31, avg=12.89, stdev= 5.28, samples=224 lat (usec) : 50=0.91%, 100=3.52%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.61%, 4=3.78%, 10=6.28%, 20=11.20%, 50=40.66% lat (msec) : 100=22.36%, 250=4.20%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.07%, ctx=6473, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=209KiB/s (214kB/s), 52.3KiB/s-52.9KiB/s (53.6kB/s-54.1kB/s), io=23.4MiB (24.6MB), run=113535-114754msec WRITE: bw=219KiB/s (224kB/s), 54.5KiB/s-55.9KiB/s (55.8kB/s-57.3kB/s), io=24.6MiB (25.7MB), run=113535-114754msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145176: Tue May 19 12:07:11 2026 read: IOPS=5, BW=23.3KiB/s (23.9kB/s)(5992KiB/257095msec) clat (msec): min=4, max=944, avg=34.67, stdev=40.92 lat (msec): min=4, max=944, avg=34.67, stdev=40.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 65], 95.00th=[ 94], | 99.00th=[ 178], 99.50th=[ 226], 99.90th=[ 384], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 94, per=28.15%, avg=26.18, stdev=17.35, samples=443 iops : min= 1, max= 23, avg= 5.90, stdev= 4.37, samples=443 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6296KiB/257095msec); 0 zone resets clat (msec): min=31, max=448, avg=130.04, stdev=56.56 lat (msec): min=31, max=448, avg=130.04, stdev=56.56 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 95], 40.00th=[ 107], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 169], 90.00th=[ 203], 95.00th=[ 236], | 99.00th=[ 321], 99.50th=[ 372], 99.90th=[ 409], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 56, per=24.81%, avg=24.07, stdev=10.12, samples=504 iops : min= 1, max= 14, avg= 5.37, stdev= 2.60, samples=504 lat (msec) : 10=4.00%, 20=15.40%, 50=21.71%, 100=23.31%, 250=33.53% lat (msec) : 500=2.02%, 1000=0.03% cpu : usr=0.05%, sys=1.33%, ctx=5427, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145178: Tue May 19 12:07:11 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(5940KiB/256742msec) clat (msec): min=4, max=998, avg=33.59, stdev=39.76 lat (msec): min=4, max=998, avg=33.59, stdev=39.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 65], 95.00th=[ 84], | 99.00th=[ 153], 99.50th=[ 203], 99.90th=[ 376], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 95, per=26.95%, avg=25.06, stdev=16.22, samples=457 iops : min= 1, max= 23, avg= 5.63, stdev= 4.10, samples=457 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6348KiB/256742msec); 0 zone resets clat (msec): min=33, max=474, avg=130.10, stdev=56.75 lat (msec): min=33, max=474, avg=130.10, stdev=56.75 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 133], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 199], 95.00th=[ 236], | 99.00th=[ 313], 99.50th=[ 372], 99.90th=[ 468], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 56, per=25.01%, avg=24.26, stdev=10.02, samples=504 iops : min= 1, max= 14, avg= 5.42, stdev= 2.57, samples=504 lat (msec) : 10=3.48%, 20=15.49%, 50=22.62%, 100=22.53%, 250=33.66% lat (msec) : 500=2.18%, 1000=0.03% cpu : usr=0.03%, sys=1.31%, ctx=5298, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145180: Tue May 19 12:07:11 2026 read: IOPS=5, BW=23.7KiB/s (24.2kB/s)(6028KiB/254590msec) clat (msec): min=5, max=374, avg=35.56, stdev=33.38 lat (msec): min=5, max=374, avg=35.56, stdev=33.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 49], 90.00th=[ 70], 95.00th=[ 92], | 99.00th=[ 163], 99.50th=[ 255], 99.90th=[ 330], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 95, per=27.02%, avg=25.13, stdev=16.28, samples=463 iops : min= 1, max= 23, avg= 5.64, stdev= 4.09, samples=463 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6260KiB/254590msec); 0 zone resets clat (msec): min=35, max=1136, avg=128.18, stdev=59.68 lat (msec): min=35, max=1136, avg=128.18, stdev=59.68 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 106], 50.00th=[ 116], 60.00th=[ 130], | 70.00th=[ 148], 80.00th=[ 165], 90.00th=[ 197], 95.00th=[ 232], | 99.00th=[ 313], 99.50th=[ 330], 99.90th=[ 397], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 55, per=25.08%, avg=24.33, stdev=10.00, samples=496 iops : min= 1, max= 13, avg= 5.44, stdev= 2.56, samples=496 lat (msec) : 10=3.35%, 20=14.06%, 50=22.85%, 100=24.58%, 250=33.07% lat (msec) : 500=2.05%, 2000=0.03% cpu : usr=0.05%, sys=1.36%, ctx=5372, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145182: Tue May 19 12:07:11 2026 read: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6052KiB/255917msec) clat (msec): min=5, max=296, avg=33.85, stdev=30.10 lat (msec): min=5, max=296, avg=33.85, stdev=30.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 66], 95.00th=[ 91], | 99.00th=[ 161], 99.50th=[ 176], 99.90th=[ 284], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 87, per=27.95%, avg=25.99, stdev=16.71, samples=450 iops : min= 1, max= 21, avg= 5.86, stdev= 4.22, samples=450 write: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6236KiB/255917msec); 0 zone resets clat (msec): min=38, max=1040, avg=131.03, stdev=60.57 lat (msec): min=38, max=1040, avg=131.03, stdev=60.57 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 201], 95.00th=[ 239], | 99.00th=[ 321], 99.50th=[ 355], 99.90th=[ 464], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 56, per=24.71%, avg=23.97, stdev= 9.92, samples=501 iops : min= 1, max= 14, avg= 5.35, stdev= 2.54, samples=501 lat (msec) : 10=2.96%, 20=15.85%, 50=22.27%, 100=23.34%, 250=33.56% lat (msec) : 500=1.99%, 2000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5446, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=93.4KiB/s (95.6kB/s), 23.1KiB/s-23.7KiB/s (23.7kB/s-24.2kB/s), io=23.4MiB (24.6MB), run=254590-257095msec WRITE: bw=97.8KiB/s (100kB/s), 24.4KiB/s-24.7KiB/s (24.0kB/s-25.3kB/s), io=24.6MiB (25.7MB), run=254590-257095msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145233: Tue May 19 12:07:51 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5920KiB/29615msec) clat (usec): min=32, max=330239, avg=39577.22, stdev=37386.40 lat (usec): min=32, max=330241, avg=39604.68, stdev=37394.92 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 55], 10.00th=[ 63], 20.00th=[ 96], | 30.00th=[ 22676], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 80217], 95.00th=[ 92799], | 99.00th=[158335], 99.50th=[299893], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 415, per=24.82%, avg=200.58, stdev=90.33, samples=57 iops : min= 1, max= 25, avg=11.82, stdev= 5.74, samples=57 write: IOPS=13, BW=215KiB/s (220kB/s)(6368KiB/29615msec); 0 zone resets clat (usec): min=1467, max=325425, avg=37315.71, stdev=41376.94 lat (usec): min=1468, max=325428, avg=37320.43, stdev=41375.62 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1909], 10.00th=[ 3064], 20.00th=[ 6128], | 30.00th=[ 8455], 40.00th=[ 14877], 50.00th=[ 25297], 60.00th=[ 35914], | 70.00th=[ 47973], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[210764], 99.50th=[304088], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 28, max= 351, per=25.09%, avg=213.22, stdev=73.30, samples=58 iops : min= 1, max= 21, avg=12.59, stdev= 4.62, samples=58 lat (usec) : 50=1.82%, 100=7.94%, 250=0.39%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=3.39%, 4=3.39%, 10=10.94%, 20=7.94%, 50=34.51% lat (msec) : 100=24.22%, 250=4.30%, 500=0.52% cpu : usr=0.06%, sys=5.32%, ctx=1439, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145235: Tue May 19 12:07:51 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27842msec) clat (usec): min=32, max=495645, avg=42767.25, stdev=38141.84 lat (usec): min=32, max=495647, avg=42770.09, stdev=38141.47 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 17433], | 30.00th=[ 27395], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 79168], 95.00th=[ 89654], | 99.00th=[154141], 99.50th=[173016], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 59, max= 351, per=25.43%, avg=205.46, stdev=73.27, samples=54 iops : min= 3, max= 21, avg=12.09, stdev= 4.61, samples=54 write: IOPS=14, BW=235KiB/s (241kB/s)(6544KiB/27842msec); 0 zone resets clat (usec): min=1410, max=187173, avg=30044.70, stdev=31305.29 lat (usec): min=1411, max=187176, avg=30061.07, stdev=31294.61 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1811], 10.00th=[ 2180], 20.00th=[ 4424], | 30.00th=[ 7242], 40.00th=[ 10945], 50.00th=[ 16909], 60.00th=[ 27919], | 70.00th=[ 39060], 80.00th=[ 53740], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[115868], 99.50th=[133694], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 416, per=27.61%, avg=234.70, stdev=92.12, samples=54 iops : min= 3, max= 26, avg=13.94, stdev= 5.85, samples=54 lat (usec) : 50=0.52%, 100=6.77%, 250=0.39%, 750=0.13% lat (msec) : 2=4.95%, 4=5.08%, 10=10.55%, 20=9.24%, 50=34.64% lat (msec) : 100=24.09%, 250=3.52%, 500=0.13% cpu : usr=0.11%, sys=5.65%, ctx=1473, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145238: Tue May 19 12:07:51 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29124msec) clat (usec): min=33, max=219346, avg=39519.35, stdev=30591.65 lat (usec): min=33, max=219347, avg=39520.72, stdev=30591.63 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 17433], | 30.00th=[ 25560], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 43254], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[149947], 99.50th=[162530], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 63, max= 448, per=26.70%, avg=215.72, stdev=85.35, samples=57 iops : min= 3, max= 28, avg=12.75, stdev= 5.43, samples=57 write: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29124msec); 0 zone resets clat (usec): min=1431, max=223629, avg=35740.87, stdev=37776.31 lat (usec): min=1433, max=223631, avg=35743.24, stdev=37776.31 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1844], 10.00th=[ 2540], 20.00th=[ 5211], | 30.00th=[ 8586], 40.00th=[ 13566], 50.00th=[ 21627], 60.00th=[ 32113], | 70.00th=[ 47449], 80.00th=[ 63701], 90.00th=[ 91751], 95.00th=[107480], | 99.00th=[166724], 99.50th=[189793], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 411, per=24.09%, avg=204.75, stdev=78.32, samples=57 iops : min= 1, max= 25, avg=12.05, stdev= 4.95, samples=57 lat (usec) : 50=1.04%, 100=6.90%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.17%, 4=3.91%, 10=8.98%, 20=9.24%, 50=36.33% lat (msec) : 100=23.96%, 250=4.82% cpu : usr=0.10%, sys=5.74%, ctx=1508, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145240: Tue May 19 12:07:51 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29517msec) clat (usec): min=32, max=239304, avg=39987.28, stdev=37387.35 lat (usec): min=34, max=239305, avg=39988.94, stdev=37387.48 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 80], | 30.00th=[ 19792], 40.00th=[ 29230], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 79168], 95.00th=[105382], | 99.00th=[198181], 99.50th=[225444], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 32, max= 416, per=26.05%, avg=210.46, stdev=77.71, samples=56 iops : min= 2, max= 26, avg=12.41, stdev= 4.88, samples=56 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29517msec); 0 zone resets clat (usec): min=1415, max=318521, avg=36044.84, stdev=43362.06 lat (usec): min=1417, max=318524, avg=36047.09, stdev=43362.16 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1876], 10.00th=[ 2343], 20.00th=[ 6194], | 30.00th=[ 8848], 40.00th=[ 14615], 50.00th=[ 22414], 60.00th=[ 32637], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 79168], 95.00th=[111674], | 99.00th=[250610], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 29, max= 416, per=24.88%, avg=211.48, stdev=93.96, samples=58 iops : min= 1, max= 26, avg=12.48, stdev= 5.96, samples=58 lat (usec) : 50=1.56%, 100=9.90%, 250=0.52%, 500=0.13%, 750=0.13% lat (msec) : 2=4.04%, 4=3.91%, 10=9.38%, 20=9.24%, 50=31.51% lat (msec) : 100=23.44%, 250=5.73%, 500=0.52% cpu : usr=0.07%, sys=5.69%, ctx=1468, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=809KiB/s (828kB/s), 200KiB/s-215KiB/s (205kB/s-220kB/s), io=23.4MiB (24.5MB), run=27842-29615msec WRITE: bw=851KiB/s (871kB/s), 207KiB/s-235KiB/s (212kB/s-241kB/s), io=24.6MiB (25.8MB), run=27842-29615msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145234: Tue May 19 12:08:38 2026 read: IOPS=4, BW=77.8KiB/s (79.7kB/s)(5920KiB/76052msec) clat (msec): min=7, max=277, avg=47.19, stdev=37.87 lat (msec): min=7, max=277, avg=47.19, stdev=37.87 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 52], 80.00th=[ 61], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 239], 99.50th=[ 253], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 223, per=27.29%, avg=85.42, stdev=50.67, samples=136 iops : min= 1, max= 13, avg= 4.56, stdev= 3.23, samples=136 write: IOPS=5, BW=83.7KiB/s (85.7kB/s)(6368KiB/76052msec); 0 zone resets clat (msec): min=46, max=404, avg=147.10, stdev=58.08 lat (msec): min=46, max=404, avg=147.12, stdev=58.07 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 75], 10.00th=[ 85], 20.00th=[ 97], | 30.00th=[ 113], 40.00th=[ 124], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 169], 80.00th=[ 186], 90.00th=[ 226], 95.00th=[ 266], | 99.00th=[ 342], 99.50th=[ 372], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 159, per=25.86%, avg=85.07, stdev=32.16, samples=147 iops : min= 1, max= 9, avg= 4.54, stdev= 2.05, samples=147 lat (msec) : 10=0.52%, 20=7.81%, 50=25.00%, 100=23.83%, 250=39.58% lat (msec) : 500=3.26% cpu : usr=0.04%, sys=1.36%, ctx=1344, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145236: Tue May 19 12:08:38 2026 read: IOPS=4, BW=75.1KiB/s (76.9kB/s)(5744KiB/76475msec) clat (msec): min=8, max=299, avg=44.14, stdev=30.15 lat (msec): min=8, max=299, avg=44.14, stdev=30.15 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 51], 80.00th=[ 62], 90.00th=[ 78], 95.00th=[ 93], | 99.00th=[ 169], 99.50th=[ 203], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 319, per=28.04%, avg=87.76, stdev=57.52, samples=129 iops : min= 1, max= 19, avg= 4.67, stdev= 3.65, samples=129 write: IOPS=5, BW=85.6KiB/s (87.6kB/s)(6544KiB/76475msec); 0 zone resets clat (msec): min=42, max=483, avg=147.61, stdev=60.11 lat (msec): min=42, max=483, avg=147.62, stdev=60.11 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 75], 10.00th=[ 85], 20.00th=[ 102], | 30.00th=[ 111], 40.00th=[ 123], 50.00th=[ 134], 60.00th=[ 150], | 70.00th=[ 165], 80.00th=[ 186], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 334], 99.50th=[ 380], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 31, max= 160, per=26.54%, avg=87.31, stdev=31.75, samples=147 iops : min= 1, max= 10, avg= 4.63, stdev= 2.03, samples=147 lat (msec) : 10=0.39%, 20=8.20%, 50=24.09%, 100=22.01%, 250=41.28% lat (msec) : 500=4.04% cpu : usr=0.04%, sys=1.36%, ctx=1452, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145237: Tue May 19 12:08:38 2026 read: IOPS=5, BW=83.3KiB/s (85.3kB/s)(6256KiB/75059msec) clat (msec): min=7, max=300, avg=45.05, stdev=35.69 lat (msec): min=7, max=300, avg=45.05, stdev=35.69 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 41], | 70.00th=[ 48], 80.00th=[ 60], 90.00th=[ 78], 95.00th=[ 110], | 99.00th=[ 201], 99.50th=[ 218], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 318, per=29.43%, avg=92.12, stdev=62.63, samples=134 iops : min= 1, max= 19, avg= 4.98, stdev= 3.97, samples=134 write: IOPS=5, BW=80.4KiB/s (82.3kB/s)(6032KiB/75059msec); 0 zone resets clat (msec): min=55, max=491, avg=151.78, stdev=60.43 lat (msec): min=55, max=491, avg=151.78, stdev=60.43 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 82], 10.00th=[ 93], 20.00th=[ 107], | 30.00th=[ 116], 40.00th=[ 127], 50.00th=[ 138], 60.00th=[ 153], | 70.00th=[ 174], 80.00th=[ 190], 90.00th=[ 228], 95.00th=[ 257], | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 30, max= 159, per=24.47%, avg=80.51, stdev=30.93, samples=147 iops : min= 1, max= 9, avg= 4.25, stdev= 1.99, samples=147 lat (msec) : 10=0.52%, 20=7.42%, 50=29.69%, 100=17.58%, 250=41.67% lat (msec) : 500=3.12% cpu : usr=0.03%, sys=1.33%, ctx=1423, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145239: Tue May 19 12:08:38 2026 read: IOPS=4, BW=79.7KiB/s (81.6kB/s)(6032KiB/75662msec) clat (msec): min=7, max=176, avg=44.11, stdev=30.54 lat (msec): min=7, max=176, avg=44.11, stdev=30.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 49], 80.00th=[ 62], 90.00th=[ 88], 95.00th=[ 106], | 99.00th=[ 161], 99.50th=[ 176], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 29, max= 255, per=28.50%, avg=89.20, stdev=55.53, samples=132 iops : min= 1, max= 15, avg= 4.80, stdev= 3.49, samples=132 write: IOPS=5, BW=82.7KiB/s (84.7kB/s)(6256KiB/75662msec); 0 zone resets clat (msec): min=54, max=364, avg=150.65, stdev=56.08 lat (msec): min=54, max=364, avg=150.65, stdev=56.08 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 78], 10.00th=[ 89], 20.00th=[ 104], | 30.00th=[ 116], 40.00th=[ 129], 50.00th=[ 140], 60.00th=[ 155], | 70.00th=[ 171], 80.00th=[ 197], 90.00th=[ 226], 95.00th=[ 257], | 99.00th=[ 317], 99.50th=[ 359], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 159, per=25.23%, avg=83.00, stdev=30.30, samples=148 iops : min= 1, max= 9, avg= 4.41, stdev= 1.95, samples=148 lat (msec) : 10=0.78%, 20=8.20%, 50=25.91%, 100=20.31%, 250=41.54% lat (msec) : 500=3.26% cpu : usr=0.04%, sys=1.41%, ctx=1415, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=313KiB/s (321kB/s), 75.1KiB/s-83.3KiB/s (76.9kB/s-85.3kB/s), io=23.4MiB (24.5MB), run=75059-76475msec WRITE: bw=330KiB/s (337kB/s), 80.4KiB/s-85.6KiB/s (82.3kB/s-87.6kB/s), io=24.6MiB (25.8MB), run=75059-76475msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145267: Tue May 19 12:08:56 2026 read: IOPS=2, BW=2434KiB/s (2492kB/s)(7168KiB/2945msec) clat (msec): min=81, max=180, avg=126.89, stdev=38.55 lat (msec): min=81, max=180, avg=126.89, stdev=38.55 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 87], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 130], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 2035, max= 4962, per=96.76%, avg=3668.00, stdev=1492.66, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1739KiB/s (1780kB/s)(5120KiB/2945msec); 0 zone resets clat (msec): min=239, max=767, avg=404.91, stdev=213.15 lat (msec): min=239, max=767, avg=405.01, stdev=213.15 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1654, max= 2043, per=36.49%, avg=1936.75, stdev=188.87, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.03%, sys=3.02%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145268: Tue May 19 12:08:56 2026 read: IOPS=0, BW=379KiB/s (388kB/s)(2048KiB/5402msec) clat (msec): min=61, max=150, avg=105.96, stdev=62.70 lat (msec): min=61, max=150, avg=105.96, stdev=62.70 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 62], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 1721, max= 1914, per=47.94%, avg=1817.50, stdev=136.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1896KiB/s (1941kB/s)(10.0MiB/5402msec); 0 zone resets clat (msec): min=277, max=876, avg=511.26, stdev=252.10 lat (msec): min=277, max=876, avg=512.62, stdev=251.34 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 300], | 30.00th=[ 321], 40.00th=[ 342], 50.00th=[ 372], 60.00th=[ 376], | 70.00th=[ 542], 80.00th=[ 835], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1721, max= 4096, per=48.04%, avg=2549.57, stdev=1040.24, samples=7 iops : min= 1, max= 4, avg= 1.71, stdev= 1.25, samples=7 lat (msec) : 100=8.33%, 250=8.33%, 500=50.00%, 750=8.33%, 1000=25.00% cpu : usr=0.00%, sys=3.20%, ctx=69, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145269: Tue May 19 12:08:56 2026 read: IOPS=1, BW=1412KiB/s (1446kB/s)(6144KiB/4352msec) clat (msec): min=60, max=565, avg=275.37, stdev=176.91 lat (msec): min=60, max=565, avg=275.37, stdev=176.91 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 292], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2039, max= 4031, per=87.03%, avg=3299.33, stdev=1096.19, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1412KiB/s (1446kB/s)(6144KiB/4352msec); 0 zone resets clat (msec): min=244, max=782, avg=434.10, stdev=199.83 lat (msec): min=244, max=782, avg=434.20, stdev=199.83 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 351], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1633, max= 2043, per=37.05%, avg=1966.00, stdev=163.83, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.05%, sys=2.51%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145270: Tue May 19 12:08:56 2026 read: IOPS=1, BW=1184KiB/s (1212kB/s)(5120KiB/4326msec) clat (msec): min=103, max=515, avg=241.09, stdev=167.67 lat (msec): min=103, max=515, avg=241.09, stdev=167.67 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 3828, max= 4071, per=100.00%, avg=3949.50, stdev=171.83, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1657KiB/s (1697kB/s)(7168KiB/4326msec); 0 zone resets clat (msec): min=152, max=595, avg=438.11, stdev=191.34 lat (msec): min=153, max=595, avg=438.21, stdev=191.35 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 171], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 550], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1777, max= 2043, per=37.43%, avg=1986.67, stdev=104.03, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=41.67%, 500=16.67%, 750=41.67% cpu : usr=0.02%, sys=2.87%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3791KiB/s (3882kB/s), 379KiB/s-2434KiB/s (388kB/s-2492kB/s), io=20.0MiB (20.0MB), run=2945-5402msec WRITE: bw=5308KiB/s (5435kB/s), 1412KiB/s-1896KiB/s (1446kB/s-1941kB/s), io=28.0MiB (29.4MB), run=2945-5402msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145272: Tue May 19 12:08:57 2026 read: IOPS=1, BW=1898KiB/s (1943kB/s)(7168KiB/3777msec) clat (usec): min=518, max=594462, avg=205713.57, stdev=230576.50 lat (usec): min=520, max=594464, avg=205715.08, stdev=230576.62 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 1319], | 30.00th=[ 9241], 40.00th=[ 9241], 50.00th=[170918], 60.00th=[252707], | 70.00th=[252707], 80.00th=[408945], 90.00th=[591397], 95.00th=[591397], | 99.00th=[591397], 99.50th=[591397], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 1393, max= 4055, per=73.74%, avg=3159.67, stdev=1530.03, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1356KiB/s (1388kB/s)(5120KiB/3777msec); 0 zone resets clat (msec): min=190, max=618, avg=466.17, stdev=172.76 lat (msec): min=190, max=618, avg=466.32, stdev=172.84 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1935, max= 2048, per=33.37%, avg=2002.00, stdev=59.35, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=16.67%, 500=33.33%, 750=25.00% cpu : usr=0.00%, sys=8.00%, ctx=120, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145273: Tue May 19 12:08:57 2026 read: IOPS=0, BW=429KiB/s (439kB/s)(2048KiB/4779msec) clat (msec): min=220, max=234, avg=227.59, stdev=10.36 lat (msec): min=220, max=234, avg=227.60, stdev=10.36 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 1943, max= 1992, per=45.92%, avg=1967.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2143KiB/s (2194kB/s)(10.0MiB/4779msec); 0 zone resets clat (msec): min=101, max=718, avg=432.17, stdev=203.95 lat (msec): min=101, max=719, avg=432.28, stdev=203.94 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 161], | 30.00th=[ 268], 40.00th=[ 393], 50.00th=[ 430], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 592], 90.00th=[ 634], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1965, max= 4071, per=38.55%, avg=2312.57, stdev=775.92, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=41.67% cpu : usr=0.00%, sys=10.21%, ctx=149, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145274: Tue May 19 12:08:57 2026 read: IOPS=1, BW=1541KiB/s (1578kB/s)(6144KiB/3988msec) clat (msec): min=135, max=324, avg=229.99, stdev=66.19 lat (msec): min=135, max=324, avg=229.99, stdev=66.19 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 251], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1943, max= 3930, per=57.92%, avg=2481.75, stdev=966.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1541KiB/s (1578kB/s)(6144KiB/3988msec); 0 zone resets clat (msec): min=163, max=1183, avg=433.46, stdev=382.02 lat (msec): min=163, max=1183, avg=434.39, stdev=381.95 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 401], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1965, max= 4063, per=42.02%, avg=2520.50, stdev=1028.80, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=50.00%, 2000=8.33% cpu : usr=0.00%, sys=11.16%, ctx=232, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145275: Tue May 19 12:08:57 2026 read: IOPS=1, BW=1219KiB/s (1248kB/s)(5120KiB/4201msec) clat (usec): min=554, max=251869, avg=59181.85, stdev=108521.27 lat (usec): min=572, max=251870, avg=59186.31, stdev=108519.16 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[ 3163], 40.00th=[ 3163], 50.00th=[ 6783], 60.00th=[ 6783], | 70.00th=[ 33424], 80.00th=[ 33424], 90.00th=[252707], 95.00th=[252707], | 99.00th=[252707], 99.50th=[252707], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7742, max= 7742, per=100.00%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1706KiB/s (1747kB/s)(7168KiB/4201msec); 0 zone resets clat (msec): min=101, max=1039, avg=556.87, stdev=335.99 lat (msec): min=101, max=1039, avg=556.99, stdev=335.98 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 232], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 584], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 852], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 1556, max= 2023, per=31.68%, avg=1900.40, stdev=195.73, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 50=8.33%, 250=16.67%, 500=16.67% lat (msec) : 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=7.10%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4285KiB/s (4388kB/s), 429KiB/s-1898KiB/s (439kB/s-1943kB/s), io=20.0MiB (20.0MB), run=3777-4779msec WRITE: bw=6000KiB/s (6144kB/s), 1356KiB/s-2143KiB/s (1388kB/s-2194kB/s), io=28.0MiB (29.4MB), run=3777-4779msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145283: Tue May 19 12:09:09 2026 read: IOPS=0, BW=3350KiB/s (3430kB/s)(12.0MiB/3668msec) clat (msec): min=231, max=1826, avg=1151.29, stdev=825.12 lat (msec): min=231, max=1826, avg=1151.30, stdev=825.12 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.50%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145285: Tue May 19 12:09:09 2026 read: IOPS=0, BW=1240KiB/s (1270kB/s)(4096KiB/3302msec) clat (nsec): min=1118.6M, max=1118.6M, avg=1118595570.00, stdev= 0.00 lat (nsec): min=1118.6M, max=1118.6M, avg=1118597721.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2481KiB/s (2540kB/s)(8192KiB/3302msec); 0 zone resets clat (msec): min=511, max=1619, avg=1065.42, stdev=783.04 lat (msec): min=511, max=1619, avg=1065.75, stdev=783.27 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8175, max= 8175, per=82.38%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.39%, ctx=31, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145287: Tue May 19 12:09:09 2026 write: IOPS=1, BW=4941KiB/s (5059kB/s)(12.0MiB/2487msec); 0 zone resets clat (msec): min=422, max=1223, avg=800.46, stdev=402.52 lat (msec): min=423, max=1223, avg=801.21, stdev=402.01 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8000, max= 8110, per=81.18%, avg=8055.00, stdev=77.78, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.95%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145288: Tue May 19 12:09:09 2026 write: IOPS=1, BW=4367KiB/s (4472kB/s)(12.0MiB/2814msec); 0 zone resets clat (msec): min=348, max=1725, avg=827.35, stdev=778.43 lat (msec): min=349, max=1725, avg=827.74, stdev=778.26 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 5483, max= 8110, per=68.49%, avg=6796.50, stdev=1857.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.19%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4467KiB/s (4574kB/s), 1240KiB/s-3350KiB/s (1270kB/s-3430kB/s), io=16.0MiB (16.8MB), run=3302-3668msec WRITE: bw=9924KiB/s (10.2MB/s), 2481KiB/s-4941KiB/s (2540kB/s-5059kB/s), io=32.0MiB (33.6MB), run=2487-3302msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145284: Tue May 19 12:09:09 2026 read: IOPS=1, BW=4180KiB/s (4280kB/s)(12.0MiB/2940msec) clat (msec): min=677, max=1127, avg=881.04, stdev=228.08 lat (msec): min=677, max=1127, avg=881.04, stdev=228.08 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7892, max= 8126, per=100.00%, avg=8009.00, stdev=165.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.19%, ctx=357, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145286: Tue May 19 12:09:09 2026 read: IOPS=0, BW=1400KiB/s (1433kB/s)(4096KiB/2926msec) clat (nsec): min=767428k, max=767428k, avg=767428180.00, stdev= 0.00 lat (nsec): min=767432k, max=767432k, avg=767431765.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2800KiB/s (2867kB/s)(8192KiB/2926msec); 0 zone resets clat (msec): min=305, max=1618, avg=962.01, stdev=928.43 lat (msec): min=305, max=1618, avg=962.41, stdev=928.39 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.58%, ctx=177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145289: Tue May 19 12:09:09 2026 write: IOPS=0, BW=2968KiB/s (3039kB/s)(12.0MiB/4140msec); 0 zone resets clat (msec): min=302, max=2667, avg=1363.51, stdev=1200.70 lat (msec): min=303, max=2668, avg=1364.39, stdev=1201.45 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 2668], 80.00th=[ 2668], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.45%, ctx=40, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145290: Tue May 19 12:09:09 2026 write: IOPS=0, BW=3903KiB/s (3997kB/s)(12.0MiB/3148msec); 0 zone resets clat (msec): min=462, max=1683, avg=943.66, stdev=650.54 lat (msec): min=463, max=1684, avg=944.14, stdev=650.65 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8062, max= 8126, per=100.00%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.02%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5573KiB/s (5707kB/s), 1400KiB/s-4180KiB/s (1433kB/s-4280kB/s), io=16.0MiB (16.8MB), run=2926-2940msec WRITE: bw=7915KiB/s (8105kB/s), 2800KiB/s-3903KiB/s (2867kB/s-3997kB/s), io=32.0MiB (33.6MB), run=2926-4140msec