== sanity test 398b: DIO and buffer IO race ============== 23:41:14 (1790394074) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.51724 s, 20.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147861: Fri Sep 25 23:42:20 2026 read: IOPS=26, BW=108KiB/s (111kB/s)(5992KiB/55526msec) clat (usec): min=39, max=686952, avg=19045.86, stdev=20414.79 lat (usec): min=40, max=686952, avg=19048.58, stdev=20414.58 clat percentiles (usec): | 1.00th=[ 111], 5.00th=[ 5014], 10.00th=[ 7832], 20.00th=[ 10421], | 30.00th=[ 12518], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22414], 80.00th=[ 25822], 90.00th=[ 31327], 95.00th=[ 38536], | 99.00th=[ 54789], 99.50th=[ 67634], 99.90th=[ 98042], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 47, max= 207, per=25.23%, avg=108.49, stdev=33.47, samples=109 iops : min= 11, max= 51, avg=26.64, stdev= 8.40, samples=109 write: IOPS=28, BW=113KiB/s (116kB/s)(6296KiB/55526msec); 0 zone resets clat (usec): min=601, max=96107, avg=17116.42, stdev=13589.52 lat (usec): min=602, max=96109, avg=17118.39, stdev=13589.89 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 2442], 10.00th=[ 3359], 20.00th=[ 5080], | 30.00th=[ 7308], 40.00th=[10421], 50.00th=[14484], 60.00th=[17695], | 70.00th=[21627], 80.00th=[27395], 90.00th=[35390], 95.00th=[43254], | 99.00th=[61080], 99.50th=[71828], 99.90th=[87557], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 23, max= 224, per=25.38%, avg=114.23, stdev=35.49, samples=109 iops : min= 5, max= 56, avg=28.07, stdev= 8.89, samples=109 lat (usec) : 50=0.03%, 100=0.39%, 250=1.40%, 500=0.26%, 750=0.20% lat (usec) : 1000=0.39% lat (msec) : 2=1.20%, 4=5.34%, 10=19.43%, 20=35.81%, 50=33.53% lat (msec) : 100=1.99%, 750=0.03% cpu : usr=0.11%, sys=28.77%, ctx=9193, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147862: Fri Sep 25 23:42:20 2026 read: IOPS=26, BW=106KiB/s (109kB/s)(5940KiB/55779msec) clat (usec): min=36, max=655974, avg=19616.80, stdev=20388.01 lat (usec): min=37, max=655975, avg=19619.85, stdev=20388.64 clat percentiles (usec): | 1.00th=[ 88], 5.00th=[ 5342], 10.00th=[ 7767], 20.00th=[ 10159], | 30.00th=[ 12518], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22938], 80.00th=[ 27132], 90.00th=[ 33162], 95.00th=[ 39060], | 99.00th=[ 64226], 99.50th=[ 79168], 99.90th=[117965], 99.95th=[658506], | 99.99th=[658506] bw ( KiB/s): min= 16, max= 255, per=24.87%, avg=106.94, stdev=36.82, samples=110 iops : min= 4, max= 63, avg=26.25, stdev= 9.16, samples=110 write: IOPS=28, BW=114KiB/s (117kB/s)(6348KiB/55779msec); 0 zone resets clat (usec): min=649, max=98773, avg=16758.88, stdev=13327.34 lat (usec): min=650, max=98774, avg=16760.05, stdev=13327.34 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 2212], 10.00th=[ 3163], 20.00th=[ 4948], | 30.00th=[ 7242], 40.00th=[10552], 50.00th=[13829], 60.00th=[17171], | 70.00th=[21103], 80.00th=[26608], 90.00th=[34866], 95.00th=[42206], | 99.00th=[59507], 99.50th=[67634], 99.90th=[94897], 99.95th=[99091], | 99.99th=[99091] bw ( KiB/s): min= 40, max= 240, per=25.32%, avg=113.95, stdev=39.02, samples=110 iops : min= 10, max= 60, avg=28.01, stdev= 9.81, samples=110 lat (usec) : 50=0.10%, 100=0.52%, 250=1.33%, 500=0.10%, 750=0.16% lat (usec) : 1000=0.33% lat (msec) : 2=1.56%, 4=5.63%, 10=19.24%, 20=35.45%, 50=33.43% lat (msec) : 100=2.08%, 250=0.03%, 750=0.03% cpu : usr=0.12%, sys=28.60%, ctx=9211, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147863: Fri Sep 25 23:42:20 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(6028KiB/55529msec) clat (usec): min=28, max=122239, avg=18764.87, stdev=11321.61 lat (usec): min=28, max=122240, avg=18766.06, stdev=11321.65 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 5014], 10.00th=[ 8094], 20.00th=[ 10552], | 30.00th=[ 12780], 40.00th=[ 14746], 50.00th=[ 16712], 60.00th=[ 19006], | 70.00th=[ 21890], 80.00th=[ 25822], 90.00th=[ 32113], 95.00th=[ 37487], | 99.00th=[ 60031], 99.50th=[ 66847], 99.90th=[ 87557], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 55, max= 216, per=25.37%, avg=109.10, stdev=33.15, samples=109 iops : min= 13, max= 54, avg=26.79, stdev= 8.32, samples=109 write: IOPS=28, BW=113KiB/s (115kB/s)(6260KiB/55529msec); 0 zone resets clat (usec): min=640, max=667772, avg=17383.59, stdev=20982.90 lat (usec): min=642, max=667774, avg=17385.63, stdev=20983.24 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 2573], 10.00th=[ 3425], 20.00th=[ 5473], | 30.00th=[ 7701], 40.00th=[ 11338], 50.00th=[ 14353], 60.00th=[ 17695], | 70.00th=[ 21365], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 41157], | 99.00th=[ 56361], 99.50th=[ 66847], 99.90th=[133694], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 15, max= 240, per=25.15%, avg=113.16, stdev=37.04, samples=109 iops : min= 3, max= 60, avg=27.82, stdev= 9.32, samples=109 lat (usec) : 50=0.07%, 100=0.23%, 250=1.73%, 500=0.16%, 750=0.23% lat (usec) : 1000=0.29% lat (msec) : 2=1.04%, 4=4.65%, 10=18.59%, 20=38.31%, 50=33.04% lat (msec) : 100=1.53%, 250=0.10%, 750=0.03% cpu : usr=0.13%, sys=28.78%, ctx=9280, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147864: Fri Sep 25 23:42:20 2026 read: IOPS=27, BW=109KiB/s (111kB/s)(6052KiB/55725msec) clat (usec): min=24, max=130102, avg=18949.93, stdev=11770.08 lat (usec): min=24, max=130102, avg=18951.86, stdev=11769.80 clat percentiles (usec): | 1.00th=[ 109], 5.00th=[ 5604], 10.00th=[ 7570], 20.00th=[ 10421], | 30.00th=[ 12518], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19268], | 70.00th=[ 22938], 80.00th=[ 26346], 90.00th=[ 32375], 95.00th=[ 38011], | 99.00th=[ 57410], 99.50th=[ 68682], 99.90th=[129500], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 32, max= 239, per=25.41%, avg=109.25, stdev=34.99, samples=110 iops : min= 8, max= 59, avg=26.83, stdev= 8.75, samples=110 write: IOPS=27, BW=112KiB/s (115kB/s)(6236KiB/55725msec); 0 zone resets clat (usec): min=639, max=665321, avg=17323.10, stdev=21208.44 lat (usec): min=641, max=665322, avg=17324.42, stdev=21208.40 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 2245], 10.00th=[ 3064], 20.00th=[ 5080], | 30.00th=[ 7635], 40.00th=[ 10814], 50.00th=[ 14222], 60.00th=[ 17433], | 70.00th=[ 21103], 80.00th=[ 26608], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 61604], 99.50th=[ 72877], 99.90th=[ 94897], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 55, max= 247, per=25.02%, avg=112.59, stdev=39.72, samples=110 iops : min= 13, max= 61, avg=27.66, stdev= 9.95, samples=110 lat (usec) : 50=0.07%, 100=0.36%, 250=1.43%, 500=0.10%, 750=0.20% lat (usec) : 1000=0.23% lat (msec) : 2=1.56%, 4=5.47%, 10=18.91%, 20=36.26%, 50=33.27% lat (msec) : 100=2.02%, 250=0.10%, 750=0.03% cpu : usr=0.13%, sys=28.53%, ctx=9275, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=430KiB/s (441kB/s), 106KiB/s-109KiB/s (109kB/s-111kB/s), io=23.4MiB (24.6MB), run=55526-55779msec WRITE: bw=451KiB/s (462kB/s), 112KiB/s-114KiB/s (115kB/s-117kB/s), io=24.6MiB (25.7MB), run=55526-55779msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147856: Fri Sep 25 23:42:38 2026 read: IOPS=20, BW=81.1KiB/s (83.1kB/s)(5992KiB/73857msec) clat (msec): min=2, max=747, avg=15.30, stdev=24.83 lat (msec): min=2, max=747, avg=15.31, stdev=24.83 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 9], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 35], 95.00th=[ 48], | 99.00th=[ 78], 99.50th=[ 96], 99.90th=[ 136], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 15, max= 224, per=25.44%, avg=82.17, stdev=53.44, samples=145 iops : min= 3, max= 56, avg=20.22, stdev=13.51, samples=145 write: IOPS=21, BW=85.2KiB/s (87.3kB/s)(6296KiB/73857msec); 0 zone resets clat (msec): min=11, max=175, avg=32.23, stdev=18.35 lat (msec): min=11, max=175, avg=32.23, stdev=18.35 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 46], 90.00th=[ 56], 95.00th=[ 68], | 99.00th=[ 95], 99.50th=[ 113], 99.90th=[ 138], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 7, max= 192, per=25.32%, avg=85.60, stdev=50.76, samples=146 iops : min= 1, max= 48, avg=21.08, stdev=12.86, samples=146 lat (msec) : 4=11.69%, 10=14.00%, 20=26.60%, 50=37.73%, 100=9.38% lat (msec) : 250=0.59%, 750=0.03% cpu : usr=0.09%, sys=9.57%, ctx=5779, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147857: Fri Sep 25 23:42:38 2026 read: IOPS=20, BW=80.1KiB/s (82.0kB/s)(5940KiB/74136msec) clat (msec): min=2, max=711, avg=15.38, stdev=24.06 lat (msec): min=2, max=711, avg=15.38, stdev=24.06 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 9], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 49], | 99.00th=[ 79], 99.50th=[ 91], 99.90th=[ 131], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 15, max= 248, per=24.82%, avg=80.16, stdev=54.40, samples=146 iops : min= 3, max= 62, avg=19.72, stdev=13.73, samples=146 write: IOPS=21, BW=85.6KiB/s (87.7kB/s)(6348KiB/74136msec); 0 zone resets clat (msec): min=11, max=143, avg=32.20, stdev=17.97 lat (msec): min=11, max=143, avg=32.20, stdev=17.97 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 67], | 99.00th=[ 89], 99.50th=[ 113], 99.90th=[ 140], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 192, per=25.26%, avg=85.38, stdev=49.63, samples=146 iops : min= 7, max= 48, avg=21.02, stdev=12.58, samples=146 lat (msec) : 4=10.90%, 10=14.42%, 20=26.20%, 50=38.15%, 100=9.90% lat (msec) : 250=0.39%, 750=0.03% cpu : usr=0.09%, sys=9.62%, ctx=5718, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147858: Fri Sep 25 23:42:38 2026 read: IOPS=20, BW=81.1KiB/s (83.1kB/s)(6028KiB/74312msec) clat (msec): min=2, max=134, avg=15.09, stdev=16.03 lat (msec): min=2, max=134, avg=15.09, stdev=16.03 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 48], | 99.00th=[ 73], 99.50th=[ 92], 99.90th=[ 121], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 15, max= 264, per=25.22%, avg=81.47, stdev=52.51, samples=147 iops : min= 3, max= 66, avg=20.05, stdev=13.29, samples=147 write: IOPS=21, BW=84.2KiB/s (86.3kB/s)(6260KiB/74312msec); 0 zone resets clat (msec): min=10, max=715, avg=32.83, stdev=25.81 lat (msec): min=10, max=715, avg=32.83, stdev=25.81 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 46], 90.00th=[ 57], 95.00th=[ 70], | 99.00th=[ 102], 99.50th=[ 127], 99.90th=[ 171], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 15, max= 232, per=25.02%, avg=84.58, stdev=51.77, samples=147 iops : min= 3, max= 58, avg=20.82, stdev=13.11, samples=147 lat (msec) : 4=10.97%, 10=14.36%, 20=26.95%, 50=37.86%, 100=9.21% lat (msec) : 250=0.62%, 750=0.03% cpu : usr=0.09%, sys=9.61%, ctx=5823, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147859: Fri Sep 25 23:42:38 2026 read: IOPS=20, BW=81.8KiB/s (83.7kB/s)(6052KiB/73997msec) clat (msec): min=2, max=121, avg=15.29, stdev=16.27 lat (msec): min=2, max=121, avg=15.29, stdev=16.27 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 5], 40.00th=[ 6], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 49], | 99.00th=[ 80], 99.50th=[ 85], 99.90th=[ 116], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 8, max= 240, per=25.38%, avg=81.98, stdev=52.72, samples=146 iops : min= 2, max= 60, avg=20.17, stdev=13.34, samples=146 write: IOPS=21, BW=84.3KiB/s (86.3kB/s)(6236KiB/73997msec); 0 zone resets clat (msec): min=11, max=715, avg=32.49, stdev=24.72 lat (msec): min=11, max=715, avg=32.49, stdev=24.72 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 67], | 99.00th=[ 95], 99.50th=[ 107], 99.90th=[ 136], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 24, max= 192, per=24.97%, avg=84.39, stdev=48.87, samples=146 iops : min= 6, max= 48, avg=20.77, stdev=12.39, samples=146 lat (msec) : 4=10.48%, 10=14.75%, 20=26.11%, 50=38.96%, 100=9.15% lat (msec) : 250=0.52%, 750=0.03% cpu : usr=0.08%, sys=9.76%, ctx=5719, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=323KiB/s (331kB/s), 80.1KiB/s-81.8KiB/s (82.0kB/s-83.7kB/s), io=23.4MiB (24.6MB), run=73857-74312msec WRITE: bw=338KiB/s (346kB/s), 84.2KiB/s-85.6KiB/s (86.3kB/s-87.7kB/s), io=24.6MiB (25.7MB), run=73857-74312msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147892: Fri Sep 25 23:42:56 2026 read: IOPS=30, BW=482KiB/s (494kB/s)(5920KiB/12278msec) clat (usec): min=27, max=105405, avg=16286.46, stdev=12993.34 lat (usec): min=28, max=105405, avg=16296.46, stdev=12994.10 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 91], 10.00th=[ 112], 20.00th=[ 7373], | 30.00th=[ 10159], 40.00th=[ 12387], 50.00th=[ 14877], 60.00th=[ 17433], | 70.00th=[ 20055], 80.00th=[ 23987], 90.00th=[ 30278], 95.00th=[ 38011], | 99.00th=[ 64226], 99.50th=[ 76022], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 223, max= 864, per=24.52%, avg=473.71, stdev=179.30, samples=24 iops : min= 13, max= 54, avg=29.29, stdev=11.32, samples=24 write: IOPS=32, BW=519KiB/s (531kB/s)(6368KiB/12278msec); 0 zone resets clat (usec): min=994, max=104901, avg=15406.09, stdev=12623.56 lat (usec): min=995, max=104903, avg=15407.56, stdev=12623.75 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2802], 10.00th=[ 3392], 20.00th=[ 4359], | 30.00th=[ 6652], 40.00th=[ 9241], 50.00th=[ 11863], 60.00th=[ 16188], | 70.00th=[ 20579], 80.00th=[ 25035], 90.00th=[ 31065], 95.00th=[ 39060], | 99.00th=[ 62653], 99.50th=[ 65274], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 221, max= 736, per=25.35%, avg=515.38, stdev=158.25, samples=24 iops : min= 13, max= 46, avg=31.88, stdev=10.04, samples=24 lat (usec) : 50=0.39%, 100=3.52%, 250=3.52%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=0.78%, 4=8.07%, 10=19.40%, 20=33.20%, 50=28.65% lat (msec) : 100=1.69%, 250=0.26% cpu : usr=0.11%, sys=30.66%, ctx=2360, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147893: Fri Sep 25 23:42:56 2026 read: IOPS=28, BW=463KiB/s (475kB/s)(5744KiB/12395msec) clat (usec): min=39, max=71423, avg=16658.52, stdev=11280.92 lat (usec): min=40, max=71424, avg=16659.15, stdev=11281.00 clat percentiles (usec): | 1.00th=[ 70], 5.00th=[ 111], 10.00th=[ 161], 20.00th=[ 8225], | 30.00th=[10683], 40.00th=[12125], 50.00th=[14877], 60.00th=[17433], | 70.00th=[21103], 80.00th=[25035], 90.00th=[32113], 95.00th=[39060], | 99.00th=[45876], 99.50th=[53216], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 55, max= 768, per=23.62%, avg=456.42, stdev=161.09, samples=24 iops : min= 3, max= 48, avg=28.21, stdev=10.09, samples=24 write: IOPS=32, BW=528KiB/s (541kB/s)(6544KiB/12395msec); 0 zone resets clat (usec): min=905, max=69222, avg=15323.52, stdev=12952.37 lat (usec): min=906, max=69223, avg=15324.64, stdev=12952.47 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2671], 10.00th=[ 3589], 20.00th=[ 4490], | 30.00th=[ 6194], 40.00th=[ 8979], 50.00th=[11731], 60.00th=[14615], | 70.00th=[19006], 80.00th=[24249], 90.00th=[32113], 95.00th=[41681], | 99.00th=[63701], 99.50th=[65274], 99.90th=[69731], 99.95th=[69731], | 99.99th=[69731] bw ( KiB/s): min= 223, max= 832, per=25.06%, avg=509.42, stdev=187.82, samples=24 iops : min= 13, max= 52, avg=31.50, stdev=11.89, samples=24 lat (usec) : 50=0.26%, 100=1.43%, 250=3.78%, 1000=0.26% lat (msec) : 2=1.82%, 4=5.86%, 10=22.14%, 20=34.77%, 50=27.99% lat (msec) : 100=1.69% cpu : usr=0.10%, sys=30.43%, ctx=2380, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147894: Fri Sep 25 23:42:56 2026 read: IOPS=32, BW=524KiB/s (536kB/s)(6256KiB/11944msec) clat (usec): min=50, max=61171, avg=16362.99, stdev=11360.86 lat (usec): min=51, max=61172, avg=16363.76, stdev=11360.89 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 102], 10.00th=[ 124], 20.00th=[ 8717], | 30.00th=[10552], 40.00th=[12518], 50.00th=[14615], 60.00th=[17433], | 70.00th=[19792], 80.00th=[23725], 90.00th=[31327], 95.00th=[39584], | 99.00th=[50070], 99.50th=[56361], 99.90th=[61080], 99.95th=[61080], | 99.99th=[61080] bw ( KiB/s): min= 160, max= 862, per=27.07%, avg=523.00, stdev=196.54, samples=23 iops : min= 10, max= 53, avg=32.35, stdev=12.31, samples=23 write: IOPS=31, BW=505KiB/s (517kB/s)(6032KiB/11944msec); 0 zone resets clat (usec): min=837, max=76020, avg=14637.91, stdev=12346.84 lat (usec): min=838, max=76021, avg=14639.17, stdev=12346.91 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 2114], 10.00th=[ 3163], 20.00th=[ 4146], | 30.00th=[ 5407], 40.00th=[ 8094], 50.00th=[12256], 60.00th=[14615], | 70.00th=[17695], 80.00th=[23725], 90.00th=[31065], 95.00th=[38536], | 99.00th=[55837], 99.50th=[62129], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 223, max= 768, per=24.20%, avg=492.04, stdev=169.24, samples=23 iops : min= 13, max= 48, avg=30.43, stdev=10.69, samples=23 lat (usec) : 100=2.34%, 250=4.04%, 500=0.13%, 1000=0.91% lat (msec) : 2=1.30%, 4=6.77%, 10=19.27%, 20=38.28%, 50=25.39% lat (msec) : 100=1.56% cpu : usr=0.09%, sys=31.05%, ctx=2409, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147895: Fri Sep 25 23:42:56 2026 read: IOPS=31, BW=510KiB/s (522kB/s)(6032KiB/11824msec) clat (usec): min=34, max=82044, avg=15995.33, stdev=12567.72 lat (usec): min=34, max=82045, avg=15996.24, stdev=12567.41 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 91], 10.00th=[ 110], 20.00th=[ 6915], | 30.00th=[ 9765], 40.00th=[12256], 50.00th=[14091], 60.00th=[16712], | 70.00th=[19268], 80.00th=[24249], 90.00th=[33817], 95.00th=[39060], | 99.00th=[56886], 99.50th=[69731], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 193, max= 832, per=25.90%, avg=500.39, stdev=189.76, samples=23 iops : min= 12, max= 52, avg=30.96, stdev=11.99, samples=23 write: IOPS=33, BW=529KiB/s (542kB/s)(6256KiB/11824msec); 0 zone resets clat (usec): min=784, max=92560, avg=14563.53, stdev=13356.90 lat (usec): min=784, max=92562, avg=14566.88, stdev=13355.85 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 2147], 10.00th=[ 3294], 20.00th=[ 4047], | 30.00th=[ 5014], 40.00th=[ 7504], 50.00th=[10552], 60.00th=[14091], | 70.00th=[17695], 80.00th=[22938], 90.00th=[32637], 95.00th=[38536], | 99.00th=[68682], 99.50th=[86508], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 221, max= 832, per=25.90%, avg=526.57, stdev=192.99, samples=23 iops : min= 13, max= 52, avg=32.57, stdev=12.11, samples=23 lat (usec) : 50=0.26%, 100=3.26%, 250=5.08%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.78% lat (msec) : 2=1.56%, 4=7.81%, 10=20.05%, 20=33.59%, 50=25.26% lat (msec) : 100=1.95% cpu : usr=0.10%, sys=31.13%, ctx=2197, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1932KiB/s (1979kB/s), 463KiB/s-524KiB/s (475kB/s-536kB/s), io=23.4MiB (24.5MB), run=11824-12395msec WRITE: bw=2033KiB/s (2082kB/s), 505KiB/s-529KiB/s (517kB/s-542kB/s), io=24.6MiB (25.8MB), run=11824-12395msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147888: Fri Sep 25 23:43:02 2026 read: IOPS=19, BW=312KiB/s (319kB/s)(5920KiB/18978msec) clat (msec): min=2, max=118, avg=14.58, stdev=16.53 lat (msec): min=2, max=118, avg=14.58, stdev=16.53 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 22], 90.00th=[ 33], 95.00th=[ 52], | 99.00th=[ 84], 99.50th=[ 89], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 96, max= 800, per=24.26%, avg=305.62, stdev=161.64, samples=37 iops : min= 6, max= 50, avg=18.76, stdev=10.31, samples=37 write: IOPS=20, BW=336KiB/s (344kB/s)(6368KiB/18978msec); 0 zone resets clat (msec): min=14, max=124, avg=34.02, stdev=16.96 lat (msec): min=14, max=124, avg=34.02, stdev=16.96 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 45], 90.00th=[ 58], 95.00th=[ 67], | 99.00th=[ 103], 99.50th=[ 111], 99.90th=[ 126], 99.95th=[ 126], | 99.99th=[ 126] bw ( KiB/s): min= 64, max= 704, per=25.09%, avg=332.65, stdev=168.46, samples=37 iops : min= 4, max= 44, avg=20.43, stdev=10.77, samples=37 lat (msec) : 4=6.77%, 10=22.01%, 20=15.36%, 50=44.92%, 100=10.16% lat (msec) : 250=0.78% cpu : usr=0.07%, sys=8.78%, ctx=1477, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147889: Fri Sep 25 23:43:02 2026 read: IOPS=18, BW=302KiB/s (310kB/s)(5744KiB/19003msec) clat (usec): min=2524, max=96823, avg=12994.18, stdev=14696.18 lat (usec): min=2525, max=96824, avg=12995.00, stdev=14696.15 clat percentiles (usec): | 1.00th=[ 2900], 5.00th=[ 3359], 10.00th=[ 3752], 20.00th=[ 4293], | 30.00th=[ 5014], 40.00th=[ 5932], 50.00th=[ 6783], 60.00th=[ 8979], | 70.00th=[11863], 80.00th=[18220], 90.00th=[33817], 95.00th=[44827], | 99.00th=[72877], 99.50th=[91751], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 31, max= 768, per=23.96%, avg=301.92, stdev=197.97, samples=37 iops : min= 1, max= 48, avg=18.51, stdev=12.61, samples=37 write: IOPS=21, BW=344KiB/s (353kB/s)(6544KiB/19003msec); 0 zone resets clat (msec): min=11, max=147, avg=34.88, stdev=18.63 lat (msec): min=11, max=147, avg=34.88, stdev=18.63 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 47], 90.00th=[ 60], 95.00th=[ 73], | 99.00th=[ 96], 99.50th=[ 113], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 159, max= 704, per=25.59%, avg=339.32, stdev=155.71, samples=37 iops : min= 9, max= 44, avg=20.86, stdev= 9.96, samples=37 lat (msec) : 4=6.90%, 10=22.92%, 20=15.23%, 50=44.79%, 100=9.77% lat (msec) : 250=0.39% cpu : usr=0.08%, sys=8.57%, ctx=1513, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147890: Fri Sep 25 23:43:02 2026 read: IOPS=20, BW=331KiB/s (339kB/s)(6256KiB/18893msec) clat (msec): min=2, max=124, avg=13.90, stdev=14.96 lat (msec): min=2, max=124, avg=13.90, stdev=14.96 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 8], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 20], 90.00th=[ 33], 95.00th=[ 45], | 99.00th=[ 72], 99.50th=[ 88], 99.90th=[ 125], 99.95th=[ 125], | 99.99th=[ 125] bw ( KiB/s): min= 95, max= 928, per=26.59%, avg=335.05, stdev=212.83, samples=37 iops : min= 5, max= 58, avg=20.59, stdev=13.51, samples=37 write: IOPS=19, BW=319KiB/s (327kB/s)(6032KiB/18893msec); 0 zone resets clat (msec): min=12, max=149, avg=35.19, stdev=18.95 lat (msec): min=12, max=149, avg=35.19, stdev=18.95 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 34], | 70.00th=[ 39], 80.00th=[ 45], 90.00th=[ 61], 95.00th=[ 74], | 99.00th=[ 113], 99.50th=[ 123], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 63, max= 672, per=23.90%, avg=316.86, stdev=158.44, samples=37 iops : min= 3, max= 42, avg=19.46, stdev=10.14, samples=37 lat (msec) : 4=5.46%, 10=24.97%, 20=17.30%, 50=42.39%, 100=8.97% lat (msec) : 250=0.78% cpu : usr=0.10%, sys=9.06%, ctx=1543, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=392,377,0,0 short=1,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147891: Fri Sep 25 23:43:02 2026 read: IOPS=19, BW=318KiB/s (326kB/s)(6032KiB/18946msec) clat (usec): min=2492, max=91638, avg=14015.39, stdev=14390.30 lat (usec): min=2492, max=91639, avg=14016.18, stdev=14390.28 clat percentiles (usec): | 1.00th=[ 2737], 5.00th=[ 3359], 10.00th=[ 3884], 20.00th=[ 4490], | 30.00th=[ 5145], 40.00th=[ 6063], 50.00th=[ 7570], 60.00th=[10814], | 70.00th=[14746], 80.00th=[21627], 90.00th=[34341], 95.00th=[43254], | 99.00th=[72877], 99.50th=[86508], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 95, max= 736, per=25.01%, avg=315.16, stdev=170.29, samples=37 iops : min= 5, max= 46, avg=19.35, stdev=10.82, samples=37 write: IOPS=20, BW=330KiB/s (338kB/s)(6256KiB/18946msec); 0 zone resets clat (msec): min=12, max=146, avg=34.88, stdev=19.85 lat (msec): min=12, max=146, avg=34.88, stdev=19.85 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 71], | 99.00th=[ 127], 99.50th=[ 138], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 96, max= 704, per=24.74%, avg=328.00, stdev=173.80, samples=37 iops : min= 6, max= 44, avg=20.14, stdev=11.11, samples=37 lat (msec) : 4=5.99%, 10=22.14%, 20=18.10%, 50=44.01%, 100=8.85% lat (msec) : 250=0.91% cpu : usr=0.07%, sys=8.53%, ctx=1475, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1260KiB/s (1291kB/s), 302KiB/s-331KiB/s (310kB/s-339kB/s), io=23.4MiB (24.5MB), run=18893-19003msec WRITE: bw=1326KiB/s (1358kB/s), 319KiB/s-344KiB/s (327kB/s-353kB/s), io=24.6MiB (25.8MB), run=18893-19003msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147904: Fri Sep 25 23:43:11 2026 read: IOPS=3, BW=3158KiB/s (3233kB/s)(7168KiB/2270msec) clat (usec): min=569, max=260003, avg=134342.10, stdev=82437.17 lat (usec): min=570, max=260004, avg=134343.29, stdev=82437.12 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 91751], | 30.00th=[110625], 40.00th=[110625], 50.00th=[137364], 60.00th=[137364], | 70.00th=[137364], 80.00th=[202376], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 4096, max= 5102, per=77.32%, avg=4599.00, stdev=711.35, samples=2 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2256KiB/s (2310kB/s)(5120KiB/2270msec); 0 zone resets clat (msec): min=125, max=589, avg=257.77, stdev=199.90 lat (msec): min=125, max=590, avg=257.84, stdev=199.92 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2048, max= 6131, per=49.11%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.04%, sys=55.49%, ctx=993, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147905: Fri Sep 25 23:43:11 2026 read: IOPS=0, BW=595KiB/s (609kB/s)(2048KiB/3443msec) clat (usec): min=447, max=95356, avg=47902.30, stdev=67110.95 lat (usec): min=448, max=95359, avg=47903.94, stdev=67111.90 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 449], | 30.00th=[ 449], 40.00th=[ 449], 50.00th=[ 449], 60.00th=[94897], | 70.00th=[94897], 80.00th=[94897], 90.00th=[94897], 95.00th=[94897], | 99.00th=[94897], 99.50th=[94897], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 1706, max= 2027, per=31.38%, avg=1866.50, stdev=226.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2974KiB/s (3046kB/s)(10.0MiB/3443msec); 0 zone resets clat (msec): min=95, max=1297, avg=333.31, stdev=359.80 lat (msec): min=95, max=1297, avg=333.39, stdev=359.79 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 114], | 30.00th=[ 153], 40.00th=[ 178], 50.00th=[ 213], 60.00th=[ 222], | 70.00th=[ 241], 80.00th=[ 296], 90.00th=[ 527], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 2048, max= 6011, per=48.67%, avg=4052.50, stdev=1618.19, samples=4 iops : min= 2, max= 5, avg= 3.50, stdev= 1.29, samples=4 lat (usec) : 500=8.33% lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=38.81%, ctx=402, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147907: Fri Sep 25 23:43:11 2026 read: IOPS=2, BW=2140KiB/s (2191kB/s)(6144KiB/2871msec) clat (usec): min=442, max=293091, avg=129626.24, stdev=142750.28 lat (usec): min=443, max=293092, avg=129627.08, stdev=142750.20 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 478], | 30.00th=[ 478], 40.00th=[ 553], 50.00th=[ 553], 60.00th=[235930], | 70.00th=[246416], 80.00th=[246416], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 2043, max= 6083, per=57.02%, avg=3391.33, stdev=2331.05, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=2, BW=2140KiB/s (2191kB/s)(6144KiB/2871msec); 0 zone resets clat (msec): min=155, max=522, avg=338.92, stdev=160.49 lat (msec): min=155, max=522, avg=338.97, stdev=160.51 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 447], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1709, max= 4055, per=28.59%, avg=2380.60, stdev=947.35, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=43.48%, ctx=539, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147908: Fri Sep 25 23:43:11 2026 read: IOPS=1, BW=1719KiB/s (1760kB/s)(5120KiB/2979msec) clat (usec): min=447, max=159023, avg=106339.16, stdev=61169.03 lat (usec): min=448, max=159024, avg=106340.03, stdev=61168.96 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 449], | 30.00th=[119014], 40.00th=[119014], 50.00th=[126354], 60.00th=[126354], | 70.00th=[126354], 80.00th=[126354], 90.00th=[158335], 95.00th=[158335], | 99.00th=[158335], 99.50th=[158335], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 2043, max= 6083, per=68.31%, avg=4063.00, stdev=2856.71, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2406KiB/s (2464kB/s)(7168KiB/2979msec); 0 zone resets clat (msec): min=102, max=986, avg=342.61, stdev=304.23 lat (msec): min=102, max=986, avg=342.69, stdev=304.27 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 174], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 232], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 456], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1703, max= 4087, per=29.62%, avg=2466.25, stdev=1091.98, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=75.00%, 500=8.33%, 1000=8.33% cpu : usr=0.00%, sys=41.47%, ctx=418, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5948KiB/s (6091kB/s), 595KiB/s-3158KiB/s (609kB/s-3233kB/s), io=20.0MiB (20.0MB), run=2270-3443msec WRITE: bw=8328KiB/s (8527kB/s), 2140KiB/s-2974KiB/s (2191kB/s-3046kB/s), io=28.0MiB (29.4MB), run=2270-3443msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147909: Fri Sep 25 23:43:11 2026 read: IOPS=2, BW=2193KiB/s (2246kB/s)(7168KiB/3268msec) clat (msec): min=48, max=275, avg=142.23, stdev=81.08 lat (msec): min=48, max=275, avg=142.23, stdev=81.08 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 62], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 126], 60.00th=[ 188], | 70.00th=[ 188], 80.00th=[ 194], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2015, max= 5019, per=47.22%, avg=2777.00, stdev=1494.70, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1567KiB/s (1604kB/s)(5120KiB/3268msec); 0 zone resets clat (msec): min=188, max=840, avg=444.49, stdev=261.93 lat (msec): min=188, max=840, avg=444.56, stdev=261.93 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2015, max= 4071, per=32.89%, avg=2708.33, stdev=1180.16, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=13.65%, ctx=181, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147910: Fri Sep 25 23:43:11 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(2048KiB/3482msec) clat (msec): min=55, max=235, avg=145.64, stdev=127.32 lat (msec): min=55, max=235, avg=145.70, stdev=127.42 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 56], 40.00th=[ 56], 50.00th=[ 56], 60.00th=[ 236], | 70.00th=[ 236], 80.00th=[ 236], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 1681, max= 2035, per=31.59%, avg=1858.00, stdev=250.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2941KiB/s (3011kB/s)(10.0MiB/3482msec); 0 zone resets clat (msec): min=31, max=1292, avg=309.34, stdev=381.07 lat (msec): min=31, max=1292, avg=309.41, stdev=381.07 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 72], | 30.00th=[ 107], 40.00th=[ 109], 50.00th=[ 134], 60.00th=[ 180], | 70.00th=[ 236], 80.00th=[ 363], 90.00th=[ 575], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 2027, max= 6107, per=49.25%, avg=4055.00, stdev=2040.11, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=50.00%, 500=8.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=15.23%, ctx=240, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147911: Fri Sep 25 23:43:11 2026 read: IOPS=1, BW=1929KiB/s (1975kB/s)(6144KiB/3185msec) clat (msec): min=47, max=501, avg=211.08, stdev=217.02 lat (msec): min=47, max=501, avg=211.08, stdev=217.02 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 78], 50.00th=[ 78], 60.00th=[ 86], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 4079, max= 6107, per=86.60%, avg=5093.00, stdev=1434.01, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1929KiB/s (1975kB/s)(6144KiB/3185msec); 0 zone resets clat (msec): min=152, max=440, avg=317.69, stdev=123.86 lat (msec): min=152, max=440, avg=317.76, stdev=123.87 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 355], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1670, max= 4071, per=28.64%, avg=2358.00, stdev=969.29, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=12.59%, ctx=110, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147912: Fri Sep 25 23:43:11 2026 read: IOPS=1, BW=1520KiB/s (1556kB/s)(5120KiB/3369msec) clat (msec): min=31, max=376, avg=187.90, stdev=157.59 lat (msec): min=31, max=376, avg=187.90, stdev=157.59 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 32], 10.00th=[ 32], 20.00th=[ 32], | 30.00th=[ 59], 40.00th=[ 59], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 4015, max= 4071, per=68.75%, avg=4043.00, stdev=39.60, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2128KiB/s (2179kB/s)(7168KiB/3369msec); 0 zone resets clat (msec): min=77, max=1047, avg=339.53, stdev=373.32 lat (msec): min=77, max=1047, avg=339.61, stdev=373.33 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 100], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 634], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1686, max= 2039, per=23.56%, avg=1939.75, stdev=169.68, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 50=8.33%, 100=41.67%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.03%, sys=12.38%, ctx=145, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5882KiB/s (6023kB/s), 588KiB/s-2193KiB/s (602kB/s-2246kB/s), io=20.0MiB (20.0MB), run=3185-3482msec WRITE: bw=8234KiB/s (8432kB/s), 1567KiB/s-2941KiB/s (1604kB/s-3011kB/s), io=28.0MiB (29.4MB), run=3185-3482msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147918: Fri Sep 25 23:43:18 2026 read: IOPS=2, BW=9002KiB/s (9218kB/s)(12.0MiB/1365msec) clat (msec): min=424, max=459, avg=445.90, stdev=18.37 lat (msec): min=424, max=459, avg=445.90, stdev=18.37 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7380, max= 8175, per=69.26%, avg=7777.50, stdev=562.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=55.87%, ctx=2514, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147919: Fri Sep 25 23:43:18 2026 read: IOPS=0, BW=2807KiB/s (2875kB/s)(4096KiB/1459msec) clat (nsec): min=454222k, max=454222k, avg=454222270.00, stdev= 0.00 lat (nsec): min=454224k, max=454224k, avg=454224125.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7366, max= 7366, per=65.60%, avg=7366.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5615KiB/s (5750kB/s)(8192KiB/1459msec); 0 zone resets clat (msec): min=319, max=651, avg=485.30, stdev=235.16 lat (msec): min=319, max=651, avg=485.61, stdev=235.20 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8175, max= 8175, per=42.69%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=20.92%, ctx=778, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147920: Fri Sep 25 23:43:18 2026 write: IOPS=1, BW=7182KiB/s (7354kB/s)(12.0MiB/1711msec); 0 zone resets clat (msec): min=163, max=1216, avg=560.07, stdev=572.78 lat (msec): min=164, max=1217, avg=560.41, stdev=572.87 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min=16384, max=16384, per=85.55%, avg=16384.00, stdev= 0.00, samples=1 iops : min= 4, max= 4, avg= 4.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.18%, sys=13.63%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147921: Fri Sep 25 23:43:18 2026 write: IOPS=2, BW=8904KiB/s (9118kB/s)(12.0MiB/1380msec); 0 zone resets clat (msec): min=182, max=974, avg=456.83, stdev=448.38 lat (msec): min=182, max=974, avg=457.11, stdev=448.36 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min=16157, max=16157, per=84.37%, avg=16157.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 1000=33.33% cpu : usr=0.15%, sys=18.20%, ctx=103, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=10.0MiB/s (11.5MB/s), 2807KiB/s-9002KiB/s (2875kB/s-9218kB/s), io=16.0MiB (16.8MB), run=1365-1459msec WRITE: bw=18.7MiB/s (19.6MB/s), 5615KiB/s-8904KiB/s (5750kB/s-9118kB/s), io=32.0MiB (33.6MB), run=1380-1711msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147922: Fri Sep 25 23:43:19 2026 read: IOPS=2, BW=9055KiB/s (9273kB/s)(12.0MiB/1357msec) clat (msec): min=409, max=454, avg=439.32, stdev=26.25 lat (msec): min=409, max=454, avg=439.32, stdev=26.25 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 8015, max= 8192, per=83.54%, avg=8103.50, stdev=125.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=18.73%, ctx=82, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147923: Fri Sep 25 23:43:19 2026 read: IOPS=0, BW=2425KiB/s (2483kB/s)(4096KiB/1689msec) clat (nsec): min=741490k, max=741490k, avg=741490297.00, stdev= 0.00 lat (nsec): min=741491k, max=741491k, avg=741491264.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 743], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 8192, max= 8192, per=84.45%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4850KiB/s (4967kB/s)(8192KiB/1689msec); 0 zone resets clat (msec): min=409, max=481, avg=445.61, stdev=50.81 lat (msec): min=409, max=481, avg=445.88, stdev=50.78 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 8192, max= 8192, per=45.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=15.58%, ctx=62, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147924: Fri Sep 25 23:43:19 2026 write: IOPS=1, BW=6793KiB/s (6956kB/s)(12.0MiB/1809msec); 0 zone resets clat (msec): min=71, max=1458, avg=588.88, stdev=757.58 lat (msec): min=71, max=1458, avg=589.07, stdev=757.53 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 72], | 30.00th=[ 72], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8192, max= 8192, per=45.23%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 100=33.33%, 250=33.33%, 2000=33.33% cpu : usr=0.06%, sys=9.68%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147925: Fri Sep 25 23:43:19 2026 write: IOPS=1, BW=7297KiB/s (7472kB/s)(12.0MiB/1684msec); 0 zone resets clat (msec): min=273, max=1033, avg=555.94, stdev=415.87 lat (msec): min=273, max=1033, avg=556.18, stdev=415.79 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7787, max= 8192, per=44.11%, avg=7989.50, stdev=286.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.06%, sys=13.37%, ctx=134, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=9700KiB/s (9933kB/s), 2425KiB/s-9055KiB/s (2483kB/s-9273kB/s), io=16.0MiB (16.8MB), run=1357-1689msec WRITE: bw=17.7MiB/s (18.5MB/s), 4850KiB/s-7297KiB/s (4967kB/s-7472kB/s), io=32.0MiB (33.6MB), run=1684-1809msec