== sanity test 398b: DIO and buffer IO race ============== 03:13:37 (1788592417) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.81966 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146428: Sat Sep 5 03:16:00 2026 read: IOPS=12, BW=48.2KiB/s (49.3kB/s)(5992KiB/124406msec) clat (usec): min=30, max=937251, avg=39819.91, stdev=38339.95 lat (usec): min=30, max=937252, avg=39823.00, stdev=38340.59 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 114], 20.00th=[ 19006], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[183501], 99.90th=[329253], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 5, max= 111, per=25.08%, avg=48.41, stdev=21.20, samples=241 iops : min= 1, max= 27, avg=11.46, stdev= 5.34, samples=241 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6296KiB/124406msec); 0 zone resets clat (usec): min=1058, max=704972, avg=40844.86, stdev=44121.55 lat (usec): min=1060, max=704972, avg=40848.98, stdev=44121.46 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1369], 10.00th=[ 2114], 20.00th=[ 5080], | 30.00th=[ 10159], 40.00th=[ 20579], 50.00th=[ 30278], 60.00th=[ 40633], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[179307], 99.50th=[217056], 99.90th=[383779], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 160, per=25.21%, avg=50.92, stdev=21.71, samples=241 iops : min= 1, max= 40, avg=12.09, stdev= 5.50, samples=241 lat (usec) : 50=0.62%, 100=4.00%, 250=0.91%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=4.92%, 4=3.81%, 10=7.00%, 20=9.28%, 50=39.49% lat (msec) : 100=24.28%, 250=5.21%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.79%, ctx=6674, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146429: Sat Sep 5 03:16:00 2026 read: IOPS=12, BW=49.0KiB/s (50.2kB/s)(5940KiB/121187msec) clat (usec): min=29, max=713896, avg=39089.41, stdev=34545.22 lat (usec): min=29, max=713898, avg=39092.40, stdev=34546.22 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 116], 20.00th=[ 17695], | 30.00th=[ 23462], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[133694], 99.50th=[154141], 99.90th=[446694], 99.95th=[717226], | 99.99th=[717226] bw ( KiB/s): min= 5, max= 111, per=25.48%, avg=49.17, stdev=20.46, samples=236 iops : min= 1, max= 27, avg=11.65, stdev= 5.15, samples=236 write: IOPS=13, BW=52.4KiB/s (53.6kB/s)(6348KiB/121187msec); 0 zone resets clat (usec): min=1042, max=916870, avg=39477.50, stdev=46729.98 lat (usec): min=1043, max=916871, avg=39480.93, stdev=46729.66 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1369], 10.00th=[ 2343], 20.00th=[ 5080], | 30.00th=[ 9896], 40.00th=[ 19792], 50.00th=[ 28705], 60.00th=[ 39060], | 70.00th=[ 50070], 80.00th=[ 65274], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[183501], 99.50th=[267387], 99.90th=[438305], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 7, max= 126, per=25.92%, avg=52.37, stdev=22.69, samples=237 iops : min= 1, max= 31, avg=12.46, stdev= 5.73, samples=237 lat (usec) : 50=0.59%, 100=4.10%, 250=0.65%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.65%, 4=3.87%, 10=7.65%, 20=10.61%, 50=38.44% lat (msec) : 100=24.19%, 250=4.56%, 500=0.26%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.00%, ctx=6648, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146430: Sat Sep 5 03:16:00 2026 read: IOPS=12, BW=48.8KiB/s (50.0kB/s)(6028KiB/123414msec) clat (usec): min=30, max=413460, avg=38360.28, stdev=30555.02 lat (usec): min=30, max=413461, avg=38362.29, stdev=30555.40 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 122], 20.00th=[ 17957], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 32900], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 58459], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[132645], 99.50th=[162530], 99.90th=[312476], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7, max= 103, per=25.33%, avg=48.90, stdev=20.15, samples=240 iops : min= 1, max= 25, avg=11.57, stdev= 5.08, samples=240 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6260KiB/123414msec); 0 zone resets clat (usec): min=1018, max=935695, avg=41606.47, stdev=46797.02 lat (usec): min=1019, max=935697, avg=41611.21, stdev=46796.98 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1385], 10.00th=[ 2114], 20.00th=[ 4817], | 30.00th=[ 9896], 40.00th=[ 21365], 50.00th=[ 32375], 60.00th=[ 42206], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[183501], 99.50th=[204473], 99.90th=[346031], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 95, per=24.86%, avg=50.21, stdev=19.43, samples=242 iops : min= 1, max= 23, avg=11.91, stdev= 4.89, samples=242 lat (usec) : 50=0.59%, 100=4.13%, 250=0.33%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=4.98%, 4=4.07%, 10=7.00%, 20=10.22%, 50=38.67% lat (msec) : 100=24.02%, 250=5.47%, 500=0.23%, 1000=0.03% cpu : usr=0.08%, sys=5.66%, ctx=6695, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146433: Sat Sep 5 03:16:00 2026 read: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6052KiB/122400msec) clat (usec): min=34, max=477600, avg=38466.23, stdev=32835.01 lat (usec): min=34, max=477601, avg=38472.17, stdev=32833.36 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 97], 20.00th=[ 17433], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[141558], 99.50th=[177210], 99.90th=[375391], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 103, per=25.99%, avg=50.16, stdev=19.30, samples=236 iops : min= 1, max= 25, avg=11.89, stdev= 4.85, samples=236 write: IOPS=12, BW=50.9KiB/s (52.2kB/s)(6236KiB/122400msec); 0 zone resets clat (usec): min=992, max=992809, avg=40833.89, stdev=47469.27 lat (usec): min=993, max=992810, avg=40858.19, stdev=47459.41 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 2180], 20.00th=[ 4817], | 30.00th=[ 10159], 40.00th=[ 20317], 50.00th=[ 31851], 60.00th=[ 40633], | 70.00th=[ 53216], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[115868], | 99.00th=[179307], 99.50th=[210764], 99.90th=[484443], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 110, per=25.13%, avg=50.76, stdev=20.63, samples=240 iops : min= 1, max= 27, avg=12.05, stdev= 5.21, samples=240 lat (usec) : 50=0.52%, 100=4.59%, 250=0.68%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=4.82%, 4=4.23%, 10=6.48%, 20=10.22%, 50=39.19% lat (msec) : 100=23.11%, 250=5.53%, 500=0.16%, 1000=0.03% cpu : usr=0.09%, sys=5.78%, ctx=6660, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=193KiB/s (198kB/s), 48.2KiB/s-49.4KiB/s (49.3kB/s-50.6kB/s), io=23.4MiB (24.6MB), run=121187-124406msec WRITE: bw=202KiB/s (207kB/s), 50.6KiB/s-52.4KiB/s (51.8kB/s-53.6kB/s), io=24.6MiB (25.7MB), run=121187-124406msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146431: Sat Sep 5 03:18:06 2026 read: IOPS=6, BW=24.1KiB/s (24.7kB/s)(5992KiB/248772msec) clat (msec): min=5, max=951, avg=32.91, stdev=39.51 lat (msec): min=5, max=951, avg=32.91, stdev=39.51 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 71], 95.00th=[ 101], | 99.00th=[ 169], 99.50th=[ 192], 99.90th=[ 305], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 111, per=27.37%, avg=26.27, stdev=17.65, samples=440 iops : min= 1, max= 27, avg= 5.92, stdev= 4.44, samples=440 write: IOPS=6, BW=25.3KiB/s (25.9kB/s)(6296KiB/248772msec); 0 zone resets clat (msec): min=30, max=735, avg=126.50, stdev=62.21 lat (msec): min=30, max=735, avg=126.50, stdev=62.21 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 114], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 205], 95.00th=[ 239], | 99.00th=[ 326], 99.50th=[ 388], 99.90th=[ 535], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 63, per=24.99%, avg=24.99, stdev=11.31, samples=485 iops : min= 1, max= 15, avg= 5.60, stdev= 2.88, samples=485 lat (msec) : 10=4.49%, 20=18.13%, 50=18.95%, 100=25.20%, 250=31.09% lat (msec) : 500=2.02%, 750=0.10%, 1000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5169, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146432: Sat Sep 5 03:18:06 2026 read: IOPS=5, BW=23.8KiB/s (24.3kB/s)(5940KiB/249951msec) clat (msec): min=4, max=906, avg=34.32, stdev=40.83 lat (msec): min=4, max=906, avg=34.33, stdev=40.83 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 49], 90.00th=[ 77], 95.00th=[ 102], | 99.00th=[ 171], 99.50th=[ 220], 99.90th=[ 300], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 108, per=27.76%, avg=26.65, stdev=17.42, samples=431 iops : min= 1, max= 27, avg= 6.02, stdev= 4.39, samples=431 write: IOPS=6, BW=25.4KiB/s (26.0kB/s)(6348KiB/249951msec); 0 zone resets clat (msec): min=37, max=548, avg=125.15, stdev=58.60 lat (msec): min=37, max=548, avg=125.15, stdev=58.60 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 203], 95.00th=[ 239], | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 518], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 56, per=25.12%, avg=25.12, stdev=11.39, samples=488 iops : min= 1, max= 14, avg= 5.63, stdev= 2.90, samples=488 lat (msec) : 10=4.56%, 20=18.26%, 50=17.06%, 100=26.20%, 250=31.67% lat (msec) : 500=2.15%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.24%, ctx=5217, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146434: Sat Sep 5 03:18:06 2026 read: IOPS=6, BW=24.2KiB/s (24.7kB/s)(6028KiB/249449msec) clat (msec): min=5, max=418, avg=33.28, stdev=34.28 lat (msec): min=5, max=418, avg=33.28, stdev=34.28 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 72], 95.00th=[ 99], | 99.00th=[ 180], 99.50th=[ 209], 99.90th=[ 305], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 111, per=27.43%, avg=26.33, stdev=17.51, samples=443 iops : min= 1, max= 27, avg= 5.94, stdev= 4.40, samples=443 write: IOPS=6, BW=25.1KiB/s (25.7kB/s)(6260KiB/249449msec); 0 zone resets clat (msec): min=35, max=1086, avg=127.08, stdev=65.42 lat (msec): min=35, max=1086, avg=127.09, stdev=65.42 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 207], 95.00th=[ 247], | 99.00th=[ 326], 99.50th=[ 430], 99.90th=[ 575], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 55, per=24.97%, avg=24.97, stdev=11.30, samples=484 iops : min= 1, max= 13, avg= 5.59, stdev= 2.88, samples=484 lat (msec) : 10=4.30%, 20=18.29%, 50=18.49%, 100=25.16%, 250=31.15% lat (msec) : 500=2.51%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.25%, ctx=4965, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146435: Sat Sep 5 03:18:06 2026 read: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6052KiB/247379msec) clat (msec): min=5, max=353, avg=33.10, stdev=35.03 lat (msec): min=5, max=353, avg=33.10, stdev=35.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 79], 95.00th=[ 108], | 99.00th=[ 167], 99.50th=[ 222], 99.90th=[ 342], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 127, per=28.33%, avg=27.19, stdev=17.92, samples=431 iops : min= 1, max= 31, avg= 6.16, stdev= 4.51, samples=431 write: IOPS=6, BW=25.2KiB/s (25.8kB/s)(6236KiB/247379msec); 0 zone resets clat (msec): min=30, max=978, avg=126.30, stdev=62.53 lat (msec): min=30, max=978, avg=126.30, stdev=62.53 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 113], 60.00th=[ 126], | 70.00th=[ 144], 80.00th=[ 165], 90.00th=[ 203], 95.00th=[ 241], | 99.00th=[ 321], 99.50th=[ 376], 99.90th=[ 735], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 56, per=24.97%, avg=24.97, stdev=10.83, samples=482 iops : min= 1, max= 14, avg= 5.59, stdev= 2.75, samples=482 lat (msec) : 10=5.21%, 20=18.75%, 50=17.61%, 100=25.00%, 250=31.22% lat (msec) : 500=2.15%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.28%, ctx=5111, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=96.1KiB/s (98.4kB/s), 23.8KiB/s-24.5KiB/s (24.3kB/s-25.1kB/s), io=23.4MiB (24.6MB), run=247379-249951msec WRITE: bw=101KiB/s (103kB/s), 25.1KiB/s-25.4KiB/s (25.7kB/s-26.0kB/s), io=24.6MiB (25.7MB), run=247379-249951msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146492: Sat Sep 5 03:18:44 2026 read: IOPS=14, BW=228KiB/s (233kB/s)(5920KiB/26017msec) clat (usec): min=36, max=232828, avg=36439.53, stdev=30991.00 lat (usec): min=37, max=232829, avg=36441.69, stdev=30990.98 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 63], 20.00th=[ 98], | 30.00th=[ 21627], 40.00th=[ 27657], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[128451], 99.50th=[154141], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 88, max= 565, per=25.19%, avg=222.18, stdev=84.51, samples=51 iops : min= 5, max= 35, avg=13.16, stdev= 5.33, samples=51 write: IOPS=15, BW=245KiB/s (251kB/s)(6368KiB/26017msec); 0 zone resets clat (usec): min=1336, max=186876, avg=30633.83, stdev=31286.41 lat (usec): min=1338, max=186877, avg=30636.36, stdev=31286.68 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1926], 10.00th=[ 3326], 20.00th=[ 5604], | 30.00th=[ 8094], 40.00th=[ 12256], 50.00th=[ 20317], 60.00th=[ 29230], | 70.00th=[ 40633], 80.00th=[ 52691], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[156238], 99.50th=[179307], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 62, max= 571, per=26.64%, avg=247.22, stdev=99.25, samples=50 iops : min= 3, max= 35, avg=14.72, stdev= 6.25, samples=50 lat (usec) : 50=1.43%, 100=8.20%, 250=0.91%, 500=0.39%, 1000=0.13% lat (msec) : 2=3.12%, 4=4.04%, 10=11.46%, 20=9.38%, 50=35.81% lat (msec) : 100=22.14%, 250=2.99% cpu : usr=0.10%, sys=6.45%, ctx=1428, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146493: Sat Sep 5 03:18:44 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5744KiB/27150msec) clat (usec): min=41, max=243510, avg=36340.94, stdev=30844.34 lat (usec): min=42, max=243511, avg=36342.35, stdev=30844.30 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 118], | 30.00th=[ 22414], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 40633], | 70.00th=[ 49021], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[137364], 99.50th=[200279], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 29, max= 383, per=24.26%, avg=213.96, stdev=87.12, samples=52 iops : min= 1, max= 23, avg=12.62, stdev= 5.46, samples=52 write: IOPS=15, BW=241KiB/s (247kB/s)(6544KiB/27150msec); 0 zone resets clat (usec): min=1416, max=311015, avg=33830.53, stdev=40784.08 lat (usec): min=1417, max=311017, avg=33842.18, stdev=40784.69 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2180], 10.00th=[ 3032], 20.00th=[ 5145], | 30.00th=[ 8029], 40.00th=[ 10552], 50.00th=[ 17695], 60.00th=[ 28705], | 70.00th=[ 42206], 80.00th=[ 58459], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[206570], 99.50th=[217056], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 508, per=25.62%, avg=237.75, stdev=113.73, samples=53 iops : min= 1, max= 31, avg=14.13, stdev= 7.17, samples=53 lat (usec) : 50=0.91%, 100=8.07%, 250=1.43%, 750=0.13%, 1000=0.13% lat (msec) : 2=2.21%, 4=5.73%, 10=12.89%, 20=9.51%, 50=33.07% lat (msec) : 100=21.88%, 250=3.91%, 500=0.13% cpu : usr=0.09%, sys=6.34%, ctx=1474, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146494: Sat Sep 5 03:18:44 2026 read: IOPS=14, BW=234KiB/s (239kB/s)(6256KiB/26789msec) clat (usec): min=38, max=222302, avg=36131.81, stdev=29117.04 lat (usec): min=38, max=222303, avg=36145.44, stdev=29116.59 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 190], | 30.00th=[ 22676], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 84411], | 99.00th=[139461], 99.50th=[173016], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 89, max= 415, per=26.44%, avg=233.17, stdev=93.70, samples=52 iops : min= 5, max= 25, avg=13.83, stdev= 5.87, samples=52 write: IOPS=14, BW=225KiB/s (231kB/s)(6032KiB/26789msec); 0 zone resets clat (usec): min=1476, max=379555, avg=32793.85, stdev=38618.93 lat (usec): min=1477, max=379557, avg=32796.09, stdev=38618.90 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2311], 10.00th=[ 3359], 20.00th=[ 4883], | 30.00th=[ 7177], 40.00th=[ 9896], 50.00th=[ 17957], 60.00th=[ 31065], | 70.00th=[ 43254], 80.00th=[ 56886], 90.00th=[ 74974], 95.00th=[105382], | 99.00th=[141558], 99.50th=[263193], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 95, max= 505, per=23.87%, avg=221.52, stdev=84.38, samples=52 iops : min= 5, max= 31, avg=13.12, stdev= 5.33, samples=52 lat (usec) : 50=0.39%, 100=8.20%, 250=1.69%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.95%, 4=5.34%, 10=12.50%, 20=8.46%, 50=34.77% lat (msec) : 100=22.79%, 250=3.39%, 500=0.26% cpu : usr=0.10%, sys=6.24%, ctx=1453, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146495: Sat Sep 5 03:18:44 2026 read: IOPS=14, BW=224KiB/s (230kB/s)(6032KiB/26872msec) clat (usec): min=36, max=288138, avg=39119.94, stdev=31833.23 lat (usec): min=37, max=288140, avg=39121.27, stdev=31833.20 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 1483], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 49546], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[141558], 99.50th=[147850], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 414, per=25.39%, avg=223.98, stdev=81.09, samples=53 iops : min= 1, max= 25, avg=13.26, stdev= 5.10, samples=53 write: IOPS=14, BW=233KiB/s (238kB/s)(6256KiB/26872msec); 0 zone resets clat (usec): min=1447, max=236041, avg=30652.01, stdev=31540.74 lat (usec): min=1449, max=236045, avg=30654.31, stdev=31540.72 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2008], 10.00th=[ 3195], 20.00th=[ 5669], | 30.00th=[ 8979], 40.00th=[ 12911], 50.00th=[ 19792], 60.00th=[ 28443], | 70.00th=[ 41157], 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[139461], 99.50th=[223347], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 63, max= 383, per=25.09%, avg=232.85, stdev=84.51, samples=53 iops : min= 3, max= 23, avg=13.83, stdev= 5.33, samples=53 lat (usec) : 50=1.30%, 100=7.03%, 250=0.91%, 500=0.26% lat (msec) : 2=2.86%, 4=4.30%, 10=11.33%, 20=9.38%, 50=36.46% lat (msec) : 100=22.79%, 250=3.26%, 500=0.13% cpu : usr=0.08%, sys=6.43%, ctx=1497, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=882KiB/s (903kB/s), 212KiB/s-234KiB/s (217kB/s-239kB/s), io=23.4MiB (24.5MB), run=26017-27150msec WRITE: bw=928KiB/s (950kB/s), 225KiB/s-245KiB/s (231kB/s-251kB/s), io=24.6MiB (25.8MB), run=26017-27150msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146496: Sat Sep 5 03:19:23 2026 read: IOPS=5, BW=89.5KiB/s (91.7kB/s)(5920KiB/66109msec) clat (msec): min=7, max=482, avg=36.36, stdev=37.19 lat (msec): min=7, max=482, avg=36.36, stdev=37.19 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 69], 95.00th=[ 95], | 99.00th=[ 161], 99.50th=[ 228], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 31, max= 307, per=28.06%, avg=100.75, stdev=60.58, samples=116 iops : min= 1, max= 19, avg= 5.53, stdev= 3.81, samples=116 write: IOPS=6, BW=96.3KiB/s (98.6kB/s)(6368KiB/66109msec); 0 zone resets clat (msec): min=37, max=377, avg=131.71, stdev=57.04 lat (msec): min=37, max=377, avg=131.71, stdev=57.04 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 120], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 182], 90.00th=[ 213], 95.00th=[ 239], | 99.00th=[ 317], 99.50th=[ 359], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 27, max= 191, per=25.54%, avg=96.55, stdev=39.40, samples=130 iops : min= 1, max= 11, avg= 5.26, stdev= 2.51, samples=130 lat (msec) : 10=1.17%, 20=14.84%, 50=23.96%, 100=24.61%, 250=33.20% lat (msec) : 500=2.21% cpu : usr=0.04%, sys=1.33%, ctx=1256, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146497: Sat Sep 5 03:19:23 2026 read: IOPS=5, BW=86.3KiB/s (88.3kB/s)(5744KiB/66591msec) clat (msec): min=7, max=408, avg=35.84, stdev=38.70 lat (msec): min=7, max=408, avg=35.84, stdev=38.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 52], 90.00th=[ 75], 95.00th=[ 108], | 99.00th=[ 194], 99.50th=[ 215], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 28, max= 352, per=27.24%, avg=97.80, stdev=63.92, samples=116 iops : min= 1, max= 22, avg= 5.33, stdev= 4.02, samples=116 write: IOPS=6, BW=98.3KiB/s (101kB/s)(6544KiB/66591msec); 0 zone resets clat (msec): min=45, max=393, avg=131.20, stdev=60.21 lat (msec): min=45, max=393, avg=131.20, stdev=60.21 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 107], 50.00th=[ 118], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 163], 90.00th=[ 209], 95.00th=[ 262], | 99.00th=[ 326], 99.50th=[ 359], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 191, per=26.23%, avg=99.16, stdev=41.23, samples=130 iops : min= 1, max= 11, avg= 5.43, stdev= 2.62, samples=130 lat (msec) : 10=2.47%, 20=17.58%, 50=17.32%, 100=25.13%, 250=34.11% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.38%, ctx=1354, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146498: Sat Sep 5 03:19:23 2026 read: IOPS=6, BW=98.9KiB/s (101kB/s)(6256KiB/63281msec) clat (msec): min=5, max=267, avg=33.77, stdev=31.97 lat (msec): min=5, max=267, avg=33.77, stdev=31.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 71], 95.00th=[ 101], | 99.00th=[ 165], 99.50th=[ 203], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 381, per=29.70%, avg=106.64, stdev=71.42, samples=116 iops : min= 1, max= 23, avg= 5.91, stdev= 4.51, samples=116 write: IOPS=5, BW=95.3KiB/s (97.6kB/s)(6032KiB/63281msec); 0 zone resets clat (msec): min=35, max=375, avg=132.05, stdev=61.07 lat (msec): min=35, max=375, avg=132.05, stdev=61.07 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 63], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 117], 60.00th=[ 132], | 70.00th=[ 150], 80.00th=[ 176], 90.00th=[ 209], 95.00th=[ 262], | 99.00th=[ 355], 99.50th=[ 363], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 28, max= 189, per=25.48%, avg=96.33, stdev=37.75, samples=123 iops : min= 1, max= 11, avg= 5.26, stdev= 2.39, samples=123 lat (msec) : 10=1.43%, 20=18.75%, 50=23.18%, 100=22.14%, 250=31.64% lat (msec) : 500=2.86% cpu : usr=0.05%, sys=1.45%, ctx=1357, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146499: Sat Sep 5 03:19:23 2026 read: IOPS=5, BW=92.6KiB/s (94.9kB/s)(6032KiB/65119msec) clat (msec): min=6, max=483, avg=35.48, stdev=38.25 lat (msec): min=6, max=483, avg=35.48, stdev=38.25 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 65], 95.00th=[ 100], | 99.00th=[ 215], 99.50th=[ 253], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 30, max= 319, per=27.52%, avg=98.80, stdev=64.38, samples=120 iops : min= 1, max= 19, avg= 5.41, stdev= 4.07, samples=120 write: IOPS=6, BW=96.1KiB/s (98.4kB/s)(6256KiB/65119msec); 0 zone resets clat (msec): min=40, max=429, avg=131.74, stdev=61.74 lat (msec): min=40, max=429, avg=131.74, stdev=61.74 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 82], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 116], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 215], 95.00th=[ 266], | 99.00th=[ 342], 99.50th=[ 368], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 27, max= 190, per=25.75%, avg=97.35, stdev=39.58, samples=127 iops : min= 1, max= 11, avg= 5.31, stdev= 2.51, samples=127 lat (msec) : 10=1.69%, 20=15.10%, 50=24.87%, 100=23.31%, 250=31.90% lat (msec) : 500=3.12% cpu : usr=0.06%, sys=1.37%, ctx=1348, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=360KiB/s (368kB/s), 86.3KiB/s-98.9KiB/s (88.3kB/s-101kB/s), io=23.4MiB (24.5MB), run=63281-66591msec WRITE: bw=378KiB/s (388kB/s), 95.3KiB/s-98.3KiB/s (97.6kB/s-101kB/s), io=24.6MiB (25.8MB), run=63281-66591msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146519: Sat Sep 5 03:19:41 2026 read: IOPS=1, BW=1356KiB/s (1388kB/s)(7168KiB/5288msec) clat (msec): min=88, max=273, avg=173.72, stdev=73.57 lat (msec): min=88, max=273, avg=173.72, stdev=73.57 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 129], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 132], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 271], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2003, max= 4248, per=82.82%, avg=2581.50, stdev=1111.15, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=0, BW=968KiB/s (991kB/s)(5120KiB/5288msec); 0 zone resets clat (msec): min=304, max=2488, avg=807.59, stdev=941.52 lat (msec): min=304, max=2488, avg=807.74, stdev=941.47 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2003, max= 2048, per=46.46%, avg=2027.40, stdev=20.70, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, >=2000=8.33% cpu : usr=0.02%, sys=3.10%, ctx=68, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146521: Sat Sep 5 03:19:41 2026 read: IOPS=0, BW=312KiB/s (319kB/s)(2048KiB/6569msec) clat (msec): min=117, max=168, avg=142.90, stdev=36.60 lat (msec): min=117, max=168, avg=142.90, stdev=36.60 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 1556, max= 2003, per=57.09%, avg=1779.50, stdev=316.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1559KiB/s (1596kB/s)(10.0MiB/6569msec); 0 zone resets clat (msec): min=127, max=3261, avg=617.89, stdev=934.77 lat (msec): min=128, max=3261, avg=618.06, stdev=934.75 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 211], | 30.00th=[ 236], 40.00th=[ 330], 50.00th=[ 355], 60.00th=[ 368], | 70.00th=[ 384], 80.00th=[ 439], 90.00th=[ 464], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 2003, max= 4071, per=62.01%, avg=2706.00, stdev=1051.30, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 0.89, samples=6 lat (msec) : 250=41.67%, 500=50.00%, >=2000=8.33% cpu : usr=0.02%, sys=3.09%, ctx=94, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146523: Sat Sep 5 03:19:41 2026 read: IOPS=0, BW=942KiB/s (964kB/s)(6144KiB/6524msec) clat (msec): min=80, max=3061, avg=710.78, stdev=1160.95 lat (msec): min=80, max=3061, avg=710.79, stdev=1160.95 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 309], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 2035, max= 4096, per=82.03%, avg=2556.75, stdev=1026.18, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=0, BW=942KiB/s (964kB/s)(6144KiB/6524msec); 0 zone resets clat (msec): min=204, max=750, avg=358.93, stdev=203.37 lat (msec): min=204, max=750, avg=358.99, stdev=203.39 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 330], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1577, max= 2048, per=44.46%, avg=1940.40, stdev=203.50, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.27%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146525: Sat Sep 5 03:19:41 2026 read: IOPS=0, BW=872KiB/s (893kB/s)(5120KiB/5872msec) clat (msec): min=87, max=1892, avg=460.72, stdev=800.76 lat (msec): min=87, max=1892, avg=460.72, stdev=800.76 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 88], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 111], 60.00th=[ 111], | 70.00th=[ 123], 80.00th=[ 123], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1221KiB/s (1250kB/s)(7168KiB/5872msec); 0 zone resets clat (msec): min=296, max=956, avg=496.88, stdev=242.99 lat (msec): min=296, max=956, avg=497.00, stdev=242.94 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 468], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 659], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1473, max= 2048, per=44.36%, avg=1935.67, stdev=227.36, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=16.67%, 250=16.67%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.01%, ctx=78, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3118KiB/s (3192kB/s), 312KiB/s-1356KiB/s (319kB/s-1388kB/s), io=20.0MiB (20.0MB), run=5288-6569msec WRITE: bw=4365KiB/s (4469kB/s), 942KiB/s-1559KiB/s (964kB/s-1596kB/s), io=28.0MiB (29.4MB), run=5288-6569msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146520: Sat Sep 5 03:19:41 2026 read: IOPS=1, BW=1339KiB/s (1371kB/s)(7168KiB/5355msec) clat (usec): min=628, max=340035, avg=197106.36, stdev=104309.23 lat (usec): min=628, max=340037, avg=197107.60, stdev=104309.33 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[164627], | 30.00th=[189793], 40.00th=[189793], 50.00th=[204473], 60.00th=[214959], | 70.00th=[214959], 80.00th=[265290], 90.00th=[341836], 95.00th=[341836], | 99.00th=[341836], 99.50th=[341836], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 1976, max= 4087, per=91.28%, avg=2802.25, stdev=1000.03, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=956KiB/s (979kB/s)(5120KiB/5355msec); 0 zone resets clat (msec): min=189, max=2376, avg=778.65, stdev=913.79 lat (msec): min=189, max=2376, avg=778.72, stdev=913.80 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1976, max= 2048, per=47.03%, avg=2021.50, stdev=32.87, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=8.74%, ctx=206, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146522: Sat Sep 5 03:19:41 2026 read: IOPS=0, BW=307KiB/s (314kB/s)(2048KiB/6671msec) clat (usec): min=1902, max=297110, avg=149506.78, stdev=208743.83 lat (usec): min=1904, max=297113, avg=149508.69, stdev=208744.45 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 1909], 10.00th=[ 1909], 20.00th=[ 1909], | 30.00th=[ 1909], 40.00th=[ 1909], 50.00th=[ 1909], 60.00th=[295699], | 70.00th=[295699], 80.00th=[295699], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 1976, max= 2003, per=64.80%, avg=1989.50, stdev=19.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1535KiB/s (1572kB/s)(10.0MiB/6671msec); 0 zone resets clat (msec): min=131, max=3379, avg=601.43, stdev=981.11 lat (msec): min=131, max=3379, avg=601.58, stdev=981.07 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 190], | 30.00th=[ 209], 40.00th=[ 271], 50.00th=[ 275], 60.00th=[ 334], | 70.00th=[ 355], 80.00th=[ 430], 90.00th=[ 439], 95.00th=[ 3373], | 99.00th=[ 3373], 99.50th=[ 3373], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 1976, max= 4096, per=75.43%, avg=3241.80, stdev=1125.71, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 2=8.33%, 250=25.00%, 500=58.33%, >=2000=8.33% cpu : usr=0.01%, sys=8.25%, ctx=126, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146524: Sat Sep 5 03:19:41 2026 read: IOPS=1, BW=1395KiB/s (1428kB/s)(6144KiB/4405msec) clat (usec): min=537, max=2445.0k, avg=408091.20, stdev=997895.17 lat (usec): min=539, max=2445.0k, avg=408092.38, stdev=997895.19 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 611], 30.00th=[ 611], 40.00th=[ 611], | 50.00th=[ 611], 60.00th=[ 742], 70.00th=[ 1012], | 80.00th=[ 1012], 90.00th=[2432697], 95.00th=[2432697], | 99.00th=[2432697], 99.50th=[2432697], 99.90th=[2432697], | 99.95th=[2432697], 99.99th=[2432697] bw ( KiB/s): min= 4087, max= 4087, per=100.00%, avg=4087.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1395KiB/s (1428kB/s)(6144KiB/4405msec); 0 zone resets clat (msec): min=82, max=714, avg=273.84, stdev=234.59 lat (msec): min=82, max=714, avg=273.99, stdev=234.60 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 245], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2019, max= 3953, per=62.16%, avg=2671.67, stdev=1109.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=33.33% lat (msec) : 2=8.33%, 100=16.67%, 250=16.67%, 500=8.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=9.29%, ctx=352, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146526: Sat Sep 5 03:19:41 2026 read: IOPS=0, BW=1008KiB/s (1033kB/s)(5120KiB/5077msec) clat (usec): min=540, max=183509, avg=102543.32, stdev=91975.59 lat (usec): min=541, max=183510, avg=102544.48, stdev=91975.60 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 537], | 30.00th=[ 4015], 40.00th=[ 4015], 50.00th=[158335], 60.00th=[158335], | 70.00th=[164627], 80.00th=[164627], 90.00th=[183501], 95.00th=[183501], | 99.00th=[183501], 99.50th=[183501], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1412KiB/s (1446kB/s)(7168KiB/5077msec); 0 zone resets clat (msec): min=149, max=1668, avg=604.30, stdev=550.51 lat (msec): min=149, max=1668, avg=604.37, stdev=550.51 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 498], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 919], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 1612, max= 2048, per=45.46%, avg=1954.00, stdev=191.56, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=8.75%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3070KiB/s (3144kB/s), 307KiB/s-1395KiB/s (314kB/s-1428kB/s), io=20.0MiB (20.0MB), run=4405-6671msec WRITE: bw=4298KiB/s (4401kB/s), 956KiB/s-1535KiB/s (979kB/s-1572kB/s), io=28.0MiB (29.4MB), run=4405-6671msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146538: Sat Sep 5 03:19:54 2026 read: IOPS=1, BW=4592KiB/s (4702kB/s)(12.0MiB/2676msec) clat (msec): min=738, max=952, avg=851.32, stdev=107.63 lat (msec): min=738, max=952, avg=851.32, stdev=107.63 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8015, max= 8126, per=100.00%, avg=8070.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.08%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146539: Sat Sep 5 03:19:54 2026 read: IOPS=0, BW=1271KiB/s (1302kB/s)(4096KiB/3222msec) clat (nsec): min=1008.1M, max=1008.1M, avg=1008095769.00, stdev= 0.00 lat (nsec): min=1008.1M, max=1008.1M, avg=1008097985.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2543KiB/s (2604kB/s)(8192KiB/3222msec); 0 zone resets clat (msec): min=737, max=1426, avg=1081.99, stdev=486.86 lat (msec): min=738, max=1426, avg=1082.61, stdev=486.96 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8094, max= 8094, per=80.85%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.88%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146540: Sat Sep 5 03:19:54 2026 write: IOPS=0, BW=3754KiB/s (3844kB/s)(12.0MiB/3273msec); 0 zone resets clat (msec): min=308, max=1523, avg=1040.93, stdev=644.87 lat (msec): min=309, max=1524, avg=1041.38, stdev=644.69 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8094, max= 8192, per=81.34%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.67%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146541: Sat Sep 5 03:19:54 2026 write: IOPS=1, BW=4585KiB/s (4695kB/s)(12.0MiB/2680msec); 0 zone resets clat (msec): min=254, max=1413, avg=812.38, stdev=580.73 lat (msec): min=254, max=1414, avg=812.82, stdev=580.83 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8078, max= 8078, per=80.69%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.98%, ctx=78, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5085KiB/s (5207kB/s), 1271KiB/s-4592KiB/s (1302kB/s-4702kB/s), io=16.0MiB (16.8MB), run=2676-3222msec WRITE: bw=9.78MiB/s (10.3MB/s), 2543KiB/s-4585KiB/s (2604kB/s-4695kB/s), io=32.0MiB (33.6MB), run=2680-3273msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146534: Sat Sep 5 03:19:55 2026 read: IOPS=1, BW=4754KiB/s (4868kB/s)(12.0MiB/2585msec) clat (msec): min=702, max=1009, avg=836.91, stdev=156.92 lat (msec): min=702, max=1009, avg=836.92, stdev=156.92 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.59%, ctx=313, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146535: Sat Sep 5 03:19:55 2026 read: IOPS=0, BW=1405KiB/s (1438kB/s)(4096KiB/2916msec) clat (nsec): min=826010k, max=826010k, avg=826010163.00, stdev= 0.00 lat (nsec): min=826014k, max=826014k, avg=826013557.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2809KiB/s (2877kB/s)(8192KiB/2916msec); 0 zone resets clat (msec): min=640, max=1337, avg=989.33, stdev=492.97 lat (msec): min=642, max=1338, avg=990.29, stdev=491.88 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8175, max= 8175, per=98.26%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.92%, ctx=196, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146536: Sat Sep 5 03:19:55 2026 write: IOPS=0, BW=3120KiB/s (3195kB/s)(12.0MiB/3938msec); 0 zone resets clat (msec): min=242, max=2099, avg=1252.80, stdev=939.29 lat (msec): min=243, max=2103, avg=1254.18, stdev=940.50 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 8047, max= 8047, per=96.72%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.61%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146537: Sat Sep 5 03:19:55 2026 write: IOPS=1, BW=4929KiB/s (5047kB/s)(12.0MiB/2493msec); 0 zone resets clat (msec): min=509, max=1048, avg=784.00, stdev=269.43 lat (msec): min=510, max=1048, avg=784.70, stdev=269.27 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 5834, max= 8159, per=84.09%, avg=6996.50, stdev=1644.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.53%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5619KiB/s (5754kB/s), 1405KiB/s-4754KiB/s (1438kB/s-4868kB/s), io=16.0MiB (16.8MB), run=2585-2916msec WRITE: bw=8321KiB/s (8521kB/s), 2809KiB/s-4929KiB/s (2877kB/s-5047kB/s), io=32.0MiB (33.6MB), run=2493-3938msec