== sanity test 398b: DIO and buffer IO race ============== 18:42:17 (1784414537) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.03427 s, 16.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157631: Sat Jul 18 18:43:33 2026 read: IOPS=22, BW=90.6KiB/s (92.8kB/s)(5992KiB/66139msec) clat (usec): min=44, max=820045, avg=23721.55, stdev=24193.00 lat (usec): min=45, max=820045, avg=23722.45, stdev=24193.00 clat percentiles (usec): | 1.00th=[ 159], 5.00th=[ 6980], 10.00th=[ 9503], 20.00th=[ 13435], | 30.00th=[ 16319], 40.00th=[ 18744], 50.00th=[ 21103], 60.00th=[ 24249], | 70.00th=[ 27657], 80.00th=[ 31851], 90.00th=[ 38011], 95.00th=[ 44827], | 99.00th=[ 65274], 99.50th=[ 76022], 99.90th=[122160], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 13, max= 182, per=24.84%, avg=89.66, stdev=29.41, samples=131 iops : min= 3, max= 45, avg=21.94, stdev= 7.42, samples=131 write: IOPS=23, BW=95.2KiB/s (97.5kB/s)(6296KiB/66139msec); 0 zone resets clat (usec): min=741, max=129596, avg=19357.04, stdev=14670.56 lat (usec): min=742, max=129596, avg=19357.94, stdev=14670.61 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 3261], 10.00th=[ 4817], 20.00th=[ 6718], | 30.00th=[ 8979], 40.00th=[ 12780], 50.00th=[ 16188], 60.00th=[ 19792], | 70.00th=[ 24249], 80.00th=[ 30016], 90.00th=[ 38536], 95.00th=[ 46400], | 99.00th=[ 64226], 99.50th=[ 78119], 99.90th=[117965], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 39, max= 200, per=25.04%, avg=94.64, stdev=32.78, samples=130 iops : min= 9, max= 50, avg=23.18, stdev= 8.25, samples=130 lat (usec) : 50=0.03%, 100=0.07%, 250=0.98%, 500=0.42%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=0.59%, 4=2.77%, 10=17.06%, 20=30.96%, 50=43.36% lat (msec) : 100=3.29%, 250=0.20%, 1000=0.03% cpu : usr=0.09%, sys=29.86%, ctx=10381, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157632: Sat Jul 18 18:43:33 2026 read: IOPS=22, BW=89.7KiB/s (91.9kB/s)(5940KiB/66188msec) clat (usec): min=31, max=136969, avg=23433.55, stdev=13022.15 lat (usec): min=31, max=136969, avg=23434.36, stdev=13022.18 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 7701], 10.00th=[ 10683], 20.00th=[ 13698], | 30.00th=[ 16188], 40.00th=[ 19006], 50.00th=[ 21365], 60.00th=[ 24249], | 70.00th=[ 27919], 80.00th=[ 31851], 90.00th=[ 38536], 95.00th=[ 43254], | 99.00th=[ 65799], 99.50th=[ 70779], 99.90th=[135267], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 6, max= 206, per=24.64%, avg=88.94, stdev=29.52, samples=131 iops : min= 1, max= 51, avg=21.76, stdev= 7.40, samples=131 write: IOPS=23, BW=95.9KiB/s (98.2kB/s)(6348KiB/66188msec); 0 zone resets clat (usec): min=679, max=817545, avg=19685.76, stdev=24558.09 lat (usec): min=679, max=817546, avg=19686.63, stdev=24558.10 clat percentiles (usec): | 1.00th=[ 947], 5.00th=[ 2933], 10.00th=[ 4424], 20.00th=[ 6456], | 30.00th=[ 9110], 40.00th=[ 12649], 50.00th=[ 16057], 60.00th=[ 20055], | 70.00th=[ 24773], 80.00th=[ 30540], 90.00th=[ 38536], 95.00th=[ 46400], | 99.00th=[ 64226], 99.50th=[ 76022], 99.90th=[ 93848], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 13, max= 216, per=25.02%, avg=94.56, stdev=33.27, samples=131 iops : min= 3, max= 54, avg=23.16, stdev= 8.37, samples=131 lat (usec) : 50=0.10%, 100=0.13%, 250=0.94%, 500=0.23%, 750=0.13% lat (usec) : 1000=0.49% lat (msec) : 2=0.55%, 4=3.55%, 10=15.04%, 20=31.51%, 50=43.91% lat (msec) : 100=3.26%, 250=0.13%, 1000=0.03% cpu : usr=0.09%, sys=29.85%, ctx=10410, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157633: Sat Jul 18 18:43:33 2026 read: IOPS=22, BW=91.3KiB/s (93.5kB/s)(6028KiB/66036msec) clat (usec): min=33, max=827365, avg=23843.49, stdev=24396.05 lat (usec): min=34, max=827366, avg=23844.85, stdev=24396.13 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 6783], 10.00th=[ 9634], 20.00th=[ 13698], | 30.00th=[ 16319], 40.00th=[ 19006], 50.00th=[ 21627], 60.00th=[ 24773], | 70.00th=[ 27919], 80.00th=[ 31851], 90.00th=[ 38536], 95.00th=[ 44827], | 99.00th=[ 61604], 99.50th=[ 70779], 99.90th=[145753], 99.95th=[826278], | 99.99th=[826278] bw ( KiB/s): min= 6, max= 160, per=25.13%, avg=90.73, stdev=27.59, samples=131 iops : min= 1, max= 40, avg=22.20, stdev= 6.95, samples=131 write: IOPS=23, BW=94.8KiB/s (97.1kB/s)(6260KiB/66036msec); 0 zone resets clat (usec): min=645, max=102874, avg=19148.45, stdev=14078.98 lat (usec): min=645, max=102875, avg=19149.49, stdev=14079.07 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 3326], 10.00th=[ 4686], 20.00th=[ 6652], | 30.00th=[ 9241], 40.00th=[ 12780], 50.00th=[ 16188], 60.00th=[ 20055], | 70.00th=[ 24249], 80.00th=[ 29754], 90.00th=[ 37487], 95.00th=[ 45351], | 99.00th=[ 65274], 99.50th=[ 79168], 99.90th=[100140], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 19, max= 207, per=24.88%, avg=94.05, stdev=32.44, samples=131 iops : min= 4, max= 51, avg=23.03, stdev= 8.12, samples=131 lat (usec) : 50=0.03%, 100=0.20%, 250=1.37%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=0.91%, 4=2.51%, 10=15.95%, 20=30.70%, 50=44.63% lat (msec) : 100=3.03%, 250=0.13%, 1000=0.03% cpu : usr=0.08%, sys=29.75%, ctx=10571, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157634: Sat Jul 18 18:43:33 2026 read: IOPS=22, BW=91.1KiB/s (93.3kB/s)(6052KiB/66436msec) clat (usec): min=30, max=734752, avg=23680.98, stdev=22515.03 lat (usec): min=31, max=734752, avg=23682.55, stdev=22515.38 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 5538], 10.00th=[ 9372], 20.00th=[ 13304], | 30.00th=[ 16319], 40.00th=[ 18482], 50.00th=[ 21103], 60.00th=[ 24511], | 70.00th=[ 27919], 80.00th=[ 32113], 90.00th=[ 38536], 95.00th=[ 45876], | 99.00th=[ 70779], 99.50th=[ 77071], 99.90th=[111674], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 31, max= 272, per=25.32%, avg=91.42, stdev=29.68, samples=131 iops : min= 7, max= 68, avg=22.37, stdev= 7.45, samples=131 write: IOPS=23, BW=93.9KiB/s (96.1kB/s)(6236KiB/66436msec); 0 zone resets clat (usec): min=638, max=107106, avg=19547.64, stdev=14575.82 lat (usec): min=638, max=107107, avg=19548.51, stdev=14575.85 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 3326], 10.00th=[ 4752], 20.00th=[ 6652], | 30.00th=[ 9241], 40.00th=[ 12911], 50.00th=[ 16450], 60.00th=[ 20055], | 70.00th=[ 24249], 80.00th=[ 30016], 90.00th=[ 40109], 95.00th=[ 47973], | 99.00th=[ 67634], 99.50th=[ 72877], 99.90th=[ 82314], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 26, max= 272, per=24.69%, avg=93.33, stdev=35.74, samples=132 iops : min= 6, max= 68, avg=22.86, stdev= 9.01, samples=132 lat (usec) : 50=0.03%, 100=0.16%, 250=1.27%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.01%, 4=2.67%, 10=15.59%, 20=31.41%, 50=43.39% lat (msec) : 100=3.55%, 250=0.10%, 750=0.03% cpu : usr=0.07%, sys=29.44%, ctx=10502, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=361KiB/s (370kB/s), 89.7KiB/s-91.3KiB/s (91.9kB/s-93.5kB/s), io=23.4MiB (24.6MB), run=66036-66436msec WRITE: bw=378KiB/s (387kB/s), 93.9KiB/s-95.9KiB/s (96.1kB/s-98.2kB/s), io=24.6MiB (25.7MB), run=66036-66436msec rand-rw: (groupid=0, jobs=1): err= 0: pid=157626: Sat Jul 18 18:43:52 2026 read: IOPS=17, BW=69.8KiB/s (71.5kB/s)(5992KiB/85810msec) clat (msec): min=2, max=838, avg=18.93, stdev=27.74 lat (msec): min=2, max=838, avg=18.93, stdev=27.74 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 13], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 41], 95.00th=[ 56], | 99.00th=[ 83], 99.50th=[ 104], 99.90th=[ 140], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 256, per=25.12%, avg=70.10, stdev=45.33, samples=168 iops : min= 1, max= 64, avg=17.17, stdev=11.52, samples=168 write: IOPS=18, BW=73.4KiB/s (75.1kB/s)(6296KiB/85810msec); 0 zone resets clat (msec): min=11, max=208, avg=36.37, stdev=20.41 lat (msec): min=11, max=208, avg=36.37, stdev=20.41 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 75], | 99.00th=[ 107], 99.50th=[ 127], 99.90th=[ 169], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 8, max= 176, per=25.03%, avg=73.09, stdev=42.61, samples=169 iops : min= 2, max= 44, avg=17.92, stdev=10.83, samples=169 lat (msec) : 4=4.49%, 10=17.48%, 20=20.38%, 50=43.88%, 100=12.79% lat (msec) : 250=0.94%, 1000=0.03% cpu : usr=0.07%, sys=12.55%, ctx=6961, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157627: Sat Jul 18 18:43:52 2026 read: IOPS=17, BW=69.4KiB/s (71.1kB/s)(5940KiB/85602msec) clat (msec): min=2, max=750, avg=18.64, stdev=25.92 lat (msec): min=2, max=750, avg=18.64, stdev=25.92 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 13], 60.00th=[ 17], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 55], | 99.00th=[ 83], 99.50th=[ 89], 99.90th=[ 163], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 232, per=24.91%, avg=69.50, stdev=47.25, samples=169 iops : min= 1, max= 58, avg=17.02, stdev=11.98, samples=169 write: IOPS=18, BW=74.2KiB/s (75.9kB/s)(6348KiB/85602msec); 0 zone resets clat (msec): min=12, max=168, avg=36.36, stdev=20.64 lat (msec): min=12, max=168, avg=36.36, stdev=20.64 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 65], 95.00th=[ 77], | 99.00th=[ 111], 99.50th=[ 128], 99.90th=[ 157], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 15, max= 184, per=25.39%, avg=74.14, stdev=43.90, samples=169 iops : min= 3, max= 46, avg=18.18, stdev=11.16, samples=169 lat (msec) : 4=4.17%, 10=18.20%, 20=20.77%, 50=42.97%, 100=13.09% lat (msec) : 250=0.78%, 1000=0.03% cpu : usr=0.06%, sys=12.58%, ctx=7058, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157628: Sat Jul 18 18:43:52 2026 read: IOPS=17, BW=70.2KiB/s (71.9kB/s)(6028KiB/85895msec) clat (msec): min=2, max=146, avg=19.10, stdev=18.94 lat (msec): min=2, max=146, avg=19.10, stdev=18.94 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 56], | 99.00th=[ 85], 99.50th=[ 111], 99.90th=[ 142], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 8, max= 232, per=25.22%, avg=70.36, stdev=45.75, samples=170 iops : min= 2, max= 58, avg=17.24, stdev=11.61, samples=170 write: IOPS=18, BW=72.9KiB/s (74.6kB/s)(6260KiB/85895msec); 0 zone resets clat (msec): min=10, max=767, avg=36.36, stdev=27.38 lat (msec): min=10, max=767, avg=36.36, stdev=27.38 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 74], | 99.00th=[ 106], 99.50th=[ 120], 99.90th=[ 182], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 15, max= 192, per=25.01%, avg=73.04, stdev=44.43, samples=170 iops : min= 3, max= 48, avg=17.91, stdev=11.29, samples=170 lat (msec) : 4=4.92%, 10=16.93%, 20=20.96%, 50=43.16%, 100=12.92% lat (msec) : 250=1.07%, 1000=0.03% cpu : usr=0.08%, sys=12.50%, ctx=7013, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157629: Sat Jul 18 18:43:52 2026 read: IOPS=17, BW=70.8KiB/s (72.5kB/s)(6052KiB/85503msec) clat (msec): min=2, max=154, avg=18.91, stdev=18.39 lat (msec): min=2, max=154, avg=18.91, stdev=18.39 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 57], | 99.00th=[ 83], 99.50th=[ 93], 99.90th=[ 144], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 15, max= 232, per=25.72%, avg=71.77, stdev=45.37, samples=167 iops : min= 3, max= 58, avg=17.59, stdev=11.52, samples=167 write: IOPS=18, BW=72.9KiB/s (74.7kB/s)(6236KiB/85503msec); 0 zone resets clat (msec): min=12, max=771, avg=36.36, stdev=27.69 lat (msec): min=12, max=771, avg=36.37, stdev=27.69 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 50], 90.00th=[ 63], 95.00th=[ 75], | 99.00th=[ 105], 99.50th=[ 129], 99.90th=[ 218], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 23, max= 192, per=25.01%, avg=73.04, stdev=43.26, samples=169 iops : min= 5, max= 48, avg=17.91, stdev=11.01, samples=169 lat (msec) : 4=4.39%, 10=17.87%, 20=20.15%, 50=44.34%, 100=12.40% lat (msec) : 250=0.81%, 1000=0.03% cpu : usr=0.07%, sys=12.58%, ctx=6863, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=280KiB/s (286kB/s), 69.4KiB/s-70.8KiB/s (71.1kB/s-72.5kB/s), io=23.4MiB (24.6MB), run=85503-85895msec WRITE: bw=293KiB/s (300kB/s), 72.9KiB/s-74.2KiB/s (74.6kB/s-75.9kB/s), io=24.6MiB (25.7MB), run=85503-85895msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157661: Sat Jul 18 18:44:15 2026 read: IOPS=23, BW=373KiB/s (382kB/s)(5920KiB/15851msec) clat (usec): min=60, max=98134, avg=22248.23, stdev=13758.42 lat (usec): min=61, max=98135, avg=22249.00, stdev=13758.51 clat percentiles (usec): | 1.00th=[ 92], 5.00th=[ 172], 10.00th=[ 7898], 20.00th=[12518], | 30.00th=[15008], 40.00th=[17171], 50.00th=[20579], 60.00th=[23987], | 70.00th=[26608], 80.00th=[30540], 90.00th=[38536], 95.00th=[47973], | 99.00th=[64226], 99.50th=[74974], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 127, max= 670, per=25.07%, avg=368.77, stdev=122.49, samples=31 iops : min= 7, max= 41, avg=22.42, stdev= 7.68, samples=31 write: IOPS=25, BW=402KiB/s (411kB/s)(6368KiB/15851msec); 0 zone resets clat (usec): min=1179, max=78564, avg=18991.74, stdev=13734.20 lat (usec): min=1179, max=78566, avg=18993.20, stdev=13734.26 clat percentiles (usec): | 1.00th=[ 1336], 5.00th=[ 4686], 10.00th=[ 5407], 20.00th=[ 6980], | 30.00th=[ 9372], 40.00th=[11994], 50.00th=[15401], 60.00th=[18744], | 70.00th=[23462], 80.00th=[30278], 90.00th=[36439], 95.00th=[47449], | 99.00th=[62129], 99.50th=[71828], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 160, max= 638, per=25.84%, avg=399.94, stdev=129.83, samples=31 iops : min= 10, max= 39, avg=24.39, stdev= 8.08, samples=31 lat (usec) : 100=0.78%, 250=2.60%, 500=0.78% lat (msec) : 2=0.52%, 4=0.78%, 10=16.80%, 20=32.81%, 50=40.62% lat (msec) : 100=4.30% cpu : usr=0.07%, sys=32.73%, ctx=2892, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157662: Sat Jul 18 18:44:15 2026 read: IOPS=22, BW=359KiB/s (368kB/s)(5744KiB/15998msec) clat (usec): min=46, max=114638, avg=22754.48, stdev=14762.24 lat (usec): min=47, max=114640, avg=22755.37, stdev=14762.26 clat percentiles (usec): | 1.00th=[ 94], 5.00th=[ 145], 10.00th=[ 9241], 20.00th=[ 13566], | 30.00th=[ 15139], 40.00th=[ 17171], 50.00th=[ 19792], 60.00th=[ 23462], | 70.00th=[ 27395], 80.00th=[ 32113], 90.00th=[ 40109], 95.00th=[ 46400], | 99.00th=[ 77071], 99.50th=[ 92799], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 159, max= 634, per=24.32%, avg=357.68, stdev=108.93, samples=31 iops : min= 9, max= 39, avg=21.71, stdev= 6.77, samples=31 write: IOPS=25, BW=409KiB/s (419kB/s)(6544KiB/15998msec); 0 zone resets clat (usec): min=1189, max=68067, avg=18902.39, stdev=13358.60 lat (usec): min=1189, max=68068, avg=18903.64, stdev=13358.67 clat percentiles (usec): | 1.00th=[ 2024], 5.00th=[ 4686], 10.00th=[ 5342], 20.00th=[ 7373], | 30.00th=[ 9634], 40.00th=[12780], 50.00th=[14877], 60.00th=[18482], | 70.00th=[23462], 80.00th=[28443], 90.00th=[39584], 95.00th=[45351], | 99.00th=[60031], 99.50th=[60556], 99.90th=[67634], 99.95th=[67634], | 99.99th=[67634] bw ( KiB/s): min= 222, max= 766, per=25.74%, avg=398.48, stdev=147.86, samples=31 iops : min= 13, max= 47, avg=24.29, stdev= 9.26, samples=31 lat (usec) : 50=0.26%, 100=0.26%, 250=2.60%, 500=0.65% lat (msec) : 2=0.52%, 4=0.91%, 10=16.80%, 20=35.29%, 50=39.19% lat (msec) : 100=3.39%, 250=0.13% cpu : usr=0.14%, sys=32.11%, ctx=2999, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157663: Sat Jul 18 18:44:15 2026 read: IOPS=24, BW=384KiB/s (394kB/s)(6256KiB/16278msec) clat (usec): min=43, max=90220, avg=22641.90, stdev=14389.52 lat (usec): min=44, max=90221, avg=22642.77, stdev=14389.53 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 155], 10.00th=[ 338], 20.00th=[11731], | 30.00th=[15008], 40.00th=[17695], 50.00th=[20841], 60.00th=[24773], | 70.00th=[28705], 80.00th=[32375], 90.00th=[41157], 95.00th=[49021], | 99.00th=[65274], 99.50th=[87557], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 159, max= 640, per=26.10%, avg=383.94, stdev=107.31, samples=32 iops : min= 9, max= 40, avg=23.37, stdev= 6.76, samples=32 write: IOPS=23, BW=371KiB/s (379kB/s)(6032KiB/16278msec); 0 zone resets clat (usec): min=1349, max=121285, avg=19620.80, stdev=14648.98 lat (usec): min=1350, max=121286, avg=19622.12, stdev=14649.06 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 17], 60.00th=[ 20], | 70.00th=[ 26], 80.00th=[ 31], 90.00th=[ 39], 95.00th=[ 48], | 99.00th=[ 63], 99.50th=[ 85], 99.90th=[ 122], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 127, max= 634, per=23.43%, avg=362.72, stdev=146.91, samples=32 iops : min= 7, max= 39, avg=22.06, stdev= 9.13, samples=32 lat (usec) : 50=0.13%, 100=0.52%, 250=3.78%, 500=0.78% lat (msec) : 2=0.26%, 4=0.78%, 10=17.06%, 20=30.34%, 50=42.58% lat (msec) : 100=3.65%, 250=0.13% cpu : usr=0.04%, sys=31.06%, ctx=2884, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157664: Sat Jul 18 18:44:15 2026 read: IOPS=23, BW=380KiB/s (389kB/s)(6032KiB/15861msec) clat (usec): min=63, max=76476, avg=21808.41, stdev=13689.95 lat (usec): min=64, max=76477, avg=21809.28, stdev=13690.25 clat percentiles (usec): | 1.00th=[ 87], 5.00th=[ 153], 10.00th=[ 273], 20.00th=[11994], | 30.00th=[14877], 40.00th=[17171], 50.00th=[19792], 60.00th=[22676], | 70.00th=[26870], 80.00th=[32375], 90.00th=[40109], 95.00th=[47449], | 99.00th=[58983], 99.50th=[69731], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 160, max= 544, per=25.59%, avg=376.45, stdev=119.56, samples=31 iops : min= 10, max= 34, avg=22.90, stdev= 7.52, samples=31 write: IOPS=24, BW=394KiB/s (404kB/s)(6256KiB/15861msec); 0 zone resets clat (usec): min=2653, max=82721, avg=19354.39, stdev=14222.25 lat (usec): min=2654, max=82722, avg=19355.77, stdev=14222.37 clat percentiles (usec): | 1.00th=[ 3752], 5.00th=[ 4948], 10.00th=[ 5932], 20.00th=[ 8029], | 30.00th=[10159], 40.00th=[12125], 50.00th=[14615], 60.00th=[17957], | 70.00th=[23200], 80.00th=[28443], 90.00th=[39584], 95.00th=[50594], | 99.00th=[67634], 99.50th=[72877], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 222, max= 638, per=25.21%, avg=390.26, stdev=120.85, samples=31 iops : min= 13, max= 39, avg=23.77, stdev= 7.51, samples=31 lat (usec) : 100=0.78%, 250=3.91%, 500=0.65% lat (msec) : 4=0.91%, 10=15.63%, 20=35.81%, 50=37.63%, 100=4.69% cpu : usr=0.12%, sys=32.06%, ctx=2887, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1471KiB/s (1507kB/s), 359KiB/s-384KiB/s (368kB/s-394kB/s), io=23.4MiB (24.5MB), run=15851-16278msec WRITE: bw=1548KiB/s (1585kB/s), 371KiB/s-409KiB/s (379kB/s-419kB/s), io=24.6MiB (25.8MB), run=15851-16278msec fio: pid=157667, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=157666: Sat Jul 18 18:44:21 2026 read: IOPS=17, BW=273KiB/s (279kB/s)(5920KiB/21724msec) clat (msec): min=2, max=143, avg=19.87, stdev=18.04 lat (msec): min=2, max=143, avg=19.87, stdev=18.04 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 62], | 99.00th=[ 74], 99.50th=[ 91], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 64, max= 768, per=26.36%, avg=272.35, stdev=161.19, samples=43 iops : min= 4, max= 48, avg=16.65, stdev=10.19, samples=43 write: IOPS=18, BW=293KiB/s (300kB/s)(6368KiB/21724msec); 0 zone resets clat (msec): min=13, max=187, avg=35.99, stdev=22.15 lat (msec): min=13, max=187, avg=35.99, stdev=22.15 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 18], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 50], 90.00th=[ 65], 95.00th=[ 78], | 99.00th=[ 117], 99.50th=[ 169], 99.90th=[ 188], 99.95th=[ 188], | 99.99th=[ 188] bw ( KiB/s): min= 64, max= 640, per=27.53%, avg=293.98, stdev=166.84, samples=43 iops : min= 4, max= 40, avg=18.00, stdev=10.54, samples=43 lat (msec) : 4=1.82%, 10=16.28%, 20=25.13%, 50=42.71%, 100=12.89% lat (msec) : 250=1.17% cpu : usr=0.05%, sys=12.34%, ctx=1881, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=157667: Sat Jul 18 18:44:21 2026 read: IOPS=14, BW=228KiB/s (233kB/s)(4240KiB/18604msec) clat (msec): min=3, max=141, avg=22.08, stdev=19.31 lat (msec): min=3, max=141, avg=22.08, stdev=19.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 21], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 52], 95.00th=[ 63], | 99.00th=[ 78], 99.50th=[ 79], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 49, max= 606, per=20.90%, avg=215.89, stdev=132.78, samples=36 iops : min= 3, max= 37, avg=13.08, stdev= 8.37, samples=36 write: IOPS=15, BW=245KiB/s (251kB/s)(4560KiB/18604msec); 0 zone resets clat (msec): min=14, max=156, avg=44.26, stdev=24.68 lat (msec): min=14, max=156, avg=44.26, stdev=24.68 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 26], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 59], 90.00th=[ 80], 95.00th=[ 94], | 99.00th=[ 140], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 127, max= 544, per=22.35%, avg=238.67, stdev=103.14, samples=36 iops : min= 7, max= 34, avg=14.50, stdev= 6.48, samples=36 lat (msec) : 4=1.27%, 10=14.88%, 20=14.88%, 50=49.36%, 100=17.42% lat (msec) : 250=2.00% cpu : usr=0.07%, sys=12.39%, ctx=1369, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=266,285,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157668: Sat Jul 18 18:44:21 2026 read: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21626msec) clat (msec): min=3, max=105, avg=18.67, stdev=16.43 lat (msec): min=3, max=105, avg=18.67, stdev=16.43 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 17], | 70.00th=[ 20], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 53], | 99.00th=[ 79], 99.50th=[ 99], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 64, max= 896, per=27.89%, avg=288.14, stdev=194.84, samples=42 iops : min= 4, max= 56, avg=17.64, stdev=12.31, samples=42 write: IOPS=17, BW=279KiB/s (286kB/s)(6032KiB/21626msec); 0 zone resets clat (msec): min=13, max=177, avg=37.88, stdev=23.03 lat (msec): min=13, max=177, avg=37.88, stdev=23.03 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 53], 90.00th=[ 68], 95.00th=[ 83], | 99.00th=[ 128], 99.50th=[ 159], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 95, max= 640, per=25.48%, avg=272.17, stdev=141.10, samples=42 iops : min= 5, max= 40, avg=16.64, stdev= 9.01, samples=42 lat (msec) : 4=1.56%, 10=19.14%, 20=23.18%, 50=42.45%, 100=12.50% lat (msec) : 250=1.17% cpu : usr=0.09%, sys=12.59%, ctx=1856, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157669: Sat Jul 18 18:44:21 2026 read: IOPS=17, BW=280KiB/s (286kB/s)(6032KiB/21568msec) clat (msec): min=3, max=137, avg=20.16, stdev=19.85 lat (msec): min=3, max=137, avg=20.16, stdev=19.85 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 88], 99.50th=[ 127], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 672, per=26.51%, avg=273.83, stdev=157.04, samples=42 iops : min= 5, max= 42, avg=16.76, stdev= 9.97, samples=42 write: IOPS=18, BW=290KiB/s (297kB/s)(6256KiB/21568msec); 0 zone resets clat (msec): min=13, max=175, avg=35.58, stdev=20.85 lat (msec): min=13, max=175, avg=35.59, stdev=20.85 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 64], 95.00th=[ 78], | 99.00th=[ 116], 99.50th=[ 146], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 64, max= 640, per=26.89%, avg=287.17, stdev=163.25, samples=42 iops : min= 4, max= 40, avg=17.60, stdev=10.34, samples=42 lat (msec) : 4=0.91%, 10=17.71%, 20=24.22%, 50=42.19%, 100=13.93% lat (msec) : 250=1.04% cpu : usr=0.06%, sys=12.51%, ctx=1869, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1033KiB/s (1058kB/s), 228KiB/s-289KiB/s (233kB/s-296kB/s), io=21.9MiB (22.0MB), run=18604-21724msec WRITE: bw=1069KiB/s (1094kB/s), 245KiB/s-293KiB/s (251kB/s-300kB/s), io=22.7MiB (23.8MB), run=18604-21724msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157678: Sat Jul 18 18:44:29 2026 read: IOPS=2, BW=2944KiB/s (3014kB/s)(7168KiB/2435msec) clat (usec): min=533, max=300155, avg=153085.67, stdev=91406.33 lat (usec): min=535, max=300157, avg=153087.30, stdev=91406.29 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[125305], | 30.00th=[137364], 40.00th=[137364], 50.00th=[145753], 60.00th=[147850], | 70.00th=[147850], 80.00th=[217056], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1924, max= 5342, per=56.26%, avg=3784.33, stdev=1728.98, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=2, BW=2103KiB/s (2153kB/s)(5120KiB/2435msec); 0 zone resets clat (msec): min=200, max=355, avg=270.06, stdev=77.52 lat (msec): min=200, max=355, avg=270.10, stdev=77.52 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 201], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 1924, max= 3871, per=27.74%, avg=2612.67, stdev=1091.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.12%, sys=49.84%, ctx=795, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157679: Sat Jul 18 18:44:29 2026 read: IOPS=0, BW=673KiB/s (689kB/s)(2048KiB/3044msec) clat (msec): min=103, max=396, avg=250.17, stdev=207.29 lat (msec): min=103, max=396, avg=250.17, stdev=207.29 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 397], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1783, max= 1924, per=27.55%, avg=1853.50, stdev=99.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3364KiB/s (3445kB/s)(10.0MiB/3044msec); 0 zone resets clat (msec): min=111, max=620, avg=249.72, stdev=166.38 lat (msec): min=111, max=620, avg=249.79, stdev=166.37 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 114], | 30.00th=[ 144], 40.00th=[ 148], 50.00th=[ 178], 60.00th=[ 218], | 70.00th=[ 239], 80.00th=[ 264], 90.00th=[ 464], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 3923, max= 5807, per=48.90%, avg=4605.67, stdev=1043.61, samples=3 iops : min= 3, max= 5, avg= 3.67, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.10%, sys=44.63%, ctx=652, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157680: Sat Jul 18 18:44:29 2026 read: IOPS=2, BW=2598KiB/s (2660kB/s)(6144KiB/2365msec) clat (usec): min=521, max=214786, avg=130359.80, stdev=101270.25 lat (usec): min=522, max=214786, avg=130360.89, stdev=101269.94 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 668], | 30.00th=[ 668], 40.00th=[175113], 50.00th=[175113], 60.00th=[193987], | 70.00th=[196084], 80.00th=[196084], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 2043, max= 3871, per=48.38%, avg=3254.33, stdev=1049.10, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2598KiB/s (2660kB/s)(6144KiB/2365msec); 0 zone resets clat (msec): min=112, max=535, avg=254.45, stdev=148.81 lat (msec): min=112, max=535, avg=254.51, stdev=148.82 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 226], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1924, max= 3561, per=25.12%, avg=2365.75, stdev=798.64, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 250=66.67%, 500=8.33%, 750=8.33% cpu : usr=0.04%, sys=41.18%, ctx=277, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157681: Sat Jul 18 18:44:29 2026 read: IOPS=1, BW=1764KiB/s (1807kB/s)(5120KiB/2902msec) clat (usec): min=449, max=185649, avg=86846.94, stdev=83781.75 lat (usec): min=451, max=185652, avg=86848.09, stdev=83782.02 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 449], | 30.00th=[ 453], 40.00th=[ 453], 50.00th=[105382], 60.00th=[105382], | 70.00th=[141558], 80.00th=[141558], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 3849, max= 3923, per=57.77%, avg=3886.00, stdev=52.33, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2470KiB/s (2529kB/s)(7168KiB/2902msec); 0 zone resets clat (msec): min=161, max=677, avg=343.75, stdev=179.93 lat (msec): min=161, max=677, avg=343.82, stdev=179.93 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 188], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 317], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1787, max= 3923, per=24.66%, avg=2322.40, stdev=899.37, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=39.95%, ctx=392, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6728KiB/s (6889kB/s), 673KiB/s-2944KiB/s (689kB/s-3014kB/s), io=20.0MiB (20.0MB), run=2365-3044msec WRITE: bw=9419KiB/s (9645kB/s), 2103KiB/s-3364KiB/s (2153kB/s-3445kB/s), io=28.0MiB (29.4MB), run=2365-3044msec rand-rw: (groupid=0, jobs=1): err= 0: pid=157682: Sat Jul 18 18:44:30 2026 read: IOPS=2, BW=2620KiB/s (2683kB/s)(7168KiB/2736msec) clat (msec): min=93, max=178, avg=137.06, stdev=37.51 lat (msec): min=93, max=178, avg=137.06, stdev=37.51 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 99], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 144], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 174], 90.00th=[ 178], 95.00th=[ 178], | 99.00th=[ 178], 99.50th=[ 178], 99.90th=[ 178], 99.95th=[ 178], | 99.99th=[ 178] bw ( KiB/s): min= 1845, max= 5197, per=44.86%, avg=2761.25, stdev=1625.51, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1871KiB/s (1916kB/s)(5120KiB/2736msec); 0 zone resets clat (msec): min=102, max=440, avg=340.59, stdev=136.87 lat (msec): min=102, max=440, avg=340.64, stdev=136.88 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1845, max= 4096, per=28.85%, avg=2486.00, stdev=1075.88, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=16.27%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157683: Sat Jul 18 18:44:30 2026 read: IOPS=0, BW=616KiB/s (630kB/s)(2048KiB/3327msec) clat (msec): min=114, max=120, avg=117.31, stdev= 3.87 lat (msec): min=114, max=120, avg=117.31, stdev= 3.87 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 121], | 70.00th=[ 121], 80.00th=[ 121], 90.00th=[ 121], 95.00th=[ 121], | 99.00th=[ 121], 99.50th=[ 121], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 1741, max= 1996, per=30.36%, avg=1868.50, stdev=180.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3078KiB/s (3152kB/s)(10.0MiB/3327msec); 0 zone resets clat (msec): min=66, max=803, avg=301.43, stdev=246.08 lat (msec): min=66, max=803, avg=301.50, stdev=246.08 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 73], | 30.00th=[ 138], 40.00th=[ 146], 50.00th=[ 165], 60.00th=[ 226], | 70.00th=[ 342], 80.00th=[ 477], 90.00th=[ 584], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1845, max= 4096, per=32.59%, avg=2808.00, stdev=1177.52, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.64, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=17.11%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157684: Sat Jul 18 18:44:30 2026 read: IOPS=1, BW=1861KiB/s (1905kB/s)(6144KiB/3302msec) clat (msec): min=71, max=417, avg=145.73, stdev=135.54 lat (msec): min=71, max=417, avg=145.73, stdev=135.54 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 75], | 30.00th=[ 75], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 85], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2007, max= 6144, per=55.23%, avg=3399.67, stdev=2376.75, samples=3 iops : min= 1, max= 6, avg= 3.00, stdev= 2.65, samples=3 write: IOPS=1, BW=1861KiB/s (1905kB/s)(6144KiB/3302msec); 0 zone resets clat (msec): min=53, max=791, avg=393.87, stdev=270.01 lat (msec): min=53, max=791, avg=393.93, stdev=270.01 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 502], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1738, max= 4096, per=28.10%, avg=2421.50, stdev=1121.80, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=41.67%, 250=16.67%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=14.27%, ctx=134, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157685: Sat Jul 18 18:44:30 2026 read: IOPS=1, BW=1577KiB/s (1615kB/s)(5120KiB/3247msec) clat (msec): min=52, max=607, avg=277.15, stdev=222.63 lat (msec): min=52, max=607, avg=277.15, stdev=222.63 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 53], 10.00th=[ 53], 20.00th=[ 53], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 230], 60.00th=[ 230], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1996, max= 4096, per=44.08%, avg=2713.33, stdev=1197.71, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 write: IOPS=2, BW=2208KiB/s (2261kB/s)(7168KiB/3247msec); 0 zone resets clat (msec): min=74, max=445, avg=263.80, stdev=145.07 lat (msec): min=74, max=445, avg=263.87, stdev=145.08 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 100], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 279], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 384], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1845, max= 4096, per=33.09%, avg=2851.75, stdev=1102.13, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=25.00%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.03%, sys=13.89%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6156KiB/s (6303kB/s), 616KiB/s-2620KiB/s (630kB/s-2683kB/s), io=20.0MiB (20.0MB), run=2736-3327msec WRITE: bw=8618KiB/s (8825kB/s), 1861KiB/s-3078KiB/s (1905kB/s-3152kB/s), io=28.0MiB (29.4MB), run=2736-3327msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=157690: Sat Jul 18 18:44:38 2026 read: IOPS=1, BW=6253KiB/s (6404kB/s)(12.0MiB/1965msec) clat (msec): min=583, max=680, avg=646.78, stdev=54.76 lat (msec): min=583, max=680, avg=646.78, stdev=54.76 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 8192, max= 8192, per=98.26%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=14.92%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157691: Sat Jul 18 18:44:38 2026 read: IOPS=0, BW=2622KiB/s (2685kB/s)(4096KiB/1562msec) clat (nsec): min=113323k, max=113323k, avg=113322632.00, stdev= 0.00 lat (nsec): min=113326k, max=113326k, avg=113325847.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 114], 60.00th=[ 114], | 70.00th=[ 114], 80.00th=[ 114], 90.00th=[ 114], 95.00th=[ 114], | 99.00th=[ 114], 99.50th=[ 114], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 7340, max= 7340, per=88.04%, avg=7340.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5245KiB/s (5370kB/s)(8192KiB/1562msec); 0 zone resets clat (msec): min=652, max=787, avg=719.59, stdev=95.56 lat (msec): min=652, max=787, avg=719.91, stdev=95.53 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8192, max= 8192, per=54.03%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.98%, ctx=91, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157692: Sat Jul 18 18:44:38 2026 write: IOPS=1, BW=5686KiB/s (5823kB/s)(12.0MiB/2161msec); 0 zone resets clat (msec): min=376, max=1296, avg=712.65, stdev=507.39 lat (msec): min=376, max=1296, avg=712.91, stdev=507.27 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 464], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7380, max= 8192, per=51.35%, avg=7786.00, stdev=574.17, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=17.55%, ctx=75, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157693: Sat Jul 18 18:44:38 2026 write: IOPS=2, BW=8203KiB/s (8400kB/s)(12.0MiB/1498msec); 0 zone resets clat (msec): min=176, max=860, avg=490.18, stdev=345.35 lat (msec): min=176, max=860, avg=490.53, stdev=345.37 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7742, max= 8192, per=52.54%, avg=7967.00, stdev=318.20, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.13%, sys=19.04%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8338KiB/s (8538kB/s), 2622KiB/s-6253KiB/s (2685kB/s-6404kB/s), io=16.0MiB (16.8MB), run=1562-1965msec WRITE: bw=14.8MiB/s (15.5MB/s), 5245KiB/s-8203KiB/s (5370kB/s-8400kB/s), io=32.0MiB (33.6MB), run=1498-2161msec rand-rw: (groupid=0, jobs=1): err= 0: pid=157695: Sat Jul 18 18:44:38 2026 read: IOPS=2, BW=8463KiB/s (8666kB/s)(12.0MiB/1452msec) clat (msec): min=413, max=563, avg=477.15, stdev=77.37 lat (msec): min=413, max=563, avg=477.15, stdev=77.37 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 5527, max= 8159, per=91.26%, avg=6843.00, stdev=1861.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=55.96%, ctx=2963, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157696: Sat Jul 18 18:44:38 2026 read: IOPS=0, BW=1875KiB/s (1920kB/s)(4096KiB/2185msec) clat (nsec): min=440615k, max=440615k, avg=440615053.00, stdev= 0.00 lat (nsec): min=440619k, max=440619k, avg=440618553.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7627, max= 7627, per=100.00%, avg=7627.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3749KiB/s (3839kB/s)(8192KiB/2185msec); 0 zone resets clat (msec): min=562, max=1141, avg=851.99, stdev=408.76 lat (msec): min=563, max=1141, avg=852.29, stdev=408.68 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8143, max= 8143, per=54.75%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=19.96%, ctx=1054, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157697: Sat Jul 18 18:44:38 2026 write: IOPS=1, BW=5578KiB/s (5712kB/s)(12.0MiB/2203msec); 0 zone resets clat (msec): min=533, max=1006, avg=720.29, stdev=251.79 lat (msec): min=533, max=1006, avg=720.59, stdev=251.77 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8143, max= 8159, per=54.80%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.05%, sys=13.67%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=157698: Sat Jul 18 18:44:38 2026 write: IOPS=1, BW=5894KiB/s (6035kB/s)(12.0MiB/2085msec); 0 zone resets clat (msec): min=278, max=993, avg=690.87, stdev=369.89 lat (msec): min=279, max=993, avg=691.19, stdev=369.74 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8159, max= 8159, per=54.85%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.05%, sys=16.89%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7498KiB/s (7678kB/s), 1875KiB/s-8463KiB/s (1920kB/s-8666kB/s), io=16.0MiB (16.8MB), run=1452-2185msec WRITE: bw=14.5MiB/s (15.2MB/s), 3749KiB/s-5894KiB/s (3839kB/s-6035kB/s), io=32.0MiB (33.6MB), run=2085-2203msec