== sanity test 398b: DIO and buffer IO race ============== 19:19:17 (1786835957) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.59067 s, 14.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178723: Sat Aug 15 19:20:59 2026 read: IOPS=16, BW=66.7KiB/s (68.3kB/s)(5992KiB/89860msec) clat (usec): min=40, max=665330, avg=32768.60, stdev=26325.16 lat (usec): min=41, max=665332, avg=32771.13, stdev=26326.74 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9372], 10.00th=[ 12911], 20.00th=[ 17433], | 30.00th=[ 20841], 40.00th=[ 23987], 50.00th=[ 28443], 60.00th=[ 32637], | 70.00th=[ 38011], 80.00th=[ 44827], 90.00th=[ 56886], 95.00th=[ 70779], | 99.00th=[106431], 99.50th=[115868], 99.90th=[250610], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 23, max= 128, per=24.98%, avg=66.45, stdev=21.62, samples=177 iops : min= 5, max= 32, avg=15.99, stdev= 5.46, samples=177 write: IOPS=17, BW=70.1KiB/s (71.7kB/s)(6296KiB/89860msec); 0 zone resets clat (usec): min=975, max=180108, avg=25634.95, stdev=24632.78 lat (usec): min=976, max=180112, avg=25639.41, stdev=24630.89 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1565], 10.00th=[ 2057], 20.00th=[ 3851], | 30.00th=[ 6915], 40.00th=[ 13173], 50.00th=[ 19268], 60.00th=[ 25560], | 70.00th=[ 32900], 80.00th=[ 43779], 90.00th=[ 59507], 95.00th=[ 76022], | 99.00th=[103285], 99.50th=[110625], 99.90th=[164627], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 23, max= 128, per=25.27%, avg=70.24, stdev=23.13, samples=176 iops : min= 5, max= 32, avg=16.95, stdev= 5.84, samples=176 lat (usec) : 50=0.23%, 100=1.11%, 250=0.36%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.85%, 4=5.66%, 10=8.24%, 20=19.14%, 50=45.21% lat (msec) : 100=13.70%, 250=1.27%, 750=0.03% cpu : usr=0.10%, sys=8.55%, ctx=7277, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178726: Sat Aug 15 19:20:59 2026 read: IOPS=16, BW=66.5KiB/s (68.0kB/s)(5940KiB/89386msec) clat (usec): min=38, max=948483, avg=33366.72, stdev=30941.20 lat (usec): min=39, max=948485, avg=33368.99, stdev=30941.47 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 9765], 10.00th=[ 13435], 20.00th=[ 17433], | 30.00th=[ 21365], 40.00th=[ 25035], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 39060], 80.00th=[ 45876], 90.00th=[ 56886], 95.00th=[ 67634], | 99.00th=[106431], 99.50th=[120062], 99.90th=[154141], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 15, max= 135, per=25.08%, avg=66.73, stdev=21.29, samples=175 iops : min= 3, max= 33, avg=16.06, stdev= 5.39, samples=175 write: IOPS=17, BW=71.0KiB/s (72.7kB/s)(6348KiB/89386msec); 0 zone resets clat (usec): min=793, max=249650, avg=24861.06, stdev=25090.35 lat (usec): min=794, max=249652, avg=24863.19, stdev=25090.42 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1582], 10.00th=[ 2147], 20.00th=[ 3654], | 30.00th=[ 6128], 40.00th=[ 11994], 50.00th=[ 18220], 60.00th=[ 24249], | 70.00th=[ 32900], 80.00th=[ 42730], 90.00th=[ 58459], 95.00th=[ 73925], | 99.00th=[104334], 99.50th=[116917], 99.90th=[202376], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 15, max= 160, per=25.57%, avg=71.07, stdev=26.84, samples=175 iops : min= 3, max= 40, avg=17.15, stdev= 6.77, samples=175 lat (usec) : 50=0.07%, 100=1.20%, 250=0.36%, 500=0.10%, 1000=0.10% lat (msec) : 2=4.39%, 4=7.03%, 10=8.66%, 20=18.72%, 50=44.34% lat (msec) : 100=13.90%, 250=1.11%, 1000=0.03% cpu : usr=0.11%, sys=8.57%, ctx=7285, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178728: Sat Aug 15 19:20:59 2026 read: IOPS=17, BW=69.2KiB/s (70.9kB/s)(6028KiB/87059msec) clat (usec): min=34, max=985689, avg=32489.76, stdev=31866.52 lat (usec): min=36, max=985690, avg=32491.96, stdev=31866.71 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 8848], 10.00th=[ 13042], 20.00th=[ 17171], | 30.00th=[ 20579], 40.00th=[ 24249], 50.00th=[ 27919], 60.00th=[ 32637], | 70.00th=[ 38536], 80.00th=[ 44303], 90.00th=[ 55837], 95.00th=[ 64750], | 99.00th=[101188], 99.50th=[128451], 99.90th=[250610], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 15, max= 136, per=25.99%, avg=69.14, stdev=21.04, samples=171 iops : min= 3, max= 34, avg=16.67, stdev= 5.32, samples=171 write: IOPS=17, BW=71.9KiB/s (73.6kB/s)(6260KiB/87059msec); 0 zone resets clat (usec): min=793, max=154775, avg=24157.20, stdev=24179.21 lat (usec): min=794, max=154777, avg=24159.56, stdev=24179.44 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1500], 10.00th=[ 2089], 20.00th=[ 3490], | 30.00th=[ 5735], 40.00th=[ 10683], 50.00th=[ 17171], 60.00th=[ 22938], | 70.00th=[ 31065], 80.00th=[ 41157], 90.00th=[ 58983], 95.00th=[ 73925], | 99.00th=[102237], 99.50th=[110625], 99.90th=[135267], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 7, max= 151, per=25.78%, avg=71.65, stdev=26.75, samples=171 iops : min= 1, max= 37, avg=17.30, stdev= 6.73, samples=171 lat (usec) : 50=0.29%, 100=1.24%, 250=0.36%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=4.43%, 4=6.93%, 10=8.95%, 20=19.34%, 50=43.46% lat (msec) : 100=13.51%, 250=1.04%, 500=0.03%, 1000=0.03% cpu : usr=0.12%, sys=8.79%, ctx=7183, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178729: Sat Aug 15 19:20:59 2026 read: IOPS=16, BW=67.1KiB/s (68.7kB/s)(6052KiB/90250msec) clat (usec): min=39, max=1009.0k, avg=33277.58, stdev=32424.57 lat (usec): min=39, max=1009.0k, avg=33279.08, stdev=32424.56 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 9110], 10.00th=[ 13304], | 20.00th=[ 17695], 30.00th=[ 21103], 40.00th=[ 25035], | 50.00th=[ 28967], 60.00th=[ 33817], 70.00th=[ 39060], | 80.00th=[ 45351], 90.00th=[ 56886], 95.00th=[ 68682], | 99.00th=[ 106431], 99.50th=[ 132645], 99.90th=[ 206570], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 128, per=25.17%, avg=66.96, stdev=19.99, samples=178 iops : min= 1, max= 32, avg=16.12, stdev= 5.06, samples=178 write: IOPS=17, BW=69.1KiB/s (70.8kB/s)(6236KiB/90250msec); 0 zone resets clat (usec): min=781, max=150129, avg=25401.37, stdev=24357.26 lat (usec): min=782, max=150131, avg=25404.73, stdev=24360.84 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1549], 10.00th=[ 2180], 20.00th=[ 3818], | 30.00th=[ 6915], 40.00th=[ 13435], 50.00th=[ 19268], 60.00th=[ 25035], | 70.00th=[ 32637], 80.00th=[ 42206], 90.00th=[ 60031], 95.00th=[ 73925], | 99.00th=[104334], 99.50th=[116917], 99.90th=[137364], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 7, max= 160, per=24.81%, avg=68.98, stdev=24.99, samples=178 iops : min= 1, max= 40, avg=16.63, stdev= 6.31, samples=178 lat (usec) : 50=0.16%, 100=1.43%, 250=0.39%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=4.04%, 4=6.32%, 10=8.20%, 20=18.39%, 50=45.96% lat (msec) : 100=13.57%, 250=1.20%, 2000=0.03% cpu : usr=0.08%, sys=8.67%, ctx=7361, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=266KiB/s (272kB/s), 66.5KiB/s-69.2KiB/s (68.0kB/s-70.9kB/s), io=23.4MiB (24.6MB), run=87059-90250msec WRITE: bw=279KiB/s (285kB/s), 69.1KiB/s-71.9KiB/s (70.8kB/s-73.6kB/s), io=24.6MiB (25.7MB), run=87059-90250msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178722: Sat Aug 15 19:21:24 2026 read: IOPS=12, BW=51.9KiB/s (53.1kB/s)(5992KiB/115507msec) clat (msec): min=5, max=717, avg=30.54, stdev=32.74 lat (msec): min=5, max=717, avg=30.54, stdev=32.74 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 90], | 99.00th=[ 132], 99.50th=[ 150], 99.90th=[ 253], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 176, per=25.23%, avg=52.22, stdev=34.82, samples=224 iops : min= 1, max= 44, avg=12.46, stdev= 8.76, samples=224 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6296KiB/115507msec); 0 zone resets clat (msec): min=7, max=298, avg=44.12, stdev=33.19 lat (msec): min=7, max=298, avg=44.12, stdev=33.19 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 66], 90.00th=[ 87], 95.00th=[ 105], | 99.00th=[ 167], 99.50th=[ 209], 99.90th=[ 292], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 160, per=25.00%, avg=54.25, stdev=34.73, samples=227 iops : min= 1, max= 40, avg=12.96, stdev= 8.73, samples=227 lat (msec) : 10=5.99%, 20=29.72%, 50=39.71%, 100=19.86%, 250=4.52% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=3.62%, ctx=5166, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178724: Sat Aug 15 19:21:24 2026 read: IOPS=12, BW=51.4KiB/s (52.7kB/s)(5940KiB/115505msec) clat (msec): min=5, max=954, avg=30.55, stdev=36.04 lat (msec): min=5, max=954, avg=30.55, stdev=36.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 88], | 99.00th=[ 140], 99.50th=[ 153], 99.90th=[ 194], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 182, per=24.87%, avg=51.48, stdev=35.51, samples=226 iops : min= 1, max= 45, avg=12.26, stdev= 8.91, samples=226 write: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6348KiB/115505msec); 0 zone resets clat (msec): min=7, max=269, avg=44.01, stdev=30.59 lat (msec): min=7, max=269, avg=44.01, stdev=30.59 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 65], 90.00th=[ 85], 95.00th=[ 106], | 99.00th=[ 146], 99.50th=[ 171], 99.90th=[ 241], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 15, max= 150, per=25.19%, avg=54.67, stdev=33.22, samples=227 iops : min= 3, max= 37, avg=13.06, stdev= 8.35, samples=227 lat (msec) : 10=5.92%, 20=27.51%, 50=42.02%, 100=19.73%, 250=4.75% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=3.66%, ctx=5225, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178725: Sat Aug 15 19:21:24 2026 read: IOPS=13, BW=52.2KiB/s (53.5kB/s)(6028KiB/115469msec) clat (msec): min=5, max=257, avg=30.08, stdev=27.37 lat (msec): min=5, max=257, avg=30.08, stdev=27.37 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 66], 95.00th=[ 88], | 99.00th=[ 136], 99.50th=[ 153], 99.90th=[ 201], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 7, max= 183, per=25.36%, avg=52.49, stdev=34.69, samples=225 iops : min= 1, max= 45, avg=12.52, stdev= 8.69, samples=225 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6260KiB/115469msec); 0 zone resets clat (msec): min=7, max=919, avg=44.59, stdev=39.39 lat (msec): min=7, max=919, avg=44.59, stdev=39.38 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 66], 90.00th=[ 88], 95.00th=[ 107], | 99.00th=[ 161], 99.50th=[ 207], 99.90th=[ 296], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 15, max= 150, per=24.99%, avg=54.23, stdev=34.12, samples=226 iops : min= 3, max= 37, avg=12.96, stdev= 8.58, samples=226 lat (msec) : 10=5.79%, 20=29.23%, 50=41.11%, 100=19.14%, 250=4.59% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=3.62%, ctx=5231, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178727: Sat Aug 15 19:21:24 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6052KiB/115220msec) clat (msec): min=5, max=203, avg=29.99, stdev=27.52 lat (msec): min=5, max=203, avg=30.00, stdev=27.52 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 66], 95.00th=[ 91], | 99.00th=[ 138], 99.50th=[ 155], 99.90th=[ 197], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 7, max= 168, per=25.51%, avg=52.81, stdev=33.96, samples=223 iops : min= 1, max= 42, avg=12.60, stdev= 8.55, samples=223 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6236KiB/115220msec); 0 zone resets clat (msec): min=9, max=977, avg=44.60, stdev=38.93 lat (msec): min=9, max=977, avg=44.60, stdev=38.93 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 53], 80.00th=[ 67], 90.00th=[ 87], 95.00th=[ 105], | 99.00th=[ 161], 99.50th=[ 188], 99.90th=[ 279], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 159, per=24.81%, avg=53.84, stdev=33.53, samples=226 iops : min= 1, max= 39, avg=12.86, stdev= 8.44, samples=226 lat (msec) : 10=5.89%, 20=28.42%, 50=41.67%, 100=18.91%, 250=5.05% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=3.74%, ctx=5239, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=208KiB/s (213kB/s), 51.4KiB/s-52.5KiB/s (52.7kB/s-53.8kB/s), io=23.4MiB (24.6MB), run=115220-115507msec WRITE: bw=218KiB/s (223kB/s), 54.1KiB/s-54.0KiB/s (55.4kB/s-56.3kB/s), io=24.6MiB (25.7MB), run=115220-115507msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178757: Sat Aug 15 19:21:53 2026 read: IOPS=16, BW=258KiB/s (265kB/s)(5920KiB/22918msec) clat (usec): min=39, max=226151, avg=32646.79, stdev=19946.08 lat (usec): min=41, max=226154, avg=32649.74, stdev=19945.09 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 82], 10.00th=[ 13829], 20.00th=[ 19268], | 30.00th=[ 23200], 40.00th=[ 26870], 50.00th=[ 30278], 60.00th=[ 34866], | 70.00th=[ 38536], 80.00th=[ 45351], 90.00th=[ 54789], 95.00th=[ 63177], | 99.00th=[ 86508], 99.50th=[ 98042], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 95, max= 415, per=25.37%, avg=257.49, stdev=71.16, samples=45 iops : min= 5, max= 25, avg=15.29, stdev= 4.45, samples=45 write: IOPS=17, BW=278KiB/s (285kB/s)(6368KiB/22918msec); 0 zone resets clat (usec): min=1395, max=153124, avg=26734.70, stdev=24776.54 lat (usec): min=1398, max=153127, avg=26747.77, stdev=24789.91 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2278], 10.00th=[ 3392], 20.00th=[ 5800], | 30.00th=[ 8717], 40.00th=[ 12780], 50.00th=[ 19006], 60.00th=[ 25822], | 70.00th=[ 33162], 80.00th=[ 46400], 90.00th=[ 61080], 95.00th=[ 74974], | 99.00th=[111674], 99.50th=[116917], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 127, max= 538, per=26.07%, avg=278.13, stdev=102.65, samples=45 iops : min= 7, max= 33, avg=16.58, stdev= 6.49, samples=45 lat (usec) : 50=0.26%, 100=2.34%, 250=0.78%, 500=0.13%, 750=0.26% lat (msec) : 2=1.30%, 4=5.34%, 10=10.81%, 20=15.36%, 50=47.53% lat (msec) : 100=14.84%, 250=1.04% cpu : usr=0.11%, sys=8.77%, ctx=1849, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178758: Sat Aug 15 19:21:53 2026 read: IOPS=15, BW=243KiB/s (249kB/s)(5744KiB/23598msec) clat (usec): min=40, max=139539, avg=34917.72, stdev=23372.55 lat (usec): min=41, max=139541, avg=34922.60, stdev=23370.31 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 265], 20.00th=[ 17957], | 30.00th=[ 22152], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 36439], | 70.00th=[ 42730], 80.00th=[ 51119], 90.00th=[ 64750], 95.00th=[ 78119], | 99.00th=[113771], 99.50th=[135267], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 95, max= 479, per=23.90%, avg=242.54, stdev=67.23, samples=46 iops : min= 5, max= 29, avg=14.33, stdev= 4.23, samples=46 write: IOPS=17, BW=277KiB/s (284kB/s)(6544KiB/23598msec); 0 zone resets clat (usec): min=1668, max=119177, avg=26620.63, stdev=24703.13 lat (usec): min=1671, max=119182, avg=26623.25, stdev=24703.26 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2376], 10.00th=[ 3163], 20.00th=[ 5211], | 30.00th=[ 8455], 40.00th=[ 13698], 50.00th=[ 19792], 60.00th=[ 25822], | 70.00th=[ 32637], 80.00th=[ 43779], 90.00th=[ 65799], 95.00th=[ 78119], | 99.00th=[106431], 99.50th=[108528], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 95, max= 447, per=25.93%, avg=276.67, stdev=95.26, samples=46 iops : min= 5, max= 27, avg=16.48, stdev= 5.97, samples=46 lat (usec) : 50=0.26%, 100=3.39%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=1.04%, 4=6.64%, 10=10.68%, 20=15.36%, 50=42.45% lat (msec) : 100=17.45%, 250=1.56% cpu : usr=0.09%, sys=8.81%, ctx=1870, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178759: Sat Aug 15 19:21:53 2026 read: IOPS=16, BW=267KiB/s (274kB/s)(6256KiB/23388msec) clat (usec): min=39, max=193857, avg=34818.84, stdev=21561.31 lat (usec): min=40, max=193859, avg=34820.31, stdev=21561.30 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 82], 10.00th=[ 13566], 20.00th=[ 19006], | 30.00th=[ 22938], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 49546], 90.00th=[ 60556], 95.00th=[ 71828], | 99.00th=[ 95945], 99.50th=[111674], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 116, max= 412, per=26.36%, avg=267.54, stdev=70.95, samples=46 iops : min= 7, max= 25, avg=15.91, stdev= 4.39, samples=46 write: IOPS=16, BW=258KiB/s (264kB/s)(6032KiB/23388msec); 0 zone resets clat (usec): min=1386, max=132324, avg=24995.76, stdev=22999.46 lat (usec): min=1387, max=132326, avg=25002.30, stdev=23003.59 clat percentiles (usec): | 1.00th=[ 1909], 5.00th=[ 2507], 10.00th=[ 3130], 20.00th=[ 4817], | 30.00th=[ 7635], 40.00th=[ 13173], 50.00th=[ 19268], 60.00th=[ 25297], | 70.00th=[ 32900], 80.00th=[ 40633], 90.00th=[ 55313], 95.00th=[ 69731], | 99.00th=[103285], 99.50th=[120062], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 63, max= 574, per=23.72%, avg=253.07, stdev=106.32, samples=46 iops : min= 3, max= 35, avg=15.00, stdev= 6.66, samples=46 lat (usec) : 50=0.26%, 100=2.73%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=6.77%, 10=10.55%, 20=15.36%, 50=45.70% lat (msec) : 100=16.28%, 250=0.78% cpu : usr=0.09%, sys=8.77%, ctx=1941, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178760: Sat Aug 15 19:21:53 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6032KiB/23136msec) clat (usec): min=31, max=187547, avg=33509.64, stdev=23609.40 lat (usec): min=31, max=187548, avg=33516.03, stdev=23610.16 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 186], 20.00th=[ 17695], | 30.00th=[ 21103], 40.00th=[ 25297], 50.00th=[ 29230], 60.00th=[ 35390], | 70.00th=[ 40633], 80.00th=[ 50594], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[122160], 99.50th=[143655], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 95, max= 478, per=25.48%, avg=258.62, stdev=83.76, samples=45 iops : min= 5, max= 29, avg=15.36, stdev= 5.20, samples=45 write: IOPS=16, BW=270KiB/s (277kB/s)(6256KiB/23136msec); 0 zone resets clat (usec): min=1283, max=129711, avg=26702.64, stdev=25505.97 lat (usec): min=1284, max=129713, avg=26705.10, stdev=25506.05 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2474], 10.00th=[ 3589], 20.00th=[ 5800], | 30.00th=[ 7832], 40.00th=[ 12387], 50.00th=[ 18744], 60.00th=[ 25035], | 70.00th=[ 34866], 80.00th=[ 43779], 90.00th=[ 63177], 95.00th=[ 80217], | 99.00th=[117965], 99.50th=[129500], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 63, max= 509, per=25.22%, avg=269.09, stdev=97.25, samples=45 iops : min= 3, max= 31, avg=16.00, stdev= 6.08, samples=45 lat (usec) : 50=0.26%, 100=3.91%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=1.04%, 4=5.21%, 10=12.24%, 20=15.49%, 50=42.32% lat (msec) : 100=16.54%, 250=1.82% cpu : usr=0.06%, sys=8.29%, ctx=1788, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1015KiB/s (1039kB/s), 243KiB/s-267KiB/s (249kB/s-274kB/s), io=23.4MiB (24.5MB), run=22918-23598msec WRITE: bw=1068KiB/s (1094kB/s), 258KiB/s-278KiB/s (264kB/s-285kB/s), io=24.6MiB (25.8MB), run=22918-23598msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178761: Sat Aug 15 19:22:02 2026 read: IOPS=11, BW=186KiB/s (191kB/s)(5920KiB/31749msec) clat (msec): min=7, max=157, avg=31.65, stdev=25.38 lat (msec): min=7, max=157, avg=31.65, stdev=25.37 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 41], 90.00th=[ 67], 95.00th=[ 93], | 99.00th=[ 124], 99.50th=[ 144], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 62, max= 477, per=24.52%, avg=182.42, stdev=104.76, samples=62 iops : min= 3, max= 29, avg=10.65, stdev= 6.58, samples=62 write: IOPS=12, BW=201KiB/s (205kB/s)(6368KiB/31749msec); 0 zone resets clat (msec): min=12, max=258, avg=49.86, stdev=34.98 lat (msec): min=12, max=259, avg=49.87, stdev=35.00 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 99], 95.00th=[ 125], | 99.00th=[ 190], 99.50th=[ 199], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 479, per=25.35%, avg=198.45, stdev=110.61, samples=62 iops : min= 1, max= 29, avg=11.65, stdev= 6.93, samples=62 lat (msec) : 10=2.60%, 20=20.96%, 50=51.69%, 100=18.23%, 250=6.38% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=3.27%, ctx=1277, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178762: Sat Aug 15 19:22:02 2026 read: IOPS=11, BW=178KiB/s (183kB/s)(5744KiB/32180msec) clat (msec): min=6, max=185, avg=33.80, stdev=30.57 lat (msec): min=6, max=185, avg=33.80, stdev=30.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 81], 95.00th=[ 96], | 99.00th=[ 161], 99.50th=[ 180], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 540, per=23.67%, avg=176.13, stdev=120.14, samples=63 iops : min= 1, max= 33, avg=10.25, stdev= 7.48, samples=63 write: IOPS=12, BW=203KiB/s (208kB/s)(6544KiB/32180msec); 0 zone resets clat (msec): min=11, max=242, avg=48.67, stdev=32.85 lat (msec): min=11, max=242, avg=48.67, stdev=32.85 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 71], 90.00th=[ 96], 95.00th=[ 113], | 99.00th=[ 157], 99.50th=[ 180], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 62, max= 478, per=25.39%, avg=198.84, stdev=115.49, samples=63 iops : min= 3, max= 29, avg=11.67, stdev= 7.26, samples=63 lat (msec) : 10=3.52%, 20=23.57%, 50=44.66%, 100=22.14%, 250=6.12% cpu : usr=0.08%, sys=3.13%, ctx=1304, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178763: Sat Aug 15 19:22:02 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31757msec) clat (msec): min=5, max=203, avg=33.67, stdev=30.08 lat (msec): min=5, max=203, avg=33.67, stdev=30.08 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 75], 95.00th=[ 101], | 99.00th=[ 150], 99.50th=[ 194], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 604, per=26.38%, avg=196.27, stdev=132.38, samples=62 iops : min= 1, max= 37, avg=11.52, stdev= 8.32, samples=62 write: IOPS=11, BW=190KiB/s (195kB/s)(6032KiB/31757msec); 0 zone resets clat (msec): min=13, max=247, avg=49.11, stdev=32.93 lat (msec): min=14, max=247, avg=49.11, stdev=32.92 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 45], | 70.00th=[ 57], 80.00th=[ 72], 90.00th=[ 94], 95.00th=[ 118], | 99.00th=[ 174], 99.50th=[ 180], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 32, max= 480, per=23.83%, avg=186.56, stdev=105.34, samples=62 iops : min= 2, max= 30, avg=10.90, stdev= 6.61, samples=62 lat (msec) : 10=3.91%, 20=20.57%, 50=49.74%, 100=19.27%, 250=6.51% cpu : usr=0.07%, sys=3.28%, ctx=1288, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178764: Sat Aug 15 19:22:02 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31346msec) clat (msec): min=5, max=200, avg=34.55, stdev=29.28 lat (msec): min=5, max=200, avg=34.55, stdev=29.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 96], | 99.00th=[ 148], 99.50th=[ 163], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 573, per=25.64%, avg=190.77, stdev=110.66, samples=62 iops : min= 1, max= 35, avg=11.18, stdev= 6.94, samples=62 write: IOPS=12, BW=200KiB/s (204kB/s)(6256KiB/31346msec); 0 zone resets clat (msec): min=11, max=265, avg=46.16, stdev=30.09 lat (msec): min=11, max=265, avg=46.16, stdev=30.09 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 69], 90.00th=[ 86], 95.00th=[ 103], | 99.00th=[ 142], 99.50th=[ 176], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 63, max= 636, per=25.54%, avg=199.97, stdev=115.90, samples=62 iops : min= 3, max= 39, avg=11.76, stdev= 7.25, samples=62 lat (msec) : 10=2.21%, 20=23.96%, 50=47.14%, 100=21.74%, 250=4.82% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=3.40%, ctx=1304, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=744KiB/s (762kB/s), 178KiB/s-197KiB/s (183kB/s-202kB/s), io=23.4MiB (24.5MB), run=31346-32180msec WRITE: bw=783KiB/s (802kB/s), 190KiB/s-203KiB/s (195kB/s-208kB/s), io=24.6MiB (25.8MB), run=31346-32180msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178781: Sat Aug 15 19:22:13 2026 read: IOPS=1, BW=1624KiB/s (1663kB/s)(7168KiB/4415msec) clat (usec): min=627, max=1945.1k, avg=403034.64, stdev=683997.94 lat (usec): min=629, max=1945.1k, avg=403101.03, stdev=683972.67 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], | 20.00th=[ 112722], 30.00th=[ 156238], 40.00th=[ 156238], | 50.00th=[ 175113], 60.00th=[ 208667], 70.00th=[ 208667], | 80.00th=[ 223347], 90.00th=[1937769], 95.00th=[1937769], | 99.00th=[1937769], 99.50th=[1937769], 99.90th=[1937769], | 99.95th=[1937769], 99.99th=[1937769] bw ( KiB/s): min= 1946, max= 4096, per=89.18%, avg=3376.33, stdev=1238.71, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1160KiB/s (1188kB/s)(5120KiB/4415msec); 0 zone resets clat (msec): min=84, max=555, avg=283.94, stdev=197.30 lat (msec): min=84, max=555, avg=284.04, stdev=197.29 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 85], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 2027, max= 6119, per=76.85%, avg=4073.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=18.15%, ctx=770, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178783: Sat Aug 15 19:22:13 2026 read: IOPS=0, BW=379KiB/s (388kB/s)(2048KiB/5409msec) clat (msec): min=213, max=2547, avg=1380.25, stdev=1650.69 lat (msec): min=213, max=2547, avg=1380.25, stdev=1650.69 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 2534], | 70.00th=[ 2534], 80.00th=[ 2534], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 2027, max= 2043, per=53.75%, avg=2035.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1893KiB/s (1939kB/s)(10.0MiB/5409msec); 0 zone resets clat (msec): min=115, max=664, avg=255.94, stdev=169.95 lat (msec): min=115, max=664, avg=256.16, stdev=169.84 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 131], | 30.00th=[ 132], 40.00th=[ 153], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 259], 80.00th=[ 271], 90.00th=[ 422], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2039, max= 4087, per=53.86%, avg=2854.40, stdev=1110.66, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=17.40%, ctx=622, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178784: Sat Aug 15 19:22:13 2026 read: IOPS=1, BW=1329KiB/s (1361kB/s)(6144KiB/4624msec) clat (usec): min=554, max=331705, avg=126822.21, stdev=129421.89 lat (usec): min=555, max=331706, avg=126823.31, stdev=129421.95 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 64750], 50.00th=[ 64750], 60.00th=[177210], | 70.00th=[185598], 80.00th=[185598], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2043, max= 4087, per=89.88%, avg=3403.00, stdev=1177.80, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1329KiB/s (1361kB/s)(6144KiB/4624msec); 0 zone resets clat (msec): min=119, max=2336, avg=588.43, stdev=859.10 lat (msec): min=119, max=2336, avg=588.49, stdev=859.11 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 292], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2027, max= 4096, per=57.78%, avg=3062.25, stdev=1188.49, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=14.02%, ctx=249, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178785: Sat Aug 15 19:22:13 2026 read: IOPS=0, BW=982KiB/s (1006kB/s)(5120KiB/5213msec) clat (usec): min=490, max=107659, avg=30922.44, stdev=47008.23 lat (usec): min=491, max=107660, avg=30923.33, stdev=47007.91 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 644], 40.00th=[ 644], 50.00th=[ 783], 60.00th=[ 783], | 70.00th=[ 44827], 80.00th=[ 44827], 90.00th=[107480], 95.00th=[107480], | 99.00th=[107480], 99.50th=[107480], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1375KiB/s (1408kB/s)(7168KiB/5213msec); 0 zone resets clat (msec): min=95, max=2377, avg=702.03, stdev=819.10 lat (msec): min=95, max=2377, avg=702.11, stdev=819.11 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 132], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 355], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 1083], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1914, max= 2048, per=38.00%, avg=2014.20, stdev=56.55, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=25.00%, 500=8.33%, 750=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=10.07%, ctx=101, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3786KiB/s (3877kB/s), 379KiB/s-1624KiB/s (388kB/s-1663kB/s), io=20.0MiB (20.0MB), run=4415-5409msec WRITE: bw=5301KiB/s (5428kB/s), 1160KiB/s-1893KiB/s (1188kB/s-1939kB/s), io=28.0MiB (29.4MB), run=4415-5409msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178778: Sat Aug 15 19:22:13 2026 read: IOPS=1, BW=1421KiB/s (1455kB/s)(7168KiB/5046msec) clat (msec): min=69, max=420, avg=173.75, stdev=133.88 lat (msec): min=69, max=420, avg=173.75, stdev=133.88 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 80], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 87], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 271], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 4096, max= 5287, per=100.00%, avg=4691.50, stdev=842.16, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=0, BW=1015KiB/s (1039kB/s)(5120KiB/5046msec); 0 zone resets clat (msec): min=150, max=2342, avg=743.47, stdev=920.60 lat (msec): min=150, max=2342, avg=743.90, stdev=920.85 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 2048, max= 4047, per=57.43%, avg=3047.50, stdev=1413.51, samples=2 iops : min= 2, max= 3, avg= 2.50, stdev= 0.71, samples=2 lat (msec) : 100=33.33%, 250=25.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.06%, sys=4.66%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178779: Sat Aug 15 19:22:13 2026 read: IOPS=0, BW=381KiB/s (390kB/s)(2048KiB/5374msec) clat (msec): min=61, max=228, avg=144.90, stdev=117.71 lat (msec): min=61, max=228, avg=144.90, stdev=117.71 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 62], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1793, max= 2015, per=50.24%, avg=1904.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1905KiB/s (1951kB/s)(10.0MiB/5374msec); 0 zone resets clat (msec): min=136, max=2043, avg=506.11, stdev=588.16 lat (msec): min=136, max=2043, avg=506.32, stdev=588.16 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 142], | 30.00th=[ 163], 40.00th=[ 207], 50.00th=[ 292], 60.00th=[ 296], | 70.00th=[ 330], 80.00th=[ 567], 90.00th=[ 885], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 2015, max= 3992, per=49.35%, avg=2618.67, stdev=915.68, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 0.89, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.88%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178780: Sat Aug 15 19:22:13 2026 read: IOPS=1, BW=1137KiB/s (1164kB/s)(6144KiB/5403msec) clat (msec): min=36, max=557, avg=295.76, stdev=218.72 lat (msec): min=36, max=557, avg=295.76, stdev=218.72 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 61], | 30.00th=[ 61], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 347], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1996, max= 2048, per=53.31%, avg=2020.50, stdev=21.55, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1137KiB/s (1164kB/s)(6144KiB/5403msec); 0 zone resets clat (msec): min=95, max=2426, avg=591.36, stdev=901.30 lat (msec): min=95, max=2426, avg=591.45, stdev=901.30 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 268], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1996, max= 3683, per=45.90%, avg=2435.50, stdev=831.94, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.53%, ctx=145, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178782: Sat Aug 15 19:22:13 2026 read: IOPS=0, BW=1020KiB/s (1044kB/s)(5120KiB/5022msec) clat (msec): min=64, max=374, avg=196.20, stdev=123.20 lat (msec): min=64, max=374, avg=196.20, stdev=123.20 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 4031, max= 4047, per=100.00%, avg=4039.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1427KiB/s (1462kB/s)(7168KiB/5022msec); 0 zone resets clat (msec): min=83, max=2356, avg=570.60, stdev=822.86 lat (msec): min=83, max=2356, avg=570.69, stdev=822.85 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 90], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 209], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 760], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1865, max= 4096, per=50.31%, avg=2669.67, stdev=1238.63, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.36%, ctx=121, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3790KiB/s (3881kB/s), 381KiB/s-1421KiB/s (390kB/s-1455kB/s), io=20.0MiB (20.0MB), run=5022-5403msec WRITE: bw=5307KiB/s (5434kB/s), 1015KiB/s-1905KiB/s (1039kB/s-1951kB/s), io=28.0MiB (29.4MB), run=5022-5403msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178791: Sat Aug 15 19:22:22 2026 read: IOPS=1, BW=6978KiB/s (7145kB/s)(12.0MiB/1761msec) clat (msec): min=507, max=590, avg=543.05, stdev=42.65 lat (msec): min=507, max=590, avg=543.05, stdev=42.65 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 5557, max= 7984, per=86.13%, avg=6770.50, stdev=1716.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=20.97%, ctx=403, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178792: Sat Aug 15 19:22:22 2026 read: IOPS=0, BW=1965KiB/s (2013kB/s)(4096KiB/2084msec) clat (nsec): min=555233k, max=555233k, avg=555233072.00, stdev= 0.00 lat (nsec): min=555235k, max=555235k, avg=555234861.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3931KiB/s (4025kB/s)(8192KiB/2084msec); 0 zone resets clat (msec): min=264, max=1065, avg=664.84, stdev=566.08 lat (msec): min=264, max=1065, avg=665.14, stdev=566.09 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 266], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8175, max= 8175, per=58.63%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.79%, ctx=222, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178793: Sat Aug 15 19:22:22 2026 write: IOPS=1, BW=5229KiB/s (5354kB/s)(12.0MiB/2350msec); 0 zone resets clat (msec): min=430, max=893, avg=708.69, stdev=245.61 lat (msec): min=430, max=894, avg=709.25, stdev=245.74 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8175, max= 8175, per=58.63%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.04%, sys=10.94%, ctx=69, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178795: Sat Aug 15 19:22:22 2026 write: IOPS=1, BW=5802KiB/s (5941kB/s)(12.0MiB/2118msec); 0 zone resets clat (msec): min=232, max=1383, avg=644.99, stdev=640.74 lat (msec): min=233, max=1383, avg=645.45, stdev=640.87 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8143, max= 8175, per=58.52%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.05%, sys=5.67%, ctx=122, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7862KiB/s (8050kB/s), 1965KiB/s-6978KiB/s (2013kB/s-7145kB/s), io=16.0MiB (16.8MB), run=1761-2084msec WRITE: bw=13.6MiB/s (14.3MB/s), 3931KiB/s-5802KiB/s (4025kB/s-5941kB/s), io=32.0MiB (33.6MB), run=2084-2350msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178796: Sat Aug 15 19:22:23 2026 read: IOPS=1, BW=5322KiB/s (5450kB/s)(12.0MiB/2309msec) clat (msec): min=272, max=1276, avg=756.03, stdev=502.85 lat (msec): min=272, max=1276, avg=756.03, stdev=502.85 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.38%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178797: Sat Aug 15 19:22:23 2026 read: IOPS=0, BW=1617KiB/s (1656kB/s)(4096KiB/2533msec) clat (nsec): min=1391.6M, max=1391.6M, avg=1391555783.00, stdev= 0.00 lat (nsec): min=1391.6M, max=1391.6M, avg=1391557252.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3234KiB/s (3312kB/s)(8192KiB/2533msec); 0 zone resets clat (msec): min=195, max=944, avg=569.73, stdev=529.68 lat (msec): min=195, max=944, avg=570.15, stdev=529.83 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8110, max= 8110, per=64.70%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.86%, ctx=36, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178798: Sat Aug 15 19:22:23 2026 write: IOPS=1, BW=4701KiB/s (4814kB/s)(12.0MiB/2614msec); 0 zone resets clat (msec): min=248, max=1273, avg=865.17, stdev=543.58 lat (msec): min=248, max=1275, avg=865.93, stdev=544.10 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8110, max= 8192, per=65.03%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.24%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178799: Sat Aug 15 19:22:23 2026 write: IOPS=1, BW=5071KiB/s (5193kB/s)(12.0MiB/2423msec); 0 zone resets clat (msec): min=277, max=1803, avg=803.65, stdev=866.15 lat (msec): min=278, max=1803, avg=804.03, stdev=866.09 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 6884, max= 6884, per=54.92%, avg=6884.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.17%, ctx=59, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6468KiB/s (6623kB/s), 1617KiB/s-5322KiB/s (1656kB/s-5450kB/s), io=16.0MiB (16.8MB), run=2309-2533msec WRITE: bw=12.2MiB/s (12.8MB/s), 3234KiB/s-5071KiB/s (3312kB/s-5193kB/s), io=32.0MiB (33.6MB), run=2423-2614msec