== sanity test 398b: DIO and buffer IO race ============== 09:25:08 (1789305908) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.54219 s, 14.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146008: Sun Sep 13 09:26:25 2026 read: IOPS=22, BW=91.1KiB/s (93.3kB/s)(5992KiB/65779msec) clat (usec): min=32, max=673199, avg=21277.62, stdev=22770.73 lat (usec): min=32, max=673201, avg=21279.20, stdev=22770.68 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 82], 10.00th=[ 6325], 20.00th=[ 10683], | 30.00th=[ 12780], 40.00th=[ 15008], 50.00th=[ 17695], 60.00th=[ 21103], | 70.00th=[ 25822], 80.00th=[ 31065], 90.00th=[ 38011], 95.00th=[ 45876], | 99.00th=[ 74974], 99.50th=[ 86508], 99.90th=[206570], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 15, max= 167, per=24.82%, avg=90.10, stdev=29.10, samples=130 iops : min= 3, max= 41, avg=21.97, stdev= 7.28, samples=130 write: IOPS=23, BW=95.7KiB/s (98.0kB/s)(6296KiB/65779msec); 0 zone resets clat (usec): min=754, max=202000, avg=21359.51, stdev=19984.99 lat (usec): min=754, max=202001, avg=21361.88, stdev=19985.07 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1418], 10.00th=[ 1958], 20.00th=[ 3228], | 30.00th=[ 5932], 40.00th=[ 12780], 50.00th=[ 17695], 60.00th=[ 22414], | 70.00th=[ 28181], 80.00th=[ 35914], 90.00th=[ 45876], 95.00th=[ 54264], | 99.00th=[ 80217], 99.50th=[108528], 99.90th=[173016], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 39, max= 174, per=24.94%, avg=95.02, stdev=28.40, samples=129 iops : min= 9, max= 43, avg=23.20, stdev= 7.14, samples=129 lat (usec) : 50=0.33%, 100=2.77%, 250=1.20%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.23% lat (msec) : 2=5.21%, 4=6.64%, 10=10.03%, 20=29.46%, 50=38.64% lat (msec) : 100=4.79%, 250=0.42%, 750=0.03% cpu : usr=0.13%, sys=11.99%, ctx=7370, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146010: Sun Sep 13 09:26:25 2026 read: IOPS=22, BW=90.0KiB/s (93.1kB/s)(5940KiB/65306msec) clat (usec): min=29, max=219426, avg=21247.87, stdev=15000.73 lat (usec): min=29, max=219426, avg=21249.73, stdev=15000.67 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 79], 10.00th=[ 6915], 20.00th=[ 10552], | 30.00th=[ 13304], 40.00th=[ 15795], 50.00th=[ 18482], 60.00th=[ 21890], | 70.00th=[ 26346], 80.00th=[ 31589], 90.00th=[ 39060], 95.00th=[ 45876], | 99.00th=[ 63177], 99.50th=[ 74974], 99.90th=[121111], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 159, per=24.91%, avg=90.43, stdev=28.79, samples=129 iops : min= 1, max= 39, avg=22.05, stdev= 7.24, samples=129 write: IOPS=24, BW=97.2KiB/s (99.5kB/s)(6348KiB/65306msec); 0 zone resets clat (usec): min=802, max=610724, avg=21080.98, stdev=24316.90 lat (usec): min=802, max=610726, avg=21084.29, stdev=24319.01 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1369], 10.00th=[ 1975], 20.00th=[ 3097], | 30.00th=[ 5538], 40.00th=[ 12125], 50.00th=[ 16712], 60.00th=[ 21627], | 70.00th=[ 26870], 80.00th=[ 34866], 90.00th=[ 47449], 95.00th=[ 56361], | 99.00th=[ 83362], 99.50th=[ 98042], 99.90th=[168821], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 168, per=25.29%, avg=96.37, stdev=29.48, samples=129 iops : min= 1, max= 42, avg=23.54, stdev= 7.38, samples=129 lat (usec) : 50=0.68%, 100=2.64%, 250=0.72%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=5.21%, 4=7.62%, 10=10.29%, 20=28.87%, 50=37.92% lat (msec) : 100=5.34%, 250=0.33%, 750=0.03% cpu : usr=0.10%, sys=12.00%, ctx=7376, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146012: Sun Sep 13 09:26:25 2026 read: IOPS=23, BW=92.3KiB/s (94.5kB/s)(6028KiB/65338msec) clat (usec): min=20, max=248618, avg=20402.59, stdev=15421.40 lat (usec): min=20, max=248619, avg=20404.71, stdev=15422.02 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 95], 10.00th=[ 6915], 20.00th=[ 10421], | 30.00th=[ 12649], 40.00th=[ 14877], 50.00th=[ 17433], 60.00th=[ 20579], | 70.00th=[ 24773], 80.00th=[ 30016], 90.00th=[ 36963], 95.00th=[ 44827], | 99.00th=[ 63701], 99.50th=[ 86508], 99.90th=[189793], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 23, max= 167, per=25.60%, avg=92.94, stdev=30.53, samples=127 iops : min= 5, max= 41, avg=22.69, stdev= 7.61, samples=127 write: IOPS=23, BW=95.8KiB/s (98.1kB/s)(6260KiB/65338msec); 0 zone resets clat (usec): min=715, max=677125, avg=21914.41, stdev=26309.37 lat (usec): min=715, max=677127, avg=21916.09, stdev=26309.15 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1516], 10.00th=[ 2040], 20.00th=[ 3556], | 30.00th=[ 6194], 40.00th=[ 12387], 50.00th=[ 16712], 60.00th=[ 21627], | 70.00th=[ 27919], 80.00th=[ 36439], 90.00th=[ 46924], 95.00th=[ 58983], | 99.00th=[ 88605], 99.50th=[114820], 99.90th=[189793], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 15, max= 174, per=25.08%, avg=95.55, stdev=29.38, samples=128 iops : min= 3, max= 43, avg=23.34, stdev= 7.37, samples=128 lat (usec) : 50=0.49%, 100=2.21%, 250=1.20%, 500=0.13%, 750=0.10% lat (usec) : 1000=0.23% lat (msec) : 2=4.49%, 4=6.77%, 10=11.95%, 20=30.44%, 50=36.26% lat (msec) : 100=5.24%, 250=0.46%, 750=0.03% cpu : usr=0.11%, sys=11.97%, ctx=7397, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146013: Sun Sep 13 09:26:25 2026 read: IOPS=22, BW=91.7KiB/s (93.9kB/s)(6052KiB/65971msec) clat (usec): min=37, max=215882, avg=20629.01, stdev=15535.64 lat (usec): min=38, max=215884, avg=20630.35, stdev=15535.70 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 72], 10.00th=[ 4948], 20.00th=[ 10159], | 30.00th=[ 12649], 40.00th=[ 15008], 50.00th=[ 17695], 60.00th=[ 21103], | 70.00th=[ 25560], 80.00th=[ 30278], 90.00th=[ 39060], 95.00th=[ 44303], | 99.00th=[ 70779], 99.50th=[ 81265], 99.90th=[158335], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 15, max= 199, per=25.42%, avg=92.29, stdev=32.32, samples=129 iops : min= 3, max= 49, avg=22.52, stdev= 8.08, samples=129 write: IOPS=23, BW=94.5KiB/s (96.8kB/s)(6236KiB/65971msec); 0 zone resets clat (usec): min=716, max=684259, avg=22109.87, stdev=26564.44 lat (usec): min=717, max=684262, avg=22114.68, stdev=26565.30 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1385], 10.00th=[ 1958], 20.00th=[ 3097], | 30.00th=[ 5800], 40.00th=[ 13042], 50.00th=[ 17957], 60.00th=[ 22414], | 70.00th=[ 28967], 80.00th=[ 35914], 90.00th=[ 48497], 95.00th=[ 57934], | 99.00th=[ 90702], 99.50th=[103285], 99.90th=[254804], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 15, max= 175, per=24.78%, avg=94.40, stdev=31.28, samples=130 iops : min= 3, max= 43, avg=23.05, stdev= 7.82, samples=130 lat (usec) : 50=0.59%, 100=3.16%, 250=0.94%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=4.98%, 4=7.23%, 10=10.71%, 20=27.96%, 50=37.96% lat (msec) : 100=5.70%, 250=0.36%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=11.96%, ctx=7283, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=364KiB/s (373kB/s), 90.0KiB/s-92.3KiB/s (93.1kB/s-94.5kB/s), io=23.4MiB (24.6MB), run=65306-65971msec WRITE: bw=381KiB/s (390kB/s), 94.5KiB/s-97.2KiB/s (96.8kB/s-99.5kB/s), io=24.6MiB (25.7MB), run=65306-65971msec fio: pid=146011, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146007: Sun Sep 13 09:27:20 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5992KiB/120462msec) clat (msec): min=3, max=689, avg=17.34, stdev=23.82 lat (msec): min=3, max=689, avg=17.34, stdev=23.82 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 48], | 99.00th=[ 83], 99.50th=[ 106], 99.90th=[ 215], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 144, per=28.87%, avg=50.23, stdev=31.30, samples=234 iops : min= 1, max= 36, avg=12.11, stdev= 7.87, samples=234 write: IOPS=13, BW=52.3KiB/s (53.5kB/s)(6296KiB/120462msec); 0 zone resets clat (msec): min=16, max=320, avg=59.86, stdev=31.51 lat (msec): min=16, max=320, avg=59.86, stdev=31.51 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 66], 80.00th=[ 81], 90.00th=[ 103], 95.00th=[ 118], | 99.00th=[ 178], 99.50th=[ 199], 99.90th=[ 288], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 15, max= 111, per=28.65%, avg=52.15, stdev=23.86, samples=237 iops : min= 3, max= 27, avg=12.58, stdev= 6.06, samples=237 lat (msec) : 4=0.13%, 10=21.65%, 20=15.46%, 50=34.70%, 100=22.07% lat (msec) : 250=5.86%, 500=0.10%, 750=0.03% cpu : usr=0.06%, sys=2.82%, ctx=5603, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146009: Sun Sep 13 09:27:20 2026 read: IOPS=12, BW=48.9KiB/s (50.1kB/s)(5940KiB/121381msec) clat (msec): min=3, max=638, avg=17.68, stdev=23.60 lat (msec): min=3, max=638, avg=17.68, stdev=23.60 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 38], 95.00th=[ 50], | 99.00th=[ 100], 99.50th=[ 112], 99.90th=[ 169], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 151, per=28.49%, avg=49.57, stdev=30.72, samples=236 iops : min= 1, max= 37, avg=11.94, stdev= 7.77, samples=236 write: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6348KiB/121381msec); 0 zone resets clat (msec): min=19, max=298, avg=59.77, stdev=31.32 lat (msec): min=19, max=298, avg=59.77, stdev=31.32 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 67], 80.00th=[ 80], 90.00th=[ 101], 95.00th=[ 122], | 99.00th=[ 157], 99.50th=[ 207], 99.90th=[ 284], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 112, per=28.55%, avg=51.96, stdev=24.08, samples=240 iops : min= 1, max= 28, avg=12.54, stdev= 6.09, samples=240 lat (msec) : 4=0.03%, 10=21.55%, 20=15.17%, 50=34.96%, 100=22.62% lat (msec) : 250=5.50%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=2.75%, ctx=5574, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146011: Sun Sep 13 09:27:20 2026 read: IOPS=9, BW=39.6KiB/s (40.5kB/s)(3196KiB/80759msec) clat (msec): min=4, max=290, avg=25.31, stdev=23.94 lat (msec): min=4, max=290, avg=25.31, stdev=23.94 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 52], 95.00th=[ 65], | 99.00th=[ 128], 99.50th=[ 148], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 119, per=22.69%, avg=39.47, stdev=24.72, samples=158 iops : min= 1, max= 29, avg= 9.37, stdev= 6.24, samples=158 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(3224KiB/80759msec); 0 zone resets clat (msec): min=21, max=670, avg=74.81, stdev=40.56 lat (msec): min=21, max=670, avg=74.82, stdev=40.55 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 31], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 52], 40.00th=[ 61], 50.00th=[ 70], 60.00th=[ 79], | 70.00th=[ 89], 80.00th=[ 100], 90.00th=[ 118], 95.00th=[ 140], | 99.00th=[ 184], 99.50th=[ 205], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 15, max= 103, per=21.64%, avg=39.38, stdev=20.08, samples=159 iops : min= 3, max= 25, avg= 9.35, stdev= 5.07, samples=159 lat (msec) : 10=12.08%, 20=15.01%, 50=31.94%, 100=30.26%, 250=10.46% lat (msec) : 500=0.12%, 750=0.06% cpu : usr=0.04%, sys=2.64%, ctx=2458, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=800,806,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146014: Sun Sep 13 09:27:20 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6052KiB/119657msec) clat (msec): min=3, max=212, avg=17.38, stdev=18.18 lat (msec): min=3, max=212, avg=17.38, stdev=18.18 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 36], 95.00th=[ 54], | 99.00th=[ 88], 99.50th=[ 114], 99.90th=[ 184], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 7, max= 160, per=29.47%, avg=51.27, stdev=32.26, samples=233 iops : min= 1, max= 40, avg=12.36, stdev= 8.12, samples=233 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6236KiB/119657msec); 0 zone resets clat (msec): min=20, max=674, avg=59.71, stdev=34.77 lat (msec): min=20, max=674, avg=59.72, stdev=34.77 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 37], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 51], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 82], 90.00th=[ 101], 95.00th=[ 122], | 99.00th=[ 167], 99.50th=[ 188], 99.90th=[ 317], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 15, max= 104, per=28.50%, avg=51.87, stdev=24.33, samples=237 iops : min= 3, max= 26, avg=12.51, stdev= 6.16, samples=237 lat (msec) : 4=0.16%, 10=21.84%, 20=15.33%, 50=34.80%, 100=22.43% lat (msec) : 250=5.34%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=2.84%, ctx=5639, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=174KiB/s (179kB/s), 39.6KiB/s-50.6KiB/s (40.5kB/s-51.8kB/s), io=20.7MiB (21.7MB), run=80759-121381msec WRITE: bw=182KiB/s (186kB/s), 39.9KiB/s-52.3KiB/s (40.9kB/s-53.6kB/s), io=21.6MiB (22.6MB), run=80759-121381msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146048: Sun Sep 13 09:27:39 2026 read: IOPS=27, BW=443KiB/s (454kB/s)(5920KiB/13362msec) clat (usec): min=40, max=181048, avg=19194.57, stdev=16417.92 lat (usec): min=40, max=181049, avg=19195.89, stdev=16418.02 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 72], 10.00th=[ 97], 20.00th=[ 9372], | 30.00th=[ 12387], 40.00th=[ 14484], 50.00th=[ 17433], 60.00th=[ 20841], | 70.00th=[ 23725], 80.00th=[ 29492], 90.00th=[ 34866], 95.00th=[ 40109], | 99.00th=[ 70779], 99.50th=[111674], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 95, max= 701, per=24.61%, avg=433.96, stdev=137.18, samples=26 iops : min= 5, max= 43, avg=26.58, stdev= 8.63, samples=26 write: IOPS=29, BW=477KiB/s (488kB/s)(6368KiB/13362msec); 0 zone resets clat (usec): min=1283, max=96366, avg=15470.47, stdev=14587.96 lat (usec): min=1285, max=96368, avg=15472.45, stdev=14587.96 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2073], 10.00th=[ 2868], 20.00th=[ 3884], | 30.00th=[ 5014], 40.00th=[ 6980], 50.00th=[10290], 60.00th=[15139], | 70.00th=[20317], 80.00th=[26084], 90.00th=[35390], 95.00th=[40109], | 99.00th=[66847], 99.50th=[93848], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 255, max= 800, per=25.36%, avg=470.38, stdev=122.14, samples=26 iops : min= 15, max= 50, avg=28.85, stdev= 7.81, samples=26 lat (usec) : 50=0.78%, 100=4.30%, 250=3.26%, 500=0.39% lat (msec) : 2=2.21%, 4=8.85%, 10=16.02%, 20=27.99%, 50=33.85% lat (msec) : 100=2.08%, 250=0.26% cpu : usr=0.15%, sys=18.15%, ctx=1863, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146049: Sun Sep 13 09:27:39 2026 read: IOPS=27, BW=434KiB/s (445kB/s)(5744KiB/13226msec) clat (usec): min=33, max=92477, avg=18402.42, stdev=12837.79 lat (usec): min=34, max=92477, avg=18403.43, stdev=12837.80 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 69], 10.00th=[ 102], 20.00th=[ 9503], | 30.00th=[12649], 40.00th=[14877], 50.00th=[17433], 60.00th=[20841], | 70.00th=[23725], 80.00th=[27395], 90.00th=[32900], 95.00th=[40109], | 99.00th=[61604], 99.50th=[71828], 99.90th=[92799], 99.95th=[92799], | 99.99th=[92799] bw ( KiB/s): min= 191, max= 768, per=24.60%, avg=433.69, stdev=147.63, samples=26 iops : min= 11, max= 48, avg=26.54, stdev= 9.32, samples=26 write: IOPS=30, BW=495KiB/s (507kB/s)(6544KiB/13226msec); 0 zone resets clat (usec): min=1443, max=132574, avg=15936.12, stdev=16398.82 lat (usec): min=1443, max=132576, avg=15938.27, stdev=16398.92 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1991], 10.00th=[ 2671], 20.00th=[ 3818], | 30.00th=[ 4948], 40.00th=[ 6390], 50.00th=[ 9241], 60.00th=[ 14615], | 70.00th=[ 19268], 80.00th=[ 27132], 90.00th=[ 36963], 95.00th=[ 45876], | 99.00th=[ 78119], 99.50th=[ 83362], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 249, max= 825, per=26.66%, avg=494.54, stdev=163.57, samples=26 iops : min= 15, max= 51, avg=30.35, stdev=10.30, samples=26 lat (usec) : 50=0.39%, 100=4.04%, 250=2.86%, 500=0.26%, 750=0.13% lat (msec) : 2=2.99%, 4=9.38%, 10=17.45%, 20=27.86%, 50=31.90% lat (msec) : 100=2.60%, 250=0.13% cpu : usr=0.09%, sys=18.34%, ctx=1855, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146050: Sun Sep 13 09:27:39 2026 read: IOPS=28, BW=461KiB/s (472kB/s)(6256KiB/13583msec) clat (usec): min=48, max=99747, avg=19058.74, stdev=15110.32 lat (usec): min=49, max=99749, avg=19059.74, stdev=15110.37 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 90], 20.00th=[ 1844], | 30.00th=[ 12256], 40.00th=[ 15139], 50.00th=[ 17695], 60.00th=[ 20317], | 70.00th=[ 24511], 80.00th=[ 29492], 90.00th=[ 36963], 95.00th=[ 42206], | 99.00th=[ 72877], 99.50th=[ 95945], 99.90th=[100140], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 185, max= 768, per=25.99%, avg=458.19, stdev=137.37, samples=26 iops : min= 11, max= 48, avg=28.08, stdev= 8.69, samples=26 write: IOPS=27, BW=444KiB/s (455kB/s)(6032KiB/13583msec); 0 zone resets clat (usec): min=1025, max=106195, avg=15984.75, stdev=16018.77 lat (usec): min=1026, max=106197, avg=15994.29, stdev=16014.18 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 2073], 10.00th=[ 2769], 20.00th=[ 3851], | 30.00th=[ 5145], 40.00th=[ 6915], 50.00th=[ 10421], 60.00th=[ 15008], | 70.00th=[ 19268], 80.00th=[ 27919], 90.00th=[ 37487], 95.00th=[ 45876], | 99.00th=[ 88605], 99.50th=[102237], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 223, max= 672, per=23.22%, avg=430.69, stdev=138.80, samples=26 iops : min= 13, max= 42, avg=26.35, stdev= 8.66, samples=26 lat (usec) : 50=0.13%, 100=5.86%, 250=3.52%, 500=0.39% lat (msec) : 2=2.60%, 4=8.20%, 10=15.76%, 20=28.52%, 50=31.77% lat (msec) : 100=2.99%, 250=0.26% cpu : usr=0.11%, sys=17.32%, ctx=1844, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146051: Sun Sep 13 09:27:39 2026 read: IOPS=28, BW=460KiB/s (471kB/s)(6032KiB/13112msec) clat (usec): min=36, max=109449, avg=17752.73, stdev=13229.37 lat (usec): min=36, max=109450, avg=17753.85, stdev=13229.34 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 67], 10.00th=[ 97], 20.00th=[ 8979], | 30.00th=[ 12125], 40.00th=[ 14615], 50.00th=[ 16909], 60.00th=[ 19530], | 70.00th=[ 23200], 80.00th=[ 26608], 90.00th=[ 33424], 95.00th=[ 39060], | 99.00th=[ 57934], 99.50th=[ 69731], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 62, max= 731, per=25.60%, avg=451.40, stdev=144.52, samples=25 iops : min= 3, max= 45, avg=27.64, stdev= 9.07, samples=25 write: IOPS=29, BW=477KiB/s (489kB/s)(6256KiB/13112msec); 0 zone resets clat (usec): min=1426, max=137222, avg=16350.22, stdev=17050.32 lat (usec): min=1428, max=137223, avg=16352.08, stdev=17050.41 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2376], 10.00th=[ 3032], 20.00th=[ 3949], | 30.00th=[ 5276], 40.00th=[ 7635], 50.00th=[ 11994], 60.00th=[ 14877], | 70.00th=[ 19792], 80.00th=[ 25035], 90.00th=[ 35390], 95.00th=[ 44303], | 99.00th=[104334], 99.50th=[127402], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 319, max= 702, per=25.40%, avg=471.08, stdev=122.37, samples=25 iops : min= 19, max= 43, avg=28.88, stdev= 7.64, samples=25 lat (usec) : 50=0.52%, 100=4.95%, 250=3.65%, 500=0.39%, 750=0.13% lat (msec) : 2=1.69%, 4=8.85%, 10=14.45%, 20=31.51%, 50=31.90% lat (msec) : 100=1.30%, 250=0.65% cpu : usr=0.09%, sys=17.95%, ctx=1835, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1763KiB/s (1806kB/s), 434KiB/s-461KiB/s (445kB/s-472kB/s), io=23.4MiB (24.5MB), run=13112-13583msec WRITE: bw=1855KiB/s (1900kB/s), 444KiB/s-495KiB/s (455kB/s-507kB/s), io=24.6MiB (25.8MB), run=13112-13583msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146052: Sun Sep 13 09:27:57 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(5920KiB/30623msec) clat (msec): min=5, max=109, avg=16.79, stdev=14.37 lat (msec): min=5, max=109, avg=16.79, stdev=14.37 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 34], 95.00th=[ 48], | 99.00th=[ 78], 99.50th=[ 99], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 63, max= 574, per=24.81%, avg=192.98, stdev=99.65, samples=59 iops : min= 3, max= 35, avg=11.54, stdev= 6.30, samples=59 write: IOPS=12, BW=208KiB/s (213kB/s)(6368KiB/30623msec); 0 zone resets clat (msec): min=25, max=246, avg=60.94, stdev=25.94 lat (msec): min=25, max=246, avg=60.94, stdev=25.94 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 52], 50.00th=[ 55], 60.00th=[ 61], | 70.00th=[ 67], 80.00th=[ 74], 90.00th=[ 90], 95.00th=[ 116], | 99.00th=[ 161], 99.50th=[ 169], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 64, max= 351, per=25.20%, avg=206.38, stdev=71.72, samples=60 iops : min= 4, max= 21, avg=12.38, stdev= 4.57, samples=60 lat (msec) : 10=18.10%, 20=19.79%, 50=27.73%, 100=30.60%, 250=3.78% cpu : usr=0.06%, sys=3.50%, ctx=1396, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146053: Sun Sep 13 09:27:57 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(5744KiB/30748msec) clat (msec): min=5, max=154, avg=17.90, stdev=17.30 lat (msec): min=5, max=154, avg=17.90, stdev=17.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 21], 90.00th=[ 40], 95.00th=[ 54], | 99.00th=[ 85], 99.50th=[ 101], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 26, max= 414, per=24.10%, avg=187.49, stdev=102.05, samples=61 iops : min= 1, max= 25, avg=11.20, stdev= 6.45, samples=61 write: IOPS=13, BW=213KiB/s (218kB/s)(6544KiB/30748msec); 0 zone resets clat (msec): min=24, max=208, avg=59.15, stdev=24.79 lat (msec): min=24, max=208, avg=59.15, stdev=24.79 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 32], 10.00th=[ 35], 20.00th=[ 40], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 53], 60.00th=[ 57], | 70.00th=[ 67], 80.00th=[ 77], 90.00th=[ 95], 95.00th=[ 110], | 99.00th=[ 140], 99.50th=[ 157], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 95, max= 383, per=25.94%, avg=212.43, stdev=77.36, samples=61 iops : min= 5, max= 23, avg=12.75, stdev= 4.92, samples=61 lat (msec) : 10=17.97%, 20=19.01%, 50=29.43%, 100=29.43%, 250=4.17% cpu : usr=0.07%, sys=3.38%, ctx=1515, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146054: Sun Sep 13 09:27:57 2026 read: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29841msec) clat (msec): min=4, max=114, avg=16.96, stdev=15.61 lat (msec): min=4, max=114, avg=16.96, stdev=15.61 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 16], 80.00th=[ 21], 90.00th=[ 32], 95.00th=[ 51], | 99.00th=[ 92], 99.50th=[ 105], 99.90th=[ 114], 99.95th=[ 114], | 99.99th=[ 114] bw ( KiB/s): min= 63, max= 512, per=27.58%, avg=214.60, stdev=116.90, samples=58 iops : min= 3, max= 32, avg=12.91, stdev= 7.38, samples=58 write: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29841msec); 0 zone resets clat (msec): min=20, max=273, avg=61.41, stdev=27.77 lat (msec): min=20, max=273, avg=61.41, stdev=27.77 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 38], 20.00th=[ 43], | 30.00th=[ 47], 40.00th=[ 51], 50.00th=[ 55], 60.00th=[ 61], | 70.00th=[ 67], 80.00th=[ 74], 90.00th=[ 92], 95.00th=[ 120], | 99.00th=[ 163], 99.50th=[ 203], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 63, max= 351, per=24.63%, avg=201.69, stdev=70.80, samples=59 iops : min= 3, max= 21, avg=12.10, stdev= 4.49, samples=59 lat (msec) : 10=18.62%, 20=21.61%, 50=27.73%, 100=28.65%, 250=3.26% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=3.67%, ctx=1495, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146055: Sun Sep 13 09:27:57 2026 read: IOPS=12, BW=198KiB/s (202kB/s)(6032KiB/30521msec) clat (usec): min=5337, max=97780, avg=16949.59, stdev=13763.55 lat (usec): min=5339, max=97782, avg=16950.59, stdev=13763.52 clat percentiles (usec): | 1.00th=[ 5735], 5.00th=[ 6587], 10.00th=[ 7242], 20.00th=[ 8291], | 30.00th=[ 9372], 40.00th=[10290], 50.00th=[11731], 60.00th=[13566], | 70.00th=[16712], 80.00th=[22938], 90.00th=[33817], 95.00th=[47973], | 99.00th=[74974], 99.50th=[81265], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 31, max= 448, per=25.16%, avg=195.73, stdev=104.16, samples=60 iops : min= 1, max= 28, avg=11.72, stdev= 6.60, samples=60 write: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30521msec); 0 zone resets clat (msec): min=24, max=266, avg=61.30, stdev=25.58 lat (msec): min=24, max=266, avg=61.31, stdev=25.58 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 52], 50.00th=[ 56], 60.00th=[ 61], | 70.00th=[ 67], 80.00th=[ 74], 90.00th=[ 91], 95.00th=[ 106], | 99.00th=[ 165], 99.50th=[ 192], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 64, max= 320, per=24.88%, avg=203.75, stdev=68.37, samples=60 iops : min= 4, max= 20, avg=12.22, stdev= 4.37, samples=60 lat (msec) : 10=18.23%, 20=19.14%, 50=28.78%, 100=30.47%, 250=3.26% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=3.56%, ctx=1464, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=779KiB/s (798kB/s), 187KiB/s-210KiB/s (191kB/s-215kB/s), io=23.4MiB (24.5MB), run=29841-30748msec WRITE: bw=820KiB/s (839kB/s), 202KiB/s-213KiB/s (207kB/s-218kB/s), io=24.6MiB (25.8MB), run=29841-30748msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146066: Sun Sep 13 09:28:06 2026 read: IOPS=2, BW=2807KiB/s (2874kB/s)(7168KiB/2554msec) clat (msec): min=88, max=338, avg=129.82, stdev=92.34 lat (msec): min=88, max=338, avg=129.82, stdev=92.34 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 94], 60.00th=[ 94], | 70.00th=[ 94], 80.00th=[ 116], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 4096, max= 5796, per=82.28%, avg=4946.00, stdev=1202.08, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=2005KiB/s (2053kB/s)(5120KiB/2554msec); 0 zone resets clat (msec): min=245, max=407, avg=315.25, stdev=66.42 lat (msec): min=245, max=407, avg=315.32, stdev=66.41 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 1932, max= 4096, per=31.99%, avg=2692.00, stdev=1217.28, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=41.67%, 250=16.67%, 500=41.67% cpu : usr=0.00%, sys=10.22%, ctx=117, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146067: Sun Sep 13 09:28:06 2026 read: IOPS=0, BW=601KiB/s (616kB/s)(2048KiB/3407msec) clat (msec): min=44, max=145, avg=94.86, stdev=71.26 lat (msec): min=44, max=145, avg=94.86, stdev=71.26 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 45], | 30.00th=[ 45], 40.00th=[ 45], 50.00th=[ 45], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 1906, max= 1932, per=31.92%, avg=1919.00, stdev=18.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3006KiB/s (3078kB/s)(10.0MiB/3407msec); 0 zone resets clat (msec): min=130, max=630, avg=320.58, stdev=175.36 lat (msec): min=130, max=630, avg=320.65, stdev=175.37 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 153], | 30.00th=[ 182], 40.00th=[ 211], 50.00th=[ 226], 60.00th=[ 253], | 70.00th=[ 460], 80.00th=[ 472], 90.00th=[ 493], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1932, max= 4007, per=31.48%, avg=2649.33, stdev=979.46, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.75, samples=6 lat (msec) : 50=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=11.74%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146068: Sun Sep 13 09:28:06 2026 read: IOPS=1, BW=1858KiB/s (1903kB/s)(6144KiB/3306msec) clat (msec): min=84, max=638, avg=225.67, stdev=205.21 lat (msec): min=84, max=638, avg=225.67, stdev=205.21 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 142], 50.00th=[ 142], 60.00th=[ 176], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2048, max= 4007, per=42.22%, avg=2537.75, stdev=979.50, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1858KiB/s (1903kB/s)(6144KiB/3306msec); 0 zone resets clat (msec): min=86, max=592, avg=317.92, stdev=200.24 lat (msec): min=86, max=592, avg=318.00, stdev=200.25 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 342], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2048, max= 3771, per=29.46%, avg=2478.75, stdev=861.50, samples=4 iops : min= 2, max= 3, avg= 2.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=10.32%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146069: Sun Sep 13 09:28:06 2026 read: IOPS=1, BW=1728KiB/s (1769kB/s)(5120KiB/2963msec) clat (msec): min=58, max=513, avg=224.57, stdev=189.11 lat (msec): min=58, max=513, avg=224.58, stdev=189.11 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 59], | 30.00th=[ 66], 40.00th=[ 66], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1932, max= 4096, per=44.54%, avg=2677.00, stdev=1229.40, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2419KiB/s (2477kB/s)(7168KiB/2963msec); 0 zone resets clat (msec): min=136, max=458, avg=254.22, stdev=137.33 lat (msec): min=136, max=458, avg=254.32, stdev=137.33 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 144], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 174], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 414], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2048, max= 3864, per=31.53%, avg=2653.33, stdev=1048.47, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=7.80%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6011KiB/s (6155kB/s), 601KiB/s-2807KiB/s (616kB/s-2874kB/s), io=20.0MiB (20.0MB), run=2554-3407msec WRITE: bw=8416KiB/s (8618kB/s), 1858KiB/s-3006KiB/s (1903kB/s-3078kB/s), io=28.0MiB (29.4MB), run=2554-3407msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146071: Sun Sep 13 09:28:06 2026 read: IOPS=2, BW=2831KiB/s (2899kB/s)(7168KiB/2532msec) clat (usec): min=426, max=225613, avg=133083.97, stdev=93795.10 lat (usec): min=427, max=225614, avg=133085.18, stdev=93795.28 clat percentiles (usec): | 1.00th=[ 429], 5.00th=[ 429], 10.00th=[ 429], 20.00th=[ 717], | 30.00th=[152044], 40.00th=[152044], 50.00th=[164627], 60.00th=[181404], | 70.00th=[181404], 80.00th=[206570], 90.00th=[225444], 95.00th=[225444], | 99.00th=[225444], 99.50th=[225444], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 1996, max= 3968, per=52.40%, avg=3194.00, stdev=1052.15, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=2022KiB/s (2071kB/s)(5120KiB/2532msec); 0 zone resets clat (msec): min=193, max=537, avg=307.10, stdev=138.94 lat (msec): min=193, max=538, avg=307.16, stdev=138.96 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1928, max= 1996, per=23.08%, avg=1969.33, stdev=36.30, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=58.33%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=33.47%, ctx=441, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146072: Sun Sep 13 09:28:06 2026 read: IOPS=0, BW=610KiB/s (624kB/s)(2048KiB/3360msec) clat (msec): min=156, max=181, avg=168.77, stdev=17.52 lat (msec): min=156, max=181, avg=168.77, stdev=17.52 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 182], 90.00th=[ 182], 95.00th=[ 182], | 99.00th=[ 182], 99.50th=[ 182], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 1845, max= 1928, per=30.95%, avg=1886.50, stdev=58.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=3048KiB/s (3121kB/s)(10.0MiB/3360msec); 0 zone resets clat (msec): min=135, max=518, avg=286.28, stdev=147.66 lat (msec): min=135, max=519, avg=286.68, stdev=147.59 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 140], | 30.00th=[ 148], 40.00th=[ 155], 50.00th=[ 247], 60.00th=[ 275], | 70.00th=[ 351], 80.00th=[ 401], 90.00th=[ 493], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1928, max= 4096, per=37.58%, avg=3206.40, stdev=1114.09, samples=5 iops : min= 1, max= 4, avg= 2.60, stdev= 1.14, samples=5 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.03%, sys=29.80%, ctx=255, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146073: Sun Sep 13 09:28:06 2026 read: IOPS=2, BW=2414KiB/s (2472kB/s)(6144KiB/2545msec) clat (usec): min=522, max=290525, avg=120295.33, stdev=111539.20 lat (usec): min=524, max=290525, avg=120296.42, stdev=111538.97 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[ 99091], 50.00th=[ 99091], 60.00th=[162530], | 70.00th=[168821], 80.00th=[168821], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1928, max= 5953, per=64.65%, avg=3940.50, stdev=2846.10, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2414KiB/s (2472kB/s)(6144KiB/2545msec); 0 zone resets clat (msec): min=190, max=375, avg=275.20, stdev=77.32 lat (msec): min=190, max=375, avg=275.43, stdev=77.28 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 284], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1910, max= 3992, per=30.81%, avg=2628.67, stdev=1181.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=33.33%, 500=41.67% cpu : usr=0.00%, sys=32.74%, ctx=341, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146074: Sun Sep 13 09:28:06 2026 read: IOPS=1, BW=1571KiB/s (1608kB/s)(5120KiB/3260msec) clat (usec): min=503, max=272804, avg=87984.91, stdev=125584.30 lat (usec): min=504, max=272804, avg=87985.67, stdev=125584.27 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 668], 60.00th=[ 668], | 70.00th=[164627], 80.00th=[164627], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 3856, max= 4096, per=65.23%, avg=3976.00, stdev=169.71, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2199KiB/s (2252kB/s)(7168KiB/3260msec); 0 zone resets clat (msec): min=113, max=644, avg=373.72, stdev=205.54 lat (msec): min=116, max=644, avg=374.20, stdev=204.93 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 174], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 372], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 550], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1984, max= 6144, per=40.96%, avg=3495.00, stdev=1972.95, samples=4 iops : min= 1, max= 6, avg= 2.75, stdev= 2.36, samples=4 lat (usec) : 750=25.00% lat (msec) : 250=33.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=21.97%, ctx=237, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6095KiB/s (6242kB/s), 610KiB/s-2831KiB/s (624kB/s-2899kB/s), io=20.0MiB (20.0MB), run=2532-3360msec WRITE: bw=8533KiB/s (8738kB/s), 2022KiB/s-3048KiB/s (2071kB/s-3121kB/s), io=28.0MiB (29.4MB), run=2532-3360msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146083: Sun Sep 13 09:28:14 2026 read: IOPS=1, BW=6896KiB/s (7061kB/s)(12.0MiB/1782msec) clat (msec): min=494, max=600, avg=555.73, stdev=54.85 lat (msec): min=494, max=600, avg=555.73, stdev=54.85 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 6059, max= 8192, per=82.38%, avg=7125.50, stdev=1508.26, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.06%, sys=37.79%, ctx=1065, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146085: Sun Sep 13 09:28:14 2026 read: IOPS=0, BW=2163KiB/s (2215kB/s)(4096KiB/1894msec) clat (nsec): min=501981k, max=501981k, avg=501980917.00, stdev= 0.00 lat (nsec): min=501982k, max=501982k, avg=501981774.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 6311, max= 6311, per=72.96%, avg=6311.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4325KiB/s (4429kB/s)(8192KiB/1894msec); 0 zone resets clat (msec): min=319, max=987, avg=653.46, stdev=471.99 lat (msec): min=319, max=987, avg=653.68, stdev=472.06 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8192, max= 8192, per=56.10%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=15.53%, ctx=221, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146086: Sun Sep 13 09:28:14 2026 write: IOPS=1, BW=5476KiB/s (5607kB/s)(12.0MiB/2244msec); 0 zone resets clat (msec): min=178, max=1160, avg=723.18, stdev=499.44 lat (msec): min=178, max=1160, avg=723.52, stdev=499.58 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8175, max= 8192, per=56.04%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.54%, ctx=62, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146087: Sun Sep 13 09:28:14 2026 write: IOPS=1, BW=5874KiB/s (6015kB/s)(12.0MiB/2092msec); 0 zone resets clat (msec): min=559, max=866, avg=669.22, stdev=171.29 lat (msec): min=559, max=866, avg=669.65, stdev=171.29 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8192, max= 8192, per=56.10%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.20%, ctx=74, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8650KiB/s (8858kB/s), 2163KiB/s-6896KiB/s (2215kB/s-7061kB/s), io=16.0MiB (16.8MB), run=1782-1894msec WRITE: bw=14.3MiB/s (14.0MB/s), 4325KiB/s-5874KiB/s (4429kB/s-6015kB/s), io=32.0MiB (33.6MB), run=1894-2244msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146080: Sun Sep 13 09:28:15 2026 read: IOPS=1, BW=6815KiB/s (6979kB/s)(12.0MiB/1803msec) clat (msec): min=293, max=821, avg=580.27, stdev=267.24 lat (msec): min=293, max=822, avg=580.28, stdev=267.24 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 6977, max= 8192, per=100.00%, avg=7584.50, stdev=859.13, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=11.88%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146081: Sun Sep 13 09:28:15 2026 read: IOPS=0, BW=1797KiB/s (1840kB/s)(4096KiB/2279msec) clat (nsec): min=551777k, max=551777k, avg=551777448.00, stdev= 0.00 lat (nsec): min=551778k, max=551778k, avg=551778295.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3595KiB/s (3681kB/s)(8192KiB/2279msec); 0 zone resets clat (msec): min=631, max=969, avg=800.82, stdev=239.17 lat (msec): min=632, max=970, avg=801.20, stdev=239.14 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 969], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8192, max= 8192, per=62.03%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.04%, sys=9.48%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146082: Sun Sep 13 09:28:15 2026 write: IOPS=1, BW=4953KiB/s (5072kB/s)(12.0MiB/2481msec); 0 zone resets clat (msec): min=105, max=1826, avg=787.42, stdev=914.27 lat (msec): min=105, max=1826, avg=787.81, stdev=914.41 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8175, max= 8175, per=61.90%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.04%, sys=7.14%, ctx=202, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146084: Sun Sep 13 09:28:15 2026 write: IOPS=1, BW=7301KiB/s (7476kB/s)(12.0MiB/1683msec); 0 zone resets clat (msec): min=258, max=946, avg=514.91, stdev=375.68 lat (msec): min=258, max=946, avg=515.18, stdev=375.58 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 6187, max= 8192, per=54.44%, avg=7189.50, stdev=1417.75, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=17.95%, ctx=94, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7189KiB/s (7362kB/s), 1797KiB/s-6815KiB/s (1840kB/s-6979kB/s), io=16.0MiB (16.8MB), run=1803-2279msec WRITE: bw=12.9MiB/s (13.5MB/s), 3595KiB/s-7301KiB/s (3681kB/s-7476kB/s), io=32.0MiB (33.6MB), run=1683-2481msec