== sanity test 398b: DIO and buffer IO race ============== 10:48:36 (1788878916) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.2817 s, 15.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146453: Tue Sep 8 10:49:51 2026 read: IOPS=23, BW=93.5KiB/s (95.7kB/s)(5992KiB/64119msec) clat (usec): min=32, max=511088, avg=21079.19, stdev=19488.00 lat (usec): min=32, max=511089, avg=21080.39, stdev=19488.03 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 93], 10.00th=[ 7177], 20.00th=[ 10814], | 30.00th=[ 12911], 40.00th=[ 15139], 50.00th=[ 17695], 60.00th=[ 21103], | 70.00th=[ 25560], 80.00th=[ 30540], 90.00th=[ 37487], 95.00th=[ 46400], | 99.00th=[ 69731], 99.50th=[ 86508], 99.90th=[166724], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 232, per=24.80%, avg=92.76, stdev=31.73, samples=127 iops : min= 1, max= 58, avg=22.69, stdev= 7.99, samples=127 write: IOPS=24, BW=98.2KiB/s (101kB/s)(6296KiB/64119msec); 0 zone resets clat (usec): min=676, max=287214, avg=20493.50, stdev=21060.19 lat (usec): min=677, max=287215, avg=20496.36, stdev=21059.96 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1467], 10.00th=[ 2073], 20.00th=[ 3294], | 30.00th=[ 5604], 40.00th=[ 10683], 50.00th=[ 15664], 60.00th=[ 20841], | 70.00th=[ 26608], 80.00th=[ 34341], 90.00th=[ 45351], 95.00th=[ 54789], | 99.00th=[ 89654], 99.50th=[111674], 99.90th=[219153], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 23, max= 240, per=25.05%, avg=98.18, stdev=31.45, samples=126 iops : min= 5, max= 60, avg=24.05, stdev= 7.90, samples=126 lat (usec) : 50=0.39%, 100=2.34%, 250=1.33%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=4.79%, 4=7.45%, 10=11.33%, 20=29.92%, 50=36.82% lat (msec) : 100=4.82%, 250=0.42%, 500=0.03%, 750=0.03% cpu : usr=0.15%, sys=14.13%, ctx=7496, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146455: Tue Sep 8 10:49:51 2026 read: IOPS=23, BW=95.3KiB/s (97.6kB/s)(5940KiB/62305msec) clat (usec): min=30, max=209779, avg=19959.00, stdev=14440.98 lat (usec): min=30, max=209781, avg=19961.77, stdev=14443.49 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 106], 10.00th=[ 7111], 20.00th=[ 10683], | 30.00th=[ 12780], 40.00th=[ 14746], 50.00th=[ 16909], 60.00th=[ 19792], | 70.00th=[ 23725], 80.00th=[ 29492], 90.00th=[ 35914], 95.00th=[ 43779], | 99.00th=[ 69731], 99.50th=[ 88605], 99.90th=[112722], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 175, per=25.40%, avg=95.00, stdev=31.17, samples=123 iops : min= 1, max= 43, avg=23.24, stdev= 7.81, samples=123 write: IOPS=25, BW=102KiB/s (104kB/s)(6348KiB/62305msec); 0 zone resets clat (usec): min=871, max=509294, avg=20402.99, stdev=22250.69 lat (usec): min=872, max=509295, avg=20404.41, stdev=22250.67 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1598], 10.00th=[ 2057], 20.00th=[ 3294], | 30.00th=[ 5473], 40.00th=[ 10683], 50.00th=[ 15795], 60.00th=[ 20841], | 70.00th=[ 26346], 80.00th=[ 33424], 90.00th=[ 44827], 95.00th=[ 56361], | 99.00th=[ 80217], 99.50th=[ 89654], 99.90th=[147850], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 39, max= 183, per=26.02%, avg=102.02, stdev=28.45, samples=122 iops : min= 9, max= 45, avg=25.00, stdev= 7.13, samples=122 lat (usec) : 50=0.23%, 100=2.15%, 250=1.43%, 500=0.26%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=4.72%, 4=7.65%, 10=11.56%, 20=31.28%, 50=35.45% lat (msec) : 100=4.79%, 250=0.23%, 750=0.03% cpu : usr=0.15%, sys=14.35%, ctx=7453, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146458: Tue Sep 8 10:49:51 2026 read: IOPS=23, BW=95.5KiB/s (97.8kB/s)(6028KiB/63126msec) clat (usec): min=34, max=518284, avg=20187.73, stdev=18825.35 lat (usec): min=35, max=518285, avg=20188.96, stdev=18825.36 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 105], 10.00th=[ 7635], 20.00th=[ 10683], | 30.00th=[ 12649], 40.00th=[ 14746], 50.00th=[ 16909], 60.00th=[ 20055], | 70.00th=[ 23200], 80.00th=[ 28443], 90.00th=[ 35914], 95.00th=[ 42730], | 99.00th=[ 66847], 99.50th=[ 89654], 99.90th=[139461], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 167, per=25.40%, avg=95.00, stdev=32.02, samples=125 iops : min= 1, max= 41, avg=23.25, stdev= 8.01, samples=125 write: IOPS=24, BW=99.2KiB/s (102kB/s)(6260KiB/63126msec); 0 zone resets clat (usec): min=582, max=299030, avg=20730.21, stdev=20510.44 lat (usec): min=582, max=299032, avg=20731.95, stdev=20510.60 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1450], 10.00th=[ 2073], 20.00th=[ 3195], | 30.00th=[ 5800], 40.00th=[ 11338], 50.00th=[ 16319], 60.00th=[ 21103], | 70.00th=[ 26608], 80.00th=[ 34866], 90.00th=[ 45351], 95.00th=[ 55837], | 99.00th=[ 79168], 99.50th=[102237], 99.90th=[154141], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 21, max= 192, per=25.15%, avg=98.58, stdev=31.04, samples=125 iops : min= 5, max= 48, avg=24.14, stdev= 7.78, samples=125 lat (usec) : 50=0.36%, 100=1.92%, 250=1.40%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.95%, 4=7.42%, 10=11.62%, 20=30.79%, 50=35.97% lat (msec) : 100=4.95%, 250=0.36%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=14.12%, ctx=7590, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146459: Tue Sep 8 10:49:51 2026 read: IOPS=23, BW=94.9KiB/s (97.2kB/s)(6052KiB/63766msec) clat (usec): min=33, max=197926, avg=20410.16, stdev=15192.58 lat (usec): min=33, max=197927, avg=20411.38, stdev=15192.55 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 99], 10.00th=[ 7767], 20.00th=[ 10683], | 30.00th=[ 12911], 40.00th=[ 14877], 50.00th=[ 17171], 60.00th=[ 20317], | 70.00th=[ 24511], 80.00th=[ 30016], 90.00th=[ 36963], 95.00th=[ 44303], | 99.00th=[ 61080], 99.50th=[ 91751], 99.90th=[183501], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 32, max= 176, per=25.54%, avg=95.52, stdev=27.29, samples=124 iops : min= 8, max= 44, avg=23.37, stdev= 6.86, samples=124 write: IOPS=24, BW=97.8KiB/s (100kB/s)(6236KiB/63766msec); 0 zone resets clat (usec): min=790, max=682358, avg=20908.14, stdev=26643.45 lat (usec): min=790, max=682360, avg=20918.68, stdev=26642.57 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1582], 10.00th=[ 2180], 20.00th=[ 3195], | 30.00th=[ 5342], 40.00th=[ 11076], 50.00th=[ 16188], 60.00th=[ 21103], | 70.00th=[ 26870], 80.00th=[ 33817], 90.00th=[ 44827], 95.00th=[ 55313], | 99.00th=[ 82314], 99.50th=[105382], 99.90th=[263193], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 16, max= 176, per=24.96%, avg=97.83, stdev=31.84, samples=125 iops : min= 4, max= 44, avg=23.95, stdev= 7.96, samples=125 lat (usec) : 50=0.33%, 100=2.18%, 250=1.30%, 500=0.16%, 1000=0.16% lat (msec) : 2=4.20%, 4=8.37%, 10=11.23%, 20=30.31%, 50=36.85% lat (msec) : 100=4.46%, 250=0.39%, 500=0.03%, 750=0.03% cpu : usr=0.13%, sys=14.11%, ctx=7469, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=374KiB/s (383kB/s), 93.5KiB/s-95.5KiB/s (95.7kB/s-97.8kB/s), io=23.4MiB (24.6MB), run=62305-64119msec WRITE: bw=392KiB/s (401kB/s), 97.8KiB/s-102KiB/s (100kB/s-104kB/s), io=24.6MiB (25.7MB), run=62305-64119msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146452: Tue Sep 8 10:50:44 2026 read: IOPS=12, BW=50.8KiB/s (52.1kB/s)(5992KiB/117836msec) clat (msec): min=4, max=517, avg=17.57, stdev=20.08 lat (msec): min=4, max=517, avg=17.57, stdev=20.08 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 51], | 99.00th=[ 77], 99.50th=[ 96], 99.90th=[ 140], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 152, per=25.65%, avg=52.07, stdev=32.16, samples=227 iops : min= 1, max= 38, avg=12.59, stdev= 8.12, samples=227 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6296KiB/117836msec); 0 zone resets clat (msec): min=19, max=306, avg=57.97, stdev=30.84 lat (msec): min=19, max=306, avg=57.97, stdev=30.84 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 43], 50.00th=[ 48], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 82], 90.00th=[ 101], 95.00th=[ 121], | 99.00th=[ 155], 99.50th=[ 171], 99.90th=[ 262], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 104, per=25.01%, avg=53.26, stdev=25.14, samples=233 iops : min= 1, max= 26, avg=12.88, stdev= 6.39, samples=233 lat (msec) : 10=20.15%, 20=16.96%, 50=37.21%, 100=20.28%, 250=5.27% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=3.24%, ctx=5513, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146454: Tue Sep 8 10:50:44 2026 read: IOPS=12, BW=50.4KiB/s (51.6kB/s)(5940KiB/117839msec) clat (msec): min=3, max=634, avg=17.70, stdev=23.07 lat (msec): min=3, max=634, avg=17.70, stdev=23.07 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 48], | 99.00th=[ 78], 99.50th=[ 103], 99.90th=[ 218], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 135, per=25.22%, avg=51.19, stdev=31.14, samples=229 iops : min= 1, max= 33, avg=12.37, stdev= 7.86, samples=229 write: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6348KiB/117839msec); 0 zone resets clat (msec): min=18, max=304, avg=57.51, stdev=30.16 lat (msec): min=18, max=304, avg=57.52, stdev=30.16 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 48], 60.00th=[ 55], | 70.00th=[ 65], 80.00th=[ 81], 90.00th=[ 100], 95.00th=[ 117], | 99.00th=[ 155], 99.50th=[ 176], 99.90th=[ 232], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 112, per=25.18%, avg=53.64, stdev=25.41, samples=233 iops : min= 1, max= 28, avg=12.98, stdev= 6.45, samples=233 lat (msec) : 4=0.07%, 10=20.28%, 20=16.37%, 50=37.63%, 100=20.31% lat (msec) : 250=5.27%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.27%, ctx=5557, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146456: Tue Sep 8 10:50:44 2026 read: IOPS=12, BW=51.2KiB/s (52.5kB/s)(6028KiB/117685msec) clat (msec): min=3, max=238, avg=18.17, stdev=18.89 lat (msec): min=3, max=238, avg=18.18, stdev=18.89 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 38], 95.00th=[ 49], | 99.00th=[ 92], 99.50th=[ 133], 99.90th=[ 215], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 159, per=25.39%, avg=51.54, stdev=30.73, samples=231 iops : min= 1, max= 39, avg=12.45, stdev= 7.75, samples=231 write: IOPS=13, BW=53.2KiB/s (54.5kB/s)(6260KiB/117685msec); 0 zone resets clat (msec): min=19, max=673, avg=57.51, stdev=34.12 lat (msec): min=19, max=673, avg=57.52, stdev=34.12 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 47], 60.00th=[ 54], | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 101], 95.00th=[ 117], | 99.00th=[ 157], 99.50th=[ 186], 99.90th=[ 305], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8, max= 120, per=24.89%, avg=53.02, stdev=25.99, samples=233 iops : min= 2, max= 30, avg=12.82, stdev= 6.59, samples=233 lat (msec) : 4=0.03%, 10=19.60%, 20=16.89%, 50=38.22%, 100=19.60% lat (msec) : 250=5.60%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=3.39%, ctx=5649, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146457: Tue Sep 8 10:50:44 2026 read: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6052KiB/116997msec) clat (msec): min=3, max=238, avg=17.23, stdev=16.90 lat (msec): min=3, max=238, avg=17.23, stdev=16.90 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 37], 95.00th=[ 46], | 99.00th=[ 78], 99.50th=[ 110], 99.90th=[ 192], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 152, per=25.75%, avg=52.28, stdev=33.17, samples=229 iops : min= 1, max= 38, avg=12.64, stdev= 8.39, samples=229 write: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6236KiB/116997msec); 0 zone resets clat (msec): min=18, max=672, avg=58.15, stdev=34.48 lat (msec): min=18, max=672, avg=58.15, stdev=34.48 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 56], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 100], 95.00th=[ 114], | 99.00th=[ 159], 99.50th=[ 184], 99.90th=[ 342], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 15, max= 112, per=24.95%, avg=53.15, stdev=24.92, samples=232 iops : min= 3, max= 28, avg=12.86, stdev= 6.32, samples=232 lat (msec) : 4=0.03%, 10=21.22%, 20=15.40%, 50=37.70%, 100=20.61% lat (msec) : 250=4.88%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=3.30%, ctx=5537, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (209kB/s), 50.4KiB/s-51.7KiB/s (51.6kB/s-52.0kB/s), io=23.4MiB (24.6MB), run=116997-117839msec WRITE: bw=213KiB/s (218kB/s), 53.2KiB/s-53.9KiB/s (54.5kB/s-55.2kB/s), io=24.6MiB (25.7MB), run=116997-117839msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146492: Tue Sep 8 10:51:03 2026 read: IOPS=28, BW=451KiB/s (462kB/s)(5920KiB/13135msec) clat (usec): min=36, max=118733, avg=17117.87, stdev=14724.56 lat (usec): min=36, max=118734, avg=17118.79, stdev=14724.54 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 68], 10.00th=[ 89], 20.00th=[ 145], | 30.00th=[ 10552], 40.00th=[ 13173], 50.00th=[ 16057], 60.00th=[ 18482], | 70.00th=[ 23200], 80.00th=[ 27395], 90.00th=[ 33424], 95.00th=[ 38536], | 99.00th=[ 76022], 99.50th=[ 88605], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 254, max= 768, per=25.56%, avg=452.35, stdev=141.21, samples=26 iops : min= 15, max= 48, avg=27.65, stdev= 9.07, samples=26 write: IOPS=30, BW=485KiB/s (496kB/s)(6368KiB/13135msec); 0 zone resets clat (usec): min=1401, max=72306, avg=16795.97, stdev=14349.25 lat (usec): min=1401, max=72307, avg=16800.07, stdev=14348.48 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2376], 10.00th=[ 3195], 20.00th=[ 4424], | 30.00th=[ 5866], 40.00th=[ 8160], 50.00th=[11863], 60.00th=[16319], | 70.00th=[22414], 80.00th=[28967], 90.00th=[38536], 95.00th=[44827], | 99.00th=[63177], 99.50th=[71828], 99.90th=[71828], 99.95th=[71828], | 99.99th=[71828] bw ( KiB/s): min= 224, max= 830, per=26.09%, avg=485.77, stdev=152.20, samples=26 iops : min= 14, max= 51, avg=29.77, stdev= 9.48, samples=26 lat (usec) : 50=0.65%, 100=5.08%, 250=5.21%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.30%, 4=7.94%, 10=15.89%, 20=28.26%, 50=32.42% lat (msec) : 100=2.47%, 250=0.13% cpu : usr=0.16%, sys=18.78%, ctx=1935, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146493: Tue Sep 8 10:51:03 2026 read: IOPS=26, BW=425KiB/s (435kB/s)(5744KiB/13530msec) clat (usec): min=45, max=122149, avg=17434.87, stdev=13944.20 lat (usec): min=45, max=122150, avg=17435.75, stdev=13944.22 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 68], 10.00th=[ 85], 20.00th=[ 133], | 30.00th=[ 11076], 40.00th=[ 13960], 50.00th=[ 16581], 60.00th=[ 20317], | 70.00th=[ 24249], 80.00th=[ 28443], 90.00th=[ 33817], 95.00th=[ 37487], | 99.00th=[ 48497], 99.50th=[ 69731], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 55, max= 638, per=23.80%, avg=421.35, stdev=152.07, samples=26 iops : min= 3, max= 39, avg=25.73, stdev= 9.43, samples=26 write: IOPS=30, BW=484KiB/s (495kB/s)(6544KiB/13530msec); 0 zone resets clat (usec): min=827, max=110419, avg=17505.96, stdev=17332.70 lat (usec): min=828, max=110422, avg=17508.53, stdev=17332.60 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2245], 10.00th=[ 2769], 20.00th=[ 3720], | 30.00th=[ 5211], 40.00th=[ 7177], 50.00th=[ 11994], 60.00th=[ 16319], | 70.00th=[ 22676], 80.00th=[ 28181], 90.00th=[ 40109], 95.00th=[ 50070], | 99.00th=[ 83362], 99.50th=[ 83362], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 195, max= 667, per=25.22%, avg=469.62, stdev=119.32, samples=26 iops : min= 12, max= 41, avg=28.77, stdev= 7.28, samples=26 lat (usec) : 50=0.52%, 100=5.99%, 250=4.04%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.34%, 4=9.24%, 10=13.80%, 20=26.56%, 50=33.85% lat (msec) : 100=2.73%, 250=0.26% cpu : usr=0.12%, sys=18.31%, ctx=1866, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146495: Tue Sep 8 10:51:03 2026 read: IOPS=29, BW=477KiB/s (488kB/s)(6256KiB/13118msec) clat (usec): min=37, max=85324, avg=16409.30, stdev=13612.82 lat (usec): min=38, max=85325, avg=16410.36, stdev=13612.81 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 91], 20.00th=[ 135], | 30.00th=[10683], 40.00th=[13173], 50.00th=[15270], 60.00th=[17957], | 70.00th=[20841], 80.00th=[26346], 90.00th=[32637], 95.00th=[41157], | 99.00th=[60031], 99.50th=[69731], 99.90th=[85459], 99.95th=[85459], | 99.99th=[85459] bw ( KiB/s): min= 287, max= 860, per=27.35%, avg=484.16, stdev=148.23, samples=25 iops : min= 17, max= 53, avg=29.64, stdev= 9.26, samples=25 write: IOPS=28, BW=460KiB/s (471kB/s)(6032KiB/13118msec); 0 zone resets clat (usec): min=1230, max=124116, avg=17459.03, stdev=16464.93 lat (usec): min=1232, max=124117, avg=17460.80, stdev=16465.01 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2311], 10.00th=[ 2900], 20.00th=[ 4047], | 30.00th=[ 5669], 40.00th=[ 8225], 50.00th=[ 12911], 60.00th=[ 16909], | 70.00th=[ 21627], 80.00th=[ 27919], 90.00th=[ 41157], 95.00th=[ 51119], | 99.00th=[ 73925], 99.50th=[ 78119], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 255, max= 608, per=24.63%, avg=458.56, stdev=101.46, samples=25 iops : min= 15, max= 38, avg=28.04, stdev= 6.43, samples=25 lat (usec) : 50=0.39%, 100=6.64%, 250=5.08%, 500=0.39%, 750=0.39% lat (msec) : 2=1.69%, 4=8.20%, 10=13.41%, 20=30.99%, 50=29.43% lat (msec) : 100=3.26%, 250=0.13% cpu : usr=0.11%, sys=18.44%, ctx=1838, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146496: Tue Sep 8 10:51:03 2026 read: IOPS=30, BW=481KiB/s (493kB/s)(6032KiB/12537msec) clat (usec): min=36, max=88005, avg=17107.35, stdev=12953.12 lat (usec): min=37, max=88005, avg=17108.29, stdev=12953.19 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 86], 20.00th=[ 223], | 30.00th=[11863], 40.00th=[13698], 50.00th=[15664], 60.00th=[19006], | 70.00th=[21890], 80.00th=[27395], 90.00th=[32900], 95.00th=[40633], | 99.00th=[49546], 99.50th=[82314], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 255, max= 640, per=26.99%, avg=477.79, stdev=105.88, samples=24 iops : min= 15, max= 40, avg=29.21, stdev= 6.74, samples=24 write: IOPS=31, BW=499KiB/s (511kB/s)(6256KiB/12537msec); 0 zone resets clat (usec): min=1286, max=96696, avg=15471.40, stdev=14045.99 lat (usec): min=1288, max=96698, avg=15473.35, stdev=14046.12 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1975], 10.00th=[ 2704], 20.00th=[ 4080], | 30.00th=[ 5342], 40.00th=[ 7242], 50.00th=[11338], 60.00th=[15270], | 70.00th=[19530], 80.00th=[25822], 90.00th=[34341], 95.00th=[41157], | 99.00th=[62129], 99.50th=[80217], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 319, max= 699, per=26.98%, avg=502.42, stdev=97.25, samples=24 iops : min= 19, max= 43, avg=30.75, stdev= 6.10, samples=24 lat (usec) : 50=0.91%, 100=5.34%, 250=3.65%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=7.16%, 10=14.71%, 20=32.29%, 50=31.25% lat (msec) : 100=1.69% cpu : usr=0.13%, sys=19.70%, ctx=1876, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1770KiB/s (1813kB/s), 425KiB/s-481KiB/s (435kB/s-493kB/s), io=23.4MiB (24.5MB), run=12537-13530msec WRITE: bw=1863KiB/s (1907kB/s), 460KiB/s-499KiB/s (471kB/s-511kB/s), io=24.6MiB (25.8MB), run=12537-13530msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146489: Tue Sep 8 10:51:17 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(5920KiB/27272msec) clat (msec): min=4, max=172, avg=17.28, stdev=20.70 lat (msec): min=4, max=172, avg=17.28, stdev=20.70 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 14], 80.00th=[ 20], 90.00th=[ 42], 95.00th=[ 58], | 99.00th=[ 120], 99.50th=[ 150], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 31, max= 544, per=24.50%, avg=215.15, stdev=130.74, samples=54 iops : min= 1, max= 34, avg=12.87, stdev= 8.31, samples=54 write: IOPS=14, BW=233KiB/s (239kB/s)(6368KiB/27272msec); 0 zone resets clat (msec): min=22, max=164, avg=52.37, stdev=26.34 lat (msec): min=22, max=164, avg=52.37, stdev=26.33 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 26], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 50], | 70.00th=[ 59], 80.00th=[ 70], 90.00th=[ 91], 95.00th=[ 108], | 99.00th=[ 144], 99.50th=[ 163], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 64, max= 447, per=25.22%, avg=233.06, stdev=115.08, samples=54 iops : min= 4, max= 27, avg=13.98, stdev= 7.37, samples=54 lat (msec) : 10=26.17%, 20=12.37%, 50=37.37%, 100=20.31%, 250=3.78% cpu : usr=0.10%, sys=4.10%, ctx=1492, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146490: Tue Sep 8 10:51:17 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5744KiB/27134msec) clat (usec): min=3918, max=91748, avg=15065.02, stdev=15049.87 lat (usec): min=3919, max=91748, avg=15066.26, stdev=15049.77 clat percentiles (usec): | 1.00th=[ 4686], 5.00th=[ 5276], 10.00th=[ 5932], 20.00th=[ 6587], | 30.00th=[ 7242], 40.00th=[ 8291], 50.00th=[ 8979], 60.00th=[10552], | 70.00th=[12911], 80.00th=[18744], 90.00th=[33162], 95.00th=[52167], | 99.00th=[76022], 99.50th=[80217], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 31, max= 576, per=24.44%, avg=214.56, stdev=135.26, samples=52 iops : min= 1, max= 36, avg=12.85, stdev= 8.68, samples=52 write: IOPS=15, BW=241KiB/s (247kB/s)(6544KiB/27134msec); 0 zone resets clat (msec): min=20, max=163, avg=52.89, stdev=25.54 lat (msec): min=20, max=163, avg=52.90, stdev=25.54 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 26], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 61], 80.00th=[ 70], 90.00th=[ 94], 95.00th=[ 108], | 99.00th=[ 126], 99.50th=[ 142], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 63, max= 448, per=25.69%, avg=237.36, stdev=106.82, samples=53 iops : min= 3, max= 28, avg=14.26, stdev= 6.87, samples=53 lat (msec) : 4=0.13%, 10=26.43%, 20=11.33%, 50=36.07%, 100=22.27% lat (msec) : 250=3.78% cpu : usr=0.11%, sys=3.95%, ctx=1391, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146491: Tue Sep 8 10:51:17 2026 read: IOPS=14, BW=238KiB/s (244kB/s)(6256KiB/26285msec) clat (msec): min=4, max=164, avg=16.05, stdev=17.45 lat (msec): min=4, max=164, avg=16.05, stdev=17.45 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 11], | 70.00th=[ 14], 80.00th=[ 21], 90.00th=[ 37], 95.00th=[ 58], | 99.00th=[ 83], 99.50th=[ 92], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 63, max= 768, per=27.28%, avg=239.54, stdev=163.10, samples=52 iops : min= 3, max= 48, avg=14.40, stdev=10.40, samples=52 write: IOPS=14, BW=229KiB/s (235kB/s)(6032KiB/26285msec); 0 zone resets clat (msec): min=21, max=175, avg=52.84, stdev=26.01 lat (msec): min=21, max=175, avg=52.84, stdev=26.01 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 36], 40.00th=[ 39], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 61], 80.00th=[ 70], 90.00th=[ 89], 95.00th=[ 106], | 99.00th=[ 142], 99.50th=[ 157], 99.90th=[ 176], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 95, max= 448, per=24.73%, avg=228.46, stdev=108.59, samples=52 iops : min= 5, max= 28, avg=13.71, stdev= 7.01, samples=52 lat (msec) : 10=27.60%, 20=13.15%, 50=35.29%, 100=20.57%, 250=3.39% cpu : usr=0.05%, sys=4.10%, ctx=1509, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146494: Tue Sep 8 10:51:17 2026 read: IOPS=13, BW=223KiB/s (228kB/s)(6032KiB/27037msec) clat (msec): min=3, max=151, avg=16.89, stdev=20.12 lat (msec): min=3, max=151, avg=16.89, stdev=20.12 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 8], 40.00th=[ 9], 50.00th=[ 10], 60.00th=[ 12], | 70.00th=[ 14], 80.00th=[ 19], 90.00th=[ 37], 95.00th=[ 63], | 99.00th=[ 105], 99.50th=[ 150], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 32, max= 480, per=25.05%, avg=219.98, stdev=127.50, samples=53 iops : min= 2, max= 30, avg=13.19, stdev= 8.03, samples=53 write: IOPS=14, BW=231KiB/s (237kB/s)(6256KiB/27037msec); 0 zone resets clat (msec): min=21, max=143, avg=52.59, stdev=24.98 lat (msec): min=21, max=143, avg=52.59, stdev=24.98 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 27], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 36], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 51], | 70.00th=[ 61], 80.00th=[ 72], 90.00th=[ 92], 95.00th=[ 104], | 99.00th=[ 132], 99.50th=[ 142], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 63, max= 448, per=24.85%, avg=229.58, stdev=110.39, samples=53 iops : min= 3, max= 28, avg=13.77, stdev= 7.11, samples=53 lat (msec) : 4=0.26%, 10=26.82%, 20=12.37%, 50=36.72%, 100=20.18% lat (msec) : 250=3.65% cpu : usr=0.09%, sys=3.97%, ctx=1496, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=878KiB/s (899kB/s), 212KiB/s-238KiB/s (217kB/s-244kB/s), io=23.4MiB (24.5MB), run=26285-27272msec WRITE: bw=924KiB/s (946kB/s), 229KiB/s-241KiB/s (235kB/s-247kB/s), io=24.6MiB (25.8MB), run=26285-27272msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146509: Tue Sep 8 10:51:26 2026 read: IOPS=2, BW=2814KiB/s (2882kB/s)(7168KiB/2547msec) clat (msec): min=141, max=231, avg=189.02, stdev=35.48 lat (msec): min=141, max=231, avg=189.02, stdev=35.48 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 157], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 201], 60.00th=[ 215], | 70.00th=[ 215], 80.00th=[ 220], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 2039, max= 4079, per=45.20%, avg=2991.75, stdev=1103.48, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=2010KiB/s (2058kB/s)(5120KiB/2547msec); 0 zone resets clat (msec): min=97, max=398, avg=219.51, stdev=131.15 lat (msec): min=97, max=398, avg=219.58, stdev=131.16 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 107], 40.00th=[ 107], 50.00th=[ 188], 60.00th=[ 188], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2039, max= 4087, per=27.56%, avg=2553.25, stdev=1022.51, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=75.00%, 500=16.67% cpu : usr=0.04%, sys=40.49%, ctx=507, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146511: Tue Sep 8 10:51:26 2026 read: IOPS=0, BW=729KiB/s (746kB/s)(2048KiB/2810msec) clat (usec): min=756, max=176760, avg=88758.26, stdev=124453.41 lat (usec): min=757, max=176763, avg=88760.23, stdev=124455.12 clat percentiles (usec): | 1.00th=[ 758], 5.00th=[ 758], 10.00th=[ 758], 20.00th=[ 758], | 30.00th=[ 758], 40.00th=[ 758], 50.00th=[ 758], 60.00th=[177210], | 70.00th=[177210], 80.00th=[177210], 90.00th=[177210], 95.00th=[177210], | 99.00th=[177210], 99.50th=[177210], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 1980, max= 2039, per=30.36%, avg=2009.50, stdev=41.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3644KiB/s (3732kB/s)(10.0MiB/2810msec); 0 zone resets clat (msec): min=143, max=389, avg=259.59, stdev=97.33 lat (msec): min=143, max=389, avg=259.68, stdev=97.30 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 146], | 30.00th=[ 157], 40.00th=[ 174], 50.00th=[ 264], 60.00th=[ 292], | 70.00th=[ 326], 80.00th=[ 351], 90.00th=[ 359], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 1980, max= 4096, per=39.54%, avg=3664.20, stdev=941.52, samples=5 iops : min= 1, max= 4, avg= 2.80, stdev= 1.10, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=41.67%, 500=50.00% cpu : usr=0.04%, sys=41.37%, ctx=239, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146513: Tue Sep 8 10:51:26 2026 read: IOPS=1, BW=1986KiB/s (2033kB/s)(6144KiB/3094msec) clat (msec): min=69, max=231, avg=149.63, stdev=67.54 lat (msec): min=69, max=231, avg=149.64, stdev=67.54 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 180], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 2035, max= 4096, per=51.42%, avg=3403.33, stdev=1185.04, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1986KiB/s (2033kB/s)(6144KiB/3094msec); 0 zone resets clat (msec): min=103, max=792, avg=347.83, stdev=257.21 lat (msec): min=103, max=792, avg=347.94, stdev=257.20 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 292], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2039, max= 4071, per=32.62%, avg=3022.75, stdev=1134.93, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=29.74%, ctx=575, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146515: Tue Sep 8 10:51:26 2026 read: IOPS=2, BW=2064KiB/s (2113kB/s)(5120KiB/2481msec) clat (usec): min=489, max=235829, avg=124665.78, stdev=114704.62 lat (usec): min=490, max=235830, avg=124666.82, stdev=114704.57 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[189793], 60.00th=[189793], | 70.00th=[198181], 80.00th=[198181], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 2039, max= 6119, per=61.63%, avg=4079.00, stdev=2885.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2889KiB/s (2958kB/s)(7168KiB/2481msec); 0 zone resets clat (msec): min=103, max=396, avg=262.38, stdev=102.64 lat (msec): min=103, max=396, avg=262.47, stdev=102.63 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 205], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 249], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 384], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 3792, max= 4087, per=43.02%, avg=3986.00, stdev=168.06, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=40.08%, ctx=234, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6619KiB/s (6778kB/s), 729KiB/s-2814KiB/s (746kB/s-2882kB/s), io=20.0MiB (20.0MB), run=2481-3094msec WRITE: bw=9267KiB/s (9489kB/s), 1986KiB/s-3644KiB/s (2033kB/s-3732kB/s), io=28.0MiB (29.4MB), run=2481-3094msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146510: Tue Sep 8 10:51:26 2026 read: IOPS=2, BW=2199KiB/s (2252kB/s)(7168KiB/3259msec) clat (msec): min=49, max=714, avg=275.52, stdev=280.02 lat (msec): min=49, max=714, avg=275.52, stdev=280.02 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 64], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 127], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 634], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1361, max= 4015, per=38.11%, avg=2368.00, stdev=1144.76, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 write: IOPS=1, BW=1571KiB/s (1609kB/s)(5120KiB/3259msec); 0 zone resets clat (msec): min=131, max=459, avg=246.39, stdev=131.81 lat (msec): min=131, max=459, avg=246.49, stdev=131.80 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2048, max= 2048, per=23.54%, avg=2048.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 50=8.33%, 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=9.88%, ctx=142, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146512: Tue Sep 8 10:51:26 2026 read: IOPS=0, BW=635KiB/s (650kB/s)(2048KiB/3225msec) clat (msec): min=81, max=252, avg=166.66, stdev=121.11 lat (msec): min=81, max=252, avg=166.66, stdev=121.11 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 82], 40.00th=[ 82], 50.00th=[ 82], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 1349, max= 2048, per=27.34%, avg=1698.50, stdev=494.27, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3175KiB/s (3251kB/s)(10.0MiB/3225msec); 0 zone resets clat (msec): min=138, max=474, avg=284.53, stdev=135.58 lat (msec): min=138, max=474, avg=284.61, stdev=135.58 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 148], 40.00th=[ 199], 50.00th=[ 234], 60.00th=[ 288], | 70.00th=[ 326], 80.00th=[ 447], 90.00th=[ 460], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2048, max= 6023, per=40.85%, avg=3553.75, stdev=1908.38, samples=4 iops : min= 2, max= 5, avg= 3.25, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=14.21%, ctx=209, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146514: Tue Sep 8 10:51:26 2026 read: IOPS=2, BW=2103KiB/s (2153kB/s)(6144KiB/2922msec) clat (msec): min=96, max=379, avg=230.41, stdev=123.73 lat (msec): min=96, max=379, avg=230.41, stdev=123.73 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 259], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2048, max= 4096, per=54.50%, avg=3386.33, stdev=1159.74, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=2, BW=2103KiB/s (2153kB/s)(6144KiB/2922msec); 0 zone resets clat (msec): min=95, max=458, avg=249.23, stdev=135.92 lat (msec): min=95, max=458, avg=249.32, stdev=135.94 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 224], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 2048, max= 4090, per=31.37%, avg=2728.67, stdev=1178.95, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=13.11%, ctx=83, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146516: Tue Sep 8 10:51:26 2026 read: IOPS=1, BW=1553KiB/s (1591kB/s)(5120KiB/3296msec) clat (msec): min=40, max=653, avg=251.96, stdev=245.26 lat (msec): min=40, max=653, avg=251.96, stdev=245.26 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 41], 10.00th=[ 41], 20.00th=[ 41], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2048, max= 6095, per=65.53%, avg=4071.50, stdev=2861.66, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2175KiB/s (2227kB/s)(7168KiB/3296msec); 0 zone resets clat (msec): min=56, max=560, avg=288.07, stdev=203.60 lat (msec): min=57, max=560, avg=288.17, stdev=203.61 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 73], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 309], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 523], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1980, max= 2048, per=23.24%, avg=2021.50, stdev=29.49, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=11.38%, ctx=105, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6214KiB/s (6363kB/s), 635KiB/s-2199KiB/s (650kB/s-2252kB/s), io=20.0MiB (20.0MB), run=2922-3296msec WRITE: bw=8699KiB/s (8908kB/s), 1571KiB/s-3175KiB/s (1609kB/s-3251kB/s), io=28.0MiB (29.4MB), run=2922-3296msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146526: Tue Sep 8 10:51:35 2026 read: IOPS=1, BW=6156KiB/s (6304kB/s)(12.0MiB/1996msec) clat (msec): min=561, max=802, avg=656.15, stdev=128.47 lat (msec): min=561, max=802, avg=656.15, stdev=128.47 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 5919, max= 8192, per=85.96%, avg=7055.50, stdev=1607.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=39.90%, ctx=1282, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146527: Tue Sep 8 10:51:35 2026 read: IOPS=0, BW=2206KiB/s (2259kB/s)(4096KiB/1857msec) clat (nsec): min=535022k, max=535022k, avg=535022405.00, stdev= 0.00 lat (nsec): min=535025k, max=535025k, avg=535024630.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 5997, max= 5997, per=73.06%, avg=5997.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4411KiB/s (4517kB/s)(8192KiB/1857msec); 0 zone resets clat (msec): min=460, max=773, avg=617.04, stdev=221.54 lat (msec): min=460, max=773, avg=617.28, stdev=221.45 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8192, max= 8192, per=59.13%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=13.15%, ctx=348, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146528: Tue Sep 8 10:51:35 2026 write: IOPS=1, BW=5196KiB/s (5320kB/s)(12.0MiB/2365msec); 0 zone resets clat (msec): min=183, max=1099, avg=743.43, stdev=490.72 lat (msec): min=184, max=1102, avg=744.62, stdev=491.59 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8192, max= 8192, per=59.13%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=13.49%, ctx=80, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146529: Tue Sep 8 10:51:35 2026 write: IOPS=1, BW=7699KiB/s (7884kB/s)(12.0MiB/1596msec); 0 zone resets clat (msec): min=265, max=796, avg=496.74, stdev=272.10 lat (msec): min=265, max=797, avg=497.24, stdev=272.52 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 430], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 5988, max= 8175, per=51.11%, avg=7081.50, stdev=1546.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=15.92%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8208KiB/s (8405kB/s), 2206KiB/s-6156KiB/s (2259kB/s-6304kB/s), io=16.0MiB (16.8MB), run=1857-1996msec WRITE: bw=13.5MiB/s (14.2MB/s), 4411KiB/s-7699KiB/s (4517kB/s-7884kB/s), io=32.0MiB (33.6MB), run=1596-2365msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146521: Tue Sep 8 10:51:35 2026 read: IOPS=1, BW=5694KiB/s (5831kB/s)(12.0MiB/2158msec) clat (msec): min=521, max=1003, avg=697.52, stdev=266.13 lat (msec): min=521, max=1003, avg=697.52, stdev=266.13 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.13%, ctx=97, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146522: Tue Sep 8 10:51:35 2026 read: IOPS=0, BW=1648KiB/s (1688kB/s)(4096KiB/2485msec) clat (nsec): min=759971k, max=759971k, avg=759971130.00, stdev= 0.00 lat (nsec): min=759974k, max=759974k, avg=759973753.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3297KiB/s (3376kB/s)(8192KiB/2485msec); 0 zone resets clat (msec): min=640, max=1024, avg=832.42, stdev=271.89 lat (msec): min=640, max=1025, avg=832.85, stdev=271.96 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1028], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8192, max= 8192, per=62.13%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=8.33%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146524: Tue Sep 8 10:51:35 2026 write: IOPS=2, BW=10.5MiB/s (10.0MB/s)(12.0MiB/1147msec); 0 zone resets clat (msec): min=261, max=469, avg=362.75, stdev=103.72 lat (msec): min=262, max=469, avg=363.51, stdev=103.48 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min=11252, max=11252, per=85.33%, avg=11252.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.17%, sys=16.67%, ctx=75, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146525: Tue Sep 8 10:51:35 2026 write: IOPS=1, BW=8021KiB/s (8213kB/s)(12.0MiB/1532msec); 0 zone resets clat (msec): min=189, max=1008, avg=490.39, stdev=451.07 lat (msec): min=189, max=1009, avg=490.95, stdev=450.94 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min=11206, max=11206, per=84.98%, avg=11206.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.07%, sys=15.74%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6593KiB/s (6751kB/s), 1648KiB/s-5694KiB/s (1688kB/s-5831kB/s), io=16.0MiB (16.8MB), run=2158-2485msec WRITE: bw=12.9MiB/s (13.5MB/s), 3297KiB/s-10.5MiB/s (3376kB/s-10.0MB/s), io=32.0MiB (33.6MB), run=1147-2485msec