== sanity test 398b: DIO and buffer IO race ============== 11:07:45 (1790694465) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.46446 s, 5.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144832: Tue Sep 29 11:10:29 2026 read: IOPS=11, BW=44.0KiB/s (45.1kB/s)(5992KiB/136060msec) clat (usec): min=29, max=364791, avg=45755.70, stdev=32629.03 lat (usec): min=29, max=364793, avg=45759.88, stdev=32629.31 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 10552], 20.00th=[ 22676], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[139461], 99.50th=[170918], 99.90th=[246416], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 110, per=25.52%, avg=43.64, stdev=18.87, samples=267 iops : min= 1, max= 27, avg=10.26, stdev= 4.76, samples=267 write: IOPS=11, BW=46.3KiB/s (47.4kB/s)(6296KiB/136060msec); 0 zone resets clat (usec): min=965, max=859402, avg=42490.40, stdev=50827.78 lat (usec): min=966, max=859405, avg=42500.39, stdev=50825.04 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1352], 10.00th=[ 1827], 20.00th=[ 4555], | 30.00th=[ 8979], 40.00th=[ 19006], 50.00th=[ 31327], 60.00th=[ 40633], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[124257], | 99.00th=[208667], 99.50th=[250610], 99.90th=[484443], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 118, per=25.74%, avg=46.07, stdev=20.64, samples=266 iops : min= 1, max= 29, avg=10.87, stdev= 5.20, samples=266 lat (usec) : 50=0.39%, 100=3.42%, 250=0.52%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.53%, 4=3.84%, 10=6.90%, 20=8.46%, 50=36.43% lat (msec) : 100=26.46%, 250=7.42%, 500=0.26%, 1000=0.03% cpu : usr=0.09%, sys=4.99%, ctx=6587, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144833: Tue Sep 29 11:10:29 2026 read: IOPS=10, BW=42.4KiB/s (43.4kB/s)(5940KiB/140053msec) clat (usec): min=35, max=361798, avg=47136.55, stdev=32694.57 lat (usec): min=35, max=361800, avg=47142.98, stdev=32691.92 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 78], 10.00th=[ 14615], 20.00th=[ 23200], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 57934], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[152044], 99.50th=[170918], 99.90th=[283116], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 95, per=24.58%, avg=42.03, stdev=17.84, samples=275 iops : min= 1, max= 23, avg= 9.85, stdev= 4.51, samples=275 write: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6348KiB/140053msec); 0 zone resets clat (usec): min=1003, max=909506, avg=43740.41, stdev=50782.52 lat (usec): min=1004, max=909507, avg=43750.86, stdev=50777.70 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1401], 10.00th=[ 1991], 20.00th=[ 5407], | 30.00th=[ 10028], 40.00th=[ 20055], 50.00th=[ 31327], 60.00th=[ 43779], | 70.00th=[ 57934], 80.00th=[ 73925], 90.00th=[ 98042], 95.00th=[123208], | 99.00th=[204473], 99.50th=[287310], 99.90th=[541066], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 127, per=25.18%, avg=45.08, stdev=20.55, samples=274 iops : min= 1, max= 31, avg=10.62, stdev= 5.19, samples=274 lat (usec) : 50=0.23%, 100=2.96%, 250=0.23%, 500=0.10%, 750=0.07% lat (msec) : 2=5.31%, 4=3.32%, 10=7.13%, 20=8.46%, 50=35.25% lat (msec) : 100=29.30%, 250=7.16%, 500=0.42%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=4.94%, ctx=6730, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144834: Tue Sep 29 11:10:29 2026 read: IOPS=10, BW=43.9KiB/s (44.9kB/s)(6028KiB/137396msec) clat (usec): min=38, max=346761, avg=45910.59, stdev=33788.73 lat (usec): min=38, max=346763, avg=45915.81, stdev=33788.89 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 76], 10.00th=[ 13698], 20.00th=[ 21103], | 30.00th=[ 27919], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 66323], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[164627], 99.50th=[191890], 99.90th=[270533], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 126, per=25.50%, avg=43.60, stdev=18.12, samples=269 iops : min= 1, max= 31, avg=10.25, stdev= 4.58, samples=269 write: IOPS=11, BW=45.6KiB/s (46.7kB/s)(6260KiB/137396msec); 0 zone resets clat (usec): min=1045, max=905106, avg=43188.43, stdev=48902.32 lat (usec): min=1047, max=905108, avg=43192.09, stdev=48901.41 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1778], 20.00th=[ 4293], | 30.00th=[ 8586], 40.00th=[ 21103], 50.00th=[ 33162], 60.00th=[ 44827], | 70.00th=[ 57934], 80.00th=[ 71828], 90.00th=[ 96994], 95.00th=[122160], | 99.00th=[183501], 99.50th=[229639], 99.90th=[459277], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 126, per=25.18%, avg=45.08, stdev=18.73, samples=270 iops : min= 1, max= 31, avg=10.62, stdev= 4.73, samples=270 lat (usec) : 50=0.20%, 100=3.03%, 250=0.46%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.89%, 4=3.71%, 10=6.45%, 20=8.59%, 50=35.38% lat (msec) : 100=28.65%, 250=7.16%, 500=0.26%, 1000=0.03% cpu : usr=0.08%, sys=4.61%, ctx=6619, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144835: Tue Sep 29 11:10:29 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(6052KiB/132399msec) clat (usec): min=33, max=948303, avg=43325.45, stdev=39799.27 lat (usec): min=33, max=948305, avg=43343.75, stdev=39799.41 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 486], 20.00th=[ 20317], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[175113], 99.90th=[513803], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 95, per=26.86%, avg=45.93, stdev=17.89, samples=257 iops : min= 1, max= 23, avg=10.83, stdev= 4.51, samples=257 write: IOPS=11, BW=47.1KiB/s (48.2kB/s)(6236KiB/132399msec); 0 zone resets clat (usec): min=742, max=442249, avg=42475.10, stdev=44299.78 lat (usec): min=744, max=442251, avg=42478.32, stdev=44298.87 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1778], 20.00th=[ 4490], | 30.00th=[ 8455], 40.00th=[ 17957], 50.00th=[ 30802], 60.00th=[ 44303], | 70.00th=[ 55837], 80.00th=[ 74974], 90.00th=[102237], 95.00th=[125305], | 99.00th=[183501], 99.50th=[223347], 99.90th=[274727], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 103, per=26.21%, avg=46.92, stdev=19.36, samples=259 iops : min= 1, max= 25, avg=11.08, stdev= 4.88, samples=259 lat (usec) : 50=0.46%, 100=3.84%, 250=0.42%, 500=0.23%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.44%, 4=3.94%, 10=7.32%, 20=8.85%, 50=35.32% lat (msec) : 100=26.37%, 250=7.39%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.82%, ctx=6406, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (176kB/s), 42.4KiB/s-45.7KiB/s (43.4kB/s-46.8kB/s), io=23.4MiB (24.6MB), run=132399-140053msec WRITE: bw=180KiB/s (184kB/s), 45.3KiB/s-47.1KiB/s (46.4kB/s-48.2kB/s), io=24.6MiB (25.7MB), run=132399-140053msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144837: Tue Sep 29 11:13:00 2026 read: IOPS=5, BW=20.7KiB/s (21.1kB/s)(5992KiB/290111msec) clat (msec): min=5, max=914, avg=38.98, stdev=46.68 lat (msec): min=5, max=914, avg=38.98, stdev=46.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 80], 95.00th=[ 120], | 99.00th=[ 203], 99.50th=[ 264], 99.90th=[ 502], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 95, per=28.47%, avg=23.35, stdev=16.11, samples=493 iops : min= 1, max= 23, avg= 5.16, stdev= 4.05, samples=493 write: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6296KiB/290111msec); 0 zone resets clat (msec): min=31, max=616, avg=147.08, stdev=68.07 lat (msec): min=31, max=616, avg=147.08, stdev=68.08 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 120], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 190], 90.00th=[ 234], 95.00th=[ 271], | 99.00th=[ 355], 99.50th=[ 456], 99.90th=[ 600], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7, max= 55, per=24.85%, avg=21.37, stdev= 9.57, samples=564 iops : min= 1, max= 13, avg= 4.66, stdev= 2.43, samples=564 lat (msec) : 10=2.57%, 20=13.83%, 50=23.40%, 100=19.40%, 250=36.59% lat (msec) : 500=4.00%, 750=0.16%, 1000=0.03% cpu : usr=0.04%, sys=1.13%, ctx=5115, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144838: Tue Sep 29 11:13:00 2026 read: IOPS=5, BW=20.5KiB/s (20.0kB/s)(5940KiB/290046msec) clat (msec): min=5, max=961, avg=38.56, stdev=44.62 lat (msec): min=5, max=961, avg=38.56, stdev=44.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 84], 95.00th=[ 112], | 99.00th=[ 197], 99.50th=[ 245], 99.90th=[ 388], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 95, per=28.54%, avg=23.40, stdev=15.71, samples=488 iops : min= 1, max= 23, avg= 5.18, stdev= 3.96, samples=488 write: IOPS=5, BW=21.9KiB/s (22.4kB/s)(6348KiB/290046msec); 0 zone resets clat (msec): min=35, max=629, avg=146.55, stdev=67.44 lat (msec): min=35, max=629, avg=146.56, stdev=67.44 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 79], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 236], 95.00th=[ 271], | 99.00th=[ 359], 99.50th=[ 435], 99.90th=[ 567], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 63, per=25.00%, avg=21.50, stdev= 9.59, samples=566 iops : min= 1, max= 15, avg= 4.70, stdev= 2.43, samples=566 lat (msec) : 10=1.82%, 20=14.81%, 50=22.36%, 100=19.63%, 250=37.27% lat (msec) : 500=3.91%, 750=0.16%, 1000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5202, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144839: Tue Sep 29 11:13:00 2026 read: IOPS=5, BW=20.0KiB/s (21.5kB/s)(6028KiB/287164msec) clat (msec): min=6, max=527, avg=38.37, stdev=38.61 lat (msec): min=6, max=527, avg=38.37, stdev=38.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 83], 95.00th=[ 113], | 99.00th=[ 188], 99.50th=[ 222], 99.90th=[ 330], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 103, per=27.97%, avg=22.93, stdev=16.37, samples=505 iops : min= 1, max= 25, avg= 5.06, stdev= 4.12, samples=505 write: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6260KiB/287164msec); 0 zone resets clat (msec): min=33, max=1088, avg=146.43, stdev=69.61 lat (msec): min=33, max=1088, avg=146.43, stdev=69.61 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 78], 20.00th=[ 93], | 30.00th=[ 107], 40.00th=[ 121], 50.00th=[ 133], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 188], 90.00th=[ 234], 95.00th=[ 279], | 99.00th=[ 368], 99.50th=[ 414], 99.90th=[ 472], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 55, per=24.98%, avg=21.48, stdev= 9.62, samples=558 iops : min= 1, max= 13, avg= 4.70, stdev= 2.43, samples=558 lat (msec) : 10=2.21%, 20=15.27%, 50=21.55%, 100=19.66%, 250=37.34% lat (msec) : 500=3.91%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.13%, ctx=4998, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144840: Tue Sep 29 11:13:00 2026 read: IOPS=5, BW=21.0KiB/s (21.5kB/s)(6052KiB/288131msec) clat (msec): min=6, max=572, avg=37.89, stdev=40.23 lat (msec): min=6, max=572, avg=37.89, stdev=40.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 182], 99.50th=[ 234], 99.90th=[ 502], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 87, per=29.53%, avg=24.21, stdev=16.48, samples=481 iops : min= 1, max= 21, avg= 5.38, stdev= 4.16, samples=481 write: IOPS=5, BW=21.6KiB/s (22.2kB/s)(6236KiB/288131msec); 0 zone resets clat (msec): min=40, max=1086, avg=147.94, stdev=73.27 lat (msec): min=40, max=1086, avg=147.94, stdev=73.27 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 132], 60.00th=[ 146], | 70.00th=[ 165], 80.00th=[ 197], 90.00th=[ 239], 95.00th=[ 284], | 99.00th=[ 384], 99.50th=[ 460], 99.90th=[ 575], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 47, per=24.79%, avg=21.32, stdev= 9.57, samples=560 iops : min= 1, max= 11, avg= 4.66, stdev= 2.43, samples=560 lat (msec) : 10=1.99%, 20=15.76%, 50=21.78%, 100=20.25%, 250=36.20% lat (msec) : 500=3.81%, 750=0.20%, 2000=0.03% cpu : usr=0.05%, sys=1.11%, ctx=5091, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.8KiB/s (84.8kB/s), 20.5KiB/s-21.0KiB/s (20.0kB/s-21.5kB/s), io=23.4MiB (24.6MB), run=287164-290111msec WRITE: bw=86.7KiB/s (88.7kB/s), 21.6KiB/s-21.9KiB/s (22.2kB/s-22.4kB/s), io=24.6MiB (25.7MB), run=287164-290111msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144903: Tue Sep 29 11:13:44 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(5920KiB/29402msec) clat (usec): min=33, max=288580, avg=41043.79, stdev=37343.49 lat (usec): min=33, max=288582, avg=41045.80, stdev=37343.54 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 60], 10.00th=[ 74], 20.00th=[ 92], | 30.00th=[ 21627], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 43254], | 70.00th=[ 52691], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[108528], | 99.00th=[162530], 99.50th=[198181], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 92, max= 379, per=26.69%, avg=205.54, stdev=73.86, samples=56 iops : min= 5, max= 23, avg=12.05, stdev= 4.65, samples=56 write: IOPS=13, BW=217KiB/s (222kB/s)(6368KiB/29402msec); 0 zone resets clat (usec): min=1099, max=235641, avg=35622.18, stdev=38925.10 lat (usec): min=1099, max=235645, avg=35638.23, stdev=38916.87 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1942], 10.00th=[ 2507], 20.00th=[ 5145], | 30.00th=[ 8029], 40.00th=[ 12256], 50.00th=[ 19530], 60.00th=[ 31327], | 70.00th=[ 45876], 80.00th=[ 63701], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[181404], 99.50th=[204473], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 30, max= 479, per=26.89%, avg=217.82, stdev=85.55, samples=57 iops : min= 1, max= 29, avg=12.84, stdev= 5.40, samples=57 lat (usec) : 50=1.30%, 100=8.85%, 250=1.56%, 500=0.26%, 750=0.13% lat (msec) : 2=3.52%, 4=5.73%, 10=9.64%, 20=8.72%, 50=31.38% lat (msec) : 100=21.74%, 250=7.03%, 500=0.13% cpu : usr=0.10%, sys=5.35%, ctx=1431, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144904: Tue Sep 29 11:13:44 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(5744KiB/30723msec) clat (usec): min=35, max=317692, avg=42417.09, stdev=40167.98 lat (usec): min=35, max=317694, avg=42429.24, stdev=40167.02 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 96], | 30.00th=[ 21890], 40.00th=[ 30540], 50.00th=[ 39060], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 65799], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[219153], 99.50th=[246416], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 30, max= 374, per=24.13%, avg=185.83, stdev=77.31, samples=60 iops : min= 1, max= 23, avg=10.82, stdev= 4.88, samples=60 write: IOPS=13, BW=213KiB/s (218kB/s)(6544KiB/30723msec); 0 zone resets clat (usec): min=1282, max=420901, avg=37691.15, stdev=43035.96 lat (usec): min=1282, max=420905, avg=37698.81, stdev=43032.92 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1942], 10.00th=[ 2900], 20.00th=[ 5145], | 30.00th=[ 8029], 40.00th=[ 13042], 50.00th=[ 21103], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 66323], 90.00th=[ 90702], 95.00th=[114820], | 99.00th=[173016], 99.50th=[200279], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 63, max= 479, per=26.08%, avg=211.28, stdev=87.79, samples=60 iops : min= 3, max= 29, avg=12.42, stdev= 5.52, samples=60 lat (usec) : 50=1.17%, 100=8.33%, 250=0.78%, 500=0.65%, 750=0.26% lat (msec) : 2=3.65%, 4=5.47%, 10=10.42%, 20=8.98%, 50=26.95% lat (msec) : 100=27.08%, 250=5.99%, 500=0.26% cpu : usr=0.07%, sys=5.50%, ctx=1404, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144905: Tue Sep 29 11:13:44 2026 read: IOPS=12, BW=201KiB/s (206kB/s)(6256KiB/31077msec) clat (usec): min=23, max=537280, avg=43104.80, stdev=47260.91 lat (usec): min=23, max=537282, avg=43106.52, stdev=47261.02 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 94], | 30.00th=[ 16450], 40.00th=[ 30016], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 57410], 80.00th=[ 68682], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[200279], 99.50th=[246416], 99.90th=[541066], 99.95th=[541066], | 99.99th=[541066] bw ( KiB/s): min= 31, max= 445, per=25.76%, avg=198.37, stdev=81.19, samples=60 iops : min= 1, max= 27, avg=11.60, stdev= 5.09, samples=60 write: IOPS=12, BW=194KiB/s (199kB/s)(6032KiB/31077msec); 0 zone resets clat (usec): min=1345, max=243288, avg=37619.44, stdev=39888.31 lat (usec): min=1349, max=243290, avg=37622.28, stdev=39888.27 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1844], 10.00th=[ 3130], 20.00th=[ 5145], | 30.00th=[ 9241], 40.00th=[ 14484], 50.00th=[ 23725], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 64750], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[162530], 99.50th=[229639], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 61, max= 444, per=23.03%, avg=186.52, stdev=91.15, samples=60 iops : min= 3, max= 27, avg=10.85, stdev= 5.72, samples=60 lat (usec) : 50=1.04%, 100=10.29%, 250=1.95%, 500=0.13%, 750=0.13% lat (msec) : 2=3.52%, 4=4.30%, 10=8.59%, 20=9.38%, 50=28.26% lat (msec) : 100=24.48%, 250=7.81%, 750=0.13% cpu : usr=0.08%, sys=5.29%, ctx=1471, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144906: Tue Sep 29 11:13:44 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28816msec) clat (usec): min=28, max=288558, avg=39687.21, stdev=37086.34 lat (usec): min=28, max=288560, avg=39697.06, stdev=37088.08 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 14222], 40.00th=[ 29230], 50.00th=[ 35914], 60.00th=[ 44827], | 70.00th=[ 54264], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[164627], 99.50th=[185598], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 31, max= 413, per=27.11%, avg=208.71, stdev=85.35, samples=56 iops : min= 1, max= 25, avg=12.27, stdev= 5.41, samples=56 write: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28816msec); 0 zone resets clat (usec): min=1199, max=279546, avg=35248.25, stdev=38610.43 lat (usec): min=1199, max=279550, avg=35251.09, stdev=38610.90 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2057], 10.00th=[ 3032], 20.00th=[ 5997], | 30.00th=[ 8356], 40.00th=[ 12649], 50.00th=[ 19792], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 60556], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[166724], 99.50th=[229639], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 445, per=26.85%, avg=217.46, stdev=82.05, samples=56 iops : min= 1, max= 27, avg=12.82, stdev= 5.17, samples=56 lat (usec) : 50=1.56%, 100=10.29%, 250=1.95%, 500=0.26%, 750=0.13% lat (msec) : 2=2.34%, 4=4.17%, 10=10.81%, 20=9.38%, 50=30.34% lat (msec) : 100=22.40%, 250=6.12%, 500=0.26% cpu : usr=0.09%, sys=5.56%, ctx=1388, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=771KiB/s (789kB/s), 187KiB/s-209KiB/s (191kB/s-214kB/s), io=23.4MiB (24.5MB), run=28816-31077msec WRITE: bw=811KiB/s (830kB/s), 194KiB/s-217KiB/s (199kB/s-222kB/s), io=24.6MiB (25.8MB), run=28816-31077msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144898: Tue Sep 29 11:14:28 2026 read: IOPS=4, BW=79.2KiB/s (81.1kB/s)(5920KiB/74728msec) clat (msec): min=9, max=290, avg=41.05, stdev=39.53 lat (msec): min=9, max=290, avg=41.06, stdev=39.54 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 84], 95.00th=[ 128], | 99.00th=[ 218], 99.50th=[ 247], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 367, per=28.59%, avg=90.65, stdev=60.05, samples=127 iops : min= 1, max= 22, avg= 4.88, stdev= 3.83, samples=127 write: IOPS=5, BW=85.2KiB/s (87.3kB/s)(6368KiB/74728msec); 0 zone resets clat (msec): min=37, max=672, avg=149.40, stdev=73.11 lat (msec): min=37, max=672, avg=149.40, stdev=73.11 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 73], 10.00th=[ 81], 20.00th=[ 94], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 133], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 199], 90.00th=[ 236], 95.00th=[ 292], | 99.00th=[ 388], 99.50th=[ 493], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 30, max= 191, per=26.28%, avg=87.76, stdev=37.75, samples=142 iops : min= 1, max= 11, avg= 4.70, stdev= 2.42, samples=142 lat (msec) : 10=0.65%, 20=12.63%, 50=25.00%, 100=19.66%, 250=37.76% lat (msec) : 500=4.17%, 750=0.13% cpu : usr=0.04%, sys=1.15%, ctx=1241, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144899: Tue Sep 29 11:14:28 2026 read: IOPS=4, BW=76.2KiB/s (77.0kB/s)(5744KiB/75428msec) clat (msec): min=7, max=279, avg=41.55, stdev=39.26 lat (msec): min=7, max=279, avg=41.55, stdev=39.26 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 88], 95.00th=[ 129], | 99.00th=[ 213], 99.50th=[ 271], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 379, per=28.70%, avg=90.98, stdev=62.45, samples=124 iops : min= 1, max= 23, avg= 4.90, stdev= 3.94, samples=124 write: IOPS=5, BW=86.8KiB/s (88.8kB/s)(6544KiB/75428msec); 0 zone resets clat (msec): min=46, max=674, avg=147.55, stdev=72.63 lat (msec): min=46, max=674, avg=147.56, stdev=72.63 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 89], | 30.00th=[ 104], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 150], | 70.00th=[ 167], 80.00th=[ 194], 90.00th=[ 234], 95.00th=[ 275], | 99.00th=[ 393], 99.50th=[ 485], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 30, max= 191, per=25.97%, avg=86.73, stdev=38.59, samples=148 iops : min= 1, max= 11, avg= 4.64, stdev= 2.51, samples=148 lat (msec) : 10=0.78%, 20=12.89%, 50=23.31%, 100=20.83%, 250=38.02% lat (msec) : 500=4.04%, 750=0.13% cpu : usr=0.05%, sys=1.16%, ctx=1228, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144900: Tue Sep 29 11:14:28 2026 read: IOPS=5, BW=86.8KiB/s (88.9kB/s)(6256KiB/72091msec) clat (msec): min=7, max=293, avg=40.84, stdev=38.67 lat (msec): min=7, max=293, avg=40.85, stdev=38.67 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 213], 99.50th=[ 222], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 318, per=30.89%, avg=97.91, stdev=70.09, samples=126 iops : min= 1, max= 19, avg= 5.34, stdev= 4.43, samples=126 write: IOPS=5, BW=83.7KiB/s (85.7kB/s)(6032KiB/72091msec); 0 zone resets clat (msec): min=43, max=477, avg=148.37, stdev=66.32 lat (msec): min=43, max=477, avg=148.37, stdev=66.32 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 78], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 120], 50.00th=[ 133], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 192], 90.00th=[ 234], 95.00th=[ 268], | 99.00th=[ 401], 99.50th=[ 435], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 188, per=25.21%, avg=84.19, stdev=35.55, samples=140 iops : min= 1, max= 11, avg= 4.46, stdev= 2.31, samples=140 lat (msec) : 10=0.91%, 20=13.28%, 50=26.95%, 100=17.06%, 250=37.89% lat (msec) : 500=3.91% cpu : usr=0.06%, sys=1.21%, ctx=1287, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144901: Tue Sep 29 11:14:28 2026 read: IOPS=5, BW=80.5KiB/s (82.5kB/s)(6032KiB/74911msec) clat (msec): min=7, max=256, avg=41.36, stdev=37.55 lat (msec): min=7, max=256, avg=41.36, stdev=37.55 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 88], 95.00th=[ 133], | 99.00th=[ 207], 99.50th=[ 213], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 30, max= 256, per=29.22%, avg=92.64, stdev=59.98, samples=127 iops : min= 1, max= 16, avg= 5.02, stdev= 3.83, samples=127 write: IOPS=5, BW=83.5KiB/s (85.5kB/s)(6256KiB/74911msec); 0 zone resets clat (msec): min=48, max=692, avg=151.14, stdev=71.93 lat (msec): min=48, max=692, avg=151.15, stdev=71.95 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 71], 10.00th=[ 81], 20.00th=[ 99], | 30.00th=[ 108], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 150], | 70.00th=[ 171], 80.00th=[ 197], 90.00th=[ 243], 95.00th=[ 296], | 99.00th=[ 388], 99.50th=[ 472], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 30, max= 191, per=25.22%, avg=84.24, stdev=35.73, samples=146 iops : min= 1, max= 11, avg= 4.49, stdev= 2.31, samples=146 lat (msec) : 10=0.65%, 20=11.46%, 50=27.21%, 100=16.93%, 250=38.80% lat (msec) : 500=4.82%, 750=0.13% cpu : usr=0.04%, sys=1.10%, ctx=1229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=318KiB/s (325kB/s), 76.2KiB/s-86.8KiB/s (77.0kB/s-88.9kB/s), io=23.4MiB (24.5MB), run=72091-75428msec WRITE: bw=334KiB/s (342kB/s), 83.5KiB/s-86.8KiB/s (85.5kB/s-88.8kB/s), io=24.6MiB (25.8MB), run=72091-75428msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144929: Tue Sep 29 11:14:47 2026 read: IOPS=1, BW=1391KiB/s (1424kB/s)(7168KiB/5154msec) clat (msec): min=16, max=2426, avg=550.62, stdev=837.73 lat (msec): min=16, max=2426, avg=550.62, stdev=837.73 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 17], 10.00th=[ 17], 20.00th=[ 180], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 257], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 460], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1715, max= 4079, per=100.00%, avg=2963.00, stdev=1267.50, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=993KiB/s (1017kB/s)(5120KiB/5154msec); 0 zone resets clat (msec): min=103, max=354, avg=232.80, stdev=101.72 lat (msec): min=103, max=355, avg=233.18, stdev=102.20 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2027, max= 3813, per=68.02%, avg=2626.33, stdev=1027.70, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 20=8.33%, 250=41.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.41%, ctx=590, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144930: Tue Sep 29 11:14:47 2026 read: IOPS=0, BW=276KiB/s (282kB/s)(2048KiB/7425msec) clat (usec): min=741, max=203590, avg=102165.94, stdev=143435.89 lat (usec): min=742, max=203593, avg=102167.95, stdev=143436.71 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 742], | 30.00th=[ 742], 40.00th=[ 742], 50.00th=[ 742], 60.00th=[204473], | 70.00th=[204473], 80.00th=[204473], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 1689, max= 2023, per=67.30%, avg=1856.00, stdev=236.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1379KiB/s (1412kB/s)(10.0MiB/7425msec); 0 zone resets clat (msec): min=129, max=3064, avg=698.14, stdev=931.89 lat (msec): min=130, max=3064, avg=698.26, stdev=931.89 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 150], | 30.00th=[ 171], 40.00th=[ 199], 50.00th=[ 249], 60.00th=[ 284], | 70.00th=[ 477], 80.00th=[ 760], 90.00th=[ 1502], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 2011, max= 4047, per=68.91%, avg=2660.67, stdev=986.07, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=16.67%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=5.90%, ctx=121, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144931: Tue Sep 29 11:14:47 2026 read: IOPS=0, BW=1016KiB/s (1040kB/s)(6144KiB/6050msec) clat (usec): min=457, max=526834, avg=138632.44, stdev=203871.48 lat (usec): min=458, max=526835, avg=138633.75, stdev=203871.43 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 635], | 30.00th=[ 635], 40.00th=[ 2540], 50.00th=[ 2540], 60.00th=[141558], | 70.00th=[160433], 80.00th=[160433], 90.00th=[526386], 95.00th=[526386], | 99.00th=[526386], 99.50th=[526386], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 4055, max= 6107, per=100.00%, avg=5081.00, stdev=1450.98, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=0, BW=1016KiB/s (1040kB/s)(6144KiB/6050msec); 0 zone resets clat (msec): min=194, max=3516, avg=838.34, stdev=1314.46 lat (msec): min=194, max=3516, avg=838.42, stdev=1314.48 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 351], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1721, max= 4055, per=63.78%, avg=2462.50, stdev=1072.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=5.27%, ctx=167, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144932: Tue Sep 29 11:14:47 2026 read: IOPS=0, BW=700KiB/s (717kB/s)(5120KiB/7315msec) clat (usec): min=555, max=388928, avg=189519.31, stdev=142900.58 lat (usec): min=556, max=388929, avg=189520.62, stdev=142900.61 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 553], | 30.00th=[145753], 40.00th=[145753], 50.00th=[162530], 60.00th=[162530], | 70.00th=[248513], 80.00th=[248513], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 2011, max= 6107, per=100.00%, avg=4059.00, stdev=2896.31, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=980KiB/s (1003kB/s)(7168KiB/7315msec); 0 zone resets clat (msec): min=196, max=3016, avg=897.68, stdev=957.38 lat (msec): min=196, max=3016, avg=897.75, stdev=957.37 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 443], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 592], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 802], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1617, max= 4087, per=59.43%, avg=2294.67, stdev=892.47, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.56%, ctx=132, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2758KiB/s (2824kB/s), 276KiB/s-1391KiB/s (282kB/s-1424kB/s), io=20.0MiB (20.0MB), run=5154-7425msec WRITE: bw=3862KiB/s (3954kB/s), 980KiB/s-1379KiB/s (1003kB/s-1412kB/s), io=28.0MiB (29.4MB), run=5154-7425msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144925: Tue Sep 29 11:14:47 2026 read: IOPS=1, BW=1097KiB/s (1123kB/s)(7168KiB/6536msec) clat (msec): min=86, max=3124, avg=617.48, stdev=1108.00 lat (msec): min=86, max=3124, avg=617.48, stdev=1108.00 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 134], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 222], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 317], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1505, max= 4063, per=100.00%, avg=2805.25, stdev=1228.34, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=783KiB/s (802kB/s)(5120KiB/6536msec); 0 zone resets clat (msec): min=189, max=667, avg=399.72, stdev=189.21 lat (msec): min=189, max=667, avg=399.88, stdev=189.24 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 342], 60.00th=[ 342], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2031, max= 4055, per=71.88%, avg=2707.00, stdev=1167.40, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=1.87%, ctx=70, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144926: Tue Sep 29 11:14:47 2026 read: IOPS=0, BW=277KiB/s (284kB/s)(2048KiB/7394msec) clat (msec): min=86, max=178, avg=132.42, stdev=65.49 lat (msec): min=86, max=178, avg=132.42, stdev=65.49 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1499, max= 2027, per=65.54%, avg=1763.00, stdev=373.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1385KiB/s (1418kB/s)(10.0MiB/7394msec); 0 zone resets clat (msec): min=183, max=3067, avg=695.75, stdev=882.98 lat (msec): min=183, max=3067, avg=695.85, stdev=882.99 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 236], | 30.00th=[ 288], 40.00th=[ 321], 50.00th=[ 355], 60.00th=[ 368], | 70.00th=[ 430], 80.00th=[ 498], 90.00th=[ 1217], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1954, max= 4063, per=68.77%, avg=2589.71, stdev=987.83, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=1.74%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144927: Tue Sep 29 11:14:47 2026 read: IOPS=0, BW=807KiB/s (827kB/s)(6144KiB/7612msec) clat (msec): min=101, max=675, avg=314.37, stdev=215.21 lat (msec): min=101, max=675, avg=314.37, stdev=215.21 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 305], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1954, max= 4071, per=100.00%, avg=3214.33, stdev=1114.73, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=807KiB/s (827kB/s)(6144KiB/7612msec); 0 zone resets clat (msec): min=316, max=3272, avg=934.13, stdev=1153.53 lat (msec): min=316, max=3272, avg=934.38, stdev=1153.46 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 527], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1469, max= 2048, per=50.96%, avg=1919.33, stdev=222.90, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=25.00%, >=2000=8.33% cpu : usr=0.03%, sys=2.00%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144928: Tue Sep 29 11:14:47 2026 read: IOPS=0, BW=722KiB/s (739kB/s)(5120KiB/7094msec) clat (msec): min=108, max=360, avg=204.97, stdev=110.67 lat (msec): min=108, max=360, avg=204.97, stdev=110.67 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 155], 60.00th=[ 155], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2011, max= 6083, per=100.00%, avg=4047.00, stdev=2879.34, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=1010KiB/s (1035kB/s)(7168KiB/7094msec); 0 zone resets clat (msec): min=284, max=3018, avg=864.60, stdev=969.46 lat (msec): min=284, max=3018, avg=864.86, stdev=969.44 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 326], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 584], 60.00th=[ 743], | 70.00th=[ 743], 80.00th=[ 751], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1494, max= 4007, per=60.39%, avg=2274.40, stdev=993.23, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=2.11%, ctx=109, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2690KiB/s (2755kB/s), 277KiB/s-1097KiB/s (284kB/s-1123kB/s), io=20.0MiB (20.0MB), run=6536-7612msec WRITE: bw=3767KiB/s (3857kB/s), 783KiB/s-1385KiB/s (802kB/s-1418kB/s), io=28.0MiB (29.4MB), run=6536-7612msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144943: Tue Sep 29 11:15:06 2026 read: IOPS=0, BW=3580KiB/s (3666kB/s)(12.0MiB/3432msec) clat (msec): min=781, max=1260, avg=1064.89, stdev=251.36 lat (msec): min=781, max=1260, avg=1064.91, stdev=251.37 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7262, max= 7922, per=100.00%, avg=7592.00, stdev=466.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.73%, ctx=440, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144945: Tue Sep 29 11:15:06 2026 read: IOPS=0, BW=846KiB/s (867kB/s)(4096KiB/4839msec) clat (nsec): min=1466.8M, max=1466.8M, avg=1466825701.00, stdev= 0.00 lat (nsec): min=1466.8M, max=1466.8M, avg=1466828106.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1469], 5.00th=[ 1469], 10.00th=[ 1469], 20.00th=[ 1469], | 30.00th=[ 1469], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1693KiB/s (1734kB/s)(8192KiB/4839msec); 0 zone resets clat (msec): min=1360, max=1918, avg=1639.88, stdev=394.42 lat (msec): min=1361, max=1919, avg=1640.56, stdev=394.59 clat percentiles (msec): | 1.00th=[ 1368], 5.00th=[ 1368], 10.00th=[ 1368], 20.00th=[ 1368], | 30.00th=[ 1368], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1921], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=3.27%, ctx=208, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144947: Tue Sep 29 11:15:06 2026 write: IOPS=0, BW=2697KiB/s (2762kB/s)(12.0MiB/4556msec); 0 zone resets clat (msec): min=1215, max=1757, avg=1440.45, stdev=282.34 lat (msec): min=1216, max=1757, avg=1440.97, stdev=282.30 clat percentiles (msec): | 1.00th=[ 1217], 5.00th=[ 1217], 10.00th=[ 1217], 20.00th=[ 1217], | 30.00th=[ 1217], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 7984, max= 8110, per=100.00%, avg=8047.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=5.29%, ctx=99, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144948: Tue Sep 29 11:15:06 2026 write: IOPS=0, BW=2720KiB/s (2786kB/s)(12.0MiB/4517msec); 0 zone resets clat (msec): min=475, max=2298, avg=1425.14, stdev=914.00 lat (msec): min=476, max=2299, avg=1425.69, stdev=914.03 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7922, max= 8143, per=100.00%, avg=8032.50, stdev=156.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.34%, ctx=75, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3386KiB/s (3467kB/s), 846KiB/s-3580KiB/s (867kB/s-3666kB/s), io=16.0MiB (16.8MB), run=3432-4839msec WRITE: bw=6772KiB/s (6934kB/s), 1693KiB/s-2720KiB/s (1734kB/s-2786kB/s), io=32.0MiB (33.6MB), run=4517-4839msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Tue Sep 29 11:15:06 2026 read: IOPS=0, BW=2569KiB/s (2631kB/s)(12.0MiB/4783msec) clat (msec): min=355, max=2273, avg=1540.56, stdev=1035.79 lat (msec): min=355, max=2273, avg=1540.56, stdev=1035.79 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 1989], 50.00th=[ 1989], 60.00th=[ 1989], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 7846, max= 8126, per=100.00%, avg=7986.00, stdev=197.99, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.55%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Tue Sep 29 11:15:06 2026 read: IOPS=0, BW=795KiB/s (814kB/s)(4096KiB/5154msec) clat (nsec): min=2103.4M, max=2103.4M, avg=2103370253.00, stdev= 0.00 lat (nsec): min=2104.1M, max=2104.1M, avg=2104086173.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2106], 5.00th=[ 2106], 10.00th=[ 2106], 20.00th=[ 2106], | 30.00th=[ 2106], 40.00th=[ 2106], 50.00th=[ 2106], 60.00th=[ 2106], | 70.00th=[ 2106], 80.00th=[ 2106], 90.00th=[ 2106], 95.00th=[ 2106], | 99.00th=[ 2106], 99.50th=[ 2106], 99.90th=[ 2106], 99.95th=[ 2106], | 99.99th=[ 2106] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1589KiB/s (1628kB/s)(8192KiB/5154msec); 0 zone resets clat (msec): min=947, max=1965, avg=1456.37, stdev=720.15 lat (msec): min=947, max=1967, avg=1457.51, stdev=720.79 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 1972], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.50%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144944: Tue Sep 29 11:15:06 2026 write: IOPS=1, BW=4793KiB/s (4908kB/s)(12.0MiB/2564msec); 0 zone resets clat (msec): min=411, max=1654, avg=834.67, stdev=709.73 lat (msec): min=411, max=1655, avg=836.15, stdev=709.35 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7249, max= 7742, per=100.00%, avg=7495.50, stdev=348.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.94%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144946: Tue Sep 29 11:15:06 2026 write: IOPS=0, BW=3933KiB/s (4028kB/s)(12.0MiB/3124msec); 0 zone resets clat (msec): min=459, max=1559, avg=932.47, stdev=565.90 lat (msec): min=459, max=1559, avg=932.86, stdev=565.90 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7772, max= 8159, per=100.00%, avg=7965.50, stdev=273.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.67%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3179KiB/s (3255kB/s), 795KiB/s-2569KiB/s (814kB/s-2631kB/s), io=16.0MiB (16.8MB), run=4783-5154msec WRITE: bw=6358KiB/s (6510kB/s), 1589KiB/s-4793KiB/s (1628kB/s-4908kB/s), io=32.0MiB (33.6MB), run=2564-5154msec