== sanity test 398b: DIO and buffer IO race ============== 19:38:30 (1786405110) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.40287 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177779: Mon Aug 10 19:41:53 2026 read: IOPS=8, BW=32.3KiB/s (33.1kB/s)(5992KiB/185453msec) clat (usec): min=37, max=779284, avg=70361.86, stdev=54591.90 lat (usec): min=38, max=779285, avg=70368.99, stdev=54590.17 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 17171], 10.00th=[ 23200], 20.00th=[ 32375], | 30.00th=[ 39584], 40.00th=[ 47973], 50.00th=[ 57934], 60.00th=[ 68682], | 70.00th=[ 81265], 80.00th=[ 99091], 90.00th=[131597], 95.00th=[164627], | 99.00th=[240124], 99.50th=[274727], 99.90th=[608175], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 5, max= 72, per=25.09%, avg=32.36, stdev=14.21, samples=355 iops : min= 1, max= 18, avg= 7.46, stdev= 3.58, samples=355 write: IOPS=8, BW=33.9KiB/s (34.8kB/s)(6296KiB/185453msec); 0 zone resets clat (usec): min=1193, max=579898, avg=50645.57, stdev=53962.86 lat (usec): min=1193, max=579900, avg=50654.95, stdev=53961.08 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1795], 10.00th=[ 2573], 20.00th=[ 5276], | 30.00th=[ 14615], 40.00th=[ 25297], 50.00th=[ 35914], 60.00th=[ 47449], | 70.00th=[ 63177], 80.00th=[ 86508], 90.00th=[121111], 95.00th=[149947], | 99.00th=[235930], 99.50th=[283116], 99.90th=[442500], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 7, max= 111, per=25.30%, avg=34.16, stdev=17.87, samples=353 iops : min= 1, max= 27, avg= 7.91, stdev= 4.52, samples=353 lat (usec) : 50=0.26%, 100=0.81%, 250=0.13%, 500=0.07%, 750=0.03% lat (msec) : 2=3.61%, 4=4.88%, 10=5.05%, 20=6.84%, 50=30.57% lat (msec) : 100=30.40%, 250=16.60%, 500=0.65%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=3.87%, ctx=7060, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177780: Mon Aug 10 19:41:53 2026 read: IOPS=8, BW=32.2KiB/s (32.9kB/s)(5940KiB/184627msec) clat (usec): min=45, max=895212, avg=70880.95, stdev=53254.35 lat (usec): min=46, max=895214, avg=70884.74, stdev=53253.41 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 18744], 10.00th=[ 24249], 20.00th=[ 34341], | 30.00th=[ 42206], 40.00th=[ 49546], 50.00th=[ 60031], 60.00th=[ 69731], | 70.00th=[ 81265], 80.00th=[ 96994], 90.00th=[129500], 95.00th=[162530], | 99.00th=[248513], 99.50th=[316670], 99.90th=[455082], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 5, max= 78, per=24.87%, avg=32.08, stdev=15.01, samples=354 iops : min= 1, max= 19, avg= 7.38, stdev= 3.80, samples=354 write: IOPS=8, BW=34.4KiB/s (35.2kB/s)(6348KiB/184627msec); 0 zone resets clat (usec): min=1010, max=555195, avg=49734.05, stdev=54832.54 lat (usec): min=1011, max=555198, avg=49739.38, stdev=54832.82 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 2024], 10.00th=[ 2868], 20.00th=[ 5866], | 30.00th=[ 12518], 40.00th=[ 22938], 50.00th=[ 33162], 60.00th=[ 44827], | 70.00th=[ 62653], 80.00th=[ 85459], 90.00th=[119014], 95.00th=[152044], | 99.00th=[242222], 99.50th=[278922], 99.90th=[534774], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 5, max= 88, per=25.31%, avg=34.16, stdev=17.82, samples=355 iops : min= 1, max= 22, avg= 7.92, stdev= 4.51, samples=355 lat (usec) : 50=0.07%, 100=0.75%, 250=0.16%, 500=0.07% lat (msec) : 2=2.54%, 4=5.21%, 10=6.48%, 20=6.93%, 50=30.21% lat (msec) : 100=30.47%, 250=16.18%, 500=0.85%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=3.89%, ctx=7092, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177781: Mon Aug 10 19:41:53 2026 read: IOPS=8, BW=33.4KiB/s (34.2kB/s)(6028KiB/180388msec) clat (usec): min=34, max=665004, avg=68021.15, stdev=51952.37 lat (usec): min=35, max=665005, avg=68024.11, stdev=51952.53 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 15401], 10.00th=[ 22152], 20.00th=[ 31065], | 30.00th=[ 39060], 40.00th=[ 47449], 50.00th=[ 55837], 60.00th=[ 65799], | 70.00th=[ 79168], 80.00th=[ 98042], 90.00th=[127402], 95.00th=[158335], | 99.00th=[263193], 99.50th=[333448], 99.90th=[375391], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 5, max= 100, per=25.95%, avg=33.48, stdev=16.16, samples=345 iops : min= 1, max= 25, avg= 7.73, stdev= 4.09, samples=345 write: IOPS=8, BW=34.7KiB/s (35.5kB/s)(6260KiB/180388msec); 0 zone resets clat (usec): min=1075, max=916111, avg=49639.53, stdev=58762.24 lat (usec): min=1077, max=916114, avg=49644.07, stdev=58773.47 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1860], 10.00th=[ 2638], 20.00th=[ 5145], | 30.00th=[ 11338], 40.00th=[ 22676], 50.00th=[ 32113], 60.00th=[ 44303], | 70.00th=[ 60031], 80.00th=[ 84411], 90.00th=[117965], 95.00th=[156238], | 99.00th=[244319], 99.50th=[278922], 99.90th=[463471], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 6, max= 117, per=25.54%, avg=34.48, stdev=17.43, samples=347 iops : min= 1, max= 29, avg= 8.00, stdev= 4.43, samples=347 lat (usec) : 50=0.20%, 100=1.20%, 250=0.07%, 500=0.03% lat (msec) : 2=3.19%, 4=5.34%, 10=6.48%, 20=6.71%, 50=30.79% lat (msec) : 100=29.17%, 250=15.82%, 500=0.94%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=3.71%, ctx=6853, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177782: Mon Aug 10 19:41:53 2026 read: IOPS=8, BW=32.6KiB/s (33.4kB/s)(6052KiB/185386msec) clat (usec): min=41, max=472878, avg=67272.96, stdev=48872.31 lat (usec): min=41, max=472878, avg=67274.32, stdev=48872.14 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 14353], 10.00th=[ 22152], 20.00th=[ 30278], | 30.00th=[ 38536], 40.00th=[ 46924], 50.00th=[ 55837], 60.00th=[ 67634], | 70.00th=[ 81265], 80.00th=[ 98042], 90.00th=[123208], 95.00th=[160433], | 99.00th=[233833], 99.50th=[278922], 99.90th=[429917], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 85, per=25.32%, avg=32.66, stdev=14.80, samples=355 iops : min= 1, max= 21, avg= 7.53, stdev= 3.75, samples=355 write: IOPS=8, BW=33.6KiB/s (34.4kB/s)(6236KiB/185386msec); 0 zone resets clat (usec): min=1214, max=922298, avg=53488.46, stdev=62161.88 lat (usec): min=1216, max=922299, avg=53493.71, stdev=62161.56 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1958], 10.00th=[ 2769], 20.00th=[ 5669], | 30.00th=[ 13173], 40.00th=[ 23987], 50.00th=[ 35914], 60.00th=[ 49021], | 70.00th=[ 68682], 80.00th=[ 88605], 90.00th=[126354], 95.00th=[160433], | 99.00th=[274727], 99.50th=[350225], 99.90th=[463471], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 5, max= 102, per=25.22%, avg=34.04, stdev=17.83, samples=351 iops : min= 1, max= 25, avg= 7.88, stdev= 4.50, samples=351 lat (usec) : 50=0.20%, 100=1.27%, 250=0.13%, 500=0.03%, 1000=0.03% lat (msec) : 2=2.64%, 4=5.01%, 10=6.09%, 20=7.26%, 50=29.69% lat (msec) : 100=30.08%, 250=16.50%, 500=1.04%, 1000=0.03% cpu : usr=0.05%, sys=3.70%, ctx=7053, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=129KiB/s (133kB/s), 32.2KiB/s-33.4KiB/s (32.9kB/s-34.2kB/s), io=23.4MiB (24.6MB), run=180388-185453msec WRITE: bw=136KiB/s (139kB/s), 33.6KiB/s-34.7KiB/s (34.4kB/s-35.5kB/s), io=24.6MiB (25.7MB), run=180388-185453msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177774: Mon Aug 10 19:42:39 2026 read: IOPS=6, BW=25.8KiB/s (26.4kB/s)(5992KiB/232246msec) clat (msec): min=4, max=1188, avg=65.02, stdev=75.60 lat (msec): min=4, max=1188, avg=65.03, stdev=75.60 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 50], | 70.00th=[ 68], 80.00th=[ 96], 90.00th=[ 150], 95.00th=[ 197], | 99.00th=[ 363], 99.50th=[ 468], 99.90th=[ 810], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 103, per=25.98%, avg=26.76, stdev=20.66, samples=424 iops : min= 1, max= 25, avg= 6.04, stdev= 5.22, samples=424 write: IOPS=6, BW=27.1KiB/s (27.8kB/s)(6296KiB/232246msec); 0 zone resets clat (msec): min=10, max=798, avg=85.30, stdev=70.62 lat (msec): min=10, max=798, avg=85.31, stdev=70.62 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 61], 60.00th=[ 79], | 70.00th=[ 102], 80.00th=[ 133], 90.00th=[ 176], 95.00th=[ 218], | 99.00th=[ 338], 99.50th=[ 376], 99.90th=[ 535], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 5, max= 120, per=25.81%, avg=27.88, stdev=20.11, samples=428 iops : min= 1, max= 30, avg= 6.33, stdev= 5.11, samples=428 lat (msec) : 10=1.01%, 20=10.25%, 50=39.94%, 100=23.93%, 250=22.01% lat (msec) : 500=2.64%, 750=0.13%, 1000=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.76%, ctx=5132, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177775: Mon Aug 10 19:42:39 2026 read: IOPS=6, BW=25.7KiB/s (26.3kB/s)(5940KiB/231388msec) clat (msec): min=5, max=1302, avg=62.21, stdev=70.08 lat (msec): min=5, max=1302, avg=62.22, stdev=70.08 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 49], | 70.00th=[ 65], 80.00th=[ 88], 90.00th=[ 138], 95.00th=[ 186], | 99.00th=[ 292], 99.50th=[ 355], 99.90th=[ 810], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 5, max= 119, per=26.58%, avg=27.38, stdev=20.33, samples=415 iops : min= 1, max= 29, avg= 6.20, stdev= 5.15, samples=415 write: IOPS=6, BW=27.4KiB/s (28.1kB/s)(6348KiB/231388msec); 0 zone resets clat (msec): min=10, max=809, avg=87.25, stdev=73.66 lat (msec): min=10, max=809, avg=87.25, stdev=73.66 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 81], | 70.00th=[ 101], 80.00th=[ 131], 90.00th=[ 180], 95.00th=[ 232], | 99.00th=[ 330], 99.50th=[ 380], 99.90th=[ 600], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 5, max= 111, per=25.94%, avg=28.02, stdev=18.90, samples=434 iops : min= 1, max= 27, avg= 6.35, stdev= 4.79, samples=434 lat (msec) : 10=0.68%, 20=9.83%, 50=39.19%, 100=26.37%, 250=21.03% lat (msec) : 500=2.70%, 750=0.10%, 1000=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.89%, ctx=5076, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177776: Mon Aug 10 19:42:39 2026 read: IOPS=6, BW=26.0KiB/s (26.6kB/s)(6028KiB/231678msec) clat (msec): min=5, max=596, avg=63.71, stdev=64.18 lat (msec): min=5, max=596, avg=63.72, stdev=64.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 50], | 70.00th=[ 68], 80.00th=[ 95], 90.00th=[ 144], 95.00th=[ 201], | 99.00th=[ 300], 99.50th=[ 351], 99.90th=[ 542], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 5, max= 119, per=26.79%, avg=27.59, stdev=20.54, samples=416 iops : min= 1, max= 29, avg= 6.25, stdev= 5.19, samples=416 write: IOPS=6, BW=27.0KiB/s (27.7kB/s)(6260KiB/231678msec); 0 zone resets clat (msec): min=10, max=1318, avg=86.27, stdev=79.53 lat (msec): min=10, max=1318, avg=86.27, stdev=79.53 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 61], 60.00th=[ 77], | 70.00th=[ 96], 80.00th=[ 129], 90.00th=[ 178], 95.00th=[ 234], | 99.00th=[ 372], 99.50th=[ 430], 99.90th=[ 617], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 5, max= 119, per=25.71%, avg=27.77, stdev=19.74, samples=429 iops : min= 1, max= 29, avg= 6.29, stdev= 5.00, samples=429 lat (msec) : 10=0.91%, 20=8.82%, 50=40.72%, 100=25.62%, 250=20.51% lat (msec) : 500=3.26%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.76%, ctx=5050, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177777: Mon Aug 10 19:42:39 2026 read: IOPS=6, BW=26.1KiB/s (26.7kB/s)(6052KiB/231677msec) clat (msec): min=5, max=559, avg=62.25, stdev=61.47 lat (msec): min=5, max=559, avg=62.26, stdev=61.47 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 66], 80.00th=[ 97], 90.00th=[ 144], 95.00th=[ 188], | 99.00th=[ 288], 99.50th=[ 347], 99.90th=[ 477], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 143, per=26.97%, avg=27.78, stdev=20.57, samples=414 iops : min= 1, max= 35, avg= 6.30, stdev= 5.20, samples=414 write: IOPS=6, BW=26.9KiB/s (27.6kB/s)(6236KiB/231677msec); 0 zone resets clat (msec): min=12, max=1326, avg=87.78, stdev=81.48 lat (msec): min=12, max=1326, avg=87.78, stdev=81.48 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 50], 50.00th=[ 61], 60.00th=[ 78], | 70.00th=[ 100], 80.00th=[ 128], 90.00th=[ 184], 95.00th=[ 241], | 99.00th=[ 359], 99.50th=[ 485], 99.90th=[ 651], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 5, max= 95, per=25.41%, avg=27.44, stdev=19.05, samples=432 iops : min= 1, max= 23, avg= 6.21, stdev= 4.83, samples=432 lat (msec) : 10=0.85%, 20=9.70%, 50=40.43%, 100=24.64%, 250=21.55% lat (msec) : 500=2.57%, 750=0.23%, 2000=0.03% cpu : usr=0.04%, sys=1.76%, ctx=4960, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=103KiB/s (106kB/s), 25.7KiB/s-26.1KiB/s (26.3kB/s-26.7kB/s), io=23.4MiB (24.6MB), run=231388-232246msec WRITE: bw=108KiB/s (111kB/s), 26.9KiB/s-27.4KiB/s (27.6kB/s-28.1kB/s), io=24.6MiB (25.7MB), run=231388-232246msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177837: Mon Aug 10 19:43:44 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(5920KiB/56814msec) clat (usec): min=39, max=395614, avg=80991.01, stdev=64521.76 lat (usec): min=40, max=395615, avg=80992.23, stdev=64521.79 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 17433], 20.00th=[ 31851], | 30.00th=[ 43254], 40.00th=[ 54789], 50.00th=[ 66323], 60.00th=[ 79168], | 70.00th=[ 98042], 80.00th=[126354], 90.00th=[152044], 95.00th=[202376], | 99.00th=[325059], 99.50th=[358613], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 31, max= 376, per=25.14%, avg=105.82, stdev=61.76, samples=108 iops : min= 1, max= 23, avg= 5.85, stdev= 3.92, samples=108 write: IOPS=7, BW=112KiB/s (115kB/s)(6368KiB/56814msec); 0 zone resets clat (usec): min=1671, max=336136, avg=65426.26, stdev=64539.46 lat (usec): min=1673, max=336138, avg=65435.62, stdev=64547.57 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2769], 10.00th=[ 4228], 20.00th=[ 9372], | 30.00th=[ 19006], 40.00th=[ 32900], 50.00th=[ 43254], 60.00th=[ 62129], | 70.00th=[ 83362], 80.00th=[111674], 90.00th=[158335], 95.00th=[198181], | 99.00th=[295699], 99.50th=[320865], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 29, max= 376, per=26.00%, avg=115.19, stdev=66.93, samples=107 iops : min= 1, max= 23, avg= 6.45, stdev= 4.26, samples=107 lat (usec) : 50=0.26%, 100=3.26%, 250=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=4.17%, 10=6.25%, 20=6.12%, 50=24.74% lat (msec) : 100=27.47%, 250=24.48%, 500=2.21% cpu : usr=0.03%, sys=3.32%, ctx=1781, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177838: Mon Aug 10 19:43:44 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(5744KiB/55194msec) clat (usec): min=39, max=432632, avg=82264.59, stdev=61591.66 lat (usec): min=39, max=432633, avg=82295.92, stdev=61587.68 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 27395], 20.00th=[ 39060], | 30.00th=[ 47973], 40.00th=[ 54789], 50.00th=[ 66847], 60.00th=[ 80217], | 70.00th=[ 94897], 80.00th=[122160], 90.00th=[160433], 95.00th=[210764], | 99.00th=[295699], 99.50th=[329253], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 30, max= 286, per=25.52%, avg=107.42, stdev=57.52, samples=102 iops : min= 1, max= 17, avg= 5.96, stdev= 3.70, samples=102 write: IOPS=7, BW=119KiB/s (121kB/s)(6544KiB/55194msec); 0 zone resets clat (usec): min=1841, max=453343, avg=61000.75, stdev=63790.24 lat (usec): min=1844, max=453346, avg=61003.65, stdev=63790.82 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 2606], 10.00th=[ 3359], 20.00th=[ 9372], | 30.00th=[ 17695], 40.00th=[ 28181], 50.00th=[ 43779], 60.00th=[ 60031], | 70.00th=[ 74974], 80.00th=[104334], 90.00th=[143655], 95.00th=[168821], | 99.00th=[283116], 99.50th=[337642], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 29, max= 285, per=27.38%, avg=121.29, stdev=59.40, samples=103 iops : min= 1, max= 17, avg= 6.83, stdev= 3.76, samples=103 lat (usec) : 50=0.13%, 100=2.73%, 250=0.13% lat (msec) : 2=0.65%, 4=5.34%, 10=5.47%, 20=5.34%, 50=23.83% lat (msec) : 100=32.55%, 250=21.74%, 500=2.08% cpu : usr=0.04%, sys=3.36%, ctx=1632, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177839: Mon Aug 10 19:43:44 2026 read: IOPS=6, BW=112KiB/s (115kB/s)(6256KiB/55894msec) clat (usec): min=40, max=477079, avg=81734.66, stdev=64235.52 lat (usec): min=40, max=477080, avg=81735.85, stdev=64235.56 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 1401], 20.00th=[ 35390], | 30.00th=[ 47973], 40.00th=[ 59507], 50.00th=[ 69731], 60.00th=[ 80217], | 70.00th=[102237], 80.00th=[122160], 90.00th=[152044], 95.00th=[189793], | 99.00th=[367002], 99.50th=[425722], 99.90th=[476054], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 24, max= 253, per=27.64%, avg=116.38, stdev=53.38, samples=104 iops : min= 1, max= 15, avg= 6.52, stdev= 3.40, samples=104 write: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55894msec); 0 zone resets clat (usec): min=1822, max=413518, avg=61905.67, stdev=63559.25 lat (usec): min=1834, max=413520, avg=61913.26, stdev=63555.94 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 5], 20.00th=[ 10], | 30.00th=[ 18], 40.00th=[ 29], 50.00th=[ 45], 60.00th=[ 59], | 70.00th=[ 78], 80.00th=[ 102], 90.00th=[ 153], 95.00th=[ 194], | 99.00th=[ 284], 99.50th=[ 288], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 28, max= 252, per=24.45%, avg=108.33, stdev=59.18, samples=106 iops : min= 1, max= 15, avg= 6.01, stdev= 3.77, samples=106 lat (usec) : 50=0.52%, 100=3.91%, 250=0.39%, 1000=0.13% lat (msec) : 2=0.91%, 4=4.17%, 10=5.73%, 20=6.77%, 50=20.31% lat (msec) : 100=31.25%, 250=23.70%, 500=2.21% cpu : usr=0.03%, sys=2.85%, ctx=1679, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177840: Mon Aug 10 19:43:44 2026 read: IOPS=6, BW=110KiB/s (113kB/s)(6032KiB/54754msec) clat (usec): min=46, max=448209, avg=75811.77, stdev=57645.18 lat (usec): min=47, max=448210, avg=75816.63, stdev=57642.74 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 63], 10.00th=[ 135], 20.00th=[ 33162], | 30.00th=[ 45876], 40.00th=[ 58459], 50.00th=[ 66323], 60.00th=[ 76022], | 70.00th=[ 89654], 80.00th=[107480], 90.00th=[143655], 95.00th=[185598], | 99.00th=[270533], 99.50th=[304088], 99.90th=[446694], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 30, max= 283, per=27.76%, avg=116.86, stdev=56.99, samples=100 iops : min= 1, max= 17, avg= 6.55, stdev= 3.62, samples=100 write: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54754msec); 0 zone resets clat (usec): min=1746, max=362637, avg=66409.18, stdev=69408.90 lat (usec): min=1748, max=362639, avg=66421.84, stdev=69401.57 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2507], 10.00th=[ 3523], 20.00th=[ 6915], | 30.00th=[ 16909], 40.00th=[ 31065], 50.00th=[ 45351], 60.00th=[ 62129], | 70.00th=[ 84411], 80.00th=[120062], 90.00th=[164627], 95.00th=[212861], | 99.00th=[312476], 99.50th=[316670], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 28, max= 346, per=26.34%, avg=116.68, stdev=58.56, samples=104 iops : min= 1, max= 21, avg= 6.53, stdev= 3.73, samples=104 lat (usec) : 50=0.52%, 100=4.17%, 250=0.39%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.43%, 4=4.56%, 10=6.51%, 20=4.69%, 50=20.57% lat (msec) : 100=32.81%, 250=21.35%, 500=2.60% cpu : usr=0.03%, sys=3.05%, ctx=1621, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=422KiB/s (432kB/s), 104KiB/s-112KiB/s (107kB/s-115kB/s), io=23.4MiB (24.5MB), run=54754-56814msec WRITE: bw=444KiB/s (454kB/s), 108KiB/s-119KiB/s (111kB/s-121kB/s), io=24.6MiB (25.8MB), run=54754-56814msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177833: Mon Aug 10 19:44:04 2026 read: IOPS=4, BW=77.7KiB/s (79.5kB/s)(5920KiB/76229msec) clat (msec): min=7, max=588, avg=85.31, stdev=85.00 lat (msec): min=7, max=588, avg=85.31, stdev=85.00 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 20], 10.00th=[ 26], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 52], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 86], 80.00th=[ 112], 90.00th=[ 163], 95.00th=[ 243], | 99.00th=[ 468], 99.50th=[ 502], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 25, max= 244, per=27.14%, avg=84.68, stdev=47.76, samples=134 iops : min= 1, max= 15, avg= 4.50, stdev= 3.08, samples=134 write: IOPS=5, BW=83.5KiB/s (85.5kB/s)(6368KiB/76229msec); 0 zone resets clat (msec): min=13, max=476, avg=111.98, stdev=79.06 lat (msec): min=13, max=476, avg=111.98, stdev=79.06 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 32], 10.00th=[ 40], 20.00th=[ 51], | 30.00th=[ 60], 40.00th=[ 73], 50.00th=[ 87], 60.00th=[ 109], | 70.00th=[ 133], 80.00th=[ 165], 90.00th=[ 218], 95.00th=[ 271], | 99.00th=[ 405], 99.50th=[ 472], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 25, max= 253, per=26.36%, avg=86.71, stdev=49.22, samples=141 iops : min= 1, max= 15, avg= 4.64, stdev= 3.12, samples=141 lat (msec) : 10=0.13%, 20=2.86%, 50=25.52%, 100=37.11%, 250=28.39% lat (msec) : 500=5.73%, 750=0.26% cpu : usr=0.03%, sys=1.28%, ctx=1303, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177834: Mon Aug 10 19:44:04 2026 read: IOPS=4, BW=75.0KiB/s (76.8kB/s)(5744KiB/76578msec) clat (msec): min=9, max=588, avg=82.37, stdev=74.30 lat (msec): min=9, max=588, avg=82.38, stdev=74.30 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 26], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 114], 90.00th=[ 171], 95.00th=[ 241], | 99.00th=[ 414], 99.50th=[ 472], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 21, max= 317, per=27.32%, avg=85.25, stdev=56.44, samples=131 iops : min= 1, max= 19, avg= 4.54, stdev= 3.55, samples=131 write: IOPS=5, BW=85.5KiB/s (87.5kB/s)(6544KiB/76578msec); 0 zone resets clat (msec): min=19, max=694, avg=114.42, stdev=95.19 lat (msec): min=19, max=694, avg=114.42, stdev=95.19 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 36], 20.00th=[ 47], | 30.00th=[ 59], 40.00th=[ 70], 50.00th=[ 86], 60.00th=[ 106], | 70.00th=[ 127], 80.00th=[ 161], 90.00th=[ 220], 95.00th=[ 296], | 99.00th=[ 527], 99.50th=[ 542], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 28, max= 364, per=27.39%, avg=90.12, stdev=51.45, samples=140 iops : min= 1, max= 22, avg= 4.86, stdev= 3.30, samples=140 lat (msec) : 10=0.13%, 20=3.26%, 50=28.52%, 100=33.59%, 250=27.99% lat (msec) : 500=5.60%, 750=0.91% cpu : usr=0.03%, sys=1.29%, ctx=1297, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177835: Mon Aug 10 19:44:04 2026 read: IOPS=5, BW=81.8KiB/s (83.8kB/s)(6256KiB/76453msec) clat (msec): min=7, max=463, avg=83.97, stdev=73.07 lat (msec): min=7, max=463, avg=83.98, stdev=73.07 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 18], 10.00th=[ 24], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 60], 60.00th=[ 73], | 70.00th=[ 93], 80.00th=[ 123], 90.00th=[ 180], 95.00th=[ 234], | 99.00th=[ 401], 99.50th=[ 426], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 25, max= 288, per=29.21%, avg=91.14, stdev=58.08, samples=132 iops : min= 1, max= 18, avg= 4.91, stdev= 3.72, samples=132 write: IOPS=4, BW=78.9KiB/s (80.8kB/s)(6032KiB/76453msec); 0 zone resets clat (msec): min=16, max=547, avg=115.11, stdev=85.16 lat (msec): min=16, max=547, avg=115.12, stdev=85.16 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 33], 10.00th=[ 41], 20.00th=[ 48], | 30.00th=[ 58], 40.00th=[ 71], 50.00th=[ 92], 60.00th=[ 113], | 70.00th=[ 138], 80.00th=[ 165], 90.00th=[ 226], 95.00th=[ 288], | 99.00th=[ 447], 99.50th=[ 460], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 25, max= 253, per=25.03%, avg=82.35, stdev=47.82, samples=139 iops : min= 1, max= 15, avg= 4.37, stdev= 3.04, samples=139 lat (msec) : 10=0.39%, 20=3.12%, 50=29.17%, 100=31.38%, 250=30.21% lat (msec) : 500=5.60%, 750=0.13% cpu : usr=0.03%, sys=1.46%, ctx=1346, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177836: Mon Aug 10 19:44:04 2026 read: IOPS=4, BW=78.8KiB/s (80.7kB/s)(6032KiB/76532msec) clat (msec): min=7, max=513, avg=82.34, stdev=73.15 lat (msec): min=7, max=513, avg=82.34, stdev=73.15 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 60], 60.00th=[ 71], | 70.00th=[ 89], 80.00th=[ 114], 90.00th=[ 180], 95.00th=[ 239], | 99.00th=[ 372], 99.50th=[ 464], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 29, max= 285, per=27.94%, avg=87.18, stdev=52.16, samples=131 iops : min= 1, max= 17, avg= 4.67, stdev= 3.34, samples=131 write: IOPS=5, BW=81.7KiB/s (83.7kB/s)(6256KiB/76532msec); 0 zone resets clat (msec): min=17, max=639, avg=114.58, stdev=88.79 lat (msec): min=17, max=639, avg=114.59, stdev=88.79 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 36], 20.00th=[ 48], | 30.00th=[ 58], 40.00th=[ 71], 50.00th=[ 89], 60.00th=[ 109], | 70.00th=[ 131], 80.00th=[ 167], 90.00th=[ 226], 95.00th=[ 284], | 99.00th=[ 426], 99.50th=[ 558], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 25, max= 333, per=26.66%, avg=87.71, stdev=53.61, samples=136 iops : min= 1, max= 20, avg= 4.69, stdev= 3.40, samples=136 lat (msec) : 10=0.26%, 20=3.65%, 50=27.47%, 100=34.64%, 250=28.26% lat (msec) : 500=5.34%, 750=0.39% cpu : usr=0.02%, sys=1.25%, ctx=1270, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=313KiB/s (320kB/s), 75.0KiB/s-81.8KiB/s (76.8kB/s-83.8kB/s), io=23.4MiB (24.5MB), run=76229-76578msec WRITE: bw=329KiB/s (337kB/s), 78.9KiB/s-85.5KiB/s (80.8kB/s-87.5kB/s), io=24.6MiB (25.8MB), run=76229-76578msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177857: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=715KiB/s (732kB/s)(7168KiB/10029msec) clat (usec): min=867, max=3892.3k, avg=1100401.30, stdev=1508478.66 lat (usec): min=868, max=3892.4k, avg=1100402.63, stdev=1508479.00 clat percentiles (usec): | 1.00th=[ 865], 5.00th=[ 865], 10.00th=[ 865], | 20.00th=[ 223347], 30.00th=[ 267387], 40.00th=[ 267387], | 50.00th=[ 337642], 60.00th=[ 417334], 70.00th=[ 417334], | 80.00th=[2566915], 90.00th=[3909092], 95.00th=[3909092], | 99.00th=[3909092], 99.50th=[3909092], 99.90th=[3909092], | 99.95th=[3909092], 99.99th=[3909092] bw ( KiB/s): min= 1796, max= 4047, per=100.00%, avg=2367.00, stdev=943.57, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=511KiB/s (523kB/s)(5120KiB/10029msec); 0 zone resets clat (msec): min=78, max=666, avg=413.78, stdev=229.36 lat (msec): min=79, max=666, avg=413.85, stdev=229.36 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 80], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1992, max= 3930, per=100.00%, avg=2647.00, stdev=1111.19, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=8.33%, 500=41.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=7.40%, ctx=1124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177858: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=166KiB/s (170kB/s)(2048KiB/12310msec) clat (msec): min=391, max=590, avg=491.10, stdev=140.16 lat (msec): min=391, max=590, avg=491.10, stdev=140.16 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2019, max= 2031, per=100.00%, avg=2025.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=832KiB/s (852kB/s)(10.0MiB/12310msec); 0 zone resets clat (msec): min=220, max=6193, avg=1123.83, stdev=1806.77 lat (msec): min=220, max=6193, avg=1123.90, stdev=1806.78 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 292], | 30.00th=[ 309], 40.00th=[ 388], 50.00th=[ 430], 60.00th=[ 651], | 70.00th=[ 667], 80.00th=[ 911], 90.00th=[ 1183], 95.00th=[ 6208], | 99.00th=[ 6208], 99.50th=[ 6208], 99.90th=[ 6208], 99.95th=[ 6208], | 99.99th=[ 6208] bw ( KiB/s): min= 1796, max= 4063, per=100.00%, avg=2555.57, stdev=1026.97, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=8.33%, 500=41.67%, 750=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.61%, ctx=143, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177860: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=594KiB/s (608kB/s)(6144KiB/10347msec) clat (usec): min=540, max=402722, avg=157251.04, stdev=179095.45 lat (usec): min=542, max=402723, avg=157252.33, stdev=179095.41 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 611], | 30.00th=[ 611], 40.00th=[ 1004], 50.00th=[ 1004], 60.00th=[242222], | 70.00th=[295699], 80.00th=[295699], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 1965, max= 3592, per=100.00%, avg=2388.00, stdev=803.00, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=594KiB/s (608kB/s)(6144KiB/10347msec); 0 zone resets clat (msec): min=280, max=5965, avg=1480.82, stdev=2209.05 lat (msec): min=280, max=5965, avg=1480.88, stdev=2209.06 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 676], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 5940], 95.00th=[ 5940], | 99.00th=[ 5940], 99.50th=[ 5940], 99.90th=[ 5940], 99.95th=[ 5940], | 99.99th=[ 5940] bw ( KiB/s): min= 1976, max= 4063, per=100.00%, avg=2504.75, stdev=1038.86, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 250=8.33%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.05%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177862: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=429KiB/s (440kB/s)(5120KiB/11926msec) clat (usec): min=1742, max=525642, avg=221850.69, stdev=235658.40 lat (usec): min=1743, max=525642, avg=221851.58, stdev=235658.26 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1745], 10.00th=[ 1745], 20.00th=[ 1745], | 30.00th=[ 1958], 40.00th=[ 1958], 50.00th=[181404], 60.00th=[181404], | 70.00th=[400557], 80.00th=[400557], 90.00th=[526386], 95.00th=[526386], | 99.00th=[526386], 99.50th=[526386], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 1965, max= 3953, per=100.00%, avg=2645.67, stdev=1132.51, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=601KiB/s (615kB/s)(7168KiB/11926msec); 0 zone resets clat (msec): min=551, max=6194, avg=1478.43, stdev=2081.77 lat (msec): min=551, max=6194, avg=1478.62, stdev=2081.78 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 642], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 877], 90.00th=[ 6208], 95.00th=[ 6208], | 99.00th=[ 6208], 99.50th=[ 6208], 99.90th=[ 6208], 99.95th=[ 6208], | 99.99th=[ 6208] bw ( KiB/s): min= 1796, max= 2031, per=84.76%, avg=1974.17, stdev=90.04, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 2=16.67%, 250=8.33%, 500=8.33%, 750=50.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.40%, ctx=168, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1664KiB/s (1704kB/s), 166KiB/s-715KiB/s (170kB/s-732kB/s), io=20.0MiB (20.0MB), run=10029-12310msec WRITE: bw=2329KiB/s (2385kB/s), 511KiB/s-832KiB/s (523kB/s-852kB/s), io=28.0MiB (29.4MB), run=10029-12310msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177859: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=562KiB/s (576kB/s)(7168KiB/12746msec) clat (msec): min=100, max=3889, avg=1375.23, stdev=1698.86 lat (msec): min=100, max=3889, avg=1375.23, stdev=1698.86 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 133], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 165], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 3574], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 2027, max= 3806, per=100.00%, avg=2476.75, stdev=886.19, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=402KiB/s (411kB/s)(5120KiB/12746msec); 0 zone resets clat (msec): min=183, max=886, avg=491.28, stdev=285.92 lat (msec): min=184, max=886, avg=491.61, stdev=285.61 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1969, max= 3968, per=100.00%, avg=2657.33, stdev=1135.55, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=50.00%, 750=16.67%, 1000=8.33%, 2000=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.21%, ctx=80, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177861: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=162KiB/s (166kB/s)(2048KiB/12666msec) clat (msec): min=264, max=636, avg=450.12, stdev=262.90 lat (msec): min=264, max=636, avg=450.12, stdev=262.90 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1651, max= 1965, per=100.00%, avg=1808.00, stdev=222.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=808KiB/s (828kB/s)(10.0MiB/12666msec); 0 zone resets clat (msec): min=236, max=5875, avg=1118.61, stdev=1690.90 lat (msec): min=236, max=5875, avg=1119.23, stdev=1690.67 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 397], | 30.00th=[ 456], 40.00th=[ 477], 50.00th=[ 523], 60.00th=[ 535], | 70.00th=[ 659], 80.00th=[ 911], 90.00th=[ 1116], 95.00th=[ 5873], | 99.00th=[ 5873], 99.50th=[ 5873], 99.90th=[ 5873], 99.95th=[ 5873], | 99.99th=[ 5873] bw ( KiB/s): min= 1851, max= 2039, per=88.14%, avg=1982.25, stdev=66.70, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 250=8.33%, 500=33.33%, 750=33.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.19%, ctx=128, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177863: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=515KiB/s (528kB/s)(6144KiB/11919msec) clat (msec): min=161, max=975, avg=428.00, stdev=296.57 lat (msec): min=161, max=975, avg=428.00, stdev=296.57 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 401], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1851, max= 2043, per=100.00%, avg=1985.80, stdev=81.73, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=515KiB/s (528kB/s)(6144KiB/11919msec); 0 zone resets clat (msec): min=273, max=5909, avg=1467.76, stdev=2189.15 lat (msec): min=273, max=5909, avg=1467.84, stdev=2189.15 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 735], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 5940], 95.00th=[ 5940], | 99.00th=[ 5940], 99.50th=[ 5940], 99.90th=[ 5940], 99.95th=[ 5940], | 99.99th=[ 5940] bw ( KiB/s): min= 1851, max= 3303, per=100.00%, avg=2307.00, stdev=669.77, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=16.67%, 500=33.33%, 750=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.28%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177864: Mon Aug 10 19:44:25 2026 read: IOPS=0, BW=444KiB/s (455kB/s)(5120KiB/11526msec) clat (msec): min=117, max=1102, avg=415.65, stdev=397.22 lat (msec): min=117, max=1102, avg=415.65, stdev=397.22 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2035, max= 4055, per=100.00%, avg=2711.00, stdev=1163.95, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=622KiB/s (637kB/s)(7168KiB/11526msec); 0 zone resets clat (msec): min=155, max=6133, avg=1311.31, stdev=2143.12 lat (msec): min=156, max=6133, avg=1311.43, stdev=2143.11 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 313], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 510], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 978], 90.00th=[ 6141], 95.00th=[ 6141], | 99.00th=[ 6141], 99.50th=[ 6141], 99.90th=[ 6141], 99.95th=[ 6141], | 99.99th=[ 6141] bw ( KiB/s): min= 1903, max= 3842, per=100.00%, avg=2726.40, stdev=1013.42, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=1.97%, ctx=97, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1607KiB/s (1645kB/s), 162KiB/s-562KiB/s (166kB/s-576kB/s), io=20.0MiB (20.0MB), run=11526-12746msec WRITE: bw=2249KiB/s (2303kB/s), 402KiB/s-808KiB/s (411kB/s-828kB/s), io=28.0MiB (29.4MB), run=11526-12746msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=177876: Mon Aug 10 19:44:43 2026 read: IOPS=0, BW=3463KiB/s (3546kB/s)(12.0MiB/3548msec) clat (msec): min=651, max=1665, avg=1123.41, stdev=510.59 lat (msec): min=651, max=1665, avg=1123.41, stdev=510.59 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=9.13%, ctx=193, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177877: Mon Aug 10 19:44:43 2026 read: IOPS=0, BW=727KiB/s (744kB/s)(4096KiB/5635msec) clat (nsec): min=4036.4M, max=4036.4M, avg=4036420040.00, stdev= 0.00 lat (nsec): min=4036.4M, max=4036.4M, avg=4036422372.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4044], 5.00th=[ 4044], 10.00th=[ 4044], 20.00th=[ 4044], | 30.00th=[ 4044], 40.00th=[ 4044], 50.00th=[ 4044], 60.00th=[ 4044], | 70.00th=[ 4044], 80.00th=[ 4044], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1454KiB/s (1489kB/s)(8192KiB/5635msec); 0 zone resets clat (msec): min=416, max=575, avg=496.01, stdev=112.16 lat (msec): min=417, max=575, avg=496.63, stdev=111.74 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.26%, ctx=390, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177878: Mon Aug 10 19:44:43 2026 write: IOPS=0, BW=1856KiB/s (1901kB/s)(12.0MiB/6620msec); 0 zone resets clat (msec): min=530, max=5104, avg=2056.39, stdev=2640.17 lat (msec): min=531, max=5105, avg=2057.74, stdev=2639.17 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 5134], 80.00th=[ 5134], 90.00th=[ 5134], 95.00th=[ 5134], | 99.00th=[ 5134], 99.50th=[ 5134], 99.90th=[ 5134], 99.95th=[ 5134], | 99.99th=[ 5134] bw ( KiB/s): min= 7757, max= 8047, per=100.00%, avg=7902.00, stdev=205.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.98%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177879: Mon Aug 10 19:44:43 2026 write: IOPS=0, BW=1783KiB/s (1826kB/s)(12.0MiB/6891msec); 0 zone resets clat (msec): min=778, max=4012, avg=2173.92, stdev=1661.90 lat (msec): min=779, max=4012, avg=2174.35, stdev=1661.86 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 1737], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4010], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 7447, max= 8159, per=100.00%, avg=7803.00, stdev=503.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.74%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2908KiB/s (2977kB/s), 727KiB/s-3463KiB/s (744kB/s-3546kB/s), io=16.0MiB (16.8MB), run=3548-5635msec WRITE: bw=4755KiB/s (4869kB/s), 1454KiB/s-1856KiB/s (1489kB/s-1901kB/s), io=32.0MiB (33.6MB), run=5635-6891msec rand-rw: (groupid=0, jobs=1): err= 0: pid=177872: Mon Aug 10 19:44:44 2026 read: IOPS=0, BW=2023KiB/s (2071kB/s)(12.0MiB/6075msec) clat (msec): min=404, max=4472, avg=1900.72, stdev=2237.24 lat (msec): min=404, max=4472, avg=1900.72, stdev=2237.24 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min=15937, max=15937, per=100.00%, avg=15937.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.08%, sys=2.50%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177873: Mon Aug 10 19:44:44 2026 read: IOPS=0, BW=1185KiB/s (1213kB/s)(4096KiB/3457msec) clat (nsec): min=590929k, max=590929k, avg=590929388.00, stdev= 0.00 lat (nsec): min=590933k, max=590933k, avg=590933366.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2370KiB/s (2427kB/s)(8192KiB/3457msec); 0 zone resets clat (msec): min=854, max=1834, avg=1344.51, stdev=692.57 lat (msec): min=857, max=1834, avg=1346.08, stdev=690.83 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 1838], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 6838, max= 6838, per=100.00%, avg=6838.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=1.94%, ctx=31, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177874: Mon Aug 10 19:44:44 2026 write: IOPS=0, BW=1486KiB/s (1522kB/s)(12.0MiB/8268msec); 0 zone resets clat (msec): min=199, max=7301, avg=2609.44, stdev=4063.75 lat (msec): min=199, max=7301, avg=2609.99, stdev=4063.58 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 7282], 80.00th=[ 7282], 90.00th=[ 7282], 95.00th=[ 7282], | 99.00th=[ 7282], 99.50th=[ 7282], 99.90th=[ 7282], 99.95th=[ 7282], | 99.99th=[ 7282] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.69%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=177875: Mon Aug 10 19:44:44 2026 write: IOPS=0, BW=1783KiB/s (1826kB/s)(12.0MiB/6892msec); 0 zone resets clat (msec): min=275, max=5943, avg=2235.46, stdev=3212.88 lat (msec): min=275, max=5950, avg=2238.03, stdev=3216.73 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 5940], 80.00th=[ 5940], 90.00th=[ 5940], 95.00th=[ 5940], | 99.00th=[ 5940], 99.50th=[ 5940], 99.90th=[ 5940], 99.95th=[ 5940], | 99.99th=[ 5940] bw ( KiB/s): min= 5603, max= 8110, per=100.00%, avg=6856.50, stdev=1772.72, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.15%, sys=2.83%, ctx=30, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2697KiB/s (2762kB/s), 1185KiB/s-2023KiB/s (1213kB/s-2071kB/s), io=16.0MiB (16.8MB), run=3457-6075msec WRITE: bw=3963KiB/s (4058kB/s), 1486KiB/s-2370KiB/s (1522kB/s-2427kB/s), io=32.0MiB (33.6MB), run=3457-8268msec