== sanity test 398b: DIO and buffer IO race ============== 16:52:44 (1787863964) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.99629 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179794: Thu Aug 27 16:55:05 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5992KiB/120641msec) clat (usec): min=39, max=936636, avg=44928.01, stdev=37229.07 lat (usec): min=39, max=936637, avg=44929.59, stdev=37229.17 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 11207], 10.00th=[ 16712], 20.00th=[ 22676], | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[164627], 99.90th=[358613], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 103, per=24.82%, avg=49.14, stdev=19.65, samples=237 iops : min= 1, max= 25, avg=11.65, stdev= 4.94, samples=237 write: IOPS=13, BW=52.2KiB/s (53.4kB/s)(6296KiB/120641msec); 0 zone resets clat (usec): min=961, max=379596, avg=33573.05, stdev=34949.75 lat (usec): min=962, max=379597, avg=33575.14, stdev=34950.46 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1549], 20.00th=[ 3556], | 30.00th=[ 7111], 40.00th=[ 16450], 50.00th=[ 24773], 60.00th=[ 32900], | 70.00th=[ 42730], 80.00th=[ 59507], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[147850], 99.50th=[158335], 99.90th=[261096], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 135, per=25.09%, avg=51.94, stdev=21.12, samples=236 iops : min= 1, max= 33, avg=12.34, stdev= 5.31, samples=236 lat (usec) : 50=0.42%, 100=1.37%, 250=0.10%, 1000=0.13% lat (msec) : 2=6.32%, 4=4.79%, 10=7.00%, 20=9.18%, 50=41.28% lat (msec) : 100=24.67%, 250=4.62%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.16%, ctx=6510, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179795: Thu Aug 27 16:55:05 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(5940KiB/119294msec) clat (usec): min=45, max=204943, avg=43717.95, stdev=27979.61 lat (usec): min=46, max=204944, avg=43728.44, stdev=27968.33 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12780], 10.00th=[ 16909], 20.00th=[ 22414], | 30.00th=[ 27657], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 62129], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[154141], 99.50th=[170918], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 15, max= 104, per=25.08%, avg=49.66, stdev=17.89, samples=234 iops : min= 3, max= 26, avg=11.77, stdev= 4.49, samples=234 write: IOPS=13, BW=53.2KiB/s (54.5kB/s)(6348KiB/119294msec); 0 zone resets clat (usec): min=1016, max=905569, avg=33980.77, stdev=41010.99 lat (usec): min=1017, max=905571, avg=33988.33, stdev=41010.80 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1860], 20.00th=[ 3818], | 30.00th=[ 6915], 40.00th=[ 15008], 50.00th=[ 23725], 60.00th=[ 32637], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[158335], 99.50th=[177210], 99.90th=[287310], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 127, per=25.55%, avg=52.88, stdev=20.24, samples=235 iops : min= 1, max= 31, avg=12.57, stdev= 5.09, samples=235 lat (usec) : 50=0.20%, 100=1.20%, 250=0.16%, 750=0.10% lat (msec) : 2=5.63%, 4=5.31%, 10=7.42%, 20=10.03%, 50=41.67% lat (msec) : 100=23.76%, 250=4.46%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.29%, ctx=6546, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179797: Thu Aug 27 16:55:05 2026 read: IOPS=12, BW=49.8KiB/s (51.0kB/s)(6028KiB/121010msec) clat (usec): min=33, max=360681, avg=43935.39, stdev=29826.17 lat (usec): min=34, max=360683, avg=43943.95, stdev=29831.69 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 12387], 10.00th=[ 16581], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[168821], 99.90th=[240124], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 151, per=25.05%, avg=49.59, stdev=19.28, samples=237 iops : min= 1, max= 37, avg=11.76, stdev= 4.85, samples=237 write: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6260KiB/121010msec); 0 zone resets clat (usec): min=994, max=889570, avg=34733.50, stdev=41462.90 lat (usec): min=995, max=889571, avg=34735.80, stdev=41462.70 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1549], 20.00th=[ 3621], | 30.00th=[ 7308], 40.00th=[ 16712], 50.00th=[ 25560], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[147850], 99.50th=[193987], 99.90th=[291505], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 135, per=24.71%, avg=51.15, stdev=22.50, samples=238 iops : min= 1, max= 33, avg=12.15, stdev= 5.66, samples=238 lat (usec) : 50=0.23%, 100=1.30%, 500=0.07%, 750=0.03%, 1000=0.03% lat (msec) : 2=6.32%, 4=4.62%, 10=6.41%, 20=10.81%, 50=41.70% lat (msec) : 100=23.18%, 250=5.21%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.20%, ctx=6533, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179801: Thu Aug 27 16:55:05 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6052KiB/119670msec) clat (usec): min=35, max=941524, avg=43514.18, stdev=36497.41 lat (usec): min=36, max=941525, avg=43516.45, stdev=36497.97 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10814], 10.00th=[ 16319], 20.00th=[ 22152], | 30.00th=[ 26608], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[135267], 99.50th=[168821], 99.90th=[329253], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 111, per=25.39%, avg=50.27, stdev=19.61, samples=236 iops : min= 1, max= 27, avg=11.92, stdev= 4.92, samples=236 write: IOPS=13, BW=52.1KiB/s (53.4kB/s)(6236KiB/119670msec); 0 zone resets clat (usec): min=985, max=280370, avg=34244.42, stdev=35622.29 lat (usec): min=986, max=280372, avg=34246.77, stdev=35622.44 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1991], 20.00th=[ 3916], | 30.00th=[ 7177], 40.00th=[ 15664], 50.00th=[ 24511], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 84411], 95.00th=[107480], | 99.00th=[147850], 99.50th=[166724], 99.90th=[242222], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 146, per=25.12%, avg=52.00, stdev=21.84, samples=235 iops : min= 1, max= 36, avg=12.36, stdev= 5.49, samples=235 lat (usec) : 50=0.23%, 100=1.56%, 250=0.23%, 500=0.07%, 1000=0.07% lat (msec) : 2=5.05%, 4=5.27%, 10=7.55%, 20=10.16%, 50=41.05% lat (msec) : 100=23.83%, 250=4.85%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.22%, ctx=6495, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=198KiB/s (203kB/s), 49.7KiB/s-50.6KiB/s (50.9kB/s-51.8kB/s), io=23.4MiB (24.6MB), run=119294-121010msec WRITE: bw=208KiB/s (213kB/s), 51.7KiB/s-53.2KiB/s (52.0kB/s-54.5kB/s), io=24.6MiB (25.7MB), run=119294-121010msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179796: Thu Aug 27 16:55:46 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(5992KiB/161566msec) clat (msec): min=5, max=947, avg=41.99, stdev=44.91 lat (msec): min=5, max=947, avg=42.00, stdev=44.91 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 120], | 99.00th=[ 194], 99.50th=[ 228], 99.90th=[ 313], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 135, per=25.29%, avg=37.44, stdev=25.69, samples=312 iops : min= 1, max= 33, avg= 8.70, stdev= 6.46, samples=312 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6296KiB/161566msec); 0 zone resets clat (msec): min=13, max=316, avg=62.42, stdev=42.17 lat (msec): min=13, max=316, avg=62.42, stdev=42.17 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 93], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 224], 99.90th=[ 284], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 111, per=25.05%, avg=38.83, stdev=23.44, samples=316 iops : min= 1, max= 27, avg= 9.04, stdev= 5.90, samples=316 lat (msec) : 10=2.38%, 20=15.89%, 50=45.05%, 100=24.38%, 250=12.08% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=4873, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179798: Thu Aug 27 16:55:46 2026 read: IOPS=9, BW=37.1KiB/s (38.0kB/s)(5940KiB/160034msec) clat (msec): min=5, max=981, avg=41.69, stdev=44.41 lat (msec): min=5, max=981, avg=41.69, stdev=44.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 58], 90.00th=[ 89], 95.00th=[ 122], | 99.00th=[ 186], 99.50th=[ 199], 99.90th=[ 317], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 151, per=25.23%, avg=37.34, stdev=25.75, samples=310 iops : min= 1, max= 37, avg= 8.67, stdev= 6.48, samples=310 write: IOPS=9, BW=39.7KiB/s (40.6kB/s)(6348KiB/160034msec); 0 zone resets clat (msec): min=9, max=342, avg=61.60, stdev=42.46 lat (msec): min=9, max=342, avg=61.61, stdev=42.46 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 90], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 220], 99.50th=[ 245], 99.90th=[ 326], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 119, per=25.46%, avg=39.46, stdev=23.30, samples=314 iops : min= 1, max= 29, avg= 9.20, stdev= 5.86, samples=314 lat (msec) : 10=2.80%, 20=14.36%, 50=46.39%, 100=24.58%, 250=11.59% lat (msec) : 500=0.26%, 1000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=4686, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179799: Thu Aug 27 16:55:46 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160547msec) clat (msec): min=5, max=380, avg=41.66, stdev=36.51 lat (msec): min=5, max=380, avg=41.67, stdev=36.51 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 90], 95.00th=[ 118], | 99.00th=[ 178], 99.50th=[ 201], 99.90th=[ 288], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 159, per=25.63%, avg=37.93, stdev=24.51, samples=310 iops : min= 1, max= 39, avg= 8.82, stdev= 6.17, samples=310 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6260KiB/160547msec); 0 zone resets clat (msec): min=12, max=971, avg=62.20, stdev=50.21 lat (msec): min=12, max=971, avg=62.20, stdev=50.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 226], 99.50th=[ 292], 99.90th=[ 418], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 120, per=25.25%, avg=39.13, stdev=23.67, samples=312 iops : min= 1, max= 30, avg= 9.12, stdev= 5.96, samples=312 lat (msec) : 10=2.08%, 20=14.55%, 50=47.30%, 100=24.22%, 250=11.36% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.05%, sys=1.78%, ctx=4762, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179800: Thu Aug 27 16:55:46 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6052KiB/160266msec) clat (msec): min=5, max=382, avg=40.25, stdev=35.58 lat (msec): min=5, max=382, avg=40.25, stdev=35.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 89], 95.00th=[ 113], | 99.00th=[ 167], 99.50th=[ 188], 99.90th=[ 279], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 127, per=26.21%, avg=38.79, stdev=26.06, samples=304 iops : min= 1, max= 31, avg= 9.03, stdev= 6.55, samples=304 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6236KiB/160266msec); 0 zone resets clat (msec): min=12, max=984, avg=63.50, stdev=50.49 lat (msec): min=12, max=984, avg=63.50, stdev=50.49 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 74], 80.00th=[ 92], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 213], 99.50th=[ 279], 99.90th=[ 426], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 119, per=24.92%, avg=38.62, stdev=23.62, samples=314 iops : min= 1, max= 29, avg= 8.99, stdev= 5.95, samples=314 lat (msec) : 10=2.64%, 20=15.89%, 50=44.40%, 100=25.03%, 250=11.59% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.07%, sys=1.71%, ctx=4862, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (152kB/s), 37.1KiB/s-37.8KiB/s (37.0kB/s-38.7kB/s), io=23.4MiB (24.6MB), run=160034-161566msec WRITE: bw=156KiB/s (159kB/s), 38.9KiB/s-39.7KiB/s (39.8kB/s-40.6kB/s), io=24.6MiB (25.7MB), run=160034-161566msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179843: Thu Aug 27 16:56:30 2026 read: IOPS=11, BW=188KiB/s (193kB/s)(5920KiB/31410msec) clat (usec): min=34, max=217070, avg=47766.70, stdev=30944.02 lat (usec): min=34, max=217072, avg=47768.13, stdev=30944.07 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 14615], 20.00th=[ 24511], | 30.00th=[ 29754], 40.00th=[ 37487], 50.00th=[ 43779], 60.00th=[ 52167], | 70.00th=[ 58983], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[ 96994], | 99.00th=[152044], 99.50th=[191890], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 63, max= 411, per=25.49%, avg=185.31, stdev=65.98, samples=61 iops : min= 3, max= 25, avg=10.77, stdev= 4.19, samples=61 write: IOPS=12, BW=203KiB/s (208kB/s)(6368KiB/31410msec); 0 zone resets clat (usec): min=1494, max=315792, avg=34057.76, stdev=35765.38 lat (usec): min=1495, max=315804, avg=34060.56, stdev=35765.71 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2638], 10.00th=[ 3654], 20.00th=[ 6063], | 30.00th=[ 9110], 40.00th=[ 13435], 50.00th=[ 24249], 60.00th=[ 31327], | 70.00th=[ 43779], 80.00th=[ 55837], 90.00th=[ 83362], 95.00th=[106431], | 99.00th=[149947], 99.50th=[181404], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 537, per=26.43%, avg=202.21, stdev=89.42, samples=61 iops : min= 1, max= 33, avg=11.85, stdev= 5.65, samples=61 lat (usec) : 50=0.78%, 100=3.26%, 250=0.13%, 500=0.13% lat (msec) : 2=1.43%, 4=4.95%, 10=10.68%, 20=9.11%, 50=36.20% lat (msec) : 100=28.26%, 250=4.95%, 500=0.13% cpu : usr=0.06%, sys=5.91%, ctx=1667, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179845: Thu Aug 27 16:56:30 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(5744KiB/32880msec) clat (usec): min=52, max=259124, avg=47620.36, stdev=31083.94 lat (usec): min=53, max=259126, avg=47625.51, stdev=31081.65 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 85], 10.00th=[ 14353], 20.00th=[ 25297], | 30.00th=[ 32375], 40.00th=[ 38011], 50.00th=[ 43254], 60.00th=[ 48497], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[100140], | 99.00th=[147850], 99.50th=[166724], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 42, max= 376, per=23.80%, avg=173.00, stdev=70.68, samples=64 iops : min= 2, max= 23, avg=10.00, stdev= 4.47, samples=64 write: IOPS=12, BW=199KiB/s (204kB/s)(6544KiB/32880msec); 0 zone resets clat (usec): min=1445, max=176181, avg=38425.79, stdev=37137.14 lat (usec): min=1447, max=176184, avg=38434.08, stdev=37137.94 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2278], 10.00th=[ 3589], 20.00th=[ 6128], | 30.00th=[ 10945], 40.00th=[ 17171], 50.00th=[ 26608], 60.00th=[ 35914], | 70.00th=[ 51119], 80.00th=[ 68682], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[160433], 99.50th=[168821], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 63, max= 470, per=25.42%, avg=194.50, stdev=82.51, samples=64 iops : min= 3, max= 29, avg=11.36, stdev= 5.24, samples=64 lat (usec) : 100=2.86%, 250=0.91%, 500=0.13% lat (msec) : 2=1.43%, 4=5.34%, 10=8.33%, 20=9.38%, 50=36.98% lat (msec) : 100=28.65%, 250=5.86%, 500=0.13% cpu : usr=0.08%, sys=5.88%, ctx=1801, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179848: Thu Aug 27 16:56:30 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(6256KiB/32941msec) clat (usec): min=54, max=232928, avg=46772.94, stdev=33591.44 lat (usec): min=55, max=232931, avg=46774.83, stdev=33591.27 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 81], 10.00th=[ 14615], 20.00th=[ 22938], | 30.00th=[ 28705], 40.00th=[ 33162], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 56361], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[107480], | 99.00th=[181404], 99.50th=[210764], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 351, per=25.83%, avg=187.80, stdev=66.90, samples=64 iops : min= 1, max= 21, avg=10.94, stdev= 4.20, samples=64 write: IOPS=11, BW=183KiB/s (188kB/s)(6032KiB/32941msec); 0 zone resets clat (usec): min=1593, max=186215, avg=37981.07, stdev=34117.16 lat (usec): min=1596, max=186219, avg=37987.41, stdev=34117.82 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2180], 10.00th=[ 3720], 20.00th=[ 7767], | 30.00th=[ 13435], 40.00th=[ 20317], 50.00th=[ 29230], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[154141], 99.50th=[156238], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 376, per=23.28%, avg=178.11, stdev=73.73, samples=64 iops : min= 1, max= 23, avg=10.33, stdev= 4.68, samples=64 lat (usec) : 100=3.39%, 250=0.39% lat (msec) : 2=1.43%, 4=4.04%, 10=7.68%, 20=10.94%, 50=39.71% lat (msec) : 100=26.56%, 250=5.86% cpu : usr=0.07%, sys=5.69%, ctx=1780, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179849: Thu Aug 27 16:56:30 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6032KiB/32620msec) clat (usec): min=38, max=180334, avg=44154.40, stdev=32351.92 lat (usec): min=38, max=180336, avg=44156.12, stdev=32352.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 75], 20.00th=[ 20055], | 30.00th=[ 26870], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 47973], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 84411], 95.00th=[109577], | 99.00th=[152044], 99.50th=[170918], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 62, max= 439, per=25.76%, avg=187.27, stdev=92.93, samples=63 iops : min= 3, max= 27, avg=10.89, stdev= 5.92, samples=63 write: IOPS=11, BW=192KiB/s (196kB/s)(6256KiB/32620msec); 0 zone resets clat (usec): min=1423, max=268200, avg=39567.47, stdev=39984.24 lat (usec): min=1425, max=268200, avg=39573.36, stdev=39989.18 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2212], 10.00th=[ 3097], 20.00th=[ 6652], | 30.00th=[ 10683], 40.00th=[ 20055], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[173016], 99.50th=[229639], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 468, per=25.13%, avg=192.27, stdev=96.89, samples=64 iops : min= 1, max= 29, avg=11.22, stdev= 6.10, samples=64 lat (usec) : 50=0.52%, 100=5.60%, 250=0.52% lat (msec) : 2=1.95%, 4=4.95%, 10=7.55%, 20=9.11%, 50=36.85% lat (msec) : 100=25.65%, 250=7.16%, 500=0.13% cpu : usr=0.07%, sys=5.64%, ctx=1715, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=727KiB/s (745kB/s), 175KiB/s-190KiB/s (179kB/s-194kB/s), io=23.4MiB (24.5MB), run=31410-32941msec WRITE: bw=765KiB/s (783kB/s), 183KiB/s-203KiB/s (188kB/s-208kB/s), io=24.6MiB (25.8MB), run=31410-32941msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179844: Thu Aug 27 16:56:41 2026 read: IOPS=8, BW=135KiB/s (139kB/s)(5920KiB/43714msec) clat (msec): min=7, max=212, avg=45.75, stdev=37.90 lat (msec): min=7, max=212, avg=45.76, stdev=37.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 99], 95.00th=[ 136], | 99.00th=[ 178], 99.50th=[ 197], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 413, per=24.78%, avg=135.06, stdev=86.89, samples=86 iops : min= 1, max= 25, avg= 7.66, stdev= 5.51, samples=86 write: IOPS=9, BW=146KiB/s (149kB/s)(6368KiB/43714msec); 0 zone resets clat (msec): min=9, max=381, avg=66.13, stdev=46.47 lat (msec): min=9, max=381, avg=66.13, stdev=46.47 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 95], 90.00th=[ 130], 95.00th=[ 161], | 99.00th=[ 243], 99.50th=[ 271], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 31, max= 415, per=25.63%, avg=147.14, stdev=86.82, samples=85 iops : min= 1, max= 25, avg= 8.42, stdev= 5.45, samples=85 lat (msec) : 10=1.04%, 20=11.59%, 50=47.14%, 100=25.78%, 250=14.06% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.83%, ctx=1208, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179846: Thu Aug 27 16:56:41 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5744KiB/43541msec) clat (msec): min=7, max=183, avg=42.46, stdev=33.85 lat (msec): min=7, max=183, avg=42.46, stdev=33.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 95], 95.00th=[ 120], | 99.00th=[ 159], 99.50th=[ 176], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 411, per=24.60%, avg=134.10, stdev=89.62, samples=84 iops : min= 1, max= 25, avg= 7.61, stdev= 5.66, samples=84 write: IOPS=9, BW=150KiB/s (154kB/s)(6544KiB/43541msec); 0 zone resets clat (msec): min=16, max=288, avg=68.80, stdev=46.39 lat (msec): min=16, max=288, avg=68.80, stdev=46.39 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 52], 60.00th=[ 59], | 70.00th=[ 79], 80.00th=[ 104], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 207], 99.50th=[ 264], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 352, per=26.41%, avg=151.59, stdev=87.37, samples=85 iops : min= 1, max= 22, avg= 8.71, stdev= 5.52, samples=85 lat (msec) : 10=0.78%, 20=10.68%, 50=48.18%, 100=25.00%, 250=14.84% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.79%, ctx=1168, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179847: Thu Aug 27 16:56:41 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43875msec) clat (msec): min=7, max=263, avg=45.78, stdev=42.16 lat (msec): min=7, max=263, avg=45.78, stdev=42.16 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 222], 99.50th=[ 232], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 30, max= 480, per=27.08%, avg=147.56, stdev=104.57, samples=82 iops : min= 1, max= 30, avg= 8.45, stdev= 6.61, samples=82 write: IOPS=8, BW=137KiB/s (141kB/s)(6032KiB/43875msec); 0 zone resets clat (msec): min=14, max=364, avg=67.82, stdev=46.77 lat (msec): min=14, max=364, avg=67.82, stdev=46.77 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 80], 80.00th=[ 100], 90.00th=[ 133], 95.00th=[ 163], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 349, per=23.82%, avg=136.70, stdev=75.37, samples=84 iops : min= 1, max= 21, avg= 7.77, stdev= 4.74, samples=84 lat (msec) : 10=1.95%, 20=12.89%, 50=45.57%, 100=24.48%, 250=14.84% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.79%, ctx=1177, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179850: Thu Aug 27 16:56:41 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6032KiB/43543msec) clat (msec): min=8, max=325, avg=46.65, stdev=42.76 lat (msec): min=8, max=325, avg=46.65, stdev=42.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 68], 90.00th=[ 108], 95.00th=[ 140], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 415, per=26.43%, avg=144.04, stdev=90.89, samples=82 iops : min= 1, max= 25, avg= 8.23, stdev= 5.69, samples=82 write: IOPS=8, BW=144KiB/s (147kB/s)(6256KiB/43543msec); 0 zone resets clat (msec): min=16, max=288, avg=65.55, stdev=42.35 lat (msec): min=16, max=288, avg=65.56, stdev=42.36 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 226], 99.50th=[ 266], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 380, per=24.96%, avg=143.28, stdev=79.85, samples=86 iops : min= 1, max= 23, avg= 8.17, stdev= 5.06, samples=86 lat (msec) : 10=0.91%, 20=11.46%, 50=45.83%, 100=28.65%, 250=12.76% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.80%, ctx=1172, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=546KiB/s (559kB/s), 132KiB/s-143KiB/s (135kB/s-146kB/s), io=23.4MiB (24.5MB), run=43541-43875msec WRITE: bw=574KiB/s (588kB/s), 137KiB/s-150KiB/s (141kB/s-154kB/s), io=24.6MiB (25.8MB), run=43541-43875msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179865: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=1006KiB/s (1030kB/s)(7168KiB/7123msec) clat (usec): min=533, max=3765.3k, avg=656068.18, stdev=1376048.73 lat (usec): min=535, max=3765.3k, avg=656069.77, stdev=1376048.51 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], | 20.00th=[ 4621], 30.00th=[ 67634], 40.00th=[ 67634], | 50.00th=[ 231736], 60.00th=[ 233833], 70.00th=[ 233833], | 80.00th=[ 287310], 90.00th=[3774874], 95.00th=[3774874], | 99.00th=[3774874], 99.50th=[3774874], 99.90th=[3774874], | 99.95th=[3774874], 99.99th=[3774874] bw ( KiB/s): min= 1914, max= 4047, per=100.00%, avg=2905.00, stdev=1083.07, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=0, BW=719KiB/s (736kB/s)(5120KiB/7123msec); 0 zone resets clat (msec): min=253, max=817, avg=486.19, stdev=225.18 lat (msec): min=253, max=817, avg=486.24, stdev=225.15 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 498], 60.00th=[ 498], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1988, max= 4096, per=76.88%, avg=2702.33, stdev=1207.08, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 100=8.33%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=8.09%, ctx=694, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179866: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=251KiB/s (257kB/s)(2048KiB/8156msec) clat (msec): min=14, max=282, avg=148.45, stdev=188.99 lat (msec): min=14, max=282, avg=148.45, stdev=188.99 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 15], 10.00th=[ 15], 20.00th=[ 15], | 30.00th=[ 15], 40.00th=[ 15], 50.00th=[ 15], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1398, max= 2011, per=67.88%, avg=1704.50, stdev=433.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1256KiB/s (1286kB/s)(10.0MiB/8156msec); 0 zone resets clat (msec): min=125, max=4250, avg=780.84, stdev=1231.05 lat (msec): min=125, max=4250, avg=780.95, stdev=1231.02 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 171], | 30.00th=[ 296], 40.00th=[ 317], 50.00th=[ 422], 60.00th=[ 493], | 70.00th=[ 502], 80.00th=[ 575], 90.00th=[ 659], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min= 1805, max= 4047, per=84.45%, avg=2968.50, stdev=1122.97, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 20=8.33%, 250=16.67%, 500=41.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=9.44%, ctx=164, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179867: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=840KiB/s (860kB/s)(6144KiB/7312msec) clat (usec): min=378, max=479271, avg=179381.12, stdev=212939.27 lat (usec): min=379, max=479272, avg=179382.28, stdev=212938.88 clat percentiles (usec): | 1.00th=[ 379], 5.00th=[ 379], 10.00th=[ 379], 20.00th=[ 433], | 30.00th=[ 433], 40.00th=[ 469], 50.00th=[ 469], 60.00th=[219153], | 70.00th=[375391], 80.00th=[375391], 90.00th=[480248], 95.00th=[480248], | 99.00th=[480248], 99.50th=[480248], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 2011, max= 6071, per=100.00%, avg=3376.67, stdev=2333.43, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=0, BW=840KiB/s (860kB/s)(6144KiB/7312msec); 0 zone resets clat (msec): min=86, max=3733, avg=1006.25, stdev=1359.04 lat (msec): min=86, max=3733, avg=1007.01, stdev=1358.93 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 600], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1479, max= 4047, per=67.92%, avg=2387.25, stdev=1134.78, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=25.00% lat (msec) : 100=8.33%, 250=8.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.47%, ctx=156, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179869: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=711KiB/s (728kB/s)(5120KiB/7205msec) clat (usec): min=543, max=395978, avg=80509.67, stdev=176354.31 lat (usec): min=544, max=395980, avg=80510.78, stdev=176354.76 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 1139], 40.00th=[ 1139], 50.00th=[ 2212], 60.00th=[ 2212], | 70.00th=[ 2704], 80.00th=[ 2704], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=0, BW=995KiB/s (1019kB/s)(7168KiB/7205msec); 0 zone resets clat (msec): min=327, max=3867, avg=941.73, stdev=1298.16 lat (msec): min=327, max=3867, avg=941.81, stdev=1298.16 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 334], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 443], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 735], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 1805, max= 2048, per=56.47%, avg=1985.00, stdev=90.55, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=16.67%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.50%, ctx=132, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2511KiB/s (2571kB/s), 251KiB/s-1006KiB/s (257kB/s-1030kB/s), io=20.0MiB (20.0MB), run=7123-8156msec WRITE: bw=3515KiB/s (3600kB/s), 719KiB/s-1256KiB/s (736kB/s-1286kB/s), io=28.0MiB (29.4MB), run=7123-8156msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179868: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=844KiB/s (864kB/s)(7168KiB/8495msec) clat (msec): min=82, max=3852, avg=929.47, stdev=1377.84 lat (msec): min=82, max=3852, avg=929.47, stdev=1377.84 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 86], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 131], 60.00th=[ 978], | 70.00th=[ 978], 80.00th=[ 1267], 90.00th=[ 3842], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 1815, max= 4000, per=100.00%, avg=3261.00, stdev=1252.37, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=603KiB/s (617kB/s)(5120KiB/8495msec); 0 zone resets clat (msec): min=86, max=552, avg=297.89, stdev=178.48 lat (msec): min=86, max=552, avg=299.30, stdev=177.88 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2043, max= 6047, per=100.00%, avg=4045.00, stdev=2831.26, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=25.00%, 250=33.33%, 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.84%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179870: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=241KiB/s (247kB/s)(2048KiB/8495msec) clat (msec): min=117, max=216, avg=167.32, stdev=69.88 lat (msec): min=117, max=216, avg=167.32, stdev=69.88 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 1537, max= 2000, per=73.38%, avg=1768.50, stdev=327.39, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1205KiB/s (1234kB/s)(10.0MiB/8495msec); 0 zone resets clat (msec): min=109, max=4422, avg=796.12, stdev=1300.73 lat (msec): min=109, max=4422, avg=796.39, stdev=1300.65 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 116], | 30.00th=[ 150], 40.00th=[ 247], 50.00th=[ 279], 60.00th=[ 464], | 70.00th=[ 609], 80.00th=[ 709], 90.00th=[ 860], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 1976, max= 6047, per=76.55%, avg=2583.57, stdev=1527.45, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.57%, ctx=109, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179871: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=743KiB/s (760kB/s)(6144KiB/8273msec) clat (msec): min=91, max=621, avg=279.50, stdev=248.57 lat (msec): min=91, max=621, avg=279.50, stdev=248.57 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 157], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1984, max= 4031, per=100.00%, avg=2514.50, stdev=1011.31, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=743KiB/s (760kB/s)(6144KiB/8273msec); 0 zone resets clat (msec): min=128, max=3692, avg=1054.46, stdev=1337.49 lat (msec): min=128, max=3692, avg=1056.64, stdev=1337.60 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 651], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1996, max= 4031, per=71.75%, avg=2421.60, stdev=899.82, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 750=33.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.28%, ctx=138, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179872: Thu Aug 27 16:56:59 2026 read: IOPS=0, BW=625KiB/s (640kB/s)(5120KiB/8198msec) clat (msec): min=205, max=540, avg=342.75, stdev=146.36 lat (msec): min=205, max=540, avg=342.75, stdev=146.36 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1984, max= 4087, per=100.00%, avg=2689.00, stdev=1210.72, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=874KiB/s (895kB/s)(7168KiB/8198msec); 0 zone resets clat (msec): min=135, max=3948, avg=918.71, stdev=1376.00 lat (msec): min=135, max=3948, avg=918.80, stdev=1375.99 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 174], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 338], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 1083], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 1726, max= 5446, per=90.59%, avg=3057.33, stdev=2073.18, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.59%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2411KiB/s (2469kB/s), 241KiB/s-844KiB/s (247kB/s-864kB/s), io=20.0MiB (20.0MB), run=8198-8495msec WRITE: bw=3375KiB/s (3456kB/s), 603KiB/s-1205KiB/s (617kB/s-1234kB/s), io=28.0MiB (29.4MB), run=8198-8495msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179883: Thu Aug 27 16:57:14 2026 read: IOPS=1, BW=4892KiB/s (5009kB/s)(12.0MiB/2512msec) clat (msec): min=710, max=948, avg=808.13, stdev=124.97 lat (msec): min=710, max=948, avg=808.13, stdev=124.97 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8094, max= 8126, per=100.00%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.90%, ctx=337, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179885: Thu Aug 27 16:57:14 2026 read: IOPS=0, BW=1549KiB/s (1586kB/s)(4096KiB/2645msec) clat (nsec): min=560645k, max=560645k, avg=560644630.00, stdev= 0.00 lat (nsec): min=560647k, max=560647k, avg=560646897.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 6005, max= 6005, per=96.95%, avg=6005.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3097KiB/s (3171kB/s)(8192KiB/2645msec); 0 zone resets clat (msec): min=678, max=1292, avg=985.60, stdev=433.89 lat (msec): min=679, max=1292, avg=986.00, stdev=434.04 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8192, max= 8192, per=77.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.86%, ctx=120, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179886: Thu Aug 27 16:57:14 2026 write: IOPS=0, BW=3957KiB/s (4052kB/s)(12.0MiB/3105msec); 0 zone resets clat (msec): min=255, max=1417, avg=1002.53, stdev=648.55 lat (msec): min=255, max=1417, avg=1002.77, stdev=648.61 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8192, max= 8192, per=77.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.51%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179887: Thu Aug 27 16:57:14 2026 write: IOPS=1, BW=4554KiB/s (4664kB/s)(12.0MiB/2698msec); 0 zone resets clat (msec): min=251, max=1392, avg=856.16, stdev=573.50 lat (msec): min=252, max=1394, avg=857.18, stdev=574.11 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8047, max= 8047, per=76.25%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=4.41%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6194KiB/s (6343kB/s), 1549KiB/s-4892KiB/s (1586kB/s-5009kB/s), io=16.0MiB (16.8MB), run=2512-2645msec WRITE: bw=10.3MiB/s (10.8MB/s), 3097KiB/s-4554KiB/s (3171kB/s-4664kB/s), io=32.0MiB (33.6MB), run=2645-3105msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179880: Thu Aug 27 16:57:15 2026 read: IOPS=0, BW=3692KiB/s (3781kB/s)(12.0MiB/3328msec) clat (msec): min=226, max=1643, avg=1062.47, stdev=742.12 lat (msec): min=226, max=1643, avg=1062.47, stdev=742.12 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.83%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179881: Thu Aug 27 16:57:15 2026 read: IOPS=0, BW=3124KiB/s (3199kB/s)(4096KiB/1311msec) clat (nsec): min=327858k, max=327858k, avg=327858337.00, stdev= 0.00 lat (nsec): min=327861k, max=327861k, avg=327861157.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 6095, max= 6095, per=100.00%, avg=6095.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6249KiB/s (6399kB/s)(8192KiB/1311msec); 0 zone resets clat (msec): min=415, max=513, avg=464.27, stdev=69.57 lat (msec): min=431, max=513, avg=472.46, stdev=58.45 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 8047, max= 8047, per=68.13%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.15%, sys=7.02%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179882: Thu Aug 27 16:57:15 2026 write: IOPS=1, BW=4563KiB/s (4672kB/s)(12.0MiB/2693msec); 0 zone resets clat (msec): min=766, max=995, avg=862.96, stdev=119.10 lat (msec): min=767, max=996, avg=863.63, stdev=118.67 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8000, max= 8047, per=67.93%, avg=8023.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.04%, sys=7.32%, ctx=92, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179884: Thu Aug 27 16:57:15 2026 write: IOPS=1, BW=4430KiB/s (4536kB/s)(12.0MiB/2774msec); 0 zone resets clat (msec): min=411, max=1792, avg=890.37, stdev=781.52 lat (msec): min=413, max=1793, avg=892.89, stdev=780.86 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min=16189, max=16189, per=100.00%, avg=16189.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.64%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4923KiB/s (5041kB/s), 3124KiB/s-3692KiB/s (3199kB/s-3781kB/s), io=16.0MiB (16.8MB), run=1311-3328msec WRITE: bw=11.5MiB/s (12.1MB/s), 4430KiB/s-6249KiB/s (4536kB/s-6399kB/s), io=32.0MiB (33.6MB), run=1311-2774msec