== sanity test 398b: DIO and buffer IO race ============== 21:07:25 (1787620045) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.39828 s, 6.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178963: Mon Aug 24 21:09:53 2026 read: IOPS=12, BW=49.2KiB/s (50.4kB/s)(5992KiB/121778msec) clat (usec): min=36, max=237346, avg=44587.54, stdev=30371.94 lat (usec): min=36, max=237348, avg=44589.95, stdev=30371.89 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10683], 10.00th=[ 16057], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[160433], 99.50th=[177210], 99.90th=[217056], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 14, max= 111, per=25.27%, avg=49.03, stdev=20.11, samples=239 iops : min= 3, max= 27, avg=11.61, stdev= 5.06, samples=239 write: IOPS=12, BW=51.7KiB/s (52.9kB/s)(6296KiB/121778msec); 0 zone resets clat (usec): min=740, max=681262, avg=34723.54, stdev=38875.25 lat (usec): min=741, max=681264, avg=34726.09, stdev=38874.82 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1156], 10.00th=[ 1303], 20.00th=[ 3326], | 30.00th=[ 6652], 40.00th=[ 16909], 50.00th=[ 24511], 60.00th=[ 32900], | 70.00th=[ 44827], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[106431], | 99.00th=[152044], 99.50th=[183501], 99.90th=[235930], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 127, per=25.30%, avg=51.36, stdev=22.10, samples=239 iops : min= 1, max= 31, avg=12.21, stdev= 5.58, samples=239 lat (usec) : 50=0.33%, 100=1.40%, 250=0.10%, 750=0.03%, 1000=0.42% lat (msec) : 2=7.16%, 4=4.33%, 10=5.73%, 20=11.30%, 50=40.07% lat (msec) : 100=23.80%, 250=5.31%, 750=0.03% cpu : usr=0.06%, sys=4.30%, ctx=6160, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178964: Mon Aug 24 21:09:53 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(5940KiB/120015msec) clat (usec): min=30, max=595944, avg=44214.13, stdev=32816.13 lat (usec): min=30, max=595945, avg=44225.42, stdev=32810.10 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10552], 10.00th=[ 15664], 20.00th=[ 21890], | 30.00th=[ 27132], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[170918], 99.90th=[231736], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 119, per=25.41%, avg=49.29, stdev=20.18, samples=235 iops : min= 1, max= 29, avg=11.68, stdev= 5.09, samples=235 write: IOPS=13, BW=52.9KiB/s (54.2kB/s)(6348KiB/120015msec); 0 zone resets clat (usec): min=617, max=315271, avg=34007.67, stdev=38052.30 lat (usec): min=618, max=315272, avg=34009.86, stdev=38052.66 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 2638], | 30.00th=[ 6259], 40.00th=[ 14222], 50.00th=[ 22676], 60.00th=[ 31851], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[162530], 99.50th=[198181], 99.90th=[304088], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 144, per=25.85%, avg=52.47, stdev=24.16, samples=235 iops : min= 1, max= 36, avg=12.50, stdev= 6.13, samples=235 lat (usec) : 50=0.23%, 100=1.43%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.62% lat (msec) : 2=7.81%, 4=4.26%, 10=6.02%, 20=11.59%, 50=39.16% lat (msec) : 100=23.44%, 250=5.01%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=4.51%, ctx=6019, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178965: Mon Aug 24 21:09:53 2026 read: IOPS=12, BW=48.8KiB/s (50.0kB/s)(6028KiB/123403msec) clat (usec): min=32, max=241399, avg=45457.91, stdev=30725.36 lat (usec): min=32, max=241400, avg=45460.27, stdev=30726.70 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11207], 10.00th=[ 15926], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[154141], 99.50th=[175113], 99.90th=[238027], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 128, per=25.04%, avg=48.58, stdev=20.20, samples=242 iops : min= 1, max= 32, avg=11.51, stdev= 5.08, samples=242 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6260KiB/123403msec); 0 zone resets clat (usec): min=728, max=591754, avg=34846.63, stdev=38839.87 lat (usec): min=730, max=591755, avg=34853.73, stdev=38841.39 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3097], | 30.00th=[ 7046], 40.00th=[ 16909], 50.00th=[ 24511], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 58983], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[166724], 99.50th=[191890], 99.90th=[235930], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 175, per=24.82%, avg=50.38, stdev=23.56, samples=242 iops : min= 1, max= 43, avg=11.97, stdev= 5.92, samples=242 lat (usec) : 50=0.26%, 100=1.37%, 250=0.10%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.33% lat (msec) : 2=7.75%, 4=3.74%, 10=5.79%, 20=10.84%, 50=39.49% lat (msec) : 100=24.93%, 250=5.27%, 750=0.03% cpu : usr=0.06%, sys=4.47%, ctx=6146, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178966: Mon Aug 24 21:09:53 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6052KiB/121952msec) clat (usec): min=38, max=589998, avg=45611.32, stdev=34917.82 lat (usec): min=39, max=589999, avg=45619.77, stdev=34924.32 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10028], 10.00th=[ 16188], 20.00th=[ 22414], | 30.00th=[ 27395], 40.00th=[ 32637], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[ 95945], | 99.00th=[164627], 99.50th=[202376], 99.90th=[312476], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 104, per=25.41%, avg=49.30, stdev=19.47, samples=239 iops : min= 1, max= 26, avg=11.69, stdev= 4.93, samples=239 write: IOPS=12, BW=51.1KiB/s (52.4kB/s)(6236KiB/121952msec); 0 zone resets clat (usec): min=750, max=385974, avg=33759.75, stdev=36611.57 lat (usec): min=751, max=385976, avg=33761.40, stdev=36611.58 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 2802], | 30.00th=[ 6063], 40.00th=[ 13173], 50.00th=[ 23200], 60.00th=[ 33424], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[152044], 99.50th=[177210], 99.90th=[250610], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 7, max= 151, per=25.03%, avg=50.82, stdev=23.53, samples=239 iops : min= 1, max= 37, avg=12.07, stdev= 5.94, samples=239 lat (usec) : 50=0.39%, 100=1.53%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.36% lat (msec) : 2=7.62%, 4=4.46%, 10=6.74%, 20=9.80%, 50=39.19% lat (msec) : 100=24.80%, 250=4.69%, 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=4.43%, ctx=6124, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=195KiB/s (199kB/s), 48.8KiB/s-49.6KiB/s (50.0kB/s-50.8kB/s), io=23.4MiB (24.6MB), run=120015-123403msec WRITE: bw=204KiB/s (209kB/s), 50.7KiB/s-52.9KiB/s (51.9kB/s-54.2kB/s), io=24.6MiB (25.7MB), run=120015-123403msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178968: Mon Aug 24 21:10:29 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(5992KiB/159054msec) clat (msec): min=5, max=814, avg=41.59, stdev=44.02 lat (msec): min=5, max=814, avg=41.59, stdev=44.02 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 127], | 99.00th=[ 201], 99.50th=[ 224], 99.90th=[ 296], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 159, per=25.42%, avg=38.13, stdev=27.73, samples=306 iops : min= 1, max= 39, avg= 8.87, stdev= 6.98, samples=306 write: IOPS=9, BW=39.6KiB/s (40.5kB/s)(6296KiB/159054msec); 0 zone resets clat (msec): min=9, max=390, avg=61.38, stdev=45.55 lat (msec): min=9, max=390, avg=61.38, stdev=45.56 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 91], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 224], 99.50th=[ 249], 99.90th=[ 355], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 135, per=25.08%, avg=39.37, stdev=26.28, samples=311 iops : min= 1, max= 33, avg= 9.18, stdev= 6.63, samples=311 lat (msec) : 10=3.55%, 20=18.29%, 50=42.02%, 100=23.67%, 250=12.11% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.57%, ctx=4607, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178969: Mon Aug 24 21:10:29 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(5940KiB/159043msec) clat (msec): min=4, max=716, avg=41.65, stdev=43.97 lat (msec): min=4, max=716, avg=41.65, stdev=43.97 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 93], 95.00th=[ 130], | 99.00th=[ 211], 99.50th=[ 243], 99.90th=[ 279], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 143, per=26.26%, avg=39.38, stdev=27.20, samples=294 iops : min= 1, max= 35, avg= 9.18, stdev= 6.85, samples=294 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6348KiB/159043msec); 0 zone resets clat (msec): min=9, max=367, avg=61.16, stdev=45.19 lat (msec): min=9, max=367, avg=61.17, stdev=45.19 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 224], 99.50th=[ 247], 99.90th=[ 338], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 143, per=25.41%, avg=39.90, stdev=26.48, samples=310 iops : min= 1, max= 35, avg= 9.31, stdev= 6.68, samples=310 lat (msec) : 10=3.81%, 20=17.42%, 50=43.72%, 100=22.46%, 250=12.17% lat (msec) : 500=0.39%, 750=0.03% cpu : usr=0.05%, sys=1.55%, ctx=4598, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178970: Mon Aug 24 21:10:29 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6028KiB/159463msec) clat (msec): min=4, max=318, avg=43.13, stdev=42.25 lat (msec): min=4, max=318, avg=43.13, stdev=42.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 138], | 99.00th=[ 205], 99.50th=[ 230], 99.90th=[ 288], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 136, per=25.60%, avg=38.40, stdev=27.20, samples=306 iops : min= 1, max= 34, avg= 8.94, stdev= 6.86, samples=306 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6260KiB/159463msec); 0 zone resets clat (msec): min=7, max=756, avg=60.29, stdev=48.99 lat (msec): min=7, max=756, avg=60.29, stdev=48.99 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 118], 95.00th=[ 146], | 99.00th=[ 222], 99.50th=[ 305], 99.90th=[ 439], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 135, per=25.15%, avg=39.49, stdev=27.27, samples=309 iops : min= 1, max= 33, avg= 9.21, stdev= 6.88, samples=309 lat (msec) : 10=3.32%, 20=17.90%, 50=43.23%, 100=23.27%, 250=11.65% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.05%, sys=1.52%, ctx=4588, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178971: Mon Aug 24 21:10:29 2026 read: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6052KiB/158364msec) clat (msec): min=4, max=270, avg=41.25, stdev=38.16 lat (msec): min=4, max=270, avg=41.25, stdev=38.16 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 118], | 99.00th=[ 190], 99.50th=[ 209], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 135, per=26.28%, avg=39.42, stdev=26.74, samples=298 iops : min= 1, max= 33, avg= 9.19, stdev= 6.73, samples=298 write: IOPS=9, BW=39.4KiB/s (40.3kB/s)(6236KiB/158364msec); 0 zone resets clat (msec): min=8, max=758, avg=61.48, stdev=50.70 lat (msec): min=8, max=758, avg=61.48, stdev=50.70 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 90], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 241], 99.50th=[ 300], 99.90th=[ 430], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 136, per=24.82%, avg=38.97, stdev=26.93, samples=310 iops : min= 1, max= 34, avg= 9.08, stdev= 6.80, samples=310 lat (msec) : 10=3.55%, 20=17.29%, 50=43.55%, 100=23.44%, 250=11.72% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.05%, sys=1.52%, ctx=4547, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=151KiB/s (154kB/s), 37.3KiB/s-38.2KiB/s (38.2kB/s-39.1kB/s), io=23.4MiB (24.6MB), run=158364-159463msec WRITE: bw=158KiB/s (161kB/s), 39.3KiB/s-39.9KiB/s (40.2kB/s-40.9kB/s), io=24.6MiB (25.7MB), run=158364-159463msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179012: Mon Aug 24 21:11:36 2026 read: IOPS=7, BW=117KiB/s (119kB/s)(5920KiB/50769msec) clat (usec): min=39, max=890837, avg=76301.92, stdev=77483.03 lat (usec): min=39, max=890838, avg=76303.04, stdev=77483.05 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 63], 10.00th=[ 2311], 20.00th=[ 30802], | 30.00th=[ 41681], 40.00th=[ 50070], 50.00th=[ 58983], 60.00th=[ 71828], | 70.00th=[ 83362], 80.00th=[110625], 90.00th=[143655], 95.00th=[189793], | 99.00th=[442500], 99.50th=[530580], 99.90th=[893387], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 30, max= 316, per=27.75%, avg=120.42, stdev=63.66, samples=95 iops : min= 1, max= 19, avg= 6.73, stdev= 4.02, samples=95 write: IOPS=7, BW=125KiB/s (128kB/s)(6368KiB/50769msec); 0 zone resets clat (usec): min=1020, max=606443, avg=55574.35, stdev=68361.79 lat (usec): min=1022, max=606446, avg=55587.84, stdev=68353.97 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1778], 10.00th=[ 2474], 20.00th=[ 5932], | 30.00th=[ 11469], 40.00th=[ 18482], 50.00th=[ 28967], 60.00th=[ 45876], | 70.00th=[ 66323], 80.00th=[ 99091], 90.00th=[145753], 95.00th=[177210], | 99.00th=[358613], 99.50th=[392168], 99.90th=[608175], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 30, max= 383, per=29.65%, avg=135.51, stdev=71.03, samples=91 iops : min= 1, max= 23, avg= 7.69, stdev= 4.47, samples=91 lat (usec) : 50=0.52%, 100=3.52%, 250=0.13%, 500=0.26% lat (msec) : 2=3.91%, 4=4.04%, 10=6.90%, 20=7.81%, 50=24.61% lat (msec) : 100=26.43%, 250=20.31%, 500=1.17%, 750=0.26%, 1000=0.13% cpu : usr=0.06%, sys=3.02%, ctx=1438, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179013: Mon Aug 24 21:11:36 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(5744KiB/51498msec) clat (usec): min=52, max=876482, avg=81467.34, stdev=78310.63 lat (usec): min=52, max=876483, avg=81475.21, stdev=78303.65 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 19006], 20.00th=[ 34866], | 30.00th=[ 46924], 40.00th=[ 54789], 50.00th=[ 62653], 60.00th=[ 76022], | 70.00th=[ 90702], 80.00th=[111674], 90.00th=[156238], 95.00th=[204473], | 99.00th=[346031], 99.50th=[549454], 99.90th=[876610], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 30, max= 351, per=26.65%, avg=115.65, stdev=64.25, samples=96 iops : min= 1, max= 21, avg= 6.43, stdev= 4.06, samples=96 write: IOPS=7, BW=127KiB/s (130kB/s)(6544KiB/51498msec); 0 zone resets clat (usec): min=1156, max=571772, avg=53590.47, stdev=68126.81 lat (usec): min=1157, max=571772, avg=53595.83, stdev=68125.97 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1713], 10.00th=[ 2343], 20.00th=[ 5866], | 30.00th=[ 11076], 40.00th=[ 20055], 50.00th=[ 32113], 60.00th=[ 45351], | 70.00th=[ 65799], 80.00th=[ 88605], 90.00th=[127402], 95.00th=[164627], | 99.00th=[320865], 99.50th=[417334], 99.90th=[574620], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 30, max= 383, per=28.50%, avg=130.26, stdev=75.15, samples=97 iops : min= 1, max= 23, avg= 7.35, stdev= 4.71, samples=97 lat (usec) : 100=3.12%, 500=0.26%, 750=0.13%, 1000=0.13% lat (msec) : 2=4.69%, 4=2.99%, 10=6.51%, 20=8.07%, 50=22.92% lat (msec) : 100=31.25%, 250=17.58%, 500=1.82%, 750=0.39%, 1000=0.13% cpu : usr=0.07%, sys=4.09%, ctx=1542, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179014: Mon Aug 24 21:11:36 2026 read: IOPS=7, BW=113KiB/s (116kB/s)(6256KiB/55129msec) clat (usec): min=37, max=845141, avg=81018.34, stdev=77537.77 lat (usec): min=38, max=845142, avg=81078.37, stdev=77558.25 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 13829], 20.00th=[ 32375], | 30.00th=[ 41681], 40.00th=[ 52167], 50.00th=[ 62653], 60.00th=[ 74974], | 70.00th=[ 94897], 80.00th=[111674], 90.00th=[160433], 95.00th=[221250], | 99.00th=[375391], 99.50th=[476054], 99.90th=[843056], 99.95th=[843056], | 99.99th=[843056] bw ( KiB/s): min= 29, max= 319, per=26.73%, avg=116.02, stdev=62.82, samples=104 iops : min= 1, max= 19, avg= 6.45, stdev= 3.94, samples=104 write: IOPS=6, BW=109KiB/s (112kB/s)(6032KiB/55129msec); 0 zone resets clat (usec): min=1220, max=476049, avg=61152.24, stdev=66995.49 lat (usec): min=1222, max=476051, avg=61160.92, stdev=66995.25 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1745], 10.00th=[ 2737], 20.00th=[ 8160], | 30.00th=[ 15008], 40.00th=[ 25297], 50.00th=[ 35914], 60.00th=[ 58459], | 70.00th=[ 83362], 80.00th=[106431], 90.00th=[152044], 95.00th=[187696], | 99.00th=[291505], 99.50th=[413139], 99.90th=[476054], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 29, max= 383, per=24.79%, avg=113.30, stdev=65.11, samples=101 iops : min= 1, max= 23, avg= 6.27, stdev= 4.09, samples=101 lat (usec) : 50=0.78%, 100=3.78%, 500=0.13%, 750=0.13% lat (msec) : 2=4.17%, 4=2.08%, 10=5.08%, 20=6.90%, 50=23.83% lat (msec) : 100=28.78%, 250=21.48%, 500=2.73%, 1000=0.13% cpu : usr=0.04%, sys=3.50%, ctx=1530, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179015: Mon Aug 24 21:11:36 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6032KiB/50115msec) clat (usec): min=40, max=411129, avg=72194.59, stdev=59686.45 lat (usec): min=40, max=411130, avg=72197.66, stdev=59685.34 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 74], 20.00th=[ 28967], | 30.00th=[ 42730], 40.00th=[ 52691], 50.00th=[ 63177], 60.00th=[ 71828], | 70.00th=[ 84411], 80.00th=[107480], 90.00th=[145753], 95.00th=[177210], | 99.00th=[267387], 99.50th=[383779], 99.90th=[413139], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 29, max= 351, per=28.63%, avg=124.24, stdev=73.93, samples=93 iops : min= 1, max= 21, avg= 6.98, stdev= 4.65, samples=93 write: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/50115msec); 0 zone resets clat (usec): min=1450, max=953634, avg=58171.57, stdev=92599.04 lat (usec): min=1451, max=953636, avg=58180.89, stdev=92603.72 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1745], 10.00th=[ 2737], 20.00th=[ 6980], | 30.00th=[ 11994], 40.00th=[ 18482], 50.00th=[ 28967], 60.00th=[ 44303], | 70.00th=[ 61080], 80.00th=[ 88605], 90.00th=[133694], 95.00th=[193987], | 99.00th=[526386], 99.50th=[692061], 99.90th=[952108], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 29, max= 447, per=28.06%, avg=128.21, stdev=80.36, samples=94 iops : min= 1, max= 27, avg= 7.23, stdev= 5.04, samples=94 lat (usec) : 50=0.65%, 100=4.82%, 250=1.04%, 500=0.13% lat (msec) : 2=4.17%, 4=2.73%, 10=7.81%, 20=8.46%, 50=20.57% lat (msec) : 100=29.56%, 250=17.84%, 500=1.69%, 750=0.39%, 1000=0.13% cpu : usr=0.05%, sys=3.04%, ctx=1431, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=434KiB/s (445kB/s), 112KiB/s-120KiB/s (114kB/s-123kB/s), io=23.4MiB (24.5MB), run=50115-55129msec WRITE: bw=457KiB/s (468kB/s), 109KiB/s-127KiB/s (112kB/s-130kB/s), io=24.6MiB (25.8MB), run=50115-55129msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179018: Mon Aug 24 21:11:53 2026 read: IOPS=5, BW=82.8KiB/s (84.8kB/s)(5920KiB/71461msec) clat (msec): min=8, max=610, avg=74.94, stdev=81.67 lat (msec): min=8, max=610, avg=74.94, stdev=81.67 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 57], | 70.00th=[ 74], 80.00th=[ 100], 90.00th=[ 165], 95.00th=[ 259], | 99.00th=[ 456], 99.50th=[ 575], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 27, max= 383, per=26.85%, avg=89.95, stdev=67.24, samples=128 iops : min= 1, max= 23, avg= 4.81, stdev= 4.23, samples=128 write: IOPS=5, BW=89.1KiB/s (91.2kB/s)(6368KiB/71461msec); 0 zone resets clat (msec): min=12, max=837, avg=109.30, stdev=95.32 lat (msec): min=12, max=837, avg=109.30, stdev=95.32 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 29], 10.00th=[ 37], 20.00th=[ 45], | 30.00th=[ 56], 40.00th=[ 68], 50.00th=[ 79], 60.00th=[ 96], | 70.00th=[ 116], 80.00th=[ 155], 90.00th=[ 224], 95.00th=[ 288], | 99.00th=[ 558], 99.50th=[ 726], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 29, max= 284, per=27.28%, avg=96.02, stdev=61.69, samples=129 iops : min= 1, max= 17, avg= 5.19, stdev= 3.93, samples=129 lat (msec) : 10=0.39%, 20=5.73%, 50=33.07%, 100=31.25%, 250=23.18% lat (msec) : 500=5.60%, 750=0.65%, 1000=0.13% cpu : usr=0.03%, sys=0.94%, ctx=1078, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179019: Mon Aug 24 21:11:53 2026 read: IOPS=5, BW=80.4KiB/s (82.3kB/s)(5744KiB/71479msec) clat (msec): min=10, max=1202, avg=75.40, stdev=97.25 lat (msec): min=10, max=1202, avg=75.40, stdev=97.25 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 103], 90.00th=[ 167], 95.00th=[ 253], | 99.00th=[ 363], 99.50th=[ 776], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 22, max= 314, per=27.70%, avg=92.78, stdev=67.19, samples=119 iops : min= 1, max= 19, avg= 4.97, stdev= 4.27, samples=119 write: IOPS=5, BW=91.6KiB/s (93.7kB/s)(6544KiB/71479msec); 0 zone resets clat (msec): min=16, max=643, avg=108.25, stdev=90.74 lat (msec): min=16, max=643, avg=108.26, stdev=90.73 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 44], | 30.00th=[ 54], 40.00th=[ 64], 50.00th=[ 74], 60.00th=[ 99], | 70.00th=[ 120], 80.00th=[ 159], 90.00th=[ 236], 95.00th=[ 288], | 99.00th=[ 451], 99.50th=[ 558], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 26, max= 351, per=28.19%, avg=99.24, stdev=66.19, samples=127 iops : min= 1, max= 21, avg= 5.39, stdev= 4.21, samples=127 lat (msec) : 20=5.86%, 50=33.98%, 100=30.08%, 250=23.44%, 500=5.99% lat (msec) : 750=0.39%, 1000=0.13%, 2000=0.13% cpu : usr=0.03%, sys=0.99%, ctx=1122, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179020: Mon Aug 24 21:11:53 2026 read: IOPS=5, BW=87.8KiB/s (89.9kB/s)(6256KiB/71220msec) clat (msec): min=8, max=766, avg=73.88, stdev=77.09 lat (msec): min=8, max=766, avg=73.88, stdev=77.09 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 75], 80.00th=[ 110], 90.00th=[ 159], 95.00th=[ 220], | 99.00th=[ 397], 99.50th=[ 550], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 29, max= 412, per=28.40%, avg=95.15, stdev=75.60, samples=128 iops : min= 1, max= 25, avg= 5.14, stdev= 4.80, samples=128 write: IOPS=5, BW=84.7KiB/s (86.7kB/s)(6032KiB/71220msec); 0 zone resets clat (msec): min=18, max=645, avg=112.02, stdev=93.67 lat (msec): min=18, max=645, avg=112.02, stdev=93.67 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 37], 20.00th=[ 48], | 30.00th=[ 62], 40.00th=[ 71], 50.00th=[ 84], 60.00th=[ 100], | 70.00th=[ 115], 80.00th=[ 161], 90.00th=[ 239], 95.00th=[ 279], | 99.00th=[ 527], 99.50th=[ 600], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 29, max= 286, per=25.56%, avg=89.97, stdev=53.81, samples=128 iops : min= 1, max= 17, avg= 4.82, stdev= 3.41, samples=128 lat (msec) : 10=0.13%, 20=4.56%, 50=33.72%, 100=31.25%, 250=25.00% lat (msec) : 500=4.56%, 750=0.65%, 1000=0.13% cpu : usr=0.03%, sys=1.01%, ctx=1101, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179021: Mon Aug 24 21:11:53 2026 read: IOPS=5, BW=84.0KiB/s (87.0kB/s)(6032KiB/70979msec) clat (msec): min=7, max=1446, avg=76.13, stdev=97.62 lat (msec): min=7, max=1446, avg=76.13, stdev=97.62 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 112], 90.00th=[ 178], 95.00th=[ 224], | 99.00th=[ 326], 99.50th=[ 384], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 26, max= 316, per=28.45%, avg=95.32, stdev=64.51, samples=122 iops : min= 1, max= 19, avg= 5.15, stdev= 4.11, samples=122 write: IOPS=5, BW=88.1KiB/s (90.3kB/s)(6256KiB/70979msec); 0 zone resets clat (msec): min=18, max=852, avg=107.62, stdev=87.85 lat (msec): min=18, max=852, avg=107.63, stdev=87.85 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 32], 10.00th=[ 36], 20.00th=[ 47], | 30.00th=[ 57], 40.00th=[ 67], 50.00th=[ 80], 60.00th=[ 97], | 70.00th=[ 123], 80.00th=[ 159], 90.00th=[ 211], 95.00th=[ 271], | 99.00th=[ 456], 99.50th=[ 542], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 30, max= 320, per=27.03%, avg=95.16, stdev=62.67, samples=128 iops : min= 1, max= 20, avg= 5.12, stdev= 3.98, samples=128 lat (msec) : 10=0.26%, 20=4.43%, 50=33.07%, 100=31.77%, 250=25.52% lat (msec) : 500=4.56%, 750=0.13%, 1000=0.13%, 2000=0.13% cpu : usr=0.04%, sys=1.00%, ctx=1058, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=335KiB/s (343kB/s), 80.4KiB/s-87.8KiB/s (82.3kB/s-89.9kB/s), io=23.4MiB (24.5MB), run=70979-71479msec WRITE: bw=353KiB/s (361kB/s), 84.7KiB/s-91.6KiB/s (86.7kB/s-93.7kB/s), io=24.6MiB (25.8MB), run=70979-71479msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179038: Mon Aug 24 21:12:11 2026 read: IOPS=1, BW=1338KiB/s (1370kB/s)(7168KiB/5356msec) clat (msec): min=95, max=2801, avg=549.74, stdev=995.61 lat (msec): min=95, max=2801, avg=549.74, stdev=995.61 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 130], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 167], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 334], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 2019, max= 4071, per=100.00%, avg=2995.25, stdev=1121.50, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=956KiB/s (979kB/s)(5120KiB/5356msec); 0 zone resets clat (msec): min=86, max=337, avg=258.32, stdev=101.12 lat (msec): min=86, max=337, avg=265.09, stdev=103.06 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2035, max= 5720, per=100.00%, avg=3877.50, stdev=2605.69, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.20%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179039: Mon Aug 24 21:12:11 2026 read: IOPS=0, BW=267KiB/s (273kB/s)(2048KiB/7684msec) clat (msec): min=99, max=142, avg=121.00, stdev=30.95 lat (msec): min=99, max=142, avg=121.00, stdev=30.94 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 144], 95.00th=[ 144], | 99.00th=[ 144], 99.50th=[ 144], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 1855, max= 2035, per=72.98%, avg=1945.00, stdev=127.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1333KiB/s (1365kB/s)(10.0MiB/7684msec); 0 zone resets clat (msec): min=143, max=2489, avg=740.65, stdev=735.40 lat (msec): min=143, max=2489, avg=740.75, stdev=735.40 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 176], | 30.00th=[ 186], 40.00th=[ 321], 50.00th=[ 368], 60.00th=[ 460], | 70.00th=[ 953], 80.00th=[ 1028], 90.00th=[ 1284], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1855, max= 4071, per=69.56%, avg=2595.43, stdev=1007.67, samples=7 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=7 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 1000=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.56%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179040: Mon Aug 24 21:12:11 2026 read: IOPS=0, BW=845KiB/s (866kB/s)(6144KiB/7268msec) clat (msec): min=54, max=427, avg=166.88, stdev=139.08 lat (msec): min=54, max=427, avg=166.89, stdev=139.08 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 69], | 30.00th=[ 69], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 155], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 1992, max= 4063, per=94.83%, avg=2527.25, stdev=1023.99, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=845KiB/s (866kB/s)(6144KiB/7268msec); 0 zone resets clat (msec): min=130, max=3713, avg=987.88, stdev=1386.24 lat (msec): min=131, max=3713, avg=987.97, stdev=1386.24 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 735], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 3708], 95.00th=[ 3708], | 99.00th=[ 3708], 99.50th=[ 3708], 99.90th=[ 3708], 99.95th=[ 3708], | 99.99th=[ 3708] bw ( KiB/s): min= 1992, max= 2048, per=54.34%, avg=2027.40, stdev=22.63, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.69%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179041: Mon Aug 24 21:12:11 2026 read: IOPS=0, BW=673KiB/s (689kB/s)(5120KiB/7605msec) clat (msec): min=132, max=347, avg=206.26, stdev=91.44 lat (msec): min=132, max=347, avg=206.26, stdev=91.44 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 133], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2031, max= 6107, per=100.00%, avg=4069.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=943KiB/s (965kB/s)(7168KiB/7605msec); 0 zone resets clat (msec): min=109, max=3330, avg=914.38, stdev=1141.59 lat (msec): min=109, max=3330, avg=914.48, stdev=1141.58 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 114], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 397], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 1234], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1992, max= 3813, per=66.11%, avg=2466.75, stdev=897.74, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.58%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2665KiB/s (2729kB/s), 267KiB/s-1338KiB/s (273kB/s-1370kB/s), io=20.0MiB (20.0MB), run=5356-7684msec WRITE: bw=3731KiB/s (3821kB/s), 845KiB/s-1333KiB/s (866kB/s-1365kB/s), io=28.0MiB (29.4MB), run=5356-7684msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179042: Mon Aug 24 21:12:11 2026 read: IOPS=0, BW=933KiB/s (956kB/s)(7168KiB/7681msec) clat (usec): min=357, max=3106.9k, avg=893379.99, stdev=1417240.15 lat (usec): min=357, max=3106.9k, avg=893380.99, stdev=1417240.20 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], | 20.00th=[ 619], 30.00th=[ 799], 40.00th=[ 799], | 50.00th=[ 111674], 60.00th=[ 219153], 70.00th=[ 219153], | 80.00th=[2801796], 90.00th=[3103785], 95.00th=[3103785], | 99.00th=[3103785], 99.50th=[3103785], 99.90th=[3103785], | 99.95th=[3103785], 99.99th=[3103785] bw ( KiB/s): min= 1996, max= 6144, per=100.00%, avg=4031.00, stdev=2075.10, samples=3 iops : min= 1, max= 6, avg= 3.33, stdev= 2.52, samples=3 write: IOPS=0, BW=667KiB/s (683kB/s)(5120KiB/7681msec); 0 zone resets clat (msec): min=116, max=477, avg=221.02, stdev=149.37 lat (msec): min=116, max=477, avg=221.10, stdev=149.36 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2048, max= 4055, per=90.70%, avg=3365.00, stdev=1140.99, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=50.00%, 500=8.33%, >=2000=16.67% cpu : usr=0.05%, sys=6.82%, ctx=720, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179043: Mon Aug 24 21:12:11 2026 read: IOPS=0, BW=265KiB/s (271kB/s)(2048KiB/7727msec) clat (msec): min=249, max=711, avg=480.62, stdev=326.47 lat (msec): min=249, max=711, avg=480.62, stdev=326.47 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2039, max= 2048, per=77.11%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1325KiB/s (1357kB/s)(10.0MiB/7727msec); 0 zone resets clat (msec): min=161, max=2846, avg=638.91, stdev=844.06 lat (msec): min=161, max=2847, avg=639.17, stdev=844.06 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 176], | 30.00th=[ 220], 40.00th=[ 230], 50.00th=[ 232], 60.00th=[ 249], | 70.00th=[ 259], 80.00th=[ 936], 90.00th=[ 1083], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1996, max= 6107, per=82.30%, avg=3053.33, stdev=1709.30, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.83, samples=6 lat (msec) : 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=7.12%, ctx=137, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179044: Mon Aug 24 21:12:11 2026 read: IOPS=0, BW=885KiB/s (907kB/s)(6144KiB/6939msec) clat (msec): min=2, max=230, avg=104.01, stdev=88.14 lat (msec): min=2, max=230, avg=104.01, stdev=88.14 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 5], | 30.00th=[ 5], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 2039, max= 6107, per=100.00%, avg=4073.00, stdev=2876.51, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=885KiB/s (907kB/s)(6144KiB/6939msec); 0 zone resets clat (msec): min=217, max=3319, avg=1040.46, stdev=1290.62 lat (msec): min=217, max=3319, avg=1040.54, stdev=1290.62 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 342], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 1825, max= 2048, per=53.66%, avg=1990.80, stdev=93.94, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 4=8.33%, 10=8.33%, 250=50.00%, 500=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.31%, ctx=119, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179045: Mon Aug 24 21:12:11 2026 read: IOPS=0, BW=665KiB/s (681kB/s)(5120KiB/7695msec) clat (usec): min=333, max=313657, avg=99691.27, stdev=143507.80 lat (usec): min=333, max=313659, avg=99692.44, stdev=143508.08 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 441], 40.00th=[ 441], 50.00th=[ 486], 60.00th=[ 486], | 70.00th=[183501], 80.00th=[183501], 90.00th=[312476], 95.00th=[312476], | 99.00th=[312476], 99.50th=[312476], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=0, BW=932KiB/s (954kB/s)(7168KiB/7695msec); 0 zone resets clat (msec): min=138, max=3631, avg=952.44, stdev=1221.50 lat (msec): min=138, max=3632, avg=952.52, stdev=1221.47 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 199], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 558], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 936], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1996, max= 4087, per=65.75%, avg=2439.40, stdev=921.25, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=25.00% lat (msec) : 250=25.00%, 500=16.67%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.17%, ctx=98, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2650KiB/s (2714kB/s), 265KiB/s-933KiB/s (271kB/s-956kB/s), io=20.0MiB (20.0MB), run=6939-7727msec WRITE: bw=3711KiB/s (3800kB/s), 667KiB/s-1325KiB/s (683kB/s-1357kB/s), io=28.0MiB (29.4MB), run=6939-7727msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179053: Mon Aug 24 21:12:23 2026 read: IOPS=1, BW=4177KiB/s (4277kB/s)(12.0MiB/2942msec) clat (msec): min=412, max=1224, avg=895.90, stdev=427.75 lat (msec): min=412, max=1224, avg=895.90, stdev=427.75 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.93%, ctx=69, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179054: Mon Aug 24 21:12:23 2026 read: IOPS=0, BW=1645KiB/s (1684kB/s)(4096KiB/2490msec) clat (nsec): min=150366k, max=150366k, avg=150365870.00, stdev= 0.00 lat (nsec): min=150369k, max=150369k, avg=150368533.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 6617, max= 6617, per=100.00%, avg=6617.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3290KiB/s (3369kB/s)(8192KiB/2490msec); 0 zone resets clat (msec): min=817, max=1364, avg=1091.15, stdev=386.70 lat (msec): min=818, max=1365, avg=1091.60, stdev=386.67 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8094, max= 8094, per=64.50%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.22%, ctx=36, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179055: Mon Aug 24 21:12:23 2026 write: IOPS=1, BW=4706KiB/s (4819kB/s)(12.0MiB/2611msec); 0 zone resets clat (msec): min=509, max=1435, avg=840.70, stdev=516.40 lat (msec): min=509, max=1436, avg=841.24, stdev=516.83 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 7937, max= 8143, per=64.07%, avg=8040.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=5.29%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179056: Mon Aug 24 21:12:23 2026 write: IOPS=1, BW=4798KiB/s (4913kB/s)(12.0MiB/2561msec); 0 zone resets clat (msec): min=458, max=1024, avg=824.20, stdev=317.05 lat (msec): min=459, max=1025, avg=824.61, stdev=317.06 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7968, max= 8143, per=64.19%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.41%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5569KiB/s (5703kB/s), 1645KiB/s-4177KiB/s (1684kB/s-4277kB/s), io=16.0MiB (16.8MB), run=2490-2942msec WRITE: bw=12.3MiB/s (12.9MB/s), 3290KiB/s-4798KiB/s (3369kB/s-4913kB/s), io=32.0MiB (33.6MB), run=2490-2611msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179057: Mon Aug 24 21:12:23 2026 read: IOPS=1, BW=5131KiB/s (5254kB/s)(12.0MiB/2395msec) clat (msec): min=674, max=805, avg=723.93, stdev=70.85 lat (msec): min=674, max=805, avg=723.94, stdev=70.85 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7953, max= 8126, per=100.00%, avg=8039.50, stdev=122.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.83%, ctx=844, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179058: Mon Aug 24 21:12:23 2026 read: IOPS=0, BW=1538KiB/s (1575kB/s)(4096KiB/2663msec) clat (nsec): min=701794k, max=701794k, avg=701793562.00, stdev= 0.00 lat (nsec): min=701796k, max=701796k, avg=701796185.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3076KiB/s (3150kB/s)(8192KiB/2663msec); 0 zone resets clat (msec): min=455, max=1287, avg=871.50, stdev=587.75 lat (msec): min=456, max=1291, avg=873.93, stdev=590.66 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8159, max= 8159, per=70.17%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.08%, sys=5.75%, ctx=212, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179059: Mon Aug 24 21:12:23 2026 write: IOPS=1, BW=4361KiB/s (4465kB/s)(12.0MiB/2818msec); 0 zone resets clat (msec): min=276, max=1379, avg=881.91, stdev=559.41 lat (msec): min=276, max=1380, avg=883.63, stdev=560.27 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8110, max= 8159, per=69.96%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.59%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179060: Mon Aug 24 21:12:23 2026 write: IOPS=1, BW=5702KiB/s (5839kB/s)(12.0MiB/2155msec); 0 zone resets clat (msec): min=215, max=1568, avg=688.33, stdev=762.96 lat (msec): min=215, max=1568, avg=688.74, stdev=762.98 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min=13744, max=13744, per=100.00%, avg=13744.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.52%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6152KiB/s (6300kB/s), 1538KiB/s-5131KiB/s (1575kB/s-5254kB/s), io=16.0MiB (16.8MB), run=2395-2663msec WRITE: bw=11.4MiB/s (11.9MB/s), 3076KiB/s-5702KiB/s (3150kB/s-5839kB/s), io=32.0MiB (33.6MB), run=2155-2818msec