== sanity test 398b: DIO and buffer IO race ============== 21:01:12 (1767319272) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.39528 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150728: Thu Jan 1 21:03:04 2026 read: IOPS=16, BW=64.3KiB/s (65.8kB/s)(5992KiB/93221msec) clat (usec): min=103, max=589292, avg=31525.99, stdev=27101.67 lat (usec): min=103, max=589295, avg=31527.15, stdev=27101.71 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 161], 10.00th=[ 449], 20.00th=[ 14877], | 30.00th=[ 19006], 40.00th=[ 22152], 50.00th=[ 27132], 60.00th=[ 32637], | 70.00th=[ 39060], 80.00th=[ 47449], 90.00th=[ 60031], 95.00th=[ 69731], | 99.00th=[ 99091], 99.50th=[115868], 99.90th=[248513], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 15, max= 134, per=25.58%, avg=63.95, stdev=23.09, samples=183 iops : min= 3, max= 33, avg=15.40, stdev= 5.82, samples=183 write: IOPS=16, BW=67.5KiB/s (69.2kB/s)(6296KiB/93221msec); 0 zone resets clat (usec): min=609, max=268823, avg=29134.97, stdev=29704.63 lat (usec): min=610, max=268824, avg=29139.33, stdev=29702.41 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1106], 10.00th=[ 1254], 20.00th=[ 2737], | 30.00th=[ 5473], 40.00th=[ 12125], 50.00th=[ 21365], 60.00th=[ 30540], | 70.00th=[ 39060], 80.00th=[ 52691], 90.00th=[ 69731], 95.00th=[ 86508], | 99.00th=[121111], 99.50th=[133694], 99.90th=[198181], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 15, max= 136, per=25.71%, avg=67.37, stdev=25.40, samples=183 iops : min= 3, max= 34, avg=16.24, stdev= 6.38, samples=183 lat (usec) : 250=4.36%, 500=0.65%, 750=0.23%, 1000=0.55% lat (msec) : 2=7.91%, 4=5.01%, 10=7.19%, 20=14.94%, 50=39.42% lat (msec) : 100=18.03%, 250=1.63%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.95%, ctx=6294, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150729: Thu Jan 1 21:03:04 2026 read: IOPS=15, BW=62.3KiB/s (63.7kB/s)(5940KiB/95417msec) clat (usec): min=62, max=476027, avg=30881.37, stdev=26365.66 lat (usec): min=63, max=476029, avg=30883.85, stdev=26366.16 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 151], 10.00th=[ 293], 20.00th=[ 14222], | 30.00th=[ 18482], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 30802], | 70.00th=[ 37487], 80.00th=[ 45351], 90.00th=[ 60556], 95.00th=[ 70779], | 99.00th=[102237], 99.50th=[119014], 99.90th=[287310], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 6, max= 143, per=25.03%, avg=62.58, stdev=25.11, samples=186 iops : min= 1, max= 35, avg=15.04, stdev= 6.34, samples=186 write: IOPS=16, BW=66.5KiB/s (68.1kB/s)(6348KiB/95417msec); 0 zone resets clat (usec): min=853, max=312508, avg=31155.79, stdev=33207.33 lat (usec): min=855, max=312509, avg=31157.71, stdev=33207.31 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1123], 10.00th=[ 1254], 20.00th=[ 2769], | 30.00th=[ 6259], 40.00th=[ 13829], 50.00th=[ 22676], 60.00th=[ 31327], | 70.00th=[ 40633], 80.00th=[ 53216], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[141558], 99.50th=[189793], 99.90th=[238027], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 15, max= 148, per=25.33%, avg=66.35, stdev=25.70, samples=187 iops : min= 3, max= 37, avg=15.99, stdev= 6.48, samples=187 lat (usec) : 100=0.07%, 250=4.56%, 500=0.52%, 750=0.16%, 1000=0.72% lat (msec) : 2=8.11%, 4=4.33%, 10=6.61%, 20=15.17%, 50=40.27% lat (msec) : 100=17.22%, 250=2.18%, 500=0.10% cpu : usr=0.10%, sys=5.72%, ctx=6259, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150730: Thu Jan 1 21:03:04 2026 read: IOPS=15, BW=63.5KiB/s (64.0kB/s)(6028KiB/94978msec) clat (usec): min=60, max=342353, avg=30987.75, stdev=23782.72 lat (usec): min=60, max=342354, avg=30991.05, stdev=23783.36 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 165], 10.00th=[ 1287], 20.00th=[ 14615], | 30.00th=[ 19268], 40.00th=[ 22938], 50.00th=[ 27132], 60.00th=[ 31327], | 70.00th=[ 37487], 80.00th=[ 45876], 90.00th=[ 58459], 95.00th=[ 67634], | 99.00th=[104334], 99.50th=[133694], 99.90th=[210764], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 15, max= 135, per=25.38%, avg=63.44, stdev=20.74, samples=187 iops : min= 3, max= 33, avg=15.25, stdev= 5.23, samples=187 write: IOPS=16, BW=65.9KiB/s (67.5kB/s)(6260KiB/94978msec); 0 zone resets clat (usec): min=632, max=516851, avg=30777.30, stdev=32107.35 lat (usec): min=633, max=516854, avg=30780.17, stdev=32106.12 clat percentiles (usec): | 1.00th=[ 996], 5.00th=[ 1123], 10.00th=[ 1254], 20.00th=[ 2802], | 30.00th=[ 6652], 40.00th=[ 15795], 50.00th=[ 23987], 60.00th=[ 32113], | 70.00th=[ 41157], 80.00th=[ 53740], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[125305], 99.50th=[147850], 99.90th=[254804], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 8, max= 135, per=24.99%, avg=65.48, stdev=24.36, samples=188 iops : min= 2, max= 33, avg=15.77, stdev= 6.14, samples=188 lat (usec) : 100=0.07%, 250=4.00%, 500=0.62%, 750=0.13%, 1000=0.59% lat (msec) : 2=7.85%, 4=4.75%, 10=5.53%, 20=15.33%, 50=41.80% lat (msec) : 100=17.32%, 250=1.92%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.82%, ctx=6317, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150731: Thu Jan 1 21:03:04 2026 read: IOPS=15, BW=63.1KiB/s (64.6kB/s)(6052KiB/95859msec) clat (usec): min=105, max=258362, avg=30653.87, stdev=22315.14 lat (usec): min=107, max=258364, avg=30657.45, stdev=22314.41 clat percentiles (usec): | 1.00th=[ 131], 5.00th=[ 165], 10.00th=[ 750], 20.00th=[ 14615], | 30.00th=[ 18744], 40.00th=[ 22676], 50.00th=[ 26870], 60.00th=[ 32113], | 70.00th=[ 38011], 80.00th=[ 45876], 90.00th=[ 56886], 95.00th=[ 66847], | 99.00th=[ 99091], 99.50th=[126354], 99.90th=[173016], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 135, per=25.10%, avg=62.74, stdev=22.40, samples=188 iops : min= 1, max= 33, avg=15.08, stdev= 5.67, samples=188 write: IOPS=16, BW=65.1KiB/s (66.6kB/s)(6236KiB/95859msec); 0 zone resets clat (usec): min=756, max=495096, avg=31667.58, stdev=34019.18 lat (usec): min=758, max=495099, avg=31670.42, stdev=34019.30 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1287], 20.00th=[ 2802], | 30.00th=[ 6652], 40.00th=[ 16057], 50.00th=[ 23987], 60.00th=[ 32113], | 70.00th=[ 42206], 80.00th=[ 53216], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[133694], 99.50th=[154141], 99.90th=[274727], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 6, max= 136, per=24.57%, avg=64.38, stdev=22.92, samples=189 iops : min= 1, max= 34, avg=15.49, stdev= 5.80, samples=189 lat (usec) : 250=3.97%, 500=0.78%, 750=0.16%, 1000=0.46% lat (msec) : 2=7.65%, 4=4.39%, 10=6.22%, 20=15.17%, 50=41.60% lat (msec) : 100=17.42%, 250=2.08%, 500=0.10% cpu : usr=0.08%, sys=5.85%, ctx=6445, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=250KiB/s (257kB/s), 62.3KiB/s-64.3KiB/s (63.7kB/s-65.8kB/s), io=23.4MiB (24.6MB), run=93221-95859msec WRITE: bw=262KiB/s (269kB/s), 65.1KiB/s-67.5KiB/s (66.6kB/s-69.2kB/s), io=24.6MiB (25.7MB), run=93221-95859msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150723: Thu Jan 1 21:04:54 2026 read: IOPS=7, BW=29.2KiB/s (29.9kB/s)(5992KiB/205279msec) clat (msec): min=4, max=828, avg=29.52, stdev=31.80 lat (msec): min=4, max=828, avg=29.52, stdev=31.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 61], 95.00th=[ 77], | 99.00th=[ 122], 99.50th=[ 157], 99.90th=[ 245], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 103, per=26.53%, avg=30.78, stdev=19.07, samples=379 iops : min= 1, max= 25, avg= 7.08, stdev= 4.82, samples=379 write: IOPS=7, BW=30.7KiB/s (31.4kB/s)(6296KiB/205279msec); 0 zone resets clat (msec): min=27, max=450, avg=102.11, stdev=48.79 lat (msec): min=27, max=450, avg=102.12, stdev=48.80 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 54], 20.00th=[ 64], | 30.00th=[ 72], 40.00th=[ 80], 50.00th=[ 90], 60.00th=[ 102], | 70.00th=[ 117], 80.00th=[ 138], 90.00th=[ 169], 95.00th=[ 194], | 99.00th=[ 259], 99.50th=[ 313], 99.90th=[ 405], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 80, per=24.99%, avg=30.23, stdev=12.91, samples=405 iops : min= 1, max= 20, avg= 6.94, stdev= 3.28, samples=405 lat (msec) : 10=6.58%, 20=16.31%, 50=22.85%, 100=32.49%, 250=21.13% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.05%, sys=1.44%, ctx=5606, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150724: Thu Jan 1 21:04:54 2026 read: IOPS=7, BW=28.7KiB/s (29.4kB/s)(5940KiB/206621msec) clat (msec): min=4, max=706, avg=29.55, stdev=31.68 lat (msec): min=4, max=706, avg=29.56, stdev=31.68 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 60], 95.00th=[ 78], | 99.00th=[ 122], 99.50th=[ 169], 99.90th=[ 313], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 110, per=26.31%, avg=30.52, stdev=19.74, samples=378 iops : min= 1, max= 27, avg= 7.01, stdev= 4.99, samples=378 write: IOPS=7, BW=30.7KiB/s (31.5kB/s)(6348KiB/206621msec); 0 zone resets clat (msec): min=28, max=372, avg=102.34, stdev=47.22 lat (msec): min=28, max=372, avg=102.34, stdev=47.22 clat percentiles (msec): | 1.00th=[ 38], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 71], 40.00th=[ 81], 50.00th=[ 91], 60.00th=[ 104], | 70.00th=[ 122], 80.00th=[ 140], 90.00th=[ 171], 95.00th=[ 192], | 99.00th=[ 243], 99.50th=[ 266], 99.90th=[ 351], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 71, per=24.90%, avg=30.13, stdev=13.29, samples=408 iops : min= 1, max= 17, avg= 6.91, stdev= 3.36, samples=408 lat (msec) : 10=7.13%, 20=15.92%, 50=22.43%, 100=32.03%, 250=22.01% lat (msec) : 500=0.46%, 750=0.03% cpu : usr=0.04%, sys=1.51%, ctx=5604, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150725: Thu Jan 1 21:04:54 2026 read: IOPS=7, BW=29.4KiB/s (30.1kB/s)(6028KiB/205170msec) clat (msec): min=4, max=294, avg=30.87, stdev=27.28 lat (msec): min=4, max=294, avg=30.88, stdev=27.27 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 62], 95.00th=[ 81], | 99.00th=[ 136], 99.50th=[ 163], 99.90th=[ 271], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 135, per=25.98%, avg=30.14, stdev=19.30, samples=388 iops : min= 1, max= 33, avg= 6.92, stdev= 4.85, samples=388 write: IOPS=7, BW=30.5KiB/s (31.2kB/s)(6260KiB/205170msec); 0 zone resets clat (msec): min=27, max=744, avg=101.15, stdev=49.44 lat (msec): min=27, max=744, avg=101.15, stdev=49.44 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 72], 40.00th=[ 80], 50.00th=[ 89], 60.00th=[ 101], | 70.00th=[ 115], 80.00th=[ 138], 90.00th=[ 167], 95.00th=[ 194], | 99.00th=[ 251], 99.50th=[ 275], 99.90th=[ 384], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 71, per=24.75%, avg=29.95, stdev=13.58, samples=405 iops : min= 1, max= 17, avg= 6.87, stdev= 3.46, samples=405 lat (msec) : 10=6.15%, 20=15.46%, 50=23.50%, 100=33.43%, 250=20.87% lat (msec) : 500=0.55%, 750=0.03% cpu : usr=0.05%, sys=1.49%, ctx=5533, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150726: Thu Jan 1 21:04:54 2026 read: IOPS=7, BW=29.7KiB/s (30.4kB/s)(6052KiB/204031msec) clat (msec): min=4, max=308, avg=29.04, stdev=27.31 lat (msec): min=4, max=308, avg=29.04, stdev=27.31 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 42], 90.00th=[ 58], 95.00th=[ 78], | 99.00th=[ 125], 99.50th=[ 171], 99.90th=[ 292], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 119, per=27.28%, avg=31.64, stdev=19.94, samples=372 iops : min= 1, max= 29, avg= 7.30, stdev= 5.01, samples=372 write: IOPS=7, BW=30.6KiB/s (31.3kB/s)(6236KiB/204031msec); 0 zone resets clat (msec): min=31, max=744, avg=102.48, stdev=48.57 lat (msec): min=31, max=744, avg=102.48, stdev=48.57 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 48], 10.00th=[ 55], 20.00th=[ 65], | 30.00th=[ 73], 40.00th=[ 82], 50.00th=[ 91], 60.00th=[ 103], | 70.00th=[ 117], 80.00th=[ 136], 90.00th=[ 167], 95.00th=[ 194], | 99.00th=[ 243], 99.50th=[ 262], 99.90th=[ 342], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 64, per=24.82%, avg=30.03, stdev=12.45, samples=403 iops : min= 1, max= 16, avg= 6.89, stdev= 3.19, samples=403 lat (msec) : 10=7.00%, 20=16.86%, 50=21.78%, 100=31.84%, 250=22.04% lat (msec) : 500=0.46%, 750=0.03% cpu : usr=0.04%, sys=1.50%, ctx=5518, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=116KiB/s (119kB/s), 28.7KiB/s-29.7KiB/s (29.4kB/s-30.4kB/s), io=23.4MiB (24.6MB), run=204031-206621msec WRITE: bw=122KiB/s (125kB/s), 30.5KiB/s-30.7KiB/s (31.2kB/s-31.5kB/s), io=24.6MiB (25.7MB), run=204031-206621msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150773: Thu Jan 1 21:05:23 2026 read: IOPS=19, BW=314KiB/s (321kB/s)(5920KiB/18878msec) clat (usec): min=114, max=116384, avg=26156.06, stdev=21397.41 lat (usec): min=114, max=116386, avg=26157.33, stdev=21397.35 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 145], 10.00th=[ 159], 20.00th=[ 235], | 30.00th=[ 14877], 40.00th=[ 19530], 50.00th=[ 24511], 60.00th=[ 30016], | 70.00th=[ 34341], 80.00th=[ 42730], 90.00th=[ 53740], 95.00th=[ 64750], | 99.00th=[ 90702], 99.50th=[102237], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 158, max= 538, per=26.65%, avg=313.46, stdev=105.34, samples=37 iops : min= 9, max= 33, avg=18.84, stdev= 6.66, samples=37 write: IOPS=21, BW=337KiB/s (345kB/s)(6368KiB/18878msec); 0 zone resets clat (usec): min=977, max=116190, avg=22681.61, stdev=23027.45 lat (usec): min=978, max=116193, avg=22683.95, stdev=23027.47 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1663], 10.00th=[ 1745], 20.00th=[ 2606], | 30.00th=[ 4817], 40.00th=[ 8225], 50.00th=[ 13829], 60.00th=[ 22938], | 70.00th=[ 30016], 80.00th=[ 41681], 90.00th=[ 59507], 95.00th=[ 68682], | 99.00th=[ 99091], 99.50th=[107480], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 158, max= 631, per=27.30%, avg=337.70, stdev=98.42, samples=37 iops : min= 9, max= 39, avg=20.35, stdev= 6.22, samples=37 lat (usec) : 250=9.90%, 500=0.91%, 750=0.39%, 1000=0.26% lat (msec) : 2=7.94%, 4=7.16%, 10=8.33%, 20=14.71%, 50=36.72% lat (msec) : 100=13.02%, 250=0.65% cpu : usr=0.11%, sys=7.35%, ctx=1355, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150774: Thu Jan 1 21:05:23 2026 read: IOPS=17, BW=286KiB/s (293kB/s)(5744KiB/20049msec) clat (usec): min=95, max=129670, avg=26723.39, stdev=21559.79 lat (usec): min=95, max=129672, avg=26724.57, stdev=21559.84 clat percentiles (usec): | 1.00th=[ 114], 5.00th=[ 135], 10.00th=[ 151], 20.00th=[ 285], | 30.00th=[ 14222], 40.00th=[ 20841], 50.00th=[ 25560], 60.00th=[ 31327], | 70.00th=[ 36439], 80.00th=[ 43779], 90.00th=[ 56361], 95.00th=[ 66323], | 99.00th=[ 79168], 99.50th=[ 88605], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 56, max= 508, per=24.23%, avg=284.95, stdev=97.78, samples=39 iops : min= 3, max= 31, avg=17.03, stdev= 6.14, samples=39 write: IOPS=20, BW=326KiB/s (334kB/s)(6544KiB/20049msec); 0 zone resets clat (usec): min=1053, max=334537, avg=25142.72, stdev=30623.43 lat (usec): min=1054, max=334538, avg=25144.75, stdev=30623.44 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1696], 10.00th=[ 2212], 20.00th=[ 3589], | 30.00th=[ 5800], 40.00th=[ 9241], 50.00th=[ 16319], 60.00th=[ 21890], | 70.00th=[ 31589], 80.00th=[ 43779], 90.00th=[ 60556], 95.00th=[ 78119], | 99.00th=[110625], 99.50th=[132645], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 157, max= 512, per=26.03%, avg=322.05, stdev=91.91, samples=39 iops : min= 9, max= 32, avg=19.36, stdev= 5.79, samples=39 lat (usec) : 100=0.13%, 250=8.98%, 500=1.04%, 750=0.26%, 1000=0.26% lat (msec) : 2=4.95%, 4=7.81%, 10=10.81%, 20=13.41%, 50=38.15% lat (msec) : 100=13.15%, 250=0.91%, 500=0.13% cpu : usr=0.09%, sys=7.40%, ctx=1381, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150775: Thu Jan 1 21:05:23 2026 read: IOPS=19, BW=307KiB/s (315kB/s)(6256KiB/20358msec) clat (usec): min=109, max=116657, avg=26539.31, stdev=21926.11 lat (usec): min=109, max=116658, avg=26540.77, stdev=21926.06 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 151], 10.00th=[ 176], 20.00th=[ 408], | 30.00th=[ 15401], 40.00th=[ 20055], 50.00th=[ 23987], 60.00th=[ 28705], | 70.00th=[ 33817], 80.00th=[ 43779], 90.00th=[ 55313], 95.00th=[ 66323], | 99.00th=[104334], 99.50th=[111674], 99.90th=[116917], 99.95th=[116917], | 99.99th=[116917] bw ( KiB/s): min= 95, max= 542, per=26.25%, avg=308.68, stdev=97.20, samples=40 iops : min= 5, max= 33, avg=18.50, stdev= 6.09, samples=40 write: IOPS=18, BW=296KiB/s (303kB/s)(6032KiB/20358msec); 0 zone resets clat (usec): min=1206, max=278998, avg=26278.44, stdev=28607.56 lat (usec): min=1208, max=279000, avg=26280.78, stdev=28607.42 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1647], 10.00th=[ 2040], 20.00th=[ 3916], | 30.00th=[ 5866], 40.00th=[ 10814], 50.00th=[ 18220], 60.00th=[ 25035], | 70.00th=[ 32375], 80.00th=[ 44827], 90.00th=[ 64226], 95.00th=[ 79168], | 99.00th=[111674], 99.50th=[158335], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 127, max= 445, per=23.68%, avg=292.98, stdev=94.49, samples=40 iops : min= 7, max= 27, avg=17.55, stdev= 6.00, samples=40 lat (usec) : 250=8.85%, 500=1.56%, 750=0.39%, 1000=0.13% lat (msec) : 2=5.21%, 4=5.73%, 10=9.64%, 20=13.28%, 50=40.10% lat (msec) : 100=13.93%, 250=1.04%, 500=0.13% cpu : usr=0.07%, sys=7.01%, ctx=1443, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150776: Thu Jan 1 21:05:23 2026 read: IOPS=19, BW=317KiB/s (324kB/s)(6032KiB/19046msec) clat (usec): min=94, max=103981, avg=25471.81, stdev=20675.60 lat (usec): min=95, max=103982, avg=25473.94, stdev=20675.94 clat percentiles (usec): | 1.00th=[ 112], 5.00th=[ 135], 10.00th=[ 155], 20.00th=[ 241], | 30.00th=[ 14222], 40.00th=[ 20055], 50.00th=[ 24773], 60.00th=[ 29230], | 70.00th=[ 35390], 80.00th=[ 42730], 90.00th=[ 53740], 95.00th=[ 60556], | 99.00th=[ 84411], 99.50th=[ 90702], 99.90th=[104334], 99.95th=[104334], | 99.99th=[104334] bw ( KiB/s): min= 111, max= 576, per=26.86%, avg=315.84, stdev=95.69, samples=37 iops : min= 6, max= 36, avg=18.95, stdev= 6.05, samples=37 write: IOPS=20, BW=328KiB/s (336kB/s)(6256KiB/19046msec); 0 zone resets clat (usec): min=1082, max=318657, avg=23694.95, stdev=27170.41 lat (usec): min=1083, max=318659, avg=23717.55, stdev=27192.09 clat percentiles (usec): | 1.00th=[ 1352], 5.00th=[ 1680], 10.00th=[ 2180], 20.00th=[ 3785], | 30.00th=[ 5866], 40.00th=[ 8291], 50.00th=[ 13566], 60.00th=[ 20841], | 70.00th=[ 30802], 80.00th=[ 45351], 90.00th=[ 56361], 95.00th=[ 68682], | 99.00th=[ 94897], 99.50th=[105382], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 127, max= 667, per=26.46%, avg=327.35, stdev=116.26, samples=37 iops : min= 7, max= 41, avg=19.70, stdev= 7.33, samples=37 lat (usec) : 100=0.26%, 250=9.77%, 500=1.43%, 750=0.13%, 1000=0.13% lat (msec) : 2=5.47%, 4=6.38%, 10=12.37%, 20=13.80%, 50=35.42% lat (msec) : 100=14.32%, 250=0.39%, 500=0.13% cpu : usr=0.09%, sys=7.42%, ctx=1368, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1177KiB/s (1205kB/s), 286KiB/s-317KiB/s (293kB/s-324kB/s), io=23.4MiB (24.5MB), run=18878-20358msec WRITE: bw=1238KiB/s (1268kB/s), 296KiB/s-337KiB/s (303kB/s-345kB/s), io=24.6MiB (25.8MB), run=18878-20358msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150778: Thu Jan 1 21:05:52 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5920KiB/48956msec) clat (msec): min=5, max=271, avg=28.79, stdev=31.07 lat (msec): min=5, max=271, avg=28.79, stdev=31.07 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 22], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 65], 95.00th=[ 87], | 99.00th=[ 159], 99.50th=[ 190], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 382, per=25.79%, avg=125.09, stdev=71.08, samples=92 iops : min= 1, max= 23, avg= 7.10, stdev= 4.46, samples=92 write: IOPS=8, BW=130KiB/s (133kB/s)(6368KiB/48956msec); 0 zone resets clat (msec): min=29, max=361, avg=96.15, stdev=41.34 lat (msec): min=29, max=361, avg=96.16, stdev=41.34 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 47], 10.00th=[ 54], 20.00th=[ 65], | 30.00th=[ 71], 40.00th=[ 80], 50.00th=[ 88], 60.00th=[ 96], | 70.00th=[ 109], 80.00th=[ 128], 90.00th=[ 148], 95.00th=[ 169], | 99.00th=[ 245], 99.50th=[ 249], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 250, per=25.36%, avg=129.60, stdev=54.50, samples=96 iops : min= 1, max= 15, avg= 7.37, stdev= 3.51, samples=96 lat (msec) : 10=9.24%, 20=17.58%, 50=17.19%, 100=36.07%, 250=19.66% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.73%, ctx=1415, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150779: Thu Jan 1 21:05:52 2026 read: IOPS=7, BW=117KiB/s (119kB/s)(5744KiB/49304msec) clat (msec): min=5, max=179, avg=27.04, stdev=25.39 lat (msec): min=5, max=179, avg=27.04, stdev=25.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 28], 80.00th=[ 39], 90.00th=[ 62], 95.00th=[ 79], | 99.00th=[ 122], 99.50th=[ 144], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 26, max= 318, per=25.58%, avg=124.07, stdev=79.25, samples=90 iops : min= 1, max= 19, avg= 7.03, stdev= 4.99, samples=90 write: IOPS=8, BW=133KiB/s (136kB/s)(6544KiB/49304msec); 0 zone resets clat (msec): min=31, max=312, avg=96.72, stdev=43.28 lat (msec): min=31, max=312, avg=96.72, stdev=43.28 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 47], 10.00th=[ 55], 20.00th=[ 63], | 30.00th=[ 71], 40.00th=[ 78], 50.00th=[ 86], 60.00th=[ 95], | 70.00th=[ 107], 80.00th=[ 127], 90.00th=[ 157], 95.00th=[ 184], | 99.00th=[ 239], 99.50th=[ 251], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 256, per=25.68%, avg=131.21, stdev=54.37, samples=97 iops : min= 1, max= 16, avg= 7.47, stdev= 3.49, samples=97 lat (msec) : 10=6.77%, 20=20.83%, 50=14.97%, 100=36.85%, 250=20.18% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.70%, ctx=1415, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150780: Thu Jan 1 21:05:52 2026 read: IOPS=8, BW=135KiB/s (139kB/s)(6256KiB/46240msec) clat (msec): min=6, max=145, avg=24.31, stdev=19.98 lat (msec): min=6, max=145, avg=24.31, stdev=19.98 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 33], 90.00th=[ 53], 95.00th=[ 64], | 99.00th=[ 121], 99.50th=[ 128], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 31, max= 448, per=28.68%, avg=139.10, stdev=87.38, samples=89 iops : min= 1, max= 28, avg= 7.99, stdev= 5.55, samples=89 write: IOPS=8, BW=130KiB/s (134kB/s)(6032KiB/46240msec); 0 zone resets clat (msec): min=25, max=269, avg=97.35, stdev=44.19 lat (msec): min=25, max=269, avg=97.36, stdev=44.20 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 52], 20.00th=[ 63], | 30.00th=[ 71], 40.00th=[ 78], 50.00th=[ 87], 60.00th=[ 96], | 70.00th=[ 109], 80.00th=[ 126], 90.00th=[ 161], 95.00th=[ 190], | 99.00th=[ 251], 99.50th=[ 264], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 288, per=25.47%, avg=130.14, stdev=54.07, samples=91 iops : min= 1, max= 18, avg= 7.42, stdev= 3.47, samples=91 lat (msec) : 10=6.38%, 20=23.18%, 50=20.05%, 100=31.38%, 250=18.49% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.60%, ctx=1352, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150781: Thu Jan 1 21:05:52 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48742msec) clat (msec): min=5, max=258, avg=26.84, stdev=26.88 lat (msec): min=5, max=258, avg=26.84, stdev=26.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 35], 90.00th=[ 56], 95.00th=[ 81], | 99.00th=[ 134], 99.50th=[ 153], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 383, per=26.05%, avg=126.35, stdev=78.60, samples=93 iops : min= 1, max= 23, avg= 7.17, stdev= 4.97, samples=93 write: IOPS=8, BW=128KiB/s (131kB/s)(6256KiB/48742msec); 0 zone resets clat (msec): min=32, max=361, avg=98.69, stdev=44.74 lat (msec): min=32, max=361, avg=98.69, stdev=44.74 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 49], 10.00th=[ 54], 20.00th=[ 64], | 30.00th=[ 71], 40.00th=[ 81], 50.00th=[ 89], 60.00th=[ 99], | 70.00th=[ 109], 80.00th=[ 128], 90.00th=[ 157], 95.00th=[ 184], | 99.00th=[ 253], 99.50th=[ 275], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 254, per=25.11%, avg=128.30, stdev=53.74, samples=96 iops : min= 1, max= 15, avg= 7.29, stdev= 3.45, samples=96 lat (msec) : 10=7.03%, 20=20.83%, 50=18.75%, 100=32.16%, 250=20.57% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.57%, ctx=1363, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=486KiB/s (497kB/s), 117KiB/s-135KiB/s (119kB/s-139kB/s), io=23.4MiB (24.5MB), run=46240-49304msec WRITE: bw=511KiB/s (523kB/s), 128KiB/s-133KiB/s (131kB/s-136kB/s), io=24.6MiB (25.8MB), run=46240-49304msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150805: Thu Jan 1 21:06:06 2026 read: IOPS=1, BW=1775KiB/s (1818kB/s)(7168KiB/4038msec) clat (msec): min=99, max=573, avg=255.33, stdev=157.59 lat (msec): min=99, max=573, avg=255.33, stdev=157.59 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 123], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 247], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 296], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1358, max= 4055, per=72.09%, avg=2821.00, stdev=1343.33, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1268KiB/s (1298kB/s)(5120KiB/4038msec); 0 zone resets clat (msec): min=261, max=671, avg=407.66, stdev=163.64 lat (msec): min=261, max=672, avg=407.78, stdev=163.62 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1885, max= 3618, per=43.08%, avg=2360.50, stdev=839.84, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=3.77%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150806: Thu Jan 1 21:06:06 2026 read: IOPS=0, BW=391KiB/s (401kB/s)(2048KiB/5233msec) clat (msec): min=108, max=442, avg=275.59, stdev=236.39 lat (msec): min=108, max=442, avg=275.59, stdev=236.39 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1391, max= 1885, per=41.86%, avg=1638.00, stdev=349.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1957KiB/s (2004kB/s)(10.0MiB/5233msec); 0 zone resets clat (msec): min=218, max=1156, avg=452.68, stdev=293.61 lat (msec): min=218, max=1156, avg=452.84, stdev=293.65 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 228], | 30.00th=[ 243], 40.00th=[ 268], 50.00th=[ 334], 60.00th=[ 363], | 70.00th=[ 447], 80.00th=[ 575], 90.00th=[ 693], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1391, max= 4047, per=40.30%, avg=2207.86, stdev=843.25, samples=7 iops : min= 1, max= 3, avg= 1.43, stdev= 0.79, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=4.45%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150807: Thu Jan 1 21:06:06 2026 read: IOPS=1, BW=1181KiB/s (1210kB/s)(6144KiB/5201msec) clat (msec): min=90, max=664, avg=293.45, stdev=208.44 lat (msec): min=90, max=664, avg=293.46, stdev=208.44 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 288], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1809, max= 2023, per=49.72%, avg=1945.40, stdev=94.06, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1181KiB/s (1210kB/s)(6144KiB/5201msec); 0 zone resets clat (msec): min=188, max=1779, avg=549.42, stdev=610.80 lat (msec): min=188, max=1779, avg=549.58, stdev=610.75 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 309], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1809, max= 2771, per=38.73%, avg=2122.00, stdev=441.64, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.85%, ctx=84, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150808: Thu Jan 1 21:06:06 2026 read: IOPS=1, BW=1217KiB/s (1246kB/s)(5120KiB/4207msec) clat (msec): min=170, max=364, avg=265.95, stdev=86.07 lat (msec): min=170, max=364, avg=265.96, stdev=86.07 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1809, max= 4096, per=66.76%, avg=2612.33, stdev=1286.36, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1704KiB/s (1745kB/s)(7168KiB/4207msec); 0 zone resets clat (msec): min=183, max=780, avg=408.04, stdev=208.20 lat (msec): min=183, max=780, avg=408.14, stdev=208.21 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 253], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 351], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 527], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1885, max= 2868, per=39.13%, avg=2143.80, stdev=408.86, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=3.54%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3914KiB/s (4008kB/s), 391KiB/s-1775KiB/s (401kB/s-1818kB/s), io=20.0MiB (20.0MB), run=4038-5233msec WRITE: bw=5479KiB/s (5611kB/s), 1181KiB/s-1957KiB/s (1210kB/s-2004kB/s), io=28.0MiB (29.4MB), run=4038-5233msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150810: Thu Jan 1 21:06:06 2026 read: IOPS=1, BW=1577KiB/s (1615kB/s)(7168KiB/4546msec) clat (usec): min=625, max=496456, avg=286885.47, stdev=163081.99 lat (usec): min=626, max=496457, avg=286886.98, stdev=163082.14 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[198181], | 30.00th=[250610], 40.00th=[250610], 50.00th=[274727], 60.00th=[375391], | 70.00th=[375391], 80.00th=[413139], 90.00th=[497026], 95.00th=[497026], | 99.00th=[497026], 99.50th=[497026], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 2027, max= 6131, per=100.00%, avg=4081.67, stdev=2052.01, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1126KiB/s (1153kB/s)(5120KiB/4546msec); 0 zone resets clat (msec): min=297, max=959, avg=451.17, stdev=284.92 lat (msec): min=297, max=959, avg=451.27, stdev=284.91 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 961], 95.00th=[ 961], | 99.00th=[ 961], 99.50th=[ 961], 99.90th=[ 961], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 1818, max= 3976, per=45.86%, avg=2563.33, stdev=1224.03, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=8.33%, 500=75.00%, 1000=8.33% cpu : usr=0.02%, sys=10.14%, ctx=256, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150811: Thu Jan 1 21:06:06 2026 read: IOPS=0, BW=399KiB/s (409kB/s)(2048KiB/5129msec) clat (msec): min=282, max=292, avg=287.32, stdev= 6.68 lat (msec): min=282, max=292, avg=287.32, stdev= 6.68 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1505, max= 2027, per=44.24%, avg=1766.00, stdev=369.11, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1996KiB/s (2044kB/s)(10.0MiB/5129msec); 0 zone resets clat (msec): min=141, max=1029, avg=428.70, stdev=280.97 lat (msec): min=141, max=1029, avg=428.81, stdev=280.96 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 220], | 30.00th=[ 230], 40.00th=[ 257], 50.00th=[ 313], 60.00th=[ 321], | 70.00th=[ 422], 80.00th=[ 659], 90.00th=[ 701], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1896, max= 4096, per=46.84%, avg=2618.33, stdev=979.03, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=11.37%, ctx=162, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150812: Thu Jan 1 21:06:06 2026 read: IOPS=1, BW=1430KiB/s (1464kB/s)(6144KiB/4296msec) clat (usec): min=871, max=489207, avg=200776.37, stdev=228126.02 lat (usec): min=872, max=489208, avg=200777.73, stdev=228126.05 clat percentiles (usec): | 1.00th=[ 873], 5.00th=[ 873], 10.00th=[ 873], 20.00th=[ 1713], | 30.00th=[ 1713], 40.00th=[ 1958], 50.00th=[ 1958], 60.00th=[283116], | 70.00th=[425722], 80.00th=[425722], 90.00th=[488637], 95.00th=[488637], | 99.00th=[488637], 99.50th=[488637], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 1988, max= 5688, per=81.02%, avg=3234.33, stdev=2125.03, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1430KiB/s (1464kB/s)(6144KiB/4296msec); 0 zone resets clat (msec): min=197, max=1721, avg=484.44, stdev=607.89 lat (msec): min=197, max=1721, avg=484.55, stdev=607.90 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 249], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 1514, max= 3792, per=41.76%, avg=2334.25, stdev=1000.43, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 250=33.33%, 500=33.33%, 2000=8.33% cpu : usr=0.00%, sys=8.82%, ctx=155, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150813: Thu Jan 1 21:06:06 2026 read: IOPS=1, BW=1241KiB/s (1271kB/s)(5120KiB/4126msec) clat (usec): min=708, max=326342, avg=102108.02, stdev=147430.62 lat (usec): min=709, max=326343, avg=102111.32, stdev=147428.84 clat percentiles (usec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 791], 40.00th=[ 791], 50.00th=[ 2245], 60.00th=[ 2245], | 70.00th=[181404], 80.00th=[181404], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 3976, max= 4055, per=100.00%, avg=4015.50, stdev=55.86, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1737KiB/s (1779kB/s)(7168KiB/4126msec); 0 zone resets clat (msec): min=170, max=1057, avg=507.85, stdev=358.18 lat (msec): min=170, max=1058, avg=508.47, stdev=358.23 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 228], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 296], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 844], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1490, max= 2043, per=33.51%, avg=1873.20, stdev=232.14, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=9.41%, ctx=128, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3993KiB/s (4089kB/s), 399KiB/s-1577KiB/s (409kB/s-1615kB/s), io=20.0MiB (20.0MB), run=4126-5129msec WRITE: bw=5590KiB/s (5724kB/s), 1126KiB/s-1996KiB/s (1153kB/s-2044kB/s), io=28.0MiB (29.4MB), run=4126-5129msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150822: Thu Jan 1 21:06:20 2026 read: IOPS=1, BW=4616KiB/s (4727kB/s)(12.0MiB/2662msec) clat (msec): min=674, max=1021, avg=814.71, stdev=183.01 lat (msec): min=674, max=1021, avg=814.71, stdev=183.01 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8047, max= 8192, per=100.00%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.72%, ctx=294, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150823: Thu Jan 1 21:06:20 2026 read: IOPS=0, BW=1472KiB/s (1507kB/s)(4096KiB/2783msec) clat (nsec): min=732455k, max=732455k, avg=732454932.00, stdev= 0.00 lat (nsec): min=732458k, max=732458k, avg=732457600.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2944KiB/s (3014kB/s)(8192KiB/2783msec); 0 zone resets clat (msec): min=355, max=1472, avg=914.15, stdev=790.14 lat (msec): min=355, max=1473, avg=914.55, stdev=790.05 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 1469], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8159, max= 8159, per=69.30%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=6.69%, ctx=125, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150825: Thu Jan 1 21:06:20 2026 write: IOPS=1, BW=4460KiB/s (4567kB/s)(12.0MiB/2755msec); 0 zone resets clat (msec): min=653, max=1024, avg=876.39, stdev=196.27 lat (msec): min=654, max=1024, avg=879.44, stdev=197.78 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 8143, max= 8159, per=69.23%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.13%, ctx=85, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150827: Thu Jan 1 21:06:20 2026 write: IOPS=1, BW=5251KiB/s (5377kB/s)(12.0MiB/2340msec); 0 zone resets clat (msec): min=283, max=1518, avg=715.92, stdev=695.81 lat (msec): min=284, max=1519, avg=716.38, stdev=695.90 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 6282, max= 8192, per=61.47%, avg=7237.00, stdev=1350.57, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.17%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5887KiB/s (6028kB/s), 1472KiB/s-4616KiB/s (1507kB/s-4727kB/s), io=16.0MiB (16.8MB), run=2662-2783msec WRITE: bw=11.5MiB/s (12.1MB/s), 2944KiB/s-5251KiB/s (3014kB/s-5377kB/s), io=32.0MiB (33.6MB), run=2340-2783msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150821: Thu Jan 1 21:06:21 2026 read: IOPS=0, BW=3049KiB/s (3122kB/s)(12.0MiB/4030msec) clat (msec): min=823, max=1547, avg=1240.48, stdev=374.44 lat (msec): min=823, max=1547, avg=1240.48, stdev=374.44 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8031, max= 8094, per=100.00%, avg=8062.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.33%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150824: Thu Jan 1 21:06:21 2026 read: IOPS=0, BW=1115KiB/s (1142kB/s)(4096KiB/3673msec) clat (nsec): min=1732.2M, max=1732.2M, avg=1732162644.00, stdev= 0.00 lat (nsec): min=1732.2M, max=1732.2M, avg=1732164861.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1737], 5.00th=[ 1737], 10.00th=[ 1737], 20.00th=[ 1737], | 30.00th=[ 1737], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2230KiB/s (2284kB/s)(8192KiB/3673msec); 0 zone resets clat (msec): min=459, max=1251, avg=855.70, stdev=560.45 lat (msec): min=459, max=1253, avg=856.63, stdev=561.45 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8031, max= 8031, per=91.18%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.53%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150826: Thu Jan 1 21:06:21 2026 write: IOPS=0, BW=3303KiB/s (3383kB/s)(12.0MiB/3720msec); 0 zone resets clat (msec): min=813, max=1408, avg=1183.39, stdev=322.56 lat (msec): min=814, max=1408, avg=1183.82, stdev=322.56 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8110, max= 8175, per=92.44%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.25%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150828: Thu Jan 1 21:06:21 2026 write: IOPS=1, BW=4534KiB/s (4643kB/s)(12.0MiB/2710msec); 0 zone resets clat (msec): min=405, max=1553, avg=849.41, stdev=616.51 lat (msec): min=406, max=1554, avg=850.11, stdev=616.71 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8143, max= 8175, per=92.63%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.29%, ctx=34, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4066KiB/s (4163kB/s), 1115KiB/s-3049KiB/s (1142kB/s-3122kB/s), io=16.0MiB (16.8MB), run=3673-4030msec WRITE: bw=8809KiB/s (9020kB/s), 2230KiB/s-4534KiB/s (2284kB/s-4643kB/s), io=32.0MiB (33.6MB), run=2710-3720msec