== sanity test 398b: DIO and buffer IO race ============== 22:43:19 (1775875399) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.54248 s, 14.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147359: Fri Apr 10 22:44:49 2026 read: IOPS=19, BW=77.1KiB/s (78.0kB/s)(5992KiB/77687msec) clat (usec): min=33, max=521134, avg=25176.89, stdev=21024.85 lat (usec): min=33, max=521135, avg=25181.36, stdev=21024.29 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 69], 10.00th=[ 359], 20.00th=[ 12911], | 30.00th=[ 15926], 40.00th=[ 18482], 50.00th=[ 22152], 60.00th=[ 25822], | 70.00th=[ 30540], 80.00th=[ 36963], 90.00th=[ 45351], 95.00th=[ 56886], | 99.00th=[ 79168], 99.50th=[ 98042], 99.90th=[115868], 99.95th=[522191], | 99.99th=[522191] bw ( KiB/s): min= 15, max= 143, per=25.21%, avg=76.62, stdev=24.02, samples=154 iops : min= 3, max= 35, avg=18.62, stdev= 6.03, samples=154 write: IOPS=20, BW=81.0KiB/s (82.0kB/s)(6296KiB/77687msec); 0 zone resets clat (usec): min=792, max=308791, avg=25162.32, stdev=25565.09 lat (usec): min=792, max=308792, avg=25165.77, stdev=25565.23 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1483], 10.00th=[ 1893], 20.00th=[ 3458], | 30.00th=[ 6325], 40.00th=[ 13566], 50.00th=[ 19006], 60.00th=[ 25560], | 70.00th=[ 33162], 80.00th=[ 42730], 90.00th=[ 56361], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[135267], 99.90th=[248513], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 160, per=25.47%, avg=81.01, stdev=26.52, samples=153 iops : min= 7, max= 40, avg=19.72, stdev= 6.64, samples=153 lat (usec) : 50=0.52%, 100=3.52%, 250=0.78%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=5.47%, 4=6.02%, 10=8.33%, 20=23.40%, 50=40.98% lat (msec) : 100=9.77%, 250=0.78%, 500=0.03%, 750=0.03% cpu : usr=0.14%, sys=9.98%, ctx=7046, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147360: Fri Apr 10 22:44:49 2026 read: IOPS=18, BW=75.6KiB/s (77.4kB/s)(5940KiB/78609msec) clat (usec): min=23, max=252247, avg=26504.64, stdev=19957.37 lat (usec): min=23, max=252249, avg=26507.14, stdev=19957.62 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 72], 10.00th=[ 8225], 20.00th=[ 13173], | 30.00th=[ 16319], 40.00th=[ 19006], 50.00th=[ 23200], 60.00th=[ 27132], | 70.00th=[ 32113], 80.00th=[ 38011], 90.00th=[ 46924], 95.00th=[ 58983], | 99.00th=[ 94897], 99.50th=[115868], 99.90th=[185598], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 160, per=24.72%, avg=75.14, stdev=26.10, samples=156 iops : min= 1, max= 40, avg=18.24, stdev= 6.57, samples=156 write: IOPS=20, BW=80.8KiB/s (82.7kB/s)(6348KiB/78609msec); 0 zone resets clat (usec): min=949, max=624153, avg=24511.01, stdev=28750.82 lat (usec): min=950, max=624155, avg=24513.17, stdev=28750.71 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1549], 10.00th=[ 1991], 20.00th=[ 3490], | 30.00th=[ 6325], 40.00th=[ 12387], 50.00th=[ 18220], 60.00th=[ 24773], | 70.00th=[ 31851], 80.00th=[ 41157], 90.00th=[ 54264], 95.00th=[ 66323], | 99.00th=[100140], 99.50th=[121111], 99.90th=[274727], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 152, per=25.17%, avg=80.04, stdev=28.30, samples=156 iops : min= 1, max= 38, avg=19.47, stdev= 7.08, samples=156 lat (usec) : 50=0.65%, 100=2.93%, 250=0.68%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.24%, 4=6.15%, 10=8.92%, 20=22.92%, 50=41.63% lat (msec) : 100=9.70%, 250=0.81%, 500=0.10%, 750=0.03% cpu : usr=0.11%, sys=9.96%, ctx=7240, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147362: Fri Apr 10 22:44:49 2026 read: IOPS=19, BW=76.4KiB/s (78.3kB/s)(6028KiB/78872msec) clat (usec): min=28, max=355257, avg=25632.14, stdev=20370.87 lat (usec): min=28, max=355259, avg=25636.57, stdev=20370.45 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 72], 10.00th=[ 6980], 20.00th=[ 12780], | 30.00th=[ 15795], 40.00th=[ 18744], 50.00th=[ 22152], 60.00th=[ 25822], | 70.00th=[ 31327], 80.00th=[ 36963], 90.00th=[ 46400], 95.00th=[ 56886], | 99.00th=[ 91751], 99.50th=[104334], 99.90th=[250610], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 23, max= 144, per=25.27%, avg=76.83, stdev=24.85, samples=154 iops : min= 5, max= 36, avg=18.67, stdev= 6.24, samples=154 write: IOPS=19, BW=79.4KiB/s (81.3kB/s)(6260KiB/78872msec); 0 zone resets clat (usec): min=856, max=728129, avg=25501.41, stdev=29651.38 lat (usec): min=857, max=728131, avg=25503.86, stdev=29651.39 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1532], 10.00th=[ 2008], 20.00th=[ 3458], | 30.00th=[ 6521], 40.00th=[ 13829], 50.00th=[ 20055], 60.00th=[ 25822], | 70.00th=[ 33162], 80.00th=[ 42730], 90.00th=[ 55837], 95.00th=[ 69731], | 99.00th=[100140], 99.50th=[124257], 99.90th=[189793], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 8, max= 152, per=24.92%, avg=79.25, stdev=26.46, samples=155 iops : min= 2, max= 38, avg=19.27, stdev= 6.63, samples=155 lat (usec) : 50=0.62%, 100=3.09%, 250=0.85%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=4.92%, 4=6.48%, 10=8.07%, 20=22.33%, 50=42.55% lat (msec) : 100=9.96%, 250=0.75%, 500=0.03%, 750=0.03% cpu : usr=0.11%, sys=9.83%, ctx=7222, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147364: Fri Apr 10 22:44:49 2026 read: IOPS=19, BW=78.1KiB/s (80.0kB/s)(6052KiB/77460msec) clat (usec): min=35, max=287130, avg=24817.89, stdev=18297.29 lat (usec): min=35, max=287131, avg=24819.38, stdev=18297.23 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 74], 10.00th=[ 6587], 20.00th=[ 12911], | 30.00th=[ 16057], 40.00th=[ 18744], 50.00th=[ 21627], 60.00th=[ 25035], | 70.00th=[ 29754], 80.00th=[ 35390], 90.00th=[ 44827], 95.00th=[ 53740], | 99.00th=[ 78119], 99.50th=[ 90702], 99.90th=[198181], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 15, max= 151, per=25.84%, avg=78.56, stdev=27.48, samples=151 iops : min= 3, max= 37, avg=19.10, stdev= 6.91, samples=151 write: IOPS=20, BW=80.5KiB/s (82.4kB/s)(6236KiB/77460msec); 0 zone resets clat (usec): min=831, max=703007, avg=25373.14, stdev=30022.58 lat (usec): min=833, max=703010, avg=25374.96, stdev=30022.59 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1450], 10.00th=[ 1926], 20.00th=[ 3556], | 30.00th=[ 6652], 40.00th=[ 12649], 50.00th=[ 18744], 60.00th=[ 25297], | 70.00th=[ 32900], 80.00th=[ 42206], 90.00th=[ 57410], 95.00th=[ 70779], | 99.00th=[112722], 99.50th=[128451], 99.90th=[229639], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 8, max= 144, per=25.33%, avg=80.55, stdev=26.56, samples=152 iops : min= 2, max= 36, avg=19.61, stdev= 6.67, samples=152 lat (usec) : 50=0.62%, 100=3.03%, 250=0.91%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.27%, 4=5.60%, 10=8.98%, 20=23.67%, 50=41.47% lat (msec) : 100=9.21%, 250=0.85%, 500=0.03%, 750=0.03% cpu : usr=0.12%, sys=9.93%, ctx=7036, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=304KiB/s (312kB/s), 75.6KiB/s-78.1KiB/s (77.4kB/s-80.0kB/s), io=23.4MiB (24.6MB), run=77460-78872msec WRITE: bw=319KiB/s (326kB/s), 79.4KiB/s-81.0KiB/s (81.3kB/s-82.0kB/s), io=24.6MiB (25.7MB), run=77460-78872msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147361: Fri Apr 10 22:46:09 2026 read: IOPS=9, BW=38.2KiB/s (39.2kB/s)(5992KiB/156700msec) clat (msec): min=4, max=546, avg=24.32, stdev=25.65 lat (msec): min=4, max=546, avg=24.33, stdev=25.65 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 46], 95.00th=[ 67], | 99.00th=[ 129], 99.50th=[ 155], 99.90th=[ 220], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 7, max= 127, per=25.55%, avg=38.58, stdev=24.33, samples=304 iops : min= 1, max= 31, avg= 9.09, stdev= 6.14, samples=304 write: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6296KiB/156700msec); 0 zone resets clat (msec): min=27, max=430, avg=76.20, stdev=36.96 lat (msec): min=27, max=430, avg=76.20, stdev=36.96 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 39], 10.00th=[ 42], 20.00th=[ 48], | 30.00th=[ 54], 40.00th=[ 61], 50.00th=[ 67], 60.00th=[ 74], | 70.00th=[ 85], 80.00th=[ 101], 90.00th=[ 125], 95.00th=[ 144], | 99.00th=[ 197], 99.50th=[ 253], 99.90th=[ 363], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 95, per=25.14%, avg=39.73, stdev=16.39, samples=310 iops : min= 1, max= 23, avg= 9.38, stdev= 4.16, samples=310 lat (msec) : 10=8.92%, 20=19.53%, 50=27.77%, 100=32.91%, 250=10.55% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.08%, sys=2.63%, ctx=5662, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147363: Fri Apr 10 22:46:09 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(5940KiB/158692msec) clat (msec): min=4, max=651, avg=24.12, stdev=28.23 lat (msec): min=4, max=651, avg=24.12, stdev=28.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 46], 95.00th=[ 61], | 99.00th=[ 112], 99.50th=[ 167], 99.90th=[ 309], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 120, per=25.59%, avg=38.64, stdev=23.26, samples=301 iops : min= 1, max= 30, avg= 9.12, stdev= 5.84, samples=301 write: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6348KiB/158692msec); 0 zone resets clat (msec): min=27, max=323, avg=77.21, stdev=35.68 lat (msec): min=27, max=323, avg=77.22, stdev=35.68 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 39], 10.00th=[ 44], 20.00th=[ 50], | 30.00th=[ 56], 40.00th=[ 61], 50.00th=[ 68], 60.00th=[ 75], | 70.00th=[ 87], 80.00th=[ 101], 90.00th=[ 127], 95.00th=[ 146], | 99.00th=[ 194], 99.50th=[ 230], 99.90th=[ 279], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 79, per=25.00%, avg=39.50, stdev=16.06, samples=314 iops : min= 1, max= 19, avg= 9.32, stdev= 4.09, samples=314 lat (msec) : 10=8.76%, 20=20.57%, 50=25.85%, 100=33.92%, 250=10.64% lat (msec) : 500=0.23%, 750=0.03% cpu : usr=0.08%, sys=2.52%, ctx=5633, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147365: Fri Apr 10 22:46:09 2026 read: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6028KiB/157795msec) clat (msec): min=4, max=217, avg=24.88, stdev=22.49 lat (msec): min=4, max=217, avg=24.88, stdev=22.49 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 33], 90.00th=[ 51], 95.00th=[ 66], | 99.00th=[ 121], 99.50th=[ 157], 99.90th=[ 209], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 7, max= 126, per=25.23%, avg=38.10, stdev=22.01, samples=309 iops : min= 1, max= 31, avg= 8.98, stdev= 5.57, samples=309 write: IOPS=9, BW=39.7KiB/s (40.6kB/s)(6260KiB/157795msec); 0 zone resets clat (msec): min=22, max=705, avg=76.67, stdev=37.96 lat (msec): min=22, max=705, avg=76.67, stdev=37.96 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 39], 10.00th=[ 43], 20.00th=[ 50], | 30.00th=[ 56], 40.00th=[ 62], 50.00th=[ 68], 60.00th=[ 77], | 70.00th=[ 87], 80.00th=[ 100], 90.00th=[ 118], 95.00th=[ 142], | 99.00th=[ 199], 99.50th=[ 230], 99.90th=[ 330], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 72, per=24.81%, avg=39.20, stdev=16.23, samples=312 iops : min= 1, max= 18, avg= 9.25, stdev= 4.12, samples=312 lat (msec) : 10=8.17%, 20=19.08%, 50=27.28%, 100=34.86%, 250=10.42% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=2.60%, ctx=5604, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147366: Fri Apr 10 22:46:09 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6052KiB/156472msec) clat (msec): min=5, max=306, avg=23.40, stdev=21.66 lat (msec): min=5, max=306, avg=23.41, stdev=21.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 21], | 70.00th=[ 24], 80.00th=[ 31], 90.00th=[ 47], 95.00th=[ 62], | 99.00th=[ 109], 99.50th=[ 131], 99.90th=[ 228], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 136, per=26.11%, avg=39.42, stdev=24.34, samples=301 iops : min= 1, max= 34, avg= 9.30, stdev= 6.13, samples=301 write: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6236KiB/156472msec); 0 zone resets clat (msec): min=26, max=695, avg=77.44, stdev=40.01 lat (msec): min=26, max=695, avg=77.44, stdev=40.01 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 39], 10.00th=[ 43], 20.00th=[ 50], | 30.00th=[ 55], 40.00th=[ 61], 50.00th=[ 67], 60.00th=[ 75], | 70.00th=[ 87], 80.00th=[ 102], 90.00th=[ 126], 95.00th=[ 144], | 99.00th=[ 205], 99.50th=[ 257], 99.90th=[ 435], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 72, per=24.97%, avg=39.45, stdev=16.15, samples=310 iops : min= 1, max= 18, avg= 9.31, stdev= 4.11, samples=310 lat (msec) : 10=9.11%, 20=20.31%, 50=26.33%, 100=33.33%, 250=10.58% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.07%, sys=2.60%, ctx=5751, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=151KiB/s (155kB/s), 37.4KiB/s-38.7KiB/s (38.3kB/s-39.6kB/s), io=23.4MiB (24.6MB), run=156472-158692msec WRITE: bw=158KiB/s (162kB/s), 39.7KiB/s-40.2KiB/s (40.6kB/s-41.1kB/s), io=24.6MiB (25.7MB), run=156472-158692msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147410: Fri Apr 10 22:46:31 2026 read: IOPS=22, BW=359KiB/s (368kB/s)(5920KiB/16487msec) clat (usec): min=38, max=122824, avg=21131.34, stdev=18413.43 lat (usec): min=38, max=122825, avg=21132.51, stdev=18413.45 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 68], 20.00th=[ 115], | 30.00th=[ 11731], 40.00th=[ 16712], 50.00th=[ 20055], 60.00th=[ 23725], | 70.00th=[ 27657], 80.00th=[ 34866], 90.00th=[ 43779], 95.00th=[ 50594], | 99.00th=[ 78119], 99.50th=[113771], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 126, max= 576, per=25.68%, avg=361.38, stdev=115.46, samples=32 iops : min= 7, max= 36, avg=21.88, stdev= 7.29, samples=32 write: IOPS=24, BW=386KiB/s (396kB/s)(6368KiB/16487msec); 0 zone resets clat (usec): min=1194, max=168302, avg=21334.47, stdev=20412.47 lat (usec): min=1195, max=168304, avg=21337.10, stdev=20412.15 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2474], 10.00th=[ 2966], 20.00th=[ 4228], | 30.00th=[ 5932], 40.00th=[ 8848], 50.00th=[ 13960], 60.00th=[ 21103], | 70.00th=[ 28967], 80.00th=[ 36963], 90.00th=[ 49021], 95.00th=[ 60031], | 99.00th=[ 80217], 99.50th=[ 96994], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 159, max= 638, per=26.38%, avg=390.47, stdev=123.67, samples=32 iops : min= 9, max= 39, avg=23.72, stdev= 7.82, samples=32 lat (usec) : 50=1.04%, 100=7.03%, 250=3.78%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.39% lat (msec) : 2=1.30%, 4=8.72%, 10=12.76%, 20=19.40%, 50=37.50% lat (msec) : 100=7.16%, 250=0.39% cpu : usr=0.09%, sys=12.57%, ctx=1623, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147411: Fri Apr 10 22:46:31 2026 read: IOPS=21, BW=342KiB/s (350kB/s)(5744KiB/16790msec) clat (usec): min=24, max=148726, avg=22891.54, stdev=20093.84 lat (usec): min=24, max=148727, avg=22893.65, stdev=20093.67 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 66], 20.00th=[ 118], | 30.00th=[ 13698], 40.00th=[ 17171], 50.00th=[ 21103], 60.00th=[ 25822], | 70.00th=[ 30278], 80.00th=[ 36439], 90.00th=[ 47449], 95.00th=[ 55837], | 99.00th=[ 89654], 99.50th=[132645], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 189, max= 576, per=24.29%, avg=341.70, stdev=89.78, samples=33 iops : min= 11, max= 36, avg=20.64, stdev= 5.65, samples=33 write: IOPS=24, BW=390KiB/s (399kB/s)(6544KiB/16790msec); 0 zone resets clat (usec): min=1589, max=157894, avg=20777.68, stdev=20372.37 lat (usec): min=1590, max=157898, avg=20779.79, stdev=20372.45 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2040], 10.00th=[ 2966], 20.00th=[ 4424], | 30.00th=[ 5997], 40.00th=[ 8717], 50.00th=[ 14091], 60.00th=[ 19530], | 70.00th=[ 28181], 80.00th=[ 35914], 90.00th=[ 47449], 95.00th=[ 54264], | 99.00th=[ 94897], 99.50th=[109577], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 159, max= 704, per=26.32%, avg=389.55, stdev=106.12, samples=33 iops : min= 9, max= 44, avg=23.64, stdev= 6.72, samples=33 lat (usec) : 50=1.56%, 100=6.77%, 250=2.73%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.60%, 4=6.51%, 10=13.67%, 20=20.05%, 50=37.37% lat (msec) : 100=7.55%, 250=0.65% cpu : usr=0.11%, sys=12.34%, ctx=1686, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147412: Fri Apr 10 22:46:31 2026 read: IOPS=22, BW=368KiB/s (376kB/s)(6256KiB/17020msec) clat (usec): min=36, max=185520, avg=21793.97, stdev=21340.28 lat (usec): min=37, max=185520, avg=21795.21, stdev=21340.26 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 68], 20.00th=[ 111], | 30.00th=[ 12649], 40.00th=[ 16319], 50.00th=[ 20055], 60.00th=[ 23200], | 70.00th=[ 28181], 80.00th=[ 33817], 90.00th=[ 43254], 95.00th=[ 51643], | 99.00th=[135267], 99.50th=[156238], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 133, max= 763, per=26.18%, avg=368.36, stdev=123.85, samples=33 iops : min= 8, max= 47, avg=22.33, stdev= 7.77, samples=33 write: IOPS=22, BW=354KiB/s (363kB/s)(6032KiB/17020msec); 0 zone resets clat (usec): min=1322, max=102601, avg=22098.40, stdev=21201.38 lat (usec): min=1323, max=102603, avg=22121.59, stdev=21195.14 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2024], 10.00th=[ 2409], 20.00th=[ 3720], | 30.00th=[ 6194], 40.00th=[ 10028], 50.00th=[ 15401], 60.00th=[ 21103], | 70.00th=[ 28181], 80.00th=[ 37487], 90.00th=[ 53216], 95.00th=[ 65274], | 99.00th=[ 96994], 99.50th=[ 98042], 99.90th=[102237], 99.95th=[102237], | 99.99th=[102237] bw ( KiB/s): min= 133, max= 605, per=23.72%, avg=351.12, stdev=124.20, samples=33 iops : min= 8, max= 37, avg=21.24, stdev= 7.68, samples=33 lat (usec) : 50=1.56%, 100=7.81%, 250=2.86%, 500=0.52% lat (msec) : 2=2.60%, 4=7.94%, 10=9.64%, 20=21.35%, 50=37.11% lat (msec) : 100=7.94%, 250=0.65% cpu : usr=0.12%, sys=12.03%, ctx=1664, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147413: Fri Apr 10 22:46:31 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(6032KiB/16203msec) clat (usec): min=25, max=103492, avg=21045.17, stdev=18622.38 lat (usec): min=25, max=103493, avg=21048.88, stdev=18621.62 clat percentiles (usec): | 1.00th=[ 37], 5.00th=[ 49], 10.00th=[ 62], 20.00th=[ 93], | 30.00th=[ 8848], 40.00th=[ 15664], 50.00th=[ 19530], 60.00th=[ 23462], | 70.00th=[ 30016], 80.00th=[ 35914], 90.00th=[ 45351], 95.00th=[ 53216], | 99.00th=[ 81265], 99.50th=[ 88605], 99.90th=[103285], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 188, max= 606, per=26.50%, avg=372.81, stdev=124.70, samples=32 iops : min= 11, max= 37, avg=22.59, stdev= 7.84, samples=32 write: IOPS=24, BW=386KiB/s (395kB/s)(6256KiB/16203msec); 0 zone resets clat (usec): min=1365, max=117448, avg=20680.10, stdev=21594.10 lat (usec): min=1367, max=117451, avg=20689.49, stdev=21599.43 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 2147], 10.00th=[ 2966], 20.00th=[ 3949], | 30.00th=[ 5080], 40.00th=[ 7767], 50.00th=[ 11338], 60.00th=[ 18220], | 70.00th=[ 25035], 80.00th=[ 37487], 90.00th=[ 50070], 95.00th=[ 65799], | 99.00th=[ 91751], 99.50th=[115868], 99.90th=[117965], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 156, max= 669, per=26.16%, avg=387.22, stdev=122.59, samples=32 iops : min= 9, max= 41, avg=23.50, stdev= 7.69, samples=32 lat (usec) : 50=2.47%, 100=7.81%, 250=2.99%, 500=0.65%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.47%, 4=7.94%, 10=13.80%, 20=19.27%, 50=33.59% lat (msec) : 100=8.20%, 250=0.39% cpu : usr=0.13%, sys=12.42%, ctx=1577, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1407KiB/s (1441kB/s), 342KiB/s-372KiB/s (350kB/s-381kB/s), io=23.4MiB (24.5MB), run=16203-17020msec WRITE: bw=1481KiB/s (1516kB/s), 354KiB/s-390KiB/s (363kB/s-399kB/s), io=24.6MiB (25.8MB), run=16203-17020msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147406: Fri Apr 10 22:46:51 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(5920KiB/36799msec) clat (msec): min=5, max=208, avg=22.91, stdev=23.29 lat (msec): min=5, max=208, avg=22.92, stdev=23.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 68], | 99.00th=[ 127], 99.50th=[ 153], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 415, per=25.93%, avg=165.46, stdev=96.91, samples=71 iops : min= 1, max= 25, avg= 9.69, stdev= 6.12, samples=71 write: IOPS=10, BW=173KiB/s (177kB/s)(6368KiB/36799msec); 0 zone resets clat (msec): min=24, max=248, avg=70.90, stdev=39.55 lat (msec): min=24, max=248, avg=70.90, stdev=39.55 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 54], 50.00th=[ 58], 60.00th=[ 66], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 125], 95.00th=[ 157], | 99.00th=[ 215], 99.50th=[ 247], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 350, per=25.76%, avg=172.88, stdev=82.23, samples=73 iops : min= 1, max= 21, avg=10.14, stdev= 5.22, samples=73 lat (msec) : 10=10.16%, 20=21.61%, 50=30.47%, 100=27.86%, 250=9.90% cpu : usr=0.08%, sys=3.21%, ctx=1555, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147407: Fri Apr 10 22:46:51 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(5744KiB/37540msec) clat (msec): min=4, max=223, avg=23.23, stdev=25.88 lat (msec): min=4, max=223, avg=23.23, stdev=25.88 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 14], 60.00th=[ 17], | 70.00th=[ 21], 80.00th=[ 32], 90.00th=[ 53], 95.00th=[ 73], | 99.00th=[ 138], 99.50th=[ 176], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 480, per=24.91%, avg=158.94, stdev=103.48, samples=71 iops : min= 1, max= 30, avg= 9.28, stdev= 6.61, samples=71 write: IOPS=10, BW=174KiB/s (179kB/s)(6544KiB/37540msec); 0 zone resets clat (msec): min=23, max=214, avg=71.16, stdev=35.37 lat (msec): min=23, max=214, avg=71.16, stdev=35.37 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 50], 40.00th=[ 55], 50.00th=[ 61], 60.00th=[ 68], | 70.00th=[ 77], 80.00th=[ 94], 90.00th=[ 126], 95.00th=[ 153], | 99.00th=[ 184], 99.50th=[ 190], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 351, per=25.84%, avg=173.36, stdev=82.51, samples=74 iops : min= 1, max= 21, avg=10.16, stdev= 5.21, samples=74 lat (msec) : 10=14.45%, 20=17.84%, 50=26.56%, 100=30.99%, 250=10.16% cpu : usr=0.08%, sys=3.08%, ctx=1449, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147408: Fri Apr 10 22:46:51 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36204msec) clat (msec): min=5, max=246, avg=21.89, stdev=25.10 lat (msec): min=5, max=246, avg=21.89, stdev=25.10 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 20], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 61], | 99.00th=[ 144], 99.50th=[ 236], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 510, per=27.34%, avg=174.42, stdev=121.04, samples=71 iops : min= 1, max= 31, avg=10.23, stdev= 7.55, samples=71 write: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36204msec); 0 zone resets clat (msec): min=23, max=288, avg=72.98, stdev=39.74 lat (msec): min=23, max=288, avg=72.98, stdev=39.74 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 34], 10.00th=[ 38], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 54], 50.00th=[ 61], 60.00th=[ 72], | 70.00th=[ 81], 80.00th=[ 97], 90.00th=[ 123], 95.00th=[ 153], | 99.00th=[ 215], 99.50th=[ 239], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 320, per=24.67%, avg=165.54, stdev=76.72, samples=71 iops : min= 1, max= 20, avg= 9.66, stdev= 4.90, samples=71 lat (msec) : 10=12.50%, 20=23.31%, 50=28.65%, 100=25.91%, 250=9.51% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=3.15%, ctx=1558, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147409: Fri Apr 10 22:46:51 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(6032KiB/36911msec) clat (msec): min=5, max=235, avg=22.83, stdev=22.71 lat (msec): min=5, max=235, avg=22.83, stdev=22.71 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 63], | 99.00th=[ 123], 99.50th=[ 129], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 415, per=25.37%, avg=161.86, stdev=96.53, samples=73 iops : min= 1, max= 25, avg= 9.45, stdev= 6.10, samples=73 write: IOPS=10, BW=169KiB/s (174kB/s)(6256KiB/36911msec); 0 zone resets clat (msec): min=29, max=224, avg=72.28, stdev=37.05 lat (msec): min=29, max=224, avg=72.28, stdev=37.05 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 36], 10.00th=[ 41], 20.00th=[ 46], | 30.00th=[ 50], 40.00th=[ 54], 50.00th=[ 59], 60.00th=[ 67], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 122], 95.00th=[ 148], | 99.00th=[ 205], 99.50th=[ 215], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 320, per=25.21%, avg=169.16, stdev=78.82, samples=73 iops : min= 1, max= 20, avg= 9.90, stdev= 5.01, samples=73 lat (msec) : 10=10.94%, 20=20.44%, 50=30.08%, 100=27.99%, 250=10.55% cpu : usr=0.10%, sys=3.17%, ctx=1463, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=638KiB/s (653kB/s), 153KiB/s-173KiB/s (157kB/s-177kB/s), io=23.4MiB (24.5MB), run=36204-37540msec WRITE: bw=671KiB/s (687kB/s), 167KiB/s-174KiB/s (171kB/s-179kB/s), io=24.6MiB (25.8MB), run=36204-37540msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147429: Fri Apr 10 22:47:00 2026 read: IOPS=2, BW=2596KiB/s (2658kB/s)(7168KiB/2761msec) clat (msec): min=79, max=201, avg=154.99, stdev=42.78 lat (msec): min=79, max=201, avg=154.99, stdev=42.78 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 129], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 165], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 201], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 2048, max= 5094, per=54.88%, avg=3735.00, stdev=1549.26, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1854KiB/s (1899kB/s)(5120KiB/2761msec); 0 zone resets clat (msec): min=133, max=599, avg=334.85, stdev=193.16 lat (msec): min=133, max=599, avg=334.94, stdev=193.17 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2031, max= 3878, per=26.23%, avg=2499.00, stdev=919.36, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=30.69%, ctx=424, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147430: Fri Apr 10 22:47:00 2026 read: IOPS=0, BW=681KiB/s (697kB/s)(2048KiB/3009msec) clat (msec): min=130, max=413, avg=271.84, stdev=199.97 lat (msec): min=130, max=413, avg=271.84, stdev=199.97 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1799, max= 2048, per=28.26%, avg=1923.50, stdev=176.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3403KiB/s (3485kB/s)(10.0MiB/3009msec); 0 zone resets clat (msec): min=77, max=767, avg=246.04, stdev=203.77 lat (msec): min=77, max=767, avg=246.17, stdev=203.76 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 100], | 30.00th=[ 115], 40.00th=[ 121], 50.00th=[ 159], 60.00th=[ 234], | 70.00th=[ 251], 80.00th=[ 313], 90.00th=[ 326], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 4079, max= 6095, per=49.92%, avg=4756.67, stdev=1159.06, samples=3 iops : min= 3, max= 5, avg= 4.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=28.03%, ctx=281, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147431: Fri Apr 10 22:47:00 2026 read: IOPS=2, BW=2411KiB/s (2469kB/s)(6144KiB/2548msec) clat (usec): min=603, max=247272, avg=70102.74, stdev=110191.23 lat (usec): min=603, max=247274, avg=70103.94, stdev=110191.62 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 652], | 30.00th=[ 652], 40.00th=[ 775], 50.00th=[ 775], 60.00th=[ 873], | 70.00th=[170918], 80.00th=[170918], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 3878, max= 4079, per=58.46%, avg=3978.50, stdev=142.13, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2411KiB/s (2469kB/s)(6144KiB/2548msec); 0 zone resets clat (msec): min=197, max=736, avg=354.08, stdev=195.11 lat (msec): min=197, max=736, avg=354.14, stdev=195.12 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 355], 80.00th=[ 355], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1939, max= 4079, per=33.49%, avg=3191.00, stdev=1115.47, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=16.67%, 1000=16.67% lat (msec) : 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.12%, sys=28.19%, ctx=272, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147432: Fri Apr 10 22:47:00 2026 read: IOPS=1, BW=1816KiB/s (1860kB/s)(5120KiB/2819msec) clat (usec): min=438, max=207063, avg=72792.73, stdev=100648.51 lat (usec): min=438, max=207063, avg=72793.91, stdev=100648.39 clat percentiles (usec): | 1.00th=[ 437], 5.00th=[ 437], 10.00th=[ 437], 20.00th=[ 437], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[ 578], 60.00th=[ 578], | 70.00th=[156238], 80.00th=[156238], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2543KiB/s (2604kB/s)(7168KiB/2819msec); 0 zone resets clat (msec): min=90, max=718, avg=350.39, stdev=271.09 lat (msec): min=90, max=719, avg=350.47, stdev=271.10 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 121], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 218], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1675, max= 2048, per=20.43%, avg=1946.40, stdev=157.93, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 750=25.00% cpu : usr=0.04%, sys=27.82%, ctx=374, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6806KiB/s (6970kB/s), 681KiB/s-2596KiB/s (697kB/s-2658kB/s), io=20.0MiB (20.0MB), run=2548-3009msec WRITE: bw=9529KiB/s (9757kB/s), 1854KiB/s-3403KiB/s (1899kB/s-3485kB/s), io=28.0MiB (29.4MB), run=2548-3009msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147424: Fri Apr 10 22:47:00 2026 read: IOPS=2, BW=2401KiB/s (2458kB/s)(7168KiB/2986msec) clat (msec): min=58, max=736, avg=246.92, stdev=249.58 lat (msec): min=58, max=736, avg=246.92, stdev=249.58 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 64], | 30.00th=[ 91], 40.00th=[ 91], 50.00th=[ 97], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 359], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1858, max= 5427, per=47.56%, avg=2797.75, stdev=1753.88, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1715KiB/s (1756kB/s)(5120KiB/2986msec); 0 zone resets clat (msec): min=162, max=306, avg=232.41, stdev=51.73 lat (msec): min=162, max=306, avg=232.51, stdev=51.74 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 1809, max= 3961, per=29.37%, avg=2419.00, stdev=1031.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=33.33%, 250=33.33%, 500=25.00%, 750=8.33% cpu : usr=0.03%, sys=9.11%, ctx=110, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147425: Fri Apr 10 22:47:00 2026 read: IOPS=0, BW=588KiB/s (602kB/s)(2048KiB/3481msec) clat (usec): min=84532, max=87119, avg=85826.09, stdev=1829.29 lat (usec): min=84535, max=87121, avg=85828.60, stdev=1828.08 clat percentiles (usec): | 1.00th=[84411], 5.00th=[84411], 10.00th=[84411], 20.00th=[84411], | 30.00th=[84411], 40.00th=[84411], 50.00th=[84411], 60.00th=[87557], | 70.00th=[87557], 80.00th=[87557], 90.00th=[87557], 95.00th=[87557], | 99.00th=[87557], 99.50th=[87557], 99.90th=[87557], 99.95th=[87557], | 99.99th=[87557] bw ( KiB/s): min= 1783, max= 1903, per=31.33%, avg=1843.00, stdev=84.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2942KiB/s (3012kB/s)(10.0MiB/3481msec); 0 zone resets clat (msec): min=120, max=785, avg=323.75, stdev=216.06 lat (msec): min=122, max=785, avg=324.07, stdev=215.87 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 138], | 30.00th=[ 174], 40.00th=[ 180], 50.00th=[ 194], 60.00th=[ 275], | 70.00th=[ 368], 80.00th=[ 481], 90.00th=[ 527], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1903, max= 3716, per=30.78%, avg=2535.33, stdev=859.34, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=10.03%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147426: Fri Apr 10 22:47:00 2026 read: IOPS=2, BW=2060KiB/s (2109kB/s)(6144KiB/2983msec) clat (msec): min=134, max=563, avg=279.56, stdev=151.23 lat (msec): min=134, max=563, avg=279.56, stdev=151.23 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 201], | 30.00th=[ 201], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 251], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2003, max= 3961, per=54.85%, avg=3226.67, stdev=1066.78, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2060KiB/s (2109kB/s)(6144KiB/2983msec); 0 zone resets clat (msec): min=128, max=444, avg=212.89, stdev=119.17 lat (msec): min=129, max=444, avg=213.00, stdev=119.15 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 201], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1858, max= 5333, per=37.12%, avg=3057.00, stdev=1972.02, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 250=75.00%, 500=16.67%, 750=8.33% cpu : usr=0.03%, sys=7.95%, ctx=73, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147427: Fri Apr 10 22:47:00 2026 read: IOPS=1, BW=1850KiB/s (1895kB/s)(5120KiB/2767msec) clat (msec): min=83, max=280, avg=151.00, stdev=80.74 lat (msec): min=83, max=280, avg=151.00, stdev=80.74 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 136], 60.00th=[ 136], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7613, max= 7613, per=100.00%, avg=7613.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2591KiB/s (2653kB/s)(7168KiB/2767msec); 0 zone resets clat (msec): min=110, max=470, avg=280.93, stdev=145.44 lat (msec): min=110, max=470, avg=281.03, stdev=145.44 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 264], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 464], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1858, max= 4007, per=32.97%, avg=2715.20, stdev=1100.23, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=9.65%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5883KiB/s (6025kB/s), 588KiB/s-2401KiB/s (602kB/s-2458kB/s), io=20.0MiB (20.0MB), run=2767-3481msec WRITE: bw=8237KiB/s (8434kB/s), 1715KiB/s-2942KiB/s (1756kB/s-3012kB/s), io=28.0MiB (29.4MB), run=2767-3481msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147439: Fri Apr 10 22:47:11 2026 read: IOPS=0, BW=3511KiB/s (3595kB/s)(12.0MiB/3500msec) clat (msec): min=563, max=2166, avg=1116.59, stdev=909.41 lat (msec): min=563, max=2166, avg=1116.60, stdev=909.41 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=17.92%, ctx=1022, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147440: Fri Apr 10 22:47:11 2026 read: IOPS=0, BW=987KiB/s (1011kB/s)(4096KiB/4149msec) clat (nsec): min=2163.0M, max=2163.0M, avg=2163974284.00, stdev= 0.00 lat (nsec): min=2163.0M, max=2163.0M, avg=2163976704.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2165], 5.00th=[ 2165], 10.00th=[ 2165], 20.00th=[ 2165], | 30.00th=[ 2165], 40.00th=[ 2165], 50.00th=[ 2165], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1974KiB/s (2022kB/s)(8192KiB/4149msec); 0 zone resets clat (msec): min=745, max=1116, avg=930.95, stdev=261.84 lat (msec): min=746, max=1116, avg=931.40, stdev=261.75 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.79%, ctx=450, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147441: Fri Apr 10 22:47:11 2026 write: IOPS=0, BW=3104KiB/s (3178kB/s)(12.0MiB/3959msec); 0 zone resets clat (msec): min=781, max=1918, avg=1258.44, stdev=590.32 lat (msec): min=781, max=1918, avg=1258.85, stdev=590.24 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=9.55%, ctx=93, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147443: Fri Apr 10 22:47:11 2026 write: IOPS=0, BW=3569KiB/s (3655kB/s)(12.0MiB/3443msec); 0 zone resets clat (msec): min=261, max=1906, avg=1104.22, stdev=823.09 lat (msec): min=263, max=1906, avg=1105.95, stdev=822.62 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.20%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3949KiB/s (4044kB/s), 987KiB/s-3511KiB/s (1011kB/s-3595kB/s), io=16.0MiB (16.8MB), run=3500-4149msec WRITE: bw=7898KiB/s (8087kB/s), 1974KiB/s-3569KiB/s (2022kB/s-3655kB/s), io=32.0MiB (33.6MB), run=3443-4149msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147442: Fri Apr 10 22:47:11 2026 read: IOPS=0, BW=3034KiB/s (3107kB/s)(12.0MiB/4050msec) clat (msec): min=253, max=2434, avg=1290.18, stdev=1094.76 lat (msec): min=253, max=2434, avg=1290.18, stdev=1094.76 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.15%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147444: Fri Apr 10 22:47:11 2026 read: IOPS=0, BW=946KiB/s (969kB/s)(4096KiB/4328msec) clat (nsec): min=2311.1M, max=2311.1M, avg=2311123177.00, stdev= 0.00 lat (nsec): min=2311.1M, max=2311.1M, avg=2311124312.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2299], 5.00th=[ 2299], 10.00th=[ 2299], 20.00th=[ 2299], | 30.00th=[ 2299], 40.00th=[ 2299], 50.00th=[ 2299], 60.00th=[ 2299], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1893KiB/s (1938kB/s)(8192KiB/4328msec); 0 zone resets clat (msec): min=726, max=1156, avg=941.45, stdev=303.91 lat (msec): min=727, max=1157, avg=942.09, stdev=304.00 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=5.78%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147445: Fri Apr 10 22:47:11 2026 write: IOPS=0, BW=2904KiB/s (2974kB/s)(12.0MiB/4231msec); 0 zone resets clat (msec): min=299, max=2886, avg=1369.27, stdev=1350.55 lat (msec): min=300, max=2887, avg=1369.82, stdev=1350.81 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 919], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=4.52%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147446: Fri Apr 10 22:47:11 2026 write: IOPS=0, BW=3231KiB/s (3309kB/s)(12.0MiB/3803msec); 0 zone resets clat (msec): min=265, max=2437, avg=1214.82, stdev=1111.36 lat (msec): min=266, max=2438, avg=1215.36, stdev=1111.56 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 2433], 80.00th=[ 2433], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=5.81%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3786KiB/s (3876kB/s), 946KiB/s-3034KiB/s (969kB/s-3107kB/s), io=16.0MiB (16.8MB), run=4050-4328msec WRITE: bw=7571KiB/s (7753kB/s), 1893KiB/s-3231KiB/s (1938kB/s-3309kB/s), io=32.0MiB (33.6MB), run=3803-4328msec