== sanity test 398b: DIO and buffer IO race ============== 10:55:36 (1788360936) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.52705 s, 14.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158246: Wed Sep 2 10:57:05 2026 read: IOPS=19, BW=78.3KiB/s (80.2kB/s)(5992KiB/76480msec) clat (usec): min=34, max=388474, avg=25379.09, stdev=21412.96 lat (usec): min=34, max=388475, avg=25382.38, stdev=21412.82 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 5211], 20.00th=[ 12387], | 30.00th=[ 15139], 40.00th=[ 17957], 50.00th=[ 21365], 60.00th=[ 25822], | 70.00th=[ 30540], 80.00th=[ 36963], 90.00th=[ 46924], 95.00th=[ 57410], | 99.00th=[ 82314], 99.50th=[116917], 99.90th=[242222], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 15, max= 151, per=25.70%, avg=78.37, stdev=25.45, samples=150 iops : min= 3, max= 37, avg=19.01, stdev= 6.40, samples=150 write: IOPS=20, BW=82.3KiB/s (84.3kB/s)(6296KiB/76480msec); 0 zone resets clat (usec): min=773, max=198258, avg=24223.54, stdev=23780.76 lat (usec): min=773, max=198261, avg=24228.21, stdev=23779.48 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1434], 10.00th=[ 1926], 20.00th=[ 3687], | 30.00th=[ 6652], 40.00th=[ 13304], 50.00th=[ 19006], 60.00th=[ 24511], | 70.00th=[ 30016], 80.00th=[ 40109], 90.00th=[ 54789], 95.00th=[ 67634], | 99.00th=[110625], 99.50th=[133694], 99.90th=[185598], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 23, max= 167, per=25.74%, avg=82.36, stdev=27.65, samples=150 iops : min= 5, max= 41, avg=20.01, stdev= 6.95, samples=150 lat (usec) : 50=0.62%, 100=3.19%, 250=0.78%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.31%, 4=5.47%, 10=9.24%, 20=24.51%, 50=40.14% lat (msec) : 100=9.57%, 250=0.91%, 500=0.03% cpu : usr=0.11%, sys=10.02%, ctx=7088, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158247: Wed Sep 2 10:57:05 2026 read: IOPS=19, BW=76.2KiB/s (78.1kB/s)(5940KiB/77911msec) clat (usec): min=35, max=269483, avg=24927.20, stdev=18467.74 lat (usec): min=36, max=269485, avg=24929.97, stdev=18466.40 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 65], 10.00th=[ 8455], 20.00th=[ 12780], | 30.00th=[ 15270], 40.00th=[ 17957], 50.00th=[ 21103], 60.00th=[ 25035], | 70.00th=[ 29492], 80.00th=[ 36439], 90.00th=[ 46924], 95.00th=[ 55313], | 99.00th=[ 82314], 99.50th=[ 88605], 99.90th=[179307], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 134, per=24.79%, avg=75.60, stdev=26.53, samples=154 iops : min= 1, max= 33, avg=18.32, stdev= 6.67, samples=154 write: IOPS=20, BW=81.5KiB/s (83.4kB/s)(6348KiB/77911msec); 0 zone resets clat (usec): min=789, max=413540, avg=25572.63, stdev=27567.84 lat (usec): min=789, max=413542, avg=25574.28, stdev=27568.00 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1467], 10.00th=[ 2024], 20.00th=[ 3982], | 30.00th=[ 7373], 40.00th=[ 13304], 50.00th=[ 19006], 60.00th=[ 25560], | 70.00th=[ 31851], 80.00th=[ 42206], 90.00th=[ 56886], 95.00th=[ 73925], | 99.00th=[100140], 99.50th=[130548], 99.90th=[354419], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 31, max= 183, per=25.38%, avg=81.21, stdev=29.43, samples=153 iops : min= 7, max= 45, avg=19.72, stdev= 7.36, samples=153 lat (usec) : 50=0.68%, 100=2.47%, 250=0.59%, 500=0.03%, 1000=0.42% lat (msec) : 2=4.65%, 4=5.47%, 10=10.06%, 20=24.84%, 50=39.81% lat (msec) : 100=10.25%, 250=0.62%, 500=0.10% cpu : usr=0.12%, sys=9.85%, ctx=7160, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158248: Wed Sep 2 10:57:05 2026 read: IOPS=19, BW=77.1KiB/s (78.9kB/s)(6028KiB/78188msec) clat (usec): min=28, max=390380, avg=25119.87, stdev=20567.35 lat (usec): min=28, max=390381, avg=25121.24, stdev=20567.75 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 67], 10.00th=[ 6194], 20.00th=[ 12387], | 30.00th=[ 15270], 40.00th=[ 17957], 50.00th=[ 21365], 60.00th=[ 25560], | 70.00th=[ 30016], 80.00th=[ 35914], 90.00th=[ 46400], 95.00th=[ 55313], | 99.00th=[ 80217], 99.50th=[124257], 99.90th=[214959], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 151, per=25.13%, avg=76.66, stdev=25.71, samples=155 iops : min= 1, max= 37, avg=18.59, stdev= 6.44, samples=155 write: IOPS=20, BW=80.1KiB/s (81.0kB/s)(6260KiB/78188msec); 0 zone resets clat (usec): min=856, max=169344, avg=25580.46, stdev=23780.58 lat (usec): min=857, max=169345, avg=25584.58, stdev=23780.19 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1434], 10.00th=[ 1975], 20.00th=[ 3752], | 30.00th=[ 7111], 40.00th=[ 14222], 50.00th=[ 20579], 60.00th=[ 27395], | 70.00th=[ 33817], 80.00th=[ 43254], 90.00th=[ 55837], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[116917], 99.90th=[162530], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 21, max= 174, per=24.87%, avg=79.58, stdev=27.44, samples=155 iops : min= 5, max= 43, avg=19.32, stdev= 6.90, samples=155 lat (usec) : 50=0.98%, 100=3.09%, 250=0.55%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.18%, 4=5.83%, 10=8.43%, 20=23.40%, 50=41.28% lat (msec) : 100=10.09%, 250=0.88%, 500=0.03% cpu : usr=0.12%, sys=9.59%, ctx=7115, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158249: Wed Sep 2 10:57:05 2026 read: IOPS=19, BW=77.1KiB/s (78.9kB/s)(6052KiB/78507msec) clat (usec): min=21, max=432073, avg=25161.36, stdev=20630.22 lat (usec): min=21, max=432074, avg=25162.50, stdev=20630.24 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 68], 10.00th=[ 7570], 20.00th=[ 12649], | 30.00th=[ 15401], 40.00th=[ 18220], 50.00th=[ 21627], 60.00th=[ 25822], | 70.00th=[ 31065], 80.00th=[ 36439], 90.00th=[ 45351], 95.00th=[ 52167], | 99.00th=[ 85459], 99.50th=[103285], 99.90th=[189793], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 21, max= 160, per=24.95%, avg=76.10, stdev=25.61, samples=155 iops : min= 5, max= 40, avg=18.45, stdev= 6.41, samples=155 write: IOPS=19, BW=79.4KiB/s (81.3kB/s)(6236KiB/78507msec); 0 zone resets clat (usec): min=754, max=298367, avg=25749.08, stdev=26812.31 lat (usec): min=755, max=298368, avg=25752.13, stdev=26811.61 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1467], 10.00th=[ 1975], 20.00th=[ 3687], | 30.00th=[ 7373], 40.00th=[ 13173], 50.00th=[ 19268], 60.00th=[ 25822], | 70.00th=[ 32900], 80.00th=[ 42206], 90.00th=[ 57934], 95.00th=[ 72877], | 99.00th=[110625], 99.50th=[139461], 99.90th=[244319], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 23, max= 167, per=24.60%, avg=78.72, stdev=25.84, samples=155 iops : min= 5, max= 41, avg=19.10, stdev= 6.51, samples=155 lat (usec) : 50=0.75%, 100=2.47%, 250=0.78%, 500=0.20%, 750=0.07% lat (usec) : 1000=0.29% lat (msec) : 2=5.05%, 4=5.63%, 10=9.11%, 20=24.15%, 50=40.95% lat (msec) : 100=9.41%, 250=1.07%, 500=0.07% cpu : usr=0.11%, sys=9.49%, ctx=7178, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=306KiB/s (313kB/s), 76.2KiB/s-78.3KiB/s (78.1kB/s-80.2kB/s), io=23.4MiB (24.6MB), run=76480-78507msec WRITE: bw=320KiB/s (328kB/s), 79.4KiB/s-82.3KiB/s (81.3kB/s-84.3kB/s), io=24.6MiB (25.7MB), run=76480-78507msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158250: Wed Sep 2 10:58:23 2026 read: IOPS=9, BW=38.3KiB/s (39.2kB/s)(5992KiB/156568msec) clat (msec): min=4, max=394, avg=22.18, stdev=22.91 lat (msec): min=4, max=394, avg=22.18, stdev=22.91 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 59], | 99.00th=[ 110], 99.50th=[ 140], 99.90th=[ 232], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 127, per=25.75%, avg=39.40, stdev=24.49, samples=298 iops : min= 1, max= 31, avg= 9.33, stdev= 6.22, samples=298 write: IOPS=10, BW=40.2KiB/s (41.2kB/s)(6296KiB/156568msec); 0 zone resets clat (msec): min=24, max=395, avg=78.22, stdev=36.82 lat (msec): min=24, max=395, avg=78.22, stdev=36.82 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 56], 40.00th=[ 63], 50.00th=[ 69], 60.00th=[ 78], | 70.00th=[ 87], 80.00th=[ 103], 90.00th=[ 126], 95.00th=[ 153], | 99.00th=[ 197], 99.50th=[ 207], 99.90th=[ 376], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 8, max= 87, per=24.85%, avg=39.75, stdev=16.14, samples=310 iops : min= 2, max= 21, avg= 9.41, stdev= 4.11, samples=310 lat (msec) : 10=11.88%, 20=19.63%, 50=23.80%, 100=33.50%, 250=11.07% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.46%, ctx=5596, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158251: Wed Sep 2 10:58:23 2026 read: IOPS=9, BW=38.0KiB/s (38.9kB/s)(5940KiB/156210msec) clat (msec): min=3, max=443, avg=22.23, stdev=25.89 lat (msec): min=3, max=443, avg=22.23, stdev=25.89 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 46], 95.00th=[ 64], | 99.00th=[ 108], 99.50th=[ 129], 99.90th=[ 409], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 127, per=25.51%, avg=39.03, stdev=24.29, samples=298 iops : min= 1, max= 31, avg= 9.24, stdev= 6.14, samples=298 write: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6348KiB/156210msec); 0 zone resets clat (msec): min=23, max=279, avg=77.47, stdev=35.52 lat (msec): min=23, max=279, avg=77.47, stdev=35.52 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 56], 40.00th=[ 62], 50.00th=[ 68], 60.00th=[ 75], | 70.00th=[ 86], 80.00th=[ 102], 90.00th=[ 125], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 239], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 80, per=25.07%, avg=40.11, stdev=16.63, samples=309 iops : min= 1, max= 20, avg= 9.50, stdev= 4.25, samples=309 lat (msec) : 4=0.03%, 10=13.25%, 20=19.14%, 50=22.43%, 100=33.89% lat (msec) : 250=11.00%, 500=0.26% cpu : usr=0.07%, sys=2.39%, ctx=5609, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158252: Wed Sep 2 10:58:23 2026 read: IOPS=9, BW=38.6KiB/s (39.5kB/s)(6028KiB/156320msec) clat (msec): min=4, max=196, avg=22.02, stdev=18.66 lat (msec): min=4, max=196, avg=22.02, stdev=18.66 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 44], 95.00th=[ 60], | 99.00th=[ 93], 99.50th=[ 109], 99.90th=[ 184], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 7, max= 134, per=25.75%, avg=39.40, stdev=23.55, samples=299 iops : min= 1, max= 33, avg= 9.33, stdev= 5.96, samples=299 write: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6260KiB/156320msec); 0 zone resets clat (msec): min=24, max=446, avg=78.52, stdev=38.65 lat (msec): min=24, max=446, avg=78.52, stdev=38.65 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 39], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 56], 40.00th=[ 64], 50.00th=[ 70], 60.00th=[ 78], | 70.00th=[ 88], 80.00th=[ 101], 90.00th=[ 125], 95.00th=[ 144], | 99.00th=[ 211], 99.50th=[ 255], 99.90th=[ 435], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 79, per=24.70%, avg=39.52, stdev=16.25, samples=309 iops : min= 1, max= 19, avg= 9.35, stdev= 4.16, samples=309 lat (msec) : 10=10.74%, 20=20.61%, 50=23.99%, 100=34.11%, 250=10.29% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.49%, ctx=5574, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158253: Wed Sep 2 10:58:23 2026 read: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6052KiB/155292msec) clat (msec): min=4, max=246, avg=21.59, stdev=20.97 lat (msec): min=4, max=246, avg=21.59, stdev=20.97 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 30], 90.00th=[ 46], 95.00th=[ 61], | 99.00th=[ 105], 99.50th=[ 125], 99.90th=[ 211], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 7, max= 133, per=26.17%, avg=40.04, stdev=23.67, samples=296 iops : min= 1, max= 33, avg= 9.49, stdev= 5.97, samples=296 write: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6236KiB/155292msec); 0 zone resets clat (msec): min=23, max=448, avg=78.49, stdev=37.63 lat (msec): min=23, max=448, avg=78.49, stdev=37.63 clat percentiles (msec): | 1.00th=[ 32], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 70], 60.00th=[ 78], | 70.00th=[ 87], 80.00th=[ 101], 90.00th=[ 123], 95.00th=[ 146], | 99.00th=[ 209], 99.50th=[ 251], 99.90th=[ 435], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 79, per=24.83%, avg=39.73, stdev=16.05, samples=307 iops : min= 1, max= 19, avg= 9.40, stdev= 4.11, samples=307 lat (msec) : 10=13.38%, 20=19.76%, 50=21.68%, 100=34.31%, 250=10.64% lat (msec) : 500=0.23% cpu : usr=0.07%, sys=2.43%, ctx=5459, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=153KiB/s (157kB/s), 38.0KiB/s-38.0KiB/s (38.9kB/s-39.9kB/s), io=23.4MiB (24.6MB), run=155292-156568msec WRITE: bw=161KiB/s (164kB/s), 40.0KiB/s-40.6KiB/s (41.0kB/s-41.6kB/s), io=24.6MiB (25.7MB), run=155292-156568msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158294: Wed Sep 2 10:58:45 2026 read: IOPS=23, BW=375KiB/s (384kB/s)(5920KiB/15789msec) clat (usec): min=20, max=158558, avg=21593.21, stdev=17881.97 lat (usec): min=20, max=158559, avg=21594.40, stdev=17882.26 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 59], 10.00th=[ 75], 20.00th=[ 644], | 30.00th=[ 12911], 40.00th=[ 16057], 50.00th=[ 19268], 60.00th=[ 23462], | 70.00th=[ 28967], 80.00th=[ 33817], 90.00th=[ 42206], 95.00th=[ 50594], | 99.00th=[ 71828], 99.50th=[103285], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 190, max= 672, per=26.45%, avg=375.61, stdev=107.68, samples=31 iops : min= 11, max= 42, avg=22.77, stdev= 6.81, samples=31 write: IOPS=25, BW=403KiB/s (413kB/s)(6368KiB/15789msec); 0 zone resets clat (usec): min=1003, max=112817, avg=19059.96, stdev=18929.40 lat (usec): min=1004, max=112819, avg=19061.81, stdev=18929.61 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2008], 10.00th=[ 2573], 20.00th=[ 3687], | 30.00th=[ 5407], 40.00th=[ 7373], 50.00th=[ 11207], 60.00th=[ 17695], | 70.00th=[ 24511], 80.00th=[ 33817], 90.00th=[ 45876], 95.00th=[ 56361], | 99.00th=[ 87557], 99.50th=[ 98042], 99.90th=[112722], 99.95th=[112722], | 99.99th=[112722] bw ( KiB/s): min= 158, max= 672, per=27.08%, avg=404.65, stdev=127.99, samples=31 iops : min= 9, max= 42, avg=24.61, stdev= 8.11, samples=31 lat (usec) : 50=1.43%, 100=5.73%, 250=1.95%, 500=0.26%, 750=0.26% lat (msec) : 2=2.73%, 4=8.72%, 10=14.71%, 20=21.48%, 50=35.81% lat (msec) : 100=6.51%, 250=0.39% cpu : usr=0.11%, sys=12.90%, ctx=1679, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158296: Wed Sep 2 10:58:45 2026 read: IOPS=22, BW=359KiB/s (367kB/s)(5744KiB/16021msec) clat (usec): min=40, max=105592, avg=22900.12, stdev=16910.83 lat (usec): min=40, max=105593, avg=22901.39, stdev=16910.95 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 73], 20.00th=[ 11600], | 30.00th=[ 15139], 40.00th=[ 18482], 50.00th=[ 21365], 60.00th=[ 24773], | 70.00th=[ 28181], 80.00th=[ 33817], 90.00th=[ 44303], 95.00th=[ 50070], | 99.00th=[ 85459], 99.50th=[ 98042], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 221, max= 542, per=25.23%, avg=358.32, stdev=93.08, samples=31 iops : min= 13, max= 33, avg=21.68, stdev= 5.86, samples=31 write: IOPS=25, BW=408KiB/s (418kB/s)(6544KiB/16021msec); 0 zone resets clat (usec): min=1236, max=84451, avg=18954.31, stdev=16562.54 lat (usec): min=1239, max=84452, avg=18956.33, stdev=16562.34 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2245], 10.00th=[ 2933], 20.00th=[ 4424], | 30.00th=[ 5866], 40.00th=[ 8586], 50.00th=[13829], 60.00th=[20055], | 70.00th=[25560], 80.00th=[33162], 90.00th=[43254], 95.00th=[52167], | 99.00th=[65799], 99.50th=[71828], 99.90th=[84411], 99.95th=[84411], | 99.99th=[84411] bw ( KiB/s): min= 223, max= 544, per=27.10%, avg=404.81, stdev=88.15, samples=31 iops : min= 13, max= 34, avg=24.61, stdev= 5.54, samples=31 lat (usec) : 50=0.91%, 100=4.82%, 250=1.56%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.95%, 4=7.29%, 10=15.10%, 20=20.83%, 50=42.06% lat (msec) : 100=5.08%, 250=0.13% cpu : usr=0.11%, sys=13.09%, ctx=1775, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158297: Wed Sep 2 10:58:45 2026 read: IOPS=23, BW=374KiB/s (383kB/s)(6256KiB/16718msec) clat (usec): min=36, max=77553, avg=22578.51, stdev=15548.14 lat (usec): min=36, max=77554, avg=22579.53, stdev=15548.10 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 59], 10.00th=[ 69], 20.00th=[10683], | 30.00th=[16188], 40.00th=[18482], 50.00th=[21890], 60.00th=[25560], | 70.00th=[30016], 80.00th=[33817], 90.00th=[41157], 95.00th=[50070], | 99.00th=[68682], 99.50th=[71828], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 113, max= 638, per=26.50%, avg=376.33, stdev=112.41, samples=33 iops : min= 7, max= 39, avg=22.88, stdev= 7.11, samples=33 write: IOPS=22, BW=361KiB/s (369kB/s)(6032KiB/16718msec); 0 zone resets clat (usec): min=1044, max=110730, avg=20408.45, stdev=18604.66 lat (usec): min=1046, max=110732, avg=20424.87, stdev=18598.10 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2024], 10.00th=[ 3458], 20.00th=[ 4686], | 30.00th=[ 6390], 40.00th=[ 10159], 50.00th=[ 15533], 60.00th=[ 21365], | 70.00th=[ 25822], 80.00th=[ 33162], 90.00th=[ 47449], 95.00th=[ 55837], | 99.00th=[ 88605], 99.50th=[101188], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 113, max= 573, per=24.03%, avg=359.03, stdev=113.87, samples=33 iops : min= 7, max= 35, avg=21.79, stdev= 7.14, samples=33 lat (usec) : 50=1.17%, 100=6.51%, 250=1.30%, 500=0.13% lat (msec) : 2=2.47%, 4=4.30%, 10=13.80%, 20=22.01%, 50=42.32% lat (msec) : 100=5.73%, 250=0.26% cpu : usr=0.13%, sys=12.98%, ctx=1838, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158298: Wed Sep 2 10:58:45 2026 read: IOPS=22, BW=358KiB/s (366kB/s)(6032KiB/16859msec) clat (usec): min=38, max=123599, avg=22032.45, stdev=17859.19 lat (usec): min=39, max=123600, avg=22033.38, stdev=17859.15 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 67], 20.00th=[ 126], | 30.00th=[ 13829], 40.00th=[ 17433], 50.00th=[ 20841], 60.00th=[ 25035], | 70.00th=[ 28967], 80.00th=[ 33817], 90.00th=[ 41681], 95.00th=[ 51643], | 99.00th=[ 82314], 99.50th=[ 99091], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 127, max= 544, per=25.88%, avg=367.53, stdev=94.62, samples=32 iops : min= 7, max= 34, avg=22.31, stdev= 6.00, samples=32 write: IOPS=23, BW=371KiB/s (380kB/s)(6256KiB/16859msec); 0 zone resets clat (usec): min=1128, max=148105, avg=21346.30, stdev=23074.82 lat (usec): min=1130, max=148107, avg=21348.00, stdev=23074.86 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1795], 10.00th=[ 2573], 20.00th=[ 4113], | 30.00th=[ 6259], 40.00th=[ 9896], 50.00th=[ 14222], 60.00th=[ 18482], | 70.00th=[ 24511], 80.00th=[ 35390], 90.00th=[ 46400], 95.00th=[ 63701], | 99.00th=[115868], 99.50th=[128451], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 85, max= 542, per=24.93%, avg=372.45, stdev=127.55, samples=33 iops : min= 5, max= 33, avg=22.64, stdev= 8.10, samples=33 lat (usec) : 50=1.17%, 100=7.29%, 250=2.34%, 500=0.13% lat (msec) : 2=3.39%, 4=6.77%, 10=11.59%, 20=22.53%, 50=37.63% lat (msec) : 100=5.99%, 250=1.17% cpu : usr=0.11%, sys=12.43%, ctx=1725, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1421KiB/s (1455kB/s), 358KiB/s-375KiB/s (366kB/s-384kB/s), io=23.4MiB (24.5MB), run=15789-16859msec WRITE: bw=1495KiB/s (1531kB/s), 361KiB/s-408KiB/s (369kB/s-418kB/s), io=24.6MiB (25.8MB), run=15789-16859msec fio: pid=158291, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=158291: Wed Sep 2 10:59:03 2026 read: IOPS=9, BW=146KiB/s (149kB/s)(4016KiB/27537msec) clat (msec): min=5, max=136, avg=26.43, stdev=22.80 lat (msec): min=5, max=136, avg=26.43, stdev=22.80 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 15], 50.00th=[ 18], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 53], 95.00th=[ 82], | 99.00th=[ 103], 99.50th=[ 124], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 352, per=22.98%, avg=144.30, stdev=73.39, samples=54 iops : min= 1, max= 22, avg= 8.33, stdev= 4.74, samples=54 write: IOPS=10, BW=162KiB/s (165kB/s)(4448KiB/27537msec); 0 zone resets clat (msec): min=23, max=198, avg=74.82, stdev=30.05 lat (msec): min=23, max=198, avg=74.82, stdev=30.05 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 50], | 30.00th=[ 55], 40.00th=[ 61], 50.00th=[ 67], 60.00th=[ 75], | 70.00th=[ 86], 80.00th=[ 101], 90.00th=[ 120], 95.00th=[ 133], | 99.00th=[ 163], 99.50th=[ 165], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 57, max= 288, per=24.30%, avg=161.09, stdev=68.41, samples=54 iops : min= 3, max= 18, avg= 9.39, stdev= 4.48, samples=54 lat (msec) : 10=8.11%, 20=18.30%, 50=27.36%, 100=34.53%, 250=11.51% cpu : usr=0.05%, sys=3.19%, ctx=1023, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=252,278,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158292: Wed Sep 2 10:59:03 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(5744KiB/35103msec) clat (msec): min=4, max=151, avg=21.84, stdev=20.09 lat (msec): min=4, max=151, avg=21.85, stdev=20.09 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 27], 90.00th=[ 43], 95.00th=[ 65], | 99.00th=[ 114], 99.50th=[ 142], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 28, max= 416, per=25.83%, avg=162.23, stdev=95.85, samples=69 iops : min= 1, max= 26, avg= 9.51, stdev= 6.12, samples=69 write: IOPS=11, BW=186KiB/s (191kB/s)(6544KiB/35103msec); 0 zone resets clat (msec): min=20, max=216, avg=66.20, stdev=30.15 lat (msec): min=20, max=216, avg=66.20, stdev=30.15 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 33], 10.00th=[ 36], 20.00th=[ 43], | 30.00th=[ 48], 40.00th=[ 55], 50.00th=[ 59], 60.00th=[ 66], | 70.00th=[ 74], 80.00th=[ 87], 90.00th=[ 105], 95.00th=[ 125], | 99.00th=[ 174], 99.50th=[ 188], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 320, per=27.71%, avg=183.70, stdev=71.52, samples=69 iops : min= 1, max= 20, avg=10.87, stdev= 4.70, samples=69 lat (msec) : 10=9.24%, 20=21.48%, 50=30.47%, 100=32.03%, 250=6.77% cpu : usr=0.05%, sys=3.13%, ctx=1530, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158293: Wed Sep 2 10:59:03 2026 read: IOPS=11, BW=182KiB/s (187kB/s)(6256KiB/34289msec) clat (msec): min=4, max=138, avg=20.86, stdev=17.82 lat (msec): min=4, max=138, avg=20.86, stdev=17.82 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 21], 80.00th=[ 28], 90.00th=[ 39], 95.00th=[ 53], | 99.00th=[ 110], 99.50th=[ 123], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 478, per=29.51%, avg=185.30, stdev=106.56, samples=67 iops : min= 1, max= 29, avg=10.97, stdev= 6.80, samples=67 write: IOPS=10, BW=176KiB/s (180kB/s)(6032KiB/34289msec); 0 zone resets clat (msec): min=24, max=196, avg=69.15, stdev=30.49 lat (msec): min=24, max=196, avg=69.15, stdev=30.49 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 36], 10.00th=[ 41], 20.00th=[ 45], | 30.00th=[ 50], 40.00th=[ 57], 50.00th=[ 63], 60.00th=[ 68], | 70.00th=[ 77], 80.00th=[ 88], 90.00th=[ 110], 95.00th=[ 138], | 99.00th=[ 167], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 63, max= 320, per=26.50%, avg=175.69, stdev=69.44, samples=68 iops : min= 3, max= 20, avg=10.37, stdev= 4.57, samples=68 lat (msec) : 10=10.81%, 20=24.74%, 50=27.73%, 100=28.91%, 250=7.81% cpu : usr=0.05%, sys=3.30%, ctx=1504, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158295: Wed Sep 2 10:59:03 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(6032KiB/34896msec) clat (msec): min=4, max=144, avg=22.66, stdev=20.92 lat (msec): min=4, max=144, avg=22.66, stdev=20.92 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 69], | 99.00th=[ 110], 99.50th=[ 124], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 30, max= 416, per=27.64%, avg=173.57, stdev=98.07, samples=68 iops : min= 1, max= 26, avg=10.22, stdev= 6.32, samples=68 write: IOPS=11, BW=179KiB/s (184kB/s)(6256KiB/34896msec); 0 zone resets clat (msec): min=26, max=216, avg=66.97, stdev=29.95 lat (msec): min=26, max=216, avg=66.97, stdev=29.95 clat percentiles (msec): | 1.00th=[ 31], 5.00th=[ 35], 10.00th=[ 38], 20.00th=[ 43], | 30.00th=[ 47], 40.00th=[ 53], 50.00th=[ 59], 60.00th=[ 66], | 70.00th=[ 74], 80.00th=[ 89], 90.00th=[ 109], 95.00th=[ 131], | 99.00th=[ 161], 99.50th=[ 192], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 63, max= 351, per=27.02%, avg=179.16, stdev=74.78, samples=69 iops : min= 3, max= 21, avg=10.58, stdev= 4.88, samples=69 lat (msec) : 10=11.20%, 20=20.83%, 50=31.64%, 100=28.13%, 250=8.20% cpu : usr=0.06%, sys=3.33%, ctx=1594, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=628KiB/s (643kB/s), 146KiB/s-182KiB/s (149kB/s-187kB/s), io=21.5MiB (22.6MB), run=27537-35103msec WRITE: bw=663KiB/s (679kB/s), 162KiB/s-186KiB/s (165kB/s-191kB/s), io=22.7MiB (23.8MB), run=27537-35103msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158308: Wed Sep 2 10:59:13 2026 read: IOPS=3, BW=3628KiB/s (3715kB/s)(7168KiB/1976msec) clat (msec): min=44, max=263, avg=107.67, stdev=72.14 lat (msec): min=44, max=263, avg=107.67, stdev=72.14 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 68], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 82], 60.00th=[ 105], | 70.00th=[ 105], 80.00th=[ 113], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 2035, max= 7211, per=85.80%, avg=4623.00, stdev=3659.98, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 write: IOPS=2, BW=2591KiB/s (2653kB/s)(5120KiB/1976msec); 0 zone resets clat (msec): min=99, max=423, avg=234.27, stdev=146.23 lat (msec): min=99, max=423, avg=234.51, stdev=146.10 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1802, max= 4071, per=38.93%, avg=2936.50, stdev=1604.43, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=8.33%, 100=33.33%, 250=33.33%, 500=25.00% cpu : usr=0.05%, sys=10.48%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158309: Wed Sep 2 10:59:13 2026 read: IOPS=0, BW=539KiB/s (552kB/s)(2048KiB/3797msec) clat (msec): min=62, max=104, avg=83.47, stdev=29.88 lat (msec): min=62, max=104, avg=83.47, stdev=29.88 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 105], | 70.00th=[ 105], 80.00th=[ 105], 90.00th=[ 105], 95.00th=[ 105], | 99.00th=[ 105], 99.50th=[ 105], 99.90th=[ 105], 99.95th=[ 105], | 99.99th=[ 105] bw ( KiB/s): min= 1756, max= 2035, per=35.18%, avg=1895.50, stdev=197.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2697KiB/s (2762kB/s)(10.0MiB/3797msec); 0 zone resets clat (msec): min=77, max=1702, avg=356.25, stdev=504.56 lat (msec): min=77, max=1703, avg=356.44, stdev=504.79 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 84], | 30.00th=[ 90], 40.00th=[ 117], 50.00th=[ 159], 60.00th=[ 201], | 70.00th=[ 213], 80.00th=[ 245], 90.00th=[ 676], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 2035, max= 6047, per=46.23%, avg=3486.80, stdev=2001.03, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 2.05, samples=5 lat (msec) : 100=33.33%, 250=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.05%, sys=7.30%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158310: Wed Sep 2 10:59:13 2026 read: IOPS=1, BW=1758KiB/s (1801kB/s)(6144KiB/3494msec) clat (msec): min=55, max=238, avg=114.19, stdev=65.80 lat (msec): min=55, max=238, avg=114.22, stdev=65.78 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 74], | 30.00th=[ 74], 40.00th=[ 84], 50.00th=[ 84], 60.00th=[ 107], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 1802, max= 4071, per=48.92%, avg=2636.00, stdev=1248.20, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1758KiB/s (1801kB/s)(6144KiB/3494msec); 0 zone resets clat (msec): min=97, max=1995, avg=465.33, stdev=752.73 lat (msec): min=97, max=1995, avg=465.42, stdev=752.70 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 199], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 2035, max= 5408, per=49.34%, avg=3721.50, stdev=2385.07, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=33.33%, 250=50.00%, 500=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.64%, ctx=128, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158311: Wed Sep 2 10:59:13 2026 read: IOPS=1, BW=1347KiB/s (1379kB/s)(5120KiB/3801msec) clat (msec): min=115, max=271, avg=185.56, stdev=69.93 lat (msec): min=115, max=271, avg=185.56, stdev=69.93 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 2015, max= 6107, per=75.37%, avg=4061.00, stdev=2893.48, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1886KiB/s (1931kB/s)(7168KiB/3801msec); 0 zone resets clat (msec): min=89, max=1597, avg=401.45, stdev=542.55 lat (msec): min=89, max=1597, avg=401.53, stdev=542.55 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 121], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 174], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 472], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 2035, max= 6144, per=59.51%, avg=4488.67, stdev=2167.71, samples=3 iops : min= 1, max= 6, avg= 4.00, stdev= 2.65, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.76%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5388KiB/s (5517kB/s), 539KiB/s-3628KiB/s (552kB/s-3715kB/s), io=20.0MiB (20.0MB), run=1976-3801msec WRITE: bw=7543KiB/s (7724kB/s), 1758KiB/s-2697KiB/s (1801kB/s-2762kB/s), io=28.0MiB (29.4MB), run=1976-3801msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158313: Wed Sep 2 10:59:13 2026 read: IOPS=1, BW=1982KiB/s (2029kB/s)(7168KiB/3617msec) clat (usec): min=357, max=2341.0k, avg=425630.77, stdev=848794.35 lat (usec): min=358, max=2341.0k, avg=425631.84, stdev=848794.34 clat percentiles (usec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], | 20.00th=[ 947], 30.00th=[ 110625], 40.00th=[ 110625], | 50.00th=[ 129500], 60.00th=[ 162530], 70.00th=[ 162530], | 80.00th=[ 233833], 90.00th=[2332034], 95.00th=[2332034], | 99.00th=[2332034], 99.50th=[2332034], 99.90th=[2332034], | 99.95th=[2332034], 99.99th=[2332034] bw ( KiB/s): min= 2035, max= 6107, per=70.52%, avg=3859.33, stdev=2068.74, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1416KiB/s (1450kB/s)(5120KiB/3617msec); 0 zone resets clat (msec): min=48, max=235, avg=127.05, stdev=73.12 lat (msec): min=48, max=235, avg=127.14, stdev=73.16 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 49], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 133], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 236], 95.00th=[ 236], | 99.00th=[ 236], 99.50th=[ 236], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 2035, max= 8143, per=66.42%, avg=5089.00, stdev=4319.01, samples=2 iops : min= 1, max= 7, avg= 4.00, stdev= 4.24, samples=2 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=19.55%, ctx=735, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158314: Wed Sep 2 10:59:13 2026 read: IOPS=0, BW=564KiB/s (577kB/s)(2048KiB/3634msec) clat (usec): min=502, max=106875, avg=53688.76, stdev=75217.36 lat (usec): min=503, max=106877, avg=53690.48, stdev=75218.25 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 502], 50.00th=[ 502], 60.00th=[106431], | 70.00th=[106431], 80.00th=[106431], 90.00th=[106431], 95.00th=[106431], | 99.00th=[106431], 99.50th=[106431], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 1732, max= 2043, per=34.49%, avg=1887.50, stdev=219.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2818KiB/s (2885kB/s)(10.0MiB/3634msec); 0 zone resets clat (msec): min=123, max=1526, avg=350.81, stdev=430.75 lat (msec): min=132, max=1526, avg=352.41, stdev=429.88 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 132], | 30.00th=[ 140], 40.00th=[ 146], 50.00th=[ 157], 60.00th=[ 178], | 70.00th=[ 247], 80.00th=[ 359], 90.00th=[ 502], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 2035, max= 8159, per=59.95%, avg=4593.25, stdev=3060.62, samples=4 iops : min= 1, max= 7, avg= 3.75, stdev= 2.75, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=20.15%, ctx=158, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158315: Wed Sep 2 10:59:13 2026 read: IOPS=1, BW=1642KiB/s (1681kB/s)(6144KiB/3742msec) clat (usec): min=448, max=145822, avg=65871.33, stdev=72933.83 lat (usec): min=449, max=145823, avg=65872.63, stdev=72933.80 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 603], 50.00th=[ 603], 60.00th=[105382], | 70.00th=[141558], 80.00th=[141558], 90.00th=[145753], 95.00th=[145753], | 99.00th=[145753], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 2035, max= 4096, per=62.23%, avg=3406.00, stdev=1187.33, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1642KiB/s (1681kB/s)(6144KiB/3742msec); 0 zone resets clat (msec): min=156, max=1740, avg=557.59, stdev=613.12 lat (msec): min=156, max=1740, avg=557.65, stdev=613.14 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 388], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 2035, max= 3543, per=31.54%, avg=2416.25, stdev=751.19, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=14.43%, ctx=168, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158316: Wed Sep 2 10:59:13 2026 read: IOPS=1, BW=1377KiB/s (1411kB/s)(5120KiB/3717msec) clat (usec): min=493, max=273390, avg=120302.46, stdev=118551.30 lat (usec): min=494, max=273390, avg=120303.59, stdev=118551.00 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[ 1532], 40.00th=[ 1532], 50.00th=[145753], 60.00th=[145753], | 70.00th=[181404], 80.00th=[181404], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 4079, max= 4087, per=74.60%, avg=4083.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1928KiB/s (1975kB/s)(7168KiB/3717msec); 0 zone resets clat (msec): min=134, max=1584, avg=444.81, stdev=517.54 lat (msec): min=134, max=1584, avg=444.89, stdev=517.51 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 155], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 215], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 464], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 2035, max= 4079, per=44.35%, avg=3398.00, stdev=961.69, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 2000=8.33% cpu : usr=0.00%, sys=18.22%, ctx=231, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5473KiB/s (5604kB/s), 564KiB/s-1982KiB/s (577kB/s-2029kB/s), io=20.0MiB (20.0MB), run=3617-3742msec WRITE: bw=7662KiB/s (7846kB/s), 1416KiB/s-2818KiB/s (1450kB/s-2885kB/s), io=28.0MiB (29.4MB), run=3617-3742msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158322: Wed Sep 2 10:59:21 2026 read: IOPS=1, BW=6561KiB/s (6718kB/s)(12.0MiB/1873msec) clat (msec): min=463, max=658, avg=555.00, stdev=98.26 lat (msec): min=463, max=658, avg=555.00, stdev=98.26 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8175, max= 8192, per=93.56%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=24.15%, ctx=815, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158323: Wed Sep 2 10:59:21 2026 read: IOPS=0, BW=3080KiB/s (3154kB/s)(4096KiB/1330msec) clat (nsec): min=474783k, max=474783k, avg=474782715.00, stdev= 0.00 lat (nsec): min=474785k, max=474785k, avg=474785151.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 5720, max= 5720, per=65.39%, avg=5720.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6159KiB/s (6307kB/s)(8192KiB/1330msec); 0 zone resets clat (msec): min=190, max=561, avg=376.38, stdev=262.22 lat (msec): min=191, max=562, avg=376.74, stdev=262.27 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 8175, max= 8175, per=61.32%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=20.02%, ctx=331, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158324: Wed Sep 2 10:59:21 2026 write: IOPS=1, BW=4999KiB/s (5119kB/s)(12.0MiB/2458msec); 0 zone resets clat (msec): min=144, max=1554, avg=728.50, stdev=735.54 lat (msec): min=144, max=1554, avg=728.78, stdev=735.67 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8159, max= 8159, per=61.20%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.04%, sys=10.99%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158325: Wed Sep 2 10:59:21 2026 write: IOPS=1, BW=8159KiB/s (8355kB/s)(12.0MiB/1506msec); 0 zone resets clat (msec): min=148, max=1041, avg=483.98, stdev=485.75 lat (msec): min=149, max=1041, avg=484.39, stdev=485.71 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min=12082, max=12082, per=90.63%, avg=12082.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.24%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8747KiB/s (8957kB/s), 3080KiB/s-6561KiB/s (3154kB/s-6718kB/s), io=16.0MiB (16.8MB), run=1330-1873msec WRITE: bw=13.0MiB/s (13.7MB/s), 4999KiB/s-8159KiB/s (5119kB/s-8355kB/s), io=32.0MiB (33.6MB), run=1330-2458msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158326: Wed Sep 2 10:59:21 2026 read: IOPS=1, BW=6536KiB/s (6693kB/s)(12.0MiB/1880msec) clat (msec): min=251, max=781, avg=587.57, stdev=292.13 lat (msec): min=251, max=781, avg=587.57, stdev=292.13 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 251], | 30.00th=[ 251], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8192, max= 8192, per=94.01%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.33%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158327: Wed Sep 2 10:59:21 2026 read: IOPS=0, BW=2716KiB/s (2781kB/s)(4096KiB/1508msec) clat (nsec): min=639659k, max=639659k, avg=639659320.00, stdev= 0.00 lat (nsec): min=639662k, max=639662k, avg=639661877.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8192, max= 8192, per=94.01%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5432KiB/s (5563kB/s)(8192KiB/1508msec); 0 zone resets clat (msec): min=178, max=605, avg=392.05, stdev=301.43 lat (msec): min=179, max=606, avg=392.99, stdev=301.98 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8192, max= 8192, per=56.83%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=10.35%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158328: Wed Sep 2 10:59:21 2026 write: IOPS=1, BW=5406KiB/s (5536kB/s)(12.0MiB/2273msec); 0 zone resets clat (msec): min=431, max=1134, avg=731.58, stdev=362.98 lat (msec): min=431, max=1135, avg=731.95, stdev=362.94 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8192, max= 8192, per=56.83%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.52%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158329: Wed Sep 2 10:59:21 2026 write: IOPS=1, BW=6657KiB/s (6816kB/s)(12.0MiB/1846msec); 0 zone resets clat (msec): min=349, max=865, avg=592.66, stdev=259.28 lat (msec): min=349, max=865, avg=593.05, stdev=259.30 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7787, max= 8192, per=55.42%, avg=7989.50, stdev=286.38, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=9.16%, ctx=134, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8715KiB/s (8924kB/s), 2716KiB/s-6536KiB/s (2781kB/s-6693kB/s), io=16.0MiB (16.8MB), run=1508-1880msec WRITE: bw=14.1MiB/s (14.8MB/s), 5406KiB/s-6657KiB/s (5536kB/s-6816kB/s), io=32.0MiB (33.6MB), run=1508-2273msec