== sanity test 398b: DIO and buffer IO race ============== 00:03:04 (1789185784) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.87011 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144513: Sat Sep 12 00:05:48 2026 read: IOPS=10, BW=43.6KiB/s (44.6kB/s)(5992KiB/137525msec) clat (usec): min=24, max=1163.3k, avg=45614.52, stdev=47506.85 lat (usec): min=25, max=1163.3k, avg=45618.20, stdev=47506.60 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 188], | 20.00th=[ 20841], 30.00th=[ 26346], 40.00th=[ 31851], | 50.00th=[ 38011], 60.00th=[ 44827], 70.00th=[ 55313], | 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[ 101188], | 99.00th=[ 145753], 99.50th=[ 162530], 99.90th=[ 666895], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 103, per=25.50%, avg=43.35, stdev=19.09, samples=269 iops : min= 1, max= 25, avg=10.19, stdev= 4.81, samples=269 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6296KiB/137525msec); 0 zone resets clat (usec): min=905, max=438207, avg=43647.24, stdev=48535.12 lat (usec): min=906, max=438208, avg=43651.45, stdev=48533.96 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1795], 20.00th=[ 4555], | 30.00th=[ 9241], 40.00th=[ 18744], 50.00th=[ 30540], 60.00th=[ 42206], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[132645], | 99.00th=[210764], 99.50th=[283116], 99.90th=[429917], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 7, max= 127, per=25.69%, avg=45.73, stdev=18.66, samples=268 iops : min= 1, max= 31, avg=10.79, stdev= 4.70, samples=268 lat (usec) : 50=0.36%, 100=4.04%, 250=0.49%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.63%, 4=3.97%, 10=6.35%, 20=9.05%, 50=35.64% lat (msec) : 100=26.14%, 250=7.71%, 500=0.33%, 750=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.89%, ctx=6643, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144516: Sat Sep 12 00:05:48 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(5940KiB/139692msec) clat (usec): min=33, max=1119.6k, avg=45429.12, stdev=43587.28 lat (usec): min=33, max=1119.6k, avg=45433.62, stdev=43587.12 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 12387], | 20.00th=[ 21103], 30.00th=[ 26608], 40.00th=[ 32375], | 50.00th=[ 38011], 60.00th=[ 44303], 70.00th=[ 55313], | 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[ 102237], | 99.00th=[ 152044], 99.50th=[ 185598], 99.90th=[ 492831], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 5, max= 111, per=25.07%, avg=42.63, stdev=18.61, samples=271 iops : min= 1, max= 27, avg=10.01, stdev= 4.67, samples=271 write: IOPS=11, BW=45.4KiB/s (46.5kB/s)(6348KiB/139692msec); 0 zone resets clat (usec): min=933, max=461550, avg=45228.53, stdev=47660.81 lat (usec): min=934, max=461551, avg=45232.46, stdev=47661.28 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1385], 10.00th=[ 1876], 20.00th=[ 4752], | 30.00th=[ 9765], 40.00th=[ 21103], 50.00th=[ 33424], 60.00th=[ 46400], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[106431], 95.00th=[130548], | 99.00th=[202376], 99.50th=[256902], 99.90th=[442500], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 151, per=25.26%, avg=44.96, stdev=21.68, samples=274 iops : min= 1, max= 37, avg=10.60, stdev= 5.46, samples=274 lat (usec) : 50=0.16%, 100=3.42%, 250=0.49%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=5.79%, 4=3.74%, 10=6.41%, 20=8.56%, 50=35.38% lat (msec) : 100=27.02%, 250=8.40%, 500=0.33%, 2000=0.03% cpu : usr=0.09%, sys=4.71%, ctx=6667, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144518: Sat Sep 12 00:05:48 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(6028KiB/140580msec) clat (usec): min=32, max=614093, avg=44401.67, stdev=35956.87 lat (usec): min=32, max=614095, avg=44405.61, stdev=35958.62 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 65], 10.00th=[ 619], 20.00th=[ 19268], | 30.00th=[ 25822], 40.00th=[ 31327], 50.00th=[ 37487], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[152044], 99.50th=[177210], 99.90th=[283116], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 182, per=25.55%, avg=43.43, stdev=22.57, samples=270 iops : min= 1, max= 45, avg=10.21, stdev= 5.69, samples=270 write: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6260KiB/140580msec); 0 zone resets clat (usec): min=941, max=1007.0k, avg=46755.93, stdev=54389.69 lat (usec): min=942, max=1007.0k, avg=46762.09, stdev=54389.99 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1385], 10.00th=[ 1991], | 20.00th=[ 4883], 30.00th=[ 10683], 40.00th=[ 22152], | 50.00th=[ 33424], 60.00th=[ 46400], 70.00th=[ 60556], | 80.00th=[ 80217], 90.00th=[ 108528], 95.00th=[ 135267], | 99.00th=[ 202376], 99.50th=[ 278922], 99.90th=[ 583009], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 206, per=25.00%, avg=44.49, stdev=22.39, samples=274 iops : min= 1, max= 51, avg=10.47, stdev= 5.62, samples=274 lat (usec) : 50=0.33%, 100=3.94%, 250=0.46%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=5.24%, 4=3.84%, 10=6.18%, 20=9.05%, 50=34.99% lat (msec) : 100=26.63%, 250=8.72%, 500=0.23%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=4.77%, ctx=6817, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144519: Sat Sep 12 00:05:48 2026 read: IOPS=10, BW=43.9KiB/s (44.9kB/s)(6052KiB/137951msec) clat (usec): min=32, max=329093, avg=43908.81, stdev=33710.59 lat (usec): min=32, max=329094, avg=43918.13, stdev=33707.45 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 121], 20.00th=[ 19006], | 30.00th=[ 25297], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[152044], 99.50th=[181404], 99.90th=[308282], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 103, per=25.98%, avg=44.17, stdev=19.27, samples=267 iops : min= 1, max= 25, avg=10.39, stdev= 4.86, samples=267 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6236KiB/137951msec); 0 zone resets clat (usec): min=1032, max=980732, avg=45492.97, stdev=54050.82 lat (usec): min=1034, max=980737, avg=45497.42, stdev=54053.73 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1352], 10.00th=[ 2147], 20.00th=[ 4817], | 30.00th=[ 10028], 40.00th=[ 20579], 50.00th=[ 34341], 60.00th=[ 45876], | 70.00th=[ 57934], 80.00th=[ 76022], 90.00th=[101188], 95.00th=[130548], | 99.00th=[208667], 99.50th=[256902], 99.90th=[549454], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 101, per=25.33%, avg=45.09, stdev=18.65, samples=269 iops : min= 1, max= 25, avg=10.63, stdev= 4.71, samples=269 lat (usec) : 50=0.52%, 100=3.97%, 250=0.85%, 500=0.26%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.95%, 4=3.91%, 10=6.90%, 20=8.92%, 50=33.92% lat (msec) : 100=27.64%, 250=7.71%, 500=0.23%, 750=0.07%, 1000=0.03% cpu : usr=0.07%, sys=4.72%, ctx=6591, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=171KiB/s (175kB/s), 42.5KiB/s-43.9KiB/s (43.5kB/s-44.9kB/s), io=23.4MiB (24.6MB), run=137525-140580msec WRITE: bw=179KiB/s (183kB/s), 44.5KiB/s-45.8KiB/s (45.6kB/s-46.9kB/s), io=24.6MiB (25.7MB), run=137525-140580msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144512: Sat Sep 12 00:07:55 2026 read: IOPS=5, BW=22.3KiB/s (22.9kB/s)(5992KiB/268237msec) clat (msec): min=6, max=1198, avg=39.35, stdev=50.98 lat (msec): min=6, max=1198, avg=39.35, stdev=50.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 112], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 609], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 95, per=28.43%, avg=25.30, stdev=16.96, samples=458 iops : min= 1, max= 23, avg= 5.70, stdev= 4.28, samples=458 write: IOPS=5, BW=23.5KiB/s (24.0kB/s)(6296KiB/268237msec); 0 zone resets clat (msec): min=42, max=948, avg=132.70, stdev=71.82 lat (msec): min=42, max=948, avg=132.70, stdev=71.82 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 128], | 70.00th=[ 150], 80.00th=[ 184], 90.00th=[ 230], 95.00th=[ 275], | 99.00th=[ 359], 99.50th=[ 409], 99.90th=[ 542], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 55, per=25.47%, avg=23.69, stdev=11.36, samples=512 iops : min= 1, max= 13, avg= 5.30, stdev= 2.92, samples=512 lat (msec) : 10=2.41%, 20=14.26%, 50=22.36%, 100=27.08%, 250=29.95% lat (msec) : 500=3.74%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.27%, ctx=5481, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144514: Sat Sep 12 00:07:55 2026 read: IOPS=5, BW=22.1KiB/s (22.7kB/s)(5940KiB/268231msec) clat (msec): min=5, max=873, avg=39.34, stdev=43.41 lat (msec): min=5, max=873, avg=39.35, stdev=43.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 85], 95.00th=[ 112], | 99.00th=[ 184], 99.50th=[ 218], 99.90th=[ 489], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 104, per=28.26%, avg=25.15, stdev=16.92, samples=456 iops : min= 1, max= 26, avg= 5.67, stdev= 4.30, samples=456 write: IOPS=5, BW=23.7KiB/s (24.2kB/s)(6348KiB/268231msec); 0 zone resets clat (msec): min=36, max=953, avg=131.94, stdev=73.97 lat (msec): min=36, max=953, avg=131.94, stdev=73.97 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 148], 80.00th=[ 178], 90.00th=[ 224], 95.00th=[ 271], | 99.00th=[ 368], 99.50th=[ 397], 99.90th=[ 667], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 56, per=25.08%, avg=23.33, stdev=11.43, samples=524 iops : min= 1, max= 14, avg= 5.21, stdev= 2.94, samples=524 lat (msec) : 10=2.21%, 20=13.61%, 50=23.31%, 100=26.43%, 250=30.99% lat (msec) : 500=3.22%, 750=0.16%, 1000=0.07% cpu : usr=0.04%, sys=1.30%, ctx=5507, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144515: Sat Sep 12 00:07:55 2026 read: IOPS=5, BW=22.7KiB/s (23.2kB/s)(6028KiB/266008msec) clat (msec): min=5, max=594, avg=38.70, stdev=39.64 lat (msec): min=5, max=594, avg=38.70, stdev=39.64 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 110], | 99.00th=[ 178], 99.50th=[ 253], 99.90th=[ 498], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 112, per=28.18%, avg=25.08, stdev=17.60, samples=465 iops : min= 1, max= 28, avg= 5.66, stdev= 4.47, samples=465 write: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6260KiB/266008msec); 0 zone resets clat (msec): min=38, max=1033, avg=132.45, stdev=76.26 lat (msec): min=38, max=1033, avg=132.45, stdev=76.26 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 110], 60.00th=[ 125], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 230], 95.00th=[ 275], | 99.00th=[ 393], 99.50th=[ 418], 99.90th=[ 726], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 56, per=25.06%, avg=23.31, stdev=11.87, samples=518 iops : min= 1, max= 14, avg= 5.20, stdev= 3.04, samples=518 lat (msec) : 10=2.64%, 20=14.19%, 50=22.56%, 100=27.54%, 250=28.97% lat (msec) : 500=3.94%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.29%, ctx=5517, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144517: Sat Sep 12 00:07:55 2026 read: IOPS=5, BW=22.8KiB/s (23.3kB/s)(6052KiB/265728msec) clat (msec): min=5, max=825, avg=38.60, stdev=43.99 lat (msec): min=5, max=825, avg=38.61, stdev=43.99 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 81], 95.00th=[ 114], | 99.00th=[ 192], 99.50th=[ 245], 99.90th=[ 567], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 111, per=28.86%, avg=25.68, stdev=16.80, samples=456 iops : min= 1, max= 27, avg= 5.80, stdev= 4.27, samples=456 write: IOPS=5, BW=23.5KiB/s (24.0kB/s)(6236KiB/265728msec); 0 zone resets clat (msec): min=36, max=1002, avg=132.72, stdev=73.29 lat (msec): min=36, max=1002, avg=132.72, stdev=73.29 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 86], 40.00th=[ 99], 50.00th=[ 110], 60.00th=[ 126], | 70.00th=[ 155], 80.00th=[ 184], 90.00th=[ 230], 95.00th=[ 271], | 99.00th=[ 351], 99.50th=[ 426], 99.90th=[ 667], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 48, per=24.99%, avg=23.24, stdev=11.54, samples=517 iops : min= 1, max= 12, avg= 5.18, stdev= 2.95, samples=517 lat (msec) : 10=1.92%, 20=14.26%, 50=24.32%, 100=27.15%, 250=28.22% lat (msec) : 500=3.97%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.26%, ctx=5506, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.5KiB/s (91.7kB/s), 22.1KiB/s-22.8KiB/s (22.7kB/s-23.3kB/s), io=23.4MiB (24.6MB), run=265728-268237msec WRITE: bw=93.7KiB/s (95.0kB/s), 23.5KiB/s-23.7KiB/s (24.0kB/s-24.2kB/s), io=24.6MiB (25.7MB), run=265728-268237msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144578: Sat Sep 12 00:08:23 2026 read: IOPS=18, BW=303KiB/s (311kB/s)(5920KiB/19516msec) clat (usec): min=34, max=142667, avg=25140.68, stdev=20204.73 lat (usec): min=34, max=142668, avg=25145.05, stdev=20207.67 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 76], 20.00th=[ 578], | 30.00th=[ 17171], 40.00th=[ 20055], 50.00th=[ 22938], 60.00th=[ 26084], | 70.00th=[ 31589], 80.00th=[ 39060], 90.00th=[ 47973], 95.00th=[ 55837], | 99.00th=[ 99091], 99.50th=[129500], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 127, max= 480, per=25.79%, avg=296.84, stdev=87.90, samples=38 iops : min= 7, max= 30, avg=17.92, stdev= 5.55, samples=38 write: IOPS=20, BW=326KiB/s (334kB/s)(6368KiB/19516msec); 0 zone resets clat (usec): min=1446, max=213551, avg=25177.94, stdev=27101.01 lat (usec): min=1448, max=213553, avg=25180.48, stdev=27101.39 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2343], 10.00th=[ 3458], 20.00th=[ 4948], | 30.00th=[ 6980], 40.00th=[ 11469], 50.00th=[ 17957], 60.00th=[ 23200], | 70.00th=[ 30016], 80.00th=[ 40633], 90.00th=[ 56361], 95.00th=[ 78119], | 99.00th=[139461], 99.50th=[162530], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 83, max= 539, per=26.75%, avg=323.89, stdev=96.88, samples=38 iops : min= 5, max= 33, avg=19.63, stdev= 6.09, samples=38 lat (usec) : 50=0.78%, 100=6.12%, 250=1.95%, 500=0.65%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.82%, 4=5.47%, 10=12.89%, 20=18.62%, 50=40.89% lat (msec) : 100=8.72%, 250=1.69% cpu : usr=0.11%, sys=10.92%, ctx=1734, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144579: Sat Sep 12 00:08:23 2026 read: IOPS=17, BW=276KiB/s (283kB/s)(5744KiB/20800msec) clat (usec): min=39, max=157345, avg=26188.31, stdev=20229.26 lat (usec): min=39, max=157346, avg=26189.52, stdev=20229.28 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 78], 20.00th=[ 3326], | 30.00th=[ 16450], 40.00th=[ 20579], 50.00th=[ 24773], 60.00th=[ 28705], | 70.00th=[ 34341], 80.00th=[ 41157], 90.00th=[ 51643], 95.00th=[ 61080], | 99.00th=[ 84411], 99.50th=[108528], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 28, max= 512, per=23.92%, avg=275.34, stdev=123.93, samples=41 iops : min= 1, max= 32, avg=16.61, stdev= 7.89, samples=41 write: IOPS=19, BW=315KiB/s (322kB/s)(6544KiB/20800msec); 0 zone resets clat (usec): min=1504, max=228478, avg=27694.24, stdev=31769.50 lat (usec): min=1504, max=228480, avg=27697.41, stdev=31770.08 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2409], 10.00th=[ 3195], 20.00th=[ 4293], | 30.00th=[ 5866], 40.00th=[ 8848], 50.00th=[ 16319], 60.00th=[ 25560], | 70.00th=[ 34341], 80.00th=[ 45351], 90.00th=[ 61604], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[164627], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 95, max= 608, per=25.87%, avg=313.32, stdev=122.45, samples=41 iops : min= 5, max= 38, avg=19.00, stdev= 7.84, samples=41 lat (usec) : 50=0.39%, 100=6.25%, 250=1.69%, 500=0.39%, 750=0.26% lat (msec) : 2=1.56%, 4=8.07%, 10=13.54%, 20=14.58%, 50=39.32% lat (msec) : 100=11.20%, 250=2.73% cpu : usr=0.12%, sys=10.33%, ctx=1722, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144580: Sat Sep 12 00:08:23 2026 read: IOPS=20, BW=326KiB/s (334kB/s)(6256KiB/19188msec) clat (usec): min=37, max=127084, avg=26822.90, stdev=19903.57 lat (usec): min=37, max=127085, avg=26824.61, stdev=19903.30 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 67], 10.00th=[ 91], 20.00th=[ 12911], | 30.00th=[ 17433], 40.00th=[ 21627], 50.00th=[ 23725], 60.00th=[ 26608], | 70.00th=[ 32113], 80.00th=[ 41681], 90.00th=[ 51119], 95.00th=[ 62653], | 99.00th=[ 95945], 99.50th=[110625], 99.90th=[127402], 99.95th=[127402], | 99.99th=[127402] bw ( KiB/s): min= 56, max= 633, per=28.44%, avg=327.37, stdev=110.80, samples=38 iops : min= 3, max= 39, avg=19.84, stdev= 7.05, samples=38 write: IOPS=19, BW=314KiB/s (322kB/s)(6032KiB/19188msec); 0 zone resets clat (usec): min=1515, max=222640, avg=22457.50, stdev=24143.70 lat (usec): min=1519, max=222641, avg=22460.15, stdev=24143.42 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2376], 10.00th=[ 3097], 20.00th=[ 4424], | 30.00th=[ 6194], 40.00th=[ 8455], 50.00th=[ 13435], 60.00th=[ 22152], | 70.00th=[ 28443], 80.00th=[ 39584], 90.00th=[ 50594], 95.00th=[ 64226], | 99.00th=[106431], 99.50th=[152044], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 84, max= 604, per=25.99%, avg=314.74, stdev=109.28, samples=38 iops : min= 5, max= 37, avg=19.05, stdev= 6.87, samples=38 lat (usec) : 50=0.78%, 100=4.95%, 250=1.69%, 500=0.26%, 750=0.13% lat (msec) : 2=1.30%, 4=7.68%, 10=13.28%, 20=17.06%, 50=41.80% lat (msec) : 100=10.03%, 250=1.04% cpu : usr=0.13%, sys=10.90%, ctx=1704, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144581: Sat Sep 12 00:08:23 2026 read: IOPS=18, BW=299KiB/s (306kB/s)(6032KiB/20166msec) clat (usec): min=43, max=171771, avg=29274.59, stdev=25983.66 lat (usec): min=43, max=171772, avg=29276.44, stdev=25985.66 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 87], 20.00th=[ 3392], | 30.00th=[ 17433], 40.00th=[ 21890], 50.00th=[ 26608], 60.00th=[ 30802], | 70.00th=[ 35914], 80.00th=[ 43779], 90.00th=[ 54264], 95.00th=[ 71828], | 99.00th=[137364], 99.50th=[170918], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 95, max= 532, per=25.77%, avg=296.64, stdev=97.40, samples=39 iops : min= 5, max= 33, avg=17.92, stdev= 6.19, samples=39 write: IOPS=19, BW=310KiB/s (318kB/s)(6256KiB/20166msec); 0 zone resets clat (usec): min=1432, max=160607, avg=23004.70, stdev=24944.11 lat (usec): min=1433, max=160608, avg=23007.51, stdev=24943.71 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2311], 10.00th=[ 2999], 20.00th=[ 4490], | 30.00th=[ 5604], 40.00th=[ 7898], 50.00th=[ 13829], 60.00th=[ 20579], | 70.00th=[ 28967], 80.00th=[ 39584], 90.00th=[ 55313], 95.00th=[ 66847], | 99.00th=[137364], 99.50th=[154141], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 127, max= 604, per=25.57%, avg=309.67, stdev=99.86, samples=39 iops : min= 7, max= 37, avg=18.74, stdev= 6.31, samples=39 lat (usec) : 50=0.26%, 100=5.47%, 250=2.86%, 500=0.65%, 750=0.13% lat (msec) : 2=1.82%, 4=7.94%, 10=13.67%, 20=13.80%, 50=39.58% lat (msec) : 100=11.59%, 250=2.21% cpu : usr=0.17%, sys=10.56%, ctx=1737, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1152KiB/s (1179kB/s), 276KiB/s-326KiB/s (283kB/s-334kB/s), io=23.4MiB (24.5MB), run=19188-20800msec WRITE: bw=1212KiB/s (1241kB/s), 310KiB/s-326KiB/s (318kB/s-334kB/s), io=24.6MiB (25.8MB), run=19188-20800msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144573: Sat Sep 12 00:08:52 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5920KiB/48810msec) clat (msec): min=7, max=263, avg=30.66, stdev=27.58 lat (msec): min=7, max=263, avg=30.67, stdev=27.57 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 57], 95.00th=[ 77], | 99.00th=[ 159], 99.50th=[ 192], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 384, per=26.44%, avg=127.68, stdev=69.77, samples=92 iops : min= 1, max= 24, avg= 7.35, stdev= 4.43, samples=92 write: IOPS=8, BW=130KiB/s (134kB/s)(6368KiB/48810msec); 0 zone resets clat (msec): min=38, max=252, avg=94.00, stdev=37.29 lat (msec): min=38, max=252, avg=94.00, stdev=37.29 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 54], 10.00th=[ 56], 20.00th=[ 66], | 30.00th=[ 72], 40.00th=[ 79], 50.00th=[ 84], 60.00th=[ 93], | 70.00th=[ 104], 80.00th=[ 117], 90.00th=[ 148], 95.00th=[ 169], | 99.00th=[ 215], 99.50th=[ 228], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 31, max= 255, per=25.56%, avg=130.10, stdev=49.46, samples=97 iops : min= 1, max= 15, avg= 7.49, stdev= 3.16, samples=97 lat (msec) : 10=2.21%, 20=17.19%, 50=24.74%, 100=37.63%, 250=17.97% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.16%, ctx=1501, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144575: Sat Sep 12 00:08:52 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(5744KiB/49503msec) clat (msec): min=8, max=193, avg=29.10, stdev=25.23 lat (msec): min=8, max=193, avg=29.10, stdev=25.23 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 36], 90.00th=[ 56], 95.00th=[ 85], | 99.00th=[ 144], 99.50th=[ 178], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 28, max= 414, per=25.12%, avg=121.31, stdev=72.81, samples=93 iops : min= 1, max= 25, avg= 6.94, stdev= 4.58, samples=93 write: IOPS=8, BW=132KiB/s (135kB/s)(6544KiB/49503msec); 0 zone resets clat (msec): min=37, max=324, avg=95.24, stdev=37.24 lat (msec): min=37, max=324, avg=95.25, stdev=37.24 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 67], | 30.00th=[ 74], 40.00th=[ 83], 50.00th=[ 89], 60.00th=[ 95], | 70.00th=[ 105], 80.00th=[ 117], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 215], 99.50th=[ 234], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 255, per=25.86%, avg=131.60, stdev=47.58, samples=98 iops : min= 1, max= 15, avg= 7.59, stdev= 3.10, samples=98 lat (msec) : 10=1.82%, 20=19.92%, 50=21.09%, 100=37.63%, 250=19.27% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=2.13%, ctx=1395, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144576: Sat Sep 12 00:08:52 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(6256KiB/47541msec) clat (msec): min=7, max=156, avg=27.19, stdev=20.88 lat (msec): min=7, max=156, avg=27.19, stdev=20.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 29], 80.00th=[ 34], 90.00th=[ 50], 95.00th=[ 71], | 99.00th=[ 126], 99.50th=[ 128], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 351, per=28.61%, avg=138.17, stdev=80.58, samples=90 iops : min= 1, max= 21, avg= 8.02, stdev= 5.02, samples=90 write: IOPS=7, BW=127KiB/s (130kB/s)(6032KiB/47541msec); 0 zone resets clat (msec): min=40, max=293, avg=97.44, stdev=41.43 lat (msec): min=40, max=293, avg=97.45, stdev=41.43 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 67], | 30.00th=[ 73], 40.00th=[ 80], 50.00th=[ 90], 60.00th=[ 96], | 70.00th=[ 104], 80.00th=[ 123], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 239], 99.50th=[ 255], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 224, per=24.84%, avg=126.45, stdev=45.87, samples=94 iops : min= 1, max= 14, avg= 7.28, stdev= 2.97, samples=94 lat (msec) : 10=2.47%, 20=21.61%, 50=24.09%, 100=34.77%, 250=16.80% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.33%, ctx=1513, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144577: Sat Sep 12 00:08:52 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(6032KiB/49322msec) clat (msec): min=7, max=284, avg=29.84, stdev=30.77 lat (msec): min=7, max=284, avg=29.84, stdev=30.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 54], 95.00th=[ 87], | 99.00th=[ 176], 99.50th=[ 268], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 415, per=26.12%, avg=126.17, stdev=71.40, samples=94 iops : min= 1, max= 25, avg= 7.26, stdev= 4.43, samples=94 write: IOPS=7, BW=127KiB/s (130kB/s)(6256KiB/49322msec); 0 zone resets clat (msec): min=42, max=234, avg=96.65, stdev=34.55 lat (msec): min=42, max=234, avg=96.66, stdev=34.55 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 68], | 30.00th=[ 74], 40.00th=[ 82], 50.00th=[ 89], 60.00th=[ 97], | 70.00th=[ 108], 80.00th=[ 124], 90.00th=[ 142], 95.00th=[ 167], | 99.00th=[ 207], 99.50th=[ 228], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 223, per=25.17%, avg=128.09, stdev=44.29, samples=97 iops : min= 1, max= 13, avg= 7.37, stdev= 2.87, samples=97 lat (msec) : 10=3.39%, 20=18.23%, 50=22.66%, 100=35.68%, 250=19.79% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.23%, ctx=1441, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=484KiB/s (495kB/s), 116KiB/s-132KiB/s (119kB/s-135kB/s), io=23.4MiB (24.5MB), run=47541-49503msec WRITE: bw=509KiB/s (521kB/s), 127KiB/s-132KiB/s (130kB/s-135kB/s), io=24.6MiB (25.8MB), run=47541-49503msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144599: Sat Sep 12 00:09:09 2026 read: IOPS=0, BW=860KiB/s (880kB/s)(7168KiB/8337msec) clat (msec): min=2, max=2672, avg=512.13, stdev=956.55 lat (msec): min=2, max=2672, avg=512.14, stdev=956.55 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 73], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 209], 60.00th=[ 220], | 70.00th=[ 220], 80.00th=[ 224], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 1497, max= 4055, per=100.00%, avg=2879.50, stdev=1351.26, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=614KiB/s (629kB/s)(5120KiB/8337msec); 0 zone resets clat (msec): min=121, max=3159, avg=949.66, stdev=1249.25 lat (msec): min=121, max=3159, avg=949.72, stdev=1249.23 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1943, max= 3864, per=82.56%, avg=2611.33, stdev=1085.65, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67% lat (msec) : >=2000=16.67% cpu : usr=0.01%, sys=6.99%, ctx=663, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144600: Sat Sep 12 00:09:09 2026 read: IOPS=0, BW=226KiB/s (231kB/s)(2048KiB/9062msec) clat (msec): min=176, max=368, avg=272.73, stdev=135.54 lat (msec): min=176, max=368, avg=272.73, stdev=135.54 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1488, max= 1943, per=75.94%, avg=1715.50, stdev=321.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1130KiB/s (1157kB/s)(10.0MiB/9062msec); 0 zone resets clat (msec): min=142, max=3107, avg=851.36, stdev=1017.74 lat (msec): min=142, max=3109, avg=851.56, stdev=1018.04 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 232], | 30.00th=[ 342], 40.00th=[ 359], 50.00th=[ 409], 60.00th=[ 435], | 70.00th=[ 489], 80.00th=[ 634], 90.00th=[ 2366], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1943, max= 6035, per=95.75%, avg=3028.50, stdev=1689.05, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=7.14%, ctx=135, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144601: Sat Sep 12 00:09:09 2026 read: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5454msec) clat (usec): min=422, max=373520, avg=153012.04, stdev=176500.10 lat (usec): min=424, max=373521, avg=153013.40, stdev=176500.16 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 2868], | 30.00th=[ 2868], 40.00th=[ 13042], 50.00th=[ 13042], 60.00th=[170918], | 70.00th=[354419], 80.00th=[354419], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 1932, max= 6083, per=100.00%, avg=3319.33, stdev=2393.41, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5454msec); 0 zone resets clat (msec): min=105, max=3219, avg=755.14, stdev=1211.36 lat (msec): min=105, max=3219, avg=755.85, stdev=1211.16 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 334], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 2929, max= 4055, per=100.00%, avg=3623.33, stdev=607.22, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 20=8.33%, 250=25.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=9.26%, ctx=117, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144602: Sat Sep 12 00:09:09 2026 read: IOPS=0, BW=576KiB/s (589kB/s)(5120KiB/8896msec) clat (usec): min=475, max=2710.6k, avg=600164.57, stdev=1182342.83 lat (usec): min=476, max=2710.6k, avg=600165.84, stdev=1182342.97 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], | 20.00th=[ 478], 30.00th=[ 2802], 40.00th=[ 2802], | 50.00th=[ 98042], 60.00th=[ 98042], 70.00th=[ 189793], | 80.00th=[ 189793], 90.00th=[2701132], 95.00th=[2701132], | 99.00th=[2701132], 99.50th=[2701132], 99.90th=[2701132], | 99.95th=[2701132], 99.99th=[2701132] bw ( KiB/s): min= 1943, max= 5919, per=100.00%, avg=3931.00, stdev=2811.46, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=806KiB/s (825kB/s)(7168KiB/8896msec); 0 zone resets clat (msec): min=166, max=3490, avg=841.47, stdev=1180.46 lat (msec): min=166, max=3491, avg=841.80, stdev=1180.37 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 194], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 535], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 584], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1630, max= 4079, per=71.58%, avg=2264.00, stdev=900.03, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=25.00%, 500=8.33%, 750=25.00% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=6.13%, ctx=540, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2260KiB/s (2314kB/s), 226KiB/s-1127KiB/s (231kB/s-1154kB/s), io=20.0MiB (20.0MB), run=5454-9062msec WRITE: bw=3164KiB/s (3240kB/s), 614KiB/s-1130KiB/s (629kB/s-1157kB/s), io=28.0MiB (29.4MB), run=5454-9062msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144594: Sat Sep 12 00:09:10 2026 read: IOPS=0, BW=847KiB/s (868kB/s)(7168KiB/8460msec) clat (msec): min=89, max=2481, avg=514.65, stdev=871.50 lat (msec): min=89, max=2481, avg=514.65, stdev=871.50 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 113], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 222], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 292], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1946, max= 4079, per=100.00%, avg=2521.75, stdev=1038.96, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=605KiB/s (620kB/s)(5120KiB/8460msec); 0 zone resets clat (msec): min=188, max=3036, avg=960.27, stdev=1175.61 lat (msec): min=188, max=3039, avg=960.83, stdev=1176.51 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1359, max= 2048, per=66.76%, avg=1848.00, stdev=329.24, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=2.44%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144595: Sat Sep 12 00:09:10 2026 read: IOPS=0, BW=223KiB/s (229kB/s)(2048KiB/9175msec) clat (msec): min=80, max=375, avg=227.92, stdev=208.55 lat (msec): min=80, max=375, avg=227.92, stdev=208.55 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 81], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 81], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 2027, max= 2035, per=100.00%, avg=2031.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1116KiB/s (1143kB/s)(10.0MiB/9175msec); 0 zone resets clat (msec): min=187, max=2888, avg=868.97, stdev=982.67 lat (msec): min=187, max=2888, avg=869.07, stdev=982.70 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 203], | 30.00th=[ 264], 40.00th=[ 447], 50.00th=[ 481], 60.00th=[ 498], | 70.00th=[ 531], 80.00th=[ 676], 90.00th=[ 2534], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1954, max= 3968, per=81.74%, avg=2262.62, stdev=689.71, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=2.40%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144596: Sat Sep 12 00:09:10 2026 read: IOPS=0, BW=997KiB/s (1021kB/s)(6144KiB/6165msec) clat (msec): min=105, max=413, avg=213.63, stdev=118.02 lat (msec): min=105, max=413, avg=213.63, stdev=118.02 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 178], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1946, max= 2048, per=100.00%, avg=2016.00, stdev=47.18, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=0, BW=997KiB/s (1021kB/s)(6144KiB/6165msec); 0 zone resets clat (msec): min=219, max=3111, avg=806.14, stdev=1134.95 lat (msec): min=220, max=3111, avg=806.25, stdev=1134.98 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 393], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1946, max= 2760, per=79.26%, avg=2194.00, stdev=379.67, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.11%, ctx=162, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144597: Sat Sep 12 00:09:10 2026 read: IOPS=0, BW=494KiB/s (506kB/s)(5120KiB/10358msec) clat (msec): min=96, max=3339, avg=921.17, stdev=1362.06 lat (msec): min=96, max=3339, avg=921.17, stdev=1362.06 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 2031, max= 4063, per=100.00%, avg=2712.33, stdev=1169.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=692KiB/s (709kB/s)(7168KiB/10358msec); 0 zone resets clat (msec): min=170, max=3327, avg=817.18, stdev=1151.68 lat (msec): min=170, max=3327, avg=817.28, stdev=1151.68 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 234], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 284], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 1099], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1395, max= 4079, per=81.44%, avg=2254.17, stdev=928.17, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=1.91%, ctx=98, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1977KiB/s (2025kB/s), 223KiB/s-997KiB/s (229kB/s-1021kB/s), io=20.0MiB (20.0MB), run=6165-10358msec WRITE: bw=2768KiB/s (2835kB/s), 605KiB/s-1116KiB/s (620kB/s-1143kB/s), io=28.0MiB (29.4MB), run=6165-10358msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144611: Sat Sep 12 00:09:23 2026 read: IOPS=2, BW=9503KiB/s (9732kB/s)(12.0MiB/1293msec) clat (msec): min=205, max=629, avg=403.54, stdev=213.52 lat (msec): min=205, max=629, avg=403.54, stdev=213.52 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 6714, max= 7968, per=100.00%, avg=7341.00, stdev=886.71, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=10.99%, ctx=74, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144612: Sat Sep 12 00:09:23 2026 read: IOPS=0, BW=1304KiB/s (1335kB/s)(4096KiB/3142msec) clat (nsec): min=1239.6M, max=1239.6M, avg=1239550245.00, stdev= 0.00 lat (nsec): min=1239.6M, max=1239.6M, avg=1239551713.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2607KiB/s (2670kB/s)(8192KiB/3142msec); 0 zone resets clat (msec): min=639, max=1199, avg=919.29, stdev=396.37 lat (msec): min=640, max=1199, avg=920.25, stdev=395.54 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8159, max= 8159, per=78.23%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.10%, sys=3.72%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144613: Sat Sep 12 00:09:23 2026 write: IOPS=1, BW=5073KiB/s (5195kB/s)(12.0MiB/2422msec); 0 zone resets clat (msec): min=558, max=1030, avg=778.41, stdev=237.42 lat (msec): min=559, max=1030, avg=779.64, stdev=236.91 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7968, max= 8110, per=77.08%, avg=8039.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.71%, ctx=38, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144614: Sat Sep 12 00:09:23 2026 write: IOPS=1, BW=6413KiB/s (6567kB/s)(12.0MiB/1916msec); 0 zone resets clat (msec): min=427, max=905, avg=623.76, stdev=250.25 lat (msec): min=428, max=915, avg=627.67, stdev=255.64 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 542], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7301, max= 7968, per=73.20%, avg=7634.50, stdev=471.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.42%, ctx=50, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5215KiB/s (5340kB/s), 1304KiB/s-9503KiB/s (1335kB/s-9732kB/s), io=16.0MiB (16.8MB), run=1293-3142msec WRITE: bw=10.2MiB/s (10.7MB/s), 2607KiB/s-6413KiB/s (2670kB/s-6567kB/s), io=32.0MiB (33.6MB), run=1916-3142msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144616: Sat Sep 12 00:09:24 2026 read: IOPS=1, BW=4894KiB/s (5011kB/s)(12.0MiB/2511msec) clat (msec): min=768, max=950, avg=836.55, stdev=99.19 lat (msec): min=768, max=950, avg=836.55, stdev=99.19 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7953, max= 8159, per=100.00%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.98%, ctx=226, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144617: Sat Sep 12 00:09:24 2026 read: IOPS=0, BW=1707KiB/s (1748kB/s)(4096KiB/2400msec) clat (nsec): min=670796k, max=670796k, avg=670795912.00, stdev= 0.00 lat (nsec): min=670798k, max=670798k, avg=670798279.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3413KiB/s (3495kB/s)(8192KiB/2400msec); 0 zone resets clat (msec): min=505, max=1220, avg=863.01, stdev=505.96 lat (msec): min=505, max=1221, avg=863.31, stdev=505.99 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8143, max= 8143, per=84.99%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.17%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144618: Sat Sep 12 00:09:24 2026 write: IOPS=0, BW=3593KiB/s (3679kB/s)(12.0MiB/3420msec); 0 zone resets clat (msec): min=377, max=2075, avg=1138.81, stdev=862.73 lat (msec): min=379, max=2076, avg=1139.65, stdev=862.10 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 7953, max= 8192, per=84.26%, avg=8072.50, stdev=169.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.12%, sys=5.24%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144619: Sat Sep 12 00:09:24 2026 write: IOPS=1, BW=4804KiB/s (4919kB/s)(12.0MiB/2558msec); 0 zone resets clat (msec): min=373, max=1586, avg=851.97, stdev=645.56 lat (msec): min=373, max=1586, avg=852.31, stdev=645.64 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8062, max= 8062, per=84.15%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.18%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6525KiB/s (6681kB/s), 1707KiB/s-4894KiB/s (1748kB/s-5011kB/s), io=16.0MiB (16.8MB), run=2400-2511msec WRITE: bw=9581KiB/s (9811kB/s), 3413KiB/s-4804KiB/s (3495kB/s-4919kB/s), io=32.0MiB (33.6MB), run=2400-3420msec