== sanity test 398b: DIO and buffer IO race ============== 18:35:59 (1768260959) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.77498 s, 7.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146740: Mon Jan 12 18:38:40 2026 read: IOPS=10, BW=43.6KiB/s (44.6kB/s)(5992KiB/137497msec) clat (usec): min=102, max=1207.6k, avg=45840.10, stdev=45594.87 lat (usec): min=103, max=1207.6k, avg=45841.87, stdev=45594.91 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 186], 10.00th=[ 553], | 20.00th=[ 20055], 30.00th=[ 27395], 40.00th=[ 33424], | 50.00th=[ 40109], 60.00th=[ 46400], 70.00th=[ 54264], | 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[ 102237], | 99.00th=[ 158335], 99.50th=[ 198181], 99.90th=[ 387974], | 99.95th=[1199571], 99.99th=[1199571] bw ( KiB/s): min= 7, max= 110, per=25.55%, avg=43.94, stdev=19.76, samples=265 iops : min= 1, max= 27, avg=10.32, stdev= 4.97, samples=265 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6296KiB/137497msec); 0 zone resets clat (usec): min=817, max=634207, avg=43357.36, stdev=49137.86 lat (usec): min=817, max=634209, avg=43361.73, stdev=49139.73 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1303], 10.00th=[ 1516], 20.00th=[ 4015], | 30.00th=[ 8356], 40.00th=[ 18744], 50.00th=[ 30540], 60.00th=[ 42206], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[129500], | 99.00th=[204473], 99.50th=[242222], 99.90th=[549454], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 112, per=25.32%, avg=45.58, stdev=19.53, samples=268 iops : min= 1, max= 28, avg=10.74, stdev= 4.93, samples=268 lat (usec) : 250=4.26%, 500=0.55%, 750=0.23%, 1000=0.23% lat (msec) : 2=7.00%, 4=3.61%, 10=6.64%, 20=8.30%, 50=34.24% lat (msec) : 100=26.63%, 250=7.94%, 500=0.26%, 750=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.08%, ctx=6297, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146741: Mon Jan 12 18:38:40 2026 read: IOPS=10, BW=43.1KiB/s (44.2kB/s)(5940KiB/137733msec) clat (usec): min=104, max=422633, avg=44583.91, stdev=34475.73 lat (usec): min=104, max=422635, avg=44585.97, stdev=34475.56 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 190], 10.00th=[ 898], 20.00th=[ 20317], | 30.00th=[ 25822], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 55313], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[103285], | 99.00th=[145753], 99.50th=[183501], 99.90th=[287310], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 103, per=25.22%, avg=43.37, stdev=19.95, samples=267 iops : min= 1, max= 25, avg=10.18, stdev= 5.03, samples=267 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6348KiB/137733msec); 0 zone resets clat (usec): min=839, max=1255.2k, avg=44754.49, stdev=55901.46 lat (usec): min=841, max=1255.2k, avg=44756.85, stdev=55901.43 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1287], 10.00th=[ 1483], | 20.00th=[ 4047], 30.00th=[ 9241], 40.00th=[ 19792], | 50.00th=[ 32900], 60.00th=[ 43779], 70.00th=[ 58459], | 80.00th=[ 78119], 90.00th=[ 100140], 95.00th=[ 129500], | 99.00th=[ 196084], 99.50th=[ 248513], 99.90th=[ 534774], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 125, per=25.77%, avg=46.39, stdev=19.93, samples=267 iops : min= 1, max= 31, avg=10.93, stdev= 5.03, samples=267 lat (usec) : 250=4.17%, 500=0.46%, 750=0.16%, 1000=0.20% lat (msec) : 2=7.26%, 4=3.61%, 10=6.51%, 20=7.75%, 50=34.57% lat (msec) : 100=27.25%, 250=7.78%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.10%, sys=5.03%, ctx=6376, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146742: Mon Jan 12 18:38:40 2026 read: IOPS=10, BW=43.4KiB/s (44.4kB/s)(6028KiB/139039msec) clat (usec): min=107, max=527431, avg=45240.49, stdev=35854.87 lat (usec): min=107, max=527432, avg=45242.26, stdev=35854.83 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 192], 10.00th=[ 437], 20.00th=[ 20055], | 30.00th=[ 27132], 40.00th=[ 32900], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 55837], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[104334], | 99.00th=[147850], 99.50th=[170918], 99.90th=[308282], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 7, max= 119, per=25.36%, avg=43.63, stdev=20.82, samples=268 iops : min= 1, max= 29, avg=10.24, stdev= 5.22, samples=268 write: IOPS=11, BW=45.0KiB/s (46.1kB/s)(6260KiB/139039msec); 0 zone resets clat (usec): min=901, max=1789.1k, avg=44977.57, stdev=64607.84 lat (usec): min=903, max=1789.1k, avg=44985.02, stdev=64612.39 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1287], 10.00th=[ 1450], | 20.00th=[ 4228], 30.00th=[ 9241], 40.00th=[ 18220], | 50.00th=[ 29754], 60.00th=[ 44827], 70.00th=[ 58983], | 80.00th=[ 77071], 90.00th=[ 103285], 95.00th=[ 135267], | 99.00th=[ 198181], 99.50th=[ 256902], 99.90th=[ 421528], | 99.95th=[1786774], 99.99th=[1786774] bw ( KiB/s): min= 7, max= 125, per=25.02%, avg=45.04, stdev=20.83, samples=269 iops : min= 1, max= 31, avg=10.59, stdev= 5.24, samples=269 lat (usec) : 250=4.33%, 500=0.68%, 750=0.26%, 1000=0.20% lat (msec) : 2=6.67%, 4=3.71%, 10=6.28%, 20=8.72%, 50=33.40% lat (msec) : 100=27.18%, 250=8.14%, 500=0.36%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.21%, ctx=6376, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146743: Mon Jan 12 18:38:40 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(6052KiB/138169msec) clat (usec): min=107, max=1450.8k, avg=45442.71, stdev=51653.99 lat (usec): min=107, max=1450.8k, avg=45446.40, stdev=51654.35 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 186], 10.00th=[ 237], | 20.00th=[ 18744], 30.00th=[ 26084], 40.00th=[ 31327], | 50.00th=[ 38536], 60.00th=[ 45876], 70.00th=[ 54264], | 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[ 106431], | 99.00th=[ 156238], 99.50th=[ 185598], 99.90th=[ 583009], | 99.95th=[1451230], 99.99th=[1451230] bw ( KiB/s): min= 7, max= 111, per=25.54%, avg=43.93, stdev=19.54, samples=268 iops : min= 1, max= 27, avg=10.32, stdev= 4.93, samples=268 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6236KiB/138169msec); 0 zone resets clat (usec): min=793, max=533507, avg=44206.33, stdev=46656.42 lat (usec): min=795, max=533508, avg=44208.59, stdev=46656.40 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1287], 10.00th=[ 1450], 20.00th=[ 4555], | 30.00th=[ 9896], 40.00th=[ 20579], 50.00th=[ 32113], 60.00th=[ 44303], | 70.00th=[ 58459], 80.00th=[ 74974], 90.00th=[104334], 95.00th=[131597], | 99.00th=[193987], 99.50th=[233833], 99.90th=[320865], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 7, max= 127, per=25.04%, avg=45.07, stdev=19.97, samples=269 iops : min= 1, max= 31, avg=10.61, stdev= 5.00, samples=269 lat (usec) : 250=5.11%, 500=0.49%, 750=0.26%, 1000=0.29% lat (msec) : 2=6.58%, 4=3.26%, 10=6.18%, 20=8.63%, 50=34.05% lat (msec) : 100=26.37%, 250=8.50%, 500=0.20%, 750=0.07%, 2000=0.03% cpu : usr=0.11%, sys=5.03%, ctx=6297, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=173KiB/s (177kB/s), 43.1KiB/s-43.8KiB/s (44.2kB/s-44.9kB/s), io=23.4MiB (24.6MB), run=137497-139039msec WRITE: bw=181KiB/s (185kB/s), 45.0KiB/s-46.1KiB/s (46.1kB/s-47.2kB/s), io=24.6MiB (25.7MB), run=137497-139039msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146735: Mon Jan 12 18:41:01 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(5992KiB/280122msec) clat (msec): min=4, max=1333, avg=36.38, stdev=47.17 lat (msec): min=4, max=1333, avg=36.38, stdev=47.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 82], 95.00th=[ 104], | 99.00th=[ 159], 99.50th=[ 176], 99.90th=[ 363], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 6, max= 95, per=28.64%, avg=24.35, stdev=16.66, samples=475 iops : min= 1, max= 23, avg= 5.44, stdev= 4.20, samples=475 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6296KiB/280122msec); 0 zone resets clat (msec): min=28, max=897, avg=143.00, stdev=74.68 lat (msec): min=28, max=897, avg=143.00, stdev=74.68 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 87], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 142], | 70.00th=[ 165], 80.00th=[ 192], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 393], 99.50th=[ 430], 99.90th=[ 684], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 6, max= 55, per=24.91%, avg=22.17, stdev=10.72, samples=545 iops : min= 1, max= 13, avg= 4.89, stdev= 2.72, samples=545 lat (msec) : 10=2.99%, 20=17.45%, 50=19.01%, 100=22.85%, 250=33.50% lat (msec) : 500=4.04%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.21%, ctx=5265, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146736: Mon Jan 12 18:41:01 2026 read: IOPS=5, BW=21.2KiB/s (21.7kB/s)(5940KiB/280328msec) clat (msec): min=5, max=1456, avg=37.44, stdev=51.93 lat (msec): min=5, max=1456, avg=37.45, stdev=51.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 52], 90.00th=[ 84], 95.00th=[ 110], | 99.00th=[ 171], 99.50th=[ 199], 99.90th=[ 422], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 6, max= 95, per=29.20%, avg=24.82, stdev=16.92, samples=461 iops : min= 1, max= 23, avg= 5.56, stdev= 4.26, samples=461 write: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6348KiB/280328msec); 0 zone resets clat (msec): min=28, max=885, avg=141.26, stdev=75.25 lat (msec): min=28, max=885, avg=141.26, stdev=75.25 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 138], | 70.00th=[ 163], 80.00th=[ 190], 90.00th=[ 236], 95.00th=[ 279], | 99.00th=[ 397], 99.50th=[ 456], 99.90th=[ 693], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 6, max= 63, per=25.20%, avg=22.43, stdev=11.13, samples=542 iops : min= 1, max= 15, avg= 4.96, stdev= 2.81, samples=542 lat (msec) : 10=2.96%, 20=17.06%, 50=19.27%, 100=23.14%, 250=33.37% lat (msec) : 500=4.00%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.22%, ctx=5147, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146737: Mon Jan 12 18:41:01 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6028KiB/278283msec) clat (msec): min=6, max=832, avg=37.20, stdev=41.37 lat (msec): min=6, max=832, avg=37.21, stdev=41.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 105], | 99.00th=[ 167], 99.50th=[ 211], 99.90th=[ 388], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 95, per=27.97%, avg=23.77, stdev=16.51, samples=488 iops : min= 1, max= 23, avg= 5.30, stdev= 4.18, samples=488 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6260KiB/278283msec); 0 zone resets clat (msec): min=28, max=1658, avg=141.65, stdev=81.38 lat (msec): min=28, max=1658, avg=141.65, stdev=81.38 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 84], | 30.00th=[ 96], 40.00th=[ 110], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 190], 90.00th=[ 239], 95.00th=[ 292], | 99.00th=[ 384], 99.50th=[ 435], 99.90th=[ 567], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7, max= 63, per=25.25%, avg=22.47, stdev=11.14, samples=535 iops : min= 1, max= 15, avg= 4.97, stdev= 2.82, samples=535 lat (msec) : 10=3.29%, 20=15.98%, 50=20.90%, 100=22.92%, 250=32.36% lat (msec) : 500=4.39%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.23%, ctx=5229, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146739: Mon Jan 12 18:41:01 2026 read: IOPS=5, BW=21.7KiB/s (22.2kB/s)(6052KiB/278798msec) clat (msec): min=4, max=293, avg=36.07, stdev=36.12 lat (msec): min=4, max=293, avg=36.08, stdev=36.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 81], 95.00th=[ 110], | 99.00th=[ 190], 99.50th=[ 234], 99.90th=[ 292], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 102, per=29.46%, avg=25.04, stdev=16.94, samples=466 iops : min= 1, max= 25, avg= 5.62, stdev= 4.28, samples=466 write: IOPS=5, BW=22.4KiB/s (22.9kB/s)(6236KiB/278798msec); 0 zone resets clat (msec): min=33, max=1685, avg=143.51, stdev=83.40 lat (msec): min=33, max=1685, avg=143.51, stdev=83.40 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 161], 80.00th=[ 190], 90.00th=[ 241], 95.00th=[ 284], | 99.00th=[ 409], 99.50th=[ 456], 99.90th=[ 802], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 6, max= 71, per=24.92%, avg=22.17, stdev=10.86, samples=539 iops : min= 1, max= 17, avg= 4.89, stdev= 2.74, samples=539 lat (msec) : 10=2.41%, 20=17.81%, 50=20.67%, 100=21.29%, 250=33.37% lat (msec) : 500=4.30%, 750=0.10%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.19%, ctx=5253, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=85.7KiB/s (87.7kB/s), 21.2KiB/s-21.7KiB/s (21.7kB/s-22.2kB/s), io=23.4MiB (24.6MB), run=278283-280328msec WRITE: bw=89.7KiB/s (91.8kB/s), 22.4KiB/s-22.6KiB/s (22.9kB/s-23.2kB/s), io=24.6MiB (25.7MB), run=278283-280328msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146803: Mon Jan 12 18:41:44 2026 read: IOPS=12, BW=206KiB/s (210kB/s)(5920KiB/28806msec) clat (usec): min=98, max=265834, avg=40561.04, stdev=34855.18 lat (usec): min=98, max=265836, avg=40563.44, stdev=34856.28 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 155], 10.00th=[ 184], 20.00th=[ 660], | 30.00th=[ 22676], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[108528], | 99.00th=[143655], 99.50th=[193987], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 61, max= 564, per=25.93%, avg=204.11, stdev=94.34, samples=56 iops : min= 3, max= 35, avg=12.02, stdev= 6.00, samples=56 write: IOPS=13, BW=221KiB/s (226kB/s)(6368KiB/28806msec); 0 zone resets clat (usec): min=1247, max=215976, avg=34256.66, stdev=36877.39 lat (usec): min=1249, max=215978, avg=34309.12, stdev=36866.41 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1811], 10.00th=[ 2376], 20.00th=[ 5342], | 30.00th=[ 8717], 40.00th=[ 12125], 50.00th=[ 20055], 60.00th=[ 29492], | 70.00th=[ 41157], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[116917], | 99.00th=[154141], 99.50th=[170918], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 62, max= 508, per=26.70%, avg=221.05, stdev=88.82, samples=56 iops : min= 3, max= 31, avg=13.07, stdev= 5.60, samples=56 lat (usec) : 100=0.13%, 250=8.20%, 500=0.78%, 750=0.65%, 1000=0.13% lat (msec) : 2=4.56%, 4=4.69%, 10=10.55%, 20=9.77%, 50=31.25% lat (msec) : 100=22.66%, 250=6.51%, 500=0.13% cpu : usr=0.09%, sys=5.47%, ctx=1332, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146804: Mon Jan 12 18:41:44 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5744KiB/29470msec) clat (usec): min=113, max=212760, avg=41775.16, stdev=34932.75 lat (usec): min=113, max=212762, avg=41776.72, stdev=34932.68 clat percentiles (usec): | 1.00th=[ 127], 5.00th=[ 172], 10.00th=[ 196], 20.00th=[ 775], | 30.00th=[ 24773], 40.00th=[ 32113], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[ 99091], | 99.00th=[166724], 99.50th=[202376], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 32, max= 377, per=25.67%, avg=202.00, stdev=76.37, samples=56 iops : min= 2, max= 23, avg=11.88, stdev= 4.77, samples=56 write: IOPS=13, BW=222KiB/s (227kB/s)(6544KiB/29470msec); 0 zone resets clat (usec): min=1492, max=344917, avg=34426.73, stdev=41397.87 lat (usec): min=1495, max=344919, avg=34429.57, stdev=41397.91 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1876], 10.00th=[ 2245], 20.00th=[ 5800], | 30.00th=[ 8979], 40.00th=[ 13304], 50.00th=[ 21627], 60.00th=[ 29230], | 70.00th=[ 40109], 80.00th=[ 56886], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[191890], 99.50th=[256902], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 32, max= 410, per=26.70%, avg=221.09, stdev=93.44, samples=58 iops : min= 2, max= 25, avg=13.09, stdev= 5.88, samples=58 lat (usec) : 250=7.42%, 500=1.30%, 750=0.52%, 1000=0.39% lat (msec) : 2=3.91%, 4=3.91%, 10=10.68%, 20=10.16%, 50=34.38% lat (msec) : 100=22.14%, 250=4.82%, 500=0.39% cpu : usr=0.08%, sys=5.93%, ctx=1429, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146805: Mon Jan 12 18:41:44 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30407msec) clat (usec): min=109, max=184572, avg=41318.65, stdev=33577.75 lat (usec): min=110, max=184574, avg=41320.39, stdev=33577.67 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 176], 10.00th=[ 215], 20.00th=[ 1991], | 30.00th=[ 21103], 40.00th=[ 31065], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[101188], | 99.00th=[143655], 99.50th=[173016], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 63, max= 445, per=26.70%, avg=210.14, stdev=78.17, samples=57 iops : min= 3, max= 27, avg=12.39, stdev= 4.93, samples=57 write: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30407msec); 0 zone resets clat (usec): min=1506, max=373943, avg=36407.10, stdev=46344.30 lat (usec): min=1508, max=373947, avg=36413.05, stdev=46344.05 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1893], 10.00th=[ 2835], 20.00th=[ 5473], | 30.00th=[ 8291], 40.00th=[ 12125], 50.00th=[ 20317], 60.00th=[ 30802], | 70.00th=[ 42730], 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[120062], | 99.00th=[200279], 99.50th=[362808], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 30, max= 440, per=23.62%, avg=195.59, stdev=81.96, samples=58 iops : min= 1, max= 27, avg=11.47, stdev= 5.20, samples=58 lat (usec) : 250=6.90%, 500=1.56%, 750=0.13%, 1000=0.39% lat (msec) : 2=4.30%, 4=4.95%, 10=11.72%, 20=9.24%, 50=31.38% lat (msec) : 100=23.96%, 250=5.08%, 500=0.39% cpu : usr=0.11%, sys=5.91%, ctx=1470, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146806: Mon Jan 12 18:41:44 2026 read: IOPS=12, BW=200KiB/s (204kB/s)(6032KiB/30207msec) clat (usec): min=110, max=166208, avg=42430.24, stdev=35422.50 lat (usec): min=111, max=166210, avg=42431.81, stdev=35422.48 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 172], 10.00th=[ 194], 20.00th=[ 857], | 30.00th=[ 23200], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 47449], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[154141], 99.50th=[164627], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 465, per=26.38%, avg=207.60, stdev=84.70, samples=57 iops : min= 1, max= 29, avg=12.23, stdev= 5.39, samples=57 write: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30207msec); 0 zone resets clat (usec): min=1345, max=468985, avg=35272.05, stdev=43595.55 lat (usec): min=1347, max=468989, avg=35286.14, stdev=43588.15 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 2474], 20.00th=[ 5735], | 30.00th=[ 8979], 40.00th=[ 12780], 50.00th=[ 18220], 60.00th=[ 28705], | 70.00th=[ 42206], 80.00th=[ 60556], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[177210], 99.50th=[240124], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 31, max= 444, per=25.18%, avg=208.47, stdev=79.72, samples=59 iops : min= 1, max= 27, avg=12.29, stdev= 5.03, samples=59 lat (usec) : 250=8.46%, 500=0.78%, 750=0.13%, 1000=0.52% lat (msec) : 2=4.69%, 4=3.12%, 10=10.94%, 20=11.33%, 50=30.08% lat (msec) : 100=22.53%, 250=7.29%, 500=0.13% cpu : usr=0.07%, sys=5.66%, ctx=1437, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=788KiB/s (807kB/s), 195KiB/s-206KiB/s (200kB/s-211kB/s), io=23.4MiB (24.5MB), run=28806-30407msec WRITE: bw=829KiB/s (849kB/s), 198KiB/s-222KiB/s (203kB/s-227kB/s), io=24.6MiB (25.8MB), run=28806-30407msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146799: Mon Jan 12 18:42:30 2026 read: IOPS=4, BW=78.8KiB/s (80.7kB/s)(5920KiB/75143msec) clat (msec): min=8, max=245, avg=40.21, stdev=36.64 lat (msec): min=8, max=245, avg=40.21, stdev=36.64 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 78], 95.00th=[ 125], | 99.00th=[ 182], 99.50th=[ 222], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 30, max= 320, per=28.96%, avg=90.65, stdev=57.52, samples=128 iops : min= 1, max= 20, avg= 4.87, stdev= 3.68, samples=128 write: IOPS=5, BW=84.7KiB/s (86.8kB/s)(6368KiB/75143msec); 0 zone resets clat (msec): min=47, max=421, avg=150.65, stdev=69.87 lat (msec): min=47, max=421, avg=150.68, stdev=69.89 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 75], 10.00th=[ 85], 20.00th=[ 96], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 131], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 197], 90.00th=[ 245], 95.00th=[ 309], | 99.00th=[ 380], 99.50th=[ 418], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 22, max= 190, per=25.86%, avg=85.09, stdev=37.75, samples=147 iops : min= 1, max= 11, avg= 4.52, stdev= 2.43, samples=147 lat (msec) : 10=0.78%, 20=12.37%, 50=24.09%, 100=19.66%, 250=38.15% lat (msec) : 500=4.95% cpu : usr=0.05%, sys=1.33%, ctx=1389, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146800: Mon Jan 12 18:42:30 2026 read: IOPS=4, BW=75.1KiB/s (76.9kB/s)(5744KiB/76485msec) clat (msec): min=7, max=289, avg=43.35, stdev=46.58 lat (msec): min=7, max=289, avg=43.35, stdev=46.58 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 95], 95.00th=[ 150], | 99.00th=[ 253], 99.50th=[ 284], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 22, max= 248, per=30.02%, avg=93.95, stdev=55.81, samples=120 iops : min= 1, max= 15, avg= 5.08, stdev= 3.53, samples=120 write: IOPS=5, BW=85.6KiB/s (87.6kB/s)(6544KiB/76485msec); 0 zone resets clat (msec): min=45, max=435, avg=148.49, stdev=67.59 lat (msec): min=45, max=435, avg=148.50, stdev=67.59 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 71], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 118], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 199], 90.00th=[ 243], 95.00th=[ 284], | 99.00th=[ 347], 99.50th=[ 401], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 192, per=26.32%, avg=86.60, stdev=38.39, samples=148 iops : min= 1, max= 12, avg= 4.61, stdev= 2.51, samples=148 lat (msec) : 10=1.43%, 20=13.02%, 50=22.27%, 100=19.40%, 250=38.67% lat (msec) : 500=5.21% cpu : usr=0.05%, sys=1.29%, ctx=1393, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146801: Mon Jan 12 18:42:30 2026 read: IOPS=5, BW=86.5KiB/s (88.6kB/s)(6256KiB/72344msec) clat (msec): min=7, max=268, avg=39.09, stdev=41.28 lat (msec): min=7, max=268, avg=39.09, stdev=41.28 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 75], 95.00th=[ 123], | 99.00th=[ 232], 99.50th=[ 264], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 315, per=31.52%, avg=98.66, stdev=63.60, samples=125 iops : min= 1, max= 19, avg= 5.38, stdev= 4.02, samples=125 write: IOPS=5, BW=83.4KiB/s (85.4kB/s)(6032KiB/72344msec); 0 zone resets clat (msec): min=45, max=450, avg=150.24, stdev=70.12 lat (msec): min=45, max=450, avg=150.25, stdev=70.12 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 70], 10.00th=[ 84], 20.00th=[ 95], | 30.00th=[ 107], 40.00th=[ 118], 50.00th=[ 134], 60.00th=[ 146], | 70.00th=[ 163], 80.00th=[ 199], 90.00th=[ 247], 95.00th=[ 296], | 99.00th=[ 401], 99.50th=[ 430], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 22, max= 190, per=25.57%, avg=84.13, stdev=36.30, samples=140 iops : min= 1, max= 11, avg= 4.46, stdev= 2.34, samples=140 lat (msec) : 10=2.08%, 20=14.71%, 50=25.00%, 100=17.19%, 250=35.81% lat (msec) : 500=5.21% cpu : usr=0.03%, sys=1.34%, ctx=1378, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146802: Mon Jan 12 18:42:30 2026 read: IOPS=5, BW=80.0KiB/s (82.9kB/s)(6032KiB/74471msec) clat (msec): min=8, max=317, avg=40.41, stdev=40.41 lat (msec): min=8, max=317, avg=40.41, stdev=40.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 115], | 99.00th=[ 224], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 282, per=30.01%, avg=93.92, stdev=58.16, samples=125 iops : min= 1, max= 17, avg= 5.08, stdev= 3.71, samples=125 write: IOPS=5, BW=84.0KiB/s (86.0kB/s)(6256KiB/74471msec); 0 zone resets clat (msec): min=54, max=429, avg=151.29, stdev=66.00 lat (msec): min=54, max=429, avg=151.30, stdev=66.00 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 74], 10.00th=[ 86], 20.00th=[ 102], | 30.00th=[ 113], 40.00th=[ 125], 50.00th=[ 132], 60.00th=[ 148], | 70.00th=[ 165], 80.00th=[ 194], 90.00th=[ 247], 95.00th=[ 292], | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 31, max= 160, per=25.85%, avg=85.06, stdev=34.89, samples=144 iops : min= 1, max= 10, avg= 4.51, stdev= 2.26, samples=144 lat (msec) : 10=1.30%, 20=13.80%, 50=23.57%, 100=16.28%, 250=39.71% lat (msec) : 500=5.34% cpu : usr=0.06%, sys=1.36%, ctx=1371, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=313KiB/s (321kB/s), 75.1KiB/s-86.5KiB/s (76.9kB/s-88.6kB/s), io=23.4MiB (24.5MB), run=72344-76485msec WRITE: bw=329KiB/s (337kB/s), 83.4KiB/s-85.6KiB/s (85.4kB/s-87.6kB/s), io=24.6MiB (25.8MB), run=72344-76485msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146827: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=893KiB/s (914kB/s)(7168KiB/8027msec) clat (msec): min=2, max=3772, avg=768.65, stdev=1333.87 lat (msec): min=2, max=3772, avg=768.65, stdev=1333.87 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 222], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 284], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 531], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1965, max= 4047, per=100.00%, avg=2413.40, stdev=913.70, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=638KiB/s (653kB/s)(5120KiB/8027msec); 0 zone resets clat (msec): min=238, max=643, avg=436.33, stdev=152.87 lat (msec): min=238, max=643, avg=436.71, stdev=152.88 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2023, max= 4047, per=85.36%, avg=2706.00, stdev=1161.41, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 4=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=7.41%, ctx=720, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146829: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=226KiB/s (232kB/s)(2048KiB/9042msec) clat (msec): min=207, max=679, avg=443.23, stdev=333.44 lat (msec): min=207, max=679, avg=443.23, stdev=333.44 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1885, max= 1996, per=85.71%, avg=1940.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1132KiB/s (1160kB/s)(10.0MiB/9042msec); 0 zone resets clat (msec): min=183, max=3461, avg=803.24, stdev=959.57 lat (msec): min=183, max=3461, avg=803.35, stdev=959.57 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 288], | 30.00th=[ 330], 40.00th=[ 447], 50.00th=[ 477], 60.00th=[ 518], | 70.00th=[ 709], 80.00th=[ 718], 90.00th=[ 902], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 1828, max= 2048, per=62.59%, avg=1984.12, stdev=70.88, samples=8 iops : min= 1, max= 2, avg= 1.25, stdev= 0.46, samples=8 lat (msec) : 250=16.67%, 500=33.33%, 750=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.21%, ctx=278, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146831: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=761KiB/s (780kB/s)(6144KiB/8069msec) clat (usec): min=681, max=424101, avg=193877.02, stdev=185464.10 lat (usec): min=683, max=424101, avg=193878.30, stdev=185463.84 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 3490], | 30.00th=[ 3490], 40.00th=[132645], 50.00th=[132645], 60.00th=[204473], | 70.00th=[396362], 80.00th=[396362], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 1825, max= 2039, per=87.48%, avg=1980.60, stdev=91.16, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=761KiB/s (780kB/s)(6144KiB/8069msec); 0 zone resets clat (msec): min=282, max=4416, avg=1088.89, stdev=1633.95 lat (msec): min=282, max=4416, avg=1089.06, stdev=1634.01 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 527], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 1825, max= 4000, per=93.04%, avg=2949.50, stdev=1184.91, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=5.61%, ctx=178, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146832: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=599KiB/s (613kB/s)(5120KiB/8551msec) clat (usec): min=884, max=386141, avg=153920.26, stdev=208203.68 lat (usec): min=886, max=386143, avg=153921.81, stdev=208204.01 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 889], 10.00th=[ 889], 20.00th=[ 889], | 30.00th=[ 955], 40.00th=[ 955], 50.00th=[ 3818], 60.00th=[ 3818], | 70.00th=[379585], 80.00th=[379585], 90.00th=[387974], 95.00th=[387974], | 99.00th=[387974], 99.50th=[387974], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 2039, max= 5919, per=100.00%, avg=3979.00, stdev=2743.57, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=838KiB/s (858kB/s)(7168KiB/8551msec); 0 zone resets clat (msec): min=240, max=4030, avg=1055.51, stdev=1353.28 lat (msec): min=240, max=4030, avg=1055.69, stdev=1353.25 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 326], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 558], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 1250], 90.00th=[ 4044], 95.00th=[ 4044], | 99.00th=[ 4044], 99.50th=[ 4044], 99.90th=[ 4044], 99.95th=[ 4044], | 99.99th=[ 4044] bw ( KiB/s): min= 1825, max= 4031, per=75.02%, avg=2378.00, stdev=927.62, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 1000=16.67% lat (msec) : 4=8.33%, 250=8.33%, 500=33.33%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.05%, sys=5.10%, ctx=155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2265KiB/s (2319kB/s), 226KiB/s-893KiB/s (232kB/s-914kB/s), io=20.0MiB (20.0MB), run=8027-9042msec WRITE: bw=3171KiB/s (3247kB/s), 638KiB/s-1132KiB/s (653kB/s-1160kB/s), io=28.0MiB (29.4MB), run=8027-9042msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146825: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=931KiB/s (953kB/s)(7168KiB/7701msec) clat (msec): min=120, max=3797, avg=675.97, stdev=1376.81 lat (msec): min=120, max=3797, avg=675.97, stdev=1376.81 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 132], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 211], 90.00th=[ 3809], 95.00th=[ 3809], | 99.00th=[ 3809], 99.50th=[ 3809], 99.90th=[ 3809], 99.95th=[ 3809], | 99.99th=[ 3809] bw ( KiB/s): min= 2027, max= 4524, per=100.00%, avg=2659.25, stdev=1243.19, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=0, BW=665KiB/s (681kB/s)(5120KiB/7701msec); 0 zone resets clat (msec): min=342, max=779, avg=571.77, stdev=160.13 lat (msec): min=342, max=779, avg=571.88, stdev=160.15 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1560, max= 2048, per=61.24%, avg=1918.50, stdev=239.15, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=50.00%, 500=8.33%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.32%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146826: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=228KiB/s (233kB/s)(2048KiB/8996msec) clat (msec): min=191, max=814, avg=502.88, stdev=440.23 lat (msec): min=191, max=814, avg=502.88, stdev=440.23 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1818, max= 2023, per=85.81%, avg=1920.50, stdev=144.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1138KiB/s (1166kB/s)(10.0MiB/8996msec); 0 zone resets clat (msec): min=223, max=3529, avg=792.04, stdev=984.36 lat (msec): min=223, max=3529, avg=792.17, stdev=984.36 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 259], | 30.00th=[ 326], 40.00th=[ 384], 50.00th=[ 451], 60.00th=[ 502], | 70.00th=[ 617], 80.00th=[ 785], 90.00th=[ 844], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 1935, max= 3900, per=71.93%, avg=2253.50, stdev=666.37, samples=8 iops : min= 1, max= 3, avg= 1.50, stdev= 0.76, samples=8 lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=25.00%, >=2000=8.33% cpu : usr=0.08%, sys=2.11%, ctx=66, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146828: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=672KiB/s (688kB/s)(6144KiB/9149msec) clat (msec): min=172, max=494, avg=296.39, stdev=112.82 lat (msec): min=172, max=494, avg=296.39, stdev=112.82 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 300], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1585, max= 2048, per=85.49%, avg=1913.20, stdev=190.98, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=0, BW=672KiB/s (688kB/s)(6144KiB/9149msec); 0 zone resets clat (msec): min=271, max=4277, avg=1184.52, stdev=1533.67 lat (msec): min=271, max=4278, avg=1184.65, stdev=1533.66 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 659], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 1935, max= 2043, per=63.94%, avg=2003.20, stdev=41.16, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=2.06%, ctx=76, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146830: Mon Jan 12 18:42:56 2026 read: IOPS=0, BW=611KiB/s (625kB/s)(5120KiB/8382msec) clat (msec): min=120, max=1050, avg=363.88, stdev=387.17 lat (msec): min=120, max=1050, avg=363.88, stdev=387.17 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 226], 60.00th=[ 226], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 2023, max= 4079, per=100.00%, avg=2713.67, stdev=1182.44, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=855KiB/s (876kB/s)(7168KiB/8382msec); 0 zone resets clat (msec): min=105, max=4127, avg=918.63, stdev=1434.24 lat (msec): min=106, max=4127, avg=918.90, stdev=1434.15 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 190], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 338], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 810], 90.00th=[ 4144], 95.00th=[ 4144], | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4144], 99.95th=[ 4144], | 99.99th=[ 4144] bw ( KiB/s): min= 1560, max= 4087, per=77.55%, avg=2429.50, stdev=1127.55, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.04%, sys=2.14%, ctx=80, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2238KiB/s (2292kB/s), 228KiB/s-931KiB/s (233kB/s-953kB/s), io=20.0MiB (20.0MB), run=7701-9149msec WRITE: bw=3134KiB/s (3209kB/s), 665KiB/s-1138KiB/s (681kB/s-1166kB/s), io=28.0MiB (29.4MB), run=7701-9149msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146840: Mon Jan 12 18:43:16 2026 read: IOPS=1, BW=5783KiB/s (5921kB/s)(12.0MiB/2125msec) clat (msec): min=402, max=974, avg=596.79, stdev=327.35 lat (msec): min=402, max=974, avg=596.79, stdev=327.35 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min=15693, max=15693, per=100.00%, avg=15693.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.00%, sys=6.83%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146841: Mon Jan 12 18:43:16 2026 read: IOPS=0, BW=951KiB/s (974kB/s)(4096KiB/4308msec) clat (nsec): min=1714.9M, max=1714.9M, avg=1714931019.00, stdev= 0.00 lat (nsec): min=1714.9M, max=1714.9M, avg=1714934432.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1902KiB/s (1947kB/s)(8192KiB/4308msec); 0 zone resets clat (msec): min=915, max=1316, avg=1116.05, stdev=283.64 lat (msec): min=916, max=1318, avg=1117.13, stdev=284.35 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 919], 50.00th=[ 919], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.44%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146842: Mon Jan 12 18:43:16 2026 write: IOPS=0, BW=2380KiB/s (2437kB/s)(12.0MiB/5163msec); 0 zone resets clat (msec): min=517, max=3398, avg=1608.98, stdev=1562.43 lat (msec): min=518, max=3406, avg=1611.61, stdev=1566.37 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 8062, max= 8159, per=100.00%, avg=8110.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.00%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146843: Mon Jan 12 18:43:16 2026 write: IOPS=0, BW=2986KiB/s (3058kB/s)(12.0MiB/4115msec); 0 zone resets clat (msec): min=574, max=2508, avg=1295.94, stdev=1056.09 lat (msec): min=577, max=2508, avg=1297.38, stdev=1055.17 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 7846, max= 8159, per=100.00%, avg=8002.50, stdev=221.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.28%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3803KiB/s (3894kB/s), 951KiB/s-5783KiB/s (974kB/s-5921kB/s), io=16.0MiB (16.8MB), run=2125-4308msec WRITE: bw=6347KiB/s (6499kB/s), 1902KiB/s-2986KiB/s (1947kB/s-3058kB/s), io=32.0MiB (33.6MB), run=4115-5163msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146844: Mon Jan 12 18:43:16 2026 read: IOPS=0, BW=3690KiB/s (3779kB/s)(12.0MiB/3330msec) clat (msec): min=843, max=1314, avg=1082.77, stdev=235.29 lat (msec): min=843, max=1314, avg=1082.77, stdev=235.29 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.17%, ctx=235, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146845: Mon Jan 12 18:43:16 2026 read: IOPS=0, BW=1461KiB/s (1496kB/s)(4096KiB/2803msec) clat (nsec): min=1244.8M, max=1244.8M, avg=1244829029.00, stdev= 0.00 lat (nsec): min=1244.8M, max=1244.8M, avg=1244832243.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2923KiB/s (2993kB/s)(8192KiB/2803msec); 0 zone resets clat (msec): min=714, max=749, avg=731.58, stdev=24.76 lat (msec): min=714, max=750, avg=732.62, stdev=25.15 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.25%, sys=7.85%, ctx=147, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146847: Mon Jan 12 18:43:16 2026 write: IOPS=0, BW=2441KiB/s (2500kB/s)(12.0MiB/5033msec); 0 zone resets clat (msec): min=332, max=4252, avg=1647.35, stdev=2256.11 lat (msec): min=332, max=4252, avg=1647.96, stdev=2256.01 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 4245], 80.00th=[ 4245], 90.00th=[ 4245], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.16%, sys=1.85%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146848: Mon Jan 12 18:43:16 2026 write: IOPS=0, BW=3127KiB/s (3202kB/s)(12.0MiB/3930msec); 0 zone resets clat (msec): min=450, max=2415, avg=1280.42, stdev=1017.05 lat (msec): min=451, max=2416, avg=1281.19, stdev=1017.70 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 978], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min=16351, max=16351, per=100.00%, avg=16351.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.80%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4920KiB/s (5038kB/s), 1461KiB/s-3690KiB/s (1496kB/s-3779kB/s), io=16.0MiB (16.8MB), run=2803-3330msec WRITE: bw=6511KiB/s (6667kB/s), 2441KiB/s-3127KiB/s (2500kB/s-3202kB/s), io=32.0MiB (33.6MB), run=2803-5033msec