== sanity test 398b: DIO and buffer IO race ============== 21:08:44 (1767319724) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.60102 s, 9.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150611: Thu Jan 1 21:11:03 2026 read: IOPS=12, BW=51.2KiB/s (52.4kB/s)(5992KiB/117053msec) clat (usec): min=85, max=650597, avg=37799.73, stdev=32446.06 lat (usec): min=86, max=650598, avg=37802.64, stdev=32445.06 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 157], 10.00th=[ 212], 20.00th=[ 15795], | 30.00th=[ 21365], 40.00th=[ 25822], 50.00th=[ 31327], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 57410], 90.00th=[ 76022], 95.00th=[ 89654], | 99.00th=[130548], 99.50th=[147850], 99.90th=[235930], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 119, per=25.67%, avg=51.35, stdev=20.20, samples=228 iops : min= 1, max= 29, avg=12.20, stdev= 5.10, samples=228 write: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6296KiB/117053msec); 0 zone resets clat (usec): min=630, max=313453, avg=38309.43, stdev=40292.32 lat (usec): min=631, max=313454, avg=38311.17, stdev=40292.25 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1123], 10.00th=[ 1237], 20.00th=[ 3261], | 30.00th=[ 8455], 40.00th=[ 17695], 50.00th=[ 27395], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 65274], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[181404], 99.50th=[206570], 99.90th=[267387], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 15, max= 134, per=25.56%, avg=53.43, stdev=22.89, samples=230 iops : min= 3, max= 33, avg=12.73, stdev= 5.75, samples=230 lat (usec) : 100=0.03%, 250=5.05%, 500=0.42%, 750=0.23%, 1000=0.33% lat (msec) : 2=7.55%, 4=3.78%, 10=5.11%, 20=12.34%, 50=36.33% lat (msec) : 100=23.44%, 250=5.27%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.30%, ctx=6218, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150612: Thu Jan 1 21:11:03 2026 read: IOPS=12, BW=50.0KiB/s (51.2kB/s)(5940KiB/118748msec) clat (usec): min=64, max=581215, avg=38577.76, stdev=33518.09 lat (usec): min=65, max=581217, avg=38586.08, stdev=33516.94 clat percentiles (usec): | 1.00th=[ 125], 5.00th=[ 153], 10.00th=[ 277], 20.00th=[ 16712], | 30.00th=[ 21627], 40.00th=[ 26870], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 58459], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[166724], 99.90th=[312476], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 7, max= 135, per=25.23%, avg=50.46, stdev=21.18, samples=230 iops : min= 1, max= 33, avg=11.98, stdev= 5.35, samples=230 write: IOPS=13, BW=53.5KiB/s (54.7kB/s)(6348KiB/118748msec); 0 zone resets clat (usec): min=734, max=322767, avg=38644.36, stdev=40842.27 lat (usec): min=735, max=322769, avg=38647.39, stdev=40842.12 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 3326], | 30.00th=[ 8029], 40.00th=[ 16909], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[175113], 99.50th=[208667], 99.90th=[263193], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 150, per=25.52%, avg=53.34, stdev=23.33, samples=232 iops : min= 1, max= 37, avg=12.71, stdev= 5.87, samples=232 lat (usec) : 100=0.03%, 250=4.69%, 500=0.36%, 750=0.20%, 1000=0.39% lat (msec) : 2=7.62%, 4=3.52%, 10=6.58%, 20=11.04%, 50=37.24% lat (msec) : 100=22.17%, 250=5.99%, 500=0.16%, 750=0.03% cpu : usr=0.05%, sys=5.13%, ctx=6118, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150613: Thu Jan 1 21:11:03 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6028KiB/119080msec) clat (usec): min=88, max=227408, avg=36742.70, stdev=28302.37 lat (usec): min=88, max=227408, avg=36744.13, stdev=28302.18 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 147], 10.00th=[ 200], 20.00th=[ 15533], | 30.00th=[ 21890], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 88605], | 99.00th=[139461], 99.50th=[149947], 99.90th=[185598], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 7, max= 111, per=25.45%, avg=50.89, stdev=21.63, samples=231 iops : min= 1, max= 27, avg=12.10, stdev= 5.46, samples=231 write: IOPS=13, BW=52.6KiB/s (53.8kB/s)(6260KiB/119080msec); 0 zone resets clat (usec): min=766, max=702425, avg=40633.17, stdev=46434.70 lat (usec): min=767, max=702427, avg=40634.88, stdev=46434.78 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1123], 10.00th=[ 1270], 20.00th=[ 3130], | 30.00th=[ 8291], 40.00th=[ 18482], 50.00th=[ 28443], 60.00th=[ 39060], | 70.00th=[ 52691], 80.00th=[ 67634], 90.00th=[ 96994], 95.00th=[124257], | 99.00th=[181404], 99.50th=[235930], 99.90th=[375391], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 119, per=24.94%, avg=52.12, stdev=21.68, samples=234 iops : min= 1, max= 29, avg=12.39, stdev= 5.45, samples=234 lat (usec) : 100=0.13%, 250=5.18%, 500=0.65%, 750=0.13%, 1000=0.36% lat (msec) : 2=7.62%, 4=3.74%, 10=5.76%, 20=10.42%, 50=37.73% lat (msec) : 100=21.97%, 250=6.15%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.08%, ctx=6172, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150614: Thu Jan 1 21:11:03 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6052KiB/119941msec) clat (usec): min=103, max=270728, avg=36967.55, stdev=28607.88 lat (usec): min=103, max=270730, avg=36968.82, stdev=28607.88 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 151], 10.00th=[ 184], 20.00th=[ 15533], | 30.00th=[ 21103], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 57410], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[126354], 99.50th=[143655], 99.90th=[212861], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 112, per=25.26%, avg=50.53, stdev=22.42, samples=234 iops : min= 1, max= 28, avg=12.00, stdev= 5.65, samples=234 write: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6236KiB/119941msec); 0 zone resets clat (usec): min=814, max=705550, avg=40982.67, stdev=46349.43 lat (usec): min=815, max=705551, avg=40986.22, stdev=46350.88 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1221], 20.00th=[ 3130], | 30.00th=[ 8029], 40.00th=[ 19530], 50.00th=[ 30016], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[204473], 99.50th=[246416], 99.90th=[392168], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 136, per=24.69%, avg=51.59, stdev=21.05, samples=236 iops : min= 1, max= 34, avg=12.27, stdev= 5.34, samples=236 lat (usec) : 250=5.73%, 500=0.46%, 750=0.10%, 1000=0.39% lat (msec) : 2=7.65%, 4=4.10%, 10=5.47%, 20=10.68%, 50=36.07% lat (msec) : 100=23.21%, 250=5.92%, 500=0.20%, 750=0.03% cpu : usr=0.08%, sys=5.05%, ctx=6179, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=200KiB/s (205kB/s), 50.0KiB/s-51.2KiB/s (51.2kB/s-52.4kB/s), io=23.4MiB (24.6MB), run=117053-119941msec WRITE: bw=210KiB/s (215kB/s), 51.0KiB/s-53.8KiB/s (53.2kB/s-55.1kB/s), io=24.6MiB (25.7MB), run=117053-119941msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150606: Thu Jan 1 21:13:14 2026 read: IOPS=5, BW=23.8KiB/s (24.4kB/s)(5992KiB/251672msec) clat (msec): min=5, max=744, avg=32.97, stdev=38.38 lat (msec): min=5, max=744, avg=32.97, stdev=38.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 97], | 99.00th=[ 178], 99.50th=[ 230], 99.90th=[ 380], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 95, per=27.85%, avg=26.45, stdev=17.74, samples=439 iops : min= 1, max= 23, avg= 6.00, stdev= 4.46, samples=439 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6296KiB/251672msec); 0 zone resets clat (msec): min=31, max=471, avg=128.26, stdev=63.82 lat (msec): min=31, max=471, avg=128.26, stdev=63.82 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 148], 80.00th=[ 174], 90.00th=[ 215], 95.00th=[ 249], | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 460], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 79, per=24.81%, avg=24.56, stdev=11.83, samples=495 iops : min= 1, max= 19, avg= 5.52, stdev= 3.01, samples=495 lat (msec) : 10=5.70%, 20=18.23%, 50=17.35%, 100=25.65%, 250=30.40% lat (msec) : 500=2.64%, 750=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5174, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150607: Thu Jan 1 21:13:14 2026 read: IOPS=5, BW=23.7KiB/s (24.3kB/s)(5940KiB/250120msec) clat (msec): min=5, max=666, avg=31.88, stdev=34.63 lat (msec): min=5, max=666, avg=31.88, stdev=34.63 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 153], 99.50th=[ 190], 99.90th=[ 251], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 119, per=28.00%, avg=26.60, stdev=18.07, samples=432 iops : min= 1, max= 29, avg= 6.04, stdev= 4.58, samples=432 write: IOPS=6, BW=25.4KiB/s (25.0kB/s)(6348KiB/250120msec); 0 zone resets clat (msec): min=33, max=494, avg=127.53, stdev=64.38 lat (msec): min=33, max=494, avg=127.53, stdev=64.38 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 249], | 99.00th=[ 363], 99.50th=[ 409], 99.90th=[ 468], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 56, per=25.27%, avg=25.02, stdev=11.37, samples=489 iops : min= 1, max= 14, avg= 5.64, stdev= 2.90, samples=489 lat (msec) : 10=5.11%, 20=18.68%, 50=17.58%, 100=25.39%, 250=30.60% lat (msec) : 500=2.60%, 750=0.03% cpu : usr=0.03%, sys=1.10%, ctx=5074, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150608: Thu Jan 1 21:13:14 2026 read: IOPS=5, BW=23.0KiB/s (24.6kB/s)(6028KiB/251269msec) clat (msec): min=4, max=372, avg=33.79, stdev=35.21 lat (msec): min=4, max=372, avg=33.79, stdev=35.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 105], | 99.00th=[ 178], 99.50th=[ 207], 99.90th=[ 305], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 103, per=27.39%, avg=26.02, stdev=17.39, samples=448 iops : min= 1, max= 25, avg= 5.88, stdev= 4.40, samples=448 write: IOPS=6, BW=24.9KiB/s (25.5kB/s)(6260KiB/251269msec); 0 zone resets clat (msec): min=27, max=787, avg=127.74, stdev=65.63 lat (msec): min=27, max=787, avg=127.75, stdev=65.63 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 144], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 255], | 99.00th=[ 355], 99.50th=[ 380], 99.90th=[ 481], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 63, per=25.09%, avg=24.84, stdev=11.72, samples=487 iops : min= 1, max= 15, avg= 5.59, stdev= 2.99, samples=487 lat (msec) : 10=5.05%, 20=17.77%, 50=17.87%, 100=26.82%, 250=29.62% lat (msec) : 500=2.83%, 1000=0.03% cpu : usr=0.04%, sys=1.11%, ctx=5112, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150609: Thu Jan 1 21:13:14 2026 read: IOPS=6, BW=24.2KiB/s (24.8kB/s)(6052KiB/249752msec) clat (msec): min=4, max=376, avg=31.59, stdev=32.43 lat (msec): min=4, max=376, avg=31.59, stdev=32.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 94], | 99.00th=[ 148], 99.50th=[ 186], 99.90th=[ 317], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 112, per=28.57%, avg=27.15, stdev=18.75, samples=432 iops : min= 1, max= 28, avg= 6.17, stdev= 4.74, samples=432 write: IOPS=6, BW=24.0KiB/s (25.6kB/s)(6236KiB/249752msec); 0 zone resets clat (msec): min=31, max=793, avg=129.29, stdev=67.26 lat (msec): min=31, max=793, avg=129.29, stdev=67.26 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 222], 95.00th=[ 264], | 99.00th=[ 351], 99.50th=[ 388], 99.90th=[ 464], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 56, per=24.89%, avg=24.64, stdev=11.56, samples=489 iops : min= 1, max= 14, avg= 5.54, stdev= 2.96, samples=489 lat (msec) : 10=5.21%, 20=18.85%, 50=18.33%, 100=25.16%, 250=29.23% lat (msec) : 500=3.19%, 1000=0.03% cpu : usr=0.04%, sys=1.12%, ctx=5244, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=95.4KiB/s (97.7kB/s), 23.7KiB/s-24.2KiB/s (24.3kB/s-24.8kB/s), io=23.4MiB (24.6MB), run=249752-251672msec WRITE: bw=99.9KiB/s (102kB/s), 24.9KiB/s-25.4KiB/s (25.5kB/s-25.0kB/s), io=24.6MiB (25.7MB), run=249752-251672msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150670: Thu Jan 1 21:13:49 2026 read: IOPS=16, BW=265KiB/s (272kB/s)(5920KiB/22313msec) clat (usec): min=103, max=456185, avg=31940.65, stdev=33383.74 lat (usec): min=103, max=456187, avg=31953.16, stdev=33380.44 clat percentiles (usec): | 1.00th=[ 115], 5.00th=[ 145], 10.00th=[ 165], 20.00th=[ 2343], | 30.00th=[ 18220], 40.00th=[ 23200], 50.00th=[ 28443], 60.00th=[ 33424], | 70.00th=[ 41157], 80.00th=[ 47973], 90.00th=[ 62653], 95.00th=[ 72877], | 99.00th=[129500], 99.50th=[196084], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 93, max= 448, per=25.30%, avg=257.79, stdev=83.97, samples=43 iops : min= 5, max= 28, avg=15.37, stdev= 5.38, samples=43 write: IOPS=17, BW=285KiB/s (292kB/s)(6368KiB/22313msec); 0 zone resets clat (usec): min=1067, max=284413, avg=26288.24, stdev=30187.38 lat (usec): min=1068, max=284415, avg=26290.55, stdev=30187.24 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1713], 10.00th=[ 1811], 20.00th=[ 3359], | 30.00th=[ 5800], 40.00th=[ 8848], 50.00th=[ 13829], 60.00th=[ 22676], | 70.00th=[ 34341], 80.00th=[ 45876], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[126354], 99.50th=[135267], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 479, per=26.27%, avg=281.60, stdev=102.38, samples=43 iops : min= 1, max= 29, avg=16.88, stdev= 6.47, samples=43 lat (usec) : 250=7.94%, 500=1.04%, 750=0.26% lat (msec) : 2=6.51%, 4=5.73%, 10=11.20%, 20=12.11%, 50=36.85% lat (msec) : 100=16.41%, 250=1.69%, 500=0.26% cpu : usr=0.08%, sys=6.56%, ctx=1358, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150671: Thu Jan 1 21:13:49 2026 read: IOPS=15, BW=245KiB/s (250kB/s)(5744KiB/23492msec) clat (usec): min=103, max=153395, avg=32533.31, stdev=26442.87 lat (usec): min=103, max=153397, avg=32536.03, stdev=26443.86 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 147], 10.00th=[ 161], 20.00th=[ 322], | 30.00th=[ 20055], 40.00th=[ 25560], 50.00th=[ 30278], 60.00th=[ 35390], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[104334], 99.50th=[133694], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 50, max= 542, per=24.50%, avg=249.62, stdev=110.74, samples=45 iops : min= 3, max= 33, avg=14.91, stdev= 6.90, samples=45 write: IOPS=17, BW=279KiB/s (285kB/s)(6544KiB/23492msec); 0 zone resets clat (usec): min=1391, max=211429, avg=28777.30, stdev=34410.29 lat (usec): min=1394, max=211431, avg=28779.81, stdev=34410.16 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1647], 10.00th=[ 1811], 20.00th=[ 3785], | 30.00th=[ 5866], 40.00th=[ 8979], 50.00th=[ 16188], 60.00th=[ 22938], | 70.00th=[ 35914], 80.00th=[ 52167], 90.00th=[ 71828], 95.00th=[ 95945], | 99.00th=[160433], 99.50th=[170918], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 62, max= 672, per=25.93%, avg=277.96, stdev=129.29, samples=46 iops : min= 3, max= 42, avg=16.67, stdev= 8.19, samples=46 lat (usec) : 250=9.11%, 500=0.65%, 750=0.13%, 1000=0.39% lat (msec) : 2=7.16%, 4=4.69%, 10=11.33%, 20=9.90%, 50=35.42% lat (msec) : 100=18.23%, 250=2.99% cpu : usr=0.09%, sys=6.29%, ctx=1367, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150672: Thu Jan 1 21:13:49 2026 read: IOPS=16, BW=268KiB/s (274kB/s)(6256KiB/23380msec) clat (usec): min=106, max=193668, avg=31540.03, stdev=25316.54 lat (usec): min=107, max=193669, avg=31548.46, stdev=25308.23 clat percentiles (usec): | 1.00th=[ 122], 5.00th=[ 161], 10.00th=[ 172], 20.00th=[ 9241], | 30.00th=[ 19792], 40.00th=[ 23725], 50.00th=[ 28967], 60.00th=[ 33424], | 70.00th=[ 40109], 80.00th=[ 50594], 90.00th=[ 62653], 95.00th=[ 73925], | 99.00th=[103285], 99.50th=[189793], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 539, per=26.31%, avg=268.09, stdev=106.57, samples=46 iops : min= 3, max= 33, avg=16.04, stdev= 6.74, samples=46 write: IOPS=16, BW=258KiB/s (264kB/s)(6032KiB/23380msec); 0 zone resets clat (usec): min=989, max=408846, avg=29209.38, stdev=36632.14 lat (usec): min=991, max=408849, avg=29211.51, stdev=36632.16 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1647], 10.00th=[ 1827], 20.00th=[ 3785], | 30.00th=[ 6587], 40.00th=[ 10814], 50.00th=[ 16909], 60.00th=[ 26346], | 70.00th=[ 38011], 80.00th=[ 49546], 90.00th=[ 65799], 95.00th=[ 89654], | 99.00th=[164627], 99.50th=[208667], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 93, max= 542, per=23.71%, avg=254.13, stdev=107.23, samples=46 iops : min= 5, max= 33, avg=15.17, stdev= 6.75, samples=46 lat (usec) : 250=7.94%, 500=0.78%, 750=0.26%, 1000=0.13% lat (msec) : 2=5.73%, 4=4.82%, 10=8.98%, 20=13.67%, 50=36.98% lat (msec) : 100=18.49%, 250=2.08%, 500=0.13% cpu : usr=0.06%, sys=6.43%, ctx=1442, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150673: Thu Jan 1 21:13:49 2026 read: IOPS=17, BW=279KiB/s (285kB/s)(6032KiB/21649msec) clat (usec): min=98, max=144878, avg=29703.14, stdev=23900.46 lat (usec): min=99, max=144879, avg=29704.44, stdev=23900.41 clat percentiles (usec): | 1.00th=[ 119], 5.00th=[ 145], 10.00th=[ 159], 20.00th=[ 1205], | 30.00th=[ 17433], 40.00th=[ 21890], 50.00th=[ 26870], 60.00th=[ 31589], | 70.00th=[ 38536], 80.00th=[ 47973], 90.00th=[ 60031], 95.00th=[ 71828], | 99.00th=[107480], 99.50th=[120062], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 126, max= 574, per=26.91%, avg=274.21, stdev=94.25, samples=42 iops : min= 7, max= 35, avg=16.43, stdev= 5.98, samples=42 write: IOPS=18, BW=289KiB/s (296kB/s)(6256KiB/21649msec); 0 zone resets clat (usec): min=1244, max=224641, avg=26648.15, stdev=30423.78 lat (usec): min=1246, max=224643, avg=26661.94, stdev=30425.47 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1647], 10.00th=[ 1909], 20.00th=[ 3490], | 30.00th=[ 6456], 40.00th=[ 10945], 50.00th=[ 15008], 60.00th=[ 22938], | 70.00th=[ 32637], 80.00th=[ 46924], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[149947], 99.50th=[204473], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 127, max= 537, per=26.60%, avg=285.19, stdev=89.74, samples=42 iops : min= 7, max= 33, avg=17.12, stdev= 5.71, samples=42 lat (usec) : 100=0.13%, 250=8.46%, 500=0.39%, 750=0.39%, 1000=0.26% lat (msec) : 2=5.86%, 4=6.12%, 10=8.33%, 20=16.28%, 50=35.42% lat (msec) : 100=16.80%, 250=1.56% cpu : usr=0.08%, sys=7.16%, ctx=1387, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1020KiB/s (1044kB/s), 245KiB/s-279KiB/s (250kB/s-285kB/s), io=23.4MiB (24.5MB), run=21649-23492msec WRITE: bw=1073KiB/s (1098kB/s), 258KiB/s-289KiB/s (264kB/s-296kB/s), io=24.6MiB (25.8MB), run=21649-23492msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150665: Thu Jan 1 21:14:24 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(5920KiB/58647msec) clat (msec): min=5, max=199, avg=31.59, stdev=31.26 lat (msec): min=5, max=199, avg=31.59, stdev=31.26 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 171], 99.50th=[ 192], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 30, max= 316, per=26.01%, avg=104.82, stdev=62.90, samples=111 iops : min= 1, max= 19, avg= 5.83, stdev= 3.97, samples=111 write: IOPS=6, BW=109KiB/s (111kB/s)(6368KiB/58647msec); 0 zone resets clat (msec): min=36, max=481, avg=117.58, stdev=54.36 lat (msec): min=36, max=481, avg=117.59, stdev=54.36 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 118], | 70.00th=[ 132], 80.00th=[ 155], 90.00th=[ 190], 95.00th=[ 226], | 99.00th=[ 313], 99.50th=[ 347], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 31, max= 256, per=25.71%, avg=109.00, stdev=46.92, samples=115 iops : min= 1, max= 16, avg= 6.09, stdev= 3.04, samples=115 lat (msec) : 10=4.43%, 20=19.79%, 50=17.45%, 100=28.13%, 250=28.52% lat (msec) : 500=1.69% cpu : usr=0.03%, sys=1.41%, ctx=1378, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150666: Thu Jan 1 21:14:24 2026 read: IOPS=6, BW=96.9KiB/s (99.2kB/s)(5744KiB/59306msec) clat (msec): min=5, max=231, avg=31.75, stdev=33.47 lat (msec): min=5, max=231, avg=31.77, stdev=33.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 41], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 190], 99.50th=[ 201], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 28, max= 320, per=26.53%, avg=106.90, stdev=62.94, samples=105 iops : min= 1, max= 20, avg= 5.95, stdev= 3.98, samples=105 write: IOPS=6, BW=110KiB/s (113kB/s)(6544KiB/59306msec); 0 zone resets clat (msec): min=29, max=477, avg=116.71, stdev=52.99 lat (msec): min=29, max=477, avg=116.72, stdev=52.99 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 99], 50.00th=[ 110], 60.00th=[ 122], | 70.00th=[ 133], 80.00th=[ 148], 90.00th=[ 178], 95.00th=[ 228], | 99.00th=[ 279], 99.50th=[ 300], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 31, max= 255, per=26.52%, avg=112.46, stdev=46.44, samples=114 iops : min= 1, max= 15, avg= 6.31, stdev= 2.99, samples=114 lat (msec) : 10=5.99%, 20=16.67%, 50=18.62%, 100=25.39%, 250=32.03% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.47%, ctx=1359, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150667: Thu Jan 1 21:14:24 2026 read: IOPS=6, BW=109KiB/s (112kB/s)(6256KiB/57146msec) clat (msec): min=6, max=217, avg=28.93, stdev=28.45 lat (msec): min=6, max=217, avg=28.93, stdev=28.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 82], | 99.00th=[ 167], 99.50th=[ 186], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 351, per=28.43%, avg=114.56, stdev=79.17, samples=108 iops : min= 1, max= 21, avg= 6.44, stdev= 4.97, samples=108 write: IOPS=6, BW=106KiB/s (108kB/s)(6032KiB/57146msec); 0 zone resets clat (msec): min=40, max=371, avg=121.14, stdev=53.88 lat (msec): min=40, max=371, avg=121.14, stdev=53.88 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 65], 20.00th=[ 78], | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 192], 95.00th=[ 224], | 99.00th=[ 326], 99.50th=[ 351], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 192, per=24.76%, avg=105.00, stdev=39.96, samples=113 iops : min= 1, max= 12, avg= 5.83, stdev= 2.60, samples=113 lat (msec) : 10=5.60%, 20=21.48%, 50=17.58%, 100=24.61%, 250=29.17% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.45%, ctx=1379, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150668: Thu Jan 1 21:14:24 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(6032KiB/57415msec) clat (msec): min=6, max=230, avg=29.10, stdev=27.44 lat (msec): min=6, max=230, avg=29.10, stdev=27.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 27], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 86], | 99.00th=[ 142], 99.50th=[ 188], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 319, per=28.12%, avg=113.32, stdev=70.94, samples=103 iops : min= 1, max= 19, avg= 6.36, stdev= 4.47, samples=103 write: IOPS=6, BW=109KiB/s (112kB/s)(6256KiB/57415msec); 0 zone resets clat (msec): min=29, max=329, avg=118.65, stdev=52.45 lat (msec): min=29, max=329, avg=118.66, stdev=52.45 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 118], | 70.00th=[ 133], 80.00th=[ 161], 90.00th=[ 194], 95.00th=[ 222], | 99.00th=[ 284], 99.50th=[ 300], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 222, per=25.57%, avg=108.44, stdev=40.97, samples=112 iops : min= 1, max= 13, avg= 6.05, stdev= 2.66, samples=112 lat (msec) : 10=4.43%, 20=20.96%, 50=17.84%, 100=27.60%, 250=27.60% lat (msec) : 500=1.56% cpu : usr=0.03%, sys=1.39%, ctx=1285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=404KiB/s (414kB/s), 96.9KiB/s-109KiB/s (99.2kB/s-112kB/s), io=23.4MiB (24.5MB), run=57146-59306msec WRITE: bw=425KiB/s (435kB/s), 106KiB/s-110KiB/s (108kB/s-113kB/s), io=24.6MiB (25.8MB), run=57146-59306msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150701: Thu Jan 1 21:14:39 2026 read: IOPS=2, BW=2481KiB/s (2541kB/s)(7168KiB/2889msec) clat (msec): min=105, max=370, avg=248.85, stdev=80.60 lat (msec): min=105, max=370, avg=248.85, stdev=80.60 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 215], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 255], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 284], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2035, max= 4096, per=56.67%, avg=3050.50, stdev=1165.49, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1772KiB/s (1815kB/s)(5120KiB/2889msec); 0 zone resets clat (msec): min=93, max=203, avg=154.18, stdev=44.22 lat (msec): min=93, max=203, avg=154.26, stdev=44.21 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 205], 95.00th=[ 205], | 99.00th=[ 205], 99.50th=[ 205], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 2048, max= 4071, per=36.12%, avg=2722.33, stdev=1167.98, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=33.33% cpu : usr=0.03%, sys=14.65%, ctx=274, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150702: Thu Jan 1 21:14:39 2026 read: IOPS=0, BW=550KiB/s (563kB/s)(2048KiB/3725msec) clat (msec): min=248, max=262, avg=255.72, stdev=10.18 lat (msec): min=248, max=262, avg=255.72, stdev=10.18 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 249], 60.00th=[ 264], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 1537, max= 2011, per=32.96%, avg=1774.00, stdev=335.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2749KiB/s (2815kB/s)(10.0MiB/3725msec); 0 zone resets clat (msec): min=66, max=644, avg=313.46, stdev=210.43 lat (msec): min=66, max=644, avg=313.68, stdev=210.64 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 85], | 30.00th=[ 171], 40.00th=[ 182], 50.00th=[ 194], 60.00th=[ 334], | 70.00th=[ 351], 80.00th=[ 502], 90.00th=[ 609], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1537, max= 6047, per=33.62%, avg=2533.86, stdev=1560.11, samples=7 iops : min= 1, max= 5, avg= 1.86, stdev= 1.46, samples=7 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.08%, sys=12.76%, ctx=135, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150704: Thu Jan 1 21:14:39 2026 read: IOPS=1, BW=1615KiB/s (1654kB/s)(6144KiB/3804msec) clat (usec): min=571, max=212072, avg=141688.98, stdev=74564.46 lat (usec): min=572, max=212073, avg=141690.08, stdev=74564.39 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[129500], | 30.00th=[129500], 40.00th=[152044], 50.00th=[152044], 60.00th=[173016], | 70.00th=[181404], 80.00th=[181404], 90.00th=[212861], 95.00th=[212861], | 99.00th=[212861], 99.50th=[212861], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 2048, max= 4071, per=62.80%, avg=3380.67, stdev=1154.37, samples=3 iops : min= 2, max= 3, avg= 2.67, stdev= 0.58, samples=3 write: IOPS=1, BW=1615KiB/s (1654kB/s)(6144KiB/3804msec); 0 zone resets clat (msec): min=160, max=1199, avg=431.69, stdev=400.07 lat (msec): min=160, max=1199, avg=431.77, stdev=400.08 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 182], | 30.00th=[ 182], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 317], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 2011, max= 4023, per=33.56%, avg=2529.25, stdev=995.95, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.03%, sys=10.39%, ctx=151, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150706: Thu Jan 1 21:14:39 2026 read: IOPS=1, BW=1528KiB/s (1565kB/s)(5120KiB/3350msec) clat (usec): min=690, max=136638, avg=51960.57, stdev=67351.74 lat (usec): min=691, max=136639, avg=51961.74, stdev=67351.78 clat percentiles (usec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 8160], 60.00th=[ 8160], | 70.00th=[113771], 80.00th=[113771], 90.00th=[137364], 95.00th=[137364], | 99.00th=[137364], 99.50th=[137364], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2140KiB/s (2191kB/s)(7168KiB/3350msec); 0 zone resets clat (msec): min=106, max=1344, avg=390.02, stdev=449.68 lat (msec): min=106, max=1348, avg=390.91, stdev=450.85 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 126], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 146], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 550], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 2011, max= 4071, per=44.69%, avg=3368.33, stdev=1175.73, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.97%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5384KiB/s (5513kB/s), 550KiB/s-2481KiB/s (563kB/s-2541kB/s), io=20.0MiB (20.0MB), run=2889-3804msec WRITE: bw=7537KiB/s (7718kB/s), 1615KiB/s-2749KiB/s (1654kB/s-2815kB/s), io=28.0MiB (29.4MB), run=2889-3804msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150699: Thu Jan 1 21:14:39 2026 read: IOPS=1, BW=1662KiB/s (1701kB/s)(7168KiB/4314msec) clat (msec): min=82, max=894, avg=339.78, stdev=287.21 lat (msec): min=82, max=894, avg=339.78, stdev=287.21 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 112], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 309], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 443], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1984, max= 3968, per=65.73%, avg=2970.25, stdev=1105.53, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1187KiB/s (1215kB/s)(5120KiB/4314msec); 0 zone resets clat (msec): min=100, max=548, avg=302.16, stdev=182.97 lat (msec): min=100, max=548, avg=302.25, stdev=182.98 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2015, max= 4087, per=53.05%, avg=3356.67, stdev=1163.44, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.43%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150700: Thu Jan 1 21:14:39 2026 read: IOPS=0, BW=452KiB/s (463kB/s)(2048KiB/4531msec) clat (msec): min=92, max=127, avg=110.15, stdev=24.27 lat (msec): min=92, max=127, avg=110.15, stdev=24.27 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 93], 60.00th=[ 128], | 70.00th=[ 128], 80.00th=[ 128], 90.00th=[ 128], 95.00th=[ 128], | 99.00th=[ 128], 99.50th=[ 128], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 1440, max= 1984, per=37.88%, avg=1712.00, stdev=384.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2260KiB/s (2314kB/s)(10.0MiB/4531msec); 0 zone resets clat (msec): min=122, max=1115, avg=425.73, stdev=290.19 lat (msec): min=122, max=1115, avg=425.81, stdev=290.18 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 236], | 30.00th=[ 249], 40.00th=[ 251], 50.00th=[ 334], 60.00th=[ 347], | 70.00th=[ 405], 80.00th=[ 510], 90.00th=[ 693], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1440, max= 5953, per=39.39%, avg=2492.14, stdev=1541.27, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=4.64%, ctx=76, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150703: Thu Jan 1 21:14:39 2026 read: IOPS=1, BW=1808KiB/s (1852kB/s)(6144KiB/3398msec) clat (msec): min=107, max=446, avg=204.00, stdev=133.16 lat (msec): min=107, max=446, avg=204.00, stdev=133.16 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 131], 50.00th=[ 131], 60.00th=[ 161], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1943, max= 4031, per=55.31%, avg=2499.25, stdev=1021.92, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1808KiB/s (1852kB/s)(6144KiB/3398msec); 0 zone resets clat (msec): min=148, max=685, avg=332.95, stdev=209.61 lat (msec): min=148, max=685, avg=333.04, stdev=209.62 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 363], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1542, max= 2043, per=30.29%, avg=1916.40, stdev=213.11, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=3.89%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150705: Thu Jan 1 21:14:39 2026 read: IOPS=1, BW=1538KiB/s (1574kB/s)(5120KiB/3330msec) clat (msec): min=82, max=200, avg=138.42, stdev=42.30 lat (msec): min=82, max=200, avg=138.42, stdev=42.30 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 144], 80.00th=[ 144], 90.00th=[ 201], 95.00th=[ 201], | 99.00th=[ 201], 99.50th=[ 201], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 2039, max= 5829, per=87.05%, avg=3934.00, stdev=2679.93, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2153KiB/s (2204kB/s)(7168KiB/3330msec); 0 zone resets clat (msec): min=157, max=549, avg=351.57, stdev=143.06 lat (msec): min=157, max=549, avg=352.12, stdev=143.20 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 215], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 363], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 468], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1406, max= 4087, per=42.72%, avg=2703.00, stdev=1236.14, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=4.18%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4520KiB/s (4628kB/s), 452KiB/s-1808KiB/s (463kB/s-1852kB/s), io=20.0MiB (20.0MB), run=3330-4531msec WRITE: bw=6328KiB/s (6480kB/s), 1187KiB/s-2260KiB/s (1215kB/s-2314kB/s), io=28.0MiB (29.4MB), run=3330-4531msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=150714: Thu Jan 1 21:14:54 2026 read: IOPS=0, BW=4089KiB/s (4187kB/s)(12.0MiB/3005msec) clat (msec): min=857, max=1021, avg=940.19, stdev=82.18 lat (msec): min=857, max=1021, avg=940.19, stdev=82.18 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.69%, ctx=336, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150715: Thu Jan 1 21:14:54 2026 read: IOPS=0, BW=1379KiB/s (1412kB/s)(4096KiB/2970msec) clat (nsec): min=1007.9M, max=1007.9M, avg=1007886756.00, stdev= 0.00 lat (nsec): min=1007.9M, max=1007.9M, avg=1007887936.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1011], 5.00th=[ 1011], 10.00th=[ 1011], 20.00th=[ 1011], | 30.00th=[ 1011], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2758KiB/s (2824kB/s)(8192KiB/2970msec); 0 zone resets clat (msec): min=382, max=1366, avg=874.89, stdev=695.84 lat (msec): min=383, max=1367, avg=875.17, stdev=695.95 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 1368], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8192, max= 8192, per=94.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.54%, ctx=167, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150717: Thu Jan 1 21:14:54 2026 write: IOPS=0, BW=3237KiB/s (3315kB/s)(12.0MiB/3796msec); 0 zone resets clat (msec): min=649, max=1689, avg=1250.15, stdev=538.67 lat (msec): min=649, max=1689, avg=1250.56, stdev=538.47 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8143, max= 8192, per=94.62%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.42%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150719: Thu Jan 1 21:14:54 2026 write: IOPS=1, BW=4802KiB/s (4917kB/s)(12.0MiB/2559msec); 0 zone resets clat (msec): min=335, max=1676, avg=833.54, stdev=733.94 lat (msec): min=335, max=1677, avg=834.05, stdev=734.21 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 5657, max= 8062, per=79.47%, avg=6859.50, stdev=1700.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.16%, sys=5.43%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5452KiB/s (5583kB/s), 1379KiB/s-4089KiB/s (1412kB/s-4187kB/s), io=16.0MiB (16.8MB), run=2970-3005msec WRITE: bw=8632KiB/s (8839kB/s), 2758KiB/s-4802KiB/s (2824kB/s-4917kB/s), io=32.0MiB (33.6MB), run=2559-3796msec rand-rw: (groupid=0, jobs=1): err= 0: pid=150716: Thu Jan 1 21:14:54 2026 read: IOPS=0, BW=3172KiB/s (3248kB/s)(12.0MiB/3874msec) clat (msec): min=521, max=1789, avg=1273.24, stdev=665.64 lat (msec): min=521, max=1789, avg=1273.24, stdev=665.64 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8094, max= 8110, per=100.00%, avg=8102.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.61%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150718: Thu Jan 1 21:14:54 2026 read: IOPS=0, BW=1106KiB/s (1133kB/s)(4096KiB/3702msec) clat (nsec): min=1858.9M, max=1858.9M, avg=1858939519.00, stdev= 0.00 lat (nsec): min=1858.9M, max=1858.9M, avg=1858941449.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1854], 5.00th=[ 1854], 10.00th=[ 1854], 20.00th=[ 1854], | 30.00th=[ 1854], 40.00th=[ 1854], 50.00th=[ 1854], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2213KiB/s (2266kB/s)(8192KiB/3702msec); 0 zone resets clat (msec): min=342, max=1347, avg=845.06, stdev=710.06 lat (msec): min=343, max=1347, avg=845.34, stdev=710.17 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.27%, ctx=37, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150720: Thu Jan 1 21:14:54 2026 write: IOPS=0, BW=3897KiB/s (3991kB/s)(12.0MiB/3153msec); 0 zone resets clat (msec): min=694, max=1388, avg=1025.05, stdev=348.52 lat (msec): min=701, max=1389, avg=1027.98, stdev=345.40 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 7907, max= 8192, per=90.94%, avg=8049.50, stdev=201.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.87%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=150721: Thu Jan 1 21:14:54 2026 write: IOPS=1, BW=4207KiB/s (4308kB/s)(12.0MiB/2921msec); 0 zone resets clat (msec): min=400, max=1679, avg=955.03, stdev=656.04 lat (msec): min=402, max=1681, avg=956.73, stdev=656.49 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8126, max= 8192, per=92.18%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.42%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4229KiB/s (4331kB/s), 1106KiB/s-3172KiB/s (1133kB/s-3248kB/s), io=16.0MiB (16.8MB), run=3702-3874msec WRITE: bw=8851KiB/s (9064kB/s), 2213KiB/s-4207KiB/s (2266kB/s-4308kB/s), io=32.0MiB (33.6MB), run=2921-3702msec