== sanity test 398b: DIO and buffer IO race ============== 23:26:25 (1787196385) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.3155 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179084: Wed Aug 19 23:28:30 2026 read: IOPS=14, BW=57.6KiB/s (59.0kB/s)(5992KiB/103971msec) clat (usec): min=32, max=282402, avg=37811.17, stdev=25991.84 lat (usec): min=32, max=282404, avg=37813.14, stdev=25992.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 95], 10.00th=[ 13566], 20.00th=[ 18744], | 30.00th=[ 22938], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[128451], 99.50th=[147850], 99.90th=[200279], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 15, max= 127, per=24.87%, avg=57.19, stdev=23.92, samples=205 iops : min= 3, max= 31, avg=13.65, stdev= 5.99, samples=205 write: IOPS=15, BW=60.6KiB/s (62.0kB/s)(6296KiB/103971msec); 0 zone resets clat (usec): min=692, max=700989, avg=29832.51, stdev=35450.78 lat (usec): min=693, max=700991, avg=29835.19, stdev=35449.99 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 2606], | 30.00th=[ 5604], 40.00th=[ 13698], 50.00th=[ 20579], 60.00th=[ 28181], | 70.00th=[ 38536], 80.00th=[ 50594], 90.00th=[ 69731], 95.00th=[ 94897], | 99.00th=[132645], 99.50th=[164627], 99.90th=[250610], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 15, max= 150, per=25.02%, avg=60.30, stdev=26.62, samples=204 iops : min= 3, max= 37, avg=14.44, stdev= 6.69, samples=204 lat (usec) : 50=0.85%, 100=1.60%, 250=0.20%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.36% lat (msec) : 2=7.78%, 4=4.95%, 10=6.09%, 20=14.58%, 50=40.56% lat (msec) : 100=19.56%, 250=3.29%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.27%, ctx=6301, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179085: Wed Aug 19 23:28:30 2026 read: IOPS=14, BW=57.4KiB/s (58.8kB/s)(5940KiB/103501msec) clat (usec): min=36, max=233587, avg=37617.46, stdev=25359.36 lat (usec): min=36, max=233588, avg=37619.98, stdev=25359.65 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 725], 10.00th=[ 13698], 20.00th=[ 18482], | 30.00th=[ 22676], 40.00th=[ 26608], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[115868], 99.50th=[141558], 99.90th=[217056], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 6, max= 119, per=24.84%, avg=57.14, stdev=22.70, samples=203 iops : min= 1, max= 29, avg=13.64, stdev= 5.68, samples=203 write: IOPS=15, BW=61.3KiB/s (62.8kB/s)(6348KiB/103501msec); 0 zone resets clat (usec): min=695, max=737137, avg=29774.99, stdev=36585.94 lat (usec): min=696, max=737138, avg=29776.90, stdev=36585.99 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1139], 10.00th=[ 1254], 20.00th=[ 2245], | 30.00th=[ 4883], 40.00th=[ 11731], 50.00th=[ 20317], 60.00th=[ 28181], | 70.00th=[ 38536], 80.00th=[ 50594], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[164627], 99.90th=[229639], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 6, max= 174, per=25.17%, avg=60.66, stdev=26.91, samples=204 iops : min= 1, max= 43, avg=14.53, stdev= 6.76, samples=204 lat (usec) : 50=0.33%, 100=1.82%, 250=0.13%, 500=0.07%, 750=0.26% lat (usec) : 1000=0.59% lat (msec) : 2=8.72%, 4=4.75%, 10=6.25%, 20=13.90%, 50=40.98% lat (msec) : 100=19.17%, 250=2.99%, 750=0.03% cpu : usr=0.08%, sys=5.23%, ctx=6306, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179086: Wed Aug 19 23:28:30 2026 read: IOPS=14, BW=59.4KiB/s (60.8kB/s)(6028KiB/101500msec) clat (usec): min=34, max=233331, avg=37509.12, stdev=25900.44 lat (usec): min=34, max=233332, avg=37516.08, stdev=25911.08 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 111], 10.00th=[ 13304], 20.00th=[ 18482], | 30.00th=[ 22152], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 36963], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[128451], 99.50th=[149947], 99.90th=[183501], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 135, per=25.69%, avg=59.09, stdev=23.37, samples=199 iops : min= 1, max= 33, avg=14.14, stdev= 5.86, samples=199 write: IOPS=15, BW=61.7KiB/s (63.2kB/s)(6260KiB/101500msec); 0 zone resets clat (usec): min=679, max=694093, avg=28462.86, stdev=34809.24 lat (usec): min=680, max=694097, avg=28467.67, stdev=34807.32 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1139], 10.00th=[ 1270], 20.00th=[ 2311], | 30.00th=[ 4948], 40.00th=[ 11207], 50.00th=[ 19530], 60.00th=[ 27132], | 70.00th=[ 35914], 80.00th=[ 48497], 90.00th=[ 67634], 95.00th=[ 88605], | 99.00th=[141558], 99.50th=[158335], 99.90th=[193987], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 7, max= 143, per=25.42%, avg=61.27, stdev=27.07, samples=199 iops : min= 1, max= 35, avg=14.67, stdev= 6.77, samples=199 lat (usec) : 50=0.49%, 100=1.95%, 250=0.13%, 750=0.10%, 1000=0.39% lat (msec) : 2=8.33%, 4=5.24%, 10=6.22%, 20=14.75%, 50=40.59% lat (msec) : 100=18.75%, 250=3.03%, 750=0.03% cpu : usr=0.08%, sys=5.27%, ctx=6206, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179087: Wed Aug 19 23:28:30 2026 read: IOPS=14, BW=59.2KiB/s (60.6kB/s)(6052KiB/102225msec) clat (usec): min=29, max=203102, avg=37010.74, stdev=25649.19 lat (usec): min=29, max=203102, avg=37012.35, stdev=25649.05 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 12649], 20.00th=[ 17957], | 30.00th=[ 21890], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 83362], | 99.00th=[127402], 99.50th=[141558], 99.90th=[187696], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 116, per=25.87%, avg=59.50, stdev=20.65, samples=199 iops : min= 1, max= 29, avg=14.24, stdev= 5.21, samples=199 write: IOPS=15, BW=61.0KiB/s (62.5kB/s)(6236KiB/102225msec); 0 zone resets clat (usec): min=762, max=787006, avg=29472.36, stdev=37218.01 lat (usec): min=763, max=787010, avg=29475.39, stdev=37217.98 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 2671], | 30.00th=[ 4883], 40.00th=[ 11994], 50.00th=[ 19792], 60.00th=[ 28181], | 70.00th=[ 37487], 80.00th=[ 49021], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[156238], 99.50th=[168821], 99.90th=[200279], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 8, max= 190, per=25.16%, avg=60.63, stdev=27.06, samples=201 iops : min= 2, max= 47, avg=14.52, stdev= 6.79, samples=201 lat (usec) : 50=0.46%, 100=2.41%, 250=0.10%, 500=0.10%, 1000=0.46% lat (msec) : 2=7.65%, 4=5.14%, 10=6.84%, 20=14.36%, 50=41.18% lat (msec) : 100=18.23%, 250=3.06%, 1000=0.03% cpu : usr=0.07%, sys=5.14%, ctx=6170, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=231KiB/s (236kB/s), 57.4KiB/s-59.4KiB/s (58.8kB/s-60.8kB/s), io=23.4MiB (24.6MB), run=101500-103971msec WRITE: bw=242KiB/s (248kB/s), 60.6KiB/s-61.7KiB/s (62.0kB/s-63.2kB/s), io=24.6MiB (25.7MB), run=101500-103971msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179079: Wed Aug 19 23:29:13 2026 read: IOPS=10, BW=40.9KiB/s (41.9kB/s)(5992KiB/146593msec) clat (msec): min=5, max=588, avg=37.55, stdev=35.09 lat (msec): min=5, max=588, avg=37.55, stdev=35.09 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 79], 95.00th=[ 105], | 99.00th=[ 163], 99.50th=[ 190], 99.90th=[ 251], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 151, per=24.98%, avg=40.71, stdev=25.32, samples=287 iops : min= 1, max= 37, avg= 9.52, stdev= 6.37, samples=287 write: IOPS=10, BW=42.9KiB/s (43.0kB/s)(6296KiB/146593msec); 0 zone resets clat (msec): min=9, max=307, avg=57.10, stdev=38.58 lat (msec): min=9, max=307, avg=57.10, stdev=38.58 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 108], 95.00th=[ 136], | 99.00th=[ 192], 99.50th=[ 213], 99.90th=[ 305], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 163, per=25.00%, avg=42.76, stdev=24.44, samples=287 iops : min= 1, max= 40, avg=10.03, stdev= 6.13, samples=287 lat (msec) : 10=2.86%, 20=16.93%, 50=46.84%, 100=24.32%, 250=8.85% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.06%, sys=1.74%, ctx=4689, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179080: Wed Aug 19 23:29:13 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(5940KiB/146149msec) clat (msec): min=5, max=765, avg=36.27, stdev=37.17 lat (msec): min=5, max=765, avg=36.28, stdev=37.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 73], 95.00th=[ 105], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 300], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 151, per=24.84%, avg=40.49, stdev=26.13, samples=286 iops : min= 1, max= 37, avg= 9.46, stdev= 6.56, samples=286 write: IOPS=10, BW=43.4KiB/s (44.5kB/s)(6348KiB/146149msec); 0 zone resets clat (msec): min=10, max=301, avg=57.90, stdev=38.61 lat (msec): min=10, max=301, avg=57.91, stdev=38.61 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 82], 90.00th=[ 111], 95.00th=[ 140], | 99.00th=[ 194], 99.50th=[ 220], 99.90th=[ 296], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 139, per=25.21%, avg=43.11, stdev=23.31, samples=287 iops : min= 1, max= 34, avg=10.12, stdev= 5.85, samples=287 lat (msec) : 10=3.06%, 20=17.35%, 50=46.35%, 100=23.99%, 250=9.02% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.74%, ctx=4743, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179081: Wed Aug 19 23:29:13 2026 read: IOPS=10, BW=41.5KiB/s (42.5kB/s)(6028KiB/145271msec) clat (msec): min=4, max=295, avg=37.04, stdev=31.65 lat (msec): min=4, max=295, avg=37.05, stdev=31.65 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 75], 95.00th=[ 101], | 99.00th=[ 161], 99.50th=[ 182], 99.90th=[ 251], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 132, per=25.77%, avg=42.00, stdev=25.30, samples=280 iops : min= 1, max= 33, avg= 9.84, stdev= 6.36, samples=280 write: IOPS=10, BW=43.1KiB/s (44.1kB/s)(6260KiB/145271msec); 0 zone resets clat (msec): min=11, max=784, avg=56.85, stdev=42.82 lat (msec): min=11, max=784, avg=56.86, stdev=42.82 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 80], 90.00th=[ 104], 95.00th=[ 134], | 99.00th=[ 201], 99.50th=[ 264], 99.90th=[ 317], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 132, per=25.21%, avg=43.11, stdev=23.99, samples=283 iops : min= 1, max= 33, avg=10.12, stdev= 6.03, samples=283 lat (msec) : 10=2.86%, 20=16.63%, 50=47.14%, 100=25.36%, 250=7.68% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=4772, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179082: Wed Aug 19 23:29:13 2026 read: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6052KiB/146608msec) clat (msec): min=5, max=250, avg=37.11, stdev=32.73 lat (msec): min=5, max=250, avg=37.11, stdev=32.73 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 53], 90.00th=[ 82], 95.00th=[ 102], | 99.00th=[ 167], 99.50th=[ 199], 99.90th=[ 226], 99.95th=[ 251], | 99.99th=[ 251] bw ( KiB/s): min= 7, max= 143, per=25.87%, avg=42.17, stdev=27.40, samples=280 iops : min= 1, max= 35, avg= 9.88, stdev= 6.86, samples=280 write: IOPS=10, BW=42.5KiB/s (43.6kB/s)(6236KiB/146608msec); 0 zone resets clat (msec): min=11, max=795, avg=57.77, stdev=44.26 lat (msec): min=11, max=795, avg=57.77, stdev=44.26 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 66], 80.00th=[ 82], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 197], 99.50th=[ 243], 99.90th=[ 330], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 124, per=24.67%, avg=42.19, stdev=23.86, samples=288 iops : min= 1, max= 31, avg= 9.89, stdev= 6.00, samples=288 lat (msec) : 10=2.99%, 20=17.09%, 50=47.36%, 100=23.40%, 250=8.89% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.06%, sys=1.69%, ctx=4593, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=164KiB/s (168kB/s), 40.6KiB/s-41.5KiB/s (41.6kB/s-42.5kB/s), io=23.4MiB (24.6MB), run=145271-146608msec WRITE: bw=171KiB/s (176kB/s), 42.5KiB/s-43.4KiB/s (43.6kB/s-44.5kB/s), io=24.6MiB (25.7MB), run=145271-146608msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179125: Wed Aug 19 23:30:04 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5920KiB/35597msec) clat (usec): min=36, max=309933, avg=52520.84, stdev=39582.47 lat (usec): min=36, max=309934, avg=52538.02, stdev=39583.92 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 15664], 20.00th=[ 24249], | 30.00th=[ 29492], 40.00th=[ 36963], 50.00th=[ 45351], 60.00th=[ 54264], | 70.00th=[ 65274], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[114820], | 99.00th=[221250], 99.50th=[278922], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 318, per=25.39%, avg=162.74, stdev=67.90, samples=69 iops : min= 1, max= 19, avg= 9.43, stdev= 4.28, samples=69 write: IOPS=11, BW=179KiB/s (183kB/s)(6368KiB/35597msec); 0 zone resets clat (usec): min=1361, max=302028, avg=39939.81, stdev=42895.13 lat (usec): min=1362, max=302029, avg=39941.97, stdev=42895.44 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1745], 10.00th=[ 2114], 20.00th=[ 4686], | 30.00th=[ 9372], 40.00th=[ 17957], 50.00th=[ 27919], 60.00th=[ 36439], | 70.00th=[ 47973], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[127402], | 99.00th=[212861], 99.50th=[217056], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 441, per=26.72%, avg=180.37, stdev=75.68, samples=68 iops : min= 1, max= 27, avg=10.54, stdev= 4.82, samples=68 lat (usec) : 50=0.52%, 100=3.12%, 250=0.26%, 1000=0.13% lat (msec) : 2=4.95%, 4=3.52%, 10=7.94%, 20=7.55%, 50=35.68% lat (msec) : 100=27.34%, 250=8.59%, 500=0.39% cpu : usr=0.06%, sys=4.56%, ctx=1664, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179126: Wed Aug 19 23:30:04 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(5744KiB/34964msec) clat (usec): min=39, max=224563, avg=51951.67, stdev=34051.82 lat (usec): min=40, max=224564, avg=51960.52, stdev=34051.95 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 13042], 20.00th=[ 25822], | 30.00th=[ 32900], 40.00th=[ 40633], 50.00th=[ 47449], 60.00th=[ 53740], | 70.00th=[ 64226], 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[117965], | 99.00th=[149947], 99.50th=[175113], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 23, max= 314, per=25.80%, avg=165.37, stdev=68.74, samples=68 iops : min= 1, max= 19, avg= 9.59, stdev= 4.35, samples=68 write: IOPS=11, BW=187KiB/s (192kB/s)(6544KiB/34964msec); 0 zone resets clat (usec): min=1305, max=214063, avg=38783.63, stdev=39921.29 lat (usec): min=1306, max=214065, avg=38785.80, stdev=39921.61 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 2638], 20.00th=[ 5604], | 30.00th=[ 10945], 40.00th=[ 17957], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[117965], | 99.00th=[173016], 99.50th=[189793], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 30, max= 510, per=27.92%, avg=188.47, stdev=95.18, samples=68 iops : min= 1, max= 31, avg=11.04, stdev= 6.02, samples=68 lat (usec) : 50=0.26%, 100=3.39%, 250=0.26%, 750=0.13% lat (msec) : 2=4.30%, 4=3.26%, 10=8.33%, 20=9.24%, 50=33.85% lat (msec) : 100=28.65%, 250=8.33% cpu : usr=0.04%, sys=4.84%, ctx=1595, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179127: Wed Aug 19 23:30:04 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(6256KiB/37311msec) clat (usec): min=45, max=336384, avg=54509.73, stdev=41987.49 lat (usec): min=46, max=336386, avg=54511.04, stdev=41987.44 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 65], 10.00th=[ 14746], 20.00th=[ 23725], | 30.00th=[ 31065], 40.00th=[ 38011], 50.00th=[ 43779], 60.00th=[ 52167], | 70.00th=[ 64226], 80.00th=[ 83362], 90.00th=[105382], 95.00th=[141558], | 99.00th=[181404], 99.50th=[240124], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 30, max= 409, per=26.60%, avg=170.53, stdev=75.05, samples=72 iops : min= 1, max= 25, avg= 9.90, stdev= 4.79, samples=72 write: IOPS=10, BW=162KiB/s (166kB/s)(6032KiB/37311msec); 0 zone resets clat (usec): min=1437, max=252482, avg=40876.11, stdev=38602.42 lat (usec): min=1440, max=252484, avg=40879.12, stdev=38601.87 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1713], 10.00th=[ 2638], 20.00th=[ 6259], | 30.00th=[ 11338], 40.00th=[ 22938], 50.00th=[ 31589], 60.00th=[ 41681], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 95945], 95.00th=[116917], | 99.00th=[156238], 99.50th=[191890], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 382, per=23.65%, avg=159.62, stdev=79.46, samples=73 iops : min= 1, max= 23, avg= 9.22, stdev= 5.03, samples=73 lat (usec) : 50=0.65%, 100=2.47%, 250=0.26%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.52%, 4=3.52%, 10=6.77%, 20=8.98%, 50=35.94% lat (msec) : 100=26.82%, 250=10.55%, 500=0.26% cpu : usr=0.08%, sys=4.03%, ctx=1694, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179128: Wed Aug 19 23:30:04 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(6032KiB/34869msec) clat (usec): min=41, max=297714, avg=49341.25, stdev=38332.27 lat (usec): min=42, max=297715, avg=49361.23, stdev=38345.52 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 306], 20.00th=[ 22676], | 30.00th=[ 29230], 40.00th=[ 35914], 50.00th=[ 40109], 60.00th=[ 48497], | 70.00th=[ 59507], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[127402], | 99.00th=[170918], 99.50th=[214959], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 382, per=26.92%, avg=172.56, stdev=86.42, samples=68 iops : min= 1, max= 23, avg=10.03, stdev= 5.43, samples=68 write: IOPS=11, BW=179KiB/s (184kB/s)(6256KiB/34869msec); 0 zone resets clat (usec): min=1234, max=289617, avg=41293.74, stdev=45953.57 lat (usec): min=1237, max=289620, avg=41296.76, stdev=45954.90 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1663], 10.00th=[ 1942], 20.00th=[ 4948], | 30.00th=[ 10290], 40.00th=[ 18482], 50.00th=[ 28181], 60.00th=[ 35914], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[102237], 95.00th=[130548], | 99.00th=[244319], 99.50th=[252707], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 408, per=26.71%, avg=180.32, stdev=87.18, samples=68 iops : min= 1, max= 25, avg=10.53, stdev= 5.52, samples=68 lat (usec) : 50=0.39%, 100=4.17%, 250=0.26%, 500=0.39% lat (msec) : 2=5.21%, 4=4.04%, 10=5.99%, 20=9.24%, 50=35.94% lat (msec) : 100=24.61%, 250=9.38%, 500=0.39% cpu : usr=0.07%, sys=4.53%, ctx=1526, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=642KiB/s (657kB/s), 164KiB/s-173KiB/s (168kB/s-177kB/s), io=23.4MiB (24.5MB), run=34869-37311msec WRITE: bw=675KiB/s (692kB/s), 162KiB/s-187KiB/s (166kB/s-192kB/s), io=24.6MiB (25.8MB), run=34869-37311msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179129: Wed Aug 19 23:30:15 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(5920KiB/48651msec) clat (msec): min=5, max=333, avg=52.72, stdev=50.43 lat (msec): min=5, max=333, avg=52.72, stdev=50.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 71], 90.00th=[ 110], 95.00th=[ 167], | 99.00th=[ 255], 99.50th=[ 313], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 478, per=25.62%, avg=125.03, stdev=81.10, samples=90 iops : min= 1, max= 29, avg= 7.01, stdev= 5.11, samples=90 write: IOPS=8, BW=131KiB/s (134kB/s)(6368KiB/48651msec); 0 zone resets clat (msec): min=12, max=346, avg=72.20, stdev=54.96 lat (msec): min=12, max=346, avg=72.20, stdev=54.97 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 25], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 105], 90.00th=[ 144], 95.00th=[ 186], | 99.00th=[ 279], 99.50th=[ 338], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 22, max= 342, per=25.45%, avg=130.81, stdev=77.39, samples=94 iops : min= 1, max= 21, avg= 7.37, stdev= 4.91, samples=94 lat (msec) : 10=1.69%, 20=9.90%, 50=45.18%, 100=26.56%, 250=14.71% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.48%, ctx=1168, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179130: Wed Aug 19 23:30:15 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5744KiB/48982msec) clat (msec): min=6, max=325, avg=52.65, stdev=45.35 lat (msec): min=6, max=325, avg=52.65, stdev=45.35 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 41], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 105], 95.00th=[ 144], | 99.00th=[ 226], 99.50th=[ 284], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 30, max= 351, per=26.05%, avg=127.10, stdev=82.97, samples=88 iops : min= 1, max= 21, avg= 7.15, stdev= 5.27, samples=88 write: IOPS=8, BW=134KiB/s (137kB/s)(6544KiB/48982msec); 0 zone resets clat (msec): min=9, max=340, avg=73.32, stdev=59.02 lat (msec): min=9, max=340, avg=73.32, stdev=59.02 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 81], 80.00th=[ 109], 90.00th=[ 148], 95.00th=[ 209], | 99.00th=[ 296], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 512, per=25.97%, avg=133.48, stdev=86.02, samples=95 iops : min= 1, max= 32, avg= 7.55, stdev= 5.47, samples=95 lat (msec) : 10=1.17%, 20=9.11%, 50=45.31%, 100=27.34%, 250=15.63% lat (msec) : 500=1.43% cpu : usr=0.08%, sys=1.31%, ctx=1155, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179131: Wed Aug 19 23:30:15 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6256KiB/48502msec) clat (msec): min=5, max=329, avg=47.51, stdev=39.41 lat (msec): min=5, max=329, avg=47.53, stdev=39.43 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 68], 90.00th=[ 104], 95.00th=[ 126], | 99.00th=[ 188], 99.50th=[ 218], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 351, per=27.96%, avg=136.46, stdev=87.84, samples=90 iops : min= 1, max= 21, avg= 7.72, stdev= 5.52, samples=90 write: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48502msec); 0 zone resets clat (msec): min=12, max=351, avg=78.22, stdev=59.91 lat (msec): min=12, max=351, avg=78.23, stdev=59.91 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 71], | 70.00th=[ 88], 80.00th=[ 112], 90.00th=[ 161], 95.00th=[ 211], | 99.00th=[ 309], 99.50th=[ 317], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 382, per=24.22%, avg=124.52, stdev=72.36, samples=93 iops : min= 1, max= 23, avg= 6.98, stdev= 4.57, samples=93 lat (msec) : 10=0.52%, 20=11.46%, 50=43.62%, 100=26.56%, 250=16.41% lat (msec) : 500=1.43% cpu : usr=0.05%, sys=1.45%, ctx=1148, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179132: Wed Aug 19 23:30:15 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48770msec) clat (msec): min=7, max=318, avg=55.40, stdev=48.19 lat (msec): min=7, max=318, avg=55.40, stdev=48.19 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 82], 90.00th=[ 126], 95.00th=[ 165], | 99.00th=[ 224], 99.50th=[ 288], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 30, max= 318, per=26.28%, avg=128.24, stdev=76.20, samples=89 iops : min= 1, max= 19, avg= 7.21, stdev= 4.82, samples=89 write: IOPS=8, BW=128KiB/s (131kB/s)(6256KiB/48770msec); 0 zone resets clat (msec): min=14, max=473, avg=70.42, stdev=56.71 lat (msec): min=14, max=473, avg=70.42, stdev=56.71 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 60], | 70.00th=[ 77], 80.00th=[ 102], 90.00th=[ 146], 95.00th=[ 178], | 99.00th=[ 279], 99.50th=[ 338], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 31, max= 509, per=25.08%, avg=128.90, stdev=82.61, samples=93 iops : min= 1, max= 31, avg= 7.25, stdev= 5.21, samples=93 lat (msec) : 10=0.39%, 20=8.85%, 50=46.09%, 100=27.08%, 250=16.28% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.51%, ctx=1303, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=489KiB/s (501kB/s), 117KiB/s-129KiB/s (120kB/s-132kB/s), io=23.4MiB (24.5MB), run=48502-48982msec WRITE: bw=514KiB/s (527kB/s), 124KiB/s-134KiB/s (127kB/s-137kB/s), io=24.6MiB (25.8MB), run=48502-48982msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179151: Wed Aug 19 23:30:29 2026 read: IOPS=1, BW=1590KiB/s (1628kB/s)(7168KiB/4509msec) clat (msec): min=82, max=1844, avg=399.98, stdev=639.21 lat (msec): min=82, max=1844, avg=399.98, stdev=639.21 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 112], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 197], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 222], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 1387, max= 3771, per=56.61%, avg=2253.60, stdev=893.71, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1136KiB/s (1163kB/s)(5120KiB/4509msec); 0 zone resets clat (msec): min=96, max=508, avg=309.87, stdev=147.93 lat (msec): min=96, max=508, avg=309.93, stdev=147.94 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1885, max= 4087, per=47.97%, avg=2673.33, stdev=1226.98, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.27%, ctx=580, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179152: Wed Aug 19 23:30:29 2026 read: IOPS=0, BW=398KiB/s (408kB/s)(2048KiB/5144msec) clat (usec): min=1614, max=346552, avg=174083.55, stdev=243907.42 lat (usec): min=1616, max=346554, avg=174085.50, stdev=243908.46 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1614], 10.00th=[ 1614], 20.00th=[ 1614], | 30.00th=[ 1614], 40.00th=[ 1614], 50.00th=[ 1614], 60.00th=[346031], | 70.00th=[346031], 80.00th=[346031], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1380, max= 2043, per=42.99%, avg=1711.50, stdev=468.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1991KiB/s (2038kB/s)(10.0MiB/5144msec); 0 zone resets clat (msec): min=129, max=1963, avg=461.61, stdev=545.61 lat (msec): min=129, max=1963, avg=461.70, stdev=545.60 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 144], | 30.00th=[ 150], 40.00th=[ 234], 50.00th=[ 284], 60.00th=[ 342], | 70.00th=[ 347], 80.00th=[ 493], 90.00th=[ 535], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 2027, max= 4096, per=57.45%, avg=3201.60, stdev=1072.62, samples=5 iops : min= 1, max= 4, avg= 2.40, stdev= 1.34, samples=5 lat (msec) : 2=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.29%, ctx=230, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179153: Wed Aug 19 23:30:29 2026 read: IOPS=1, BW=1510KiB/s (1547kB/s)(6144KiB/4068msec) clat (usec): min=373, max=271421, avg=78828.10, stdev=123081.90 lat (usec): min=374, max=271422, avg=78829.53, stdev=123081.91 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 375], 10.00th=[ 375], 20.00th=[ 429], | 30.00th=[ 429], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 1844], | 70.00th=[198181], 80.00th=[198181], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 2035, max= 4096, per=82.91%, avg=3300.67, stdev=1108.08, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1510KiB/s (1547kB/s)(6144KiB/4068msec); 0 zone resets clat (msec): min=99, max=2217, avg=578.16, stdev=818.13 lat (msec): min=99, max=2217, avg=578.22, stdev=818.14 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 284], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1885, max= 4047, per=44.93%, avg=2503.75, stdev=1031.49, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.56%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179154: Wed Aug 19 23:30:29 2026 read: IOPS=0, BW=1013KiB/s (1037kB/s)(5120KiB/5054msec) clat (usec): min=491, max=299309, avg=128635.95, stdev=134308.70 lat (usec): min=493, max=299310, avg=128637.18, stdev=134308.17 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 490], | 30.00th=[ 562], 40.00th=[ 562], 50.00th=[113771], 60.00th=[113771], | 70.00th=[229639], 80.00th=[229639], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1418KiB/s (1452kB/s)(7168KiB/5054msec); 0 zone resets clat (msec): min=185, max=2240, avg=593.07, stdev=754.87 lat (msec): min=185, max=2240, avg=593.14, stdev=754.86 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 207], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 236], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 768], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1410, max= 5657, per=66.62%, avg=3712.67, stdev=2146.06, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=50.00%, 500=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.19%, ctx=136, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3981KiB/s (4077kB/s), 398KiB/s-1590KiB/s (408kB/s-1628kB/s), io=20.0MiB (20.0MB), run=4068-5144msec WRITE: bw=5574KiB/s (5708kB/s), 1136KiB/s-1991KiB/s (1163kB/s-2038kB/s), io=28.0MiB (29.4MB), run=4068-5144msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179147: Wed Aug 19 23:30:30 2026 read: IOPS=1, BW=1595KiB/s (1633kB/s)(7168KiB/4495msec) clat (msec): min=65, max=1725, avg=414.65, stdev=590.95 lat (msec): min=65, max=1725, avg=414.65, stdev=590.95 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 83], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 266], 60.00th=[ 313], | 70.00th=[ 313], 80.00th=[ 368], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 2019, max= 6035, per=82.64%, avg=3028.00, stdev=2004.69, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1139KiB/s (1166kB/s)(5120KiB/4495msec); 0 zone resets clat (msec): min=221, max=350, avg=308.53, stdev=52.85 lat (msec): min=221, max=350, avg=308.60, stdev=52.85 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2019, max= 4071, per=52.82%, avg=2709.67, stdev=1178.99, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=25.00%, 250=8.33%, 500=58.33%, 2000=8.33% cpu : usr=0.00%, sys=2.11%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179148: Wed Aug 19 23:30:30 2026 read: IOPS=0, BW=366KiB/s (375kB/s)(2048KiB/5588msec) clat (msec): min=338, max=469, avg=404.03, stdev=93.23 lat (msec): min=338, max=469, avg=404.03, stdev=93.23 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1528, max= 2039, per=48.68%, avg=1783.50, stdev=361.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1832KiB/s (1876kB/s)(10.0MiB/5588msec); 0 zone resets clat (msec): min=79, max=2224, avg=455.08, stdev=631.21 lat (msec): min=79, max=2224, avg=455.15, stdev=631.21 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 132], | 30.00th=[ 186], 40.00th=[ 207], 50.00th=[ 288], 60.00th=[ 305], | 70.00th=[ 309], 80.00th=[ 384], 90.00th=[ 435], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 2011, max= 6131, per=63.26%, avg=3245.40, stdev=1830.63, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.64%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179149: Wed Aug 19 23:30:30 2026 read: IOPS=1, BW=1208KiB/s (1237kB/s)(6144KiB/5086msec) clat (msec): min=58, max=650, avg=209.43, stdev=221.42 lat (msec): min=58, max=650, avg=209.43, stdev=221.42 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 136], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2011, max= 2048, per=55.31%, avg=2026.40, stdev=16.67, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1208KiB/s (1237kB/s)(6144KiB/5086msec); 0 zone resets clat (msec): min=81, max=2219, avg=615.81, stdev=808.20 lat (msec): min=81, max=2219, avg=616.17, stdev=808.04 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 397], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 2011, max= 2786, per=43.29%, avg=2221.00, stdev=377.00, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.11%, ctx=91, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179150: Wed Aug 19 23:30:30 2026 read: IOPS=1, BW=1087KiB/s (1113kB/s)(5120KiB/4709msec) clat (msec): min=51, max=496, avg=208.01, stdev=171.93 lat (msec): min=51, max=496, avg=208.01, stdev=171.93 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 52], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 222], 80.00th=[ 222], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 4023, max= 4047, per=100.00%, avg=4035.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1522KiB/s (1559kB/s)(7168KiB/4709msec); 0 zone resets clat (msec): min=98, max=2179, avg=512.33, stdev=752.21 lat (msec): min=98, max=2179, avg=512.41, stdev=752.20 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 121], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 575], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 1448, max= 4096, per=49.09%, avg=2518.33, stdev=1395.00, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=16.67%, 250=58.33%, 500=8.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.82%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3665KiB/s (3753kB/s), 366KiB/s-1595KiB/s (375kB/s-1633kB/s), io=20.0MiB (20.0MB), run=4495-5588msec WRITE: bw=5131KiB/s (5254kB/s), 1139KiB/s-1832KiB/s (1166kB/s-1876kB/s), io=28.0MiB (29.4MB), run=4495-5588msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179160: Wed Aug 19 23:30:42 2026 read: IOPS=1, BW=4894KiB/s (5011kB/s)(12.0MiB/2511msec) clat (msec): min=409, max=1167, avg=790.39, stdev=379.17 lat (msec): min=409, max=1167, avg=790.39, stdev=379.17 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8062, max= 8175, per=100.00%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.38%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179161: Wed Aug 19 23:30:42 2026 read: IOPS=0, BW=1900KiB/s (1945kB/s)(4096KiB/2156msec) clat (nsec): min=227021k, max=227021k, avg=227020610.00, stdev= 0.00 lat (nsec): min=227023k, max=227023k, avg=227023212.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 6460, max= 6460, per=99.02%, avg=6460.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3800KiB/s (3891kB/s)(8192KiB/2156msec); 0 zone resets clat (msec): min=624, max=1281, avg=952.86, stdev=464.28 lat (msec): min=625, max=1281, avg=953.50, stdev=463.84 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 1284], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8078, max= 8078, per=67.87%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.80%, ctx=57, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179163: Wed Aug 19 23:30:42 2026 write: IOPS=1, BW=4463KiB/s (4571kB/s)(12.0MiB/2753msec); 0 zone resets clat (msec): min=368, max=1205, avg=913.44, stdev=472.48 lat (msec): min=369, max=1205, avg=914.17, stdev=471.70 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8110, max= 8175, per=68.41%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.51%, ctx=117, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179164: Wed Aug 19 23:30:42 2026 write: IOPS=1, BW=5766KiB/s (5905kB/s)(12.0MiB/2131msec); 0 zone resets clat (msec): min=314, max=1218, avg=680.21, stdev=475.95 lat (msec): min=314, max=1222, avg=681.84, stdev=477.72 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 5885, max= 8078, per=58.66%, avg=6981.50, stdev=1550.69, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.77%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6525KiB/s (6681kB/s), 1900KiB/s-4894KiB/s (1945kB/s-5011kB/s), io=16.0MiB (16.8MB), run=2156-2511msec WRITE: bw=11.6MiB/s (12.2MB/s), 3800KiB/s-5766KiB/s (3891kB/s-5905kB/s), io=32.0MiB (33.6MB), run=2131-2753msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179165: Wed Aug 19 23:30:43 2026 read: IOPS=1, BW=6744KiB/s (6906kB/s)(12.0MiB/1822msec) clat (msec): min=549, max=668, avg=606.81, stdev=59.42 lat (msec): min=549, max=668, avg=606.81, stdev=59.42 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 6262, max= 8143, per=100.00%, avg=7202.50, stdev=1330.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=14.33%, ctx=317, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179166: Wed Aug 19 23:30:43 2026 read: IOPS=0, BW=1414KiB/s (1448kB/s)(4096KiB/2897msec) clat (nsec): min=669767k, max=669767k, avg=669766857.00, stdev= 0.00 lat (nsec): min=669768k, max=669768k, avg=669768359.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2828KiB/s (2896kB/s)(8192KiB/2897msec); 0 zone resets clat (msec): min=980, max=1244, avg=1112.64, stdev=186.92 lat (msec): min=980, max=1245, avg=1113.03, stdev=187.07 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 1250], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8159, max= 8159, per=72.61%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.49%, ctx=193, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179167: Wed Aug 19 23:30:43 2026 write: IOPS=1, BW=4214KiB/s (4315kB/s)(12.0MiB/2916msec); 0 zone resets clat (msec): min=288, max=1338, avg=970.97, stdev=591.92 lat (msec): min=288, max=1338, avg=971.40, stdev=592.02 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8143, max= 8143, per=72.47%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.36%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179168: Wed Aug 19 23:30:43 2026 write: IOPS=1, BW=4733KiB/s (4847kB/s)(12.0MiB/2596msec); 0 zone resets clat (msec): min=247, max=1291, avg=864.59, stdev=547.17 lat (msec): min=247, max=1291, avg=864.87, stdev=547.14 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8143, max= 8143, per=72.47%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.62%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5656KiB/s (5791kB/s), 1414KiB/s-6744KiB/s (1448kB/s-6906kB/s), io=16.0MiB (16.8MB), run=1822-2897msec WRITE: bw=10.0MiB/s (11.5MB/s), 2828KiB/s-4733KiB/s (2896kB/s-4847kB/s), io=32.0MiB (33.6MB), run=2596-2916msec