== sanity test 398b: DIO and buffer IO race ============== 22:06:45 (1788833205) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.06864 s, 7.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147237: Mon Sep 7 22:09:12 2026 read: IOPS=11, BW=46.7KiB/s (47.8kB/s)(5992KiB/128349msec) clat (usec): min=32, max=343461, avg=42173.26, stdev=33874.83 lat (usec): min=32, max=343462, avg=42176.72, stdev=33875.35 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 76], 20.00th=[ 17957], | 30.00th=[ 23725], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[160433], 99.50th=[179307], 99.90th=[267387], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 7, max= 119, per=25.41%, avg=46.76, stdev=19.52, samples=250 iops : min= 1, max= 29, avg=11.05, stdev= 4.89, samples=250 write: IOPS=12, BW=49.1KiB/s (50.2kB/s)(6296KiB/128349msec); 0 zone resets clat (usec): min=693, max=1143.1k, avg=41060.59, stdev=49629.30 lat (usec): min=694, max=1143.1k, avg=41066.58, stdev=49626.44 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1139], 10.00th=[ 1254], | 20.00th=[ 3261], 30.00th=[ 8979], 40.00th=[ 18482], | 50.00th=[ 29492], 60.00th=[ 40633], 70.00th=[ 53740], | 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[ 124257], | 99.00th=[ 181404], 99.50th=[ 202376], 99.90th=[ 238027], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 15, max= 125, per=25.57%, avg=49.10, stdev=20.67, samples=250 iops : min= 3, max= 31, avg=11.64, stdev= 5.19, samples=250 lat (usec) : 50=0.85%, 100=4.39%, 250=0.20%, 750=0.03%, 1000=0.46% lat (msec) : 2=7.45%, 4=3.16%, 10=5.53%, 20=10.51%, 50=36.00% lat (msec) : 100=23.76%, 250=7.52%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=4.54%, ctx=6175, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147240: Mon Sep 7 22:09:12 2026 read: IOPS=11, BW=47.0KiB/s (48.2kB/s)(5940KiB/126266msec) clat (usec): min=33, max=343521, avg=40938.72, stdev=32515.62 lat (usec): min=33, max=343521, avg=40939.94, stdev=32515.79 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 82], 20.00th=[ 17695], | 30.00th=[ 23462], 40.00th=[ 28705], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[162530], 99.90th=[308282], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 6, max= 111, per=25.71%, avg=47.30, stdev=20.75, samples=245 iops : min= 1, max= 27, avg=11.19, stdev= 5.20, samples=245 write: IOPS=12, BW=50.3KiB/s (51.5kB/s)(6348KiB/126266msec); 0 zone resets clat (usec): min=663, max=1228.4k, avg=40956.50, stdev=53443.73 lat (usec): min=664, max=1228.4k, avg=40959.19, stdev=53444.00 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1237], | 20.00th=[ 2999], 30.00th=[ 7111], 40.00th=[ 17171], | 50.00th=[ 27919], 60.00th=[ 39584], 70.00th=[ 53216], | 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[ 126354], | 99.00th=[ 189793], 99.50th=[ 233833], 99.90th=[ 413139], | 99.95th=[1233126], 99.99th=[1233126] bw ( KiB/s): min= 7, max= 127, per=26.14%, avg=50.18, stdev=23.36, samples=247 iops : min= 1, max= 31, avg=11.91, stdev= 5.88, samples=247 lat (usec) : 50=0.85%, 100=4.17%, 250=0.13%, 500=0.13%, 750=0.16% lat (usec) : 1000=0.29% lat (msec) : 2=8.24%, 4=3.84%, 10=5.40%, 20=10.29%, 50=35.38% lat (msec) : 100=24.06%, 250=6.77%, 500=0.26%, 2000=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6095, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147243: Mon Sep 7 22:09:12 2026 read: IOPS=11, BW=46.2KiB/s (47.4kB/s)(6028KiB/130342msec) clat (usec): min=32, max=253444, avg=39980.05, stdev=32023.56 lat (usec): min=32, max=253445, avg=39981.58, stdev=32023.45 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 56], 10.00th=[ 70], 20.00th=[ 15926], | 30.00th=[ 21627], 40.00th=[ 27132], 50.00th=[ 33424], 60.00th=[ 40633], | 70.00th=[ 49546], 80.00th=[ 61080], 90.00th=[ 82314], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[173016], 99.90th=[227541], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 182, per=25.16%, avg=46.29, stdev=23.00, samples=253 iops : min= 1, max= 45, avg=10.93, stdev= 5.78, samples=253 write: IOPS=12, BW=48.0KiB/s (49.2kB/s)(6260KiB/130342msec); 0 zone resets clat (usec): min=652, max=1501.8k, avg=44456.47, stdev=57583.72 lat (usec): min=653, max=1501.8k, avg=44460.61, stdev=57584.43 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1139], 10.00th=[ 1221], | 20.00th=[ 3326], 30.00th=[ 9503], 40.00th=[ 21365], | 50.00th=[ 33817], 60.00th=[ 44827], 70.00th=[ 56886], | 80.00th=[ 74974], 90.00th=[ 102237], 95.00th=[ 128451], | 99.00th=[ 191890], 99.50th=[ 225444], 99.90th=[ 341836], | 99.95th=[1501561], 99.99th=[1501561] bw ( KiB/s): min= 7, max= 190, per=24.89%, avg=47.79, stdev=22.53, samples=254 iops : min= 1, max= 47, avg=11.31, stdev= 5.68, samples=254 lat (usec) : 50=0.81%, 100=4.92%, 250=0.23%, 500=0.13%, 750=0.16% lat (usec) : 1000=0.46% lat (msec) : 2=7.52%, 4=3.35%, 10=5.01%, 20=10.19%, 50=34.93% lat (msec) : 100=24.61%, 250=7.49%, 500=0.16%, 2000=0.03% cpu : usr=0.07%, sys=4.52%, ctx=6183, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147244: Mon Sep 7 22:09:12 2026 read: IOPS=11, BW=47.0KiB/s (48.2kB/s)(6052KiB/128655msec) clat (usec): min=32, max=364010, avg=40813.57, stdev=33891.92 lat (usec): min=32, max=364011, avg=40817.41, stdev=33890.08 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 15401], | 30.00th=[ 22938], 40.00th=[ 28181], 50.00th=[ 33817], 60.00th=[ 41681], | 70.00th=[ 51119], 80.00th=[ 63701], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[139461], 99.50th=[193987], 99.90th=[250610], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 119, per=25.75%, avg=47.38, stdev=21.54, samples=249 iops : min= 1, max= 29, avg=11.21, stdev= 5.42, samples=249 write: IOPS=12, BW=48.5KiB/s (49.6kB/s)(6236KiB/128655msec); 0 zone resets clat (usec): min=688, max=1213.2k, avg=42517.08, stdev=53276.32 lat (usec): min=689, max=1213.2k, avg=42518.50, stdev=53276.38 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1254], | 20.00th=[ 3654], 30.00th=[ 9634], 40.00th=[ 19006], | 50.00th=[ 30802], 60.00th=[ 42206], 70.00th=[ 55313], | 80.00th=[ 70779], 90.00th=[ 98042], 95.00th=[ 123208], | 99.00th=[ 200279], 99.50th=[ 250610], 99.90th=[ 379585], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 127, per=25.27%, avg=48.51, stdev=20.35, samples=250 iops : min= 1, max= 31, avg=11.50, stdev= 5.09, samples=250 lat (usec) : 50=1.20%, 100=5.31%, 250=0.26%, 500=0.16%, 750=0.13% lat (usec) : 1000=0.03% lat (msec) : 2=7.91%, 4=2.73%, 10=5.21%, 20=10.77%, 50=33.92% lat (msec) : 100=24.97%, 250=7.10%, 500=0.26%, 2000=0.03% cpu : usr=0.08%, sys=4.57%, ctx=6113, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=184KiB/s (189kB/s), 46.2KiB/s-47.0KiB/s (47.4kB/s-48.2kB/s), io=23.4MiB (24.6MB), run=126266-130342msec WRITE: bw=193KiB/s (198kB/s), 48.0KiB/s-50.3KiB/s (49.2kB/s-51.5kB/s), io=24.6MiB (25.7MB), run=126266-130342msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147238: Mon Sep 7 22:11:16 2026 read: IOPS=5, BW=23.7KiB/s (24.3kB/s)(5992KiB/252552msec) clat (msec): min=5, max=1134, avg=33.29, stdev=49.12 lat (msec): min=5, max=1134, avg=33.29, stdev=49.12 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 43], 90.00th=[ 77], 95.00th=[ 109], | 99.00th=[ 203], 99.50th=[ 243], 99.90th=[ 472], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 111, per=28.75%, avg=27.02, stdev=18.75, samples=429 iops : min= 1, max= 27, avg= 6.13, stdev= 4.74, samples=429 write: IOPS=6, BW=24.9KiB/s (25.5kB/s)(6296KiB/252552msec); 0 zone resets clat (msec): min=32, max=512, avg=128.41, stdev=68.42 lat (msec): min=32, max=512, avg=128.41, stdev=68.42 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 123], | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 222], 95.00th=[ 268], | 99.00th=[ 368], 99.50th=[ 409], 99.90th=[ 485], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 7, max= 63, per=25.33%, avg=24.83, stdev=12.36, samples=489 iops : min= 1, max= 15, avg= 5.57, stdev= 3.15, samples=489 lat (msec) : 10=7.16%, 20=18.95%, 50=15.76%, 100=25.78%, 250=28.97% lat (msec) : 500=3.32%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=4996, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147239: Mon Sep 7 22:11:16 2026 read: IOPS=5, BW=23.4KiB/s (23.0kB/s)(5940KiB/253679msec) clat (msec): min=4, max=1284, avg=33.88, stdev=50.40 lat (msec): min=4, max=1284, avg=33.89, stdev=50.40 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 77], 95.00th=[ 106], | 99.00th=[ 180], 99.50th=[ 271], 99.90th=[ 451], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 95, per=28.69%, avg=26.96, stdev=17.90, samples=427 iops : min= 1, max= 23, avg= 6.12, stdev= 4.52, samples=427 write: IOPS=6, BW=25.0KiB/s (25.6kB/s)(6348KiB/253679msec); 0 zone resets clat (msec): min=34, max=484, avg=127.82, stdev=66.61 lat (msec): min=34, max=484, avg=127.83, stdev=66.61 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 88], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 124], | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 220], 95.00th=[ 268], | 99.00th=[ 355], 99.50th=[ 397], 99.90th=[ 460], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 7, max= 62, per=25.44%, avg=24.93, stdev=11.90, samples=492 iops : min= 1, max= 15, avg= 5.60, stdev= 3.04, samples=492 lat (msec) : 10=5.99%, 20=19.47%, 50=15.27%, 100=26.76%, 250=28.87% lat (msec) : 500=3.61%, 2000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=4991, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147241: Mon Sep 7 22:11:16 2026 read: IOPS=5, BW=23.7KiB/s (24.2kB/s)(6028KiB/254545msec) clat (msec): min=4, max=478, avg=34.64, stdev=40.39 lat (msec): min=4, max=478, avg=34.64, stdev=40.39 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 48], 90.00th=[ 81], 95.00th=[ 113], | 99.00th=[ 205], 99.50th=[ 259], 99.90th=[ 326], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 135, per=27.60%, avg=25.95, stdev=18.56, samples=448 iops : min= 1, max= 33, avg= 5.85, stdev= 4.69, samples=448 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6260KiB/254545msec); 0 zone resets clat (msec): min=34, max=1492, avg=128.97, stdev=76.94 lat (msec): min=34, max=1492, avg=128.97, stdev=76.94 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 123], | 70.00th=[ 142], 80.00th=[ 171], 90.00th=[ 226], 95.00th=[ 266], | 99.00th=[ 372], 99.50th=[ 430], 99.90th=[ 485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 7, max= 63, per=25.06%, avg=24.56, stdev=12.48, samples=490 iops : min= 1, max= 15, avg= 5.51, stdev= 3.18, samples=490 lat (msec) : 10=6.28%, 20=18.46%, 50=16.37%, 100=26.24%, 250=28.87% lat (msec) : 500=3.74%, 2000=0.03% cpu : usr=0.05%, sys=1.03%, ctx=4838, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147242: Mon Sep 7 22:11:16 2026 read: IOPS=5, BW=23.8KiB/s (24.4kB/s)(6052KiB/254130msec) clat (msec): min=4, max=399, avg=33.43, stdev=39.72 lat (msec): min=4, max=399, avg=33.43, stdev=39.72 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 31], 80.00th=[ 46], 90.00th=[ 79], 95.00th=[ 105], | 99.00th=[ 199], 99.50th=[ 279], 99.90th=[ 384], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 7, max= 103, per=29.02%, avg=27.28, stdev=18.60, samples=430 iops : min= 1, max= 25, avg= 6.20, stdev= 4.69, samples=430 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6236KiB/254130msec); 0 zone resets clat (msec): min=28, max=1535, avg=130.17, stdev=78.75 lat (msec): min=28, max=1535, avg=130.17, stdev=78.75 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 124], | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 228], 95.00th=[ 284], | 99.00th=[ 372], 99.50th=[ 422], 99.90th=[ 535], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7, max= 55, per=24.97%, avg=24.47, stdev=12.14, samples=492 iops : min= 1, max= 13, avg= 5.49, stdev= 3.10, samples=492 lat (msec) : 10=6.45%, 20=19.47%, 50=15.59%, 100=26.79%, 250=27.73% lat (msec) : 500=3.87%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.05%, ctx=5124, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=94.3KiB/s (96.6kB/s), 23.4KiB/s-23.8KiB/s (23.0kB/s-24.4kB/s), io=23.4MiB (24.6MB), run=252552-254545msec WRITE: bw=98.8KiB/s (101kB/s), 24.5KiB/s-25.0KiB/s (25.1kB/s-25.6kB/s), io=24.6MiB (25.7MB), run=252552-254545msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147307: Mon Sep 7 22:11:53 2026 read: IOPS=14, BW=233KiB/s (238kB/s)(5920KiB/25448msec) clat (usec): min=39, max=205445, avg=35916.66, stdev=28944.52 lat (usec): min=39, max=205446, avg=35918.84, stdev=28944.29 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 174], | 30.00th=[ 21890], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 56886], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[135267], 99.50th=[183501], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 63, max= 447, per=25.45%, avg=232.38, stdev=80.25, samples=50 iops : min= 3, max= 27, avg=13.74, stdev= 5.05, samples=50 write: IOPS=15, BW=250KiB/s (256kB/s)(6368KiB/25448msec); 0 zone resets clat (usec): min=1058, max=280546, avg=30271.16, stdev=34134.33 lat (usec): min=1059, max=280548, avg=30288.52, stdev=34134.91 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1631], 10.00th=[ 2212], 20.00th=[ 3949], | 30.00th=[ 6980], 40.00th=[ 11469], 50.00th=[ 18744], 60.00th=[ 27919], | 70.00th=[ 38536], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[200279], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 31, max= 477, per=26.09%, avg=250.76, stdev=104.05, samples=50 iops : min= 1, max= 29, avg=14.90, stdev= 6.59, samples=50 lat (usec) : 50=0.91%, 100=8.59%, 250=0.26%, 500=0.26%, 1000=0.26% lat (msec) : 2=5.08%, 4=5.86%, 10=8.85%, 20=10.29%, 50=34.90% lat (msec) : 100=21.74%, 250=2.86%, 500=0.13% cpu : usr=0.07%, sys=5.41%, ctx=1374, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147308: Mon Sep 7 22:11:53 2026 read: IOPS=13, BW=220KiB/s (225kB/s)(5744KiB/26100msec) clat (usec): min=38, max=178658, avg=34837.75, stdev=29621.87 lat (usec): min=39, max=178659, avg=34841.29, stdev=29621.71 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 53], 10.00th=[ 62], 20.00th=[ 109], | 30.00th=[ 20841], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 69731], 95.00th=[ 90702], | 99.00th=[130548], 99.50th=[166724], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 29, max= 414, per=24.44%, avg=223.14, stdev=97.74, samples=50 iops : min= 1, max= 25, avg=13.14, stdev= 6.19, samples=50 write: IOPS=15, BW=251KiB/s (257kB/s)(6544KiB/26100msec); 0 zone resets clat (usec): min=1077, max=242023, avg=31935.70, stdev=38974.11 lat (usec): min=1078, max=242026, avg=31937.65, stdev=38974.03 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1663], 10.00th=[ 2180], 20.00th=[ 3458], | 30.00th=[ 6063], 40.00th=[ 9634], 50.00th=[ 17695], 60.00th=[ 27395], | 70.00th=[ 37487], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[200279], 99.50th=[231736], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 29, max= 634, per=25.93%, avg=249.16, stdev=107.78, samples=51 iops : min= 1, max= 39, avg=14.80, stdev= 6.80, samples=51 lat (usec) : 50=2.08%, 100=7.16%, 250=0.91%, 750=0.13% lat (msec) : 2=4.82%, 4=7.81%, 10=10.29%, 20=7.55%, 50=35.42% lat (msec) : 100=19.92%, 250=3.91% cpu : usr=0.07%, sys=5.58%, ctx=1315, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147309: Mon Sep 7 22:11:53 2026 read: IOPS=14, BW=239KiB/s (244kB/s)(6256KiB/26209msec) clat (usec): min=36, max=234160, avg=36972.10, stdev=33381.49 lat (usec): min=36, max=234161, avg=36977.04, stdev=33378.94 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 80], | 30.00th=[ 20579], 40.00th=[ 27657], 50.00th=[ 33424], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 58459], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[158335], 99.50th=[212861], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 57, max= 415, per=25.93%, avg=236.76, stdev=81.04, samples=51 iops : min= 3, max= 25, avg=14.02, stdev= 5.09, samples=51 write: IOPS=14, BW=230KiB/s (236kB/s)(6032KiB/26209msec); 0 zone resets clat (usec): min=1157, max=200123, avg=30553.72, stdev=32990.61 lat (usec): min=1159, max=200125, avg=30555.75, stdev=32990.65 clat percentiles (usec): | 1.00th=[ 1385], 5.00th=[ 1713], 10.00th=[ 2114], 20.00th=[ 4359], | 30.00th=[ 7046], 40.00th=[ 10945], 50.00th=[ 18744], 60.00th=[ 29754], | 70.00th=[ 40109], 80.00th=[ 51643], 90.00th=[ 72877], 95.00th=[102237], | 99.00th=[143655], 99.50th=[177210], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 504, per=23.33%, avg=224.24, stdev=94.12, samples=51 iops : min= 1, max= 31, avg=13.24, stdev= 5.93, samples=51 lat (usec) : 50=1.56%, 100=9.90%, 250=0.39%, 500=0.13%, 1000=0.13% lat (msec) : 2=4.43%, 4=4.17%, 10=10.03%, 20=9.24%, 50=35.16% lat (msec) : 100=20.57%, 250=4.30% cpu : usr=0.06%, sys=5.13%, ctx=1415, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147310: Mon Sep 7 22:11:53 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24506msec) clat (usec): min=28, max=165487, avg=34779.07, stdev=27669.81 lat (usec): min=28, max=165488, avg=34780.13, stdev=27669.81 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 97], | 30.00th=[ 20841], 40.00th=[ 27395], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 46400], 80.00th=[ 55837], 90.00th=[ 66323], 95.00th=[ 80217], | 99.00th=[123208], 99.50th=[158335], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 29, max= 540, per=26.70%, avg=243.79, stdev=94.94, samples=48 iops : min= 1, max= 33, avg=14.46, stdev= 6.01, samples=48 write: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24506msec); 0 zone resets clat (usec): min=1191, max=202776, avg=28364.70, stdev=32578.94 lat (usec): min=1193, max=202778, avg=28366.61, stdev=32578.98 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1663], 10.00th=[ 1958], 20.00th=[ 3687], | 30.00th=[ 5407], 40.00th=[ 8094], 50.00th=[ 15401], 60.00th=[ 24249], | 70.00th=[ 36963], 80.00th=[ 51119], 90.00th=[ 66847], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[191890], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 95, max= 505, per=26.46%, avg=254.29, stdev=106.82, samples=48 iops : min= 5, max= 31, avg=15.12, stdev= 6.74, samples=48 lat (usec) : 50=1.30%, 100=8.72%, 250=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=5.73%, 4=6.25%, 10=10.81%, 20=8.85%, 50=33.72% lat (msec) : 100=20.70%, 250=3.12% cpu : usr=0.10%, sys=5.59%, ctx=1347, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=914KiB/s (936kB/s), 220KiB/s-246KiB/s (225kB/s-252kB/s), io=23.4MiB (24.5MB), run=24506-26209msec WRITE: bw=962KiB/s (985kB/s), 230KiB/s-255KiB/s (236kB/s-261kB/s), io=24.6MiB (25.8MB), run=24506-26209msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147303: Mon Sep 7 22:12:27 2026 read: IOPS=6, BW=98.4KiB/s (101kB/s)(5920KiB/60176msec) clat (msec): min=5, max=286, avg=33.45, stdev=39.15 lat (msec): min=5, max=286, avg=33.45, stdev=39.15 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 68], 95.00th=[ 105], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 319, per=26.98%, avg=107.40, stdev=70.10, samples=108 iops : min= 1, max= 19, avg= 5.91, stdev= 4.40, samples=108 write: IOPS=6, BW=106KiB/s (108kB/s)(6368KiB/60176msec); 0 zone resets clat (msec): min=28, max=352, avg=119.54, stdev=54.21 lat (msec): min=28, max=352, avg=119.54, stdev=54.21 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 120], | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 192], 95.00th=[ 228], | 99.00th=[ 326], 99.50th=[ 338], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 21, max= 222, per=25.50%, avg=106.60, stdev=46.82, samples=117 iops : min= 1, max= 13, avg= 5.85, stdev= 3.01, samples=117 lat (msec) : 10=3.91%, 20=18.10%, 50=19.92%, 100=27.21%, 250=29.43% lat (msec) : 500=1.43% cpu : usr=0.03%, sys=1.23%, ctx=1169, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147304: Mon Sep 7 22:12:27 2026 read: IOPS=5, BW=95.5KiB/s (97.7kB/s)(5744KiB/60174msec) clat (msec): min=5, max=253, avg=33.40, stdev=37.04 lat (msec): min=5, max=253, avg=33.41, stdev=37.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 104], | 99.00th=[ 222], 99.50th=[ 249], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 21, max= 318, per=28.69%, avg=114.20, stdev=69.72, samples=98 iops : min= 1, max= 19, avg= 6.36, stdev= 4.42, samples=98 write: IOPS=6, BW=109KiB/s (111kB/s)(6544KiB/60174msec); 0 zone resets clat (msec): min=33, max=384, avg=117.58, stdev=58.71 lat (msec): min=33, max=384, avg=117.58, stdev=58.71 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 57], 10.00th=[ 64], 20.00th=[ 73], | 30.00th=[ 83], 40.00th=[ 91], 50.00th=[ 103], 60.00th=[ 113], | 70.00th=[ 130], 80.00th=[ 150], 90.00th=[ 197], 95.00th=[ 239], | 99.00th=[ 317], 99.50th=[ 355], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 21, max= 223, per=26.16%, avg=109.33, stdev=49.02, samples=117 iops : min= 1, max= 13, avg= 6.03, stdev= 3.12, samples=117 lat (msec) : 10=4.43%, 20=17.71%, 50=17.58%, 100=30.47%, 250=27.47% lat (msec) : 500=2.34% cpu : usr=0.04%, sys=1.16%, ctx=1267, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147305: Mon Sep 7 22:12:27 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(6256KiB/58704msec) clat (msec): min=6, max=207, avg=31.18, stdev=34.35 lat (msec): min=6, max=207, avg=31.18, stdev=34.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 40], 90.00th=[ 64], 95.00th=[ 111], | 99.00th=[ 194], 99.50th=[ 203], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 30, max= 448, per=29.85%, avg=118.81, stdev=81.81, samples=104 iops : min= 1, max= 28, avg= 6.63, stdev= 5.18, samples=104 write: IOPS=6, BW=103KiB/s (105kB/s)(6032KiB/58704msec); 0 zone resets clat (msec): min=33, max=456, avg=122.00, stdev=64.29 lat (msec): min=33, max=456, avg=122.00, stdev=64.29 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 54], 10.00th=[ 64], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 94], 50.00th=[ 102], 60.00th=[ 114], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 213], 95.00th=[ 251], | 99.00th=[ 368], 99.50th=[ 384], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 30, max= 222, per=25.18%, avg=105.24, stdev=47.99, samples=112 iops : min= 1, max= 13, avg= 5.77, stdev= 3.09, samples=112 lat (msec) : 10=5.08%, 20=21.48%, 50=19.01%, 100=26.30%, 250=25.39% lat (msec) : 500=2.73% cpu : usr=0.04%, sys=1.19%, ctx=1335, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147306: Mon Sep 7 22:12:27 2026 read: IOPS=6, BW=101KiB/s (103kB/s)(6032KiB/59909msec) clat (msec): min=6, max=273, avg=33.59, stdev=39.49 lat (msec): min=6, max=273, avg=33.59, stdev=39.49 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 41], 90.00th=[ 82], 95.00th=[ 124], | 99.00th=[ 215], 99.50th=[ 249], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 314, per=27.94%, avg=111.22, stdev=72.16, samples=106 iops : min= 1, max= 19, avg= 6.15, stdev= 4.59, samples=106 write: IOPS=6, BW=104KiB/s (107kB/s)(6256KiB/59909msec); 0 zone resets clat (msec): min=41, max=466, avg=119.78, stdev=59.22 lat (msec): min=41, max=466, avg=119.79, stdev=59.22 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 117], | 70.00th=[ 136], 80.00th=[ 163], 90.00th=[ 199], 95.00th=[ 232], | 99.00th=[ 317], 99.50th=[ 393], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 21, max= 224, per=25.17%, avg=105.20, stdev=50.32, samples=117 iops : min= 1, max= 14, avg= 5.77, stdev= 3.23, samples=117 lat (msec) : 10=5.21%, 20=20.83%, 50=16.28%, 100=26.95%, 250=28.91% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.26%, ctx=1286, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=398KiB/s (408kB/s), 95.5KiB/s-107KiB/s (97.7kB/s-109kB/s), io=23.4MiB (24.5MB), run=58704-60176msec WRITE: bw=419KiB/s (429kB/s), 103KiB/s-109KiB/s (105kB/s-111kB/s), io=24.6MiB (25.8MB), run=58704-60176msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147331: Mon Sep 7 22:12:43 2026 read: IOPS=2, BW=2084KiB/s (2134kB/s)(7168KiB/3440msec) clat (usec): min=505, max=204310, avg=83306.56, stdev=98075.57 lat (usec): min=506, max=204312, avg=83307.93, stdev=98075.80 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 529], | 30.00th=[ 2089], 40.00th=[ 2089], 50.00th=[ 17433], 60.00th=[175113], | 70.00th=[175113], 80.00th=[183501], 90.00th=[204473], 95.00th=[204473], | 99.00th=[204473], 99.50th=[204473], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 1651, max= 4096, per=72.25%, avg=2897.25, stdev=1335.42, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=1, BW=1488KiB/s (1524kB/s)(5120KiB/3440msec); 0 zone resets clat (msec): min=67, max=1445, avg=489.31, stdev=553.18 lat (msec): min=67, max=1445, avg=489.59, stdev=553.13 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 3670, max= 4007, per=68.37%, avg=3838.50, stdev=238.29, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 20=8.33%, 100=8.33%, 250=33.33%, 500=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=8.20%, ctx=168, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147332: Mon Sep 7 22:12:43 2026 read: IOPS=0, BW=401KiB/s (411kB/s)(2048KiB/5107msec) clat (msec): min=105, max=1701, avg=903.39, stdev=1128.07 lat (msec): min=105, max=1701, avg=903.39, stdev=1128.07 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 1703], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 1835, max= 2015, per=48.00%, avg=1925.00, stdev=127.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2005KiB/s (2053kB/s)(10.0MiB/5107msec); 0 zone resets clat (msec): min=72, max=759, avg=316.74, stdev=248.37 lat (msec): min=72, max=759, avg=316.84, stdev=248.37 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 100], | 30.00th=[ 136], 40.00th=[ 178], 50.00th=[ 203], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 567], 90.00th=[ 659], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2003, max= 4031, per=49.04%, avg=2753.20, stdev=1009.87, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=16.67%, 250=50.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=9.38%, ctx=309, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147333: Mon Sep 7 22:12:43 2026 read: IOPS=1, BW=1559KiB/s (1596kB/s)(6144KiB/3942msec) clat (usec): min=457, max=292913, avg=201039.26, stdev=115133.14 lat (usec): min=458, max=292915, avg=201040.41, stdev=115133.34 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[160433], | 30.00th=[160433], 40.00th=[175113], 50.00th=[175113], 60.00th=[287310], | 70.00th=[291505], 80.00th=[291505], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 1835, max= 4031, per=82.07%, avg=3291.00, stdev=1260.99, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1559KiB/s (1596kB/s)(6144KiB/3942msec); 0 zone resets clat (msec): min=93, max=659, avg=382.19, stdev=206.50 lat (msec): min=93, max=659, avg=382.30, stdev=206.47 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 405], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1835, max= 4096, per=42.71%, avg=2397.60, stdev=952.86, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=12.66%, ctx=237, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147334: Mon Sep 7 22:12:43 2026 read: IOPS=0, BW=1023KiB/s (1048kB/s)(5120KiB/5003msec) clat (usec): min=398, max=298902, avg=159243.04, stdev=145339.04 lat (usec): min=399, max=298904, avg=159244.44, stdev=145339.13 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 400], | 30.00th=[ 3392], 40.00th=[ 3392], 50.00th=[238027], 60.00th=[238027], | 70.00th=[254804], 80.00th=[254804], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1835, max= 6119, per=99.18%, avg=3977.00, stdev=3029.25, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1433KiB/s (1467kB/s)(7168KiB/5003msec); 0 zone resets clat (msec): min=169, max=1387, avg=552.99, stdev=431.39 lat (msec): min=169, max=1387, avg=553.06, stdev=431.40 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 194], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 439], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 743], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1659, max= 4055, per=40.43%, avg=2269.67, stdev=886.86, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 500=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=7.52%, ctx=133, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4010KiB/s (4106kB/s), 401KiB/s-2084KiB/s (411kB/s-2134kB/s), io=20.0MiB (20.0MB), run=3440-5107msec WRITE: bw=5614KiB/s (5749kB/s), 1433KiB/s-2005KiB/s (1467kB/s-2053kB/s), io=28.0MiB (29.4MB), run=3440-5107msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147327: Mon Sep 7 22:12:44 2026 read: IOPS=1, BW=1212KiB/s (1242kB/s)(7168KiB/5912msec) clat (msec): min=61, max=413, avg=207.83, stdev=124.26 lat (msec): min=61, max=413, avg=207.84, stdev=124.26 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 123], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 178], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 338], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1514, max= 4096, per=84.27%, avg=2919.25, stdev=1358.72, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=866KiB/s (887kB/s)(5120KiB/5912msec); 0 zone resets clat (msec): min=227, max=1461, avg=848.63, stdev=465.25 lat (msec): min=227, max=1461, avg=849.04, stdev=465.13 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1980, max= 3992, per=51.74%, avg=2508.75, stdev=989.22, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=2.23%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147328: Mon Sep 7 22:12:44 2026 read: IOPS=0, BW=374KiB/s (383kB/s)(2048KiB/5473msec) clat (msec): min=85, max=1580, avg=832.74, stdev=1057.42 lat (msec): min=85, max=1580, avg=832.74, stdev=1057.42 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 86], 50.00th=[ 86], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 2035, max= 2039, per=58.80%, avg=2037.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1871KiB/s (1916kB/s)(10.0MiB/5473msec); 0 zone resets clat (msec): min=140, max=536, avg=344.64, stdev=146.19 lat (msec): min=140, max=536, avg=344.72, stdev=146.19 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 184], | 30.00th=[ 192], 40.00th=[ 305], 50.00th=[ 309], 60.00th=[ 330], | 70.00th=[ 443], 80.00th=[ 481], 90.00th=[ 527], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1980, max= 4096, per=55.82%, avg=2706.83, stdev=1076.21, samples=6 iops : min= 1, max= 4, avg= 2.00, stdev= 1.55, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.04%, sys=3.40%, ctx=87, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147329: Mon Sep 7 22:12:44 2026 read: IOPS=1, BW=1221KiB/s (1251kB/s)(6144KiB/5030msec) clat (msec): min=81, max=997, avg=391.00, stdev=323.15 lat (msec): min=81, max=997, avg=391.00, stdev=323.15 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 397], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2015, max= 2048, per=58.78%, avg=2036.00, stdev=12.69, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1221KiB/s (1251kB/s)(6144KiB/5030msec); 0 zone resets clat (msec): min=241, max=529, avg=366.65, stdev=119.96 lat (msec): min=241, max=529, avg=366.73, stdev=119.95 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 355], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1980, max= 4071, per=52.29%, avg=2535.50, stdev=1024.13, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=2.62%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147330: Mon Sep 7 22:12:44 2026 read: IOPS=1, BW=1097KiB/s (1124kB/s)(5120KiB/4666msec) clat (msec): min=115, max=221, avg=176.65, stdev=39.23 lat (msec): min=115, max=221, avg=176.65, stdev=39.23 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 222], 95.00th=[ 222], | 99.00th=[ 222], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 1980, max= 4096, per=77.86%, avg=2697.00, stdev=1211.70, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1536KiB/s (1573kB/s)(7168KiB/4666msec); 0 zone resets clat (msec): min=188, max=1702, avg=535.43, stdev=547.26 lat (msec): min=188, max=1702, avg=535.53, stdev=547.26 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 213], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 275], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 718], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 2015, max= 3961, per=62.60%, avg=3035.67, stdev=976.50, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=66.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.04%, sys=2.59%, ctx=48, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3464KiB/s (3547kB/s), 374KiB/s-1221KiB/s (383kB/s-1251kB/s), io=20.0MiB (20.0MB), run=4666-5912msec WRITE: bw=4850KiB/s (4966kB/s), 866KiB/s-1871KiB/s (887kB/s-1916kB/s), io=28.0MiB (29.4MB), run=4666-5912msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147342: Mon Sep 7 22:13:01 2026 read: IOPS=1, BW=4892KiB/s (5009kB/s)(12.0MiB/2512msec) clat (msec): min=401, max=1520, avg=787.41, stdev=635.28 lat (msec): min=401, max=1520, avg=787.41, stdev=635.28 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min=16318, max=16318, per=100.00%, avg=16318.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.70%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147343: Mon Sep 7 22:13:01 2026 read: IOPS=0, BW=1013KiB/s (1037kB/s)(4096KiB/4045msec) clat (nsec): min=986409k, max=986409k, avg=986408879.00, stdev= 0.00 lat (nsec): min=986412k, max=986412k, avg=986411587.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2025KiB/s (2074kB/s)(8192KiB/4045msec); 0 zone resets clat (msec): min=728, max=2060, avg=1394.35, stdev=941.67 lat (msec): min=728, max=2060, avg=1394.70, stdev=941.76 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 2056], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.67%, ctx=54, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147344: Mon Sep 7 22:13:01 2026 write: IOPS=0, BW=2949KiB/s (3020kB/s)(12.0MiB/4167msec); 0 zone resets clat (msec): min=337, max=2509, avg=1367.06, stdev=1090.38 lat (msec): min=338, max=2510, avg=1367.66, stdev=1090.77 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.62%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147346: Mon Sep 7 22:13:01 2026 write: IOPS=0, BW=3821KiB/s (3913kB/s)(12.0MiB/3216msec); 0 zone resets clat (msec): min=722, max=1317, avg=1014.40, stdev=297.96 lat (msec): min=724, max=1318, avg=1015.38, stdev=297.11 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8015, max= 8159, per=100.00%, avg=8087.00, stdev=101.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.83%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4050KiB/s (4148kB/s), 1013KiB/s-4892KiB/s (1037kB/s-5009kB/s), io=16.0MiB (16.8MB), run=2512-4045msec WRITE: bw=7864KiB/s (8052kB/s), 2025KiB/s-3821KiB/s (2074kB/s-3913kB/s), io=32.0MiB (33.6MB), run=3216-4167msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147345: Mon Sep 7 22:13:01 2026 read: IOPS=1, BW=4288KiB/s (4390kB/s)(12.0MiB/2866msec) clat (msec): min=780, max=1095, avg=926.22, stdev=158.65 lat (msec): min=780, max=1095, avg=926.22, stdev=158.65 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7585, max= 8047, per=100.00%, avg=7816.00, stdev=326.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=11.69%, ctx=330, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147347: Mon Sep 7 22:13:01 2026 read: IOPS=0, BW=948KiB/s (971kB/s)(4096KiB/4319msec) clat (nsec): min=833140k, max=833140k, avg=833140444.00, stdev= 0.00 lat (nsec): min=833143k, max=833143k, avg=833142813.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1897KiB/s (1942kB/s)(8192KiB/4319msec); 0 zone resets clat (msec): min=774, max=2473, avg=1623.94, stdev=1201.14 lat (msec): min=774, max=2473, avg=1624.22, stdev=1201.01 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 2467], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.02%, sys=4.59%, ctx=156, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147348: Mon Sep 7 22:13:01 2026 write: IOPS=0, BW=3246KiB/s (3324kB/s)(12.0MiB/3786msec); 0 zone resets clat (msec): min=504, max=1782, avg=1147.99, stdev=639.36 lat (msec): min=504, max=1783, avg=1148.36, stdev=639.45 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.08%, sys=4.36%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147349: Mon Sep 7 22:13:01 2026 write: IOPS=0, BW=3708KiB/s (3797kB/s)(12.0MiB/3314msec); 0 zone resets clat (msec): min=498, max=1471, avg=1067.00, stdev=507.08 lat (msec): min=499, max=1472, avg=1067.85, stdev=506.30 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.17%, ctx=41, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3793KiB/s (3885kB/s), 948KiB/s-4288KiB/s (971kB/s-4390kB/s), io=16.0MiB (16.8MB), run=2866-4319msec WRITE: bw=7587KiB/s (7769kB/s), 1897KiB/s-3708KiB/s (1942kB/s-3797kB/s), io=32.0MiB (33.6MB), run=3314-4319msec