== sanity test 398b: DIO and buffer IO race ============== 06:18:09 (1789985889) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.02649 s, 12.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158382: Mon Sep 21 06:20:24 2026 read: IOPS=12, BW=51.0KiB/s (52.3kB/s)(5992KiB/117414msec) clat (usec): min=28, max=484347, avg=37248.01, stdev=35923.97 lat (usec): min=28, max=484348, avg=37249.30, stdev=35923.90 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 7963], 20.00th=[ 14877], | 30.00th=[ 19792], 40.00th=[ 23725], 50.00th=[ 29492], 60.00th=[ 35390], | 70.00th=[ 43254], 80.00th=[ 54264], 90.00th=[ 74974], 95.00th=[ 92799], | 99.00th=[139461], 99.50th=[177210], 99.90th=[455082], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 4, max= 168, per=25.56%, avg=51.37, stdev=26.24, samples=227 iops : min= 1, max= 42, avg=12.21, stdev= 6.61, samples=227 write: IOPS=13, BW=53.6KiB/s (54.9kB/s)(6296KiB/117414msec); 0 zone resets clat (usec): min=712, max=1656.3k, avg=38807.10, stdev=61026.42 lat (usec): min=713, max=1656.3k, avg=38809.12, stdev=61026.08 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1156], 10.00th=[ 1483], | 20.00th=[ 3490], 30.00th=[ 8094], 40.00th=[ 17171], | 50.00th=[ 26608], 60.00th=[ 35390], 70.00th=[ 45876], | 80.00th=[ 61080], 90.00th=[ 88605], 95.00th=[ 115868], | 99.00th=[ 206570], 99.50th=[ 263193], 99.90th=[ 574620], | 99.95th=[1652556], 99.99th=[1652556] bw ( KiB/s): min= 2, max= 188, per=25.74%, avg=54.06, stdev=28.80, samples=227 iops : min= 0, max= 47, avg=12.89, stdev= 7.25, samples=227 lat (usec) : 50=0.75%, 100=3.12%, 250=0.29%, 500=0.16%, 750=0.10% lat (usec) : 1000=0.59% lat (msec) : 2=6.32%, 4=4.20%, 10=6.77%, 20=14.88%, 50=37.60% lat (msec) : 100=19.69%, 250=5.05%, 500=0.42%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=4.98%, ctx=6555, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158383: Mon Sep 21 06:20:24 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(5940KiB/119374msec) clat (usec): min=20, max=1701.1k, avg=39317.65, stdev=57950.75 lat (usec): min=21, max=1701.1k, avg=39318.71, stdev=57950.77 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 62], 10.00th=[ 9372], | 20.00th=[ 15533], 30.00th=[ 19792], 40.00th=[ 23725], | 50.00th=[ 29754], 60.00th=[ 35914], 70.00th=[ 43254], | 80.00th=[ 53216], 90.00th=[ 76022], 95.00th=[ 101188], | 99.00th=[ 179307], 99.50th=[ 227541], 99.90th=[ 692061], | 99.95th=[1702888], 99.99th=[1702888] bw ( KiB/s): min= 2, max= 119, per=24.98%, avg=50.22, stdev=24.28, samples=230 iops : min= 0, max= 29, avg=11.92, stdev= 6.12, samples=230 write: IOPS=13, BW=53.2KiB/s (54.5kB/s)(6348KiB/119374msec); 0 zone resets clat (usec): min=566, max=516576, avg=38103.90, stdev=44673.01 lat (usec): min=566, max=516577, avg=38105.60, stdev=44673.19 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 1156], 10.00th=[ 1549], 20.00th=[ 3752], | 30.00th=[ 8979], 40.00th=[ 18482], 50.00th=[ 27132], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[206570], 99.50th=[274727], 99.90th=[450888], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 191, per=25.51%, avg=53.57, stdev=28.14, samples=230 iops : min= 1, max= 47, avg=12.76, stdev= 7.08, samples=230 lat (usec) : 50=0.88%, 100=2.64%, 250=0.33%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.55% lat (msec) : 2=6.02%, 4=4.13%, 10=6.15%, 20=15.56%, 50=38.15% lat (msec) : 100=19.08%, 250=5.79%, 500=0.39%, 750=0.07%, 2000=0.03% cpu : usr=0.06%, sys=5.28%, ctx=6687, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158384: Mon Sep 21 06:20:24 2026 read: IOPS=13, BW=52.4KiB/s (53.7kB/s)(6028KiB/115027msec) clat (usec): min=33, max=564492, avg=37398.66, stdev=37238.23 lat (usec): min=33, max=564492, avg=37405.34, stdev=37237.92 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 338], 20.00th=[ 14746], | 30.00th=[ 19268], 40.00th=[ 23725], 50.00th=[ 28705], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[158335], 99.50th=[191890], 99.90th=[492831], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 6, max= 156, per=26.38%, avg=53.02, stdev=25.11, samples=221 iops : min= 1, max= 39, avg=12.63, stdev= 6.33, samples=221 write: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6260KiB/115027msec); 0 zone resets clat (usec): min=766, max=1673.3k, avg=37162.92, stdev=59332.75 lat (usec): min=767, max=1673.3k, avg=37165.90, stdev=59332.01 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1123], 10.00th=[ 1401], | 20.00th=[ 3294], 30.00th=[ 6980], 40.00th=[ 16909], | 50.00th=[ 25297], 60.00th=[ 34866], 70.00th=[ 44827], | 80.00th=[ 57934], 90.00th=[ 84411], 95.00th=[ 106431], | 99.00th=[ 196084], 99.50th=[ 278922], 99.90th=[ 471860], | 99.95th=[1669333], 99.99th=[1669333] bw ( KiB/s): min= 2, max= 143, per=25.83%, avg=54.24, stdev=26.20, samples=224 iops : min= 0, max= 35, avg=12.93, stdev= 6.61, samples=224 lat (usec) : 50=1.17%, 100=3.29%, 250=0.39%, 500=0.07%, 1000=0.81% lat (msec) : 2=6.38%, 4=4.26%, 10=6.28%, 20=15.23%, 50=37.40% lat (msec) : 100=19.30%, 250=5.01%, 500=0.33%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.14%, ctx=6533, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158385: Mon Sep 21 06:20:24 2026 read: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6052KiB/116385msec) clat (usec): min=30, max=1692.1k, avg=37142.65, stdev=53657.13 lat (usec): min=30, max=1692.1k, avg=37144.28, stdev=53656.89 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 2704], | 20.00th=[ 15139], 30.00th=[ 19268], 40.00th=[ 23987], | 50.00th=[ 28705], 60.00th=[ 35914], 70.00th=[ 42730], | 80.00th=[ 53216], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[ 141558], 99.50th=[ 187696], 99.90th=[ 429917], | 99.95th=[1686111], 99.99th=[1686111] bw ( KiB/s): min= 7, max= 136, per=26.45%, avg=53.16, stdev=23.63, samples=222 iops : min= 1, max= 34, avg=12.65, stdev= 5.95, samples=222 write: IOPS=13, BW=53.6KiB/s (54.9kB/s)(6236KiB/116385msec); 0 zone resets clat (usec): min=728, max=696800, avg=38228.53, stdev=49579.66 lat (usec): min=728, max=696801, avg=38232.52, stdev=49583.48 clat percentiles (usec): | 1.00th=[ 979], 5.00th=[ 1156], 10.00th=[ 1467], 20.00th=[ 3163], | 30.00th=[ 7177], 40.00th=[ 16319], 50.00th=[ 25297], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 89654], 95.00th=[117965], | 99.00th=[189793], 99.50th=[304088], 99.90th=[583009], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 6, max= 167, per=25.80%, avg=54.18, stdev=25.48, samples=224 iops : min= 1, max= 41, avg=12.92, stdev= 6.40, samples=224 lat (usec) : 50=1.24%, 100=3.03%, 250=0.42%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.65% lat (msec) : 2=6.28%, 4=4.95%, 10=6.54%, 20=14.75%, 50=36.95% lat (msec) : 100=19.14%, 250=5.40%, 500=0.42%, 750=0.07%, 2000=0.03% cpu : usr=0.07%, sys=5.07%, ctx=6435, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=201KiB/s (206kB/s), 49.8KiB/s-52.4KiB/s (50.0kB/s-53.7kB/s), io=23.4MiB (24.6MB), run=115027-119374msec WRITE: bw=211KiB/s (216kB/s), 53.2KiB/s-54.4KiB/s (54.5kB/s-55.7kB/s), io=24.6MiB (25.7MB), run=115027-119374msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158387: Mon Sep 21 06:22:24 2026 read: IOPS=6, BW=25.5KiB/s (26.2kB/s)(5992KiB/234607msec) clat (msec): min=4, max=463, avg=34.48, stdev=41.73 lat (msec): min=4, max=463, avg=34.48, stdev=41.73 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 69], 95.00th=[ 94], | 99.00th=[ 197], 99.50th=[ 363], 99.90th=[ 439], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 7, max= 112, per=28.32%, avg=28.32, stdev=20.77, samples=411 iops : min= 1, max= 28, avg= 6.48, stdev= 5.25, samples=411 write: IOPS=6, BW=26.8KiB/s (27.5kB/s)(6296KiB/234607msec); 0 zone resets clat (msec): min=23, max=1711, avg=115.95, stdev=81.28 lat (msec): min=23, max=1711, avg=115.96, stdev=81.28 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 45], 10.00th=[ 53], 20.00th=[ 62], | 30.00th=[ 71], 40.00th=[ 82], 50.00th=[ 93], 60.00th=[ 109], | 70.00th=[ 134], 80.00th=[ 161], 90.00th=[ 211], 95.00th=[ 253], | 99.00th=[ 363], 99.50th=[ 397], 99.90th=[ 760], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 6, max= 72, per=25.96%, avg=27.00, stdev=14.90, samples=452 iops : min= 1, max= 18, avg= 6.15, stdev= 3.81, samples=452 lat (msec) : 10=6.54%, 20=15.33%, 50=21.68%, 100=31.38%, 250=22.07% lat (msec) : 500=2.90%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.33%, ctx=5509, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158388: Mon Sep 21 06:22:24 2026 read: IOPS=6, BW=24.8KiB/s (25.4kB/s)(5940KiB/239913msec) clat (msec): min=4, max=1752, avg=34.65, stdev=59.90 lat (msec): min=4, max=1752, avg=34.65, stdev=59.90 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 69], 95.00th=[ 94], | 99.00th=[ 194], 99.50th=[ 264], 99.90th=[ 609], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 6, max= 110, per=28.16%, avg=28.16, stdev=20.04, samples=409 iops : min= 1, max= 27, avg= 6.45, stdev= 5.08, samples=409 write: IOPS=6, BW=26.5KiB/s (27.1kB/s)(6348KiB/239913msec); 0 zone resets clat (msec): min=29, max=787, avg=118.46, stdev=73.92 lat (msec): min=29, max=787, avg=118.46, stdev=73.92 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 72], 40.00th=[ 84], 50.00th=[ 96], 60.00th=[ 112], | 70.00th=[ 133], 80.00th=[ 169], 90.00th=[ 218], 95.00th=[ 259], | 99.00th=[ 384], 99.50th=[ 439], 99.90th=[ 567], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 6, max= 71, per=25.53%, avg=26.55, stdev=14.68, samples=463 iops : min= 1, max= 17, avg= 6.03, stdev= 3.74, samples=463 lat (msec) : 10=7.98%, 20=14.16%, 50=21.84%, 100=29.65%, 250=23.34% lat (msec) : 500=2.90%, 750=0.07%, 1000=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.30%, ctx=5374, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158389: Mon Sep 21 06:22:24 2026 read: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6028KiB/236610msec) clat (msec): min=3, max=722, avg=34.84, stdev=39.40 lat (msec): min=3, max=722, avg=34.84, stdev=39.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 73], 95.00th=[ 95], | 99.00th=[ 182], 99.50th=[ 230], 99.90th=[ 510], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 119, per=27.89%, avg=27.89, stdev=19.82, samples=419 iops : min= 1, max= 29, avg= 6.38, stdev= 5.01, samples=419 write: IOPS=6, BW=26.5KiB/s (27.1kB/s)(6260KiB/236610msec); 0 zone resets clat (msec): min=29, max=1717, avg=117.35, stdev=83.04 lat (msec): min=29, max=1717, avg=117.35, stdev=83.04 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 45], 10.00th=[ 52], 20.00th=[ 61], | 30.00th=[ 72], 40.00th=[ 84], 50.00th=[ 96], 60.00th=[ 111], | 70.00th=[ 133], 80.00th=[ 163], 90.00th=[ 207], 95.00th=[ 255], | 99.00th=[ 388], 99.50th=[ 472], 99.90th=[ 776], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7, max= 71, per=25.75%, avg=26.78, stdev=15.03, samples=452 iops : min= 1, max= 17, avg= 6.09, stdev= 3.84, samples=452 lat (msec) : 4=0.03%, 10=7.68%, 20=14.03%, 50=21.61%, 100=30.73% lat (msec) : 250=23.11%, 500=2.60%, 750=0.13%, 1000=0.03%, 2000=0.03% cpu : usr=0.03%, sys=1.27%, ctx=5342, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158390: Mon Sep 21 06:22:24 2026 read: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6052KiB/236401msec) clat (msec): min=4, max=451, avg=34.45, stdev=38.96 lat (msec): min=4, max=451, avg=34.45, stdev=38.96 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 23], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 72], 95.00th=[ 100], | 99.00th=[ 203], 99.50th=[ 253], 99.90th=[ 384], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 5, max= 127, per=28.44%, avg=28.44, stdev=20.03, samples=413 iops : min= 1, max= 31, avg= 6.52, stdev= 5.07, samples=413 write: IOPS=6, BW=26.4KiB/s (27.0kB/s)(6236KiB/236401msec); 0 zone resets clat (msec): min=25, max=1729, avg=117.89, stdev=84.13 lat (msec): min=25, max=1729, avg=117.90, stdev=84.14 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 46], 10.00th=[ 53], 20.00th=[ 63], | 30.00th=[ 72], 40.00th=[ 83], 50.00th=[ 96], 60.00th=[ 112], | 70.00th=[ 133], 80.00th=[ 161], 90.00th=[ 209], 95.00th=[ 253], | 99.00th=[ 405], 99.50th=[ 477], 99.90th=[ 651], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 7, max= 64, per=25.35%, avg=26.36, stdev=14.82, samples=458 iops : min= 1, max= 16, avg= 5.99, stdev= 3.78, samples=458 lat (msec) : 10=8.14%, 20=14.19%, 50=21.94%, 100=29.23%, 250=23.60% lat (msec) : 500=2.67%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.28%, ctx=5339, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=100KiB/s (102kB/s), 24.8KiB/s-25.6KiB/s (25.4kB/s-26.2kB/s), io=23.4MiB (24.6MB), run=234607-239913msec WRITE: bw=105KiB/s (107kB/s), 26.4KiB/s-26.8KiB/s (27.0kB/s-27.5kB/s), io=24.6MiB (25.7MB), run=234607-239913msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158436: Mon Sep 21 06:23:08 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(5920KiB/30512msec) clat (usec): min=37, max=224651, avg=41175.83, stdev=36405.16 lat (usec): min=38, max=224651, avg=41177.27, stdev=36404.93 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 75], | 30.00th=[ 19530], 40.00th=[ 31065], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 55837], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[147850], 99.50th=[221250], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 62, max= 351, per=24.86%, avg=193.63, stdev=70.15, samples=60 iops : min= 3, max= 21, avg=11.32, stdev= 4.39, samples=60 write: IOPS=13, BW=209KiB/s (214kB/s)(6368KiB/30512msec); 0 zone resets clat (usec): min=1370, max=174555, avg=37672.27, stdev=39809.15 lat (usec): min=1372, max=174556, avg=37691.42, stdev=39824.23 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1647], 10.00th=[ 2114], 20.00th=[ 4424], | 30.00th=[ 6849], 40.00th=[ 11076], 50.00th=[ 20055], 60.00th=[ 35914], | 70.00th=[ 52167], 80.00th=[ 73925], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[158335], 99.50th=[166724], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 542, per=25.95%, avg=212.51, stdev=103.62, samples=59 iops : min= 1, max= 33, avg=12.51, stdev= 6.49, samples=59 lat (usec) : 50=1.43%, 100=9.38%, 250=1.17%, 500=0.26%, 750=0.13% lat (msec) : 2=4.82%, 4=4.04%, 10=10.94%, 20=7.94%, 50=26.56% lat (msec) : 100=25.91%, 250=7.42% cpu : usr=0.06%, sys=5.06%, ctx=1424, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158437: Mon Sep 21 06:23:08 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(5744KiB/30736msec) clat (usec): min=40, max=227223, avg=43562.44, stdev=37575.65 lat (usec): min=40, max=227224, avg=43563.76, stdev=37575.57 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 186], | 30.00th=[ 24511], 40.00th=[ 31589], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 70779], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[183501], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 27, max= 380, per=23.68%, avg=184.45, stdev=74.22, samples=60 iops : min= 1, max= 23, avg=10.75, stdev= 4.71, samples=60 write: IOPS=13, BW=213KiB/s (218kB/s)(6544KiB/30736msec); 0 zone resets clat (usec): min=1153, max=196305, avg=36446.21, stdev=38323.39 lat (usec): min=1155, max=196308, avg=36448.17, stdev=38323.37 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1795], 10.00th=[ 2671], 20.00th=[ 5735], | 30.00th=[ 8848], 40.00th=[ 13566], 50.00th=[ 19530], 60.00th=[ 32113], | 70.00th=[ 45876], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[109577], | 99.00th=[158335], 99.50th=[181404], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 31, max= 382, per=25.48%, avg=208.67, stdev=73.52, samples=60 iops : min= 1, max= 23, avg=12.27, stdev= 4.63, samples=60 lat (usec) : 50=1.17%, 100=7.94%, 250=0.52%, 500=0.26%, 750=0.26% lat (msec) : 2=3.91%, 4=3.91%, 10=10.81%, 20=10.03%, 50=29.56% lat (msec) : 100=25.13%, 250=6.51% cpu : usr=0.07%, sys=4.88%, ctx=1378, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158438: Mon Sep 21 06:23:08 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29656msec) clat (usec): min=40, max=238683, avg=42731.64, stdev=38273.05 lat (usec): min=40, max=238683, avg=42736.04, stdev=38275.71 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 87], | 30.00th=[ 22676], 40.00th=[ 31065], 50.00th=[ 38011], 60.00th=[ 46400], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[110625], | 99.00th=[173016], 99.50th=[225444], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 62, max= 413, per=27.22%, avg=212.07, stdev=76.80, samples=58 iops : min= 3, max= 25, avg=12.48, stdev= 4.84, samples=58 write: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29656msec); 0 zone resets clat (usec): min=1385, max=239058, avg=34147.22, stdev=39849.19 lat (usec): min=1386, max=239060, avg=34149.13, stdev=39849.29 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1745], 10.00th=[ 2073], 20.00th=[ 4047], | 30.00th=[ 6521], 40.00th=[ 10552], 50.00th=[ 17695], 60.00th=[ 28181], | 70.00th=[ 40109], 80.00th=[ 62653], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[187696], 99.50th=[221250], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 412, per=24.54%, avg=200.95, stdev=96.96, samples=58 iops : min= 1, max= 25, avg=11.79, stdev= 6.12, samples=58 lat (usec) : 50=1.04%, 100=9.38%, 250=1.30%, 500=0.26%, 750=0.26% lat (msec) : 2=4.30%, 4=5.60%, 10=9.77%, 20=8.33%, 50=27.99% lat (msec) : 100=23.83%, 250=7.94% cpu : usr=0.09%, sys=4.67%, ctx=1359, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158439: Mon Sep 21 06:23:08 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(6032KiB/29869msec) clat (usec): min=38, max=192046, avg=40170.85, stdev=33869.23 lat (usec): min=39, max=192048, avg=40173.76, stdev=33872.75 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 48], 10.00th=[ 60], 20.00th=[ 74], | 30.00th=[ 17695], 40.00th=[ 29492], 50.00th=[ 39584], 60.00th=[ 50070], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[131597], 99.50th=[162530], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 383, per=25.36%, avg=197.53, stdev=86.76, samples=58 iops : min= 1, max= 23, avg=11.55, stdev= 5.45, samples=58 write: IOPS=13, BW=209KiB/s (214kB/s)(6256KiB/29869msec); 0 zone resets clat (usec): min=1188, max=266066, avg=36987.63, stdev=43689.46 lat (usec): min=1189, max=266068, avg=37007.24, stdev=43678.88 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1647], 10.00th=[ 2114], 20.00th=[ 4948], | 30.00th=[ 8455], 40.00th=[ 13435], 50.00th=[ 21103], 60.00th=[ 32113], | 70.00th=[ 44303], 80.00th=[ 60556], 90.00th=[ 95945], 95.00th=[122160], | 99.00th=[235930], 99.50th=[261096], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 61, max= 446, per=25.32%, avg=207.36, stdev=94.96, samples=58 iops : min= 3, max= 27, avg=12.19, stdev= 5.97, samples=58 lat (usec) : 50=2.73%, 100=9.64%, 250=0.39%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=5.21%, 4=4.04%, 10=9.11%, 20=8.46%, 50=27.60% lat (msec) : 100=25.65%, 250=6.51%, 500=0.26% cpu : usr=0.08%, sys=5.06%, ctx=1375, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=779KiB/s (798kB/s), 187KiB/s-211KiB/s (191kB/s-216kB/s), io=23.4MiB (24.5MB), run=29656-30736msec WRITE: bw=820KiB/s (840kB/s), 203KiB/s-213KiB/s (208kB/s-218kB/s), io=24.6MiB (25.8MB), run=29656-30736msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158440: Mon Sep 21 06:23:46 2026 read: IOPS=5, BW=88.8KiB/s (90.0kB/s)(5920KiB/66639msec) clat (msec): min=5, max=376, avg=39.51, stdev=45.47 lat (msec): min=5, max=376, avg=39.51, stdev=45.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 53], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 262], 99.50th=[ 330], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 412, per=27.53%, avg=96.92, stdev=67.93, samples=119 iops : min= 1, max= 25, avg= 5.29, stdev= 4.33, samples=119 write: IOPS=5, BW=95.6KiB/s (97.9kB/s)(6368KiB/66639msec); 0 zone resets clat (msec): min=39, max=390, avg=129.67, stdev=63.71 lat (msec): min=39, max=390, avg=129.68, stdev=63.72 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 111], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 167], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 347], 99.50th=[ 355], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 31, max= 192, per=26.64%, avg=98.82, stdev=43.86, samples=126 iops : min= 1, max= 12, avg= 5.42, stdev= 2.82, samples=126 lat (msec) : 10=2.73%, 20=15.23%, 50=20.70%, 100=26.17%, 250=31.12% lat (msec) : 500=4.04% cpu : usr=0.03%, sys=1.14%, ctx=1262, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158441: Mon Sep 21 06:23:46 2026 read: IOPS=5, BW=84.6KiB/s (86.6kB/s)(5744KiB/67906msec) clat (msec): min=6, max=268, avg=38.59, stdev=40.29 lat (msec): min=6, max=268, avg=38.59, stdev=40.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 54], 90.00th=[ 84], 95.00th=[ 133], | 99.00th=[ 213], 99.50th=[ 268], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 29, max= 348, per=28.23%, avg=99.36, stdev=68.92, samples=113 iops : min= 1, max= 21, avg= 5.47, stdev= 4.36, samples=113 write: IOPS=6, BW=96.4KiB/s (98.7kB/s)(6544KiB/67906msec); 0 zone resets clat (msec): min=36, max=455, avg=131.07, stdev=72.70 lat (msec): min=36, max=455, avg=131.07, stdev=72.70 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 124], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 226], 95.00th=[ 296], | 99.00th=[ 405], 99.50th=[ 414], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 31, max= 254, per=26.75%, avg=99.25, stdev=47.69, samples=129 iops : min= 1, max= 15, avg= 5.44, stdev= 3.04, samples=129 lat (msec) : 10=2.47%, 20=16.41%, 50=19.66%, 100=26.17%, 250=30.73% lat (msec) : 500=4.56% cpu : usr=0.04%, sys=1.24%, ctx=1290, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158442: Mon Sep 21 06:23:46 2026 read: IOPS=5, BW=95.2KiB/s (97.4kB/s)(6256KiB/65740msec) clat (msec): min=6, max=252, avg=37.41, stdev=41.17 lat (msec): min=6, max=252, avg=37.42, stdev=41.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 99], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 232], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 383, per=29.78%, avg=104.83, stdev=76.75, samples=118 iops : min= 1, max= 23, avg= 5.81, stdev= 4.88, samples=118 write: IOPS=5, BW=91.8KiB/s (93.0kB/s)(6032KiB/65740msec); 0 zone resets clat (msec): min=35, max=543, avg=135.13, stdev=70.03 lat (msec): min=35, max=543, avg=135.13, stdev=70.03 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 70], 20.00th=[ 83], | 30.00th=[ 94], 40.00th=[ 105], 50.00th=[ 111], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 180], 90.00th=[ 224], 95.00th=[ 271], | 99.00th=[ 368], 99.50th=[ 460], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 28, max= 220, per=24.81%, avg=92.06, stdev=43.96, samples=129 iops : min= 1, max= 13, avg= 4.99, stdev= 2.84, samples=129 lat (msec) : 10=4.04%, 20=18.62%, 50=19.66%, 100=21.09%, 250=33.07% lat (msec) : 500=3.39%, 750=0.13% cpu : usr=0.03%, sys=1.09%, ctx=1331, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158443: Mon Sep 21 06:23:46 2026 read: IOPS=5, BW=89.6KiB/s (91.7kB/s)(6032KiB/67332msec) clat (msec): min=6, max=288, avg=38.50, stdev=43.02 lat (msec): min=6, max=288, avg=38.51, stdev=43.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 83], 95.00th=[ 121], | 99.00th=[ 239], 99.50th=[ 259], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 287, per=29.39%, avg=103.45, stdev=65.78, samples=114 iops : min= 1, max= 17, avg= 5.71, stdev= 4.18, samples=114 write: IOPS=5, BW=92.9KiB/s (95.1kB/s)(6256KiB/67332msec); 0 zone resets clat (msec): min=42, max=540, avg=134.09, stdev=70.29 lat (msec): min=42, max=540, avg=134.09, stdev=70.29 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 91], 40.00th=[ 102], 50.00th=[ 114], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 178], 90.00th=[ 234], 95.00th=[ 271], | 99.00th=[ 380], 99.50th=[ 409], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 222, per=25.88%, avg=96.03, stdev=45.88, samples=128 iops : min= 1, max= 13, avg= 5.23, stdev= 2.95, samples=128 lat (msec) : 10=3.78%, 20=15.63%, 50=21.35%, 100=24.61%, 250=30.34% lat (msec) : 500=4.17%, 750=0.13% cpu : usr=0.04%, sys=1.20%, ctx=1265, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=353KiB/s (361kB/s), 84.6KiB/s-95.2KiB/s (86.6kB/s-97.4kB/s), io=23.4MiB (24.5MB), run=65740-67906msec WRITE: bw=371KiB/s (380kB/s), 91.8KiB/s-96.4KiB/s (93.0kB/s-98.7kB/s), io=24.6MiB (25.8MB), run=65740-67906msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158467: Mon Sep 21 06:24:02 2026 read: IOPS=1, BW=1535KiB/s (1572kB/s)(7168KiB/4670msec) clat (msec): min=76, max=929, avg=280.70, stdev=301.31 lat (msec): min=76, max=929, avg=280.70, stdev=301.31 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 89], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 157], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 334], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1422, max= 2043, per=50.11%, avg=1921.67, stdev=245.79, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1096KiB/s (1123kB/s)(5120KiB/4670msec); 0 zone resets clat (msec): min=213, max=732, avg=510.44, stdev=192.28 lat (msec): min=214, max=732, avg=510.86, stdev=191.70 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2023, max= 2043, per=37.90%, avg=2035.00, stdev= 8.64, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=3.28%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158468: Mon Sep 21 06:24:02 2026 read: IOPS=0, BW=391KiB/s (400kB/s)(2048KiB/5239msec) clat (msec): min=147, max=158, avg=152.63, stdev= 7.87 lat (msec): min=147, max=158, avg=152.63, stdev= 7.87 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 1430, max= 2023, per=45.02%, avg=1726.50, stdev=419.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1955KiB/s (2001kB/s)(10.0MiB/5239msec); 0 zone resets clat (msec): min=161, max=1309, avg=475.68, stdev=333.17 lat (msec): min=162, max=1309, avg=475.80, stdev=333.17 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 213], | 30.00th=[ 241], 40.00th=[ 243], 50.00th=[ 426], 60.00th=[ 498], | 70.00th=[ 510], 80.00th=[ 575], 90.00th=[ 592], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2023, max= 4063, per=50.45%, avg=2709.17, stdev=1039.44, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=2.75%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158469: Mon Sep 21 06:24:02 2026 read: IOPS=1, BW=1151KiB/s (1178kB/s)(6144KiB/5339msec) clat (msec): min=111, max=372, avg=265.23, stdev=92.08 lat (msec): min=111, max=372, avg=265.23, stdev=92.08 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 305], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1988, max= 3961, per=65.39%, avg=2507.75, stdev=969.16, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1151KiB/s (1178kB/s)(6144KiB/5339msec); 0 zone resets clat (msec): min=170, max=1305, avg=594.09, stdev=403.69 lat (msec): min=170, max=1307, avg=594.41, stdev=404.08 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 667], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1460, max= 2048, per=35.96%, avg=1930.83, stdev=231.54, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.07%, ctx=76, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158471: Mon Sep 21 06:24:02 2026 read: IOPS=1, BW=1328KiB/s (1360kB/s)(5120KiB/3854msec) clat (msec): min=149, max=436, avg=248.35, stdev=117.34 lat (msec): min=149, max=436, avg=248.35, stdev=117.34 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 439], 95.00th=[ 439], | 99.00th=[ 439], 99.50th=[ 439], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 1980, max= 6107, per=100.00%, avg=4043.50, stdev=2918.23, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1860KiB/s (1905kB/s)(7168KiB/3854msec); 0 zone resets clat (msec): min=157, max=590, avg=365.71, stdev=185.03 lat (msec): min=157, max=590, avg=365.82, stdev=185.05 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 209], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 292], 60.00th=[ 523], | 70.00th=[ 523], 80.00th=[ 558], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1497, max= 4079, per=50.95%, avg=2736.20, stdev=1237.15, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=3.17%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3836KiB/s (3928kB/s), 391KiB/s-1535KiB/s (400kB/s-1572kB/s), io=20.0MiB (20.0MB), run=3854-5339msec WRITE: bw=5370KiB/s (5499kB/s), 1096KiB/s-1955KiB/s (1123kB/s-2001kB/s), io=28.0MiB (29.4MB), run=3854-5339msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158472: Mon Sep 21 06:24:02 2026 read: IOPS=2, BW=2129KiB/s (2180kB/s)(7168KiB/3367msec) clat (usec): min=494, max=467803, avg=240211.98, stdev=136743.62 lat (usec): min=496, max=467805, avg=240213.60, stdev=136743.63 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[217056], | 30.00th=[227541], 40.00th=[227541], 50.00th=[240124], 60.00th=[242222], | 70.00th=[242222], 80.00th=[287310], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 1946, max= 2043, per=52.03%, avg=2009.50, stdev=34.56, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1521KiB/s (1557kB/s)(5120KiB/3367msec); 0 zone resets clat (msec): min=174, max=420, avg=291.66, stdev=108.49 lat (msec): min=174, max=420, avg=292.00, stdev=108.17 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2003, max= 4087, per=49.92%, avg=2699.00, stdev=1202.04, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=41.67% cpu : usr=0.03%, sys=11.05%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158473: Mon Sep 21 06:24:02 2026 read: IOPS=0, BW=386KiB/s (396kB/s)(2048KiB/5302msec) clat (msec): min=228, max=269, avg=249.23, stdev=29.10 lat (msec): min=228, max=269, avg=249.23, stdev=29.11 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1359, max= 2011, per=43.63%, avg=1685.00, stdev=461.03, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1931KiB/s (1978kB/s)(10.0MiB/5302msec); 0 zone resets clat (msec): min=174, max=943, avg=450.74, stdev=263.19 lat (msec): min=174, max=943, avg=450.97, stdev=263.13 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 247], | 30.00th=[ 284], 40.00th=[ 309], 50.00th=[ 313], 60.00th=[ 342], | 70.00th=[ 397], 80.00th=[ 726], 90.00th=[ 776], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2000, max= 4096, per=49.97%, avg=2702.00, stdev=1045.80, samples=6 iops : min= 1, max= 4, avg= 1.83, stdev= 1.33, samples=6 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=10.87%, ctx=175, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158474: Mon Sep 21 06:24:02 2026 read: IOPS=1, BW=1575KiB/s (1612kB/s)(6144KiB/3902msec) clat (usec): min=657, max=384338, avg=113605.01, stdev=171430.99 lat (usec): min=658, max=384339, avg=113606.36, stdev=171430.74 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 7767], 50.00th=[ 7767], 60.00th=[ 11338], | 70.00th=[274727], 80.00th=[274727], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 2043, max= 6023, per=87.25%, avg=3369.67, stdev=2297.85, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1575KiB/s (1612kB/s)(6144KiB/3902msec); 0 zone resets clat (msec): min=186, max=1200, avg=481.58, stdev=375.05 lat (msec): min=186, max=1200, avg=481.67, stdev=375.04 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 430], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1954, max= 4015, per=46.44%, avg=2510.75, stdev=1003.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 10=8.33%, 20=8.33%, 250=16.67%, 500=33.33% lat (msec) : 750=8.33%, 2000=8.33% cpu : usr=0.08%, sys=8.18%, ctx=146, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158475: Mon Sep 21 06:24:02 2026 read: IOPS=1, BW=1125KiB/s (1152kB/s)(5120KiB/4550msec) clat (usec): min=497, max=328526, avg=105120.37, stdev=150305.88 lat (usec): min=498, max=328526, avg=105121.47, stdev=150305.70 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 832], 40.00th=[ 832], 50.00th=[ 1614], 60.00th=[ 1614], | 70.00th=[193987], 80.00th=[193987], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 4023, max= 4087, per=100.00%, avg=4055.00, stdev=45.25, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1575KiB/s (1613kB/s)(7168KiB/4550msec); 0 zone resets clat (msec): min=184, max=1241, avg=568.55, stdev=444.22 lat (msec): min=184, max=1241, avg=568.65, stdev=444.22 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 197], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 259], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 936], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 2003, max= 2043, per=37.25%, avg=2014.20, stdev=16.35, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=25.00%, 500=25.00%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=7.76%, ctx=176, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3863KiB/s (3955kB/s), 386KiB/s-2129KiB/s (396kB/s-2180kB/s), io=20.0MiB (20.0MB), run=3367-5302msec WRITE: bw=5408KiB/s (5538kB/s), 1521KiB/s-1931KiB/s (1557kB/s-1978kB/s), io=28.0MiB (29.4MB), run=3367-5302msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=158482: Mon Sep 21 06:24:16 2026 read: IOPS=1, BW=6110KiB/s (6257kB/s)(12.0MiB/2011msec) clat (msec): min=117, max=879, avg=617.29, stdev=432.90 lat (msec): min=117, max=879, avg=617.29, stdev=432.90 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.20%, sys=3.68%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158483: Mon Sep 21 06:24:16 2026 read: IOPS=0, BW=1731KiB/s (1773kB/s)(4096KiB/2366msec) clat (nsec): min=348679k, max=348679k, avg=348679434.00, stdev= 0.00 lat (nsec): min=348682k, max=348682k, avg=348682401.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 5587, max= 5587, per=80.69%, avg=5587.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3462KiB/s (3545kB/s)(8192KiB/2366msec); 0 zone resets clat (msec): min=739, max=1176, avg=957.59, stdev=308.90 lat (msec): min=739, max=1176, avg=958.08, stdev=308.79 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7876, max= 7876, per=88.39%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.42%, sys=4.40%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158484: Mon Sep 21 06:24:17 2026 write: IOPS=0, BW=3342KiB/s (3422kB/s)(12.0MiB/3677msec); 0 zone resets clat (msec): min=728, max=1436, avg=1171.42, stdev=385.97 lat (msec): min=729, max=1447, avg=1179.32, stdev=392.30 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 1351], 50.00th=[ 1351], 60.00th=[ 1351], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8126, max= 8143, per=91.29%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.16%, sys=3.75%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158485: Mon Sep 21 06:24:17 2026 write: IOPS=1, BW=5655KiB/s (5791kB/s)(12.0MiB/2173msec); 0 zone resets clat (msec): min=472, max=1001, avg=688.01, stdev=277.86 lat (msec): min=473, max=1002, avg=688.45, stdev=277.90 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 5834, max= 7876, per=76.93%, avg=6855.00, stdev=1443.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.64%, sys=4.65%, ctx=46, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6925KiB/s (7091kB/s), 1731KiB/s-6110KiB/s (1773kB/s-6257kB/s), io=16.0MiB (16.8MB), run=2011-2366msec WRITE: bw=8912KiB/s (9125kB/s), 3342KiB/s-5655KiB/s (3422kB/s-5791kB/s), io=32.0MiB (33.6MB), run=2173-3677msec rand-rw: (groupid=0, jobs=1): err= 0: pid=158487: Mon Sep 21 06:24:17 2026 read: IOPS=1, BW=5974KiB/s (6117kB/s)(12.0MiB/2057msec) clat (msec): min=479, max=812, avg=685.28, stdev=179.82 lat (msec): min=479, max=812, avg=685.28, stdev=179.82 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=13.13%, ctx=411, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158488: Mon Sep 21 06:24:17 2026 read: IOPS=0, BW=1600KiB/s (1638kB/s)(4096KiB/2560msec) clat (nsec): min=651024k, max=651024k, avg=651024491.00, stdev= 0.00 lat (nsec): min=651026k, max=651026k, avg=651026071.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3200KiB/s (3277kB/s)(8192KiB/2560msec); 0 zone resets clat (msec): min=512, max=1393, avg=953.03, stdev=623.60 lat (msec): min=513, max=1394, avg=953.93, stdev=622.82 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8192, max= 8192, per=82.38%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.08%, sys=5.78%, ctx=246, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158489: Mon Sep 21 06:24:17 2026 write: IOPS=0, BW=3729KiB/s (3819kB/s)(12.0MiB/3295msec); 0 zone resets clat (msec): min=390, max=1565, avg=1097.02, stdev=622.56 lat (msec): min=391, max=1565, avg=1097.31, stdev=622.48 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8192, max= 8192, per=82.38%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.79%, ctx=21, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=158490: Mon Sep 21 06:24:17 2026 write: IOPS=1, BW=5247KiB/s (5373kB/s)(12.0MiB/2342msec); 0 zone resets clat (msec): min=348, max=1102, avg=773.36, stdev=385.62 lat (msec): min=349, max=1102, avg=774.55, stdev=385.84 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8143, max= 8143, per=81.89%, avg=8143.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.63%, ctx=30, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6400KiB/s (6554kB/s), 1600KiB/s-5974KiB/s (1638kB/s-6117kB/s), io=16.0MiB (16.8MB), run=2057-2560msec WRITE: bw=9945KiB/s (10.2MB/s), 3200KiB/s-5247KiB/s (3277kB/s-5373kB/s), io=32.0MiB (33.6MB), run=2342-3295msec