== sanity test 398b: DIO and buffer IO race ============== 20:23:22 (1787790202) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.61289 s, 9.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145369: Wed Aug 26 20:25:27 2026 read: IOPS=14, BW=56.3KiB/s (57.7kB/s)(5992KiB/106356msec) clat (usec): min=32, max=294808, avg=34304.27, stdev=26185.39 lat (usec): min=32, max=294809, avg=34305.51, stdev=26185.28 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 59], 10.00th=[ 10028], 20.00th=[ 16057], | 30.00th=[ 20579], 40.00th=[ 24773], 50.00th=[ 28967], 60.00th=[ 34866], | 70.00th=[ 41157], 80.00th=[ 49546], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[123208], 99.50th=[158335], 99.90th=[225444], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 112, per=25.14%, avg=56.07, stdev=21.19, samples=208 iops : min= 1, max= 28, avg=13.39, stdev= 5.35, samples=208 write: IOPS=14, BW=59.2KiB/s (60.6kB/s)(6296KiB/106356msec); 0 zone resets clat (usec): min=908, max=1074.8k, avg=34695.34, stdev=45298.93 lat (usec): min=909, max=1074.8k, avg=34698.50, stdev=45300.18 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1549], | 20.00th=[ 3294], 30.00th=[ 6915], 40.00th=[ 16057], | 50.00th=[ 25035], 60.00th=[ 34341], 70.00th=[ 44827], | 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[ 154141], 99.50th=[ 181404], 99.90th=[ 530580], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 136, per=25.23%, avg=59.03, stdev=22.90, samples=208 iops : min= 1, max= 34, avg=14.13, stdev= 5.75, samples=208 lat (usec) : 50=0.36%, 100=3.52%, 250=0.39%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=6.64%, 4=4.75%, 10=6.18%, 20=14.19%, 50=40.46% lat (msec) : 100=19.92%, 250=3.03%, 500=0.10%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=5.79%, ctx=6697, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145370: Wed Aug 26 20:25:27 2026 read: IOPS=14, BW=57.2KiB/s (58.6kB/s)(5940KiB/103809msec) clat (usec): min=32, max=220168, avg=33395.69, stdev=24810.52 lat (usec): min=33, max=220169, avg=33397.75, stdev=24809.87 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 6587], 20.00th=[ 15795], | 30.00th=[ 20317], 40.00th=[ 23725], 50.00th=[ 28443], 60.00th=[ 33817], | 70.00th=[ 41157], 80.00th=[ 49546], 90.00th=[ 63177], 95.00th=[ 78119], | 99.00th=[127402], 99.50th=[139461], 99.90th=[208667], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 7, max= 128, per=25.55%, avg=56.97, stdev=23.58, samples=204 iops : min= 1, max= 32, avg=13.61, stdev= 5.92, samples=204 write: IOPS=15, BW=61.2KiB/s (62.6kB/s)(6348KiB/103809msec); 0 zone resets clat (usec): min=681, max=1094.9k, avg=33910.57, stdev=43828.89 lat (usec): min=683, max=1094.9k, avg=33916.73, stdev=43833.93 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1582], | 20.00th=[ 3589], 30.00th=[ 7177], 40.00th=[ 15270], | 50.00th=[ 23987], 60.00th=[ 32637], 70.00th=[ 43254], | 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[ 145753], 99.50th=[ 212861], 99.90th=[ 375391], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 142, per=25.95%, avg=60.73, stdev=23.66, samples=204 iops : min= 1, max= 35, avg=14.56, stdev= 5.94, samples=204 lat (usec) : 50=0.85%, 100=3.19%, 250=0.52%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.29% lat (msec) : 2=6.28%, 4=4.88%, 10=7.32%, 20=13.83%, 50=39.97% lat (msec) : 100=19.47%, 250=3.19%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.68%, ctx=6500, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145371: Wed Aug 26 20:25:27 2026 read: IOPS=14, BW=56.2KiB/s (57.6kB/s)(6028KiB/107230msec) clat (usec): min=32, max=232604, avg=33900.62, stdev=25724.02 lat (usec): min=32, max=232605, avg=33902.10, stdev=25723.72 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 102], 20.00th=[ 15139], | 30.00th=[ 19530], 40.00th=[ 24511], 50.00th=[ 28967], 60.00th=[ 34866], | 70.00th=[ 42206], 80.00th=[ 51119], 90.00th=[ 66847], 95.00th=[ 79168], | 99.00th=[112722], 99.50th=[139461], 99.90th=[229639], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 168, per=25.51%, avg=56.89, stdev=24.86, samples=207 iops : min= 1, max= 42, avg=13.60, stdev= 6.26, samples=207 write: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6260KiB/107230msec); 0 zone resets clat (usec): min=897, max=1162.8k, avg=35613.15, stdev=46470.00 lat (usec): min=898, max=1162.9k, avg=35618.64, stdev=46468.21 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1598], | 20.00th=[ 3720], 30.00th=[ 7177], 40.00th=[ 16581], | 50.00th=[ 26346], 60.00th=[ 34866], 70.00th=[ 46924], | 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[ 173016], 99.50th=[ 202376], 99.90th=[ 320865], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 7, max= 200, per=24.83%, avg=58.10, stdev=25.60, samples=210 iops : min= 1, max= 50, avg=13.90, stdev= 6.46, samples=210 lat (usec) : 50=0.94%, 100=3.94%, 250=0.36%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.58%, 4=3.84%, 10=7.06%, 20=14.10%, 50=38.93% lat (msec) : 100=20.44%, 250=3.42%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=5.69%, ctx=6739, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145372: Wed Aug 26 20:25:27 2026 read: IOPS=14, BW=57.1KiB/s (58.4kB/s)(6052KiB/106043msec) clat (usec): min=32, max=1114.0k, avg=34062.17, stdev=37005.84 lat (usec): min=33, max=1114.0k, avg=34063.73, stdev=37005.68 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 8979], | 20.00th=[ 16319], 30.00th=[ 20055], 40.00th=[ 24249], | 50.00th=[ 28705], 60.00th=[ 33817], 70.00th=[ 40109], | 80.00th=[ 49021], 90.00th=[ 63701], 95.00th=[ 77071], | 99.00th=[ 111674], 99.50th=[ 129500], 99.90th=[ 263193], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 118, per=25.40%, avg=56.65, stdev=22.91, samples=208 iops : min= 1, max= 29, avg=13.54, stdev= 5.75, samples=208 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6236KiB/106043msec); 0 zone resets clat (usec): min=995, max=384190, avg=34739.51, stdev=35570.26 lat (usec): min=996, max=384191, avg=34741.24, stdev=35570.38 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1598], 20.00th=[ 3458], | 30.00th=[ 7439], 40.00th=[ 19006], 50.00th=[ 26870], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[147850], 99.50th=[164627], 99.90th=[362808], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 119, per=25.09%, avg=58.71, stdev=20.62, samples=207 iops : min= 1, max= 29, avg=14.06, stdev= 5.18, samples=207 lat (usec) : 50=0.81%, 100=3.09%, 250=0.33%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.48%, 4=4.72%, 10=5.92%, 20=14.19%, 50=41.67% lat (msec) : 100=19.08%, 250=3.29%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=5.72%, ctx=6713, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=224KiB/s (229kB/s), 56.2KiB/s-57.2KiB/s (57.6kB/s-58.6kB/s), io=23.4MiB (24.6MB), run=103809-107230msec WRITE: bw=234KiB/s (240kB/s), 58.4KiB/s-61.2KiB/s (59.8kB/s-62.6kB/s), io=24.6MiB (25.7MB), run=103809-107230msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145365: Wed Aug 26 20:27:21 2026 read: IOPS=6, BW=27.3KiB/s (27.9kB/s)(5992KiB/219604msec) clat (msec): min=5, max=1029, avg=30.79, stdev=40.53 lat (msec): min=5, max=1029, avg=30.79, stdev=40.53 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 61], 95.00th=[ 89], | 99.00th=[ 157], 99.50th=[ 203], 99.90th=[ 393], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 96, per=27.43%, avg=29.63, stdev=18.99, samples=393 iops : min= 1, max= 24, avg= 6.82, stdev= 4.82, samples=393 write: IOPS=7, BW=28.7KiB/s (29.4kB/s)(6296KiB/219604msec); 0 zone resets clat (msec): min=33, max=409, avg=109.96, stdev=50.75 lat (msec): min=33, max=409, avg=109.97, stdev=50.75 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 80], 40.00th=[ 88], 50.00th=[ 96], 60.00th=[ 107], | 70.00th=[ 122], 80.00th=[ 142], 90.00th=[ 180], 95.00th=[ 211], | 99.00th=[ 288], 99.50th=[ 334], 99.90th=[ 384], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 56, per=25.18%, avg=28.46, stdev=12.36, samples=429 iops : min= 1, max= 14, avg= 6.52, stdev= 3.16, samples=429 lat (msec) : 10=5.70%, 20=18.62%, 50=18.59%, 100=31.67%, 250=24.25% lat (msec) : 500=1.14%, 2000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5458, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145366: Wed Aug 26 20:27:21 2026 read: IOPS=6, BW=26.8KiB/s (27.5kB/s)(5940KiB/221229msec) clat (msec): min=5, max=1165, avg=29.45, stdev=40.94 lat (msec): min=5, max=1165, avg=29.45, stdev=40.94 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 58], 95.00th=[ 81], | 99.00th=[ 153], 99.50th=[ 188], 99.90th=[ 296], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 112, per=26.90%, avg=29.06, stdev=18.46, samples=397 iops : min= 1, max= 28, avg= 6.67, stdev= 4.70, samples=397 write: IOPS=7, BW=28.7KiB/s (29.4kB/s)(6348KiB/221229msec); 0 zone resets clat (msec): min=34, max=576, avg=111.60, stdev=53.75 lat (msec): min=34, max=576, avg=111.61, stdev=53.75 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 81], 40.00th=[ 89], 50.00th=[ 97], 60.00th=[ 109], | 70.00th=[ 122], 80.00th=[ 146], 90.00th=[ 182], 95.00th=[ 215], | 99.00th=[ 296], 99.50th=[ 342], 99.90th=[ 514], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 56, per=24.97%, avg=28.21, stdev=12.09, samples=435 iops : min= 1, max= 14, avg= 6.46, stdev= 3.10, samples=435 lat (msec) : 10=5.50%, 20=19.08%, 50=19.17%, 100=30.66%, 250=24.22% lat (msec) : 500=1.27%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.36%, ctx=5539, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145367: Wed Aug 26 20:27:21 2026 read: IOPS=6, BW=27.3KiB/s (27.0kB/s)(6028KiB/220825msec) clat (msec): min=5, max=390, avg=30.60, stdev=31.86 lat (msec): min=5, max=390, avg=30.60, stdev=31.86 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 42], 90.00th=[ 65], 95.00th=[ 85], | 99.00th=[ 142], 99.50th=[ 205], 99.90th=[ 363], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 119, per=26.95%, avg=29.11, stdev=19.01, samples=403 iops : min= 1, max= 29, avg= 6.69, stdev= 4.79, samples=403 write: IOPS=7, BW=28.3KiB/s (29.0kB/s)(6260KiB/220825msec); 0 zone resets clat (msec): min=35, max=1205, avg=111.39, stdev=58.59 lat (msec): min=35, max=1205, avg=111.40, stdev=58.59 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 71], | 30.00th=[ 80], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 108], | 70.00th=[ 122], 80.00th=[ 142], 90.00th=[ 182], 95.00th=[ 215], | 99.00th=[ 292], 99.50th=[ 338], 99.90th=[ 414], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 71, per=24.90%, avg=28.14, stdev=12.57, samples=432 iops : min= 1, max= 17, avg= 6.44, stdev= 3.22, samples=432 lat (msec) : 10=6.25%, 20=17.09%, 50=19.40%, 100=31.93%, 250=23.86% lat (msec) : 500=1.43%, 2000=0.03% cpu : usr=0.04%, sys=1.33%, ctx=5437, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145368: Wed Aug 26 20:27:21 2026 read: IOPS=6, BW=27.7KiB/s (28.3kB/s)(6052KiB/218729msec) clat (msec): min=4, max=291, avg=29.26, stdev=27.75 lat (msec): min=4, max=291, avg=29.26, stdev=27.75 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 64], 95.00th=[ 86], | 99.00th=[ 142], 99.50th=[ 167], 99.90th=[ 226], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 112, per=27.07%, avg=29.24, stdev=19.04, samples=403 iops : min= 1, max= 28, avg= 6.72, stdev= 4.83, samples=403 write: IOPS=7, BW=28.5KiB/s (29.2kB/s)(6236KiB/218729msec); 0 zone resets clat (msec): min=34, max=1183, avg=111.61, stdev=59.36 lat (msec): min=34, max=1183, avg=111.61, stdev=59.37 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 71], | 30.00th=[ 81], 40.00th=[ 88], 50.00th=[ 97], 60.00th=[ 108], | 70.00th=[ 123], 80.00th=[ 144], 90.00th=[ 182], 95.00th=[ 218], | 99.00th=[ 288], 99.50th=[ 313], 99.90th=[ 617], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 56, per=24.94%, avg=28.18, stdev=12.23, samples=430 iops : min= 1, max= 14, avg= 6.45, stdev= 3.12, samples=430 lat (msec) : 10=5.92%, 20=18.95%, 50=18.46%, 100=31.48%, 250=23.93% lat (msec) : 500=1.17%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.31%, ctx=5560, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=109KiB/s (111kB/s), 26.8KiB/s-27.7KiB/s (27.5kB/s-28.3kB/s), io=23.4MiB (24.6MB), run=218729-221229msec WRITE: bw=114KiB/s (116kB/s), 28.3KiB/s-28.7KiB/s (29.0kB/s-29.4kB/s), io=24.6MiB (25.7MB), run=218729-221229msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145414: Wed Aug 26 20:27:47 2026 read: IOPS=19, BW=315KiB/s (323kB/s)(5920KiB/18772msec) clat (usec): min=40, max=125365, avg=26125.88, stdev=19188.15 lat (usec): min=41, max=125367, avg=26127.05, stdev=19188.14 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 82], 20.00th=[ 11863], | 30.00th=[ 16909], 40.00th=[ 21103], 50.00th=[ 24249], 60.00th=[ 28705], | 70.00th=[ 32900], 80.00th=[ 41157], 90.00th=[ 50070], 95.00th=[ 57934], | 99.00th=[ 79168], 99.50th=[121111], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 95, max= 538, per=24.67%, avg=313.30, stdev=97.32, samples=37 iops : min= 5, max= 33, avg=18.95, stdev= 6.16, samples=37 write: IOPS=21, BW=339KiB/s (347kB/s)(6368KiB/18772msec); 0 zone resets clat (usec): min=1367, max=245878, avg=22519.37, stdev=26252.72 lat (usec): min=1369, max=245879, avg=22521.86, stdev=26252.56 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2057], 10.00th=[ 2474], 20.00th=[ 3982], | 30.00th=[ 5735], 40.00th=[ 7832], 50.00th=[ 12780], 60.00th=[ 20055], | 70.00th=[ 28443], 80.00th=[ 41157], 90.00th=[ 54264], 95.00th=[ 63701], | 99.00th=[ 95945], 99.50th=[233833], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 95, max= 576, per=25.31%, avg=338.11, stdev=111.59, samples=37 iops : min= 5, max= 36, avg=20.51, stdev= 7.08, samples=37 lat (usec) : 50=0.78%, 100=5.08%, 250=1.82%, 500=0.39%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=8.33%, 10=13.41%, 20=16.41%, 50=39.84% lat (msec) : 100=10.29%, 250=0.65% cpu : usr=0.11%, sys=10.49%, ctx=1677, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145415: Wed Aug 26 20:27:47 2026 read: IOPS=19, BW=320KiB/s (327kB/s)(5744KiB/17968msec) clat (usec): min=39, max=163144, avg=26076.73, stdev=18887.61 lat (usec): min=39, max=163146, avg=26078.18, stdev=18887.45 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 89], 20.00th=[ 13960], | 30.00th=[ 17433], 40.00th=[ 20317], 50.00th=[ 23462], 60.00th=[ 28181], | 70.00th=[ 32637], 80.00th=[ 39584], 90.00th=[ 47449], 95.00th=[ 56886], | 99.00th=[ 87557], 99.50th=[ 96994], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 127, max= 509, per=25.19%, avg=319.91, stdev=85.57, samples=35 iops : min= 7, max= 31, avg=19.37, stdev= 5.30, samples=35 write: IOPS=22, BW=364KiB/s (373kB/s)(6544KiB/17968msec); 0 zone resets clat (usec): min=1382, max=130800, avg=20911.27, stdev=19811.81 lat (usec): min=1384, max=130801, avg=20918.20, stdev=19810.90 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2442], 10.00th=[ 3195], 20.00th=[ 4424], | 30.00th=[ 6128], 40.00th=[ 9503], 50.00th=[ 15139], 60.00th=[ 20841], | 70.00th=[ 26608], 80.00th=[ 36439], 90.00th=[ 47449], 95.00th=[ 56886], | 99.00th=[ 91751], 99.50th=[100140], 99.90th=[130548], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 159, max= 581, per=27.32%, avg=365.03, stdev=116.43, samples=35 iops : min= 9, max= 36, avg=22.20, stdev= 7.47, samples=35 lat (usec) : 50=0.13%, 100=5.08%, 250=1.43%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.30%, 4=7.29%, 10=13.54%, 20=19.66%, 50=42.58% lat (msec) : 100=7.94%, 250=0.52% cpu : usr=0.09%, sys=11.48%, ctx=1706, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145416: Wed Aug 26 20:27:47 2026 read: IOPS=20, BW=332KiB/s (340kB/s)(6256KiB/18853msec) clat (usec): min=23, max=204764, avg=26569.09, stdev=23892.29 lat (usec): min=23, max=204766, avg=26573.13, stdev=23891.83 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 1188], | 30.00th=[ 17171], 40.00th=[ 20841], 50.00th=[ 23987], 60.00th=[ 27919], | 70.00th=[ 32900], 80.00th=[ 39060], 90.00th=[ 48497], 95.00th=[ 62129], | 99.00th=[126354], 99.50th=[187696], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 160, max= 601, per=26.24%, avg=333.22, stdev=87.64, samples=37 iops : min= 10, max= 37, avg=20.19, stdev= 5.55, samples=37 write: IOPS=19, BW=320KiB/s (328kB/s)(6032KiB/18853msec); 0 zone resets clat (usec): min=1460, max=241596, avg=22055.01, stdev=24085.59 lat (usec): min=1462, max=241598, avg=22059.16, stdev=24085.46 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 2073], 10.00th=[ 2900], 20.00th=[ 4293], | 30.00th=[ 6259], 40.00th=[ 9634], 50.00th=[ 15139], 60.00th=[ 20317], | 70.00th=[ 27919], 80.00th=[ 36439], 90.00th=[ 50594], 95.00th=[ 62129], | 99.00th=[117965], 99.50th=[128451], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 127, max= 637, per=23.55%, avg=314.68, stdev=112.42, samples=37 iops : min= 7, max= 39, avg=19.03, stdev= 7.16, samples=37 lat (usec) : 50=1.43%, 100=6.25%, 250=1.82%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.08%, 4=6.77%, 10=11.07%, 20=18.23%, 50=41.93% lat (msec) : 100=8.07%, 250=1.69% cpu : usr=0.08%, sys=10.40%, ctx=1707, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145417: Wed Aug 26 20:27:47 2026 read: IOPS=20, BW=336KiB/s (344kB/s)(6032KiB/17977msec) clat (usec): min=33, max=261645, avg=25997.91, stdev=23710.51 lat (usec): min=33, max=261646, avg=25999.05, stdev=23710.53 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 63], 10.00th=[ 76], 20.00th=[ 10683], | 30.00th=[ 16188], 40.00th=[ 19530], 50.00th=[ 23200], 60.00th=[ 27395], | 70.00th=[ 31851], 80.00th=[ 39060], 90.00th=[ 49546], 95.00th=[ 58459], | 99.00th=[112722], 99.50th=[135267], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 95, max= 544, per=26.30%, avg=334.00, stdev=105.86, samples=35 iops : min= 5, max= 34, avg=20.26, stdev= 6.81, samples=35 write: IOPS=21, BW=348KiB/s (356kB/s)(6256KiB/17977msec); 0 zone resets clat (usec): min=1425, max=188509, avg=20540.32, stdev=21956.07 lat (usec): min=1427, max=188513, avg=20542.65, stdev=21955.91 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2089], 10.00th=[ 2507], 20.00th=[ 4359], | 30.00th=[ 5932], 40.00th=[ 8225], 50.00th=[ 12518], 60.00th=[ 19006], | 70.00th=[ 25035], 80.00th=[ 33162], 90.00th=[ 49546], 95.00th=[ 60556], | 99.00th=[100140], 99.50th=[135267], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 159, max= 670, per=26.07%, avg=348.31, stdev=114.32, samples=35 iops : min= 9, max= 41, avg=21.14, stdev= 7.20, samples=35 lat (usec) : 50=0.39%, 100=6.51%, 250=2.21%, 500=0.39%, 750=0.13% lat (msec) : 2=2.21%, 4=7.03%, 10=14.06%, 20=18.88%, 50=38.41% lat (msec) : 100=8.59%, 250=1.04%, 500=0.13% cpu : usr=0.09%, sys=11.20%, ctx=1671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1270KiB/s (1301kB/s), 315KiB/s-336KiB/s (323kB/s-344kB/s), io=23.4MiB (24.5MB), run=17968-18853msec WRITE: bw=1337KiB/s (1369kB/s), 320KiB/s-364KiB/s (328kB/s-373kB/s), io=24.6MiB (25.8MB), run=17968-18853msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145420: Wed Aug 26 20:28:17 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5920KiB/47597msec) clat (msec): min=6, max=258, avg=27.63, stdev=28.05 lat (msec): min=6, max=258, avg=27.64, stdev=28.05 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 47], 95.00th=[ 68], | 99.00th=[ 184], 99.50th=[ 241], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 414, per=25.56%, avg=126.50, stdev=73.77, samples=92 iops : min= 1, max= 25, avg= 7.26, stdev= 4.63, samples=92 write: IOPS=8, BW=134KiB/s (137kB/s)(6368KiB/47597msec); 0 zone resets clat (msec): min=41, max=295, avg=93.75, stdev=33.86 lat (msec): min=41, max=295, avg=93.76, stdev=33.86 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 67], | 30.00th=[ 73], 40.00th=[ 81], 50.00th=[ 88], 60.00th=[ 94], | 70.00th=[ 105], 80.00th=[ 116], 90.00th=[ 133], 95.00th=[ 155], | 99.00th=[ 245], 99.50th=[ 266], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 224, per=25.69%, avg=133.57, stdev=47.28, samples=94 iops : min= 1, max= 14, avg= 7.70, stdev= 3.04, samples=94 lat (msec) : 10=2.86%, 20=21.74%, 50=20.96%, 100=35.03%, 250=18.88% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=2.04%, ctx=1452, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145421: Wed Aug 26 20:28:17 2026 read: IOPS=7, BW=119KiB/s (122kB/s)(5744KiB/48379msec) clat (msec): min=6, max=189, avg=26.88, stdev=24.46 lat (msec): min=6, max=189, avg=26.88, stdev=24.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 59], 95.00th=[ 85], | 99.00th=[ 118], 99.50th=[ 150], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 21, max= 414, per=25.21%, avg=124.79, stdev=80.41, samples=90 iops : min= 1, max= 25, avg= 7.14, stdev= 5.01, samples=90 write: IOPS=8, BW=135KiB/s (139kB/s)(6544KiB/48379msec); 0 zone resets clat (msec): min=38, max=335, avg=94.52, stdev=36.28 lat (msec): min=38, max=335, avg=94.52, stdev=36.28 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 68], | 30.00th=[ 74], 40.00th=[ 81], 50.00th=[ 87], 60.00th=[ 94], | 70.00th=[ 103], 80.00th=[ 115], 90.00th=[ 142], 95.00th=[ 161], | 99.00th=[ 226], 99.50th=[ 264], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 30, max= 224, per=25.86%, avg=134.45, stdev=50.25, samples=95 iops : min= 1, max= 14, avg= 7.76, stdev= 3.24, samples=95 lat (msec) : 10=4.43%, 20=21.22%, 50=16.80%, 100=39.32%, 250=17.84% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=1.88%, ctx=1394, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145422: Wed Aug 26 20:28:17 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(6256KiB/46644msec) clat (msec): min=6, max=185, avg=26.47, stdev=24.75 lat (msec): min=6, max=185, avg=26.47, stdev=24.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 45], 95.00th=[ 68], | 99.00th=[ 148], 99.50th=[ 180], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 320, per=27.85%, avg=137.83, stdev=82.11, samples=90 iops : min= 1, max= 20, avg= 7.97, stdev= 5.17, samples=90 write: IOPS=8, BW=129KiB/s (132kB/s)(6032KiB/46644msec); 0 zone resets clat (msec): min=42, max=229, avg=96.10, stdev=36.20 lat (msec): min=42, max=229, avg=96.11, stdev=36.20 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 66], | 30.00th=[ 73], 40.00th=[ 80], 50.00th=[ 88], 60.00th=[ 97], | 70.00th=[ 106], 80.00th=[ 123], 90.00th=[ 148], 95.00th=[ 169], | 99.00th=[ 220], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 256, per=24.82%, avg=129.09, stdev=44.05, samples=92 iops : min= 1, max= 16, avg= 7.41, stdev= 2.87, samples=92 lat (msec) : 10=4.17%, 20=23.83%, 50=20.44%, 100=31.90%, 250=19.66% cpu : usr=0.05%, sys=2.05%, ctx=1502, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145423: Wed Aug 26 20:28:17 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6032KiB/46688msec) clat (msec): min=6, max=195, avg=26.70, stdev=23.17 lat (msec): min=6, max=195, avg=26.70, stdev=23.17 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 47], 95.00th=[ 67], | 99.00th=[ 144], 99.50th=[ 157], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 22, max= 320, per=27.04%, avg=133.83, stdev=71.78, samples=88 iops : min= 1, max= 20, avg= 7.70, stdev= 4.60, samples=88 write: IOPS=8, BW=134KiB/s (137kB/s)(6256KiB/46688msec); 0 zone resets clat (msec): min=42, max=334, avg=93.57, stdev=38.07 lat (msec): min=42, max=334, avg=93.57, stdev=38.07 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 52], 10.00th=[ 57], 20.00th=[ 65], | 30.00th=[ 71], 40.00th=[ 80], 50.00th=[ 87], 60.00th=[ 93], | 70.00th=[ 100], 80.00th=[ 116], 90.00th=[ 144], 95.00th=[ 167], | 99.00th=[ 257], 99.50th=[ 266], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 32, max= 256, per=25.70%, avg=133.62, stdev=45.94, samples=92 iops : min= 2, max= 16, avg= 7.70, stdev= 2.96, samples=92 lat (msec) : 10=4.17%, 20=20.96%, 50=20.96%, 100=37.89%, 250=15.49% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.99%, ctx=1450, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=495KiB/s (507kB/s), 119KiB/s-134KiB/s (122kB/s-137kB/s), io=23.4MiB (24.5MB), run=46644-48379msec WRITE: bw=521KiB/s (533kB/s), 129KiB/s-135KiB/s (132kB/s-139kB/s), io=24.6MiB (25.8MB), run=46644-48379msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145440: Wed Aug 26 20:28:28 2026 read: IOPS=1, BW=1756KiB/s (1798kB/s)(7168KiB/4083msec) clat (usec): min=525, max=1989.7k, avg=371243.56, stdev=721925.78 lat (usec): min=526, max=1989.7k, avg=371244.96, stdev=721925.87 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 529], 30.00th=[ 3228], 40.00th=[ 3228], | 50.00th=[ 119014], 60.00th=[ 223347], 70.00th=[ 223347], | 80.00th=[ 263193], 90.00th=[1988101], 95.00th=[1988101], | 99.00th=[1988101], 99.50th=[1988101], 99.90th=[1988101], | 99.95th=[1988101], 99.99th=[1988101] bw ( KiB/s): min= 1815, max= 3976, per=56.72%, avg=2844.75, stdev=1083.49, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1254KiB/s (1284kB/s)(5120KiB/4083msec); 0 zone resets clat (msec): min=152, max=602, avg=292.07, stdev=179.26 lat (msec): min=152, max=602, avg=292.13, stdev=179.23 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1988, max= 5446, per=52.93%, avg=3717.00, stdev=2445.18, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 250=41.67%, 500=16.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=16.76%, ctx=346, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145441: Wed Aug 26 20:28:28 2026 read: IOPS=0, BW=516KiB/s (528kB/s)(2048KiB/3971msec) clat (usec): min=512, max=128071, avg=64291.96, stdev=90197.20 lat (usec): min=514, max=128074, avg=64294.28, stdev=90198.53 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 515], 60.00th=[128451], | 70.00th=[128451], 80.00th=[128451], 90.00th=[128451], 95.00th=[128451], | 99.00th=[128451], 99.50th=[128451], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 1750, max= 2027, per=37.66%, avg=1888.50, stdev=195.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2579KiB/s (2641kB/s)(10.0MiB/3971msec); 0 zone resets clat (msec): min=152, max=715, avg=382.25, stdev=194.17 lat (msec): min=152, max=716, avg=382.34, stdev=194.20 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 163], | 30.00th=[ 224], 40.00th=[ 243], 50.00th=[ 351], 60.00th=[ 355], | 70.00th=[ 502], 80.00th=[ 510], 90.00th=[ 609], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2027, max= 4071, per=50.58%, avg=3552.00, stdev=870.92, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=16.67%, 750=33.33% cpu : usr=0.00%, sys=19.57%, ctx=167, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145442: Wed Aug 26 20:28:28 2026 read: IOPS=1, BW=1765KiB/s (1807kB/s)(6144KiB/3482msec) clat (usec): min=522, max=226757, avg=131707.83, stdev=103343.00 lat (usec): min=523, max=226758, avg=131709.16, stdev=103342.84 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 1221], | 30.00th=[ 1221], 40.00th=[164627], 50.00th=[164627], 60.00th=[191890], | 70.00th=[204473], 80.00th=[204473], 90.00th=[227541], 95.00th=[227541], | 99.00th=[227541], 99.50th=[227541], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 1988, max= 4079, per=67.28%, avg=3374.00, stdev=1200.37, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1765KiB/s (1807kB/s)(6144KiB/3482msec); 0 zone resets clat (msec): min=157, max=928, avg=446.79, stdev=276.36 lat (msec): min=162, max=928, avg=447.80, stdev=275.20 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 393], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1988, max= 3663, per=34.58%, avg=2428.25, stdev=823.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.06%, sys=18.79%, ctx=368, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145443: Wed Aug 26 20:28:28 2026 read: IOPS=1, BW=1604KiB/s (1642kB/s)(5120KiB/3193msec) clat (usec): min=988, max=199259, avg=113359.54, stdev=103213.77 lat (usec): min=989, max=199260, avg=113360.86, stdev=103213.80 clat percentiles (usec): | 1.00th=[ 988], 5.00th=[ 988], 10.00th=[ 988], 20.00th=[ 988], | 30.00th=[ 1074], 40.00th=[ 1074], 50.00th=[168821], 60.00th=[168821], | 70.00th=[196084], 80.00th=[196084], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 2035, max= 6119, per=81.30%, avg=4077.00, stdev=2887.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2245KiB/s (2299kB/s)(7168KiB/3193msec); 0 zone resets clat (msec): min=194, max=894, avg=374.25, stdev=256.67 lat (msec): min=194, max=894, avg=374.33, stdev=256.67 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 207], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 251], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 535], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1825, max= 4055, per=42.33%, avg=2972.75, stdev=1207.54, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=58.33%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=23.43%, ctx=285, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5016KiB/s (5136kB/s), 516KiB/s-1765KiB/s (528kB/s-1807kB/s), io=20.0MiB (20.0MB), run=3193-4083msec WRITE: bw=7022KiB/s (7191kB/s), 1254KiB/s-2579KiB/s (1284kB/s-2641kB/s), io=28.0MiB (29.4MB), run=3193-4083msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145445: Wed Aug 26 20:28:29 2026 read: IOPS=1, BW=1644KiB/s (1684kB/s)(7168KiB/4359msec) clat (msec): min=51, max=1356, avg=399.00, stdev=466.70 lat (msec): min=51, max=1356, avg=399.00, stdev=466.70 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 52], 10.00th=[ 52], 20.00th=[ 68], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 236], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 634], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 1475, max= 2043, per=40.96%, avg=1924.33, stdev=223.45, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1175KiB/s (1203kB/s)(5120KiB/4359msec); 0 zone resets clat (msec): min=128, max=575, avg=303.76, stdev=221.16 lat (msec): min=129, max=575, avg=303.85, stdev=221.16 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1939, max= 6107, per=61.17%, avg=4023.00, stdev=2947.22, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=4.15%, ctx=75, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145446: Wed Aug 26 20:28:29 2026 read: IOPS=0, BW=509KiB/s (521kB/s)(2048KiB/4027msec) clat (msec): min=89, max=473, avg=281.66, stdev=271.07 lat (msec): min=89, max=473, avg=281.66, stdev=271.07 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1556, max= 2035, per=38.22%, avg=1795.50, stdev=338.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2543KiB/s (2604kB/s)(10.0MiB/4027msec); 0 zone resets clat (msec): min=140, max=767, avg=345.90, stdev=193.46 lat (msec): min=140, max=767, avg=346.04, stdev=193.42 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 148], | 30.00th=[ 218], 40.00th=[ 230], 50.00th=[ 284], 60.00th=[ 296], | 70.00th=[ 439], 80.00th=[ 468], 90.00th=[ 477], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1939, max= 4079, per=42.98%, avg=2827.00, stdev=1132.65, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=50.00%, 1000=8.33% cpu : usr=0.00%, sys=8.94%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145447: Wed Aug 26 20:28:29 2026 read: IOPS=1, BW=1625KiB/s (1664kB/s)(6144KiB/3780msec) clat (msec): min=77, max=383, avg=159.48, stdev=114.06 lat (msec): min=77, max=383, avg=159.48, stdev=114.06 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 101], 50.00th=[ 101], 60.00th=[ 148], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 1939, max= 4055, per=53.47%, avg=2512.00, stdev=1029.52, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1625KiB/s (1664kB/s)(6144KiB/3780msec); 0 zone resets clat (msec): min=111, max=990, avg=462.53, stdev=293.61 lat (msec): min=111, max=990, avg=462.62, stdev=293.61 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1473, max= 2043, per=29.26%, avg=1924.67, stdev=224.66, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=6.88%, ctx=96, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145448: Wed Aug 26 20:28:29 2026 read: IOPS=1, BW=1249KiB/s (1279kB/s)(5120KiB/4098msec) clat (msec): min=47, max=608, avg=218.71, stdev=241.77 lat (msec): min=47, max=608, avg=218.71, stdev=241.77 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 48], 10.00th=[ 48], 20.00th=[ 48], | 30.00th=[ 60], 40.00th=[ 60], 50.00th=[ 78], 60.00th=[ 78], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2027, max= 3878, per=56.34%, avg=2646.67, stdev=1066.37, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1749KiB/s (1791kB/s)(7168KiB/4098msec); 0 zone resets clat (msec): min=131, max=1011, avg=427.78, stdev=315.71 lat (msec): min=131, max=1011, avg=427.89, stdev=315.70 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 157], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 347], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 625], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1539, max= 4055, per=38.69%, avg=2544.33, stdev=1331.95, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=16.67%, 750=25.00% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=6.79%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4698KiB/s (4811kB/s), 509KiB/s-1644KiB/s (521kB/s-1684kB/s), io=20.0MiB (20.0MB), run=3780-4359msec WRITE: bw=6578KiB/s (6736kB/s), 1175KiB/s-2543KiB/s (1203kB/s-2604kB/s), io=28.0MiB (29.4MB), run=3780-4359msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145455: Wed Aug 26 20:28:38 2026 read: IOPS=3, BW=14.2MiB/s (14.9MB/s)(12.0MiB/843msec) clat (msec): min=176, max=388, avg=252.64, stdev=117.61 lat (msec): min=176, max=388, avg=252.64, stdev=117.61 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min=12641, max=12641, per=81.55%, avg=12641.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 500=33.33% cpu : usr=0.00%, sys=15.32%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145456: Wed Aug 26 20:28:38 2026 read: IOPS=0, BW=3875KiB/s (3968kB/s)(4096KiB/1057msec) clat (nsec): min=150066k, max=150066k, avg=150065774.00, stdev= 0.00 lat (nsec): min=150069k, max=150069k, avg=150069272.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 150], 80.00th=[ 150], 90.00th=[ 150], 95.00th=[ 150], | 99.00th=[ 150], 99.50th=[ 150], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 5626, max= 5626, per=36.30%, avg=5626.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=7750KiB/s (7936kB/s)(8192KiB/1057msec); 0 zone resets clat (msec): min=359, max=465, avg=412.69, stdev=74.63 lat (msec): min=363, max=466, avg=414.84, stdev=72.42 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 5626, max= 5626, per=29.05%, avg=5626.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=15.72%, ctx=77, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145457: Wed Aug 26 20:28:38 2026 write: IOPS=1, BW=7262KiB/s (7437kB/s)(12.0MiB/1692msec); 0 zone resets clat (msec): min=487, max=626, avg=541.24, stdev=74.52 lat (msec): min=487, max=626, avg=541.80, stdev=74.42 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 6781, max= 8192, per=38.66%, avg=7486.50, stdev=997.73, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.12%, sys=10.94%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145458: Wed Aug 26 20:28:38 2026 write: IOPS=3, BW=12.2MiB/s (12.8MB/s)(12.0MiB/980msec); 0 zone resets clat (msec): min=269, max=366, avg=308.85, stdev=51.00 lat (msec): min=269, max=366, avg=309.92, stdev=50.63 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 292], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 6095, max= 6095, per=31.47%, avg=6095.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=13.48%, ctx=32, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=15.1MiB/s (15.9MB/s), 3875KiB/s-14.2MiB/s (3968kB/s-14.9MB/s), io=16.0MiB (16.8MB), run=843-1057msec WRITE: bw=18.9MiB/s (19.8MB/s), 7262KiB/s-12.2MiB/s (7437kB/s-12.8MB/s), io=32.0MiB (33.6MB), run=980-1692msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145460: Wed Aug 26 20:28:39 2026 read: IOPS=1, BW=6266KiB/s (6417kB/s)(12.0MiB/1961msec) clat (msec): min=589, max=714, avg=653.32, stdev=62.55 lat (msec): min=589, max=714, avg=653.33, stdev=62.55 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 6187, max= 8175, per=92.18%, avg=7181.00, stdev=1405.73, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=17.50%, ctx=457, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145461: Wed Aug 26 20:28:39 2026 read: IOPS=0, BW=1948KiB/s (1994kB/s)(4096KiB/2103msec) clat (nsec): min=674497k, max=674497k, avg=674496985.00, stdev= 0.00 lat (nsec): min=674500k, max=674500k, avg=674499803.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 5962, max= 5962, per=76.53%, avg=5962.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3895KiB/s (3989kB/s)(8192KiB/2103msec); 0 zone resets clat (msec): min=344, max=1078, avg=711.64, stdev=518.95 lat (msec): min=345, max=1078, avg=712.02, stdev=518.94 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8143, max= 8143, per=53.80%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.14%, sys=11.27%, ctx=181, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145462: Wed Aug 26 20:28:39 2026 write: IOPS=1, BW=5676KiB/s (5812kB/s)(12.0MiB/2165msec); 0 zone resets clat (msec): min=414, max=1061, avg=720.53, stdev=324.64 lat (msec): min=414, max=1061, avg=720.87, stdev=324.67 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8143, max= 8143, per=53.80%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=11.60%, ctx=68, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145463: Wed Aug 26 20:28:39 2026 write: IOPS=2, BW=8275KiB/s (8473kB/s)(12.0MiB/1485msec); 0 zone resets clat (msec): min=247, max=619, avg=493.65, stdev=212.76 lat (msec): min=248, max=620, avg=494.38, stdev=212.93 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 5468, max= 8143, per=44.97%, avg=6805.50, stdev=1891.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.07%, sys=9.97%, ctx=70, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7791KiB/s (7978kB/s), 1948KiB/s-6266KiB/s (1994kB/s-6417kB/s), io=16.0MiB (16.8MB), run=1961-2103msec WRITE: bw=14.8MiB/s (15.5MB/s), 3895KiB/s-8275KiB/s (3989kB/s-8473kB/s), io=32.0MiB (33.6MB), run=1485-2165msec