== sanity test 398b: DIO and buffer IO race ============== 21:22:22 (1788657742) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.79614 s, 10.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179559: Sat Sep 5 21:24:23 2026 read: IOPS=14, BW=56.3KiB/s (57.6kB/s)(5992KiB/106434msec) clat (usec): min=47, max=562665, avg=39460.96, stdev=27094.99 lat (usec): min=48, max=562667, avg=39463.18, stdev=27093.92 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10683], 10.00th=[ 15664], 20.00th=[ 21365], | 30.00th=[ 25560], 40.00th=[ 30016], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[119014], 99.50th=[145753], 99.90th=[179307], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 12, max= 111, per=24.84%, avg=55.64, stdev=18.12, samples=210 iops : min= 3, max= 27, avg=13.26, stdev= 4.54, samples=210 write: IOPS=14, BW=59.2KiB/s (60.6kB/s)(6296KiB/106434msec); 0 zone resets clat (usec): min=956, max=235188, avg=29939.63, stdev=30117.06 lat (usec): min=958, max=235189, avg=29941.68, stdev=30117.13 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1303], 10.00th=[ 1926], 20.00th=[ 3589], | 30.00th=[ 6587], 40.00th=[ 14091], 50.00th=[ 21627], 60.00th=[ 29230], | 70.00th=[ 38536], 80.00th=[ 53740], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[124257], 99.50th=[139461], 99.90th=[214959], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 15, max= 142, per=25.04%, avg=58.85, stdev=23.17, samples=209 iops : min= 3, max= 35, avg=14.06, stdev= 5.82, samples=209 lat (usec) : 50=0.13%, 100=1.46%, 250=0.23%, 500=0.03%, 1000=0.13% lat (msec) : 2=5.57%, 4=5.63%, 10=7.62%, 20=12.11%, 50=43.03% lat (msec) : 100=21.58%, 250=2.44%, 750=0.03% cpu : usr=0.08%, sys=6.15%, ctx=6902, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179560: Sat Sep 5 21:24:23 2026 read: IOPS=14, BW=56.1KiB/s (57.5kB/s)(5940KiB/105845msec) clat (usec): min=39, max=549074, avg=39594.50, stdev=28290.35 lat (usec): min=39, max=549075, avg=39595.90, stdev=28290.35 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 12649], 10.00th=[ 16581], 20.00th=[ 21103], | 30.00th=[ 24773], 40.00th=[ 28967], 50.00th=[ 34341], 60.00th=[ 39060], | 70.00th=[ 45351], 80.00th=[ 54789], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[141558], 99.50th=[166724], 99.90th=[217056], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 6, max= 111, per=24.94%, avg=55.87, stdev=20.28, samples=208 iops : min= 1, max= 27, avg=13.32, stdev= 5.09, samples=208 write: IOPS=14, BW=59.0KiB/s (61.4kB/s)(6348KiB/105845msec); 0 zone resets clat (usec): min=968, max=236284, avg=29516.46, stdev=29497.87 lat (usec): min=969, max=236285, avg=29519.42, stdev=29497.86 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1450], 10.00th=[ 2040], 20.00th=[ 3752], | 30.00th=[ 6652], 40.00th=[ 13304], 50.00th=[ 21890], 60.00th=[ 28967], | 70.00th=[ 37487], 80.00th=[ 52167], 90.00th=[ 70779], 95.00th=[ 87557], | 99.00th=[124257], 99.50th=[135267], 99.90th=[177210], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 152, per=25.36%, avg=59.60, stdev=23.18, samples=208 iops : min= 1, max= 38, avg=14.25, stdev= 5.82, samples=208 lat (usec) : 50=0.07%, 100=1.24%, 250=0.13%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=4.75%, 4=6.22%, 10=7.85%, 20=12.63%, 50=44.40% lat (msec) : 100=19.95%, 250=2.57%, 750=0.03% cpu : usr=0.08%, sys=6.13%, ctx=6940, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179561: Sat Sep 5 21:24:23 2026 read: IOPS=14, BW=57.3KiB/s (58.7kB/s)(6028KiB/105235msec) clat (usec): min=36, max=187503, avg=38071.79, stdev=23409.09 lat (usec): min=36, max=187504, avg=38073.20, stdev=23409.17 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9634], 10.00th=[ 15270], 20.00th=[ 20317], | 30.00th=[ 24773], 40.00th=[ 28967], 50.00th=[ 33424], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 53216], 90.00th=[ 67634], 95.00th=[ 80217], | 99.00th=[111674], 99.50th=[131597], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 23, max= 135, per=25.47%, avg=57.06, stdev=20.45, samples=207 iops : min= 5, max= 33, avg=13.61, stdev= 5.15, samples=207 write: IOPS=14, BW=59.5KiB/s (60.9kB/s)(6260KiB/105235msec); 0 zone resets clat (usec): min=1040, max=588074, avg=30470.38, stdev=32842.17 lat (usec): min=1042, max=588076, avg=30473.69, stdev=32841.76 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1516], 10.00th=[ 2147], 20.00th=[ 3916], | 30.00th=[ 6587], 40.00th=[ 13173], 50.00th=[ 22676], 60.00th=[ 29754], | 70.00th=[ 39060], 80.00th=[ 54264], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[127402], 99.50th=[139461], 99.90th=[179307], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 6, max= 127, per=25.10%, avg=58.98, stdev=23.79, samples=208 iops : min= 1, max= 31, avg=14.10, stdev= 5.96, samples=208 lat (usec) : 50=0.13%, 100=1.73%, 250=0.23%, 500=0.10% lat (msec) : 2=4.46%, 4=6.02%, 10=8.33%, 20=12.37%, 50=43.03% lat (msec) : 100=21.00%, 250=2.57%, 750=0.03% cpu : usr=0.10%, sys=6.25%, ctx=6964, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179562: Sat Sep 5 21:24:23 2026 read: IOPS=14, BW=56.6KiB/s (57.0kB/s)(6052KiB/106905msec) clat (usec): min=40, max=235371, avg=39465.14, stdev=26155.66 lat (usec): min=41, max=235373, avg=39467.98, stdev=26155.11 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10159], 10.00th=[ 15270], 20.00th=[ 20317], | 30.00th=[ 24511], 40.00th=[ 28443], 50.00th=[ 33424], 60.00th=[ 40109], | 70.00th=[ 47449], 80.00th=[ 55837], 90.00th=[ 67634], 95.00th=[ 84411], | 99.00th=[129500], 99.50th=[154141], 99.90th=[208667], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=56.02, stdev=18.70, samples=210 iops : min= 1, max= 27, avg=13.35, stdev= 4.71, samples=210 write: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6236KiB/106905msec); 0 zone resets clat (usec): min=950, max=600639, avg=30183.42, stdev=33238.35 lat (usec): min=952, max=600641, avg=30185.88, stdev=33237.87 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1434], 10.00th=[ 2040], 20.00th=[ 3654], | 30.00th=[ 6194], 40.00th=[ 14222], 50.00th=[ 22414], 60.00th=[ 29492], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[128451], 99.50th=[143655], 99.90th=[221250], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 6, max= 143, per=24.50%, avg=57.56, stdev=24.06, samples=211 iops : min= 1, max= 35, avg=13.74, stdev= 6.04, samples=211 lat (usec) : 50=0.10%, 100=1.46%, 250=0.26%, 1000=0.13% lat (msec) : 2=4.85%, 4=6.35%, 10=7.42%, 20=12.86%, 50=42.38% lat (msec) : 100=21.03%, 250=3.12%, 750=0.03% cpu : usr=0.09%, sys=6.00%, ctx=6833, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=225KiB/s (230kB/s), 56.1KiB/s-57.3KiB/s (57.5kB/s-58.7kB/s), io=23.4MiB (24.6MB), run=105235-106905msec WRITE: bw=235KiB/s (241kB/s), 58.3KiB/s-59.0KiB/s (59.7kB/s-61.4kB/s), io=24.6MiB (25.7MB), run=105235-106905msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179554: Sat Sep 5 21:24:59 2026 read: IOPS=10, BW=42.2KiB/s (43.2kB/s)(5992KiB/141951msec) clat (msec): min=5, max=758, avg=37.08, stdev=38.36 lat (msec): min=5, max=758, avg=37.08, stdev=38.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 87], 95.00th=[ 112], | 99.00th=[ 163], 99.50th=[ 190], 99.90th=[ 245], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 151, per=25.33%, avg=42.55, stdev=29.02, samples=275 iops : min= 1, max= 37, avg=10.00, stdev= 7.28, samples=275 write: IOPS=11, BW=44.4KiB/s (45.4kB/s)(6296KiB/141951msec); 0 zone resets clat (msec): min=11, max=316, avg=54.65, stdev=38.25 lat (msec): min=11, max=316, avg=54.65, stdev=38.25 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 83], 90.00th=[ 107], 95.00th=[ 126], | 99.00th=[ 201], 99.50th=[ 220], 99.90th=[ 279], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 127, per=25.11%, avg=44.20, stdev=28.10, samples=278 iops : min= 1, max= 31, avg=10.42, stdev= 7.06, samples=278 lat (msec) : 10=3.52%, 20=20.18%, 50=45.25%, 100=21.68%, 250=9.28% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=2.09%, ctx=4850, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179555: Sat Sep 5 21:24:59 2026 read: IOPS=10, BW=41.6KiB/s (42.6kB/s)(5940KiB/142741msec) clat (msec): min=5, max=755, avg=37.75, stdev=41.54 lat (msec): min=5, max=755, avg=37.75, stdev=41.54 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 55], 90.00th=[ 88], 95.00th=[ 114], | 99.00th=[ 188], 99.50th=[ 226], 99.90th=[ 317], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 175, per=24.95%, avg=41.91, stdev=28.93, samples=277 iops : min= 1, max= 43, avg= 9.85, stdev= 7.27, samples=277 write: IOPS=11, BW=44.5KiB/s (45.5kB/s)(6348KiB/142741msec); 0 zone resets clat (msec): min=10, max=293, avg=54.37, stdev=37.82 lat (msec): min=10, max=293, avg=54.38, stdev=37.82 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 81], 90.00th=[ 107], 95.00th=[ 131], | 99.00th=[ 190], 99.50th=[ 211], 99.90th=[ 262], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 136, per=25.20%, avg=44.35, stdev=28.52, samples=280 iops : min= 1, max= 34, avg=10.46, stdev= 7.17, samples=280 lat (msec) : 10=3.61%, 20=20.12%, 50=45.21%, 100=21.58%, 250=9.21% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=2.07%, ctx=4905, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179556: Sat Sep 5 21:24:59 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6028KiB/141851msec) clat (msec): min=5, max=321, avg=37.45, stdev=35.08 lat (msec): min=5, max=321, avg=37.45, stdev=35.09 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 109], | 99.00th=[ 169], 99.50th=[ 192], 99.90th=[ 305], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 151, per=25.44%, avg=42.74, stdev=29.01, samples=276 iops : min= 1, max= 37, avg=10.05, stdev= 7.29, samples=276 write: IOPS=11, BW=44.1KiB/s (45.2kB/s)(6260KiB/141851msec); 0 zone resets clat (msec): min=9, max=792, avg=54.32, stdev=42.21 lat (msec): min=9, max=792, avg=54.33, stdev=42.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 79], 90.00th=[ 105], 95.00th=[ 132], | 99.00th=[ 197], 99.50th=[ 220], 99.90th=[ 326], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 128, per=25.00%, avg=44.00, stdev=28.16, samples=278 iops : min= 1, max= 32, avg=10.37, stdev= 7.08, samples=278 lat (msec) : 10=3.26%, 20=19.63%, 50=45.87%, 100=22.30%, 250=8.72% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=2.10%, ctx=4951, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179557: Sat Sep 5 21:24:59 2026 read: IOPS=10, BW=43.2KiB/s (44.2kB/s)(6052KiB/140129msec) clat (msec): min=5, max=312, avg=36.29, stdev=33.78 lat (msec): min=5, max=312, avg=36.29, stdev=33.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 109], | 99.00th=[ 159], 99.50th=[ 186], 99.90th=[ 239], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 144, per=26.06%, avg=43.77, stdev=29.27, samples=271 iops : min= 1, max= 36, avg=10.31, stdev= 7.35, samples=271 write: IOPS=11, BW=44.5KiB/s (45.6kB/s)(6236KiB/140129msec); 0 zone resets clat (msec): min=10, max=801, avg=54.42, stdev=41.74 lat (msec): min=10, max=801, avg=54.42, stdev=41.74 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 81], 90.00th=[ 103], 95.00th=[ 128], | 99.00th=[ 190], 99.50th=[ 215], 99.90th=[ 292], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 135, per=25.25%, avg=44.44, stdev=27.95, samples=275 iops : min= 1, max= 33, avg=10.47, stdev= 7.02, samples=275 lat (msec) : 10=3.78%, 20=19.92%, 50=44.99%, 100=22.36%, 250=8.79% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.13%, ctx=4901, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=168KiB/s (172kB/s), 41.6KiB/s-43.2KiB/s (42.6kB/s-44.2kB/s), io=23.4MiB (24.6MB), run=140129-142741msec WRITE: bw=176KiB/s (180kB/s), 44.1KiB/s-44.5KiB/s (45.2kB/s-45.6kB/s), io=24.6MiB (25.7MB), run=140129-142741msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179605: Sat Sep 5 21:25:38 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5920KiB/29241msec) clat (usec): min=43, max=167180, avg=41506.47, stdev=24017.93 lat (usec): min=43, max=167181, avg=41507.80, stdev=24017.94 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 70], 10.00th=[ 14877], 20.00th=[ 23200], | 30.00th=[ 28443], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 60031], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[105382], 99.50th=[123208], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 63, max= 414, per=25.76%, avg=200.89, stdev=62.03, samples=57 iops : min= 3, max= 25, avg=11.82, stdev= 3.88, samples=57 write: IOPS=13, BW=218KiB/s (223kB/s)(6368KiB/29241msec); 0 zone resets clat (usec): min=1314, max=232357, avg=34283.81, stdev=32831.12 lat (usec): min=1315, max=232359, avg=34287.11, stdev=32831.06 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2311], 10.00th=[ 3556], 20.00th=[ 5538], | 30.00th=[ 9896], 40.00th=[ 18482], 50.00th=[ 25297], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 58983], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[162530], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 29, max= 415, per=26.53%, avg=217.81, stdev=80.65, samples=57 iops : min= 1, max= 25, avg=12.88, stdev= 5.05, samples=57 lat (usec) : 50=0.65%, 100=2.47%, 250=0.39% lat (msec) : 2=1.82%, 4=5.60%, 10=8.59%, 20=9.90%, 50=41.15% lat (msec) : 100=26.30%, 250=3.12% cpu : usr=0.06%, sys=6.43%, ctx=1757, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179606: Sat Sep 5 21:25:38 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(5744KiB/29168msec) clat (usec): min=38, max=144659, avg=43594.58, stdev=26381.98 lat (usec): min=38, max=144660, avg=43596.28, stdev=26382.37 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 89], 10.00th=[ 19006], 20.00th=[ 24773], | 30.00th=[ 29492], 40.00th=[ 33162], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 89654], | 99.00th=[141558], 99.50th=[143655], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 29, max= 349, per=24.95%, avg=194.58, stdev=67.96, samples=57 iops : min= 1, max= 21, avg=11.40, stdev= 4.34, samples=57 write: IOPS=14, BW=224KiB/s (230kB/s)(6544KiB/29168msec); 0 zone resets clat (usec): min=1589, max=172847, avg=32348.94, stdev=29870.85 lat (usec): min=1590, max=172849, avg=32363.33, stdev=29896.62 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2114], 10.00th=[ 3163], 20.00th=[ 5800], | 30.00th=[ 10683], 40.00th=[ 18744], 50.00th=[ 24511], 60.00th=[ 30540], | 70.00th=[ 41681], 80.00th=[ 52691], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[119014], 99.50th=[149947], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 32, max= 445, per=26.85%, avg=220.47, stdev=91.40, samples=57 iops : min= 2, max= 27, avg=13.05, stdev= 5.71, samples=57 lat (usec) : 50=0.26%, 100=2.21%, 250=0.26%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.69%, 4=6.25%, 10=7.55%, 20=8.72%, 50=44.92% lat (msec) : 100=24.22%, 250=3.52% cpu : usr=0.09%, sys=6.07%, ctx=1797, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179607: Sat Sep 5 21:25:38 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30684msec) clat (usec): min=46, max=192943, avg=43518.56, stdev=28353.90 lat (usec): min=47, max=192945, avg=43527.04, stdev=28355.71 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 16712], 20.00th=[ 23725], | 30.00th=[ 27132], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[170918], 99.50th=[177210], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 59, max= 444, per=26.05%, avg=203.17, stdev=77.00, samples=60 iops : min= 3, max= 27, avg=11.95, stdev= 4.80, samples=60 write: IOPS=12, BW=197KiB/s (201kB/s)(6032KiB/30684msec); 0 zone resets clat (usec): min=1523, max=158193, avg=35844.42, stdev=33085.85 lat (usec): min=1524, max=158195, avg=35848.54, stdev=33084.01 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2212], 10.00th=[ 3589], 20.00th=[ 5932], | 30.00th=[ 10421], 40.00th=[ 19792], 50.00th=[ 26870], 60.00th=[ 35390], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[139461], 99.50th=[143655], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 351, per=23.85%, avg=195.85, stdev=72.32, samples=59 iops : min= 3, max= 21, avg=11.49, stdev= 4.54, samples=59 lat (usec) : 50=0.26%, 100=2.60%, 250=0.52% lat (msec) : 2=1.95%, 4=3.39%, 10=8.85%, 20=10.16%, 50=43.49% lat (msec) : 100=23.96%, 250=4.82% cpu : usr=0.06%, sys=5.64%, ctx=1821, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179608: Sat Sep 5 21:25:38 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28808msec) clat (usec): min=35, max=209281, avg=40374.64, stdev=29179.66 lat (usec): min=36, max=209283, avg=40376.80, stdev=29179.53 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 78], 20.00th=[ 20841], | 30.00th=[ 25822], 40.00th=[ 29754], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 57934], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[158335], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 93, max= 351, per=27.25%, avg=212.54, stdev=69.30, samples=56 iops : min= 5, max= 21, avg=12.55, stdev= 4.31, samples=56 write: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28808msec); 0 zone resets clat (usec): min=1341, max=166193, avg=33911.85, stdev=32801.64 lat (usec): min=1344, max=166195, avg=33914.49, stdev=32802.30 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2311], 10.00th=[ 3195], 20.00th=[ 5669], | 30.00th=[ 8291], 40.00th=[ 14091], 50.00th=[ 23462], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[137364], 99.50th=[147850], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 93, max= 383, per=26.47%, avg=217.30, stdev=75.71, samples=57 iops : min= 5, max= 23, avg=12.84, stdev= 4.73, samples=57 lat (usec) : 50=0.65%, 100=5.08%, 250=0.65% lat (msec) : 2=1.69%, 4=5.86%, 10=9.90%, 20=8.59%, 50=39.45% lat (msec) : 100=23.70%, 250=4.43% cpu : usr=0.08%, sys=5.76%, ctx=1717, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=781KiB/s (799kB/s), 197KiB/s-209KiB/s (202kB/s-214kB/s), io=23.4MiB (24.5MB), run=28808-30684msec WRITE: bw=821KiB/s (841kB/s), 197KiB/s-224KiB/s (201kB/s-230kB/s), io=24.6MiB (25.8MB), run=28808-30684msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179601: Sat Sep 5 21:25:49 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5920KiB/41220msec) clat (msec): min=8, max=269, avg=44.17, stdev=34.30 lat (msec): min=8, max=269, avg=44.17, stdev=34.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 87], 95.00th=[ 116], | 99.00th=[ 174], 99.50th=[ 209], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 407, per=24.73%, avg=142.43, stdev=82.76, samples=81 iops : min= 1, max= 25, avg= 8.11, stdev= 5.29, samples=81 write: IOPS=9, BW=154KiB/s (158kB/s)(6368KiB/41220msec); 0 zone resets clat (msec): min=15, max=221, avg=62.33, stdev=39.20 lat (msec): min=15, max=221, avg=62.34, stdev=39.21 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 138], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 384, per=25.70%, avg=155.71, stdev=80.29, samples=80 iops : min= 1, max= 24, avg= 8.95, stdev= 5.11, samples=80 lat (msec) : 10=0.39%, 20=10.16%, 50=49.87%, 100=27.60%, 250=11.85% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.02%, ctx=1230, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179602: Sat Sep 5 21:25:49 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(5744KiB/40943msec) clat (msec): min=6, max=226, avg=42.36, stdev=33.70 lat (msec): min=6, max=226, avg=42.36, stdev=33.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 56], 90.00th=[ 86], 95.00th=[ 122], | 99.00th=[ 167], 99.50th=[ 226], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 28, max= 416, per=24.35%, avg=140.25, stdev=83.72, samples=81 iops : min= 1, max= 26, avg= 7.96, stdev= 5.34, samples=81 write: IOPS=9, BW=160KiB/s (164kB/s)(6544KiB/40943msec); 0 zone resets clat (msec): min=17, max=296, avg=62.55, stdev=40.35 lat (msec): min=17, max=296, avg=62.55, stdev=40.35 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 59], | 70.00th=[ 69], 80.00th=[ 86], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 236], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 381, per=26.29%, avg=159.33, stdev=78.84, samples=81 iops : min= 1, max= 23, avg= 9.16, stdev= 5.02, samples=81 lat (msec) : 10=1.30%, 20=9.77%, 50=49.61%, 100=28.78%, 250=10.29% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.99%, ctx=1213, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179603: Sat Sep 5 21:25:49 2026 read: IOPS=9, BW=151KiB/s (154kB/s)(6256KiB/41568msec) clat (msec): min=7, max=234, avg=45.12, stdev=37.39 lat (msec): min=7, max=234, avg=45.12, stdev=37.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 414, per=26.13%, avg=150.52, stdev=95.87, samples=82 iops : min= 1, max= 25, avg= 8.61, stdev= 6.12, samples=82 write: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41568msec); 0 zone resets clat (msec): min=16, max=286, avg=63.15, stdev=41.06 lat (msec): min=16, max=286, avg=63.15, stdev=41.06 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 146], | 99.00th=[ 190], 99.50th=[ 222], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 416, per=23.74%, avg=143.85, stdev=79.43, samples=82 iops : min= 1, max= 26, avg= 8.20, stdev= 5.06, samples=82 lat (msec) : 10=0.91%, 20=11.07%, 50=49.74%, 100=25.78%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.06%, ctx=1241, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179604: Sat Sep 5 21:25:49 2026 read: IOPS=9, BW=146KiB/s (149kB/s)(6032KiB/41318msec) clat (msec): min=8, max=265, avg=45.13, stdev=39.13 lat (msec): min=8, max=265, avg=45.14, stdev=39.13 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 107], 95.00th=[ 133], | 99.00th=[ 188], 99.50th=[ 241], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 352, per=25.08%, avg=144.46, stdev=83.46, samples=81 iops : min= 1, max= 22, avg= 8.23, stdev= 5.32, samples=81 write: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41318msec); 0 zone resets clat (msec): min=13, max=243, avg=61.71, stdev=39.42 lat (msec): min=13, max=243, avg=61.71, stdev=39.42 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 470, per=24.93%, avg=151.09, stdev=90.26, samples=81 iops : min= 1, max= 29, avg= 8.65, stdev= 5.76, samples=81 lat (msec) : 10=0.26%, 20=10.68%, 50=51.56%, 100=23.05%, 250=14.32% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.92%, ctx=1161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=576KiB/s (590kB/s), 140KiB/s-151KiB/s (144kB/s-154kB/s), io=23.4MiB (24.5MB), run=40943-41568msec WRITE: bw=606KiB/s (621kB/s), 145KiB/s-160KiB/s (149kB/s-164kB/s), io=24.6MiB (25.8MB), run=40943-41568msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179623: Sat Sep 5 21:26:04 2026 read: IOPS=2, BW=2685KiB/s (2749kB/s)(7168KiB/2670msec) clat (msec): min=131, max=392, avg=222.12, stdev=87.06 lat (msec): min=131, max=392, avg=222.12, stdev=87.06 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 159], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 203], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 262], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 2003, max= 4465, per=58.84%, avg=2632.50, stdev=1221.74, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1918KiB/s (1964kB/s)(5120KiB/2670msec); 0 zone resets clat (msec): min=130, max=387, avg=204.03, stdev=105.83 lat (msec): min=130, max=387, avg=204.20, stdev=105.79 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 131], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2027, max= 6107, per=64.93%, avg=4067.00, stdev=2885.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 250=75.00%, 500=25.00% cpu : usr=0.04%, sys=20.04%, ctx=243, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179625: Sat Sep 5 21:26:04 2026 read: IOPS=0, BW=447KiB/s (458kB/s)(2048KiB/4577msec) clat (msec): min=213, max=527, avg=370.24, stdev=221.70 lat (msec): min=213, max=527, avg=370.24, stdev=221.70 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1501, max= 2039, per=39.56%, avg=1770.00, stdev=380.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2237KiB/s (2291kB/s)(10.0MiB/4577msec); 0 zone resets clat (msec): min=81, max=722, avg=362.04, stdev=224.18 lat (msec): min=81, max=723, avg=362.15, stdev=224.18 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 123], | 30.00th=[ 127], 40.00th=[ 234], 50.00th=[ 334], 60.00th=[ 338], | 70.00th=[ 527], 80.00th=[ 550], 90.00th=[ 592], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2003, max= 4071, per=47.61%, avg=2982.33, stdev=1067.00, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=16.67%, 750=41.67% cpu : usr=0.00%, sys=16.04%, ctx=194, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179627: Sat Sep 5 21:26:04 2026 read: IOPS=2, BW=2237KiB/s (2290kB/s)(6144KiB/2747msec) clat (usec): min=1602, max=376119, avg=133935.26, stdev=141708.92 lat (usec): min=1603, max=376120, avg=133936.51, stdev=141709.03 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1598], 10.00th=[ 1598], 20.00th=[ 1876], | 30.00th=[ 1876], 40.00th=[ 93848], 50.00th=[ 93848], 60.00th=[124257], | 70.00th=[204473], 80.00th=[204473], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 2035, max= 4063, per=75.41%, avg=3373.67, stdev=1159.49, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2237KiB/s (2290kB/s)(6144KiB/2747msec); 0 zone resets clat (msec): min=145, max=587, avg=316.18, stdev=158.53 lat (msec): min=145, max=587, avg=316.24, stdev=158.55 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 305], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1943, max= 4071, per=38.59%, avg=2417.40, stdev=925.10, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 2=16.67%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=19.34%, ctx=86, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179628: Sat Sep 5 21:26:04 2026 read: IOPS=1, BW=1327KiB/s (1359kB/s)(5120KiB/3859msec) clat (usec): min=820, max=172791, avg=64737.99, stdev=87116.19 lat (usec): min=822, max=172792, avg=64739.09, stdev=87116.21 clat percentiles (usec): | 1.00th=[ 824], 5.00th=[ 824], 10.00th=[ 824], 20.00th=[ 824], | 30.00th=[ 1713], 40.00th=[ 1713], 50.00th=[ 1926], 60.00th=[ 1926], | 70.00th=[145753], 80.00th=[145753], 90.00th=[173016], 95.00th=[173016], | 99.00th=[173016], 99.50th=[173016], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 1861, max= 6011, per=87.97%, avg=3936.00, stdev=2934.49, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1857KiB/s (1902kB/s)(7168KiB/3859msec); 0 zone resets clat (msec): min=145, max=898, avg=475.21, stdev=354.80 lat (msec): min=146, max=898, avg=475.61, stdev=354.64 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 153], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 300], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 860], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 2003, max= 4007, per=46.93%, avg=2940.00, stdev=1074.42, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 250=41.67%, 500=8.33%, 1000=25.00% cpu : usr=0.03%, sys=15.16%, ctx=140, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4475KiB/s (4582kB/s), 447KiB/s-2685KiB/s (458kB/s-2749kB/s), io=20.0MiB (20.0MB), run=2670-4577msec WRITE: bw=6264KiB/s (6415kB/s), 1857KiB/s-2237KiB/s (1902kB/s-2291kB/s), io=28.0MiB (29.4MB), run=2670-4577msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179621: Sat Sep 5 21:26:05 2026 read: IOPS=1, BW=1641KiB/s (1681kB/s)(7168KiB/4367msec) clat (msec): min=84, max=863, avg=301.75, stdev=265.44 lat (msec): min=84, max=863, avg=301.75, stdev=265.44 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 142], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 230], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 388], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1537, max= 3716, per=53.42%, avg=2269.40, stdev=836.71, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1172KiB/s (1201kB/s)(5120KiB/4367msec); 0 zone resets clat (msec): min=140, max=844, avg=402.02, stdev=264.22 lat (msec): min=140, max=844, avg=403.68, stdev=263.92 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 2039, max= 4096, per=57.35%, avg=3410.33, stdev=1187.61, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 1000=16.67% cpu : usr=0.00%, sys=5.47%, ctx=120, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179622: Sat Sep 5 21:26:05 2026 read: IOPS=0, BW=425KiB/s (435kB/s)(2048KiB/4821msec) clat (msec): min=225, max=709, avg=467.71, stdev=342.64 lat (msec): min=225, max=709, avg=467.71, stdev=342.64 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2003, max= 2048, per=47.68%, avg=2025.50, stdev=31.82, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2124KiB/s (2175kB/s)(10.0MiB/4821msec); 0 zone resets clat (msec): min=127, max=1035, avg=378.83, stdev=299.82 lat (msec): min=127, max=1035, avg=378.95, stdev=299.80 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 138], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 257], 60.00th=[ 321], | 70.00th=[ 334], 80.00th=[ 468], 90.00th=[ 760], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 2003, max= 4096, per=53.64%, avg=3190.00, stdev=1074.16, samples=5 iops : min= 1, max= 4, avg= 2.60, stdev= 1.14, samples=5 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.06%, sys=6.31%, ctx=98, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179624: Sat Sep 5 21:26:05 2026 read: IOPS=1, BW=1359KiB/s (1391kB/s)(6144KiB/4522msec) clat (msec): min=92, max=161, avg=141.49, stdev=26.00 lat (msec): min=92, max=161, avg=141.49, stdev=26.00 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 157], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 2048, max= 4096, per=77.37%, avg=3286.67, stdev=1089.41, samples=3 iops : min= 2, max= 4, avg= 3.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1359KiB/s (1391kB/s)(6144KiB/4522msec); 0 zone resets clat (msec): min=120, max=1230, avg=564.20, stdev=374.82 lat (msec): min=120, max=1231, avg=564.71, stdev=374.60 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 567], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 2003, max= 2048, per=34.10%, avg=2028.20, stdev=23.30, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=5.15%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179626: Sat Sep 5 21:26:05 2026 read: IOPS=1, BW=1105KiB/s (1131kB/s)(5120KiB/4634msec) clat (msec): min=76, max=527, avg=302.80, stdev=207.99 lat (msec): min=76, max=527, avg=302.80, stdev=207.99 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2039, max= 3716, per=61.23%, avg=2601.00, stdev=965.63, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1547KiB/s (1584kB/s)(7168KiB/4634msec); 0 zone resets clat (msec): min=117, max=922, avg=417.87, stdev=260.63 lat (msec): min=117, max=922, avg=418.00, stdev=260.64 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 271], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 376], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 550], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 2003, max= 6131, per=68.55%, avg=4076.67, stdev=2064.07, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=6.11%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4248KiB/s (4350kB/s), 425KiB/s-1641KiB/s (435kB/s-1681kB/s), io=20.0MiB (20.0MB), run=4367-4821msec WRITE: bw=5947KiB/s (6090kB/s), 1172KiB/s-2124KiB/s (1201kB/s-2175kB/s), io=28.0MiB (29.4MB), run=4367-4821msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179640: Sat Sep 5 21:26:18 2026 read: IOPS=1, BW=5793KiB/s (5933kB/s)(12.0MiB/2121msec) clat (msec): min=567, max=760, avg=668.60, stdev=97.13 lat (msec): min=567, max=760, avg=668.60, stdev=97.13 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7627, max= 8143, per=100.00%, avg=7885.00, stdev=364.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.28%, sys=16.23%, ctx=204, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179641: Sat Sep 5 21:26:18 2026 read: IOPS=0, BW=1521KiB/s (1557kB/s)(4096KiB/2693msec) clat (nsec): min=613444k, max=613444k, avg=613444270.00, stdev= 0.00 lat (nsec): min=613448k, max=613448k, avg=613447906.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7627, max= 7627, per=100.00%, avg=7627.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3042KiB/s (3115kB/s)(8192KiB/2693msec); 0 zone resets clat (msec): min=582, max=1416, avg=999.61, stdev=589.64 lat (msec): min=583, max=1416, avg=1000.03, stdev=589.53 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8143, max= 8143, per=66.93%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.31%, ctx=153, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179642: Sat Sep 5 21:26:18 2026 write: IOPS=1, BW=4678KiB/s (4790kB/s)(12.0MiB/2627msec); 0 zone resets clat (msec): min=162, max=1289, avg=852.69, stdev=604.55 lat (msec): min=164, max=1290, avg=853.52, stdev=603.92 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8078, max= 8143, per=66.66%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.62%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179643: Sat Sep 5 21:26:18 2026 write: IOPS=1, BW=5097KiB/s (5219kB/s)(12.0MiB/2411msec); 0 zone resets clat (msec): min=275, max=1123, avg=780.70, stdev=446.90 lat (msec): min=275, max=1126, avg=782.74, stdev=448.27 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7627, max= 8159, per=64.87%, avg=7893.00, stdev=376.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.81%, ctx=37, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6084KiB/s (6230kB/s), 1521KiB/s-5793KiB/s (1557kB/s-5933kB/s), io=16.0MiB (16.8MB), run=2121-2693msec WRITE: bw=11.9MiB/s (12.5MB/s), 3042KiB/s-5097KiB/s (3115kB/s-5219kB/s), io=32.0MiB (33.6MB), run=2411-2693msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179635: Sat Sep 5 21:26:18 2026 read: IOPS=1, BW=4324KiB/s (4427kB/s)(12.0MiB/2842msec) clat (msec): min=185, max=1334, avg=898.37, stdev=622.72 lat (msec): min=185, max=1334, avg=898.37, stdev=622.72 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8062, max= 8126, per=100.00%, avg=8094.00, stdev=45.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.06%, ctx=39, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179636: Sat Sep 5 21:26:18 2026 read: IOPS=0, BW=1276KiB/s (1307kB/s)(4096KiB/3209msec) clat (nsec): min=1111.0M, max=1111.0M, avg=1111962671.00, stdev= 0.00 lat (nsec): min=1111.0M, max=1111.0M, avg=1111965461.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2553KiB/s (2614kB/s)(8192KiB/3209msec); 0 zone resets clat (msec): min=899, max=1054, avg=977.06, stdev=110.16 lat (msec): min=899, max=1055, avg=977.36, stdev=110.03 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 1053], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8126, max= 8126, per=79.58%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.71%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179637: Sat Sep 5 21:26:18 2026 write: IOPS=1, BW=4463KiB/s (4571kB/s)(12.0MiB/2753msec); 0 zone resets clat (msec): min=461, max=1435, avg=887.13, stdev=498.14 lat (msec): min=462, max=1435, avg=887.56, stdev=498.21 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8078, max= 8143, per=79.43%, avg=8110.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.51%, ctx=106, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179638: Sat Sep 5 21:26:18 2026 write: IOPS=1, BW=5073KiB/s (5195kB/s)(12.0MiB/2422msec); 0 zone resets clat (msec): min=421, max=1359, avg=780.47, stdev=506.43 lat (msec): min=421, max=1360, avg=781.01, stdev=506.35 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 5859, max= 8110, per=68.40%, avg=6984.50, stdev=1591.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.08%, sys=6.98%, ctx=83, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5106KiB/s (5228kB/s), 1276KiB/s-4324KiB/s (1307kB/s-4427kB/s), io=16.0MiB (16.8MB), run=2842-3209msec WRITE: bw=9.97MiB/s (10.5MB/s), 2553KiB/s-5073KiB/s (2614kB/s-5195kB/s), io=32.0MiB (33.6MB), run=2422-3209msec