== sanity test 398b: DIO and buffer IO race ============== 22:55:38 (1790736938) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.73221 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146757: Tue Sep 29 22:57:40 2026 read: IOPS=14, BW=56.6KiB/s (57.0kB/s)(5992KiB/105826msec) clat (usec): min=34, max=393164, avg=34485.94, stdev=26321.36 lat (usec): min=34, max=393165, avg=34487.25, stdev=26321.37 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 5145], 20.00th=[ 16188], | 30.00th=[ 20055], 40.00th=[ 25035], 50.00th=[ 28967], 60.00th=[ 34341], | 70.00th=[ 42730], 80.00th=[ 52167], 90.00th=[ 66847], 95.00th=[ 81265], | 99.00th=[116917], 99.50th=[131597], 99.90th=[181404], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 111, per=25.08%, avg=56.68, stdev=22.73, samples=207 iops : min= 1, max= 27, avg=13.56, stdev= 5.69, samples=207 write: IOPS=14, BW=59.5KiB/s (60.9kB/s)(6296KiB/105826msec); 0 zone resets clat (usec): min=945, max=447166, avg=34337.61, stdev=36551.63 lat (usec): min=947, max=447167, avg=34340.08, stdev=36551.73 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1205], 10.00th=[ 1680], 20.00th=[ 3785], | 30.00th=[ 7373], 40.00th=[ 16909], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 44827], 80.00th=[ 57934], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[141558], 99.50th=[173016], 99.90th=[408945], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 6, max= 127, per=24.88%, avg=58.98, stdev=23.19, samples=209 iops : min= 1, max= 31, avg=14.12, stdev= 5.82, samples=209 lat (usec) : 50=0.75%, 100=3.58%, 250=0.26%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.09%, 4=4.65%, 10=7.42%, 20=13.28%, 50=39.52% lat (msec) : 100=21.03%, 250=3.09%, 500=0.16% cpu : usr=0.08%, sys=6.07%, ctx=6671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146758: Tue Sep 29 22:57:40 2026 read: IOPS=14, BW=59.1KiB/s (60.6kB/s)(5940KiB/100434msec) clat (usec): min=30, max=312489, avg=31536.25, stdev=24123.76 lat (usec): min=30, max=312490, avg=31539.96, stdev=24126.93 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 99], 20.00th=[ 14615], | 30.00th=[ 18744], 40.00th=[ 22676], 50.00th=[ 26608], 60.00th=[ 31589], | 70.00th=[ 39060], 80.00th=[ 47973], 90.00th=[ 63177], 95.00th=[ 73925], | 99.00th=[102237], 99.50th=[117965], 99.90th=[181404], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 6, max= 109, per=25.95%, avg=58.65, stdev=22.64, samples=198 iops : min= 1, max= 27, avg=14.05, stdev= 5.69, samples=198 write: IOPS=15, BW=63.2KiB/s (64.7kB/s)(6348KiB/100434msec); 0 zone resets clat (usec): min=1019, max=236493, avg=33699.41, stdev=33832.26 lat (usec): min=1020, max=236494, avg=33703.73, stdev=33832.09 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1303], 10.00th=[ 1860], 20.00th=[ 3720], | 30.00th=[ 6915], 40.00th=[ 16450], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 43779], 80.00th=[ 56886], 90.00th=[ 78119], 95.00th=[100140], | 99.00th=[139461], 99.50th=[170918], 99.90th=[214959], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 6, max= 157, per=26.41%, avg=62.59, stdev=24.92, samples=198 iops : min= 1, max= 39, avg=15.04, stdev= 6.29, samples=198 lat (usec) : 50=0.91%, 100=3.97%, 250=0.49%, 500=0.13%, 750=0.10% lat (msec) : 2=6.02%, 4=5.08%, 10=7.58%, 20=14.13%, 50=39.94% lat (msec) : 100=18.55%, 250=3.06%, 500=0.03% cpu : usr=0.07%, sys=6.28%, ctx=6401, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146759: Tue Sep 29 22:57:40 2026 read: IOPS=14, BW=58.4KiB/s (59.8kB/s)(6028KiB/103230msec) clat (usec): min=23, max=204251, avg=31673.96, stdev=23501.89 lat (usec): min=23, max=204253, avg=31677.82, stdev=23502.99 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 109], 20.00th=[ 14484], | 30.00th=[ 18744], 40.00th=[ 22414], 50.00th=[ 26346], 60.00th=[ 32113], | 70.00th=[ 39060], 80.00th=[ 48497], 90.00th=[ 61604], 95.00th=[ 72877], | 99.00th=[105382], 99.50th=[133694], 99.90th=[158335], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 7, max= 125, per=25.71%, avg=58.11, stdev=24.81, samples=203 iops : min= 1, max= 31, avg=13.92, stdev= 6.21, samples=203 write: IOPS=15, BW=60.6KiB/s (62.1kB/s)(6260KiB/103230msec); 0 zone resets clat (usec): min=938, max=423836, avg=35375.08, stdev=38977.85 lat (usec): min=939, max=423837, avg=35377.30, stdev=38978.72 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1729], 20.00th=[ 3458], | 30.00th=[ 6718], 40.00th=[ 15270], 50.00th=[ 24773], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 60556], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[160433], 99.50th=[219153], 99.90th=[337642], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 143, per=25.35%, avg=60.07, stdev=23.82, samples=204 iops : min= 1, max= 35, avg=14.41, stdev= 6.00, samples=204 lat (usec) : 50=1.43%, 100=3.42%, 250=0.26%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=6.15%, 4=5.37%, 10=6.97%, 20=15.01%, 50=38.22% lat (msec) : 100=19.21%, 250=3.48%, 500=0.16% cpu : usr=0.10%, sys=6.09%, ctx=6527, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146760: Tue Sep 29 22:57:40 2026 read: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6052KiB/105374msec) clat (usec): min=34, max=444855, avg=34000.80, stdev=28535.70 lat (usec): min=34, max=444856, avg=34007.22, stdev=28536.95 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 194], 20.00th=[ 15270], | 30.00th=[ 19792], 40.00th=[ 24249], 50.00th=[ 28443], 60.00th=[ 34341], | 70.00th=[ 41681], 80.00th=[ 50070], 90.00th=[ 64226], 95.00th=[ 79168], | 99.00th=[115868], 99.50th=[152044], 99.90th=[325059], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 120, per=25.37%, avg=57.34, stdev=21.75, samples=206 iops : min= 1, max= 30, avg=13.72, stdev= 5.46, samples=206 write: IOPS=14, BW=59.2KiB/s (60.6kB/s)(6236KiB/105374msec); 0 zone resets clat (usec): min=957, max=483585, avg=34513.12, stdev=36217.14 lat (usec): min=958, max=483588, avg=34514.74, stdev=36216.96 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1680], 20.00th=[ 3392], | 30.00th=[ 6980], 40.00th=[ 16188], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[175113], 99.90th=[283116], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 13, max= 159, per=24.69%, avg=58.52, stdev=23.55, samples=208 iops : min= 3, max= 39, avg=14.02, stdev= 5.90, samples=208 lat (usec) : 50=0.94%, 100=3.55%, 250=0.52%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=6.22%, 4=5.11%, 10=6.71%, 20=13.57%, 50=39.42% lat (msec) : 100=20.28%, 250=3.19%, 500=0.13% cpu : usr=0.08%, sys=6.05%, ctx=6613, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=227KiB/s (232kB/s), 56.6KiB/s-59.1KiB/s (57.0kB/s-60.6kB/s), io=23.4MiB (24.6MB), run=100434-105826msec WRITE: bw=238KiB/s (243kB/s), 59.2KiB/s-63.2KiB/s (60.6kB/s-64.7kB/s), io=24.6MiB (25.7MB), run=100434-105826msec fio: pid=146755, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=146752: Tue Sep 29 22:59:47 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(5992KiB/231334msec) clat (msec): min=4, max=803, avg=32.67, stdev=35.72 lat (msec): min=4, max=803, avg=32.67, stdev=35.72 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 63], 95.00th=[ 84], | 99.00th=[ 167], 99.50th=[ 211], 99.90th=[ 296], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 103, per=30.56%, avg=27.81, stdev=17.88, samples=418 iops : min= 1, max= 25, avg= 6.37, stdev= 4.53, samples=418 write: IOPS=6, BW=27.2KiB/s (27.9kB/s)(6296KiB/231334msec); 0 zone resets clat (msec): min=33, max=466, avg=115.66, stdev=52.84 lat (msec): min=33, max=466, avg=115.67, stdev=52.85 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 51], 10.00th=[ 61], 20.00th=[ 72], | 30.00th=[ 83], 40.00th=[ 94], 50.00th=[ 106], 60.00th=[ 118], | 70.00th=[ 136], 80.00th=[ 153], 90.00th=[ 186], 95.00th=[ 213], | 99.00th=[ 275], 99.50th=[ 326], 99.90th=[ 435], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 7, max= 64, per=27.91%, avg=26.79, stdev=11.61, samples=455 iops : min= 1, max= 16, avg= 6.11, stdev= 2.99, samples=455 lat (msec) : 10=5.18%, 20=14.23%, 50=23.99%, 100=27.25%, 250=28.09% lat (msec) : 500=1.24%, 1000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5666, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146753: Tue Sep 29 22:59:47 2026 read: IOPS=6, BW=25.5KiB/s (26.1kB/s)(5940KiB/232896msec) clat (msec): min=4, max=726, avg=32.46, stdev=33.86 lat (msec): min=4, max=726, avg=32.46, stdev=33.86 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 43], 90.00th=[ 63], 95.00th=[ 89], | 99.00th=[ 140], 99.50th=[ 174], 99.90th=[ 447], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 95, per=30.59%, avg=27.84, stdev=17.69, samples=414 iops : min= 1, max= 23, avg= 6.38, stdev= 4.48, samples=414 write: IOPS=6, BW=27.3KiB/s (27.9kB/s)(6348KiB/232896msec); 0 zone resets clat (msec): min=35, max=537, avg=116.16, stdev=53.34 lat (msec): min=35, max=537, avg=116.17, stdev=53.34 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 72], | 30.00th=[ 84], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 118], | 70.00th=[ 134], 80.00th=[ 150], 90.00th=[ 186], 95.00th=[ 213], | 99.00th=[ 292], 99.50th=[ 326], 99.90th=[ 435], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 63, per=27.93%, avg=26.81, stdev=10.94, samples=458 iops : min= 1, max= 15, avg= 6.12, stdev= 2.83, samples=458 lat (msec) : 10=4.23%, 20=14.52%, 50=23.60%, 100=28.26%, 250=28.22% lat (msec) : 500=1.11%, 750=0.07% cpu : usr=0.04%, sys=1.35%, ctx=5749, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146754: Tue Sep 29 22:59:47 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6028KiB/233161msec) clat (msec): min=4, max=293, avg=33.76, stdev=31.18 lat (msec): min=4, max=293, avg=33.76, stdev=31.18 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 66], 95.00th=[ 89], | 99.00th=[ 171], 99.50th=[ 222], 99.90th=[ 288], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 111, per=29.46%, avg=26.81, stdev=17.97, samples=436 iops : min= 1, max= 27, avg= 6.11, stdev= 4.54, samples=436 write: IOPS=6, BW=26.8KiB/s (27.5kB/s)(6260KiB/233161msec); 0 zone resets clat (msec): min=33, max=822, avg=116.25, stdev=56.39 lat (msec): min=33, max=822, avg=116.25, stdev=56.39 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 72], | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 104], 60.00th=[ 117], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 190], 95.00th=[ 215], | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 542], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 63, per=27.63%, avg=26.53, stdev=11.65, samples=457 iops : min= 1, max= 15, avg= 6.05, stdev= 3.01, samples=457 lat (msec) : 10=4.20%, 20=15.14%, 50=22.98%, 100=29.10%, 250=27.64% lat (msec) : 500=0.88%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5653, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=146755: Tue Sep 29 22:59:47 2026 read: IOPS=5, BW=21.6KiB/s (22.1kB/s)(3416KiB/158102msec) clat (msec): min=5, max=287, avg=40.58, stdev=34.63 lat (msec): min=5, max=287, avg=40.58, stdev=34.63 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 83], 95.00th=[ 104], | 99.00th=[ 155], 99.50th=[ 220], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 88, per=25.66%, avg=23.35, stdev=15.17, samples=282 iops : min= 1, max= 22, avg= 5.21, stdev= 3.86, samples=282 write: IOPS=5, BW=22.3KiB/s (22.8kB/s)(3520KiB/158102msec); 0 zone resets clat (msec): min=36, max=900, avg=139.93, stdev=61.28 lat (msec): min=36, max=900, avg=139.93, stdev=61.28 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 75], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 120], 50.00th=[ 132], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 178], 90.00th=[ 211], 95.00th=[ 245], | 99.00th=[ 326], 99.50th=[ 363], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 48, per=22.65%, avg=21.75, stdev= 9.21, samples=311 iops : min= 1, max= 12, avg= 4.81, stdev= 2.36, samples=311 lat (msec) : 10=2.71%, 20=11.76%, 50=23.11%, 100=21.61%, 250=38.39% lat (msec) : 500=2.31%, 1000=0.06% cpu : usr=0.03%, sys=1.19%, ctx=2711, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=855,880,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=91.7KiB/s (93.9kB/s), 21.6KiB/s-25.9KiB/s (22.1kB/s-26.5kB/s), io=20.9MiB (21.9MB), run=158102-233161msec WRITE: bw=96.2KiB/s (98.5kB/s), 22.3KiB/s-27.3KiB/s (22.8kB/s-27.9kB/s), io=21.9MiB (22.0MB), run=158102-233161msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146807: Tue Sep 29 23:00:19 2026 read: IOPS=16, BW=268KiB/s (275kB/s)(5920KiB/22050msec) clat (usec): min=31, max=109779, avg=31591.36, stdev=23334.84 lat (usec): min=32, max=109781, avg=31592.52, stdev=23334.76 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 269], | 30.00th=[ 20055], 40.00th=[ 26084], 50.00th=[ 31327], 60.00th=[ 35390], | 70.00th=[ 40633], 80.00th=[ 49546], 90.00th=[ 61080], 95.00th=[ 70779], | 99.00th=[ 99091], 99.50th=[107480], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 127, max= 447, per=26.03%, avg=266.81, stdev=78.68, samples=43 iops : min= 7, max= 27, avg=15.98, stdev= 5.00, samples=43 write: IOPS=18, BW=289KiB/s (296kB/s)(6368KiB/22050msec); 0 zone resets clat (usec): min=1357, max=273391, avg=25522.70, stdev=28911.48 lat (usec): min=1359, max=273394, avg=25524.57, stdev=28911.54 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1663], 10.00th=[ 2180], 20.00th=[ 3654], | 30.00th=[ 6063], 40.00th=[ 8586], 50.00th=[ 13435], 60.00th=[ 22938], | 70.00th=[ 32637], 80.00th=[ 47449], 90.00th=[ 65799], 95.00th=[ 80217], | 99.00th=[114820], 99.50th=[143655], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 576, per=26.72%, avg=288.26, stdev=115.42, samples=43 iops : min= 3, max= 36, avg=17.35, stdev= 7.24, samples=43 lat (usec) : 50=2.21%, 100=7.03%, 250=0.26%, 500=0.39%, 750=0.13% lat (msec) : 2=4.30%, 4=6.90%, 10=11.20%, 20=11.98%, 50=36.46% lat (msec) : 100=17.97%, 250=1.04%, 500=0.13% cpu : usr=0.05%, sys=7.13%, ctx=1457, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146809: Tue Sep 29 23:00:19 2026 read: IOPS=16, BW=266KiB/s (272kB/s)(5744KiB/21620msec) clat (usec): min=39, max=143656, avg=30790.06, stdev=25149.74 lat (usec): min=40, max=143657, avg=30791.22, stdev=25149.65 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 94], | 30.00th=[ 18482], 40.00th=[ 23200], 50.00th=[ 29230], 60.00th=[ 33424], | 70.00th=[ 40109], 80.00th=[ 48497], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[125305], 99.50th=[137364], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 94, max= 443, per=25.83%, avg=264.74, stdev=92.96, samples=42 iops : min= 5, max= 27, avg=15.86, stdev= 5.85, samples=42 write: IOPS=18, BW=303KiB/s (310kB/s)(6544KiB/21620msec); 0 zone resets clat (usec): min=1351, max=150036, avg=25698.91, stdev=25905.37 lat (usec): min=1352, max=150038, avg=25713.84, stdev=25903.74 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1975], 10.00th=[ 2540], 20.00th=[ 4490], | 30.00th=[ 7242], 40.00th=[ 10945], 50.00th=[ 16450], 60.00th=[ 23987], | 70.00th=[ 31065], 80.00th=[ 47973], 90.00th=[ 61080], 95.00th=[ 82314], | 99.00th=[105382], 99.50th=[122160], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 63, max= 508, per=27.63%, avg=298.12, stdev=102.77, samples=42 iops : min= 3, max= 31, avg=17.95, stdev= 6.46, samples=42 lat (usec) : 50=1.95%, 100=7.42%, 250=0.39%, 500=0.39% lat (msec) : 2=2.99%, 4=6.77%, 10=11.20%, 20=13.02%, 50=37.50% lat (msec) : 100=16.41%, 250=1.95% cpu : usr=0.12%, sys=7.12%, ctx=1420, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146810: Tue Sep 29 23:00:19 2026 read: IOPS=16, BW=268KiB/s (274kB/s)(6256KiB/23351msec) clat (usec): min=28, max=165732, avg=30927.38, stdev=25122.94 lat (usec): min=28, max=165734, avg=30929.54, stdev=25123.45 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 7046], | 30.00th=[ 18220], 40.00th=[ 23725], 50.00th=[ 27919], 60.00th=[ 31589], | 70.00th=[ 39584], 80.00th=[ 49546], 90.00th=[ 63177], 95.00th=[ 74974], | 99.00th=[111674], 99.50th=[121111], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 62, max= 480, per=26.18%, avg=268.39, stdev=95.18, samples=46 iops : min= 3, max= 30, avg=16.09, stdev= 6.04, samples=46 write: IOPS=16, BW=258KiB/s (265kB/s)(6032KiB/23351msec); 0 zone resets clat (usec): min=1454, max=182211, avg=29374.63, stdev=31857.91 lat (usec): min=1457, max=182213, avg=29376.49, stdev=31857.89 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1745], 10.00th=[ 2245], 20.00th=[ 4490], | 30.00th=[ 7373], 40.00th=[ 12125], 50.00th=[ 20579], 60.00th=[ 27919], | 70.00th=[ 36439], 80.00th=[ 46400], 90.00th=[ 66323], 95.00th=[ 92799], | 99.00th=[154141], 99.50th=[179307], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 62, max= 473, per=23.94%, avg=258.28, stdev=93.45, samples=46 iops : min= 3, max= 29, avg=15.43, stdev= 5.87, samples=46 lat (usec) : 50=1.56%, 100=7.03%, 250=0.26%, 500=0.52%, 750=0.26% lat (msec) : 2=4.30%, 4=3.78%, 10=10.68%, 20=12.76%, 50=40.49% lat (msec) : 100=15.36%, 250=2.99% cpu : usr=0.11%, sys=6.73%, ctx=1533, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146811: Tue Sep 29 23:00:19 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(6032KiB/23233msec) clat (usec): min=33, max=229725, avg=32610.17, stdev=30490.61 lat (usec): min=33, max=229726, avg=32611.35, stdev=30490.67 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 96], | 30.00th=[ 17171], 40.00th=[ 23200], 50.00th=[ 27919], 60.00th=[ 34866], | 70.00th=[ 41681], 80.00th=[ 51119], 90.00th=[ 66323], 95.00th=[ 96994], | 99.00th=[152044], 99.50th=[166724], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 444, per=25.26%, avg=258.91, stdev=88.16, samples=45 iops : min= 3, max= 27, avg=15.49, stdev= 5.55, samples=45 write: IOPS=16, BW=269KiB/s (276kB/s)(6256KiB/23233msec); 0 zone resets clat (usec): min=1326, max=218846, avg=27585.54, stdev=30015.21 lat (usec): min=1327, max=218849, avg=27587.71, stdev=30015.09 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1762], 10.00th=[ 2671], 20.00th=[ 4359], | 30.00th=[ 6521], 40.00th=[ 9765], 50.00th=[ 16450], 60.00th=[ 27657], | 70.00th=[ 34866], 80.00th=[ 46400], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[145753], 99.50th=[162530], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 95, max= 475, per=24.88%, avg=268.49, stdev=92.82, samples=45 iops : min= 5, max= 29, avg=16.09, stdev= 5.87, samples=45 lat (usec) : 50=1.43%, 100=8.59%, 250=1.17%, 1000=0.26% lat (msec) : 2=3.39%, 4=6.51%, 10=11.98%, 20=10.68%, 50=36.59% lat (msec) : 100=16.54%, 250=2.86% cpu : usr=0.08%, sys=6.84%, ctx=1479, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1026KiB/s (1050kB/s), 260KiB/s-268KiB/s (266kB/s-275kB/s), io=23.4MiB (24.5MB), run=21620-23351msec WRITE: bw=1079KiB/s (1105kB/s), 258KiB/s-303KiB/s (265kB/s-310kB/s), io=24.6MiB (25.8MB), run=21620-23351msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146812: Tue Sep 29 23:00:54 2026 read: IOPS=6, BW=102KiB/s (104kB/s)(5920KiB/58083msec) clat (msec): min=7, max=380, avg=30.92, stdev=36.61 lat (msec): min=7, max=380, avg=30.92, stdev=36.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 54], 95.00th=[ 87], | 99.00th=[ 159], 99.50th=[ 376], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 414, per=26.81%, avg=109.37, stdev=64.72, samples=107 iops : min= 1, max= 25, avg= 6.10, stdev= 4.01, samples=107 write: IOPS=6, BW=110KiB/s (112kB/s)(6368KiB/58083msec); 0 zone resets clat (msec): min=31, max=373, avg=116.37, stdev=47.37 lat (msec): min=31, max=373, avg=116.37, stdev=47.37 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 66], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 96], 50.00th=[ 109], 60.00th=[ 118], | 70.00th=[ 133], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 205], | 99.00th=[ 259], 99.50th=[ 305], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 30, max= 286, per=25.87%, avg=111.25, stdev=43.58, samples=113 iops : min= 1, max= 17, avg= 6.20, stdev= 2.79, samples=113 lat (msec) : 10=2.86%, 20=19.92%, 50=21.22%, 100=25.13%, 250=29.82% lat (msec) : 500=1.04% cpu : usr=0.02%, sys=1.48%, ctx=1391, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146813: Tue Sep 29 23:00:54 2026 read: IOPS=6, BW=98.0KiB/s (100kB/s)(5744KiB/58598msec) clat (msec): min=5, max=326, avg=30.87, stdev=33.52 lat (msec): min=5, max=326, avg=30.88, stdev=33.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 68], 95.00th=[ 86], | 99.00th=[ 167], 99.50th=[ 296], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 28, max= 319, per=26.52%, avg=108.20, stdev=68.46, samples=105 iops : min= 1, max= 19, avg= 6.02, stdev= 4.34, samples=105 write: IOPS=6, BW=112KiB/s (114kB/s)(6544KiB/58598msec); 0 zone resets clat (msec): min=34, max=370, avg=115.94, stdev=46.65 lat (msec): min=34, max=370, avg=115.94, stdev=46.64 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 88], 40.00th=[ 100], 50.00th=[ 112], 60.00th=[ 123], | 70.00th=[ 133], 80.00th=[ 146], 90.00th=[ 176], 95.00th=[ 207], | 99.00th=[ 255], 99.50th=[ 262], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 191, per=26.34%, avg=113.27, stdev=38.98, samples=114 iops : min= 1, max= 11, avg= 6.33, stdev= 2.47, samples=114 lat (msec) : 10=3.26%, 20=21.09%, 50=16.41%, 100=25.78%, 250=32.42% lat (msec) : 500=1.04% cpu : usr=0.03%, sys=1.38%, ctx=1384, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146814: Tue Sep 29 23:00:54 2026 read: IOPS=6, BW=111KiB/s (114kB/s)(6256KiB/56150msec) clat (msec): min=6, max=158, avg=29.65, stdev=25.11 lat (msec): min=6, max=158, avg=29.66, stdev=25.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 39], 90.00th=[ 61], 95.00th=[ 88], | 99.00th=[ 138], 99.50th=[ 153], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 30, max= 414, per=29.47%, avg=120.23, stdev=83.25, samples=103 iops : min= 1, max= 25, avg= 6.78, stdev= 5.25, samples=103 write: IOPS=6, BW=107KiB/s (110kB/s)(6032KiB/56150msec); 0 zone resets clat (msec): min=27, max=380, avg=117.61, stdev=52.60 lat (msec): min=27, max=380, avg=117.61, stdev=52.60 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 78], | 30.00th=[ 86], 40.00th=[ 95], 50.00th=[ 107], 60.00th=[ 118], | 70.00th=[ 133], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 220], | 99.00th=[ 313], 99.50th=[ 347], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 191, per=25.15%, avg=108.16, stdev=40.41, samples=110 iops : min= 1, max= 11, avg= 6.01, stdev= 2.56, samples=110 lat (msec) : 10=3.78%, 20=19.40%, 50=21.74%, 100=26.17%, 250=27.60% lat (msec) : 500=1.30% cpu : usr=0.04%, sys=1.52%, ctx=1363, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146815: Tue Sep 29 23:00:54 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(6032KiB/57925msec) clat (msec): min=5, max=371, avg=30.68, stdev=32.61 lat (msec): min=5, max=371, avg=30.68, stdev=32.61 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 39], 90.00th=[ 57], 95.00th=[ 92], | 99.00th=[ 167], 99.50th=[ 190], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 288, per=26.65%, avg=108.72, stdev=70.29, samples=108 iops : min= 1, max= 18, avg= 6.06, stdev= 4.42, samples=108 write: IOPS=6, BW=108KiB/s (111kB/s)(6256KiB/57925msec); 0 zone resets clat (msec): min=28, max=341, avg=117.88, stdev=49.93 lat (msec): min=28, max=341, avg=117.88, stdev=49.93 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 80], | 30.00th=[ 89], 40.00th=[ 99], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 131], 80.00th=[ 150], 90.00th=[ 188], 95.00th=[ 209], | 99.00th=[ 300], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 28, max= 222, per=25.43%, avg=109.37, stdev=41.71, samples=112 iops : min= 1, max= 13, avg= 6.09, stdev= 2.65, samples=112 lat (msec) : 10=3.78%, 20=18.88%, 50=22.14%, 100=23.96%, 250=30.08% lat (msec) : 500=1.17% cpu : usr=0.04%, sys=1.48%, ctx=1350, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=409KiB/s (419kB/s), 98.0KiB/s-111KiB/s (100kB/s-114kB/s), io=23.4MiB (24.5MB), run=56150-58598msec WRITE: bw=430KiB/s (440kB/s), 107KiB/s-112KiB/s (110kB/s-114kB/s), io=24.6MiB (25.8MB), run=56150-58598msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146845: Tue Sep 29 23:01:10 2026 read: IOPS=1, BW=1083KiB/s (1109kB/s)(7168KiB/6619msec) clat (msec): min=113, max=3095, avg=624.32, stdev=1093.35 lat (msec): min=113, max=3095, avg=624.32, stdev=1093.35 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 127], | 30.00th=[ 184], 40.00th=[ 184], 50.00th=[ 209], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 363], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 2019, max= 4023, per=100.00%, avg=2978.75, stdev=1103.78, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=774KiB/s (792kB/s)(5120KiB/6619msec); 0 zone resets clat (msec): min=165, max=995, avg=440.94, stdev=323.46 lat (msec): min=165, max=995, avg=441.05, stdev=323.41 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 2011, max= 3785, per=65.21%, avg=2602.33, stdev=1024.22, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=8.78%, ctx=428, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146846: Tue Sep 29 23:01:10 2026 read: IOPS=0, BW=285KiB/s (292kB/s)(2048KiB/7184msec) clat (msec): min=178, max=284, avg=231.67, stdev=75.15 lat (msec): min=178, max=284, avg=231.67, stdev=75.16 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 180], 50.00th=[ 180], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1648, max= 1892, per=62.11%, avg=1770.00, stdev=172.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1425KiB/s (1460kB/s)(10.0MiB/7184msec); 0 zone resets clat (msec): min=115, max=3074, avg=655.42, stdev=877.01 lat (msec): min=115, max=3074, avg=655.76, stdev=876.89 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 134], | 30.00th=[ 284], 40.00th=[ 313], 50.00th=[ 363], 60.00th=[ 393], | 70.00th=[ 460], 80.00th=[ 558], 90.00th=[ 869], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 1921, max= 5976, per=78.54%, avg=3134.60, stdev=1772.36, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.04%, sys=8.35%, ctx=188, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146848: Tue Sep 29 23:01:10 2026 read: IOPS=0, BW=924KiB/s (947kB/s)(6144KiB/6646msec) clat (usec): min=498, max=934633, avg=260811.03, stdev=364348.04 lat (usec): min=501, max=934634, avg=260812.26, stdev=364347.86 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 775], | 30.00th=[ 775], 40.00th=[ 1647], 50.00th=[ 1647], 60.00th=[287310], | 70.00th=[341836], 80.00th=[341836], 90.00th=[935330], 95.00th=[935330], | 99.00th=[935330], 99.50th=[935330], 99.90th=[935330], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 1921, max= 3785, per=85.40%, avg=2434.00, stdev=901.76, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=924KiB/s (947kB/s)(6144KiB/6646msec); 0 zone resets clat (msec): min=244, max=3030, avg=837.62, stdev=1084.95 lat (msec): min=244, max=3030, avg=837.90, stdev=1084.92 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 460], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1892, max= 3407, per=58.44%, avg=2332.25, stdev=718.85, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.05%, sys=6.31%, ctx=174, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146850: Tue Sep 29 23:01:10 2026 read: IOPS=0, BW=866KiB/s (887kB/s)(5120KiB/5913msec) clat (usec): min=484, max=255306, avg=134347.12, stdev=123561.22 lat (usec): min=486, max=255308, avg=134348.35, stdev=123561.23 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 486], | 30.00th=[ 922], 40.00th=[ 922], 50.00th=[204473], 60.00th=[204473], | 70.00th=[210764], 80.00th=[210764], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 1921, max= 5941, per=100.00%, avg=3931.00, stdev=2842.57, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1212KiB/s (1241kB/s)(7168KiB/5913msec); 0 zone resets clat (msec): min=248, max=3044, avg=739.87, stdev=1029.52 lat (msec): min=248, max=3044, avg=739.94, stdev=1029.52 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 251], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 718], 90.00th=[ 3037], 95.00th=[ 3037], | 99.00th=[ 3037], 99.50th=[ 3037], 99.90th=[ 3037], 99.95th=[ 3037], | 99.99th=[ 3037] bw ( KiB/s): min= 1712, max= 3842, per=57.47%, avg=2293.60, stdev=874.19, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.43%, ctx=199, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2851KiB/s (2919kB/s), 285KiB/s-1083KiB/s (292kB/s-1109kB/s), io=20.0MiB (20.0MB), run=5913-7184msec WRITE: bw=3991KiB/s (4087kB/s), 774KiB/s-1425KiB/s (792kB/s-1460kB/s), io=28.0MiB (29.4MB), run=5913-7184msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146847: Tue Sep 29 23:01:11 2026 read: IOPS=0, BW=847KiB/s (867kB/s)(7168KiB/8466msec) clat (msec): min=71, max=3128, avg=958.32, stdev=1102.64 lat (msec): min=71, max=3128, avg=958.32, stdev=1102.65 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 92], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 527], 60.00th=[ 919], | 70.00th=[ 919], 80.00th=[ 1636], 90.00th=[ 3138], 95.00th=[ 3138], | 99.00th=[ 3138], 99.50th=[ 3138], 99.90th=[ 3138], 99.95th=[ 3138], | 99.99th=[ 3138] bw ( KiB/s): min= 1950, max= 2048, per=83.58%, avg=2021.83, stdev=36.69, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 write: IOPS=0, BW=605KiB/s (619kB/s)(5120KiB/8466msec); 0 zone resets clat (msec): min=107, max=860, avg=340.85, stdev=299.58 lat (msec): min=107, max=860, avg=340.92, stdev=299.58 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 257], 60.00th=[ 257], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2019, max= 4047, per=79.88%, avg=2704.67, stdev=1162.59, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=16.67%, 250=16.67%, 500=25.00%, 750=8.33%, 1000=16.67% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=1.11%, ctx=54, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146849: Tue Sep 29 23:01:11 2026 read: IOPS=0, BW=265KiB/s (271kB/s)(2048KiB/7729msec) clat (msec): min=109, max=647, avg=378.16, stdev=380.37 lat (msec): min=109, max=647, avg=378.16, stdev=380.38 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 110], 50.00th=[ 110], 60.00th=[ 651], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2019, max= 2039, per=83.88%, avg=2029.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1325KiB/s (1357kB/s)(10.0MiB/7729msec); 0 zone resets clat (msec): min=136, max=3724, avg=684.49, stdev=1089.22 lat (msec): min=136, max=3724, avg=684.57, stdev=1089.22 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 176], | 30.00th=[ 184], 40.00th=[ 203], 50.00th=[ 279], 60.00th=[ 300], | 70.00th=[ 414], 80.00th=[ 676], 90.00th=[ 760], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1950, max= 4096, per=83.47%, avg=2826.20, stdev=1133.72, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.07%, ctx=97, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146851: Tue Sep 29 23:01:11 2026 read: IOPS=0, BW=814KiB/s (834kB/s)(6144KiB/7544msec) clat (msec): min=109, max=684, avg=246.21, stdev=217.18 lat (msec): min=109, max=684, avg=246.21, stdev=217.18 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 174], | 70.00th=[ 209], 80.00th=[ 209], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2019, max= 4055, per=100.00%, avg=2707.33, stdev=1167.20, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=814KiB/s (834kB/s)(6144KiB/7544msec); 0 zone resets clat (msec): min=106, max=3683, avg=973.88, stdev=1376.78 lat (msec): min=106, max=3683, avg=973.96, stdev=1376.77 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 201], 50.00th=[ 201], 60.00th=[ 609], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 3675], 95.00th=[ 3675], | 99.00th=[ 3675], 99.50th=[ 3675], 99.90th=[ 3675], 99.95th=[ 3675], | 99.99th=[ 3675] bw ( KiB/s): min= 2003, max= 4079, per=74.93%, avg=2537.25, stdev=1028.00, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=66.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.89%, ctx=132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146852: Tue Sep 29 23:01:11 2026 read: IOPS=0, BW=629KiB/s (644kB/s)(5120KiB/8136msec) clat (msec): min=115, max=619, avg=386.60, stdev=184.88 lat (msec): min=115, max=619, avg=386.60, stdev=184.88 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 418], 60.00th=[ 418], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2003, max= 2048, per=83.90%, avg=2029.50, stdev=22.34, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=0, BW=881KiB/s (902kB/s)(7168KiB/8136msec); 0 zone resets clat (msec): min=135, max=3451, avg=857.01, stdev=1177.65 lat (msec): min=135, max=3451, avg=857.08, stdev=1177.64 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 169], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 489], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 902], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 1950, max= 2048, per=59.56%, avg=2016.60, stdev=38.85, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.54%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2419KiB/s (2477kB/s), 265KiB/s-847KiB/s (271kB/s-867kB/s), io=20.0MiB (20.0MB), run=7544-8466msec WRITE: bw=3387KiB/s (3468kB/s), 605KiB/s-1325KiB/s (619kB/s-1357kB/s), io=28.0MiB (29.4MB), run=7544-8466msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146869: Tue Sep 29 23:01:25 2026 read: IOPS=1, BW=4409KiB/s (4515kB/s)(12.0MiB/2787msec) clat (msec): min=859, max=968, avg=912.77, stdev=54.79 lat (msec): min=859, max=968, avg=912.77, stdev=54.79 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 8094, max= 8159, per=100.00%, avg=8126.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.04%, sys=13.32%, ctx=294, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146870: Tue Sep 29 23:01:25 2026 read: IOPS=0, BW=1161KiB/s (1189kB/s)(4096KiB/3528msec) clat (nsec): min=830498k, max=830498k, avg=830498349.00, stdev= 0.00 lat (nsec): min=830501k, max=830501k, avg=830500974.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2322KiB/s (2378kB/s)(8192KiB/3528msec); 0 zone resets clat (msec): min=1076, max=1500, avg=1288.68, stdev=300.24 lat (msec): min=1076, max=1501, avg=1288.99, stdev=300.21 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8094, max= 8094, per=87.15%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.19%, ctx=85, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146871: Tue Sep 29 23:01:25 2026 write: IOPS=0, BW=3499KiB/s (3583kB/s)(12.0MiB/3512msec); 0 zone resets clat (msec): min=517, max=1856, avg=1127.40, stdev=677.30 lat (msec): min=518, max=1857, avg=1128.74, stdev=677.72 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8094, max= 8126, per=87.33%, avg=8110.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.90%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146872: Tue Sep 29 23:01:25 2026 write: IOPS=0, BW=3523KiB/s (3607kB/s)(12.0MiB/3488msec); 0 zone resets clat (msec): min=917, max=1359, avg=1146.08, stdev=221.52 lat (msec): min=917, max=1361, avg=1146.94, stdev=222.27 clat percentiles (msec): | 1.00th=[ 919], 5.00th=[ 919], 10.00th=[ 919], 20.00th=[ 919], | 30.00th=[ 919], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8126, max= 8175, per=87.76%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.15%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4644KiB/s (4755kB/s), 1161KiB/s-4409KiB/s (1189kB/s-4515kB/s), io=16.0MiB (16.8MB), run=2787-3528msec WRITE: bw=9288KiB/s (9511kB/s), 2322KiB/s-3523KiB/s (2378kB/s-3607kB/s), io=32.0MiB (33.6MB), run=3488-3528msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146864: Tue Sep 29 23:01:26 2026 read: IOPS=1, BW=4242KiB/s (4343kB/s)(12.0MiB/2897msec) clat (msec): min=670, max=1211, avg=949.91, stdev=270.84 lat (msec): min=670, max=1211, avg=949.91, stdev=270.84 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7757, max= 8062, per=100.00%, avg=7909.50, stdev=215.67, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.45%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146865: Tue Sep 29 23:01:26 2026 read: IOPS=0, BW=2435KiB/s (2494kB/s)(4096KiB/1682msec) clat (nsec): min=269392k, max=269392k, avg=269391683.00, stdev= 0.00 lat (nsec): min=269394k, max=269394k, avg=269394353.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4870KiB/s (4987kB/s)(8192KiB/1682msec); 0 zone resets clat (msec): min=582, max=809, avg=696.04, stdev=160.96 lat (msec): min=583, max=810, avg=697.00, stdev=159.87 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.00%, ctx=39, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146866: Tue Sep 29 23:01:26 2026 write: IOPS=0, BW=2861KiB/s (2930kB/s)(12.0MiB/4295msec); 0 zone resets clat (msec): min=283, max=3326, avg=1418.17, stdev=1662.68 lat (msec): min=284, max=3327, avg=1418.44, stdev=1662.62 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.12%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146867: Tue Sep 29 23:01:26 2026 write: IOPS=1, BW=4342KiB/s (4446kB/s)(12.0MiB/2830msec); 0 zone resets clat (msec): min=300, max=2021, avg=924.49, stdev=952.74 lat (msec): min=300, max=2021, avg=924.82, stdev=952.72 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 451], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 6077, max= 8143, per=93.20%, avg=7110.00, stdev=1460.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.43%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5656KiB/s (5791kB/s), 2435KiB/s-4242KiB/s (2494kB/s-4343kB/s), io=16.0MiB (16.8MB), run=1682-2897msec WRITE: bw=7629KiB/s (7812kB/s), 2861KiB/s-4870KiB/s (2930kB/s-4987kB/s), io=32.0MiB (33.6MB), run=1682-4295msec