== sanity test 398b: DIO and buffer IO race ============== 19:02:03 (1787785323) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.659 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146018: Wed Aug 26 19:04:23 2026 read: IOPS=12, BW=50.1KiB/s (51.3kB/s)(5992KiB/119626msec) clat (usec): min=32, max=606357, avg=38830.50, stdev=33710.33 lat (usec): min=32, max=606359, avg=38833.05, stdev=33708.97 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 121], 20.00th=[ 17695], | 30.00th=[ 22676], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[149947], 99.50th=[158335], 99.90th=[383779], 99.95th=[608175], | 99.99th=[608175] bw ( KiB/s): min= 7, max= 111, per=24.93%, avg=49.85, stdev=20.62, samples=234 iops : min= 1, max= 27, avg=11.83, stdev= 5.19, samples=234 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6296KiB/119626msec); 0 zone resets clat (usec): min=928, max=1085.1k, avg=38785.22, stdev=48092.91 lat (usec): min=930, max=1085.1k, avg=38788.52, stdev=48093.04 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1876], | 20.00th=[ 3982], 30.00th=[ 7701], 40.00th=[ 17957], | 50.00th=[ 28967], 60.00th=[ 39584], 70.00th=[ 49546], | 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[ 111674], | 99.00th=[ 168821], 99.50th=[ 250610], 99.90th=[ 362808], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 127, per=25.43%, avg=53.15, stdev=22.50, samples=231 iops : min= 1, max= 31, avg=12.67, stdev= 5.64, samples=231 lat (usec) : 50=0.88%, 100=3.71%, 250=0.55%, 500=0.16%, 1000=0.10% lat (msec) : 2=5.50%, 4=4.79%, 10=7.00%, 20=11.04%, 50=37.27% lat (msec) : 100=23.89%, 250=4.79%, 500=0.26%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.31%, ctx=6493, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146019: Wed Aug 26 19:04:23 2026 read: IOPS=12, BW=49.7KiB/s (50.8kB/s)(5940KiB/119633msec) clat (usec): min=25, max=551079, avg=38533.40, stdev=33506.56 lat (usec): min=26, max=551082, avg=38535.61, stdev=33506.37 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 126], 20.00th=[ 17433], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 45876], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[149947], 99.50th=[185598], 99.90th=[375391], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 111, per=24.79%, avg=49.58, stdev=20.76, samples=233 iops : min= 1, max= 27, avg=11.76, stdev= 5.21, samples=233 write: IOPS=13, BW=53.1KiB/s (54.3kB/s)(6348KiB/119633msec); 0 zone resets clat (usec): min=957, max=1114.7k, avg=39049.38, stdev=47412.15 lat (usec): min=958, max=1114.7k, avg=39057.73, stdev=47407.91 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1696], | 20.00th=[ 3687], 30.00th=[ 7308], 40.00th=[ 18482], | 50.00th=[ 29230], 60.00th=[ 39584], 70.00th=[ 51643], | 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[ 110625], | 99.00th=[ 168821], 99.50th=[ 187696], 99.90th=[ 316670], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 126, per=25.05%, avg=52.36, stdev=21.70, samples=235 iops : min= 1, max= 31, avg=12.46, stdev= 5.46, samples=235 lat (usec) : 50=0.46%, 100=4.10%, 250=0.46%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.32%, 4=4.52%, 10=6.87%, 20=10.19%, 50=38.48% lat (msec) : 100=22.98%, 250=5.01%, 500=0.23%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.34%, ctx=6638, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146020: Wed Aug 26 19:04:23 2026 read: IOPS=12, BW=51.1KiB/s (52.3kB/s)(6028KiB/118000msec) clat (usec): min=32, max=367333, avg=37183.05, stdev=30288.36 lat (usec): min=32, max=367335, avg=37184.58, stdev=30288.47 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 133], 20.00th=[ 17433], | 30.00th=[ 22152], 40.00th=[ 26084], 50.00th=[ 30802], 60.00th=[ 35914], | 70.00th=[ 44827], 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[156238], 99.50th=[193987], 99.90th=[231736], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 111, per=25.39%, avg=50.78, stdev=22.32, samples=232 iops : min= 1, max= 27, avg=12.06, stdev= 5.61, samples=232 write: IOPS=13, BW=53.1KiB/s (54.3kB/s)(6260KiB/118000msec); 0 zone resets clat (usec): min=1005, max=1092.8k, avg=39346.74, stdev=47609.83 lat (usec): min=1007, max=1092.8k, avg=39351.48, stdev=47612.81 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1729], | 20.00th=[ 3916], 30.00th=[ 8455], 40.00th=[ 19530], | 50.00th=[ 30016], 60.00th=[ 40109], 70.00th=[ 51119], | 80.00th=[ 66323], 90.00th=[ 88605], 95.00th=[ 112722], | 99.00th=[ 168821], 99.50th=[ 193987], 99.90th=[ 467665], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 127, per=25.21%, avg=52.68, stdev=20.95, samples=232 iops : min= 1, max= 31, avg=12.54, stdev= 5.27, samples=232 lat (usec) : 50=0.78%, 100=3.91%, 250=0.26%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.05%, 4=4.46%, 10=6.28%, 20=11.04%, 50=39.23% lat (msec) : 100=22.46%, 250=5.24%, 500=0.10%, 2000=0.03% cpu : usr=0.07%, sys=5.34%, ctx=6550, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146021: Wed Aug 26 19:04:23 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6052KiB/119795msec) clat (usec): min=34, max=1142.6k, avg=39629.06, stdev=42028.75 lat (usec): min=34, max=1142.6k, avg=39630.52, stdev=42028.65 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 61], 10.00th=[ 8291], | 20.00th=[ 18744], 30.00th=[ 23462], 40.00th=[ 27395], | 50.00th=[ 32375], 60.00th=[ 38536], 70.00th=[ 47449], | 80.00th=[ 57410], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[ 145753], 99.50th=[ 210764], 99.90th=[ 425722], | 99.95th=[1149240], 99.99th=[1149240] bw ( KiB/s): min= 7, max= 117, per=25.21%, avg=50.42, stdev=21.06, samples=235 iops : min= 1, max= 29, avg=11.98, stdev= 5.31, samples=235 write: IOPS=13, BW=52.1KiB/s (53.3kB/s)(6236KiB/119795msec); 0 zone resets clat (usec): min=1001, max=514640, avg=38230.96, stdev=41817.77 lat (usec): min=1002, max=514642, avg=38234.23, stdev=41816.85 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1663], 20.00th=[ 3589], | 30.00th=[ 6652], 40.00th=[ 14877], 50.00th=[ 27132], 60.00th=[ 36963], | 70.00th=[ 50594], 80.00th=[ 65799], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[170918], 99.50th=[193987], 99.90th=[308282], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 7, max= 118, per=24.93%, avg=52.11, stdev=21.57, samples=234 iops : min= 1, max= 29, avg=12.40, stdev= 5.42, samples=234 lat (usec) : 50=0.52%, 100=3.71%, 250=0.26%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=6.35%, 4=4.69%, 10=7.13%, 20=10.22%, 50=38.22% lat (msec) : 100=23.08%, 250=5.37%, 500=0.16%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.22%, ctx=6602, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=200KiB/s (205kB/s), 49.7KiB/s-51.1KiB/s (50.8kB/s-52.3kB/s), io=23.4MiB (24.6MB), run=118000-119795msec WRITE: bw=210KiB/s (215kB/s), 52.1KiB/s-53.1KiB/s (53.3kB/s-54.3kB/s), io=24.6MiB (25.7MB), run=118000-119795msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146014: Wed Aug 26 19:07:04 2026 read: IOPS=5, BW=21.3KiB/s (21.8kB/s)(5992KiB/281581msec) clat (msec): min=5, max=1136, avg=37.13, stdev=41.21 lat (msec): min=5, max=1136, avg=37.13, stdev=41.21 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 163], 99.50th=[ 180], 99.90th=[ 305], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7, max= 87, per=28.01%, avg=23.81, stdev=15.43, samples=486 iops : min= 1, max= 21, avg= 5.34, stdev= 3.87, samples=486 write: IOPS=5, BW=22.4KiB/s (22.9kB/s)(6296KiB/281581msec); 0 zone resets clat (msec): min=43, max=663, avg=143.26, stdev=63.37 lat (msec): min=43, max=663, avg=143.26, stdev=63.37 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 68], 10.00th=[ 79], 20.00th=[ 94], | 30.00th=[ 107], 40.00th=[ 118], 50.00th=[ 130], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 186], 90.00th=[ 222], 95.00th=[ 259], | 99.00th=[ 351], 99.50th=[ 401], 99.90th=[ 575], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 7, max= 55, per=24.68%, avg=21.97, stdev= 8.80, samples=551 iops : min= 1, max= 13, avg= 4.87, stdev= 2.22, samples=551 lat (msec) : 10=1.66%, 20=13.83%, 50=23.44%, 100=20.15%, 250=37.86% lat (msec) : 500=2.93%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=1.15%, ctx=5256, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146015: Wed Aug 26 19:07:04 2026 read: IOPS=5, BW=21.1KiB/s (21.6kB/s)(5940KiB/281337msec) clat (msec): min=5, max=1195, avg=37.51, stdev=45.71 lat (msec): min=5, max=1195, avg=37.52, stdev=45.71 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 77], 95.00th=[ 101], | 99.00th=[ 174], 99.50th=[ 220], 99.90th=[ 405], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 102, per=27.81%, avg=23.64, stdev=15.48, samples=484 iops : min= 1, max= 25, avg= 5.28, stdev= 3.88, samples=484 write: IOPS=5, BW=22.6KiB/s (23.1kB/s)(6348KiB/281337msec); 0 zone resets clat (msec): min=48, max=602, avg=141.87, stdev=60.11 lat (msec): min=48, max=602, avg=141.87, stdev=60.11 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 105], 40.00th=[ 118], 50.00th=[ 131], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 218], 95.00th=[ 249], | 99.00th=[ 347], 99.50th=[ 380], 99.90th=[ 550], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 47, per=25.03%, avg=22.28, stdev= 8.76, samples=548 iops : min= 1, max= 11, avg= 4.95, stdev= 2.21, samples=548 lat (msec) : 10=1.99%, 20=14.88%, 50=22.07%, 100=20.80%, 250=37.53% lat (msec) : 500=2.64%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.12%, ctx=5370, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146016: Wed Aug 26 19:07:04 2026 read: IOPS=5, BW=21.4KiB/s (21.9kB/s)(6028KiB/281550msec) clat (msec): min=6, max=476, avg=37.73, stdev=31.69 lat (msec): min=6, max=476, avg=37.73, stdev=31.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 53], 90.00th=[ 73], 95.00th=[ 94], | 99.00th=[ 155], 99.50th=[ 180], 99.90th=[ 300], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 119, per=27.55%, avg=23.42, stdev=15.24, samples=497 iops : min= 1, max= 29, avg= 5.23, stdev= 3.83, samples=497 write: IOPS=5, BW=22.2KiB/s (22.8kB/s)(6260KiB/281550msec); 0 zone resets clat (msec): min=33, max=1410, avg=143.30, stdev=69.24 lat (msec): min=33, max=1410, avg=143.30, stdev=69.24 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 93], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 131], 60.00th=[ 144], | 70.00th=[ 161], 80.00th=[ 184], 90.00th=[ 226], 95.00th=[ 255], | 99.00th=[ 355], 99.50th=[ 393], 99.90th=[ 550], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 7, max= 47, per=24.69%, avg=21.98, stdev= 8.90, samples=548 iops : min= 1, max= 11, avg= 4.87, stdev= 2.25, samples=548 lat (msec) : 10=1.73%, 20=12.47%, 50=24.51%, 100=21.06%, 250=37.27% lat (msec) : 500=2.86%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.12%, ctx=5285, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146017: Wed Aug 26 19:07:04 2026 read: IOPS=5, BW=21.8KiB/s (22.3kB/s)(6052KiB/277625msec) clat (msec): min=6, max=479, avg=36.22, stdev=33.70 lat (msec): min=6, max=479, avg=36.22, stdev=33.70 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 38], 80.00th=[ 49], 90.00th=[ 74], 95.00th=[ 94], | 99.00th=[ 163], 99.50th=[ 194], 99.90th=[ 397], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 88, per=29.08%, avg=24.71, stdev=15.99, samples=473 iops : min= 1, max= 22, avg= 5.55, stdev= 4.04, samples=473 write: IOPS=5, BW=22.5KiB/s (23.0kB/s)(6236KiB/277625msec); 0 zone resets clat (msec): min=37, max=1336, avg=142.64, stdev=66.01 lat (msec): min=37, max=1336, avg=142.64, stdev=66.01 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 106], 40.00th=[ 117], 50.00th=[ 131], 60.00th=[ 146], | 70.00th=[ 161], 80.00th=[ 182], 90.00th=[ 220], 95.00th=[ 255], | 99.00th=[ 334], 99.50th=[ 359], 99.90th=[ 550], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7, max= 48, per=24.67%, avg=21.95, stdev= 8.75, samples=546 iops : min= 1, max= 12, avg= 4.86, stdev= 2.21, samples=546 lat (msec) : 10=2.08%, 20=14.32%, 50=23.83%, 100=19.66%, 250=37.27% lat (msec) : 500=2.77%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.16%, ctx=5345, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=85.3KiB/s (87.3kB/s), 21.1KiB/s-21.8KiB/s (21.6kB/s-22.3kB/s), io=23.4MiB (24.6MB), run=277625-281581msec WRITE: bw=89.3KiB/s (91.4kB/s), 22.2KiB/s-22.6KiB/s (22.8kB/s-23.1kB/s), io=24.6MiB (25.7MB), run=277625-281581msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146082: Wed Aug 26 19:07:43 2026 read: IOPS=12, BW=195KiB/s (199kB/s)(5920KiB/30394msec) clat (usec): min=40, max=283648, avg=42252.35, stdev=38248.40 lat (usec): min=40, max=283649, avg=42253.79, stdev=38248.30 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 70], 20.00th=[ 113], | 30.00th=[ 22152], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[170918], 99.50th=[254804], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 62, max= 382, per=24.77%, avg=195.19, stdev=77.83, samples=59 iops : min= 3, max= 23, avg=11.44, stdev= 4.86, samples=59 write: IOPS=13, BW=210KiB/s (215kB/s)(6368KiB/30394msec); 0 zone resets clat (usec): min=1472, max=337605, avg=36917.67, stdev=40018.47 lat (usec): min=1474, max=337607, avg=36933.80, stdev=40009.36 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1876], 10.00th=[ 2638], 20.00th=[ 4883], | 30.00th=[ 7832], 40.00th=[ 11994], 50.00th=[ 22938], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[117965], | 99.00th=[152044], 99.50th=[221250], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 382, per=25.42%, avg=210.69, stdev=79.80, samples=59 iops : min= 1, max= 23, avg=12.42, stdev= 4.98, samples=59 lat (usec) : 50=0.91%, 100=8.33%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.52%, 4=5.60%, 10=10.16%, 20=8.33%, 50=31.38% lat (msec) : 100=23.96%, 250=6.38%, 500=0.39% cpu : usr=0.08%, sys=5.78%, ctx=1462, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146083: Wed Aug 26 19:07:43 2026 read: IOPS=12, BW=193KiB/s (198kB/s)(5744KiB/29745msec) clat (usec): min=31, max=381658, avg=44027.98, stdev=36790.04 lat (usec): min=32, max=381659, avg=44029.62, stdev=36789.61 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 65], 10.00th=[ 73], 20.00th=[ 13304], | 30.00th=[ 28443], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 49546], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 83362], 95.00th=[ 96994], | 99.00th=[170918], 99.50th=[181404], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 382, per=24.88%, avg=196.02, stdev=74.97, samples=57 iops : min= 1, max= 23, avg=11.49, stdev= 4.67, samples=57 write: IOPS=13, BW=220KiB/s (225kB/s)(6544KiB/29745msec); 0 zone resets clat (usec): min=1491, max=296713, avg=33835.37, stdev=39257.94 lat (usec): min=1493, max=296716, avg=33846.81, stdev=39264.13 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1893], 10.00th=[ 2638], 20.00th=[ 4817], | 30.00th=[ 7177], 40.00th=[ 11863], 50.00th=[ 19792], 60.00th=[ 29230], | 70.00th=[ 44827], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[185598], 99.50th=[225444], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 383, per=26.45%, avg=219.24, stdev=88.90, samples=58 iops : min= 1, max= 23, avg=12.95, stdev= 5.55, samples=58 lat (usec) : 50=0.78%, 100=6.77%, 250=1.43%, 500=0.13% lat (msec) : 2=3.78%, 4=4.82%, 10=10.94%, 20=8.33%, 50=31.12% lat (msec) : 100=27.21%, 250=4.30%, 500=0.39% cpu : usr=0.08%, sys=5.83%, ctx=1477, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146084: Wed Aug 26 19:07:43 2026 read: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30271msec) clat (usec): min=39, max=227497, avg=41202.00, stdev=32392.96 lat (usec): min=39, max=227498, avg=41203.55, stdev=32392.99 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 67], 10.00th=[ 77], 20.00th=[ 15795], | 30.00th=[ 26608], 40.00th=[ 30802], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 61080], 90.00th=[ 77071], 95.00th=[ 89654], | 99.00th=[168821], 99.50th=[181404], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 61, max= 411, per=26.47%, avg=208.56, stdev=84.82, samples=59 iops : min= 3, max= 25, avg=12.29, stdev= 5.37, samples=59 write: IOPS=12, BW=199KiB/s (204kB/s)(6032KiB/30271msec); 0 zone resets clat (usec): min=1175, max=360695, avg=37273.89, stdev=41638.14 lat (usec): min=1178, max=360697, avg=37306.43, stdev=41639.88 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2147], 10.00th=[ 2835], 20.00th=[ 5866], | 30.00th=[ 8848], 40.00th=[ 15139], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 65274], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[212861], 99.50th=[274727], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 62, max= 379, per=23.84%, avg=197.66, stdev=81.59, samples=59 iops : min= 3, max= 23, avg=11.61, stdev= 5.11, samples=59 lat (usec) : 50=0.65%, 100=7.29%, 250=0.91%, 500=0.39%, 750=0.13% lat (msec) : 2=2.21%, 4=5.34%, 10=9.11%, 20=6.64%, 50=35.94% lat (msec) : 100=26.56%, 250=4.56%, 500=0.26% cpu : usr=0.10%, sys=5.47%, ctx=1463, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146085: Wed Aug 26 19:07:43 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29558msec) clat (usec): min=38, max=348606, avg=40156.86, stdev=37751.27 lat (usec): min=38, max=348608, avg=40158.33, stdev=37751.34 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 105], | 30.00th=[ 22152], 40.00th=[ 30016], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[ 91751], | 99.00th=[170918], 99.50th=[256902], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 415, per=25.75%, avg=202.91, stdev=80.02, samples=58 iops : min= 1, max= 25, avg=11.93, stdev= 5.04, samples=58 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29558msec); 0 zone resets clat (usec): min=1437, max=204054, avg=36692.31, stdev=39590.45 lat (usec): min=1439, max=204057, avg=36695.33, stdev=39591.13 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2024], 10.00th=[ 2835], 20.00th=[ 5866], | 30.00th=[ 8586], 40.00th=[ 11600], 50.00th=[ 21365], 60.00th=[ 34341], | 70.00th=[ 47449], 80.00th=[ 62653], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[181404], 99.50th=[202376], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 63, max= 414, per=25.58%, avg=212.09, stdev=81.57, samples=58 iops : min= 3, max= 25, avg=12.50, stdev= 5.10, samples=58 lat (usec) : 50=1.04%, 100=8.20%, 250=1.95%, 500=0.26%, 750=0.39% lat (msec) : 2=2.47%, 4=4.69%, 10=11.98%, 20=7.81%, 50=31.51% lat (msec) : 100=23.57%, 250=5.86%, 500=0.26% cpu : usr=0.07%, sys=5.83%, ctx=1425, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=788KiB/s (807kB/s), 193KiB/s-207KiB/s (198kB/s-212kB/s), io=23.4MiB (24.5MB), run=29558-30394msec WRITE: bw=829KiB/s (849kB/s), 199KiB/s-220KiB/s (204kB/s-225kB/s), io=24.6MiB (25.8MB), run=29558-30394msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146077: Wed Aug 26 19:08:24 2026 read: IOPS=5, BW=83.1KiB/s (85.1kB/s)(5920KiB/71266msec) clat (msec): min=8, max=371, avg=40.50, stdev=45.94 lat (msec): min=8, max=371, avg=40.50, stdev=45.94 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 89], 95.00th=[ 124], | 99.00th=[ 255], 99.50th=[ 330], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 320, per=28.01%, avg=93.55, stdev=59.51, samples=125 iops : min= 1, max= 20, avg= 5.13, stdev= 3.82, samples=125 write: IOPS=5, BW=89.4KiB/s (91.5kB/s)(6368KiB/71266msec); 0 zone resets clat (msec): min=41, max=435, avg=141.02, stdev=63.91 lat (msec): min=41, max=435, avg=141.03, stdev=63.90 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 102], 40.00th=[ 115], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 153], 80.00th=[ 180], 90.00th=[ 239], 95.00th=[ 268], | 99.00th=[ 372], 99.50th=[ 401], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 27, max= 191, per=25.93%, avg=91.01, stdev=41.40, samples=138 iops : min= 1, max= 11, avg= 4.96, stdev= 2.70, samples=138 lat (msec) : 10=0.91%, 20=16.41%, 50=21.48%, 100=20.31%, 250=36.20% lat (msec) : 500=4.69% cpu : usr=0.04%, sys=1.18%, ctx=1263, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146078: Wed Aug 26 19:08:24 2026 read: IOPS=5, BW=80.2KiB/s (82.1kB/s)(5744KiB/71612msec) clat (msec): min=6, max=328, avg=39.24, stdev=40.28 lat (msec): min=6, max=328, avg=39.24, stdev=40.28 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 87], 95.00th=[ 118], | 99.00th=[ 199], 99.50th=[ 271], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 27, max= 346, per=29.78%, avg=99.48, stdev=67.46, samples=113 iops : min= 1, max= 21, avg= 5.50, stdev= 4.30, samples=113 write: IOPS=5, BW=91.4KiB/s (93.6kB/s)(6544KiB/71612msec); 0 zone resets clat (msec): min=39, max=509, avg=140.21, stdev=70.93 lat (msec): min=39, max=509, avg=140.21, stdev=70.93 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 100], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 134], | 70.00th=[ 155], 80.00th=[ 182], 90.00th=[ 232], 95.00th=[ 296], | 99.00th=[ 397], 99.50th=[ 422], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 31, max= 192, per=26.07%, avg=91.52, stdev=41.77, samples=140 iops : min= 1, max= 12, avg= 4.99, stdev= 2.74, samples=140 lat (msec) : 10=1.56%, 20=15.10%, 50=20.70%, 100=22.14%, 250=35.94% lat (msec) : 500=4.43%, 750=0.13% cpu : usr=0.04%, sys=1.28%, ctx=1348, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146079: Wed Aug 26 19:08:24 2026 read: IOPS=5, BW=91.9KiB/s (94.1kB/s)(6256KiB/68044msec) clat (msec): min=7, max=257, avg=36.74, stdev=35.50 lat (msec): min=7, max=257, avg=36.74, stdev=35.50 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 78], 95.00th=[ 125], | 99.00th=[ 174], 99.50th=[ 230], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 416, per=30.12%, avg=100.59, stdev=71.70, samples=123 iops : min= 1, max= 26, avg= 5.53, stdev= 4.58, samples=123 write: IOPS=5, BW=88.6KiB/s (90.8kB/s)(6032KiB/68044msec); 0 zone resets clat (msec): min=48, max=429, avg=141.92, stdev=67.72 lat (msec): min=48, max=429, avg=141.93, stdev=67.72 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 101], 40.00th=[ 110], 50.00th=[ 121], 60.00th=[ 138], | 70.00th=[ 153], 80.00th=[ 186], 90.00th=[ 239], 95.00th=[ 288], | 99.00th=[ 376], 99.50th=[ 405], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 30, max= 192, per=25.31%, avg=88.85, stdev=39.99, samples=133 iops : min= 1, max= 12, avg= 4.80, stdev= 2.59, samples=133 lat (msec) : 10=1.95%, 20=16.80%, 50=23.18%, 100=20.05%, 250=33.72% lat (msec) : 500=4.30% cpu : usr=0.04%, sys=1.26%, ctx=1405, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146080: Wed Aug 26 19:08:24 2026 read: IOPS=5, BW=85.0KiB/s (87.1kB/s)(6032KiB/70937msec) clat (msec): min=8, max=332, avg=39.41, stdev=41.76 lat (msec): min=8, max=332, avg=39.41, stdev=41.76 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 38], 80.00th=[ 49], 90.00th=[ 83], 95.00th=[ 126], | 99.00th=[ 245], 99.50th=[ 249], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 284, per=28.26%, avg=94.39, stdev=59.16, samples=125 iops : min= 1, max= 17, avg= 5.18, stdev= 3.80, samples=125 write: IOPS=5, BW=88.2KiB/s (90.3kB/s)(6256KiB/70937msec); 0 zone resets clat (msec): min=47, max=447, avg=143.27, stdev=70.39 lat (msec): min=47, max=447, avg=143.27, stdev=70.39 clat percentiles (msec): | 1.00th=[ 58], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 89], | 30.00th=[ 103], 40.00th=[ 115], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 153], 80.00th=[ 184], 90.00th=[ 230], 95.00th=[ 279], | 99.00th=[ 426], 99.50th=[ 439], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 192, per=25.39%, avg=89.10, stdev=40.98, samples=138 iops : min= 1, max= 12, avg= 4.84, stdev= 2.67, samples=138 lat (msec) : 10=1.04%, 20=16.02%, 50=22.40%, 100=20.44%, 250=35.68% lat (msec) : 500=4.43% cpu : usr=0.04%, sys=1.15%, ctx=1306, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=334KiB/s (342kB/s), 80.2KiB/s-91.9KiB/s (82.1kB/s-94.1kB/s), io=23.4MiB (24.5MB), run=68044-71612msec WRITE: bw=352KiB/s (360kB/s), 88.2KiB/s-91.4KiB/s (90.3kB/s-93.6kB/s), io=24.6MiB (25.8MB), run=68044-71612msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146102: Wed Aug 26 19:08:38 2026 read: IOPS=1, BW=1977KiB/s (2024kB/s)(7168KiB/3626msec) clat (usec): min=904, max=368346, avg=212870.15, stdev=149723.64 lat (usec): min=905, max=368348, avg=212871.62, stdev=149723.86 clat percentiles (usec): | 1.00th=[ 906], 5.00th=[ 906], 10.00th=[ 906], 20.00th=[ 1270], | 30.00th=[250610], 40.00th=[250610], 50.00th=[270533], 60.00th=[274727], | 70.00th=[274727], 80.00th=[320865], 90.00th=[367002], 95.00th=[367002], | 99.00th=[367002], 99.50th=[367002], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 2039, max= 2801, per=53.32%, avg=2230.50, stdev=380.34, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1412KiB/s (1446kB/s)(5120KiB/3626msec); 0 zone resets clat (msec): min=281, max=583, avg=397.67, stdev=143.01 lat (msec): min=281, max=583, avg=397.75, stdev=143.01 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2035, max= 2039, per=34.79%, avg=2037.67, stdev= 2.31, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 500=66.67%, 750=16.67% cpu : usr=0.00%, sys=17.41%, ctx=218, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146103: Wed Aug 26 19:08:38 2026 read: IOPS=0, BW=418KiB/s (428kB/s)(2048KiB/4895msec) clat (usec): min=617, max=344943, avg=172780.49, stdev=243475.71 lat (usec): min=618, max=344947, avg=172782.81, stdev=243477.21 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 619], | 30.00th=[ 619], 40.00th=[ 619], 50.00th=[ 619], 60.00th=[346031], | 70.00th=[346031], 80.00th=[346031], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1400, max= 2035, per=41.06%, avg=1717.50, stdev=449.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2092KiB/s (2142kB/s)(10.0MiB/4895msec); 0 zone resets clat (msec): min=146, max=1179, avg=440.47, stdev=350.04 lat (msec): min=146, max=1179, avg=440.55, stdev=350.04 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 165], | 30.00th=[ 218], 40.00th=[ 245], 50.00th=[ 255], 60.00th=[ 305], | 70.00th=[ 330], 80.00th=[ 735], 90.00th=[ 835], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 2007, max= 6107, per=52.09%, avg=3051.00, stdev=1704.92, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=14.94%, ctx=191, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146104: Wed Aug 26 19:08:38 2026 read: IOPS=1, BW=1531KiB/s (1568kB/s)(6144KiB/4012msec) clat (usec): min=433, max=483688, avg=209712.95, stdev=202938.07 lat (usec): min=434, max=483690, avg=209714.40, stdev=202938.15 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], 20.00th=[ 469], | 30.00th=[ 469], 40.00th=[102237], 50.00th=[102237], 60.00th=[329253], | 70.00th=[341836], 80.00th=[341836], 90.00th=[484443], 95.00th=[484443], | 99.00th=[484443], 99.50th=[484443], 99.90th=[484443], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 2007, max= 4079, per=80.68%, avg=3375.00, stdev=1184.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1531KiB/s (1568kB/s)(6144KiB/4012msec); 0 zone resets clat (msec): min=189, max=1011, avg=435.16, stdev=297.58 lat (msec): min=189, max=1011, avg=435.22, stdev=297.59 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 363], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1420, max= 4079, per=39.56%, avg=2316.80, stdev=1019.80, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67% lat (msec) : 250=16.67%, 500=58.33%, 2000=8.33% cpu : usr=0.07%, sys=15.08%, ctx=304, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146105: Wed Aug 26 19:08:38 2026 read: IOPS=1, BW=1294KiB/s (1325kB/s)(5120KiB/3956msec) clat (usec): min=640, max=358476, avg=156254.77, stdev=154341.54 lat (usec): min=641, max=358477, avg=156256.06, stdev=154341.49 clat percentiles (usec): | 1.00th=[ 644], 5.00th=[ 644], 10.00th=[ 644], 20.00th=[ 644], | 30.00th=[ 873], 40.00th=[ 873], 50.00th=[202376], 60.00th=[202376], | 70.00th=[219153], 80.00th=[219153], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1812KiB/s (1855kB/s)(7168KiB/3956msec); 0 zone resets clat (msec): min=259, max=858, avg=446.56, stdev=212.51 lat (msec): min=259, max=858, avg=446.67, stdev=212.57 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 292], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 347], 60.00th=[ 464], | 70.00th=[ 464], 80.00th=[ 584], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1343, max= 4015, per=39.20%, avg=2295.80, stdev=1007.38, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=15.83%, ctx=212, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4184KiB/s (4284kB/s), 418KiB/s-1977KiB/s (428kB/s-2024kB/s), io=20.0MiB (20.0MB), run=3626-4895msec WRITE: bw=5857KiB/s (5998kB/s), 1412KiB/s-2092KiB/s (1446kB/s-2142kB/s), io=28.0MiB (29.4MB), run=3626-4895msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146107: Wed Aug 26 19:08:39 2026 read: IOPS=1, BW=1660KiB/s (1700kB/s)(7168KiB/4318msec) clat (msec): min=81, max=733, avg=232.64, stdev=227.12 lat (msec): min=81, max=733, avg=232.64, stdev=227.12 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 103], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 176], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 241], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1878, max= 4087, per=63.66%, avg=2403.00, stdev=943.43, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1186KiB/s (1214kB/s)(5120KiB/4318msec); 0 zone resets clat (msec): min=329, max=828, avg=527.76, stdev=195.30 lat (msec): min=329, max=828, avg=528.65, stdev=195.34 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1889, max= 2043, per=37.52%, avg=1982.75, stdev=66.06, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=5.72%, ctx=99, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146108: Wed Aug 26 19:08:39 2026 read: IOPS=0, BW=427KiB/s (437kB/s)(2048KiB/4797msec) clat (msec): min=135, max=147, avg=141.38, stdev= 8.52 lat (msec): min=135, max=147, avg=141.38, stdev= 8.52 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 148], 90.00th=[ 148], 95.00th=[ 148], | 99.00th=[ 148], 99.50th=[ 148], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 1678, max= 2007, per=48.81%, avg=1842.50, stdev=232.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2135KiB/s (2186kB/s)(10.0MiB/4797msec); 0 zone resets clat (msec): min=119, max=1135, avg=439.63, stdev=363.07 lat (msec): min=119, max=1135, avg=440.13, stdev=363.81 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 144], | 30.00th=[ 169], 40.00th=[ 245], 50.00th=[ 309], 60.00th=[ 321], | 70.00th=[ 393], 80.00th=[ 527], 90.00th=[ 1036], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 1889, max= 6144, per=57.09%, avg=3017.00, stdev=1727.35, samples=6 iops : min= 1, max= 6, avg= 2.17, stdev= 2.04, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=5.82%, ctx=88, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146109: Wed Aug 26 19:08:39 2026 read: IOPS=1, BW=1369KiB/s (1402kB/s)(6144KiB/4489msec) clat (msec): min=78, max=623, avg=225.21, stdev=203.73 lat (msec): min=78, max=623, avg=225.22, stdev=203.73 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 186], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2035, max= 4015, per=88.60%, avg=3344.67, stdev=1134.31, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1369KiB/s (1402kB/s)(6144KiB/4489msec); 0 zone resets clat (msec): min=264, max=1321, avg=502.12, stdev=403.70 lat (msec): min=265, max=1321, avg=502.29, stdev=403.73 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1684, max= 2043, per=36.61%, avg=1934.80, stdev=153.72, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.07%, sys=4.41%, ctx=95, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146110: Wed Aug 26 19:08:39 2026 read: IOPS=0, BW=944KiB/s (966kB/s)(5120KiB/5425msec) clat (msec): min=75, max=576, avg=209.60, stdev=208.93 lat (msec): min=75, max=576, avg=209.60, stdev=208.93 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2035, max= 6144, per=100.00%, avg=4089.50, stdev=2905.50, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=1, BW=1321KiB/s (1353kB/s)(7168KiB/5425msec); 0 zone resets clat (msec): min=181, max=1201, avg=608.72, stdev=398.86 lat (msec): min=181, max=1201, avg=608.96, stdev=398.73 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 213], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 600], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 1011], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1889, max= 4079, per=45.57%, avg=2408.20, stdev=935.93, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=8.33%, 750=25.00%, 2000=16.67% cpu : usr=0.02%, sys=4.07%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3775KiB/s (3866kB/s), 427KiB/s-1660KiB/s (437kB/s-1700kB/s), io=20.0MiB (20.0MB), run=4318-5425msec WRITE: bw=5285KiB/s (5412kB/s), 1186KiB/s-2135KiB/s (1214kB/s-2186kB/s), io=28.0MiB (29.4MB), run=4318-5425msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146116: Wed Aug 26 19:08:52 2026 read: IOPS=1, BW=5326KiB/s (5454kB/s)(12.0MiB/2307msec) clat (msec): min=636, max=828, avg=745.53, stdev=98.48 lat (msec): min=636, max=828, avg=745.53, stdev=98.48 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=19.77%, ctx=224, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146117: Wed Aug 26 19:08:52 2026 read: IOPS=0, BW=1385KiB/s (1418kB/s)(4096KiB/2958msec) clat (nsec): min=637754k, max=637754k, avg=637754281.00, stdev= 0.00 lat (nsec): min=637757k, max=637757k, avg=637756889.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2769KiB/s (2836kB/s)(8192KiB/2958msec); 0 zone resets clat (msec): min=696, max=1611, avg=1154.05, stdev=647.28 lat (msec): min=698, max=1612, avg=1155.26, stdev=646.03 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8192, max= 8192, per=83.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.58%, ctx=118, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146118: Wed Aug 26 19:08:52 2026 write: IOPS=0, BW=3674KiB/s (3762kB/s)(12.0MiB/3345msec); 0 zone resets clat (msec): min=836, max=1273, avg=1107.52, stdev=236.75 lat (msec): min=836, max=1273, avg=1107.89, stdev=236.80 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8175, max= 8192, per=83.54%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.09%, sys=4.31%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146119: Wed Aug 26 19:08:52 2026 write: IOPS=1, BW=4929KiB/s (5047kB/s)(12.0MiB/2493msec); 0 zone resets clat (msec): min=656, max=1046, avg=810.06, stdev=207.64 lat (msec): min=657, max=1046, avg=811.19, stdev=207.11 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8126, max= 8175, per=83.20%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.16%, sys=7.38%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5539KiB/s (5672kB/s), 1385KiB/s-5326KiB/s (1418kB/s-5454kB/s), io=16.0MiB (16.8MB), run=2307-2958msec WRITE: bw=9796KiB/s (10.0MB/s), 2769KiB/s-4929KiB/s (2836kB/s-5047kB/s), io=32.0MiB (33.6MB), run=2493-3345msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146121: Wed Aug 26 19:08:53 2026 read: IOPS=0, BW=3404KiB/s (3486kB/s)(12.0MiB/3610msec) clat (msec): min=388, max=1679, avg=1188.67, stdev=699.17 lat (msec): min=388, max=1679, avg=1188.67, stdev=699.17 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 1502], 50.00th=[ 1502], 60.00th=[ 1502], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.80%, ctx=72, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146122: Wed Aug 26 19:08:53 2026 read: IOPS=0, BW=1150KiB/s (1177kB/s)(4096KiB/3563msec) clat (nsec): min=1522.3M, max=1522.3M, avg=1522259712.00, stdev= 0.00 lat (nsec): min=1522.3M, max=1522.3M, avg=1522262352.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1519], 5.00th=[ 1519], 10.00th=[ 1519], 20.00th=[ 1519], | 30.00th=[ 1519], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2299KiB/s (2354kB/s)(8192KiB/3563msec); 0 zone resets clat (msec): min=973, max=1058, avg=1015.83, stdev=59.91 lat (msec): min=974, max=1061, avg=1017.70, stdev=61.78 clat percentiles (msec): | 1.00th=[ 978], 5.00th=[ 978], 10.00th=[ 978], 20.00th=[ 978], | 30.00th=[ 978], 40.00th=[ 978], 50.00th=[ 978], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8110, max= 8110, per=88.19%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.10%, ctx=69, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146123: Wed Aug 26 19:08:53 2026 write: IOPS=0, BW=3633KiB/s (3721kB/s)(12.0MiB/3382msec); 0 zone resets clat (msec): min=380, max=1673, avg=1125.34, stdev=668.38 lat (msec): min=381, max=1674, avg=1125.91, stdev=668.28 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7876, max= 8175, per=87.27%, avg=8025.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.28%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146124: Wed Aug 26 19:08:53 2026 write: IOPS=1, BW=4838KiB/s (4954kB/s)(12.0MiB/2540msec); 0 zone resets clat (msec): min=518, max=1284, avg=833.03, stdev=401.19 lat (msec): min=519, max=1286, avg=833.81, stdev=401.57 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7123, max= 8175, per=83.18%, avg=7649.00, stdev=743.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.07%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4539KiB/s (4647kB/s), 1150KiB/s-3404KiB/s (1177kB/s-3486kB/s), io=16.0MiB (16.8MB), run=3563-3610msec WRITE: bw=9197KiB/s (9417kB/s), 2299KiB/s-4838KiB/s (2354kB/s-4954kB/s), io=32.0MiB (33.6MB), run=2540-3563msec