== sanity test 398b: DIO and buffer IO race ============== 11:18:24 (1789139904) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.67346 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144240: Fri Sep 11 11:20:58 2026 read: IOPS=11, BW=45.2KiB/s (46.2kB/s)(5992KiB/132690msec) clat (usec): min=28, max=1079.2k, avg=43902.92, stdev=46087.60 lat (usec): min=28, max=1079.2k, avg=43909.62, stdev=46085.32 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 89], | 20.00th=[ 18220], 30.00th=[ 23987], 40.00th=[ 29754], | 50.00th=[ 36439], 60.00th=[ 43779], 70.00th=[ 52691], | 80.00th=[ 64226], 90.00th=[ 83362], 95.00th=[ 100140], | 99.00th=[ 156238], 99.50th=[ 200279], 99.90th=[ 509608], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 126, per=25.41%, avg=45.73, stdev=20.38, samples=255 iops : min= 1, max= 31, avg=10.79, stdev= 5.14, samples=255 write: IOPS=11, BW=47.4KiB/s (48.6kB/s)(6296KiB/132690msec); 0 zone resets clat (usec): min=749, max=292537, avg=42424.55, stdev=43648.22 lat (usec): min=751, max=292539, avg=42427.00, stdev=43647.94 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1319], 20.00th=[ 3818], | 30.00th=[ 8717], 40.00th=[ 19530], 50.00th=[ 31589], 60.00th=[ 42206], | 70.00th=[ 56886], 80.00th=[ 74974], 90.00th=[ 99091], 95.00th=[122160], | 99.00th=[196084], 99.50th=[219153], 99.90th=[283116], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 114, per=25.08%, avg=47.15, stdev=20.47, samples=260 iops : min= 1, max= 28, avg=11.13, stdev= 5.14, samples=260 lat (usec) : 50=0.55%, 100=4.52%, 250=0.23%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=7.19%, 4=3.35%, 10=6.32%, 20=9.15%, 50=34.73% lat (msec) : 100=26.40%, 250=6.97%, 500=0.33%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.90%, ctx=6210, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144241: Fri Sep 11 11:20:58 2026 read: IOPS=11, BW=44.6KiB/s (45.7kB/s)(5940KiB/133076msec) clat (usec): min=28, max=1118.6k, avg=44202.66, stdev=46179.49 lat (usec): min=28, max=1118.6k, avg=44204.08, stdev=46179.53 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 99], | 20.00th=[ 19006], 30.00th=[ 24773], 40.00th=[ 30016], | 50.00th=[ 36963], 60.00th=[ 44303], 70.00th=[ 53740], | 80.00th=[ 63701], 90.00th=[ 85459], 95.00th=[ 101188], | 99.00th=[ 168821], 99.50th=[ 208667], 99.90th=[ 591397], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 102, per=24.81%, avg=44.66, stdev=17.64, samples=258 iops : min= 1, max= 25, avg=10.51, stdev= 4.44, samples=258 write: IOPS=11, BW=47.7KiB/s (48.8kB/s)(6348KiB/133076msec); 0 zone resets clat (usec): min=747, max=414850, avg=42391.71, stdev=45041.10 lat (usec): min=748, max=414851, avg=42393.61, stdev=45040.94 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1188], 10.00th=[ 1336], 20.00th=[ 4146], | 30.00th=[ 8356], 40.00th=[ 19530], 50.00th=[ 31851], 60.00th=[ 42206], | 70.00th=[ 54264], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[125305], | 99.00th=[196084], 99.50th=[246416], 99.90th=[379585], 99.95th=[413139], | 99.99th=[413139] bw ( KiB/s): min= 7, max= 159, per=25.27%, avg=47.50, stdev=22.37, samples=259 iops : min= 1, max= 39, avg=11.23, stdev= 5.63, samples=259 lat (usec) : 50=0.55%, 100=4.30%, 250=0.07%, 500=0.13%, 750=0.03% lat (msec) : 2=7.03%, 4=3.22%, 10=6.71%, 20=9.28%, 50=35.64% lat (msec) : 100=25.07%, 250=7.62%, 500=0.29%, 750=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.73%, ctx=6072, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144242: Fri Sep 11 11:20:58 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6028KiB/132341msec) clat (usec): min=32, max=355952, avg=42451.24, stdev=32882.66 lat (usec): min=33, max=355954, avg=42454.94, stdev=32883.45 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 88], 20.00th=[ 19268], | 30.00th=[ 24773], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[147850], 99.50th=[185598], 99.90th=[329253], 99.95th=[354419], | 99.99th=[354419] bw ( KiB/s): min= 7, max= 120, per=25.24%, avg=45.43, stdev=19.30, samples=257 iops : min= 1, max= 30, avg=10.70, stdev= 4.87, samples=257 write: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6260KiB/132341msec); 0 zone resets clat (usec): min=712, max=1381.8k, avg=43586.39, stdev=56232.10 lat (usec): min=714, max=1381.8k, avg=43588.34, stdev=56232.15 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1270], | 20.00th=[ 3556], 30.00th=[ 8586], 40.00th=[ 19530], | 50.00th=[ 31589], 60.00th=[ 42206], 70.00th=[ 56886], | 80.00th=[ 76022], 90.00th=[ 102237], 95.00th=[ 125305], | 99.00th=[ 193987], 99.50th=[ 248513], 99.90th=[ 501220], | 99.95th=[1384121], 99.99th=[1384121] bw ( KiB/s): min= 7, max= 117, per=25.08%, avg=47.15, stdev=19.70, samples=257 iops : min= 1, max= 29, avg=11.15, stdev= 4.97, samples=257 lat (usec) : 50=0.94%, 100=4.13%, 250=0.23%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=7.78%, 4=2.86%, 10=5.70%, 20=9.28%, 50=35.06% lat (msec) : 100=25.85%, 250=7.55%, 500=0.20%, 750=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.89%, ctx=6170, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144243: Fri Sep 11 11:20:58 2026 read: IOPS=11, BW=46.2KiB/s (47.3kB/s)(6052KiB/130898msec) clat (usec): min=30, max=409136, avg=41909.87, stdev=33645.43 lat (usec): min=31, max=409137, avg=41920.41, stdev=33650.10 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 58], 10.00th=[ 104], 20.00th=[ 18482], | 30.00th=[ 24249], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[158335], 99.50th=[189793], 99.90th=[354419], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 103, per=25.95%, avg=46.71, stdev=20.27, samples=253 iops : min= 1, max= 25, avg=11.02, stdev= 5.11, samples=253 write: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6236KiB/130898msec); 0 zone resets clat (usec): min=950, max=1345.8k, avg=43155.07, stdev=55148.18 lat (usec): min=952, max=1345.8k, avg=43172.19, stdev=55167.76 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1270], | 20.00th=[ 3294], 30.00th=[ 8455], 40.00th=[ 19530], | 50.00th=[ 30802], 60.00th=[ 42730], 70.00th=[ 55837], | 80.00th=[ 76022], 90.00th=[ 101188], 95.00th=[ 126354], | 99.00th=[ 208667], 99.50th=[ 221250], 99.90th=[ 291505], | 99.95th=[1350566], 99.99th=[1350566] bw ( KiB/s): min= 7, max= 118, per=25.50%, avg=47.94, stdev=19.99, samples=254 iops : min= 1, max= 29, avg=11.34, stdev= 5.05, samples=254 lat (usec) : 50=0.94%, 100=3.94%, 250=0.49%, 500=0.10%, 1000=0.10% lat (msec) : 2=8.43%, 4=2.70%, 10=5.66%, 20=9.41%, 50=35.09% lat (msec) : 100=25.88%, 250=7.03%, 500=0.20%, 2000=0.03% cpu : usr=0.08%, sys=4.86%, ctx=6208, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=180KiB/s (185kB/s), 44.6KiB/s-46.2KiB/s (45.7kB/s-47.3kB/s), io=23.4MiB (24.6MB), run=130898-133076msec WRITE: bw=189KiB/s (193kB/s), 47.3KiB/s-47.7KiB/s (48.4kB/s-48.8kB/s), io=24.6MiB (25.7MB), run=130898-133076msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144235: Fri Sep 11 11:23:13 2026 read: IOPS=5, BW=22.3KiB/s (22.9kB/s)(5992KiB/268262msec) clat (msec): min=4, max=1244, avg=35.98, stdev=48.03 lat (msec): min=4, max=1244, avg=35.99, stdev=48.03 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 78], 95.00th=[ 105], | 99.00th=[ 180], 99.50th=[ 211], 99.90th=[ 506], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 96, per=28.24%, avg=25.13, stdev=17.28, samples=461 iops : min= 1, max= 24, avg= 5.66, stdev= 4.35, samples=461 write: IOPS=5, BW=23.5KiB/s (24.0kB/s)(6296KiB/268262msec); 0 zone resets clat (msec): min=28, max=700, avg=135.88, stdev=73.78 lat (msec): min=28, max=700, avg=135.88, stdev=73.78 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 116], 60.00th=[ 132], | 70.00th=[ 153], 80.00th=[ 184], 90.00th=[ 232], 95.00th=[ 271], | 99.00th=[ 388], 99.50th=[ 451], 99.90th=[ 676], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 71, per=25.21%, avg=23.45, stdev=11.32, samples=517 iops : min= 1, max= 17, avg= 5.23, stdev= 2.89, samples=517 lat (msec) : 10=4.23%, 20=16.41%, 50=19.86%, 100=25.26%, 250=30.40% lat (msec) : 500=3.58%, 750=0.23%, 2000=0.03% cpu : usr=0.05%, sys=1.11%, ctx=5064, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144236: Fri Sep 11 11:23:13 2026 read: IOPS=5, BW=22.2KiB/s (22.7kB/s)(5940KiB/268057msec) clat (msec): min=5, max=1291, avg=35.38, stdev=48.01 lat (msec): min=5, max=1291, avg=35.38, stdev=48.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 77], 95.00th=[ 109], | 99.00th=[ 171], 99.50th=[ 197], 99.90th=[ 426], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 95, per=28.57%, avg=25.43, stdev=16.79, samples=451 iops : min= 1, max= 23, avg= 5.73, stdev= 4.24, samples=451 write: IOPS=5, BW=23.7KiB/s (24.2kB/s)(6348KiB/268057msec); 0 zone resets clat (msec): min=35, max=700, avg=135.47, stdev=72.06 lat (msec): min=35, max=700, avg=135.48, stdev=72.06 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 150], 80.00th=[ 184], 90.00th=[ 239], 95.00th=[ 284], | 99.00th=[ 368], 99.50th=[ 405], 99.90th=[ 609], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 63, per=25.26%, avg=23.50, stdev=11.31, samples=520 iops : min= 1, max= 15, avg= 5.24, stdev= 2.88, samples=520 lat (msec) : 10=3.97%, 20=17.12%, 50=19.24%, 100=25.13%, 250=30.11% lat (msec) : 500=4.26%, 750=0.13%, 2000=0.03% cpu : usr=0.04%, sys=1.07%, ctx=5243, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144237: Fri Sep 11 11:23:13 2026 read: IOPS=5, BW=22.5KiB/s (22.0kB/s)(6028KiB/268381msec) clat (msec): min=4, max=333, avg=36.85, stdev=35.96 lat (msec): min=4, max=333, avg=36.85, stdev=35.96 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 81], 95.00th=[ 112], | 99.00th=[ 182], 99.50th=[ 201], 99.90th=[ 313], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 103, per=27.53%, avg=24.51, stdev=17.36, samples=475 iops : min= 1, max= 25, avg= 5.50, stdev= 4.39, samples=475 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6260KiB/268381msec); 0 zone resets clat (msec): min=36, max=1536, avg=135.70, stdev=79.30 lat (msec): min=36, max=1536, avg=135.70, stdev=79.30 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 115], 60.00th=[ 128], | 70.00th=[ 150], 80.00th=[ 180], 90.00th=[ 236], 95.00th=[ 284], | 99.00th=[ 372], 99.50th=[ 456], 99.90th=[ 625], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7, max= 56, per=24.95%, avg=23.20, stdev=11.38, samples=520 iops : min= 1, max= 14, avg= 5.17, stdev= 2.90, samples=520 lat (msec) : 10=4.75%, 20=14.75%, 50=20.21%, 100=25.13%, 250=30.92% lat (msec) : 500=4.13%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5226, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144238: Fri Sep 11 11:23:13 2026 read: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6052KiB/267563msec) clat (msec): min=5, max=440, avg=35.82, stdev=38.30 lat (msec): min=5, max=440, avg=35.82, stdev=38.30 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 50], 90.00th=[ 81], 95.00th=[ 114], | 99.00th=[ 186], 99.50th=[ 218], 99.90th=[ 284], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 119, per=28.56%, avg=25.42, stdev=17.83, samples=460 iops : min= 1, max= 29, avg= 5.73, stdev= 4.50, samples=460 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6236KiB/267563msec); 0 zone resets clat (msec): min=33, max=1535, avg=136.55, stdev=79.43 lat (msec): min=33, max=1535, avg=136.55, stdev=79.43 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 92], 40.00th=[ 103], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 148], 80.00th=[ 182], 90.00th=[ 234], 95.00th=[ 288], | 99.00th=[ 363], 99.50th=[ 426], 99.90th=[ 625], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7, max= 63, per=24.68%, avg=22.96, stdev=11.49, samples=522 iops : min= 1, max= 15, avg= 5.11, stdev= 2.93, samples=522 lat (msec) : 10=4.88%, 20=16.96%, 50=18.59%, 100=24.22%, 250=31.15% lat (msec) : 500=4.10%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.12%, ctx=5251, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=89.5KiB/s (91.6kB/s), 22.2KiB/s-22.6KiB/s (22.7kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=267563-268381msec WRITE: bw=93.7KiB/s (95.9kB/s), 23.3KiB/s-23.7KiB/s (23.9kB/s-24.2kB/s), io=24.6MiB (25.7MB), run=267563-268381msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144304: Fri Sep 11 11:23:48 2026 read: IOPS=15, BW=242KiB/s (247kB/s)(5920KiB/24506msec) clat (usec): min=31, max=203745, avg=34109.10, stdev=28762.84 lat (usec): min=31, max=203746, avg=34110.26, stdev=28762.91 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 52], 10.00th=[ 57], 20.00th=[ 84], | 30.00th=[ 19792], 40.00th=[ 25297], 50.00th=[ 31327], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 53216], 90.00th=[ 65274], 95.00th=[ 88605], | 99.00th=[128451], 99.50th=[149947], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 126, max= 407, per=24.34%, avg=233.40, stdev=74.98, samples=47 iops : min= 7, max= 25, avg=13.87, stdev= 4.72, samples=47 write: IOPS=16, BW=260KiB/s (266kB/s)(6368KiB/24506msec); 0 zone resets clat (usec): min=1492, max=146650, avg=29249.30, stdev=29775.94 lat (usec): min=1494, max=146652, avg=29251.23, stdev=29775.99 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1680], 10.00th=[ 2180], 20.00th=[ 4359], | 30.00th=[ 6980], 40.00th=[ 12911], 50.00th=[ 18744], 60.00th=[ 27919], | 70.00th=[ 39060], 80.00th=[ 47449], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 62, max= 473, per=25.41%, avg=256.43, stdev=93.20, samples=47 iops : min= 3, max= 29, avg=15.32, stdev= 5.83, samples=47 lat (usec) : 50=1.82%, 100=8.07%, 250=0.52%, 500=0.39% lat (msec) : 2=4.56%, 4=5.34%, 10=9.51%, 20=10.94%, 50=36.46% lat (msec) : 100=19.40%, 250=2.99% cpu : usr=0.07%, sys=6.60%, ctx=1463, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144305: Fri Sep 11 11:23:48 2026 read: IOPS=15, BW=240KiB/s (246kB/s)(5744KiB/23885msec) clat (usec): min=37, max=128007, avg=33353.65, stdev=26730.40 lat (usec): min=37, max=128008, avg=33354.76, stdev=26730.45 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 59], 20.00th=[ 74], | 30.00th=[ 19006], 40.00th=[ 26346], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 44827], 80.00th=[ 55837], 90.00th=[ 68682], 95.00th=[ 79168], | 99.00th=[109577], 99.50th=[115868], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 126, max= 410, per=24.98%, avg=239.52, stdev=76.42, samples=46 iops : min= 7, max= 25, avg=14.28, stdev= 4.86, samples=46 write: IOPS=17, BW=274KiB/s (281kB/s)(6544KiB/23885msec); 0 zone resets clat (usec): min=1346, max=202206, avg=28830.82, stdev=30327.65 lat (usec): min=1349, max=202207, avg=28844.57, stdev=30344.61 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1631], 10.00th=[ 1811], 20.00th=[ 3752], | 30.00th=[ 6980], 40.00th=[ 10945], 50.00th=[ 17957], 60.00th=[ 27132], | 70.00th=[ 38011], 80.00th=[ 52167], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[121111], 99.50th=[137364], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 124, max= 471, per=26.72%, avg=269.65, stdev=96.50, samples=46 iops : min= 7, max= 29, avg=16.15, stdev= 6.09, samples=46 lat (usec) : 50=1.69%, 100=8.85%, 250=0.65%, 500=0.26% lat (msec) : 2=6.51%, 4=5.21%, 10=9.38%, 20=9.90%, 50=34.90% lat (msec) : 100=20.44%, 250=2.21% cpu : usr=0.08%, sys=6.49%, ctx=1381, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144306: Fri Sep 11 11:23:48 2026 read: IOPS=15, BW=251KiB/s (257kB/s)(6256KiB/24954msec) clat (usec): min=34, max=184994, avg=33106.24, stdev=29776.38 lat (usec): min=34, max=184996, avg=33107.37, stdev=29776.42 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 47], 10.00th=[ 57], 20.00th=[ 73], | 30.00th=[ 16909], 40.00th=[ 25035], 50.00th=[ 30540], 60.00th=[ 35914], | 70.00th=[ 43779], 80.00th=[ 53740], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[128451], 99.50th=[166724], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 63, max= 465, per=26.77%, avg=256.68, stdev=108.22, samples=47 iops : min= 3, max= 29, avg=15.36, stdev= 6.85, samples=47 write: IOPS=15, BW=242KiB/s (248kB/s)(6032KiB/24954msec); 0 zone resets clat (usec): min=1327, max=227594, avg=31082.62, stdev=35361.37 lat (usec): min=1329, max=227596, avg=31087.66, stdev=35359.46 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1696], 10.00th=[ 1991], 20.00th=[ 4293], | 30.00th=[ 7308], 40.00th=[ 11731], 50.00th=[ 20055], 60.00th=[ 26870], | 70.00th=[ 38011], 80.00th=[ 52691], 90.00th=[ 72877], 95.00th=[ 99091], | 99.00th=[179307], 99.50th=[191890], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 62, max= 476, per=23.55%, avg=237.58, stdev=100.77, samples=48 iops : min= 3, max= 29, avg=14.17, stdev= 6.42, samples=48 lat (usec) : 50=2.73%, 100=9.38%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.08%, 4=4.30%, 10=9.64%, 20=10.42%, 50=34.90% lat (msec) : 100=18.62%, 250=4.17% cpu : usr=0.08%, sys=6.26%, ctx=1366, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144307: Fri Sep 11 11:23:48 2026 read: IOPS=15, BW=249KiB/s (255kB/s)(6032KiB/24270msec) clat (usec): min=34, max=233113, avg=33947.62, stdev=32212.69 lat (usec): min=34, max=233114, avg=33951.05, stdev=32211.37 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 70], | 30.00th=[ 16712], 40.00th=[ 23987], 50.00th=[ 29492], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 69731], 95.00th=[ 88605], | 99.00th=[143655], 99.50th=[208667], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 601, per=26.41%, avg=253.28, stdev=100.96, samples=46 iops : min= 3, max= 37, avg=15.13, stdev= 6.36, samples=46 write: IOPS=16, BW=258KiB/s (264kB/s)(6256KiB/24270msec); 0 zone resets clat (usec): min=1365, max=293422, avg=28628.41, stdev=32742.54 lat (usec): min=1368, max=293425, avg=28632.25, stdev=32743.73 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1680], 10.00th=[ 2008], 20.00th=[ 3720], | 30.00th=[ 6915], 40.00th=[ 10945], 50.00th=[ 19006], 60.00th=[ 25035], | 70.00th=[ 35914], 80.00th=[ 49546], 90.00th=[ 64750], 95.00th=[ 90702], | 99.00th=[156238], 99.50th=[202376], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 31, max= 497, per=25.54%, avg=257.72, stdev=108.64, samples=47 iops : min= 1, max= 31, avg=15.40, stdev= 6.82, samples=47 lat (usec) : 50=1.82%, 100=10.29%, 250=1.04%, 500=0.13%, 750=0.26% lat (msec) : 2=5.21%, 4=5.60%, 10=8.59%, 20=9.90%, 50=34.11% lat (msec) : 100=19.92%, 250=2.99%, 500=0.13% cpu : usr=0.10%, sys=6.80%, ctx=1393, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=960KiB/s (983kB/s), 240KiB/s-251KiB/s (246kB/s-257kB/s), io=23.4MiB (24.5MB), run=23885-24954msec WRITE: bw=1010KiB/s (1034kB/s), 242KiB/s-274KiB/s (248kB/s-281kB/s), io=24.6MiB (25.8MB), run=23885-24954msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144300: Fri Sep 11 11:24:23 2026 read: IOPS=6, BW=99.8KiB/s (102kB/s)(5920KiB/59304msec) clat (msec): min=5, max=197, avg=31.32, stdev=29.53 lat (msec): min=5, max=197, avg=31.32, stdev=29.53 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 87], | 99.00th=[ 176], 99.50th=[ 194], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 30, max= 318, per=26.70%, avg=107.08, stdev=66.35, samples=107 iops : min= 1, max= 19, avg= 5.96, stdev= 4.19, samples=107 write: IOPS=6, BW=107KiB/s (110kB/s)(6368KiB/59304msec); 0 zone resets clat (msec): min=33, max=434, avg=119.78, stdev=58.61 lat (msec): min=33, max=434, avg=119.78, stdev=58.61 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 108], 60.00th=[ 121], | 70.00th=[ 132], 80.00th=[ 150], 90.00th=[ 197], 95.00th=[ 239], | 99.00th=[ 326], 99.50th=[ 418], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 22, max= 224, per=25.36%, avg=107.03, stdev=47.85, samples=116 iops : min= 1, max= 14, avg= 5.95, stdev= 3.04, samples=116 lat (msec) : 10=3.65%, 20=17.71%, 50=20.57%, 100=27.34%, 250=28.65% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.42%, ctx=1370, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144301: Fri Sep 11 11:24:23 2026 read: IOPS=6, BW=96.2KiB/s (98.5kB/s)(5744KiB/59700msec) clat (msec): min=6, max=248, avg=30.92, stdev=30.85 lat (msec): min=6, max=248, avg=30.92, stdev=30.85 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 40], 90.00th=[ 65], 95.00th=[ 90], | 99.00th=[ 161], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 22, max= 416, per=27.96%, avg=112.10, stdev=71.23, samples=100 iops : min= 1, max= 26, avg= 6.30, stdev= 4.55, samples=100 write: IOPS=6, BW=110KiB/s (112kB/s)(6544KiB/59700msec); 0 zone resets clat (msec): min=33, max=434, avg=118.23, stdev=57.37 lat (msec): min=33, max=434, avg=118.23, stdev=57.37 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 53], 10.00th=[ 65], 20.00th=[ 78], | 30.00th=[ 85], 40.00th=[ 93], 50.00th=[ 103], 60.00th=[ 117], | 70.00th=[ 132], 80.00th=[ 153], 90.00th=[ 190], 95.00th=[ 236], | 99.00th=[ 317], 99.50th=[ 330], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 288, per=26.11%, avg=110.19, stdev=46.57, samples=116 iops : min= 1, max= 18, avg= 6.15, stdev= 2.98, samples=116 lat (msec) : 10=3.26%, 20=17.97%, 50=20.57%, 100=28.13%, 250=28.13% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.29%, ctx=1284, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144302: Fri Sep 11 11:24:23 2026 read: IOPS=6, BW=112KiB/s (114kB/s)(6256KiB/56018msec) clat (msec): min=5, max=251, avg=31.19, stdev=31.48 lat (msec): min=5, max=251, avg=31.21, stdev=31.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 62], 95.00th=[ 93], | 99.00th=[ 190], 99.50th=[ 251], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 22, max= 380, per=30.18%, avg=121.04, stdev=76.42, samples=102 iops : min= 1, max= 23, avg= 6.82, stdev= 4.85, samples=102 write: IOPS=6, BW=108KiB/s (110kB/s)(6032KiB/56018msec); 0 zone resets clat (msec): min=32, max=368, avg=115.74, stdev=54.18 lat (msec): min=32, max=368, avg=115.75, stdev=54.18 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 50], 10.00th=[ 58], 20.00th=[ 74], | 30.00th=[ 84], 40.00th=[ 93], 50.00th=[ 104], 60.00th=[ 116], | 70.00th=[ 133], 80.00th=[ 155], 90.00th=[ 186], 95.00th=[ 232], | 99.00th=[ 279], 99.50th=[ 321], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 29, max= 224, per=25.88%, avg=109.21, stdev=47.41, samples=108 iops : min= 1, max= 14, avg= 6.10, stdev= 3.04, samples=108 lat (msec) : 10=4.30%, 20=17.45%, 50=25.26%, 100=25.00%, 250=26.04% lat (msec) : 500=1.95% cpu : usr=0.04%, sys=1.32%, ctx=1275, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144303: Fri Sep 11 11:24:23 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(6032KiB/58204msec) clat (msec): min=5, max=328, avg=32.04, stdev=32.82 lat (msec): min=5, max=328, avg=32.05, stdev=32.82 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 68], 95.00th=[ 90], | 99.00th=[ 167], 99.50th=[ 259], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 412, per=27.85%, avg=111.69, stdev=69.65, samples=105 iops : min= 1, max= 25, avg= 6.24, stdev= 4.38, samples=105 write: IOPS=6, BW=107KiB/s (110kB/s)(6256KiB/58204msec); 0 zone resets clat (msec): min=34, max=434, avg=117.45, stdev=54.02 lat (msec): min=34, max=434, avg=117.46, stdev=54.01 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 51], 10.00th=[ 66], 20.00th=[ 74], | 30.00th=[ 86], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 118], | 70.00th=[ 131], 80.00th=[ 150], 90.00th=[ 188], 95.00th=[ 239], | 99.00th=[ 284], 99.50th=[ 317], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 29, max= 224, per=25.47%, avg=107.46, stdev=47.41, samples=114 iops : min= 1, max= 14, avg= 5.97, stdev= 3.05, samples=114 lat (msec) : 10=4.04%, 20=17.58%, 50=21.09%, 100=27.34%, 250=27.73% lat (msec) : 500=2.21% cpu : usr=0.04%, sys=1.37%, ctx=1317, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=401KiB/s (411kB/s), 96.2KiB/s-112KiB/s (98.5kB/s-114kB/s), io=23.4MiB (24.5MB), run=56018-59700msec WRITE: bw=422KiB/s (432kB/s), 107KiB/s-110KiB/s (110kB/s-112kB/s), io=24.6MiB (25.8MB), run=56018-59700msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144325: Fri Sep 11 11:24:40 2026 read: IOPS=1, BW=1122KiB/s (1149kB/s)(7168KiB/6386msec) clat (usec): min=552, max=2680.1k, avg=751277.22, stdev=1080383.22 lat (usec): min=553, max=2680.1k, avg=751278.63, stdev=1080383.37 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], | 20.00th=[ 988], 30.00th=[ 149947], 40.00th=[ 149947], | 50.00th=[ 160433], 60.00th=[ 371196], 70.00th=[ 371196], | 80.00th=[1887437], 90.00th=[2667578], 95.00th=[2667578], | 99.00th=[2667578], 99.50th=[2667578], 99.90th=[2667578], | 99.95th=[2667578], 99.99th=[2667578] bw ( KiB/s): min= 1973, max= 6119, per=100.00%, avg=3035.50, stdev=2055.84, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=0, BW=802KiB/s (821kB/s)(5120KiB/6386msec); 0 zone resets clat (msec): min=101, max=303, avg=182.63, stdev=74.54 lat (msec): min=101, max=303, avg=182.71, stdev=74.52 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 188], 80.00th=[ 188], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2039, max= 6000, per=94.93%, avg=4019.50, stdev=2800.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=50.00%, 500=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=7.16%, ctx=643, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144326: Fri Sep 11 11:24:40 2026 read: IOPS=0, BW=302KiB/s (310kB/s)(2048KiB/6771msec) clat (usec): min=600, max=323343, avg=161971.95, stdev=228214.21 lat (usec): min=601, max=323346, avg=161974.18, stdev=228215.30 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[ 603], 60.00th=[325059], | 70.00th=[325059], 80.00th=[325059], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 1492, max= 2048, per=58.53%, avg=1770.00, stdev=393.15, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1512KiB/s (1549kB/s)(10.0MiB/6771msec); 0 zone resets clat (msec): min=62, max=2412, avg=631.93, stdev=883.31 lat (msec): min=62, max=2412, avg=632.09, stdev=883.47 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 106], | 30.00th=[ 184], 40.00th=[ 243], 50.00th=[ 249], 60.00th=[ 253], | 70.00th=[ 275], 80.00th=[ 355], 90.00th=[ 2198], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1973, max= 6107, per=85.86%, avg=3635.40, stdev=1710.65, samples=5 iops : min= 1, max= 5, avg= 3.00, stdev= 1.58, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=7.75%, ctx=140, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144327: Fri Sep 11 11:24:40 2026 read: IOPS=1, BW=1097KiB/s (1123kB/s)(6144KiB/5600msec) clat (usec): min=895, max=186007, avg=106102.88, stdev=83102.67 lat (usec): min=897, max=186008, avg=106103.99, stdev=83102.67 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 4047], | 30.00th=[ 4047], 40.00th=[120062], 50.00th=[120062], 60.00th=[156238], | 70.00th=[168821], 80.00th=[168821], 90.00th=[185598], 95.00th=[185598], | 99.00th=[185598], 99.50th=[185598], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 3953, max= 4096, per=100.00%, avg=4024.50, stdev=101.12, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1097KiB/s (1123kB/s)(6144KiB/5600msec); 0 zone resets clat (msec): min=181, max=2233, avg=798.66, stdev=912.70 lat (msec): min=181, max=2234, avg=798.73, stdev=912.69 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 257], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1976, max= 2913, per=53.00%, avg=2244.00, stdev=447.15, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (usec) : 1000=8.33% lat (msec) : 10=8.33%, 250=58.33%, 500=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.20%, ctx=120, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144328: Fri Sep 11 11:24:40 2026 read: IOPS=0, BW=844KiB/s (864kB/s)(5120KiB/6069msec) clat (usec): min=668, max=294590, avg=81290.09, stdev=122422.05 lat (usec): min=669, max=294592, avg=81291.46, stdev=122422.31 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 668], | 30.00th=[ 840], 40.00th=[ 840], 50.00th=[ 47449], 60.00th=[ 47449], | 70.00th=[ 62653], 80.00th=[ 62653], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1181KiB/s (1209kB/s)(7168KiB/6069msec); 0 zone resets clat (msec): min=180, max=2285, avg=802.54, stdev=877.11 lat (msec): min=180, max=2285, avg=802.67, stdev=877.10 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 236], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 300], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 1838], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1490, max= 4000, per=67.41%, avg=2854.00, stdev=1311.20, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.25%, ctx=134, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3025KiB/s (3097kB/s), 302KiB/s-1122KiB/s (310kB/s-1149kB/s), io=20.0MiB (20.0MB), run=5600-6771msec WRITE: bw=4235KiB/s (4336kB/s), 802KiB/s-1512KiB/s (821kB/s-1549kB/s), io=28.0MiB (29.4MB), run=5600-6771msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144330: Fri Sep 11 11:24:40 2026 read: IOPS=0, BW=978KiB/s (1002kB/s)(7168KiB/7329msec) clat (msec): min=73, max=2350, avg=826.61, stdev=948.47 lat (msec): min=73, max=2350, avg=826.61, stdev=948.47 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 93], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 157], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1703], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1992, max= 2031, per=73.22%, avg=2016.50, stdev=16.22, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=699KiB/s (715kB/s)(5120KiB/7329msec); 0 zone resets clat (msec): min=184, max=340, avg=230.09, stdev=63.29 lat (msec): min=184, max=340, avg=230.21, stdev=63.28 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 2015, max= 4055, per=87.11%, avg=3359.00, stdev=1164.19, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=8.33%, 2000=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=2.67%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144331: Fri Sep 11 11:24:40 2026 read: IOPS=0, BW=287KiB/s (294kB/s)(2048KiB/7134msec) clat (msec): min=64, max=368, avg=216.46, stdev=215.52 lat (msec): min=64, max=368, avg=216.47, stdev=215.54 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 65], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 1381, max= 1996, per=61.31%, avg=1688.50, stdev=434.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1435KiB/s (1470kB/s)(10.0MiB/7134msec); 0 zone resets clat (msec): min=79, max=2493, avg=662.87, stdev=954.41 lat (msec): min=79, max=2493, avg=662.97, stdev=954.41 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 165], | 30.00th=[ 199], 40.00th=[ 211], 50.00th=[ 228], 60.00th=[ 236], | 70.00th=[ 268], 80.00th=[ 305], 90.00th=[ 2433], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2043, max= 5988, per=100.00%, avg=4005.50, stdev=1610.61, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, >=2000=16.67% cpu : usr=0.03%, sys=2.07%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144332: Fri Sep 11 11:24:40 2026 read: IOPS=0, BW=897KiB/s (919kB/s)(6144KiB/6848msec) clat (msec): min=49, max=152, avg=100.85, stdev=41.17 lat (msec): min=49, max=152, avg=100.85, stdev=41.17 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 64], | 30.00th=[ 64], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 113], | 70.00th=[ 140], 80.00th=[ 140], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 1996, max= 5976, per=100.00%, avg=3333.00, stdev=2288.96, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=0, BW=897KiB/s (919kB/s)(6144KiB/6848msec); 0 zone resets clat (msec): min=159, max=2392, avg=1012.83, stdev=1070.57 lat (msec): min=159, max=2392, avg=1013.08, stdev=1070.44 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 338], 50.00th=[ 338], 60.00th=[ 617], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2015, max= 4087, per=78.53%, avg=3028.25, stdev=1163.84, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=41.67%, 500=8.33%, 750=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=1.71%, ctx=60, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144333: Fri Sep 11 11:24:40 2026 read: IOPS=0, BW=689KiB/s (705kB/s)(5120KiB/7435msec) clat (msec): min=66, max=248, avg=106.44, stdev=79.59 lat (msec): min=66, max=248, avg=106.44, stdev=79.59 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 67], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 70], 60.00th=[ 70], | 70.00th=[ 79], 80.00th=[ 79], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 1992, max= 5988, per=100.00%, avg=3990.00, stdev=2825.60, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=964KiB/s (987kB/s)(7168KiB/7435msec); 0 zone resets clat (msec): min=152, max=2662, avg=969.42, stdev=1066.30 lat (msec): min=153, max=2662, avg=969.62, stdev=1066.24 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 239], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 435], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 2366], 90.00th=[ 2668], 95.00th=[ 2668], | 99.00th=[ 2668], 99.50th=[ 2668], 99.90th=[ 2668], 99.95th=[ 2668], | 99.99th=[ 2668] bw ( KiB/s): min= 2003, max= 3984, per=62.55%, avg=2412.00, stdev=878.94, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=33.33%, 250=25.00%, 500=16.67%, 750=8.33%, >=2000=16.67% cpu : usr=0.01%, sys=2.19%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2755KiB/s (2821kB/s), 287KiB/s-978KiB/s (294kB/s-1002kB/s), io=20.0MiB (20.0MB), run=6848-7435msec WRITE: bw=3856KiB/s (3949kB/s), 699KiB/s-1435KiB/s (715kB/s-1470kB/s), io=28.0MiB (29.4MB), run=6848-7435msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144345: Fri Sep 11 11:24:55 2026 read: IOPS=1, BW=4187KiB/s (4287kB/s)(12.0MiB/2935msec) clat (msec): min=201, max=1599, avg=935.15, stdev=701.49 lat (msec): min=201, max=1599, avg=935.15, stdev=701.49 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.44%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144346: Fri Sep 11 11:24:55 2026 read: IOPS=0, BW=1196KiB/s (1225kB/s)(4096KiB/3424msec) clat (nsec): min=1412.3M, max=1412.3M, avg=1412344028.00, stdev= 0.00 lat (nsec): min=1412.3M, max=1412.3M, avg=1412346633.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1418], 5.00th=[ 1418], 10.00th=[ 1418], 20.00th=[ 1418], | 30.00th=[ 1418], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2393KiB/s (2450kB/s)(8192KiB/3424msec); 0 zone resets clat (msec): min=577, max=1311, avg=944.74, stdev=519.08 lat (msec): min=578, max=1312, avg=945.16, stdev=519.06 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 7772, max= 7772, per=81.21%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.86%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144347: Fri Sep 11 11:24:55 2026 write: IOPS=1, BW=8052KiB/s (8246kB/s)(12.0MiB/1526msec); 0 zone resets clat (msec): min=317, max=729, avg=493.69, stdev=212.16 lat (msec): min=317, max=731, avg=494.99, stdev=213.30 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7025, max= 8143, per=79.25%, avg=7584.00, stdev=790.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.07%, sys=6.42%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144348: Fri Sep 11 11:24:55 2026 write: IOPS=1, BW=5347KiB/s (5476kB/s)(12.0MiB/2298msec); 0 zone resets clat (msec): min=353, max=1080, avg=727.87, stdev=363.95 lat (msec): min=354, max=1081, avg=728.74, stdev=364.05 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8110, max= 8175, per=85.08%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.09%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4785KiB/s (4900kB/s), 1196KiB/s-4187KiB/s (1225kB/s-4287kB/s), io=16.0MiB (16.8MB), run=2935-3424msec WRITE: bw=9570KiB/s (9800kB/s), 2393KiB/s-8052KiB/s (2450kB/s-8246kB/s), io=32.0MiB (33.6MB), run=1526-3424msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144341: Fri Sep 11 11:24:55 2026 read: IOPS=1, BW=4370KiB/s (4475kB/s)(12.0MiB/2812msec) clat (msec): min=762, max=1048, avg=898.44, stdev=143.61 lat (msec): min=762, max=1048, avg=898.45, stdev=143.61 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7757, max= 8143, per=100.00%, avg=7950.00, stdev=272.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=14.37%, ctx=303, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144342: Fri Sep 11 11:24:55 2026 read: IOPS=0, BW=1731KiB/s (1773kB/s)(4096KiB/2366msec) clat (nsec): min=945821k, max=945821k, avg=945821457.00, stdev= 0.00 lat (nsec): min=945824k, max=945824k, avg=945823897.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3462KiB/s (3545kB/s)(8192KiB/2366msec); 0 zone resets clat (msec): min=508, max=675, avg=592.10, stdev=118.08 lat (msec): min=508, max=677, avg=593.05, stdev=118.89 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 8062, max= 8062, per=92.02%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.04%, sys=5.79%, ctx=119, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144343: Fri Sep 11 11:24:55 2026 write: IOPS=0, BW=3286KiB/s (3364kB/s)(12.0MiB/3740msec); 0 zone resets clat (msec): min=494, max=1803, avg=1223.14, stdev=666.53 lat (msec): min=495, max=1803, avg=1223.57, stdev=666.54 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 1368], 50.00th=[ 1368], 60.00th=[ 1368], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8062, max= 8110, per=92.30%, avg=8086.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.05%, sys=5.86%, ctx=104, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144344: Fri Sep 11 11:24:55 2026 write: IOPS=1, BW=5829KiB/s (5969kB/s)(12.0MiB/2108msec); 0 zone resets clat (msec): min=395, max=1151, avg=657.77, stdev=427.78 lat (msec): min=396, max=1152, avg=658.45, stdev=428.27 clat percentiles (msec): | 1.00th=[ 397], 5.00th=[ 397], 10.00th=[ 397], 20.00th=[ 397], | 30.00th=[ 397], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 6681, max= 8143, per=84.60%, avg=7412.00, stdev=1033.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.60%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5826KiB/s (5966kB/s), 1731KiB/s-4370KiB/s (1773kB/s-4475kB/s), io=16.0MiB (16.8MB), run=2366-2812msec WRITE: bw=8761KiB/s (8972kB/s), 3286KiB/s-5829KiB/s (3364kB/s-5969kB/s), io=32.0MiB (33.6MB), run=2108-3740msec