== sanity test 398b: DIO and buffer IO race ============== 08:52:25 (1788267145) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.55134 s, 14.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145429: Tue Sep 1 08:53:56 2026 read: IOPS=19, BW=77.2KiB/s (79.0kB/s)(5992KiB/77621msec) clat (usec): min=37, max=680066, avg=24821.49, stdev=27347.05 lat (usec): min=37, max=680068, avg=24824.17, stdev=27346.48 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 67], 10.00th=[ 153], 20.00th=[ 11731], | 30.00th=[ 14746], 40.00th=[ 17171], 50.00th=[ 20055], 60.00th=[ 23987], | 70.00th=[ 29230], 80.00th=[ 35914], 90.00th=[ 45876], 95.00th=[ 56886], | 99.00th=[ 89654], 99.50th=[115868], 99.90th=[434111], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 7, max= 151, per=25.67%, avg=77.26, stdev=27.19, samples=153 iops : min= 1, max= 37, avg=18.73, stdev= 6.83, samples=153 write: IOPS=20, BW=81.1KiB/s (83.1kB/s)(6296KiB/77621msec); 0 zone resets clat (usec): min=889, max=145270, avg=25527.78, stdev=23865.63 lat (usec): min=891, max=145271, avg=25530.00, stdev=23865.57 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1532], 10.00th=[ 2073], 20.00th=[ 3556], | 30.00th=[ 6194], 40.00th=[ 13698], 50.00th=[ 20841], 60.00th=[ 26608], | 70.00th=[ 33817], 80.00th=[ 43779], 90.00th=[ 57934], 95.00th=[ 69731], | 99.00th=[ 99091], 99.50th=[119014], 99.90th=[143655], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 15, max= 175, per=25.78%, avg=81.20, stdev=28.03, samples=153 iops : min= 3, max= 43, avg=19.71, stdev= 6.98, samples=153 lat (usec) : 50=0.46%, 100=3.35%, 250=1.24%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.07% lat (msec) : 2=4.95%, 4=6.41%, 10=9.28%, 20=23.21%, 50=39.55% lat (msec) : 100=10.38%, 250=0.81%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=10.51%, ctx=7161, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145430: Tue Sep 1 08:53:56 2026 read: IOPS=18, BW=74.9KiB/s (76.7kB/s)(5940KiB/79327msec) clat (usec): min=29, max=313120, avg=25662.44, stdev=19870.16 lat (usec): min=30, max=313121, avg=25664.75, stdev=19871.38 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 76], 10.00th=[ 6259], 20.00th=[ 12387], | 30.00th=[ 15139], 40.00th=[ 17957], 50.00th=[ 21103], 60.00th=[ 25822], | 70.00th=[ 32113], 80.00th=[ 39060], 90.00th=[ 48497], 95.00th=[ 56886], | 99.00th=[ 89654], 99.50th=[110625], 99.90th=[149947], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 6, max= 144, per=24.61%, avg=74.09, stdev=26.46, samples=157 iops : min= 1, max= 36, avg=17.94, stdev= 6.63, samples=157 write: IOPS=20, BW=80.0KiB/s (81.9kB/s)(6348KiB/79327msec); 0 zone resets clat (usec): min=867, max=709098, avg=25841.71, stdev=30250.04 lat (usec): min=868, max=709099, avg=25847.25, stdev=30247.78 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1565], 10.00th=[ 2089], 20.00th=[ 3490], | 30.00th=[ 5669], 40.00th=[ 13566], 50.00th=[ 20579], 60.00th=[ 26608], | 70.00th=[ 33424], 80.00th=[ 41681], 90.00th=[ 56886], 95.00th=[ 70779], | 99.00th=[108528], 99.50th=[137364], 99.90th=[304088], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 13, max= 159, per=25.04%, avg=78.87, stdev=27.81, samples=157 iops : min= 3, max= 39, avg=19.12, stdev= 6.99, samples=157 lat (usec) : 50=0.26%, 100=3.09%, 250=1.04%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.52%, 4=7.19%, 10=8.63%, 20=22.95%, 50=40.46% lat (msec) : 100=10.51%, 250=0.98%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=10.44%, ctx=7369, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145431: Tue Sep 1 08:53:56 2026 read: IOPS=19, BW=76.1KiB/s (77.9kB/s)(6028KiB/79250msec) clat (usec): min=27, max=219653, avg=24326.49, stdev=19362.10 lat (usec): min=27, max=219654, avg=24329.91, stdev=19362.87 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 68], 10.00th=[ 149], 20.00th=[ 11731], | 30.00th=[ 14615], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 24511], | 70.00th=[ 29754], 80.00th=[ 36963], 90.00th=[ 46924], 95.00th=[ 54789], | 99.00th=[ 77071], 99.50th=[114820], 99.90th=[206570], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 15, max= 159, per=25.42%, avg=76.50, stdev=27.91, samples=155 iops : min= 3, max= 39, avg=18.54, stdev= 7.01, samples=155 write: IOPS=19, BW=78.0KiB/s (80.9kB/s)(6260KiB/79250msec); 0 zone resets clat (usec): min=781, max=805901, avg=27067.83, stdev=32716.72 lat (usec): min=781, max=805904, avg=27071.48, stdev=32718.94 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1516], 10.00th=[ 2114], 20.00th=[ 3752], | 30.00th=[ 6456], 40.00th=[ 14091], 50.00th=[ 20841], 60.00th=[ 26608], | 70.00th=[ 34866], 80.00th=[ 45351], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[111674], 99.50th=[137364], 99.90th=[254804], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 15, max= 167, per=25.01%, avg=78.79, stdev=27.79, samples=156 iops : min= 3, max= 41, avg=19.11, stdev= 6.98, samples=156 lat (usec) : 50=0.59%, 100=3.39%, 250=1.24%, 500=0.33%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=4.39%, 4=6.54%, 10=8.63%, 20=23.54%, 50=38.90% lat (msec) : 100=11.10%, 250=1.01%, 500=0.03%, 1000=0.03% cpu : usr=0.11%, sys=10.31%, ctx=7381, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145432: Tue Sep 1 08:53:56 2026 read: IOPS=19, BW=76.0KiB/s (77.9kB/s)(6052KiB/79592msec) clat (usec): min=35, max=231732, avg=24277.35, stdev=18550.92 lat (usec): min=36, max=231733, avg=24278.60, stdev=18550.93 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 74], 10.00th=[ 217], 20.00th=[ 11600], | 30.00th=[ 14353], 40.00th=[ 17171], 50.00th=[ 20317], 60.00th=[ 23987], | 70.00th=[ 30016], 80.00th=[ 37487], 90.00th=[ 47973], 95.00th=[ 56886], | 99.00th=[ 81265], 99.50th=[ 98042], 99.90th=[130548], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 15, max= 152, per=25.45%, avg=76.60, stdev=28.35, samples=156 iops : min= 3, max= 38, avg=18.56, stdev= 7.15, samples=156 write: IOPS=19, BW=78.3KiB/s (80.2kB/s)(6236KiB/79592msec); 0 zone resets clat (usec): min=872, max=790585, avg=27360.67, stdev=34370.80 lat (usec): min=873, max=790588, avg=27369.93, stdev=34382.35 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1467], 10.00th=[ 2040], 20.00th=[ 3490], | 30.00th=[ 5997], 40.00th=[ 13435], 50.00th=[ 20055], 60.00th=[ 26346], | 70.00th=[ 35390], 80.00th=[ 46400], 90.00th=[ 61080], 95.00th=[ 76022], | 99.00th=[114820], 99.50th=[128451], 99.90th=[421528], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 15, max= 175, per=24.87%, avg=78.35, stdev=28.19, samples=157 iops : min= 3, max= 43, avg=18.99, stdev= 7.05, samples=157 lat (usec) : 50=0.23%, 100=3.48%, 250=1.30%, 500=0.33%, 750=0.10% lat (usec) : 1000=0.16% lat (msec) : 2=5.05%, 4=6.97%, 10=8.37%, 20=23.57%, 50=37.27% lat (msec) : 100=12.08%, 250=1.01%, 500=0.07%, 1000=0.03% cpu : usr=0.12%, sys=10.25%, ctx=7270, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=302KiB/s (309kB/s), 74.9KiB/s-77.2KiB/s (76.7kB/s-79.0kB/s), io=23.4MiB (24.6MB), run=77621-79592msec WRITE: bw=316KiB/s (323kB/s), 78.3KiB/s-81.1KiB/s (80.2kB/s-83.1kB/s), io=24.6MiB (25.7MB), run=77621-79592msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145424: Tue Sep 1 08:55:17 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(5992KiB/160319msec) clat (msec): min=4, max=724, avg=24.88, stdev=27.81 lat (msec): min=4, max=724, avg=24.89, stdev=27.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 48], 95.00th=[ 66], | 99.00th=[ 109], 99.50th=[ 129], 99.90th=[ 275], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 128, per=25.82%, avg=38.47, stdev=23.41, samples=306 iops : min= 1, max= 32, avg= 9.11, stdev= 5.89, samples=306 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6296KiB/160319msec); 0 zone resets clat (msec): min=24, max=289, avg=77.96, stdev=34.55 lat (msec): min=24, max=289, avg=77.97, stdev=34.55 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 69], 60.00th=[ 75], | 70.00th=[ 88], 80.00th=[ 103], 90.00th=[ 127], 95.00th=[ 148], | 99.00th=[ 190], 99.50th=[ 209], 99.90th=[ 268], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 80, per=24.99%, avg=38.98, stdev=16.01, samples=317 iops : min= 1, max= 20, avg= 9.23, stdev= 4.08, samples=317 lat (msec) : 10=7.85%, 20=18.98%, 50=27.12%, 100=34.51%, 250=11.43% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.06%, sys=2.33%, ctx=5741, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145425: Tue Sep 1 08:55:17 2026 read: IOPS=9, BW=36.0KiB/s (37.8kB/s)(5940KiB/160714msec) clat (msec): min=4, max=731, avg=24.47, stdev=27.84 lat (msec): min=4, max=731, avg=24.48, stdev=27.84 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 48], 95.00th=[ 63], | 99.00th=[ 116], 99.50th=[ 142], 99.90th=[ 188], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 102, per=25.45%, avg=37.92, stdev=21.32, samples=307 iops : min= 1, max= 25, avg= 8.97, stdev= 5.38, samples=307 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6348KiB/160714msec); 0 zone resets clat (msec): min=27, max=422, avg=78.17, stdev=36.57 lat (msec): min=27, max=422, avg=78.18, stdev=36.57 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 69], 60.00th=[ 77], | 70.00th=[ 87], 80.00th=[ 100], 90.00th=[ 126], 95.00th=[ 148], | 99.00th=[ 199], 99.50th=[ 232], 99.90th=[ 363], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 79, per=25.10%, avg=39.15, stdev=15.85, samples=317 iops : min= 1, max= 19, avg= 9.27, stdev= 4.04, samples=317 lat (msec) : 10=8.69%, 20=18.59%, 50=26.79%, 100=34.96%, 250=10.77% lat (msec) : 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=2.34%, ctx=5660, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145426: Tue Sep 1 08:55:17 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6028KiB/160585msec) clat (msec): min=4, max=349, avg=24.21, stdev=20.76 lat (msec): min=4, max=349, avg=24.21, stdev=20.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 22], | 70.00th=[ 26], 80.00th=[ 32], 90.00th=[ 47], 95.00th=[ 62], | 99.00th=[ 94], 99.50th=[ 124], 99.90th=[ 190], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 119, per=25.53%, avg=38.04, stdev=22.53, samples=310 iops : min= 1, max= 29, avg= 9.00, stdev= 5.70, samples=310 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6260KiB/160585msec); 0 zone resets clat (msec): min=27, max=819, avg=79.10, stdev=42.12 lat (msec): min=27, max=819, avg=79.10, stdev=42.12 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 70], 60.00th=[ 78], | 70.00th=[ 86], 80.00th=[ 104], 90.00th=[ 127], 95.00th=[ 148], | 99.00th=[ 205], 99.50th=[ 247], 99.90th=[ 550], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 80, per=24.78%, avg=38.65, stdev=15.87, samples=317 iops : min= 1, max= 20, avg= 9.15, stdev= 4.04, samples=317 lat (msec) : 10=7.52%, 20=19.53%, 50=27.86%, 100=33.72%, 250=11.10% lat (msec) : 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.07%, sys=2.34%, ctx=5696, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145427: Tue Sep 1 08:55:17 2026 read: IOPS=9, BW=37.0KiB/s (38.9kB/s)(6052KiB/159422msec) clat (msec): min=3, max=362, avg=24.02, stdev=22.47 lat (msec): min=3, max=362, avg=24.02, stdev=22.47 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 13], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 47], 95.00th=[ 65], | 99.00th=[ 108], 99.50th=[ 140], 99.90th=[ 205], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 159, per=26.24%, avg=39.10, stdev=24.03, samples=304 iops : min= 1, max= 39, avg= 9.26, stdev= 6.06, samples=304 write: IOPS=9, BW=39.1KiB/s (40.1kB/s)(6236KiB/159422msec); 0 zone resets clat (msec): min=29, max=774, avg=78.75, stdev=39.13 lat (msec): min=29, max=774, avg=78.76, stdev=39.13 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 51], | 30.00th=[ 57], 40.00th=[ 63], 50.00th=[ 69], 60.00th=[ 78], | 70.00th=[ 89], 80.00th=[ 104], 90.00th=[ 127], 95.00th=[ 146], | 99.00th=[ 186], 99.50th=[ 215], 99.90th=[ 418], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 79, per=24.81%, avg=38.70, stdev=15.27, samples=316 iops : min= 1, max= 19, avg= 9.16, stdev= 3.88, samples=316 lat (msec) : 4=0.03%, 10=8.98%, 20=18.98%, 50=26.50%, 100=34.02% lat (msec) : 250=11.30%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=2.36%, ctx=5710, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 36.0KiB/s-37.0KiB/s (37.8kB/s-38.9kB/s), io=23.4MiB (24.6MB), run=159422-160714msec WRITE: bw=156KiB/s (160kB/s), 38.0KiB/s-39.5KiB/s (39.9kB/s-40.4kB/s), io=24.6MiB (25.7MB), run=159422-160714msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145469: Tue Sep 1 08:55:38 2026 read: IOPS=24, BW=386KiB/s (395kB/s)(5920KiB/15332msec) clat (usec): min=28, max=129438, avg=20599.78, stdev=16454.28 lat (usec): min=28, max=129439, avg=20600.93, stdev=16454.31 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 62], 10.00th=[ 91], 20.00th=[ 379], | 30.00th=[ 13960], 40.00th=[ 16450], 50.00th=[ 18744], 60.00th=[ 22414], | 70.00th=[ 26346], 80.00th=[ 31065], 90.00th=[ 39060], 95.00th=[ 50070], | 99.00th=[ 77071], 99.50th=[ 80217], 99.90th=[129500], 99.95th=[129500], | 99.99th=[129500] bw ( KiB/s): min= 160, max= 640, per=25.64%, avg=389.03, stdev=133.36, samples=30 iops : min= 10, max= 40, avg=23.77, stdev= 8.49, samples=30 write: IOPS=25, BW=415KiB/s (425kB/s)(6368KiB/15332msec); 0 zone resets clat (usec): min=1465, max=118631, avg=18972.63, stdev=17152.91 lat (usec): min=1467, max=118634, avg=18976.67, stdev=17152.46 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2737], 10.00th=[ 3294], 20.00th=[ 4817], | 30.00th=[ 7046], 40.00th=[ 10421], 50.00th=[ 13304], 60.00th=[ 17433], | 70.00th=[ 24249], 80.00th=[ 31327], 90.00th=[ 43254], 95.00th=[ 53216], | 99.00th=[ 74974], 99.50th=[113771], 99.90th=[119014], 99.95th=[119014], | 99.99th=[119014] bw ( KiB/s): min= 146, max= 661, per=26.26%, avg=419.03, stdev=122.49, samples=30 iops : min= 9, max= 41, avg=25.67, stdev= 7.58, samples=30 lat (usec) : 50=0.78%, 100=4.56%, 250=3.78%, 500=0.52% lat (msec) : 2=1.17%, 4=5.99%, 10=14.71%, 20=27.99%, 50=35.03% lat (msec) : 100=5.08%, 250=0.39% cpu : usr=0.18%, sys=18.08%, ctx=1891, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145470: Tue Sep 1 08:55:38 2026 read: IOPS=23, BW=372KiB/s (381kB/s)(5744KiB/15438msec) clat (usec): min=37, max=157964, avg=23074.52, stdev=17883.67 lat (usec): min=38, max=157966, avg=23075.82, stdev=17883.71 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 100], 10.00th=[ 155], 20.00th=[ 12387], | 30.00th=[ 15270], 40.00th=[ 17695], 50.00th=[ 21890], 60.00th=[ 24249], | 70.00th=[ 27395], 80.00th=[ 33424], 90.00th=[ 40633], 95.00th=[ 50070], | 99.00th=[ 82314], 99.50th=[129500], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 189, max= 574, per=24.59%, avg=373.10, stdev=95.28, samples=30 iops : min= 11, max= 35, avg=22.77, stdev= 6.02, samples=30 write: IOPS=26, BW=424KiB/s (434kB/s)(6544KiB/15438msec); 0 zone resets clat (usec): min=1459, max=128163, avg=17402.58, stdev=15514.13 lat (usec): min=1462, max=128165, avg=17405.58, stdev=15514.31 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2769], 10.00th=[ 3392], 20.00th=[ 4883], | 30.00th=[ 6915], 40.00th=[ 8979], 50.00th=[ 12256], 60.00th=[ 16319], | 70.00th=[ 21365], 80.00th=[ 29754], 90.00th=[ 38536], 95.00th=[ 46924], | 99.00th=[ 63701], 99.50th=[ 66847], 99.90th=[128451], 99.95th=[128451], | 99.99th=[128451] bw ( KiB/s): min= 126, max= 768, per=26.52%, avg=423.20, stdev=160.68, samples=30 iops : min= 7, max= 48, avg=25.90, stdev=10.18, samples=30 lat (usec) : 50=0.13%, 100=2.34%, 250=3.65%, 500=0.26%, 750=0.26% lat (msec) : 2=1.30%, 4=6.51%, 10=16.80%, 20=27.21%, 50=37.50% lat (msec) : 100=3.52%, 250=0.52% cpu : usr=0.12%, sys=18.46%, ctx=1983, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145471: Tue Sep 1 08:55:38 2026 read: IOPS=24, BW=396KiB/s (406kB/s)(6256KiB/15781msec) clat (usec): min=30, max=116303, avg=20655.76, stdev=16726.42 lat (usec): min=31, max=116305, avg=20658.57, stdev=16725.62 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 67], 10.00th=[ 106], 20.00th=[ 586], | 30.00th=[ 12780], 40.00th=[ 16188], 50.00th=[ 19006], 60.00th=[ 22152], | 70.00th=[ 27132], 80.00th=[ 32113], 90.00th=[ 39060], 95.00th=[ 46400], | 99.00th=[ 82314], 99.50th=[113771], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 191, max= 734, per=26.30%, avg=398.97, stdev=115.93, samples=31 iops : min= 11, max= 45, avg=24.39, stdev= 7.25, samples=31 write: IOPS=23, BW=382KiB/s (391kB/s)(6032KiB/15781msec); 0 zone resets clat (usec): min=1500, max=139836, avg=20059.60, stdev=19578.20 lat (usec): min=1502, max=139838, avg=20061.99, stdev=19578.04 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 10], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 25], 80.00th=[ 32], 90.00th=[ 45], 95.00th=[ 57], | 99.00th=[ 100], 99.50th=[ 127], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 159, max= 638, per=23.72%, avg=378.65, stdev=118.46, samples=31 iops : min= 9, max= 39, avg=23.10, stdev= 7.39, samples=31 lat (usec) : 50=1.04%, 100=3.91%, 250=4.43%, 500=0.78%, 750=0.13% lat (msec) : 2=0.65%, 4=7.42%, 10=14.06%, 20=25.26%, 50=36.85% lat (msec) : 100=4.82%, 250=0.65% cpu : usr=0.13%, sys=17.36%, ctx=1981, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145472: Tue Sep 1 08:55:38 2026 read: IOPS=24, BW=387KiB/s (396kB/s)(6032KiB/15579msec) clat (usec): min=43, max=152281, avg=20784.93, stdev=17353.14 lat (usec): min=44, max=152283, avg=20786.33, stdev=17353.14 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 101], 20.00th=[ 502], | 30.00th=[ 13173], 40.00th=[ 15795], 50.00th=[ 19006], 60.00th=[ 22414], | 70.00th=[ 26346], 80.00th=[ 31589], 90.00th=[ 39584], 95.00th=[ 50070], | 99.00th=[ 83362], 99.50th=[103285], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 29, max= 606, per=25.27%, avg=383.37, stdev=117.29, samples=30 iops : min= 1, max= 37, avg=23.40, stdev= 7.39, samples=30 write: IOPS=25, BW=402KiB/s (411kB/s)(6256KiB/15579msec); 0 zone resets clat (usec): min=1321, max=132627, avg=19244.61, stdev=19398.24 lat (usec): min=1323, max=132628, avg=19246.84, stdev=19398.26 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2835], 10.00th=[ 3523], 20.00th=[ 4621], | 30.00th=[ 6325], 40.00th=[ 8979], 50.00th=[ 13304], 60.00th=[ 17171], | 70.00th=[ 23725], 80.00th=[ 32113], 90.00th=[ 41681], 95.00th=[ 54264], | 99.00th=[ 92799], 99.50th=[128451], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 95, max= 665, per=25.27%, avg=403.23, stdev=133.83, samples=30 iops : min= 5, max= 41, avg=24.67, stdev= 8.37, samples=30 lat (usec) : 50=0.39%, 100=4.43%, 250=4.30%, 500=0.65%, 750=0.13% lat (msec) : 2=1.17%, 4=6.38%, 10=15.36%, 20=25.39%, 50=35.94% lat (msec) : 100=5.21%, 250=0.65% cpu : usr=0.13%, sys=17.51%, ctx=1961, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1518KiB/s (1554kB/s), 372KiB/s-396KiB/s (381kB/s-406kB/s), io=23.4MiB (24.5MB), run=15332-15781msec WRITE: bw=1597KiB/s (1635kB/s), 382KiB/s-424KiB/s (391kB/s-434kB/s), io=24.6MiB (25.8MB), run=15332-15781msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145473: Tue Sep 1 08:55:56 2026 read: IOPS=11, BW=181KiB/s (185kB/s)(5920KiB/32765msec) clat (msec): min=5, max=123, avg=20.85, stdev=20.36 lat (msec): min=5, max=123, avg=20.85, stdev=20.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 16], | 70.00th=[ 20], 80.00th=[ 29], 90.00th=[ 46], 95.00th=[ 67], | 99.00th=[ 118], 99.50th=[ 123], 99.90th=[ 124], 99.95th=[ 124], | 99.99th=[ 124] bw ( KiB/s): min= 32, max= 383, per=24.97%, avg=180.02, stdev=87.38, samples=65 iops : min= 2, max= 23, avg=10.58, stdev= 5.52, samples=65 write: IOPS=12, BW=194KiB/s (199kB/s)(6368KiB/32765msec); 0 zone resets clat (msec): min=24, max=184, avg=62.67, stdev=25.25 lat (msec): min=24, max=184, avg=62.67, stdev=25.25 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 34], 10.00th=[ 37], 20.00th=[ 44], | 30.00th=[ 48], 40.00th=[ 52], 50.00th=[ 57], 60.00th=[ 63], | 70.00th=[ 70], 80.00th=[ 79], 90.00th=[ 99], 95.00th=[ 117], | 99.00th=[ 142], 99.50th=[ 176], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 56, max= 352, per=25.55%, avg=193.89, stdev=78.98, samples=65 iops : min= 3, max= 22, avg=11.46, stdev= 4.95, samples=65 lat (msec) : 10=14.58%, 20=19.66%, 50=28.91%, 100=31.90%, 250=4.95% cpu : usr=0.08%, sys=3.74%, ctx=1519, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145474: Tue Sep 1 08:55:56 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5744KiB/33175msec) clat (msec): min=5, max=151, avg=19.90, stdev=20.44 lat (msec): min=5, max=151, avg=19.90, stdev=20.44 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 27], 90.00th=[ 45], 95.00th=[ 65], | 99.00th=[ 102], 99.50th=[ 120], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 28, max= 447, per=24.28%, avg=175.09, stdev=98.90, samples=64 iops : min= 1, max= 27, avg=10.27, stdev= 6.29, samples=64 write: IOPS=12, BW=197KiB/s (202kB/s)(6544KiB/33175msec); 0 zone resets clat (msec): min=24, max=252, avg=63.10, stdev=31.32 lat (msec): min=24, max=252, avg=63.10, stdev=31.32 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 34], 10.00th=[ 36], 20.00th=[ 42], | 30.00th=[ 46], 40.00th=[ 50], 50.00th=[ 55], 60.00th=[ 59], | 70.00th=[ 67], 80.00th=[ 80], 90.00th=[ 102], 95.00th=[ 138], | 99.00th=[ 180], 99.50th=[ 203], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 63, max= 350, per=25.60%, avg=194.34, stdev=81.01, samples=65 iops : min= 3, max= 21, avg=11.49, stdev= 5.11, samples=65 lat (msec) : 10=15.63%, 20=19.27%, 50=30.08%, 100=28.65%, 250=6.25% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=3.57%, ctx=1488, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145475: Tue Sep 1 08:55:56 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31906msec) clat (msec): min=5, max=169, avg=18.77, stdev=19.52 lat (msec): min=5, max=169, avg=18.77, stdev=19.52 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 22], 90.00th=[ 40], 95.00th=[ 58], | 99.00th=[ 107], 99.50th=[ 127], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 31, max= 702, per=27.38%, avg=197.43, stdev=127.58, samples=63 iops : min= 1, max= 43, avg=11.68, stdev= 8.01, samples=63 write: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31906msec); 0 zone resets clat (msec): min=27, max=254, avg=64.64, stdev=30.69 lat (msec): min=27, max=254, avg=64.64, stdev=30.69 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 38], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 56], 60.00th=[ 61], | 70.00th=[ 69], 80.00th=[ 83], 90.00th=[ 105], 95.00th=[ 127], | 99.00th=[ 178], 99.50th=[ 211], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 319, per=24.80%, avg=188.24, stdev=77.19, samples=63 iops : min= 1, max= 19, avg=11.11, stdev= 4.81, samples=63 lat (msec) : 10=19.27%, 20=20.44%, 50=26.30%, 100=27.47%, 250=6.38% lat (msec) : 500=0.13% cpu : usr=0.11%, sys=3.63%, ctx=1513, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145476: Tue Sep 1 08:55:56 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(6032KiB/32512msec) clat (msec): min=5, max=117, avg=19.15, stdev=18.06 lat (msec): min=5, max=117, avg=19.15, stdev=18.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 45], 95.00th=[ 64], | 99.00th=[ 87], 99.50th=[ 97], 99.90th=[ 117], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 31, max= 447, per=25.91%, avg=186.79, stdev=97.15, samples=63 iops : min= 1, max= 27, avg=11.02, stdev= 6.08, samples=63 write: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32512msec); 0 zone resets clat (msec): min=27, max=276, avg=64.48, stdev=30.34 lat (msec): min=27, max=276, avg=64.48, stdev=30.34 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 52], 50.00th=[ 56], 60.00th=[ 62], | 70.00th=[ 71], 80.00th=[ 83], 90.00th=[ 104], 95.00th=[ 125], | 99.00th=[ 171], 99.50th=[ 197], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 63, max= 350, per=25.27%, avg=191.78, stdev=77.27, samples=64 iops : min= 3, max= 21, avg=11.31, stdev= 4.91, samples=64 lat (msec) : 10=17.06%, 20=19.66%, 50=26.43%, 100=30.99%, 250=5.73% lat (msec) : 500=0.13% cpu : usr=0.10%, sys=3.68%, ctx=1492, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=722KiB/s (739kB/s), 173KiB/s-196KiB/s (177kB/s-201kB/s), io=23.4MiB (24.5MB), run=31906-33175msec WRITE: bw=760KiB/s (778kB/s), 189KiB/s-197KiB/s (194kB/s-202kB/s), io=24.6MiB (25.8MB), run=31906-33175msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145488: Tue Sep 1 08:56:07 2026 read: IOPS=2, BW=2691KiB/s (2755kB/s)(7168KiB/2664msec) clat (msec): min=70, max=271, avg=168.64, stdev=73.10 lat (msec): min=70, max=271, avg=168.64, stdev=73.10 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 89], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 171], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 239], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1992, max= 6083, per=52.48%, avg=3037.50, stdev=2030.46, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=1, BW=1922KiB/s (1968kB/s)(5120KiB/2664msec); 0 zone resets clat (msec): min=168, max=374, avg=261.94, stdev=89.11 lat (msec): min=168, max=374, avg=262.04, stdev=89.13 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1992, max= 4055, per=31.23%, avg=2530.50, stdev=1016.60, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=10.70%, ctx=116, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145489: Tue Sep 1 08:56:07 2026 read: IOPS=0, BW=579KiB/s (593kB/s)(2048KiB/3538msec) clat (msec): min=68, max=349, avg=208.87, stdev=199.18 lat (msec): min=68, max=349, avg=208.87, stdev=199.18 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 68], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 1935, max= 1992, per=33.92%, avg=1963.50, stdev=40.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2894KiB/s (2964kB/s)(10.0MiB/3538msec); 0 zone resets clat (msec): min=153, max=546, avg=309.46, stdev=142.17 lat (msec): min=153, max=546, avg=309.57, stdev=142.17 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 247], 50.00th=[ 253], 60.00th=[ 262], | 70.00th=[ 363], 80.00th=[ 397], 90.00th=[ 523], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1935, max= 4087, per=34.93%, avg=2830.40, stdev=1133.36, samples=5 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=10.29%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145490: Tue Sep 1 08:56:07 2026 read: IOPS=1, BW=1847KiB/s (1891kB/s)(6144KiB/3327msec) clat (msec): min=77, max=817, avg=277.35, stdev=284.26 lat (msec): min=77, max=817, avg=277.35, stdev=284.26 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 123], 50.00th=[ 123], 60.00th=[ 180], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1992, max= 4087, per=58.36%, avg=3378.00, stdev=1200.42, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1847KiB/s (1891kB/s)(6144KiB/3327msec); 0 zone resets clat (msec): min=145, max=495, avg=273.24, stdev=136.37 lat (msec): min=145, max=495, avg=273.33, stdev=136.37 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 241], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2027, max= 4071, per=31.43%, avg=2547.25, stdev=1015.87, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 1000=8.33% cpu : usr=0.06%, sys=8.75%, ctx=175, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145492: Tue Sep 1 08:56:07 2026 read: IOPS=1, BW=1584KiB/s (1622kB/s)(5120KiB/3233msec) clat (msec): min=71, max=243, avg=183.39, stdev=70.36 lat (msec): min=71, max=243, avg=183.39, stdev=70.36 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 71], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 211], 60.00th=[ 211], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 3984, max= 4071, per=69.58%, avg=4027.50, stdev=61.52, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2217KiB/s (2270kB/s)(7168KiB/3233msec); 0 zone resets clat (msec): min=123, max=650, avg=326.00, stdev=186.90 lat (msec): min=123, max=650, avg=326.07, stdev=186.92 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 161], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 266], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 477], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2023, max= 2737, per=27.95%, avg=2265.00, stdev=408.81, samples=3 iops : min= 1, max= 2, avg= 1.33, stdev= 0.58, samples=3 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=8.29%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5789KiB/s (5928kB/s), 579KiB/s-2691KiB/s (593kB/s-2755kB/s), io=20.0MiB (20.0MB), run=2664-3538msec WRITE: bw=8104KiB/s (8299kB/s), 1847KiB/s-2894KiB/s (1891kB/s-2964kB/s), io=28.0MiB (29.4MB), run=2664-3538msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145491: Tue Sep 1 08:56:07 2026 read: IOPS=2, BW=2509KiB/s (2569kB/s)(7168KiB/2857msec) clat (usec): min=551, max=259229, avg=169549.28, stdev=80129.01 lat (usec): min=552, max=259230, avg=169550.23, stdev=80129.04 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[170918], | 30.00th=[177210], 40.00th=[177210], 50.00th=[185598], 60.00th=[189793], | 70.00th=[189793], 80.00th=[204473], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 1882, max= 4063, per=43.98%, avg=2496.75, stdev=1046.32, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1792KiB/s (1835kB/s)(5120KiB/2857msec); 0 zone resets clat (msec): min=159, max=467, avg=301.04, stdev=140.83 lat (msec): min=159, max=467, avg=301.13, stdev=140.84 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2003, max= 4096, per=34.13%, avg=2712.67, stdev=1198.14, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=33.33% cpu : usr=0.00%, sys=29.06%, ctx=349, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145493: Tue Sep 1 08:56:07 2026 read: IOPS=0, BW=568KiB/s (581kB/s)(2048KiB/3607msec) clat (usec): min=512, max=244376, avg=122444.35, stdev=172437.44 lat (usec): min=513, max=244378, avg=122446.10, stdev=172438.34 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 515], 40.00th=[ 515], 50.00th=[ 515], 60.00th=[244319], | 70.00th=[244319], 80.00th=[244319], 90.00th=[244319], 95.00th=[244319], | 99.00th=[244319], 99.50th=[244319], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 1383, max= 1882, per=28.76%, avg=1632.50, stdev=352.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2839KiB/s (2907kB/s)(10.0MiB/3607msec); 0 zone resets clat (msec): min=156, max=989, avg=324.83, stdev=246.58 lat (msec): min=156, max=989, avg=324.94, stdev=246.57 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 159], | 30.00th=[ 180], 40.00th=[ 199], 50.00th=[ 259], 60.00th=[ 284], | 70.00th=[ 296], 80.00th=[ 342], 90.00th=[ 393], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 2039, max= 5647, per=49.64%, avg=3945.00, stdev=1478.02, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=26.32%, ctx=197, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145494: Tue Sep 1 08:56:07 2026 read: IOPS=2, BW=2425KiB/s (2483kB/s)(6144KiB/2534msec) clat (usec): min=511, max=276798, avg=111354.51, stdev=104945.40 lat (usec): min=512, max=276799, avg=111355.83, stdev=104945.27 clat percentiles (usec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 31065], | 30.00th=[ 31065], 40.00th=[ 44827], 50.00th=[ 44827], 60.00th=[147850], | 70.00th=[168821], 80.00th=[168821], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 2048, max= 6119, per=71.93%, avg=4083.50, stdev=2878.63, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=2, BW=2425KiB/s (2483kB/s)(6144KiB/2534msec); 0 zone resets clat (msec): min=137, max=755, avg=293.07, stdev=235.21 lat (msec): min=137, max=755, avg=293.21, stdev=235.20 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 268], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 2048, max= 4079, per=37.13%, avg=2951.33, stdev=1033.92, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (usec) : 750=8.33% lat (msec) : 50=16.67%, 250=41.67%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=26.10%, ctx=227, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145495: Tue Sep 1 08:56:07 2026 read: IOPS=1, BW=1439KiB/s (1474kB/s)(5120KiB/3558msec) clat (usec): min=594, max=192947, avg=96206.41, stdev=90364.31 lat (usec): min=595, max=192948, avg=96207.59, stdev=90364.21 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[ 594], | 30.00th=[ 1778], 40.00th=[ 1778], 50.00th=[122160], 60.00th=[122160], | 70.00th=[164627], 80.00th=[164627], 90.00th=[193987], 95.00th=[193987], | 99.00th=[193987], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 7529, max= 7529, per=100.00%, avg=7529.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2015KiB/s (2063kB/s)(7168KiB/3558msec); 0 zone resets clat (msec): min=141, max=834, avg=434.14, stdev=226.85 lat (msec): min=141, max=835, avg=434.21, stdev=226.85 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 300], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 397], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 617], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1387, max= 4096, per=29.97%, avg=2382.25, stdev=1181.30, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=21.82%, ctx=266, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5678KiB/s (5814kB/s), 568KiB/s-2509KiB/s (581kB/s-2569kB/s), io=20.0MiB (20.0MB), run=2534-3607msec WRITE: bw=7949KiB/s (8140kB/s), 1792KiB/s-2839KiB/s (1835kB/s-2907kB/s), io=28.0MiB (29.4MB), run=2534-3607msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145500: Tue Sep 1 08:56:15 2026 read: IOPS=1, BW=6150KiB/s (6298kB/s)(12.0MiB/1998msec) clat (msec): min=504, max=748, avg=618.11, stdev=123.22 lat (msec): min=504, max=748, avg=618.11, stdev=123.22 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8175, max= 8175, per=99.70%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=12.12%, ctx=90, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145502: Tue Sep 1 08:56:15 2026 read: IOPS=0, BW=2075KiB/s (2125kB/s)(4096KiB/1974msec) clat (nsec): min=217352k, max=217352k, avg=217352275.00, stdev= 0.00 lat (nsec): min=217354k, max=217354k, avg=217354390.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 218], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 218], 95.00th=[ 218], | 99.00th=[ 218], 99.50th=[ 218], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 6159, max= 6159, per=75.11%, avg=6159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4150KiB/s (4250kB/s)(8192KiB/1974msec); 0 zone resets clat (msec): min=576, max=1037, avg=807.12, stdev=325.91 lat (msec): min=577, max=1037, avg=807.51, stdev=325.94 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8175, max= 8175, per=62.17%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=14.45%, ctx=93, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145503: Tue Sep 1 08:56:15 2026 write: IOPS=1, BW=4931KiB/s (5049kB/s)(12.0MiB/2492msec); 0 zone resets clat (msec): min=194, max=1219, avg=779.89, stdev=527.93 lat (msec): min=194, max=1220, avg=780.52, stdev=528.14 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8175, per=62.17%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.16%, sys=12.20%, ctx=53, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145504: Tue Sep 1 08:56:15 2026 write: IOPS=1, BW=6187KiB/s (6336kB/s)(12.0MiB/1986msec); 0 zone resets clat (msec): min=227, max=1362, avg=610.92, stdev=651.13 lat (msec): min=227, max=1363, avg=611.40, stdev=651.12 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min=12154, max=12154, per=92.43%, avg=12154.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.05%, sys=14.06%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8200KiB/s (8397kB/s), 2075KiB/s-6150KiB/s (2125kB/s-6298kB/s), io=16.0MiB (16.8MB), run=1974-1998msec WRITE: bw=12.8MiB/s (13.5MB/s), 4150KiB/s-6187KiB/s (4250kB/s-6336kB/s), io=32.0MiB (33.6MB), run=1974-2492msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145505: Tue Sep 1 08:56:16 2026 read: IOPS=1, BW=7054KiB/s (7223kB/s)(12.0MiB/1742msec) clat (msec): min=446, max=646, avg=537.39, stdev=101.10 lat (msec): min=446, max=646, avg=537.39, stdev=101.10 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 518], 50.00th=[ 518], 60.00th=[ 518], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 6942, max= 8192, per=91.63%, avg=7567.00, stdev=883.88, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=39.40%, ctx=1043, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145506: Tue Sep 1 08:56:16 2026 read: IOPS=0, BW=2065KiB/s (2114kB/s)(4096KiB/1984msec) clat (nsec): min=577481k, max=577481k, avg=577481483.00, stdev= 0.00 lat (nsec): min=577484k, max=577484k, avg=577483886.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 6714, max= 6714, per=81.30%, avg=6714.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4129KiB/s (4228kB/s)(8192KiB/1984msec); 0 zone resets clat (msec): min=586, max=795, avg=691.06, stdev=148.18 lat (msec): min=586, max=796, avg=691.42, stdev=148.05 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8192, max= 8192, per=61.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=11.20%, ctx=307, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145507: Tue Sep 1 08:56:16 2026 write: IOPS=1, BW=4981KiB/s (5100kB/s)(12.0MiB/2467msec); 0 zone resets clat (msec): min=163, max=1399, avg=790.29, stdev=618.51 lat (msec): min=163, max=1400, avg=790.93, stdev=618.45 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8192, max= 8192, per=61.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.08%, sys=6.29%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145508: Tue Sep 1 08:56:16 2026 write: IOPS=1, BW=6282KiB/s (6433kB/s)(12.0MiB/1956msec); 0 zone resets clat (msec): min=386, max=1066, avg=616.81, stdev=389.31 lat (msec): min=387, max=1067, avg=617.24, stdev=389.59 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7327, max= 8192, per=58.42%, avg=7759.50, stdev=611.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=10.90%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8258KiB/s (8456kB/s), 2065KiB/s-7054KiB/s (2114kB/s-7223kB/s), io=16.0MiB (16.8MB), run=1742-1984msec WRITE: bw=12.0MiB/s (13.6MB/s), 4129KiB/s-6282KiB/s (4228kB/s-6433kB/s), io=32.0MiB (33.6MB), run=1956-2467msec