== sanity test 398b: DIO and buffer IO race ============== 15:27:08 (1777577228) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.53177 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189211: Thu Apr 30 15:29:35 2026 read: IOPS=12, BW=48.5KiB/s (49.7kB/s)(5992KiB/123489msec) clat (usec): min=48, max=955356, avg=45712.85, stdev=36565.20 lat (usec): min=48, max=955357, avg=45725.57, stdev=36566.84 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11338], 10.00th=[ 16909], 20.00th=[ 23462], | 30.00th=[ 29230], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 64226], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[145753], 99.50th=[175113], 99.90th=[217056], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 103, per=25.65%, avg=48.23, stdev=16.85, samples=243 iops : min= 1, max= 25, avg=11.42, stdev= 4.25, samples=243 write: IOPS=12, BW=50.0KiB/s (52.2kB/s)(6296KiB/123489msec); 0 zone resets clat (usec): min=1149, max=267778, avg=34675.96, stdev=34679.86 lat (usec): min=1150, max=267780, avg=34681.13, stdev=34679.30 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1500], 10.00th=[ 2073], 20.00th=[ 4817], | 30.00th=[ 8225], 40.00th=[ 17171], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 44827], 80.00th=[ 58983], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[145753], 99.50th=[177210], 99.90th=[265290], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 128, per=25.69%, avg=50.62, stdev=21.52, samples=243 iops : min= 1, max= 32, avg=12.02, stdev= 5.43, samples=243 lat (usec) : 50=0.20%, 100=1.76%, 250=0.23%, 750=0.03% lat (msec) : 2=4.85%, 4=4.07%, 10=8.17%, 20=9.08%, 50=41.99% lat (msec) : 100=24.84%, 250=4.69%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.60%, ctx=6638, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189212: Thu Apr 30 15:29:35 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(5940KiB/127542msec) clat (usec): min=42, max=933659, avg=48644.60, stdev=39207.69 lat (usec): min=44, max=933660, avg=48647.22, stdev=39207.55 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 13173], 10.00th=[ 18744], 20.00th=[ 25035], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 57934], 80.00th=[ 67634], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[164627], 99.50th=[191890], 99.90th=[396362], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 7, max= 111, per=24.55%, avg=46.16, stdev=16.34, samples=251 iops : min= 1, max= 27, avg=10.90, stdev= 4.11, samples=251 write: IOPS=12, BW=49.8KiB/s (50.0kB/s)(6348KiB/127542msec); 0 zone resets clat (usec): min=1154, max=297427, avg=34560.08, stdev=35600.81 lat (usec): min=1155, max=297429, avg=34570.34, stdev=35598.83 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 1860], 20.00th=[ 4015], | 30.00th=[ 7832], 40.00th=[ 15664], 50.00th=[ 24511], 60.00th=[ 33162], | 70.00th=[ 44303], 80.00th=[ 61080], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[147850], 99.50th=[179307], 99.90th=[227541], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 175, per=25.04%, avg=49.33, stdev=22.27, samples=251 iops : min= 1, max= 43, avg=11.70, stdev= 5.61, samples=251 lat (usec) : 50=0.07%, 100=1.50%, 250=0.16%, 500=0.07%, 750=0.03% lat (msec) : 2=5.63%, 4=4.69%, 10=7.06%, 20=9.31%, 50=39.78% lat (msec) : 100=26.11%, 250=5.40%, 500=0.16%, 1000=0.03% cpu : usr=0.09%, sys=5.66%, ctx=6680, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189213: Thu Apr 30 15:29:35 2026 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(6028KiB/123505msec) clat (usec): min=32, max=272746, avg=45390.09, stdev=28143.17 lat (usec): min=33, max=272747, avg=45393.09, stdev=28142.63 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12518], 10.00th=[ 17957], 20.00th=[ 23987], | 30.00th=[ 29230], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[137364], 99.50th=[158335], 99.90th=[265290], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 99, per=25.79%, avg=48.48, stdev=18.18, samples=243 iops : min= 1, max= 24, avg=11.49, stdev= 4.61, samples=243 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6260KiB/123505msec); 0 zone resets clat (usec): min=1141, max=894642, avg=34931.87, stdev=40593.09 lat (usec): min=1142, max=894644, avg=34934.45, stdev=40593.40 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1434], 10.00th=[ 2245], 20.00th=[ 4817], | 30.00th=[ 8356], 40.00th=[ 16909], 50.00th=[ 25822], 60.00th=[ 33817], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[143655], 99.50th=[160433], 99.90th=[350225], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 103, per=25.76%, avg=50.75, stdev=19.10, samples=241 iops : min= 1, max= 25, avg=12.06, stdev= 4.83, samples=241 lat (usec) : 50=0.36%, 100=1.43%, 250=0.16%, 500=0.03% lat (msec) : 2=4.56%, 4=3.94%, 10=8.20%, 20=9.38%, 50=41.67% lat (msec) : 100=25.85%, 250=4.30%, 500=0.10%, 1000=0.03% cpu : usr=0.10%, sys=5.63%, ctx=6647, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189214: Thu Apr 30 15:29:35 2026 read: IOPS=11, BW=47.9KiB/s (49.1kB/s)(6052KiB/126294msec) clat (usec): min=34, max=184917, avg=45041.14, stdev=27530.04 lat (usec): min=34, max=184917, avg=45042.73, stdev=27530.11 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10028], 10.00th=[ 18482], 20.00th=[ 23987], | 30.00th=[ 28705], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 65274], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[160433], 99.90th=[179307], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 7, max= 108, per=25.40%, avg=47.75, stdev=18.42, samples=247 iops : min= 1, max= 27, avg=11.30, stdev= 4.66, samples=247 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6236KiB/126294msec); 0 zone resets clat (usec): min=1124, max=871223, avg=36997.99, stdev=42026.99 lat (usec): min=1125, max=871225, avg=37004.74, stdev=42024.02 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1450], 10.00th=[ 2147], 20.00th=[ 4621], | 30.00th=[ 8717], 40.00th=[ 17171], 50.00th=[ 27395], 60.00th=[ 36439], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[156238], 99.50th=[212861], 99.90th=[256902], 99.95th=[868221], | 99.99th=[868221] bw ( KiB/s): min= 7, max= 135, per=24.79%, avg=48.83, stdev=20.74, samples=248 iops : min= 1, max= 33, avg=11.58, stdev= 5.23, samples=248 lat (usec) : 50=0.36%, 100=1.69%, 250=0.10%, 500=0.20%, 1000=0.03% lat (msec) : 2=4.62%, 4=4.43%, 10=7.32%, 20=8.95%, 50=40.72% lat (msec) : 100=26.56%, 250=4.95%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.56%, ctx=6704, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (193kB/s), 46.6KiB/s-48.8KiB/s (47.7kB/s-49.0kB/s), io=23.4MiB (24.6MB), run=123489-127542msec WRITE: bw=197KiB/s (202kB/s), 49.4KiB/s-50.0KiB/s (50.6kB/s-52.2kB/s), io=24.6MiB (25.7MB), run=123489-127542msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189216: Thu Apr 30 15:30:24 2026 read: IOPS=8, BW=34.1KiB/s (34.9kB/s)(5992KiB/175628msec) clat (msec): min=6, max=838, avg=46.03, stdev=42.81 lat (msec): min=6, max=838, avg=46.04, stdev=42.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 52], 80.00th=[ 67], 90.00th=[ 94], 95.00th=[ 124], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 326], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 126, per=25.22%, avg=34.30, stdev=21.66, samples=339 iops : min= 1, max= 31, avg= 7.90, stdev= 5.46, samples=339 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6296KiB/175628msec); 0 zone resets clat (msec): min=10, max=336, avg=67.64, stdev=41.52 lat (msec): min=10, max=336, avg=67.65, stdev=41.52 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 64], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 125], 95.00th=[ 153], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 288], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 96, per=24.89%, avg=35.59, stdev=19.47, samples=343 iops : min= 1, max= 24, avg= 8.22, stdev= 4.92, samples=343 lat (msec) : 10=0.91%, 20=10.81%, 50=45.02%, 100=29.79%, 250=13.12% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=2.13%, ctx=5090, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189217: Thu Apr 30 15:30:24 2026 read: IOPS=8, BW=33.9KiB/s (34.7kB/s)(5940KiB/175157msec) clat (msec): min=7, max=949, avg=45.16, stdev=43.60 lat (msec): min=7, max=949, avg=45.16, stdev=43.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 96], 95.00th=[ 125], | 99.00th=[ 174], 99.50th=[ 205], 99.90th=[ 305], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=34.37, stdev=20.90, samples=335 iops : min= 1, max= 29, avg= 7.91, stdev= 5.27, samples=335 write: IOPS=9, BW=36.2KiB/s (37.1kB/s)(6348KiB/175157msec); 0 zone resets clat (msec): min=9, max=330, avg=68.02, stdev=41.68 lat (msec): min=9, max=330, avg=68.02, stdev=41.68 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 124], 95.00th=[ 150], | 99.00th=[ 218], 99.50th=[ 239], 99.90th=[ 305], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 7, max= 95, per=25.20%, avg=36.04, stdev=19.02, samples=342 iops : min= 1, max= 23, avg= 8.33, stdev= 4.80, samples=342 lat (msec) : 10=1.01%, 20=10.22%, 50=46.68%, 100=27.80%, 250=14.06% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=2.14%, ctx=5152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189218: Thu Apr 30 15:30:24 2026 read: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6028KiB/175730msec) clat (msec): min=5, max=322, avg=46.35, stdev=39.92 lat (msec): min=5, max=322, avg=46.36, stdev=39.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 65], 90.00th=[ 102], 95.00th=[ 127], | 99.00th=[ 194], 99.50th=[ 232], 99.90th=[ 279], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 119, per=25.23%, avg=34.32, stdev=21.53, samples=340 iops : min= 1, max= 29, avg= 7.90, stdev= 5.42, samples=340 write: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6260KiB/175730msec); 0 zone resets clat (msec): min=13, max=927, avg=67.53, stdev=48.05 lat (msec): min=13, max=927, avg=67.54, stdev=48.05 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 77], 80.00th=[ 94], 90.00th=[ 129], 95.00th=[ 148], | 99.00th=[ 215], 99.50th=[ 264], 99.90th=[ 489], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 103, per=24.65%, avg=35.25, stdev=19.74, samples=344 iops : min= 1, max= 25, avg= 8.13, stdev= 4.99, samples=344 lat (msec) : 10=0.98%, 20=10.64%, 50=46.35%, 100=27.99%, 250=13.57% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=2.06%, ctx=4991, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189219: Thu Apr 30 15:30:24 2026 read: IOPS=8, BW=34.9KiB/s (35.7kB/s)(6052KiB/173362msec) clat (msec): min=6, max=323, avg=44.68, stdev=37.85 lat (msec): min=6, max=323, avg=44.68, stdev=37.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 93], 95.00th=[ 126], | 99.00th=[ 184], 99.50th=[ 218], 99.90th=[ 317], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 117, per=26.22%, avg=35.65, stdev=21.68, samples=329 iops : min= 1, max= 29, avg= 8.24, stdev= 5.48, samples=329 write: IOPS=8, BW=35.0KiB/s (36.8kB/s)(6236KiB/173362msec); 0 zone resets clat (msec): min=15, max=967, avg=67.74, stdev=48.04 lat (msec): min=15, max=967, avg=67.75, stdev=48.04 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 124], 95.00th=[ 144], | 99.00th=[ 211], 99.50th=[ 262], 99.90th=[ 489], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 96, per=24.99%, avg=35.74, stdev=19.70, samples=338 iops : min= 1, max= 24, avg= 8.25, stdev= 4.97, samples=338 lat (msec) : 10=1.04%, 20=11.36%, 50=44.76%, 100=29.43%, 250=12.96% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=2.13%, ctx=4989, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=137KiB/s (140kB/s), 33.9KiB/s-34.9KiB/s (34.7kB/s-35.7kB/s), io=23.4MiB (24.6MB), run=173362-175730msec WRITE: bw=143KiB/s (146kB/s), 35.6KiB/s-36.2KiB/s (36.5kB/s-37.1kB/s), io=24.6MiB (25.7MB), run=173362-175730msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189263: Thu Apr 30 15:31:13 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35500msec) clat (usec): min=36, max=282478, avg=50269.17, stdev=35006.85 lat (usec): min=36, max=282480, avg=50270.63, stdev=35006.83 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 190], 20.00th=[ 25822], | 30.00th=[ 33424], 40.00th=[ 39060], 50.00th=[ 45876], 60.00th=[ 51643], | 70.00th=[ 61080], 80.00th=[ 72877], 90.00th=[ 90702], 95.00th=[106431], | 99.00th=[166724], 99.50th=[250610], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 62, max= 442, per=25.86%, avg=166.80, stdev=64.60, samples=69 iops : min= 3, max= 27, avg= 9.65, stdev= 4.12, samples=69 write: IOPS=11, BW=179KiB/s (184kB/s)(6368KiB/35500msec); 0 zone resets clat (usec): min=1596, max=193533, avg=41803.73, stdev=40163.50 lat (usec): min=1598, max=193534, avg=41807.88, stdev=40163.69 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 3752], 20.00th=[ 7570], | 30.00th=[ 13304], 40.00th=[ 21627], 50.00th=[ 29492], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 70779], 90.00th=[103285], 95.00th=[125305], | 99.00th=[166724], 99.50th=[187696], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 320, per=26.54%, avg=179.91, stdev=71.05, samples=69 iops : min= 1, max= 20, avg=10.48, stdev= 4.54, samples=69 lat (usec) : 50=0.52%, 100=3.91%, 250=0.39% lat (msec) : 2=1.82%, 4=3.91%, 10=7.68%, 20=8.33%, 50=37.11% lat (msec) : 100=27.86%, 250=8.20%, 500=0.26% cpu : usr=0.08%, sys=5.86%, ctx=1762, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189264: Thu Apr 30 15:31:13 2026 read: IOPS=9, BW=159KiB/s (163kB/s)(5744KiB/36145msec) clat (usec): min=45, max=251275, avg=52531.41, stdev=35253.01 lat (usec): min=46, max=251276, avg=52601.39, stdev=35279.08 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 13042], 20.00th=[ 26608], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 48497], 60.00th=[ 55837], | 70.00th=[ 65274], 80.00th=[ 74974], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[168821], 99.50th=[212861], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 287, per=25.27%, avg=163.01, stdev=61.92, samples=68 iops : min= 1, max= 17, avg= 9.40, stdev= 3.93, samples=68 write: IOPS=11, BW=181KiB/s (185kB/s)(6544KiB/36145msec); 0 zone resets clat (usec): min=1586, max=199897, avg=41540.48, stdev=38557.62 lat (usec): min=1589, max=199900, avg=41547.74, stdev=38562.15 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2057], 10.00th=[ 4015], 20.00th=[ 7635], | 30.00th=[ 12256], 40.00th=[ 21365], 50.00th=[ 31851], 60.00th=[ 40633], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[162530], 99.50th=[173016], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 373, per=26.28%, avg=178.17, stdev=79.18, samples=70 iops : min= 1, max= 23, avg=10.37, stdev= 5.04, samples=70 lat (usec) : 50=0.13%, 100=3.39%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.73%, 4=2.86%, 10=8.98%, 20=8.85%, 50=32.29% lat (msec) : 100=31.51%, 250=8.72%, 500=0.13% cpu : usr=0.07%, sys=5.69%, ctx=1715, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189265: Thu Apr 30 15:31:13 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(6256KiB/37115msec) clat (usec): min=31, max=374544, avg=53757.85, stdev=39182.32 lat (usec): min=31, max=374545, avg=53759.37, stdev=39182.28 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 74], 10.00th=[ 18220], 20.00th=[ 27132], | 30.00th=[ 33162], 40.00th=[ 41681], 50.00th=[ 48497], 60.00th=[ 55313], | 70.00th=[ 65799], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[225444], 99.50th=[254804], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 318, per=26.03%, avg=167.89, stdev=60.53, samples=72 iops : min= 1, max= 19, avg= 9.71, stdev= 3.84, samples=72 write: IOPS=10, BW=163KiB/s (166kB/s)(6032KiB/37115msec); 0 zone resets clat (usec): min=1738, max=215430, avg=42387.26, stdev=38759.16 lat (usec): min=1740, max=215432, avg=42421.85, stdev=38777.61 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2343], 10.00th=[ 4424], 20.00th=[ 7701], | 30.00th=[ 15270], 40.00th=[ 23200], 50.00th=[ 32900], 60.00th=[ 41157], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[ 93848], 95.00th=[126354], | 99.00th=[168821], 99.50th=[200279], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 30, max= 416, per=24.10%, avg=163.41, stdev=81.54, samples=70 iops : min= 1, max= 26, avg= 9.41, stdev= 5.18, samples=70 lat (usec) : 50=0.26%, 100=3.26%, 250=0.39%, 500=0.26% lat (msec) : 2=1.82%, 4=2.73%, 10=7.29%, 20=7.42%, 50=36.20% lat (msec) : 100=32.16%, 250=7.94%, 500=0.26% cpu : usr=0.06%, sys=5.38%, ctx=1764, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189266: Thu Apr 30 15:31:13 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35704msec) clat (usec): min=34, max=329009, avg=51258.83, stdev=39273.77 lat (usec): min=34, max=329010, avg=51284.96, stdev=39286.35 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 64], 10.00th=[ 86], 20.00th=[ 26084], | 30.00th=[ 32900], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 54264], | 70.00th=[ 62129], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[200279], 99.50th=[217056], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 31, max= 316, per=26.01%, avg=167.74, stdev=66.12, samples=70 iops : min= 1, max= 19, avg= 9.70, stdev= 4.15, samples=70 write: IOPS=10, BW=175KiB/s (179kB/s)(6256KiB/35704msec); 0 zone resets clat (usec): min=1500, max=238927, avg=40988.01, stdev=39822.75 lat (usec): min=1503, max=238929, avg=40992.23, stdev=39824.88 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1991], 10.00th=[ 3556], 20.00th=[ 7898], | 30.00th=[ 13960], 40.00th=[ 20841], 50.00th=[ 30016], 60.00th=[ 37487], | 70.00th=[ 50594], 80.00th=[ 66323], 90.00th=[ 94897], 95.00th=[121111], | 99.00th=[181404], 99.50th=[187696], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 31, max= 406, per=25.78%, avg=174.76, stdev=77.31, samples=70 iops : min= 1, max= 25, avg=10.14, stdev= 4.94, samples=70 lat (usec) : 50=0.26%, 100=5.21%, 250=0.26%, 500=0.39% lat (msec) : 2=2.73%, 4=2.99%, 10=6.64%, 20=9.38%, 50=34.24% lat (msec) : 100=29.56%, 250=8.20%, 500=0.13% cpu : usr=0.07%, sys=5.41%, ctx=1708, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=645KiB/s (661kB/s), 159KiB/s-169KiB/s (163kB/s-173kB/s), io=23.4MiB (24.5MB), run=35500-37115msec WRITE: bw=679KiB/s (695kB/s), 163KiB/s-181KiB/s (166kB/s-185kB/s), io=24.6MiB (25.8MB), run=35500-37115msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189259: Thu Apr 30 15:31:29 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5920KiB/51927msec) clat (msec): min=9, max=253, avg=53.93, stdev=44.02 lat (msec): min=9, max=253, avg=53.94, stdev=44.03 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 70], 90.00th=[ 109], 95.00th=[ 159], | 99.00th=[ 230], 99.50th=[ 251], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 30, max= 281, per=25.38%, avg=115.24, stdev=62.95, samples=100 iops : min= 1, max= 17, avg= 6.39, stdev= 4.00, samples=100 write: IOPS=7, BW=123KiB/s (126kB/s)(6368KiB/51927msec); 0 zone resets clat (msec): min=16, max=345, avg=80.15, stdev=46.24 lat (msec): min=16, max=345, avg=80.17, stdev=46.24 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 50], 40.00th=[ 58], 50.00th=[ 68], 60.00th=[ 81], | 70.00th=[ 95], 80.00th=[ 111], 90.00th=[ 146], 95.00th=[ 167], | 99.00th=[ 234], 99.50th=[ 257], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 30, max= 320, per=26.14%, avg=124.70, stdev=63.00, samples=100 iops : min= 1, max= 20, avg= 6.98, stdev= 4.02, samples=100 lat (msec) : 10=0.26%, 20=4.04%, 50=41.93%, 100=34.38%, 250=18.88% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.97%, ctx=1277, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189260: Thu Apr 30 15:31:29 2026 read: IOPS=6, BW=110KiB/s (112kB/s)(5744KiB/52377msec) clat (msec): min=10, max=336, avg=54.68, stdev=44.73 lat (msec): min=10, max=336, avg=54.68, stdev=44.73 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 59], 80.00th=[ 71], 90.00th=[ 118], 95.00th=[ 150], | 99.00th=[ 218], 99.50th=[ 247], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 320, per=24.61%, avg=111.71, stdev=67.95, samples=100 iops : min= 1, max= 20, avg= 6.16, stdev= 4.31, samples=100 write: IOPS=7, BW=125KiB/s (128kB/s)(6544KiB/52377msec); 0 zone resets clat (msec): min=16, max=281, avg=79.48, stdev=49.20 lat (msec): min=16, max=281, avg=79.48, stdev=49.20 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 58], 50.00th=[ 66], 60.00th=[ 75], | 70.00th=[ 88], 80.00th=[ 112], 90.00th=[ 153], 95.00th=[ 180], | 99.00th=[ 251], 99.50th=[ 257], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 288, per=26.20%, avg=124.99, stdev=64.45, samples=102 iops : min= 1, max= 18, avg= 7.00, stdev= 4.08, samples=102 lat (msec) : 20=5.73%, 50=39.97%, 100=35.68%, 250=17.84%, 500=0.78% cpu : usr=0.04%, sys=1.90%, ctx=1268, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189261: Thu Apr 30 15:31:29 2026 read: IOPS=7, BW=120KiB/s (122kB/s)(6256KiB/52316msec) clat (msec): min=8, max=253, avg=52.60, stdev=41.10 lat (msec): min=8, max=253, avg=52.61, stdev=41.09 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 71], 90.00th=[ 104], 95.00th=[ 146], | 99.00th=[ 228], 99.50th=[ 243], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 31, max= 379, per=27.95%, avg=126.91, stdev=76.79, samples=97 iops : min= 1, max= 23, avg= 7.12, stdev= 4.84, samples=97 write: IOPS=7, BW=115KiB/s (118kB/s)(6032KiB/52316msec); 0 zone resets clat (msec): min=17, max=445, avg=83.13, stdev=54.83 lat (msec): min=17, max=445, avg=83.14, stdev=54.83 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 69], 60.00th=[ 80], | 70.00th=[ 92], 80.00th=[ 114], 90.00th=[ 146], 95.00th=[ 201], | 99.00th=[ 268], 99.50th=[ 351], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 288, per=24.13%, avg=115.11, stdev=55.65, samples=102 iops : min= 1, max= 18, avg= 6.38, stdev= 3.55, samples=102 lat (msec) : 10=0.39%, 20=4.43%, 50=42.97%, 100=33.85%, 250=17.32% lat (msec) : 500=1.04% cpu : usr=0.05%, sys=1.89%, ctx=1252, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189262: Thu Apr 30 15:31:29 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52730msec) clat (msec): min=9, max=330, avg=57.35, stdev=44.08 lat (msec): min=9, max=330, avg=57.35, stdev=44.08 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 65], 80.00th=[ 78], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 259], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 320, per=26.61%, avg=120.80, stdev=64.83, samples=96 iops : min= 1, max= 20, avg= 6.73, stdev= 4.11, samples=96 write: IOPS=7, BW=119KiB/s (121kB/s)(6256KiB/52730msec); 0 zone resets clat (msec): min=18, max=437, avg=78.58, stdev=54.10 lat (msec): min=18, max=437, avg=78.58, stdev=54.10 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 52], 50.00th=[ 62], 60.00th=[ 75], | 70.00th=[ 90], 80.00th=[ 108], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 275], 99.50th=[ 355], 99.90th=[ 439], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 30, max= 319, per=25.00%, avg=119.24, stdev=68.27, samples=101 iops : min= 1, max= 19, avg= 6.62, stdev= 4.34, samples=101 lat (msec) : 10=0.26%, 20=5.47%, 50=41.67%, 100=32.94%, 250=18.75% lat (msec) : 500=0.91% cpu : usr=0.06%, sys=1.92%, ctx=1390, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=454KiB/s (465kB/s), 110KiB/s-120KiB/s (112kB/s-122kB/s), io=23.4MiB (24.5MB), run=51927-52730msec WRITE: bw=478KiB/s (489kB/s), 115KiB/s-125KiB/s (118kB/s-128kB/s), io=24.6MiB (25.8MB), run=51927-52730msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189282: Thu Apr 30 15:31:45 2026 read: IOPS=1, BW=2024KiB/s (2072kB/s)(7168KiB/3542msec) clat (msec): min=84, max=824, avg=343.79, stdev=244.93 lat (msec): min=84, max=824, avg=343.79, stdev=244.93 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 159], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 292], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 464], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1396, max= 4071, per=57.24%, avg=2305.00, stdev=1023.59, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1446KiB/s (1480kB/s)(5120KiB/3542msec); 0 zone resets clat (msec): min=92, max=247, avg=188.09, stdev=64.13 lat (msec): min=92, max=247, avg=188.19, stdev=64.12 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 247], 95.00th=[ 247], | 99.00th=[ 247], 99.50th=[ 247], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 2019, max= 5988, per=59.37%, avg=3347.33, stdev=2286.90, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=25.00%, 1000=8.33% cpu : usr=0.00%, sys=3.95%, ctx=61, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189283: Thu Apr 30 15:31:45 2026 read: IOPS=0, BW=403KiB/s (412kB/s)(2048KiB/5085msec) clat (msec): min=104, max=255, avg=180.24, stdev=107.08 lat (msec): min=104, max=255, avg=180.24, stdev=107.08 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 257], | 70.00th=[ 257], 80.00th=[ 257], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1420, max= 1943, per=41.76%, avg=1681.50, stdev=369.82, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2014KiB/s (2062kB/s)(10.0MiB/5085msec); 0 zone resets clat (msec): min=189, max=721, avg=468.91, stdev=196.93 lat (msec): min=189, max=721, avg=469.01, stdev=196.93 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 232], | 30.00th=[ 288], 40.00th=[ 376], 50.00th=[ 430], 60.00th=[ 502], | 70.00th=[ 584], 80.00th=[ 667], 90.00th=[ 701], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1420, max= 2043, per=34.40%, avg=1939.75, stdev=212.47, samples=8 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=8 lat (msec) : 250=25.00%, 500=41.67%, 750=33.33% cpu : usr=0.04%, sys=5.66%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189284: Thu Apr 30 15:31:45 2026 read: IOPS=1, BW=1469KiB/s (1504kB/s)(6144KiB/4183msec) clat (msec): min=112, max=513, avg=325.04, stdev=160.72 lat (msec): min=112, max=513, avg=325.04, stdev=160.72 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1943, max= 2035, per=49.62%, avg=1998.25, stdev=40.16, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1469KiB/s (1504kB/s)(6144KiB/4183msec); 0 zone resets clat (msec): min=137, max=829, avg=360.29, stdev=267.07 lat (msec): min=137, max=829, avg=360.40, stdev=267.06 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 401], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1505, max= 2035, per=33.27%, avg=1875.50, stdev=250.24, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=3.87%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189285: Thu Apr 30 15:31:45 2026 read: IOPS=1, BW=1117KiB/s (1144kB/s)(5120KiB/4584msec) clat (msec): min=113, max=462, avg=197.54, stdev=149.01 lat (msec): min=113, max=462, avg=197.54, stdev=149.01 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 134], 60.00th=[ 134], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 3886, max= 4071, per=98.80%, avg=3978.50, stdev=130.81, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1564KiB/s (1601kB/s)(7168KiB/4584msec); 0 zone resets clat (msec): min=200, max=725, avg=509.60, stdev=220.96 lat (msec): min=200, max=725, avg=509.68, stdev=220.96 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 218], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 600], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 718], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1501, max= 2043, per=34.03%, avg=1918.80, stdev=234.25, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=33.33% cpu : usr=0.00%, sys=4.10%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4028KiB/s (4124kB/s), 403KiB/s-2024KiB/s (412kB/s-2072kB/s), io=20.0MiB (20.0MB), run=3542-5085msec WRITE: bw=5639KiB/s (5774kB/s), 1446KiB/s-2014KiB/s (1480kB/s-2062kB/s), io=28.0MiB (29.4MB), run=3542-5085msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189286: Thu Apr 30 15:31:45 2026 read: IOPS=1, BW=1535KiB/s (1572kB/s)(7168KiB/4669msec) clat (msec): min=162, max=448, avg=280.09, stdev=102.09 lat (msec): min=162, max=448, avg=280.10, stdev=102.09 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 190], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 271], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 342], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1448, max= 4096, per=57.31%, avg=2288.00, stdev=1035.38, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=1, BW=1097KiB/s (1123kB/s)(5120KiB/4669msec); 0 zone resets clat (msec): min=213, max=863, avg=496.24, stdev=310.33 lat (msec): min=213, max=863, avg=496.49, stdev=310.51 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1939, max= 6107, per=71.97%, avg=4023.00, stdev=2947.22, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 250=41.67%, 500=41.67%, 1000=16.67% cpu : usr=0.04%, sys=12.10%, ctx=215, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189287: Thu Apr 30 15:31:45 2026 read: IOPS=0, BW=399KiB/s (409kB/s)(2048KiB/5129msec) clat (msec): min=238, max=415, avg=327.03, stdev=125.01 lat (msec): min=238, max=415, avg=327.03, stdev=125.01 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1481, max= 1988, per=43.45%, avg=1734.50, stdev=358.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1996KiB/s (2044kB/s)(10.0MiB/5129msec); 0 zone resets clat (msec): min=134, max=977, avg=441.73, stdev=290.23 lat (msec): min=135, max=977, avg=441.81, stdev=290.23 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 201], | 30.00th=[ 222], 40.00th=[ 284], 50.00th=[ 300], 60.00th=[ 326], | 70.00th=[ 447], 80.00th=[ 760], 90.00th=[ 776], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1481, max= 4063, per=45.89%, avg=2565.00, stdev=1108.51, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 1000=25.00% cpu : usr=0.00%, sys=12.48%, ctx=201, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189288: Thu Apr 30 15:31:45 2026 read: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec) clat (usec): min=666, max=245867, avg=122903.67, stdev=113425.12 lat (usec): min=668, max=245869, avg=122905.03, stdev=113425.30 clat percentiles (usec): | 1.00th=[ 668], 5.00th=[ 668], 10.00th=[ 668], 20.00th=[ 2311], | 30.00th=[ 2311], 40.00th=[ 70779], 50.00th=[ 70779], 60.00th=[175113], | 70.00th=[242222], 80.00th=[242222], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 2035, max= 4096, per=84.08%, avg=3356.33, stdev=1147.03, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec); 0 zone resets clat (msec): min=196, max=776, avg=459.40, stdev=212.64 lat (msec): min=196, max=776, avg=459.48, stdev=212.66 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 506], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1471, max= 4096, per=42.86%, avg=2396.00, stdev=1161.76, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.03%, sys=12.24%, ctx=159, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189289: Thu Apr 30 15:31:45 2026 read: IOPS=0, BW=1010KiB/s (1035kB/s)(5120KiB/5068msec) clat (msec): min=2, max=391, avg=186.39, stdev=146.40 lat (msec): min=2, max=391, avg=186.39, stdev=146.40 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1988, max= 5796, per=97.49%, avg=3892.00, stdev=2692.66, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1414KiB/s (1448kB/s)(7168KiB/5068msec); 0 zone resets clat (msec): min=244, max=1112, avg=557.11, stdev=325.36 lat (msec): min=244, max=1112, avg=557.25, stdev=325.32 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 279], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 493], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 793], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1939, max= 4063, per=42.96%, avg=2401.40, stdev=929.72, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 4=8.33%, 100=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=9.81%, ctx=135, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3993KiB/s (4089kB/s), 399KiB/s-1645KiB/s (409kB/s-1685kB/s), io=20.0MiB (20.0MB), run=3734-5129msec WRITE: bw=5590KiB/s (5724kB/s), 1097KiB/s-1996KiB/s (1123kB/s-2044kB/s), io=28.0MiB (29.4MB), run=3734-5129msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=189297: Thu Apr 30 15:31:59 2026 read: IOPS=1, BW=4514KiB/s (4623kB/s)(12.0MiB/2722msec) clat (msec): min=528, max=1040, avg=852.70, stdev=282.36 lat (msec): min=528, max=1040, avg=852.70, stdev=282.36 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8078, max= 8094, per=100.00%, avg=8086.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.37%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189298: Thu Apr 30 15:31:59 2026 read: IOPS=0, BW=1104KiB/s (1131kB/s)(4096KiB/3710msec) clat (nsec): min=1171.0M, max=1171.0M, avg=1171007154.00, stdev= 0.00 lat (nsec): min=1171.0M, max=1171.0M, avg=1171008494.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2208KiB/s (2261kB/s)(8192KiB/3710msec); 0 zone resets clat (msec): min=717, max=1661, avg=1189.90, stdev=667.60 lat (msec): min=718, max=1662, avg=1190.38, stdev=667.40 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8078, max= 8078, per=91.46%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.75%, ctx=50, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189300: Thu Apr 30 15:31:59 2026 write: IOPS=0, BW=3663KiB/s (3750kB/s)(12.0MiB/3355msec); 0 zone resets clat (msec): min=393, max=1519, avg=1050.36, stdev=585.90 lat (msec): min=394, max=1519, avg=1050.83, stdev=585.91 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 393], | 30.00th=[ 393], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8078, max= 8159, per=91.92%, avg=8118.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.84%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189302: Thu Apr 30 15:31:59 2026 write: IOPS=1, BW=4237KiB/s (4339kB/s)(12.0MiB/2900msec); 0 zone resets clat (msec): min=471, max=1254, avg=887.18, stdev=393.68 lat (msec): min=473, max=1254, avg=887.95, stdev=392.93 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8143, max= 8159, per=92.29%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.14%, ctx=71, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4416KiB/s (4522kB/s), 1104KiB/s-4514KiB/s (1131kB/s-4623kB/s), io=16.0MiB (16.8MB), run=2722-3710msec WRITE: bw=8832KiB/s (9044kB/s), 2208KiB/s-4237KiB/s (2261kB/s-4339kB/s), io=32.0MiB (33.6MB), run=2900-3710msec rand-rw: (groupid=0, jobs=1): err= 0: pid=189299: Thu Apr 30 15:32:00 2026 read: IOPS=0, BW=4013KiB/s (4109kB/s)(12.0MiB/3062msec) clat (msec): min=939, max=987, avg=962.21, stdev=24.34 lat (msec): min=939, max=987, avg=962.21, stdev=24.34 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=13.95%, ctx=338, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189301: Thu Apr 30 15:32:00 2026 read: IOPS=0, BW=1257KiB/s (1287kB/s)(4096KiB/3258msec) clat (nsec): min=873919k, max=873919k, avg=873919427.00, stdev= 0.00 lat (nsec): min=873923k, max=873923k, avg=873922857.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2514KiB/s (2575kB/s)(8192KiB/3258msec); 0 zone resets clat (msec): min=601, max=1558, avg=1079.88, stdev=676.46 lat (msec): min=605, max=1558, avg=1082.20, stdev=673.83 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8110, max= 8110, per=91.38%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.25%, ctx=143, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189303: Thu Apr 30 15:32:00 2026 write: IOPS=0, BW=3328KiB/s (3408kB/s)(12.0MiB/3692msec); 0 zone resets clat (msec): min=287, max=1848, avg=1191.96, stdev=809.58 lat (msec): min=287, max=1848, avg=1192.61, stdev=809.58 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8110, max= 8159, per=91.66%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.55%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=189304: Thu Apr 30 15:32:00 2026 write: IOPS=1, BW=5354KiB/s (5483kB/s)(12.0MiB/2295msec); 0 zone resets clat (msec): min=315, max=1365, avg=696.70, stdev=580.80 lat (msec): min=316, max=1367, avg=697.49, stdev=581.70 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 6491, max= 8175, per=82.63%, avg=7333.00, stdev=1190.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.06%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5029KiB/s (5150kB/s), 1257KiB/s-4013KiB/s (1287kB/s-4109kB/s), io=16.0MiB (16.8MB), run=3062-3258msec WRITE: bw=8875KiB/s (9088kB/s), 2514KiB/s-5354KiB/s (2575kB/s-5483kB/s), io=32.0MiB (33.6MB), run=2295-3692msec