== sanity test 398b: DIO and buffer IO race ============== 05:10:33 (1779873033) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.40291 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148968: Wed May 27 05:12:49 2026 read: IOPS=12, BW=51.7KiB/s (52.0kB/s)(5992KiB/115875msec) clat (usec): min=28, max=170116, avg=35807.43, stdev=25722.04 lat (usec): min=28, max=170117, avg=35810.58, stdev=25720.32 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 71], 20.00th=[ 17171], | 30.00th=[ 22152], 40.00th=[ 26870], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[122160], 99.50th=[137364], 99.90th=[164627], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 7, max= 119, per=25.35%, avg=51.45, stdev=21.09, samples=228 iops : min= 1, max= 29, avg=12.24, stdev= 5.29, samples=228 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6296KiB/115875msec); 0 zone resets clat (usec): min=1052, max=893842, avg=39260.92, stdev=43522.52 lat (usec): min=1063, max=893843, avg=39263.94, stdev=43521.18 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1942], 20.00th=[ 4490], | 30.00th=[ 8586], 40.00th=[ 19530], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 52167], 80.00th=[ 66847], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[173016], 99.50th=[193987], 99.90th=[291505], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 119, per=25.49%, avg=54.29, stdev=21.18, samples=227 iops : min= 1, max= 29, avg=12.93, stdev= 5.33, samples=227 lat (usec) : 50=1.07%, 100=4.43%, 250=0.36%, 500=0.03%, 750=0.03% lat (msec) : 2=5.40%, 4=4.56%, 10=7.16%, 20=10.45%, 50=38.83% lat (msec) : 100=23.01%, 250=4.56%, 500=0.07%, 1000=0.03% cpu : usr=0.08%, sys=5.94%, ctx=6712, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148969: Wed May 27 05:12:49 2026 read: IOPS=12, BW=50.4KiB/s (51.6kB/s)(5940KiB/117970msec) clat (usec): min=31, max=240032, avg=37114.27, stdev=27977.16 lat (usec): min=31, max=240033, avg=37123.50, stdev=27982.68 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 89], 20.00th=[ 16909], | 30.00th=[ 21890], 40.00th=[ 26084], 50.00th=[ 31589], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 85459], | 99.00th=[133694], 99.50th=[152044], 99.90th=[185598], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 112, per=24.68%, avg=50.10, stdev=20.81, samples=231 iops : min= 1, max= 28, avg=11.89, stdev= 5.24, samples=231 write: IOPS=13, BW=53.8KiB/s (55.1kB/s)(6348KiB/117970msec); 0 zone resets clat (usec): min=1093, max=955448, avg=39315.82, stdev=46085.05 lat (usec): min=1094, max=955449, avg=39318.05, stdev=46084.74 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1893], 20.00th=[ 4359], | 30.00th=[ 8586], 40.00th=[ 18744], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 91751], 95.00th=[115868], | 99.00th=[168821], 99.50th=[200279], 99.90th=[484443], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 143, per=25.00%, avg=53.24, stdev=19.90, samples=232 iops : min= 1, max= 35, avg=12.69, stdev= 5.03, samples=232 lat (usec) : 50=1.17%, 100=3.87%, 250=0.62%, 500=0.20%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=5.66%, 4=4.20%, 10=7.03%, 20=10.51%, 50=38.09% lat (msec) : 100=22.98%, 250=5.40%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=6.00%, ctx=6652, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148971: Wed May 27 05:12:49 2026 read: IOPS=12, BW=51.4KiB/s (52.7kB/s)(6028KiB/117162msec) clat (usec): min=33, max=222245, avg=36214.56, stdev=27270.69 lat (usec): min=34, max=222246, avg=36216.85, stdev=27270.72 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 56], 10.00th=[ 84], 20.00th=[ 16319], | 30.00th=[ 22414], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 38536], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 81265], | 99.00th=[124257], 99.50th=[170918], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 7, max= 103, per=25.43%, avg=51.62, stdev=21.15, samples=228 iops : min= 1, max= 25, avg=12.27, stdev= 5.30, samples=228 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6260KiB/117162msec); 0 zone resets clat (usec): min=1059, max=1108.4k, avg=39690.46, stdev=47577.68 lat (usec): min=1059, max=1108.4k, avg=39692.00, stdev=47577.67 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 2147], | 20.00th=[ 4883], 30.00th=[ 9110], 40.00th=[ 20317], | 50.00th=[ 30802], 60.00th=[ 39060], 70.00th=[ 50594], | 80.00th=[ 63701], 90.00th=[ 88605], 95.00th=[ 114820], | 99.00th=[ 181404], 99.50th=[ 208667], 99.90th=[ 295699], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 7, max= 134, per=25.06%, avg=53.38, stdev=21.41, samples=229 iops : min= 1, max= 33, avg=12.71, stdev= 5.37, samples=229 lat (usec) : 50=0.91%, 100=4.33%, 250=0.39%, 500=0.13%, 750=0.03% lat (msec) : 2=4.82%, 4=4.10%, 10=7.49%, 20=11.04%, 50=39.19% lat (msec) : 100=22.75%, 250=4.72%, 500=0.07%, 2000=0.03% cpu : usr=0.07%, sys=5.84%, ctx=6567, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148973: Wed May 27 05:12:49 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6052KiB/117545msec) clat (usec): min=31, max=961564, avg=37404.34, stdev=37118.82 lat (usec): min=31, max=961565, avg=37405.54, stdev=37118.81 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 82], 20.00th=[ 16909], | 30.00th=[ 22152], 40.00th=[ 26346], 50.00th=[ 31327], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 55313], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[123208], 99.50th=[193987], 99.90th=[299893], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 111, per=25.45%, avg=51.67, stdev=20.77, samples=229 iops : min= 1, max= 27, avg=12.28, stdev= 5.24, samples=229 write: IOPS=13, BW=53.1KiB/s (54.3kB/s)(6236KiB/117545msec); 0 zone resets clat (usec): min=1064, max=299006, avg=38801.07, stdev=37185.44 lat (usec): min=1066, max=299008, avg=38802.49, stdev=37185.46 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1369], 10.00th=[ 2057], 20.00th=[ 5145], | 30.00th=[ 10421], 40.00th=[ 20317], 50.00th=[ 30278], 60.00th=[ 40109], | 70.00th=[ 52167], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[152044], 99.50th=[177210], 99.90th=[278922], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 7, max= 135, per=24.87%, avg=52.98, stdev=21.32, samples=230 iops : min= 1, max= 33, avg=12.62, stdev= 5.35, samples=230 lat (usec) : 50=1.11%, 100=4.26%, 250=0.23%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=5.05%, 4=3.55%, 10=6.93%, 20=11.75%, 50=38.25% lat (msec) : 100=23.76%, 250=4.75%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.90%, ctx=6701, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (208kB/s), 50.4KiB/s-51.7KiB/s (51.6kB/s-52.0kB/s), io=23.4MiB (24.6MB), run=115875-117970msec WRITE: bw=213KiB/s (218kB/s), 53.1KiB/s-54.3KiB/s (54.3kB/s-55.6kB/s), io=24.6MiB (25.7MB), run=115875-117970msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148966: Wed May 27 05:15:10 2026 read: IOPS=5, BW=23.3KiB/s (23.8kB/s)(5992KiB/257444msec) clat (msec): min=4, max=881, avg=32.62, stdev=40.77 lat (msec): min=4, max=881, avg=32.62, stdev=40.77 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 95], | 99.00th=[ 176], 99.50th=[ 275], 99.90th=[ 351], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 87, per=27.82%, avg=25.60, stdev=16.82, samples=453 iops : min= 1, max= 21, avg= 5.77, stdev= 4.25, samples=453 write: IOPS=6, BW=24.5KiB/s (25.0kB/s)(6296KiB/257444msec); 0 zone resets clat (msec): min=33, max=556, avg=132.23, stdev=58.57 lat (msec): min=33, max=556, avg=132.23, stdev=58.57 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 209], 95.00th=[ 245], | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 418], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 7, max= 55, per=24.86%, avg=24.11, stdev= 9.99, samples=504 iops : min= 1, max= 13, avg= 5.40, stdev= 2.54, samples=504 lat (msec) : 10=4.69%, 20=18.98%, 50=17.84%, 100=22.07%, 250=33.79% lat (msec) : 500=2.57%, 750=0.03%, 1000=0.03% cpu : usr=0.03%, sys=1.28%, ctx=5056, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148967: Wed May 27 05:15:10 2026 read: IOPS=5, BW=22.9KiB/s (23.5kB/s)(5940KiB/258829msec) clat (msec): min=5, max=942, avg=32.23, stdev=42.13 lat (msec): min=5, max=942, avg=32.23, stdev=42.13 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 66], 95.00th=[ 91], | 99.00th=[ 192], 99.50th=[ 264], 99.90th=[ 380], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 7, max= 95, per=27.64%, avg=25.43, stdev=17.30, samples=451 iops : min= 1, max= 23, avg= 5.73, stdev= 4.34, samples=451 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6348KiB/258829msec); 0 zone resets clat (msec): min=31, max=564, avg=132.67, stdev=59.26 lat (msec): min=31, max=564, avg=132.68, stdev=59.26 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 134], | 70.00th=[ 150], 80.00th=[ 169], 90.00th=[ 209], 95.00th=[ 241], | 99.00th=[ 351], 99.50th=[ 372], 99.90th=[ 489], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 56, per=24.88%, avg=24.13, stdev=10.19, samples=506 iops : min= 1, max= 14, avg= 5.41, stdev= 2.61, samples=506 lat (msec) : 10=4.52%, 20=18.95%, 50=18.36%, 100=21.39%, 250=34.44% lat (msec) : 500=2.28%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.25%, ctx=5080, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148970: Wed May 27 05:15:10 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6028KiB/257919msec) clat (msec): min=4, max=412, avg=33.49, stdev=35.79 lat (msec): min=4, max=412, avg=33.49, stdev=35.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 73], 95.00th=[ 95], | 99.00th=[ 178], 99.50th=[ 239], 99.90th=[ 355], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 128, per=27.85%, avg=25.62, stdev=17.78, samples=455 iops : min= 1, max= 32, avg= 5.78, stdev= 4.48, samples=455 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6260KiB/257919msec); 0 zone resets clat (msec): min=37, max=1080, avg=132.28, stdev=61.52 lat (msec): min=37, max=1080, avg=132.29, stdev=61.52 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 174], 90.00th=[ 205], 95.00th=[ 239], | 99.00th=[ 330], 99.50th=[ 363], 99.90th=[ 451], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 55, per=24.66%, avg=23.92, stdev=10.15, samples=505 iops : min= 1, max= 13, avg= 5.35, stdev= 2.58, samples=505 lat (msec) : 10=4.30%, 20=18.39%, 50=18.26%, 100=22.30%, 250=34.60% lat (msec) : 500=2.12%, 2000=0.03% cpu : usr=0.04%, sys=1.31%, ctx=5202, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148972: Wed May 27 05:15:10 2026 read: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6052KiB/256211msec) clat (msec): min=4, max=296, avg=32.44, stdev=32.19 lat (msec): min=4, max=296, avg=32.45, stdev=32.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 73], 95.00th=[ 96], | 99.00th=[ 155], 99.50th=[ 199], 99.90th=[ 279], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 103, per=28.05%, avg=25.81, stdev=17.20, samples=453 iops : min= 1, max= 25, avg= 5.83, stdev= 4.34, samples=453 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6236KiB/256211msec); 0 zone resets clat (msec): min=36, max=1166, avg=132.59, stdev=62.49 lat (msec): min=36, max=1166, avg=132.59, stdev=62.49 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 207], 95.00th=[ 241], | 99.00th=[ 330], 99.50th=[ 359], 99.90th=[ 401], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 63, per=24.67%, avg=23.93, stdev=10.30, samples=502 iops : min= 1, max= 15, avg= 5.35, stdev= 2.62, samples=502 lat (msec) : 10=4.26%, 20=18.49%, 50=18.65%, 100=21.91%, 250=34.54% lat (msec) : 500=2.12%, 2000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5178, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=92.8KiB/s (94.0kB/s), 22.9KiB/s-23.6KiB/s (23.5kB/s-24.2kB/s), io=23.4MiB (24.6MB), run=256211-258829msec WRITE: bw=97.1KiB/s (99.5kB/s), 24.3KiB/s-24.5KiB/s (24.9kB/s-25.1kB/s), io=24.6MiB (25.7MB), run=256211-258829msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149030: Wed May 27 05:15:47 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(5920KiB/26457msec) clat (usec): min=37, max=198028, avg=37236.90, stdev=30683.21 lat (usec): min=37, max=198030, avg=37237.96, stdev=30683.21 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 7308], | 30.00th=[ 22414], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 45876], 80.00th=[ 58459], 90.00th=[ 70779], 95.00th=[ 89654], | 99.00th=[141558], 99.50th=[183501], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 94, max= 445, per=24.89%, avg=224.52, stdev=71.20, samples=52 iops : min= 5, max= 27, avg=13.23, stdev= 4.44, samples=52 write: IOPS=15, BW=241KiB/s (246kB/s)(6368KiB/26457msec); 0 zone resets clat (usec): min=1564, max=260230, avg=31790.46, stdev=37066.01 lat (usec): min=1566, max=260231, avg=31793.92, stdev=37066.70 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1975], 10.00th=[ 2802], 20.00th=[ 5211], | 30.00th=[ 7832], 40.00th=[ 11338], 50.00th=[ 19006], 60.00th=[ 28181], | 70.00th=[ 38011], 80.00th=[ 50594], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[193987], 99.50th=[200279], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 63, max= 448, per=25.40%, avg=241.02, stdev=86.05, samples=52 iops : min= 3, max= 28, avg=14.29, stdev= 5.52, samples=52 lat (usec) : 50=1.17%, 100=7.42%, 250=0.26%, 750=0.26% lat (msec) : 2=2.73%, 4=4.82%, 10=12.89%, 20=9.90%, 50=37.50% lat (msec) : 100=18.49%, 250=4.43%, 500=0.13% cpu : usr=0.08%, sys=6.42%, ctx=1502, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149031: Wed May 27 05:15:47 2026 read: IOPS=13, BW=216KiB/s (222kB/s)(5744KiB/26539msec) clat (usec): min=29, max=316502, avg=39495.85, stdev=33313.66 lat (usec): min=30, max=316503, avg=39504.50, stdev=33311.15 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 62], 10.00th=[ 79], 20.00th=[ 19006], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 48497], 80.00th=[ 57410], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[166724], 99.50th=[287310], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 63, max= 380, per=23.75%, avg=214.21, stdev=80.26, samples=52 iops : min= 3, max= 23, avg=12.60, stdev= 5.08, samples=52 write: IOPS=15, BW=247KiB/s (252kB/s)(6544KiB/26539msec); 0 zone resets clat (usec): min=1455, max=231424, avg=30104.39, stdev=32152.14 lat (usec): min=1458, max=231426, avg=30107.51, stdev=32151.18 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2212], 10.00th=[ 3228], 20.00th=[ 5342], | 30.00th=[ 8094], 40.00th=[ 11731], 50.00th=[ 17957], 60.00th=[ 26346], | 70.00th=[ 37487], 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 89654], | 99.00th=[139461], 99.50th=[158335], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 96, max= 479, per=25.67%, avg=243.60, stdev=92.44, samples=52 iops : min= 6, max= 29, avg=14.44, stdev= 5.80, samples=52 lat (usec) : 50=0.52%, 100=5.47%, 250=0.26%, 500=0.39%, 750=0.13% lat (msec) : 2=1.95%, 4=5.73%, 10=11.85%, 20=11.33%, 50=37.89% lat (msec) : 100=20.83%, 250=3.39%, 500=0.26% cpu : usr=0.07%, sys=6.75%, ctx=1533, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149032: Wed May 27 05:15:47 2026 read: IOPS=15, BW=240KiB/s (246kB/s)(6256KiB/26027msec) clat (usec): min=36, max=230041, avg=35322.23, stdev=29834.44 lat (usec): min=36, max=230042, avg=35323.31, stdev=29834.44 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 143], | 30.00th=[ 21365], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 67634], 95.00th=[ 89654], | 99.00th=[131597], 99.50th=[168821], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 445, per=26.72%, avg=240.98, stdev=85.64, samples=51 iops : min= 3, max= 27, avg=14.27, stdev= 5.39, samples=51 write: IOPS=14, BW=232KiB/s (237kB/s)(6032KiB/26027msec); 0 zone resets clat (usec): min=1512, max=391666, avg=32295.93, stdev=37293.71 lat (usec): min=1512, max=391668, avg=32304.06, stdev=37294.72 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1958], 10.00th=[ 2999], 20.00th=[ 5211], | 30.00th=[ 9372], 40.00th=[ 14222], 50.00th=[ 19792], 60.00th=[ 27657], | 70.00th=[ 39060], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[137364], 99.50th=[233833], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 94, max= 413, per=24.25%, avg=230.18, stdev=85.84, samples=51 iops : min= 5, max= 25, avg=13.61, stdev= 5.40, samples=51 lat (usec) : 50=1.30%, 100=8.07%, 250=1.30%, 500=0.52% lat (msec) : 2=3.12%, 4=4.82%, 10=8.07%, 20=11.72%, 50=37.24% lat (msec) : 100=20.31%, 250=3.39%, 500=0.13% cpu : usr=0.05%, sys=6.67%, ctx=1471, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149033: Wed May 27 05:15:47 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(6032KiB/25571msec) clat (usec): min=35, max=180054, avg=38041.68, stdev=27473.92 lat (usec): min=36, max=180055, avg=38048.08, stdev=27470.93 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 16450], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 47449], 80.00th=[ 57410], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[113771], 99.50th=[158335], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 31, max= 436, per=25.83%, avg=233.02, stdev=84.93, samples=50 iops : min= 1, max= 27, avg=13.78, stdev= 5.34, samples=50 write: IOPS=15, BW=245KiB/s (251kB/s)(6256KiB/25571msec); 0 zone resets clat (usec): min=1513, max=215293, avg=28590.79, stdev=32472.39 lat (usec): min=1514, max=215295, avg=28592.73, stdev=32472.37 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1860], 10.00th=[ 2474], 20.00th=[ 4621], | 30.00th=[ 6587], 40.00th=[ 9503], 50.00th=[ 15795], 60.00th=[ 23725], | 70.00th=[ 35914], 80.00th=[ 51119], 90.00th=[ 70779], 95.00th=[ 90702], | 99.00th=[147850], 99.50th=[187696], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 94, max= 499, per=25.73%, avg=244.14, stdev=87.97, samples=50 iops : min= 5, max= 31, avg=14.50, stdev= 5.61, samples=50 lat (usec) : 50=1.04%, 100=6.12%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=4.04%, 4=4.43%, 10=12.63%, 20=10.29%, 50=36.59% lat (msec) : 100=20.18%, 250=3.65% cpu : usr=0.05%, sys=6.95%, ctx=1482, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=903KiB/s (924kB/s), 216KiB/s-240KiB/s (222kB/s-246kB/s), io=23.4MiB (24.5MB), run=25571-26539msec WRITE: bw=950KiB/s (972kB/s), 232KiB/s-247KiB/s (237kB/s-252kB/s), io=24.6MiB (25.8MB), run=25571-26539msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149025: Wed May 27 05:16:34 2026 read: IOPS=5, BW=80.3KiB/s (82.3kB/s)(5920KiB/73683msec) clat (msec): min=6, max=393, avg=39.89, stdev=35.66 lat (msec): min=6, max=393, avg=39.89, stdev=35.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 79], 95.00th=[ 108], | 99.00th=[ 157], 99.50th=[ 255], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 286, per=27.79%, avg=89.78, stdev=48.98, samples=129 iops : min= 1, max= 17, avg= 4.85, stdev= 3.10, samples=129 write: IOPS=5, BW=86.4KiB/s (88.5kB/s)(6368KiB/73683msec); 0 zone resets clat (msec): min=42, max=377, avg=147.79, stdev=60.46 lat (msec): min=42, max=377, avg=147.79, stdev=60.46 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 67], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 111], 40.00th=[ 126], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 169], 80.00th=[ 192], 90.00th=[ 226], 95.00th=[ 271], | 99.00th=[ 359], 99.50th=[ 376], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 190, per=25.44%, avg=86.49, stdev=32.73, samples=144 iops : min= 1, max= 11, avg= 4.64, stdev= 2.08, samples=144 lat (msec) : 10=2.21%, 20=9.38%, 50=25.91%, 100=19.01%, 250=39.71% lat (msec) : 500=3.78% cpu : usr=0.04%, sys=1.50%, ctx=1323, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149026: Wed May 27 05:16:34 2026 read: IOPS=4, BW=77.7KiB/s (79.6kB/s)(5744KiB/73929msec) clat (msec): min=7, max=394, avg=40.61, stdev=38.76 lat (msec): min=7, max=394, avg=40.61, stdev=38.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 118], | 99.00th=[ 165], 99.50th=[ 262], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 21, max= 350, per=28.30%, avg=91.40, stdev=61.48, samples=124 iops : min= 1, max= 21, avg= 4.96, stdev= 3.81, samples=124 write: IOPS=5, BW=88.5KiB/s (90.6kB/s)(6544KiB/73929msec); 0 zone resets clat (msec): min=38, max=416, avg=144.99, stdev=58.17 lat (msec): min=38, max=416, avg=144.99, stdev=58.17 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 67], 10.00th=[ 79], 20.00th=[ 96], | 30.00th=[ 110], 40.00th=[ 125], 50.00th=[ 142], 60.00th=[ 153], | 70.00th=[ 167], 80.00th=[ 186], 90.00th=[ 218], 95.00th=[ 253], | 99.00th=[ 321], 99.50th=[ 372], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 223, per=26.05%, avg=88.59, stdev=36.85, samples=145 iops : min= 1, max= 13, avg= 4.77, stdev= 2.33, samples=145 lat (msec) : 10=2.21%, 20=12.24%, 50=22.40%, 100=18.62%, 250=41.54% lat (msec) : 500=2.99% cpu : usr=0.03%, sys=1.38%, ctx=1353, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149027: Wed May 27 05:16:34 2026 read: IOPS=5, BW=88.2KiB/s (90.3kB/s)(6256KiB/70919msec) clat (msec): min=6, max=333, avg=36.02, stdev=32.48 lat (msec): min=6, max=333, avg=36.02, stdev=32.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 142], 99.50th=[ 275], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 319, per=29.56%, avg=95.47, stdev=65.55, samples=129 iops : min= 1, max= 19, avg= 5.22, stdev= 4.15, samples=129 write: IOPS=5, BW=85.1KiB/s (87.1kB/s)(6032KiB/70919msec); 0 zone resets clat (msec): min=41, max=395, avg=150.45, stdev=61.28 lat (msec): min=41, max=395, avg=150.45, stdev=61.28 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 80], 20.00th=[ 95], | 30.00th=[ 113], 40.00th=[ 126], 50.00th=[ 140], 60.00th=[ 157], | 70.00th=[ 178], 80.00th=[ 201], 90.00th=[ 234], 95.00th=[ 268], | 99.00th=[ 313], 99.50th=[ 380], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 31, max= 190, per=24.86%, avg=84.51, stdev=29.85, samples=140 iops : min= 1, max= 11, avg= 4.52, stdev= 1.92, samples=140 lat (msec) : 10=2.47%, 20=12.89%, 50=26.82%, 100=18.10%, 250=36.20% lat (msec) : 500=3.52% cpu : usr=0.03%, sys=1.38%, ctx=1358, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149028: Wed May 27 05:16:34 2026 read: IOPS=5, BW=82.6KiB/s (84.6kB/s)(6032KiB/73010msec) clat (msec): min=6, max=375, avg=39.55, stdev=35.07 lat (msec): min=6, max=375, avg=39.56, stdev=35.06 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 54], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 165], 99.50th=[ 180], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 285, per=28.61%, avg=92.40, stdev=59.01, samples=127 iops : min= 1, max= 17, avg= 5.03, stdev= 3.74, samples=127 write: IOPS=5, BW=85.7KiB/s (87.7kB/s)(6256KiB/73010msec); 0 zone resets clat (msec): min=46, max=390, avg=148.31, stdev=59.77 lat (msec): min=46, max=390, avg=148.32, stdev=59.76 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 125], 50.00th=[ 138], 60.00th=[ 155], | 70.00th=[ 174], 80.00th=[ 194], 90.00th=[ 228], 95.00th=[ 255], | 99.00th=[ 330], 99.50th=[ 355], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 191, per=25.24%, avg=85.83, stdev=33.19, samples=143 iops : min= 1, max= 11, avg= 4.60, stdev= 2.07, samples=143 lat (msec) : 10=0.78%, 20=13.15%, 50=23.83%, 100=19.79%, 250=39.32% lat (msec) : 500=3.12% cpu : usr=0.03%, sys=1.32%, ctx=1368, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=324KiB/s (332kB/s), 77.7KiB/s-88.2KiB/s (79.6kB/s-90.3kB/s), io=23.4MiB (24.5MB), run=70919-73929msec WRITE: bw=341KiB/s (349kB/s), 85.1KiB/s-88.5KiB/s (87.1kB/s-90.6kB/s), io=24.6MiB (25.8MB), run=70919-73929msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149053: Wed May 27 05:16:58 2026 read: IOPS=1, BW=1043KiB/s (1068kB/s)(7168KiB/6874msec) clat (usec): min=1693, max=3731.4k, avg=747504.34, stdev=1328204.39 lat (usec): min=1694, max=3731.4k, avg=747505.72, stdev=1328204.29 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1696], 10.00th=[ 1696], | 20.00th=[ 147850], 30.00th=[ 173016], 40.00th=[ 173016], | 50.00th=[ 227541], 60.00th=[ 379585], 70.00th=[ 379585], | 80.00th=[ 566232], 90.00th=[3741320], 95.00th=[3741320], | 99.00th=[3741320], 99.50th=[3741320], 99.90th=[3741320], | 99.95th=[3741320], 99.99th=[3741320] bw ( KiB/s): min= 2011, max= 4096, per=100.00%, avg=3016.25, stdev=1144.75, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=745KiB/s (763kB/s)(5120KiB/6874msec); 0 zone resets clat (msec): min=188, max=468, avg=289.34, stdev=116.40 lat (msec): min=188, max=468, avg=289.40, stdev=116.38 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 1957, max= 3390, per=72.93%, avg=2452.67, stdev=812.20, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=50.00%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.06%, ctx=721, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149054: Wed May 27 05:16:58 2026 read: IOPS=0, BW=240KiB/s (246kB/s)(2048KiB/8525msec) clat (msec): min=318, max=416, avg=367.28, stdev=69.10 lat (msec): min=318, max=416, avg=367.29, stdev=69.10 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1756, max= 2015, per=78.50%, avg=1885.50, stdev=183.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1201KiB/s (1230kB/s)(10.0MiB/8525msec); 0 zone resets clat (msec): min=89, max=3996, avg=766.04, stdev=1158.99 lat (msec): min=89, max=3996, avg=766.13, stdev=1158.97 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 194], | 30.00th=[ 257], 40.00th=[ 326], 50.00th=[ 359], 60.00th=[ 414], | 70.00th=[ 498], 80.00th=[ 609], 90.00th=[ 927], 95.00th=[ 4010], | 99.00th=[ 4010], 99.50th=[ 4010], 99.90th=[ 4010], 99.95th=[ 4010], | 99.99th=[ 4010] bw ( KiB/s): min= 1695, max= 6144, per=88.18%, avg=2965.50, stdev=1751.74, samples=6 iops : min= 1, max= 6, avg= 2.33, stdev= 1.97, samples=6 lat (msec) : 100=8.33%, 250=8.33%, 500=58.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.92%, ctx=128, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149055: Wed May 27 05:16:58 2026 read: IOPS=0, BW=855KiB/s (876kB/s)(6144KiB/7184msec) clat (usec): min=545, max=427055, avg=208154.42, stdev=139345.02 lat (usec): min=546, max=427056, avg=208173.37, stdev=139347.20 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[143655], | 30.00th=[143655], 40.00th=[204473], 50.00th=[204473], 60.00th=[221250], | 70.00th=[250610], 80.00th=[250610], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 2011, max= 3915, per=100.00%, avg=3105.33, stdev=983.40, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=855KiB/s (876kB/s)(6144KiB/7184msec); 0 zone resets clat (msec): min=230, max=3904, avg=950.93, stdev=1449.90 lat (msec): min=230, max=3904, avg=951.00, stdev=1449.90 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 380], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 1297, max= 2043, per=54.60%, avg=1836.33, stdev=293.45, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=5.64%, ctx=154, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149056: Wed May 27 05:16:58 2026 read: IOPS=0, BW=685KiB/s (701kB/s)(5120KiB/7478msec) clat (msec): min=2, max=380, avg=161.44, stdev=164.29 lat (msec): min=2, max=380, avg=161.44, stdev=164.29 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 161], 60.00th=[ 161], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 2011, max= 6047, per=100.00%, avg=4029.00, stdev=2853.88, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=959KiB/s (982kB/s)(7168KiB/7478msec); 0 zone resets clat (msec): min=114, max=3931, avg=939.68, stdev=1348.76 lat (msec): min=114, max=3931, avg=939.75, stdev=1348.78 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 447], 60.00th=[ 735], | 70.00th=[ 735], 80.00th=[ 877], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 1957, max= 4039, per=71.95%, avg=2419.60, stdev=906.00, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 4=16.67%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=5.50%, ctx=138, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2402KiB/s (2460kB/s), 240KiB/s-1043KiB/s (246kB/s-1068kB/s), io=20.0MiB (20.0MB), run=6874-8525msec WRITE: bw=3363KiB/s (3444kB/s), 745KiB/s-1201KiB/s (763kB/s-1230kB/s), io=28.0MiB (29.4MB), run=6874-8525msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149058: Wed May 27 05:16:58 2026 read: IOPS=0, BW=867KiB/s (888kB/s)(7168KiB/8268msec) clat (msec): min=93, max=3333, avg=924.81, stdev=1220.58 lat (msec): min=93, max=3333, avg=924.82, stdev=1220.58 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 121], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 201], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 1754], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 2039, max= 4039, per=100.00%, avg=2443.40, stdev=891.98, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=0, BW=619KiB/s (634kB/s)(5120KiB/8268msec); 0 zone resets clat (msec): min=148, max=542, avg=334.31, stdev=161.24 lat (msec): min=148, max=542, avg=334.42, stdev=161.26 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2023, max= 4096, per=100.00%, avg=3396.67, stdev=1189.70, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.78%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149059: Wed May 27 05:16:58 2026 read: IOPS=0, BW=237KiB/s (243kB/s)(2048KiB/8641msec) clat (msec): min=157, max=168, avg=162.84, stdev= 7.97 lat (msec): min=157, max=168, avg=162.84, stdev= 7.97 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 169], | 70.00th=[ 169], 80.00th=[ 169], 90.00th=[ 169], 95.00th=[ 169], | 99.00th=[ 169], 99.50th=[ 169], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 1595, max= 2039, per=76.67%, avg=1817.00, stdev=313.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1185KiB/s (1213kB/s)(10.0MiB/8641msec); 0 zone resets clat (msec): min=227, max=3632, avg=817.98, stdev=1024.04 lat (msec): min=227, max=3632, avg=818.07, stdev=1024.04 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 243], | 30.00th=[ 288], 40.00th=[ 300], 50.00th=[ 309], 60.00th=[ 693], | 70.00th=[ 751], 80.00th=[ 869], 90.00th=[ 877], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1878, max= 4096, per=69.21%, avg=2296.29, stdev=795.61, samples=7 iops : min= 1, max= 4, avg= 1.43, stdev= 1.13, samples=7 lat (msec) : 250=33.33%, 500=25.00%, 750=8.33%, 1000=25.00%, >=2000=8.33% cpu : usr=0.01%, sys=2.77%, ctx=111, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149060: Wed May 27 05:16:58 2026 read: IOPS=0, BW=788KiB/s (807kB/s)(6144KiB/7800msec) clat (msec): min=86, max=449, avg=200.70, stdev=134.01 lat (msec): min=86, max=449, avg=200.71, stdev=134.01 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 126], | 30.00th=[ 126], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 150], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2043, max= 4079, per=100.00%, avg=3387.00, stdev=1164.11, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=788KiB/s (807kB/s)(6144KiB/7800msec); 0 zone resets clat (msec): min=256, max=4359, avg=1072.99, stdev=1614.74 lat (msec): min=257, max=4359, avg=1073.15, stdev=1614.69 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 542], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 1530, max= 2043, per=58.48%, avg=1940.33, stdev=202.24, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.05%, ctx=66, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149061: Wed May 27 05:16:58 2026 read: IOPS=0, BW=625KiB/s (640kB/s)(5120KiB/8196msec) clat (msec): min=75, max=663, avg=327.09, stdev=250.05 lat (msec): min=75, max=663, avg=327.10, stdev=250.05 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 4047, max= 4087, per=100.00%, avg=4067.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=875KiB/s (896kB/s)(7168KiB/8196msec); 0 zone resets clat (msec): min=259, max=3598, avg=914.82, stdev=1197.50 lat (msec): min=259, max=3598, avg=915.25, stdev=1197.32 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 330], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 456], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 835], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 1597, max= 2035, per=57.32%, avg=1901.80, stdev=181.01, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.65%, ctx=98, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2370KiB/s (2427kB/s), 237KiB/s-867KiB/s (243kB/s-888kB/s), io=20.0MiB (20.0MB), run=7800-8641msec WRITE: bw=3318KiB/s (3398kB/s), 619KiB/s-1185KiB/s (634kB/s-1213kB/s), io=28.0MiB (29.4MB), run=7800-8641msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=149068: Wed May 27 05:17:11 2026 read: IOPS=0, BW=3873KiB/s (3966kB/s)(12.0MiB/3173msec) clat (msec): min=555, max=1689, avg=1057.19, stdev=578.33 lat (msec): min=555, max=1689, avg=1057.19, stdev=578.33 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 7984, max= 8126, per=100.00%, avg=8055.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.52%, ctx=28, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149069: Wed May 27 05:17:11 2026 read: IOPS=0, BW=1144KiB/s (1171kB/s)(4096KiB/3581msec) clat (nsec): min=238154k, max=238154k, avg=238154288.00, stdev= 0.00 lat (nsec): min=238155k, max=238155k, avg=238155404.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2288KiB/s (2343kB/s)(8192KiB/3581msec); 0 zone resets clat (msec): min=1188, max=2142, avg=1665.18, stdev=674.54 lat (msec): min=1188, max=2142, avg=1665.62, stdev=674.51 clat percentiles (msec): | 1.00th=[ 1183], 5.00th=[ 1183], 10.00th=[ 1183], 20.00th=[ 1183], | 30.00th=[ 1183], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 2140], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 7742, max= 7742, per=84.61%, avg=7742.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=3.44%, ctx=63, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149070: Wed May 27 05:17:11 2026 write: IOPS=1, BW=5378KiB/s (5507kB/s)(12.0MiB/2285msec); 0 zone resets clat (msec): min=593, max=812, avg=728.62, stdev=118.03 lat (msec): min=594, max=813, avg=729.06, stdev=117.95 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7742, max= 8175, per=86.98%, avg=7958.50, stdev=306.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.91%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149071: Wed May 27 05:17:11 2026 write: IOPS=1, BW=4422KiB/s (4528kB/s)(12.0MiB/2779msec); 0 zone resets clat (msec): min=539, max=1186, avg=925.27, stdev=341.12 lat (msec): min=539, max=1186, avg=925.98, stdev=341.37 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 5927, max= 8126, per=76.79%, avg=7026.50, stdev=1554.93, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.07%, sys=4.50%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4575KiB/s (4685kB/s), 1144KiB/s-3873KiB/s (1171kB/s-3966kB/s), io=16.0MiB (16.8MB), run=3173-3581msec WRITE: bw=9151KiB/s (9370kB/s), 2288KiB/s-5378KiB/s (2343kB/s-5507kB/s), io=32.0MiB (33.6MB), run=2285-3581msec rand-rw: (groupid=0, jobs=1): err= 0: pid=149073: Wed May 27 05:17:12 2026 read: IOPS=1, BW=4712KiB/s (4825kB/s)(12.0MiB/2608msec) clat (msec): min=682, max=1121, avg=867.23, stdev=227.70 lat (msec): min=682, max=1121, avg=867.24, stdev=227.70 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8110, max= 8159, per=100.00%, avg=8134.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=15.46%, ctx=309, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149074: Wed May 27 05:17:12 2026 read: IOPS=0, BW=960KiB/s (983kB/s)(4096KiB/4266msec) clat (nsec): min=1109.2M, max=1109.2M, avg=1109202342.00, stdev= 0.00 lat (nsec): min=1109.2M, max=1109.2M, avg=1109204219.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1920KiB/s (1966kB/s)(8192KiB/4266msec); 0 zone resets clat (msec): min=582, max=2562, avg=1572.20, stdev=1400.26 lat (msec): min=584, max=2568, avg=1576.82, stdev=1402.79 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 2567], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.07%, sys=3.21%, ctx=110, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149075: Wed May 27 05:17:12 2026 write: IOPS=0, BW=2950KiB/s (3020kB/s)(12.0MiB/4166msec); 0 zone resets clat (msec): min=567, max=1832, avg=1379.76, stdev=704.73 lat (msec): min=568, max=1835, avg=1381.03, stdev=705.55 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 1737], 50.00th=[ 1737], 60.00th=[ 1737], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 8000, max= 8159, per=100.00%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.60%, ctx=41, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=149076: Wed May 27 05:17:12 2026 write: IOPS=0, BW=4009KiB/s (4105kB/s)(12.0MiB/3065msec); 0 zone resets clat (msec): min=446, max=1569, avg=1020.97, stdev=562.03 lat (msec): min=446, max=1570, avg=1021.41, stdev=562.10 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.82%, ctx=44, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3841KiB/s (3933kB/s), 960KiB/s-4712KiB/s (983kB/s-4825kB/s), io=16.0MiB (16.8MB), run=2608-4266msec WRITE: bw=7681KiB/s (7866kB/s), 1920KiB/s-4009KiB/s (1966kB/s-4105kB/s), io=32.0MiB (33.6MB), run=3065-4266msec