== sanity test 398b: DIO and buffer IO race ============== 23:13:28 (1788750808) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.02242 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179694: Sun Sep 6 23:15:59 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(5992KiB/129352msec) clat (usec): min=39, max=778045, avg=47400.43, stdev=36556.19 lat (usec): min=40, max=778048, avg=47409.87, stdev=36553.12 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12518], 10.00th=[ 17957], 20.00th=[ 23462], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 68682], 90.00th=[ 85459], 95.00th=[102237], | 99.00th=[152044], 99.50th=[181404], 99.90th=[316670], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 15, max= 95, per=25.11%, avg=46.21, stdev=16.90, samples=253 iops : min= 3, max= 23, avg=10.90, stdev= 4.28, samples=253 write: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6296KiB/129352msec); 0 zone resets clat (usec): min=903, max=258509, avg=36741.92, stdev=38329.63 lat (usec): min=904, max=258512, avg=36750.03, stdev=38333.67 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1582], 20.00th=[ 3916], | 30.00th=[ 7767], 40.00th=[ 16581], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 62653], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[166724], 99.50th=[185598], 99.90th=[250610], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 127, per=25.17%, avg=48.33, stdev=20.77, samples=254 iops : min= 1, max= 31, avg=11.44, stdev= 5.24, samples=254 lat (usec) : 50=0.10%, 100=1.43%, 250=0.23%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=5.96%, 4=4.46%, 10=6.80%, 20=8.89%, 50=39.88% lat (msec) : 100=25.85%, 250=5.99%, 500=0.16%, 1000=0.03% cpu : usr=0.09%, sys=4.83%, ctx=6729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Sun Sep 6 23:15:59 2026 read: IOPS=11, BW=46.3KiB/s (47.4kB/s)(5940KiB/128383msec) clat (usec): min=36, max=230220, avg=46939.20, stdev=29399.48 lat (usec): min=37, max=230221, avg=46941.15, stdev=29399.18 clat percentiles (usec): | 1.00th=[ 64], 5.00th=[ 15008], 10.00th=[ 19268], 20.00th=[ 24773], | 30.00th=[ 28705], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[145753], 99.50th=[173016], 99.90th=[212861], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 5, max= 101, per=24.95%, avg=45.91, stdev=18.09, samples=252 iops : min= 1, max= 25, avg=10.83, stdev= 4.58, samples=252 write: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6348KiB/128383msec); 0 zone resets clat (usec): min=761, max=854096, avg=36722.17, stdev=42703.23 lat (usec): min=762, max=854097, avg=36726.69, stdev=42703.32 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1352], 10.00th=[ 1598], 20.00th=[ 3589], | 30.00th=[ 7635], 40.00th=[ 16581], 50.00th=[ 26608], 60.00th=[ 35914], | 70.00th=[ 47449], 80.00th=[ 62129], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[162530], 99.50th=[185598], 99.90th=[274727], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 157, per=25.62%, avg=49.19, stdev=22.14, samples=252 iops : min= 1, max= 39, avg=11.65, stdev= 5.57, samples=252 lat (usec) : 50=0.10%, 100=1.33%, 250=0.10%, 1000=0.26% lat (msec) : 2=6.28%, 4=4.56%, 10=5.96%, 20=9.18%, 50=40.23% lat (msec) : 100=25.91%, 250=5.99%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.02%, ctx=6604, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Sun Sep 6 23:15:59 2026 read: IOPS=11, BW=46.4KiB/s (47.6kB/s)(6028KiB/129802msec) clat (usec): min=36, max=287456, avg=47509.08, stdev=31311.61 lat (usec): min=37, max=287458, avg=47523.79, stdev=31323.45 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 10028], 10.00th=[ 17171], 20.00th=[ 22938], | 30.00th=[ 28705], 40.00th=[ 34341], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[103285], | 99.00th=[154141], 99.50th=[181404], 99.90th=[214959], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 104, per=25.08%, avg=46.14, stdev=18.75, samples=253 iops : min= 1, max= 26, avg=10.89, stdev= 4.74, samples=253 write: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6260KiB/129802msec); 0 zone resets clat (usec): min=697, max=1008.2k, avg=36797.88, stdev=45645.97 lat (usec): min=698, max=1008.2k, avg=36801.99, stdev=45646.18 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1614], | 20.00th=[ 3621], 30.00th=[ 7504], 40.00th=[ 16909], | 50.00th=[ 26346], 60.00th=[ 34341], 70.00th=[ 46924], | 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[ 110625], | 99.00th=[ 175113], 99.50th=[ 217056], 99.90th=[ 261096], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 7, max= 111, per=25.17%, avg=48.33, stdev=20.97, samples=251 iops : min= 1, max= 27, avg=11.44, stdev= 5.32, samples=251 lat (usec) : 50=0.10%, 100=1.92%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.18%, 4=4.33%, 10=6.90%, 20=9.15%, 50=38.09% lat (msec) : 100=26.69%, 250=6.09%, 500=0.10%, 2000=0.03% cpu : usr=0.09%, sys=4.79%, ctx=6648, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Sun Sep 6 23:15:59 2026 read: IOPS=11, BW=46.4KiB/s (47.5kB/s)(6052KiB/130364msec) clat (usec): min=38, max=252856, avg=46365.84, stdev=30166.61 lat (usec): min=38, max=252857, avg=46368.23, stdev=30166.69 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 10159], 10.00th=[ 17695], 20.00th=[ 23462], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 54789], 80.00th=[ 65799], 90.00th=[ 85459], 95.00th=[101188], | 99.00th=[145753], 99.50th=[181404], 99.90th=[246416], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 95, per=25.17%, avg=46.32, stdev=17.11, samples=255 iops : min= 1, max= 23, avg=10.93, stdev= 4.32, samples=255 write: IOPS=11, BW=47.8KiB/s (48.0kB/s)(6236KiB/130364msec); 0 zone resets clat (usec): min=768, max=979564, avg=38281.76, stdev=44424.24 lat (usec): min=769, max=979567, avg=38284.59, stdev=44424.13 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1385], 10.00th=[ 1909], 20.00th=[ 4359], | 30.00th=[ 9241], 40.00th=[ 20317], 50.00th=[ 28967], 60.00th=[ 38011], | 70.00th=[ 50070], 80.00th=[ 63701], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[164627], 99.50th=[202376], 99.90th=[295699], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 103, per=24.86%, avg=47.73, stdev=19.62, samples=255 iops : min= 1, max= 25, avg=11.29, stdev= 4.94, samples=255 lat (usec) : 50=0.20%, 100=1.60%, 250=0.10%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=5.34%, 4=4.10%, 10=6.48%, 20=9.02%, 50=39.71% lat (msec) : 100=27.18%, 250=5.79%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=4.74%, ctx=6591, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=184KiB/s (189kB/s), 46.3KiB/s-46.4KiB/s (47.4kB/s-47.6kB/s), io=23.4MiB (24.6MB), run=128383-130364msec WRITE: bw=193KiB/s (197kB/s), 47.8KiB/s-49.4KiB/s (48.0kB/s-50.6kB/s), io=24.6MiB (25.7MB), run=128383-130364msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179690: Sun Sep 6 23:16:37 2026 read: IOPS=8, BW=35.7KiB/s (36.5kB/s)(5992KiB/168005msec) clat (msec): min=4, max=880, avg=44.72, stdev=45.42 lat (msec): min=4, max=880, avg=44.73, stdev=45.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 101], 95.00th=[ 138], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 284], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 131, per=25.82%, avg=36.66, stdev=24.16, samples=318 iops : min= 1, max= 32, avg= 8.49, stdev= 6.09, samples=318 write: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6296KiB/168005msec); 0 zone resets clat (msec): min=10, max=368, avg=63.87, stdev=45.56 lat (msec): min=10, max=368, avg=63.88, stdev=45.56 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 218], 99.50th=[ 284], 99.90th=[ 355], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 112, per=25.33%, avg=37.74, stdev=22.84, samples=325 iops : min= 1, max= 28, avg= 8.77, stdev= 5.76, samples=325 lat (msec) : 10=1.69%, 20=14.32%, 50=45.57%, 100=24.80%, 250=13.12% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.07%, sys=1.72%, ctx=4734, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179691: Sun Sep 6 23:16:37 2026 read: IOPS=8, BW=35.3KiB/s (36.1kB/s)(5940KiB/168477msec) clat (msec): min=5, max=961, avg=45.14, stdev=47.56 lat (msec): min=5, max=961, avg=45.14, stdev=47.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 67], 90.00th=[ 101], 95.00th=[ 127], | 99.00th=[ 205], 99.50th=[ 247], 99.90th=[ 380], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 131, per=25.19%, avg=35.77, stdev=25.02, samples=320 iops : min= 1, max= 32, avg= 8.28, stdev= 6.32, samples=320 write: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6348KiB/168477msec); 0 zone resets clat (msec): min=10, max=394, avg=63.59, stdev=46.55 lat (msec): min=10, max=394, avg=63.59, stdev=46.55 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 123], 95.00th=[ 155], | 99.00th=[ 239], 99.50th=[ 309], 99.90th=[ 388], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 116, per=24.93%, avg=37.14, stdev=22.88, samples=329 iops : min= 1, max= 29, avg= 8.62, stdev= 5.78, samples=329 lat (msec) : 10=1.82%, 20=14.78%, 50=45.83%, 100=23.70%, 250=13.18% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.08%, sys=1.75%, ctx=4856, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Sun Sep 6 23:16:37 2026 read: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6028KiB/168263msec) clat (msec): min=5, max=331, avg=43.02, stdev=39.56 lat (msec): min=5, max=331, avg=43.03, stdev=39.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 125], | 99.00th=[ 192], 99.50th=[ 239], 99.90th=[ 271], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 7, max= 144, per=25.32%, avg=35.95, stdev=23.61, samples=325 iops : min= 1, max= 36, avg= 8.33, stdev= 5.96, samples=325 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6260KiB/168263msec); 0 zone resets clat (msec): min=11, max=1033, avg=65.76, stdev=52.86 lat (msec): min=11, max=1033, avg=65.77, stdev=52.86 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 125], 95.00th=[ 159], | 99.00th=[ 236], 99.50th=[ 300], 99.90th=[ 447], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 116, per=24.85%, avg=37.03, stdev=23.03, samples=328 iops : min= 1, max= 29, avg= 8.59, stdev= 5.83, samples=328 lat (msec) : 10=1.89%, 20=14.88%, 50=44.30%, 100=25.94%, 250=12.40% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.07%, sys=1.77%, ctx=4707, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Sun Sep 6 23:16:37 2026 read: IOPS=8, BW=35.0KiB/s (36.8kB/s)(6052KiB/168279msec) clat (msec): min=5, max=379, avg=43.94, stdev=40.72 lat (msec): min=5, max=379, avg=43.94, stdev=40.72 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 100], 95.00th=[ 128], | 99.00th=[ 194], 99.50th=[ 243], 99.90th=[ 321], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7, max= 124, per=25.60%, avg=36.36, stdev=24.71, samples=323 iops : min= 1, max= 31, avg= 8.43, stdev= 6.23, samples=323 write: IOPS=9, BW=37.1KiB/s (37.9kB/s)(6236KiB/168279msec); 0 zone resets clat (msec): min=10, max=1037, avg=65.01, stdev=52.98 lat (msec): min=10, max=1037, avg=65.02, stdev=52.98 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 60], | 70.00th=[ 77], 80.00th=[ 96], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 247], 99.50th=[ 296], 99.90th=[ 443], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 116, per=24.76%, avg=36.90, stdev=23.21, samples=327 iops : min= 1, max= 29, avg= 8.57, stdev= 5.87, samples=327 lat (msec) : 10=1.86%, 20=14.26%, 50=46.09%, 100=23.54%, 250=13.74% lat (msec) : 500=0.49%, 2000=0.03% cpu : usr=0.06%, sys=1.73%, ctx=4851, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=143KiB/s (146kB/s), 35.3KiB/s-35.0KiB/s (36.1kB/s-36.8kB/s), io=23.4MiB (24.6MB), run=168005-168477msec WRITE: bw=149KiB/s (153kB/s), 37.1KiB/s-37.7KiB/s (37.9kB/s-38.6kB/s), io=24.6MiB (25.7MB), run=168005-168477msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179737: Sun Sep 6 23:17:23 2026 read: IOPS=10, BW=174KiB/s (179kB/s)(5920KiB/33928msec) clat (usec): min=48, max=184412, avg=51282.37, stdev=31980.15 lat (usec): min=49, max=184414, avg=51283.87, stdev=31980.13 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 81], 10.00th=[ 19268], 20.00th=[ 26084], | 30.00th=[ 33424], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 60031], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[113771], | 99.00th=[162530], 99.50th=[173016], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 351, per=25.06%, avg=176.70, stdev=63.75, samples=66 iops : min= 1, max= 21, avg=10.24, stdev= 4.00, samples=66 write: IOPS=11, BW=188KiB/s (192kB/s)(6368KiB/33928msec); 0 zone resets clat (usec): min=1217, max=202759, avg=37100.88, stdev=36796.48 lat (usec): min=1218, max=202763, avg=37103.70, stdev=36796.94 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1991], 10.00th=[ 2573], 20.00th=[ 5800], | 30.00th=[ 9634], 40.00th=[ 16909], 50.00th=[ 26346], 60.00th=[ 36963], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 88605], 95.00th=[114820], | 99.00th=[160433], 99.50th=[189793], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 31, max= 348, per=25.25%, avg=187.34, stdev=73.22, samples=67 iops : min= 1, max= 21, avg=10.93, stdev= 4.60, samples=67 lat (usec) : 50=0.26%, 100=2.47%, 250=0.13%, 500=0.13% lat (msec) : 2=2.86%, 4=4.95%, 10=7.81%, 20=8.85%, 50=37.89% lat (msec) : 100=27.21%, 250=7.42% cpu : usr=0.07%, sys=5.52%, ctx=1786, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179738: Sun Sep 6 23:17:23 2026 read: IOPS=10, BW=175KiB/s (179kB/s)(5744KiB/32863msec) clat (usec): min=45, max=227557, avg=50029.63, stdev=31820.07 lat (usec): min=46, max=227558, avg=50031.06, stdev=31820.12 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 80], 10.00th=[ 20055], 20.00th=[ 27919], | 30.00th=[ 33817], 40.00th=[ 39584], 50.00th=[ 44827], 60.00th=[ 49546], | 70.00th=[ 56361], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[114820], | 99.00th=[149947], 99.50th=[187696], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 352, per=24.68%, avg=174.02, stdev=73.96, samples=64 iops : min= 1, max= 22, avg=10.08, stdev= 4.69, samples=64 write: IOPS=12, BW=199KiB/s (204kB/s)(6544KiB/32863msec); 0 zone resets clat (usec): min=1178, max=232117, avg=35776.87, stdev=37673.77 lat (usec): min=1180, max=232120, avg=35782.58, stdev=37674.69 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1926], 10.00th=[ 2769], 20.00th=[ 5932], | 30.00th=[ 9765], 40.00th=[ 14222], 50.00th=[ 24511], 60.00th=[ 32375], | 70.00th=[ 44827], 80.00th=[ 58459], 90.00th=[ 84411], 95.00th=[111674], | 99.00th=[166724], 99.50th=[185598], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 479, per=26.62%, avg=197.50, stdev=86.22, samples=64 iops : min= 1, max= 29, avg=11.56, stdev= 5.39, samples=64 lat (usec) : 50=0.26%, 100=2.34%, 250=0.26% lat (msec) : 2=3.26%, 4=3.39%, 10=9.64%, 20=10.16%, 50=39.45% lat (msec) : 100=24.35%, 250=6.90% cpu : usr=0.09%, sys=5.04%, ctx=1641, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179739: Sun Sep 6 23:17:23 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(6256KiB/33404msec) clat (usec): min=39, max=305775, avg=47741.78, stdev=32465.98 lat (usec): min=39, max=305776, avg=47746.08, stdev=32462.99 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 94], 10.00th=[ 15926], 20.00th=[ 24511], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 57934], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[147850], 99.50th=[214959], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 59, max= 416, per=26.60%, avg=187.55, stdev=71.67, samples=66 iops : min= 3, max= 26, avg=10.92, stdev= 4.51, samples=66 write: IOPS=11, BW=181KiB/s (185kB/s)(6032KiB/33404msec); 0 zone resets clat (usec): min=1475, max=256479, avg=38395.15, stdev=37449.66 lat (usec): min=1478, max=256482, avg=38417.65, stdev=37432.26 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2073], 10.00th=[ 3884], 20.00th=[ 7832], | 30.00th=[ 12780], 40.00th=[ 19268], 50.00th=[ 27919], 60.00th=[ 39060], | 70.00th=[ 49546], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[108528], | 99.00th=[179307], 99.50th=[217056], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 62, max= 380, per=24.58%, avg=182.40, stdev=80.30, samples=65 iops : min= 3, max= 23, avg=10.60, stdev= 5.10, samples=65 lat (usec) : 50=0.39%, 100=2.34%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.21%, 4=3.39%, 10=7.29%, 20=10.03%, 50=39.84% lat (msec) : 100=28.52%, 250=5.34%, 500=0.26% cpu : usr=0.07%, sys=4.97%, ctx=1769, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Sun Sep 6 23:17:23 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31872msec) clat (usec): min=44, max=205005, avg=46776.63, stdev=31509.95 lat (usec): min=46, max=205006, avg=46778.78, stdev=31509.51 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 74], 10.00th=[ 14091], 20.00th=[ 25297], | 30.00th=[ 30278], 40.00th=[ 36439], 50.00th=[ 40633], 60.00th=[ 47973], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 85459], 95.00th=[103285], | 99.00th=[156238], 99.50th=[191890], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 414, per=26.77%, avg=188.70, stdev=74.72, samples=63 iops : min= 1, max= 25, avg=11.00, stdev= 4.69, samples=63 write: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31872msec); 0 zone resets clat (usec): min=1020, max=270479, avg=36204.98, stdev=38415.03 lat (usec): min=1020, max=270480, avg=36207.64, stdev=38415.04 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2212], 10.00th=[ 3359], 20.00th=[ 5735], | 30.00th=[ 8455], 40.00th=[ 16909], 50.00th=[ 24511], 60.00th=[ 35914], | 70.00th=[ 46924], 80.00th=[ 60031], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[200279], 99.50th=[219153], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 63, max= 384, per=26.46%, avg=196.32, stdev=74.70, samples=63 iops : min= 3, max= 24, avg=11.48, stdev= 4.75, samples=63 lat (usec) : 50=0.13%, 100=3.65%, 250=0.39%, 500=0.26%, 750=0.13% lat (msec) : 2=1.69%, 4=5.21%, 10=10.16%, 20=8.07%, 50=37.63% lat (msec) : 100=27.08%, 250=5.47%, 500=0.13% cpu : usr=0.11%, sys=5.61%, ctx=1726, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=706KiB/s (723kB/s), 174KiB/s-189KiB/s (179kB/s-194kB/s), io=23.4MiB (24.5MB), run=31872-33928msec WRITE: bw=743KiB/s (761kB/s), 181KiB/s-199KiB/s (185kB/s-204kB/s), io=24.6MiB (25.8MB), run=31872-33928msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Sun Sep 6 23:17:36 2026 read: IOPS=8, BW=128KiB/s (131kB/s)(5920KiB/46118msec) clat (msec): min=7, max=261, avg=48.62, stdev=36.95 lat (msec): min=7, max=261, avg=48.62, stdev=36.95 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 69], 90.00th=[ 96], 95.00th=[ 123], | 99.00th=[ 188], 99.50th=[ 211], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 30, max= 384, per=25.25%, avg=129.56, stdev=74.03, samples=90 iops : min= 1, max= 24, avg= 7.26, stdev= 4.71, samples=90 write: IOPS=8, BW=138KiB/s (141kB/s)(6368KiB/46118msec); 0 zone resets clat (msec): min=14, max=467, avg=70.47, stdev=46.34 lat (msec): min=14, max=467, avg=70.47, stdev=46.34 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 56], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 102], 90.00th=[ 132], 95.00th=[ 157], | 99.00th=[ 241], 99.50th=[ 257], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 27, max= 350, per=25.53%, avg=137.60, stdev=66.55, samples=91 iops : min= 1, max= 21, avg= 7.77, stdev= 4.17, samples=91 lat (msec) : 10=0.65%, 20=8.07%, 50=44.27%, 100=32.03%, 250=14.45% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.61%, ctx=1166, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179743: Sun Sep 6 23:17:36 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(5744KiB/46680msec) clat (msec): min=8, max=254, avg=49.64, stdev=40.33 lat (msec): min=8, max=254, avg=49.65, stdev=40.33 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 73], 90.00th=[ 105], 95.00th=[ 134], | 99.00th=[ 209], 99.50th=[ 222], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 28, max= 352, per=24.80%, avg=127.22, stdev=76.38, samples=89 iops : min= 1, max= 22, avg= 7.11, stdev= 4.83, samples=89 write: IOPS=8, BW=140KiB/s (144kB/s)(6544KiB/46680msec); 0 zone resets clat (msec): min=15, max=447, avg=70.33, stdev=50.94 lat (msec): min=15, max=447, avg=70.33, stdev=50.94 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 136], 95.00th=[ 167], | 99.00th=[ 262], 99.50th=[ 321], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 319, per=26.49%, avg=142.76, stdev=73.60, samples=90 iops : min= 1, max= 19, avg= 8.09, stdev= 4.64, samples=90 lat (msec) : 10=0.26%, 20=10.29%, 50=44.79%, 100=29.69%, 250=14.19% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.61%, ctx=1233, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179744: Sun Sep 6 23:17:36 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(6256KiB/45445msec) clat (msec): min=7, max=225, avg=48.27, stdev=38.54 lat (msec): min=7, max=225, avg=48.27, stdev=38.54 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 138], | 99.00th=[ 194], 99.50th=[ 213], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 27, max= 351, per=26.90%, avg=138.00, stdev=83.11, samples=89 iops : min= 1, max= 21, avg= 7.79, stdev= 5.25, samples=89 write: IOPS=8, BW=133KiB/s (136kB/s)(6032KiB/45445msec); 0 zone resets clat (msec): min=16, max=269, avg=70.31, stdev=41.09 lat (msec): min=16, max=269, avg=70.31, stdev=41.09 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 57], 60.00th=[ 73], | 70.00th=[ 85], 80.00th=[ 103], 90.00th=[ 130], 95.00th=[ 146], | 99.00th=[ 211], 99.50th=[ 232], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 347, per=24.54%, avg=132.28, stdev=64.74, samples=88 iops : min= 1, max= 21, avg= 7.43, stdev= 4.08, samples=88 lat (msec) : 10=0.91%, 20=6.90%, 50=48.18%, 100=28.26%, 250=15.63% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.89%, ctx=1205, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179745: Sun Sep 6 23:17:36 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(6032KiB/46014msec) clat (msec): min=6, max=316, avg=49.53, stdev=40.20 lat (msec): min=6, max=316, avg=49.53, stdev=40.20 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 66], 90.00th=[ 115], 95.00th=[ 140], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 318, per=25.87%, avg=132.73, stdev=72.10, samples=88 iops : min= 1, max= 19, avg= 7.45, stdev= 4.55, samples=88 write: IOPS=8, BW=136KiB/s (139kB/s)(6256KiB/46014msec); 0 zone resets clat (msec): min=14, max=324, avg=69.80, stdev=47.15 lat (msec): min=14, max=324, avg=69.80, stdev=47.15 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 56], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 94], 90.00th=[ 132], 95.00th=[ 159], | 99.00th=[ 262], 99.50th=[ 284], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 351, per=25.15%, avg=135.53, stdev=68.19, samples=90 iops : min= 1, max= 21, avg= 7.64, stdev= 4.31, samples=90 lat (msec) : 10=0.13%, 20=8.33%, 50=46.88%, 100=30.21%, 250=13.80% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.89%, ctx=1245, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=513KiB/s (525kB/s), 123KiB/s-138KiB/s (126kB/s-141kB/s), io=23.4MiB (24.5MB), run=45445-46680msec WRITE: bw=540KiB/s (553kB/s), 133KiB/s-140KiB/s (136kB/s-144kB/s), io=24.6MiB (25.8MB), run=45445-46680msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179758: Sun Sep 6 23:17:55 2026 read: IOPS=1, BW=1209KiB/s (1238kB/s)(7168KiB/5930msec) clat (usec): min=1748, max=2961.3k, avg=557378.82, stdev=1062560.36 lat (usec): min=1750, max=2961.3k, avg=557380.88, stdev=1062560.75 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1745], 10.00th=[ 1745], | 20.00th=[ 160433], 30.00th=[ 173016], 40.00th=[ 173016], | 50.00th=[ 181404], 60.00th=[ 191890], 70.00th=[ 191890], | 80.00th=[ 233833], 90.00th=[2969568], 95.00th=[2969568], | 99.00th=[2969568], 99.50th=[2969568], 99.90th=[2969568], | 99.95th=[2969568], 99.99th=[2969568] bw ( KiB/s): min= 2043, max= 4071, per=100.00%, avg=3055.00, stdev=1168.56, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=863KiB/s (884kB/s)(5120KiB/5930msec); 0 zone resets clat (msec): min=240, max=724, avg=377.58, stdev=200.01 lat (msec): min=240, max=724, avg=377.67, stdev=200.00 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 2035, max= 4023, per=65.01%, avg=2700.33, stdev=1145.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 250=58.33%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.32%, ctx=589, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179759: Sun Sep 6 23:17:55 2026 read: IOPS=0, BW=297KiB/s (304kB/s)(2048KiB/6901msec) clat (msec): min=202, max=206, avg=204.56, stdev= 3.06 lat (msec): min=202, max=206, avg=204.56, stdev= 3.06 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 203], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 207], 95.00th=[ 207], | 99.00th=[ 207], 99.50th=[ 207], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 1412, max= 2043, per=58.22%, avg=1727.50, stdev=446.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1484KiB/s (1519kB/s)(10.0MiB/6901msec); 0 zone resets clat (msec): min=137, max=3526, avg=643.67, stdev=1027.00 lat (msec): min=137, max=3526, avg=644.19, stdev=1027.01 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 203], | 30.00th=[ 222], 40.00th=[ 224], 50.00th=[ 275], 60.00th=[ 288], | 70.00th=[ 363], 80.00th=[ 472], 90.00th=[ 726], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 2011, max= 4071, per=71.73%, avg=2979.67, stdev=1054.33, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.01%, sys=7.59%, ctx=160, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179760: Sun Sep 6 23:17:55 2026 read: IOPS=0, BW=995KiB/s (1019kB/s)(6144KiB/6175msec) clat (usec): min=651, max=268597, avg=103276.75, stdev=118398.45 lat (usec): min=652, max=268599, avg=103277.96, stdev=118398.66 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 8979], 50.00th=[ 8979], 60.00th=[126354], | 70.00th=[214959], 80.00th=[214959], 90.00th=[270533], 95.00th=[270533], | 99.00th=[270533], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 1851, max= 4023, per=83.86%, avg=2488.00, stdev=1027.17, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=995KiB/s (1019kB/s)(6144KiB/6175msec); 0 zone resets clat (msec): min=104, max=3508, avg=910.17, stdev=1281.80 lat (msec): min=104, max=3508, avg=910.26, stdev=1281.82 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 472], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 2011, max= 3038, per=54.93%, avg=2281.75, stdev=504.35, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=25.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.05%, sys=6.33%, ctx=195, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179761: Sun Sep 6 23:17:55 2026 read: IOPS=0, BW=877KiB/s (898kB/s)(5120KiB/5837msec) clat (usec): min=600, max=221330, avg=107174.96, stdev=107918.61 lat (usec): min=602, max=221332, avg=107176.25, stdev=107918.79 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[102237], 60.00th=[102237], | 70.00th=[210764], 80.00th=[210764], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 3703, max= 4023, per=100.00%, avg=3863.00, stdev=226.27, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1228KiB/s (1258kB/s)(7168KiB/5837msec); 0 zone resets clat (msec): min=162, max=3230, avg=743.50, stdev=1104.20 lat (msec): min=162, max=3230, avg=743.59, stdev=1104.21 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 249], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 313], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 502], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 1501, max= 4071, per=55.26%, avg=2295.40, stdev=1015.62, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=7.08%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2968KiB/s (3039kB/s), 297KiB/s-1209KiB/s (304kB/s-1238kB/s), io=20.0MiB (20.0MB), run=5837-6901msec WRITE: bw=4155KiB/s (4254kB/s), 863KiB/s-1484KiB/s (884kB/s-1519kB/s), io=28.0MiB (29.4MB), run=5837-6901msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179763: Sun Sep 6 23:17:55 2026 read: IOPS=0, BW=956KiB/s (979kB/s)(7168KiB/7496msec) clat (msec): min=111, max=2825, avg=877.09, stdev=1037.66 lat (msec): min=111, max=2825, avg=877.09, stdev=1037.66 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 126], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 359], 60.00th=[ 802], | 70.00th=[ 802], 80.00th=[ 1737], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1858, max= 4031, per=92.63%, avg=2490.75, stdev=1030.31, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=683KiB/s (699kB/s)(5120KiB/7496msec); 0 zone resets clat (msec): min=160, max=403, avg=266.52, stdev=104.95 lat (msec): min=160, max=403, avg=266.63, stdev=104.95 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 1858, max= 4096, per=70.66%, avg=2660.33, stdev=1246.19, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=1.80%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179764: Sun Sep 6 23:17:55 2026 read: IOPS=0, BW=274KiB/s (281kB/s)(2048KiB/7469msec) clat (msec): min=160, max=480, avg=320.50, stdev=225.66 lat (msec): min=160, max=480, avg=320.50, stdev=225.66 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1458, max= 2043, per=65.10%, avg=1750.50, stdev=413.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1371KiB/s (1404kB/s)(10.0MiB/7469msec); 0 zone resets clat (msec): min=112, max=3849, avg=682.48, stdev=1133.91 lat (msec): min=112, max=3849, avg=682.63, stdev=1133.94 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 159], | 30.00th=[ 182], 40.00th=[ 190], 50.00th=[ 207], 60.00th=[ 257], | 70.00th=[ 498], 80.00th=[ 625], 90.00th=[ 751], 95.00th=[ 3842], | 99.00th=[ 3842], 99.50th=[ 3842], 99.90th=[ 3842], 99.95th=[ 3842], | 99.99th=[ 3842] bw ( KiB/s): min= 1835, max= 4087, per=71.05%, avg=2675.17, stdev=1086.85, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.38%, ctx=77, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179765: Sun Sep 6 23:17:55 2026 read: IOPS=0, BW=827KiB/s (847kB/s)(6144KiB/7430msec) clat (msec): min=116, max=508, avg=293.21, stdev=163.24 lat (msec): min=116, max=508, avg=293.21, stdev=163.24 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 194], 50.00th=[ 194], 60.00th=[ 334], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1858, max= 2048, per=74.22%, avg=1995.80, stdev=77.93, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=827KiB/s (847kB/s)(6144KiB/7430msec); 0 zone resets clat (msec): min=76, max=3740, avg=935.68, stdev=1386.06 lat (msec): min=76, max=3740, avg=937.31, stdev=1385.60 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 266], | 30.00th=[ 266], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 485], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1984, max= 4096, per=67.21%, avg=2530.50, stdev=1043.82, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=2.40%, ctx=103, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179766: Sun Sep 6 23:17:55 2026 read: IOPS=0, BW=672KiB/s (688kB/s)(5120KiB/7615msec) clat (msec): min=61, max=591, avg=317.87, stdev=221.49 lat (msec): min=61, max=591, avg=317.87, stdev=221.49 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 2015, max= 4096, per=100.00%, avg=2712.67, stdev=1198.02, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=0, BW=941KiB/s (964kB/s)(7168KiB/7615msec); 0 zone resets clat (msec): min=108, max=3635, avg=852.78, stdev=1244.58 lat (msec): min=108, max=3635, avg=852.89, stdev=1244.57 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 180], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 523], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 651], 90.00th=[ 3641], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 1858, max= 2048, per=52.84%, avg=1989.60, stdev=77.25, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=33.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.26%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2689KiB/s (2754kB/s), 274KiB/s-956KiB/s (281kB/s-979kB/s), io=20.0MiB (20.0MB), run=7430-7615msec WRITE: bw=3765KiB/s (3856kB/s), 683KiB/s-1371KiB/s (699kB/s-1404kB/s), io=28.0MiB (29.4MB), run=7430-7615msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179778: Sun Sep 6 23:18:12 2026 read: IOPS=1, BW=4396KiB/s (4502kB/s)(12.0MiB/2795msec) clat (msec): min=532, max=1344, avg=901.14, stdev=411.19 lat (msec): min=532, max=1344, avg=901.14, stdev=411.19 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7922, max= 7953, per=100.00%, avg=7937.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.22%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179779: Sun Sep 6 23:18:12 2026 read: IOPS=0, BW=1148KiB/s (1176kB/s)(4096KiB/3568msec) clat (nsec): min=1267.7M, max=1267.7M, avg=1267736726.00, stdev= 0.00 lat (nsec): min=1267.7M, max=1267.7M, avg=1267740030.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2296KiB/s (2351kB/s)(8192KiB/3568msec); 0 zone resets clat (msec): min=774, max=1519, avg=1147.01, stdev=527.19 lat (msec): min=778, max=1520, avg=1149.18, stdev=524.72 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 1519], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 8110, max= 8110, per=88.32%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.66%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179780: Sun Sep 6 23:18:12 2026 write: IOPS=0, BW=3481KiB/s (3565kB/s)(12.0MiB/3530msec); 0 zone resets clat (msec): min=224, max=2011, avg=1175.88, stdev=899.38 lat (msec): min=224, max=2012, avg=1176.37, stdev=899.32 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 8062, max= 8062, per=87.79%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.69%, ctx=26, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179781: Sun Sep 6 23:18:12 2026 write: IOPS=0, BW=3766KiB/s (3856kB/s)(12.0MiB/3263msec); 0 zone resets clat (msec): min=311, max=2187, avg=1084.65, stdev=980.48 lat (msec): min=312, max=2189, avg=1087.21, stdev=980.35 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 7846, max= 7846, per=85.44%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.00%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4592KiB/s (4702kB/s), 1148KiB/s-4396KiB/s (1176kB/s-4502kB/s), io=16.0MiB (16.8MB), run=2795-3568msec WRITE: bw=9184KiB/s (9404kB/s), 2296KiB/s-3766KiB/s (2351kB/s-3856kB/s), io=32.0MiB (33.6MB), run=3263-3568msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179773: Sun Sep 6 23:18:12 2026 read: IOPS=0, BW=3752KiB/s (3842kB/s)(12.0MiB/3275msec) clat (msec): min=911, max=1293, avg=1067.69, stdev=200.26 lat (msec): min=911, max=1293, avg=1067.69, stdev=200.26 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.09%, sys=9.77%, ctx=204, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179774: Sun Sep 6 23:18:12 2026 read: IOPS=0, BW=1182KiB/s (1210kB/s)(4096KiB/3465msec) clat (nsec): min=1134.2M, max=1134.2M, avg=1134208153.00, stdev= 0.00 lat (nsec): min=1134.2M, max=1134.2M, avg=1134212900.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2364KiB/s (2421kB/s)(8192KiB/3465msec); 0 zone resets clat (msec): min=736, max=1398, avg=1067.35, stdev=467.66 lat (msec): min=736, max=1398, avg=1067.66, stdev=467.79 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.04%, ctx=154, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179775: Sun Sep 6 23:18:12 2026 write: IOPS=0, BW=2689KiB/s (2753kB/s)(12.0MiB/4570msec); 0 zone resets clat (msec): min=183, max=3273, avg=1482.41, stdev=1602.86 lat (msec): min=184, max=3274, avg=1482.83, stdev=1602.72 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 986], | 70.00th=[ 3272], 80.00th=[ 3272], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.32%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179776: Sun Sep 6 23:18:12 2026 write: IOPS=0, BW=3338KiB/s (3418kB/s)(12.0MiB/3681msec); 0 zone resets clat (msec): min=477, max=2129, avg=1150.66, stdev=867.37 lat (msec): min=478, max=2130, avg=1151.24, stdev=867.63 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.61%, ctx=40, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4728KiB/s (4842kB/s), 1182KiB/s-3752KiB/s (1210kB/s-3842kB/s), io=16.0MiB (16.8MB), run=3275-3465msec WRITE: bw=7170KiB/s (7342kB/s), 2364KiB/s-3338KiB/s (2421kB/s-3418kB/s), io=32.0MiB (33.6MB), run=3465-4570msec