== sanity test 398b: DIO and buffer IO race ============== 11:46:14 (1789055174) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.51768 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179868: Thu Sep 10 11:48:34 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(5992KiB/118708msec) clat (usec): min=37, max=467371, avg=43686.94, stdev=29628.80 lat (usec): min=37, max=467371, avg=43689.02, stdev=29628.22 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12518], 10.00th=[ 17695], 20.00th=[ 22414], | 30.00th=[ 26870], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[139461], 99.50th=[158335], 99.90th=[267387], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 118, per=25.44%, avg=49.87, stdev=18.13, samples=234 iops : min= 1, max= 29, avg=11.81, stdev= 4.54, samples=234 write: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6296KiB/118708msec); 0 zone resets clat (usec): min=1046, max=267558, avg=33729.29, stdev=36184.78 lat (usec): min=1046, max=267559, avg=33732.03, stdev=36184.63 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1221], 10.00th=[ 1500], 20.00th=[ 3589], | 30.00th=[ 6718], 40.00th=[ 14615], 50.00th=[ 23725], 60.00th=[ 31327], | 70.00th=[ 41681], 80.00th=[ 57410], 90.00th=[ 84411], 95.00th=[111674], | 99.00th=[147850], 99.50th=[185598], 99.90th=[258999], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 14, max= 181, per=25.68%, avg=52.91, stdev=21.87, samples=232 iops : min= 3, max= 45, avg=12.57, stdev= 5.52, samples=232 lat (usec) : 50=0.16%, 100=1.30%, 250=0.13%, 500=0.07%, 750=0.07% lat (msec) : 2=6.64%, 4=4.36%, 10=7.26%, 20=10.58%, 50=40.92% lat (msec) : 100=23.21%, 250=5.14%, 500=0.16% cpu : usr=0.09%, sys=5.08%, ctx=6437, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179869: Thu Sep 10 11:48:34 2026 read: IOPS=12, BW=48.9KiB/s (50.1kB/s)(5940KiB/121427msec) clat (usec): min=46, max=564170, avg=44665.76, stdev=30857.47 lat (usec): min=47, max=564171, avg=44668.67, stdev=30858.25 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12256], 10.00th=[ 16909], 20.00th=[ 22938], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[143655], 99.50th=[166724], 99.90th=[291505], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 95, per=24.76%, avg=48.54, stdev=17.98, samples=239 iops : min= 1, max= 23, avg=11.47, stdev= 4.50, samples=239 write: IOPS=13, BW=52.3KiB/s (53.5kB/s)(6348KiB/121427msec); 0 zone resets clat (usec): min=911, max=241089, avg=34616.68, stdev=35997.11 lat (usec): min=913, max=241091, avg=34618.31, stdev=35997.13 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1696], 20.00th=[ 3621], | 30.00th=[ 6849], 40.00th=[ 14484], 50.00th=[ 25035], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[156238], 99.50th=[187696], 99.90th=[225444], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 126, per=25.23%, avg=51.98, stdev=20.91, samples=238 iops : min= 1, max= 31, avg=12.34, stdev= 5.24, samples=238 lat (usec) : 50=0.13%, 100=1.33%, 250=0.23%, 500=0.03%, 1000=0.10% lat (msec) : 2=6.38%, 4=4.62%, 10=7.62%, 20=9.64%, 50=40.01% lat (msec) : 100=25.20%, 250=4.65%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.19%, ctx=6547, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179870: Thu Sep 10 11:48:34 2026 read: IOPS=12, BW=49.4KiB/s (50.6kB/s)(6028KiB/122016msec) clat (usec): min=45, max=295622, avg=44216.54, stdev=30043.48 lat (usec): min=46, max=295623, avg=44222.84, stdev=30040.63 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9372], 10.00th=[ 15795], 20.00th=[ 21627], | 30.00th=[ 27132], 40.00th=[ 33162], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[145753], 99.50th=[179307], 99.90th=[291505], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 7, max= 134, per=24.89%, avg=48.78, stdev=21.19, samples=240 iops : min= 1, max= 33, avg=11.53, stdev= 5.31, samples=240 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6260KiB/122016msec); 0 zone resets clat (usec): min=1007, max=639207, avg=35294.79, stdev=38632.20 lat (usec): min=1008, max=639209, avg=35298.81, stdev=38632.46 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1270], 10.00th=[ 1811], 20.00th=[ 3982], | 30.00th=[ 7570], 40.00th=[ 16712], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[107480], | 99.00th=[141558], 99.50th=[173016], 99.90th=[308282], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 15, max= 126, per=24.71%, avg=50.90, stdev=21.04, samples=239 iops : min= 3, max= 31, avg=12.06, stdev= 5.28, samples=239 lat (usec) : 50=0.16%, 100=1.46%, 250=0.26%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.47%, 4=4.92%, 10=7.62%, 20=10.64%, 50=39.58% lat (msec) : 100=24.67%, 250=4.98%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.04%, ctx=6461, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179871: Thu Sep 10 11:48:34 2026 read: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6052KiB/120485msec) clat (usec): min=36, max=366555, avg=43201.86, stdev=28779.80 lat (usec): min=37, max=366556, avg=43203.43, stdev=28779.86 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 85], 10.00th=[ 15664], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[123208], 99.50th=[154141], 99.90th=[217056], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 127, per=25.43%, avg=49.85, stdev=19.95, samples=237 iops : min= 1, max= 31, avg=11.80, stdev= 4.99, samples=237 write: IOPS=12, BW=51.8KiB/s (52.0kB/s)(6236KiB/120485msec); 0 zone resets clat (usec): min=952, max=630200, avg=35226.19, stdev=38890.30 lat (usec): min=953, max=630204, avg=35236.23, stdev=38886.83 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1254], 10.00th=[ 1614], 20.00th=[ 3589], | 30.00th=[ 7111], 40.00th=[ 15795], 50.00th=[ 25035], 60.00th=[ 33162], | 70.00th=[ 44827], 80.00th=[ 62653], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[145753], 99.50th=[181404], 99.90th=[278922], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 134, per=24.92%, avg=51.33, stdev=23.84, samples=237 iops : min= 1, max= 33, avg=12.17, stdev= 5.97, samples=237 lat (usec) : 50=0.39%, 100=2.12%, 250=0.10%, 500=0.10%, 750=0.10% lat (usec) : 1000=0.03% lat (msec) : 2=6.64%, 4=4.46%, 10=6.67%, 20=10.48%, 50=39.49% lat (msec) : 100=24.19%, 250=5.14%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.23%, ctx=6427, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=197KiB/s (202kB/s), 48.9KiB/s-50.5KiB/s (50.1kB/s-51.7kB/s), io=23.4MiB (24.6MB), run=118708-122016msec WRITE: bw=206KiB/s (211kB/s), 51.3KiB/s-53.0KiB/s (52.5kB/s-54.3kB/s), io=24.6MiB (25.7MB), run=118708-122016msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179863: Thu Sep 10 11:49:15 2026 read: IOPS=9, BW=36.6KiB/s (37.5kB/s)(5992KiB/163809msec) clat (msec): min=5, max=987, avg=43.34, stdev=44.93 lat (msec): min=5, max=987, avg=43.34, stdev=44.93 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 121], | 99.00th=[ 190], 99.50th=[ 222], 99.90th=[ 321], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 143, per=25.22%, avg=36.82, stdev=24.81, samples=317 iops : min= 1, max= 35, avg= 8.53, stdev= 6.24, samples=317 write: IOPS=9, BW=38.4KiB/s (39.4kB/s)(6296KiB/163809msec); 0 zone resets clat (msec): min=11, max=366, avg=62.48, stdev=43.05 lat (msec): min=11, max=366, avg=62.49, stdev=43.05 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 122], 95.00th=[ 148], | 99.00th=[ 220], 99.50th=[ 247], 99.90th=[ 330], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 111, per=25.03%, avg=38.29, stdev=22.69, samples=320 iops : min= 1, max= 27, avg= 8.90, stdev= 5.69, samples=320 lat (msec) : 10=1.73%, 20=14.75%, 50=45.74%, 100=25.62%, 250=11.85% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=1.86%, ctx=4880, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179864: Thu Sep 10 11:49:15 2026 read: IOPS=9, BW=36.2KiB/s (37.1kB/s)(5940KiB/164005msec) clat (msec): min=4, max=1116, avg=43.50, stdev=49.12 lat (msec): min=4, max=1116, avg=43.51, stdev=49.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 131], | 99.00th=[ 203], 99.50th=[ 243], 99.90th=[ 326], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 127, per=25.25%, avg=36.87, stdev=25.31, samples=313 iops : min= 1, max= 31, avg= 8.54, stdev= 6.36, samples=313 write: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6348KiB/164005msec); 0 zone resets clat (msec): min=12, max=301, avg=62.34, stdev=43.78 lat (msec): min=12, max=301, avg=62.34, stdev=43.78 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 92], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 247], 99.90th=[ 292], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 111, per=24.97%, avg=38.20, stdev=24.24, samples=322 iops : min= 1, max= 27, avg= 8.88, stdev= 6.10, samples=322 lat (msec) : 10=2.51%, 20=14.97%, 50=45.83%, 100=23.50%, 250=12.76% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=1.79%, ctx=4862, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179865: Thu Sep 10 11:49:15 2026 read: IOPS=9, BW=37.0KiB/s (37.9kB/s)(6028KiB/162779msec) clat (msec): min=6, max=288, avg=42.41, stdev=38.48 lat (msec): min=6, max=288, avg=42.41, stdev=38.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 126], | 99.00th=[ 194], 99.50th=[ 222], 99.90th=[ 275], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 133, per=25.43%, avg=37.13, stdev=25.23, samples=316 iops : min= 1, max= 33, avg= 8.61, stdev= 6.33, samples=316 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6260KiB/162779msec); 0 zone resets clat (msec): min=11, max=1168, avg=62.87, stdev=53.56 lat (msec): min=11, max=1168, avg=62.88, stdev=53.56 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 92], 90.00th=[ 125], 95.00th=[ 153], | 99.00th=[ 230], 99.50th=[ 279], 99.90th=[ 376], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 135, per=25.22%, avg=38.59, stdev=24.86, samples=316 iops : min= 1, max= 33, avg= 8.97, stdev= 6.25, samples=316 lat (msec) : 10=1.99%, 20=15.76%, 50=46.06%, 100=23.31%, 250=12.47% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.06%, sys=1.77%, ctx=4843, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179866: Thu Sep 10 11:49:15 2026 read: IOPS=9, BW=37.1KiB/s (37.9kB/s)(6052KiB/163313msec) clat (msec): min=5, max=291, avg=42.32, stdev=38.01 lat (msec): min=5, max=291, avg=42.32, stdev=38.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 90], 95.00th=[ 122], | 99.00th=[ 197], 99.50th=[ 205], 99.90th=[ 279], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 135, per=26.15%, avg=38.18, stdev=25.10, samples=309 iops : min= 1, max= 33, avg= 8.87, stdev= 6.31, samples=309 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6236KiB/163313msec); 0 zone resets clat (msec): min=12, max=1158, avg=63.38, stdev=51.24 lat (msec): min=12, max=1158, avg=63.38, stdev=51.24 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 211], 99.50th=[ 247], 99.90th=[ 372], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 142, per=24.96%, avg=38.18, stdev=23.19, samples=318 iops : min= 1, max= 35, avg= 8.87, stdev= 5.83, samples=318 lat (msec) : 10=2.21%, 20=14.16%, 50=46.71%, 100=24.19%, 250=12.43% lat (msec) : 500=0.26%, 2000=0.03% cpu : usr=0.06%, sys=1.85%, ctx=4929, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=146KiB/s (150kB/s), 36.2KiB/s-37.1KiB/s (37.1kB/s-37.9kB/s), io=23.4MiB (24.6MB), run=162779-164005msec WRITE: bw=153KiB/s (157kB/s), 38.2KiB/s-38.7KiB/s (39.1kB/s-39.6kB/s), io=24.6MiB (25.7MB), run=162779-164005msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179913: Thu Sep 10 11:49:54 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(5920KiB/28264msec) clat (usec): min=44, max=189582, avg=38864.74, stdev=26005.31 lat (usec): min=45, max=189583, avg=38866.10, stdev=26005.50 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 1516], 20.00th=[ 20055], | 30.00th=[ 24773], 40.00th=[ 29754], 50.00th=[ 34866], 60.00th=[ 41157], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 69731], 95.00th=[ 82314], | 99.00th=[121111], 99.50th=[158335], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 93, max= 350, per=24.75%, avg=204.91, stdev=68.93, samples=55 iops : min= 5, max= 21, avg=11.98, stdev= 4.31, samples=55 write: IOPS=14, BW=225KiB/s (231kB/s)(6368KiB/28264msec); 0 zone resets clat (usec): min=1493, max=168139, avg=34716.92, stdev=32661.98 lat (usec): min=1495, max=168141, avg=34723.48, stdev=32660.71 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2573], 10.00th=[ 3589], 20.00th=[ 5866], | 30.00th=[ 10159], 40.00th=[ 17171], 50.00th=[ 25560], 60.00th=[ 34341], | 70.00th=[ 43779], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[141558], 99.50th=[149947], 99.90th=[168821], 99.95th=[168821], | 99.99th=[168821] bw ( KiB/s): min= 62, max= 447, per=25.53%, avg=222.35, stdev=95.72, samples=55 iops : min= 3, max= 27, avg=13.09, stdev= 6.00, samples=55 lat (usec) : 50=0.26%, 100=3.78%, 250=0.26%, 1000=0.13% lat (msec) : 2=1.82%, 4=5.21%, 10=9.38%, 20=11.20%, 50=40.76% lat (msec) : 100=23.83%, 250=3.39% cpu : usr=0.05%, sys=7.08%, ctx=1755, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179914: Thu Sep 10 11:49:54 2026 read: IOPS=13, BW=208KiB/s (213kB/s)(5744KiB/27612msec) clat (usec): min=42, max=233074, avg=41254.42, stdev=30646.16 lat (usec): min=42, max=233075, avg=41258.23, stdev=30644.69 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 143], 20.00th=[ 20317], | 30.00th=[ 25560], 40.00th=[ 31065], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 50070], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 90702], | 99.00th=[160433], 99.50th=[179307], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 50, max= 383, per=25.09%, avg=207.76, stdev=78.14, samples=54 iops : min= 3, max= 23, avg=12.19, stdev= 4.90, samples=54 write: IOPS=14, BW=237KiB/s (243kB/s)(6544KiB/27612msec); 0 zone resets clat (usec): min=1372, max=159548, avg=31182.16, stdev=30486.60 lat (usec): min=1375, max=159552, avg=31188.92, stdev=30483.09 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2507], 10.00th=[ 3261], 20.00th=[ 5407], | 30.00th=[ 8094], 40.00th=[ 13960], 50.00th=[ 22938], 60.00th=[ 29754], | 70.00th=[ 36963], 80.00th=[ 52691], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[122160], 99.50th=[131597], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 63, max= 798, per=27.11%, avg=236.15, stdev=119.96, samples=54 iops : min= 3, max= 49, avg=13.96, stdev= 7.53, samples=54 lat (usec) : 50=0.52%, 100=3.78%, 250=1.30%, 500=0.26%, 750=0.26% lat (msec) : 2=1.95%, 4=6.12%, 10=10.29%, 20=8.98%, 50=40.76% lat (msec) : 100=21.88%, 250=3.91% cpu : usr=0.07%, sys=7.28%, ctx=1733, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179915: Thu Sep 10 11:49:54 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6256KiB/28927msec) clat (usec): min=38, max=216147, avg=38332.67, stdev=27431.10 lat (usec): min=38, max=216149, avg=38335.36, stdev=27429.11 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 108], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 29754], 50.00th=[ 35914], 60.00th=[ 43779], | 70.00th=[ 49546], 80.00th=[ 55313], 90.00th=[ 66847], 95.00th=[ 84411], | 99.00th=[135267], 99.50th=[183501], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 63, max= 542, per=26.16%, avg=216.63, stdev=107.26, samples=57 iops : min= 3, max= 33, avg=12.74, stdev= 6.72, samples=57 write: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28927msec); 0 zone resets clat (usec): min=1486, max=374637, avg=36865.45, stdev=35359.04 lat (usec): min=1487, max=374638, avg=36867.88, stdev=35359.44 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2737], 10.00th=[ 4047], 20.00th=[ 7504], | 30.00th=[ 12911], 40.00th=[ 21365], 50.00th=[ 31327], 60.00th=[ 39584], | 70.00th=[ 46924], 80.00th=[ 58983], 90.00th=[ 81265], 95.00th=[ 94897], | 99.00th=[147850], 99.50th=[156238], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 62, max= 415, per=23.83%, avg=207.56, stdev=84.72, samples=57 iops : min= 3, max= 25, avg=12.18, stdev= 5.35, samples=57 lat (usec) : 50=0.26%, 100=4.69%, 250=1.17%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.43%, 4=3.52%, 10=8.07%, 20=11.20%, 50=41.67% lat (msec) : 100=24.74%, 250=2.73%, 500=0.13% cpu : usr=0.08%, sys=6.82%, ctx=1837, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179916: Thu Sep 10 11:49:54 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(6032KiB/27288msec) clat (usec): min=38, max=201535, avg=39742.70, stdev=29744.14 lat (usec): min=38, max=201536, avg=39744.01, stdev=29744.35 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 63], 10.00th=[ 74], 20.00th=[ 17957], | 30.00th=[ 24773], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[149947], 99.50th=[170918], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 62, max= 542, per=26.57%, avg=219.96, stdev=96.54, samples=53 iops : min= 3, max= 33, avg=12.94, stdev= 6.04, samples=53 write: IOPS=14, BW=229KiB/s (235kB/s)(6256KiB/27288msec); 0 zone resets clat (usec): min=1506, max=146317, avg=31322.99, stdev=30076.12 lat (usec): min=1507, max=146319, avg=31328.80, stdev=30074.18 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2180], 10.00th=[ 3228], 20.00th=[ 5800], | 30.00th=[ 8848], 40.00th=[ 13435], 50.00th=[ 21365], 60.00th=[ 31851], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[131597], 99.50th=[139461], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 31, max= 446, per=26.30%, avg=229.06, stdev=88.78, samples=53 iops : min= 1, max= 27, avg=13.53, stdev= 5.59, samples=53 lat (usec) : 50=1.04%, 100=4.95%, 250=0.78%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.95%, 4=4.95%, 10=10.55%, 20=11.33%, 50=37.76% lat (msec) : 100=22.40%, 250=3.91% cpu : usr=0.08%, sys=6.90%, ctx=1673, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=828KiB/s (848kB/s), 208KiB/s-221KiB/s (213kB/s-226kB/s), io=23.4MiB (24.5MB), run=27288-28927msec WRITE: bw=871KiB/s (892kB/s), 209KiB/s-237KiB/s (214kB/s-243kB/s), io=24.6MiB (25.8MB), run=27288-28927msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179908: Thu Sep 10 11:50:05 2026 read: IOPS=9, BW=149KiB/s (153kB/s)(5920KiB/39700msec) clat (msec): min=7, max=196, avg=40.63, stdev=31.70 lat (msec): min=7, max=196, avg=40.63, stdev=31.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 110], | 99.00th=[ 150], 99.50th=[ 194], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 31, max= 383, per=24.91%, avg=149.48, stdev=82.44, samples=77 iops : min= 1, max= 23, avg= 8.62, stdev= 5.26, samples=77 write: IOPS=10, BW=160KiB/s (164kB/s)(6368KiB/39700msec); 0 zone resets clat (msec): min=13, max=236, avg=61.87, stdev=38.39 lat (msec): min=13, max=236, avg=61.87, stdev=38.39 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 205], 99.50th=[ 224], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 411, per=25.22%, avg=159.12, stdev=80.23, samples=78 iops : min= 1, max= 25, avg= 9.24, stdev= 5.07, samples=78 lat (msec) : 10=1.17%, 20=10.68%, 50=50.91%, 100=26.82%, 250=10.42% cpu : usr=0.05%, sys=2.16%, ctx=1228, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179909: Thu Sep 10 11:50:05 2026 read: IOPS=9, BW=145KiB/s (148kB/s)(5744KiB/39646msec) clat (msec): min=7, max=204, avg=40.16, stdev=33.24 lat (msec): min=7, max=204, avg=40.17, stdev=33.23 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 83], 95.00th=[ 114], | 99.00th=[ 176], 99.50th=[ 205], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 448, per=25.27%, avg=151.65, stdev=90.97, samples=74 iops : min= 1, max= 28, avg= 8.78, stdev= 5.82, samples=74 write: IOPS=10, BW=165KiB/s (169kB/s)(6544KiB/39646msec); 0 zone resets clat (msec): min=12, max=450, avg=61.39, stdev=42.75 lat (msec): min=12, max=450, avg=61.39, stdev=42.75 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 49], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 88], 90.00th=[ 120], 95.00th=[ 138], | 99.00th=[ 182], 99.50th=[ 222], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 31, max= 443, per=25.95%, avg=163.74, stdev=88.20, samples=78 iops : min= 1, max= 27, avg= 9.53, stdev= 5.58, samples=78 lat (msec) : 10=1.43%, 20=11.98%, 50=49.87%, 100=26.17%, 250=10.29% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.19%, ctx=1206, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179910: Thu Sep 10 11:50:05 2026 read: IOPS=9, BW=157KiB/s (160kB/s)(6256KiB/39919msec) clat (msec): min=6, max=361, avg=42.99, stdev=37.78 lat (msec): min=6, max=361, avg=42.99, stdev=37.78 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 89], 95.00th=[ 114], | 99.00th=[ 176], 99.50th=[ 245], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 447, per=25.75%, avg=154.49, stdev=97.74, samples=78 iops : min= 1, max= 27, avg= 8.95, stdev= 6.16, samples=78 write: IOPS=9, BW=151KiB/s (155kB/s)(6032KiB/39919msec); 0 zone resets clat (msec): min=14, max=268, avg=60.95, stdev=36.86 lat (msec): min=14, max=268, avg=60.95, stdev=36.86 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 90], 90.00th=[ 112], 95.00th=[ 133], | 99.00th=[ 178], 99.50th=[ 232], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 384, per=23.18%, avg=146.24, stdev=77.77, samples=78 iops : min= 1, max= 24, avg= 8.44, stdev= 4.92, samples=78 lat (msec) : 10=1.43%, 20=15.23%, 50=44.53%, 100=27.73%, 250=10.81% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=2.16%, ctx=1244, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179911: Thu Sep 10 11:50:05 2026 read: IOPS=9, BW=152KiB/s (155kB/s)(6032KiB/39738msec) clat (msec): min=6, max=275, avg=43.30, stdev=38.69 lat (msec): min=6, max=275, avg=43.30, stdev=38.69 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 58], 90.00th=[ 94], 95.00th=[ 124], | 99.00th=[ 205], 99.50th=[ 249], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 475, per=25.25%, avg=151.49, stdev=93.55, samples=77 iops : min= 1, max= 29, avg= 8.77, stdev= 5.91, samples=77 write: IOPS=9, BW=157KiB/s (161kB/s)(6256KiB/39738msec); 0 zone resets clat (msec): min=13, max=448, avg=59.53, stdev=39.98 lat (msec): min=13, max=448, avg=59.54, stdev=39.98 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 112], 95.00th=[ 128], | 99.00th=[ 171], 99.50th=[ 192], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 416, per=24.67%, avg=155.65, stdev=88.66, samples=78 iops : min= 1, max= 26, avg= 9.03, stdev= 5.60, samples=78 lat (msec) : 10=1.43%, 20=12.11%, 50=50.65%, 100=23.83%, 250=11.72% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=2.02%, ctx=1197, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=600KiB/s (614kB/s), 145KiB/s-157KiB/s (148kB/s-160kB/s), io=23.4MiB (24.5MB), run=39646-39919msec WRITE: bw=631KiB/s (646kB/s), 151KiB/s-165KiB/s (155kB/s-169kB/s), io=24.6MiB (25.8MB), run=39646-39919msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179929: Thu Sep 10 11:50:21 2026 read: IOPS=1, BW=1604KiB/s (1642kB/s)(7168KiB/4469msec) clat (msec): min=92, max=1445, avg=372.43, stdev=483.66 lat (msec): min=92, max=1445, avg=372.43, stdev=483.66 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 95], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 211], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 380], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 2031, max= 5515, per=100.00%, avg=3598.67, stdev=1767.98, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1146KiB/s (1173kB/s)(5120KiB/4469msec); 0 zone resets clat (msec): min=161, max=731, avg=356.46, stdev=220.47 lat (msec): min=161, max=731, avg=356.56, stdev=220.47 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1625, max= 3992, per=53.65%, avg=2420.75, stdev=1065.01, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.92%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179930: Thu Sep 10 11:50:21 2026 read: IOPS=0, BW=322KiB/s (330kB/s)(2048KiB/6354msec) clat (msec): min=103, max=109, avg=106.63, stdev= 4.75 lat (msec): min=103, max=109, avg=106.63, stdev= 4.75 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 110], | 70.00th=[ 110], 80.00th=[ 110], 90.00th=[ 110], 95.00th=[ 110], | 99.00th=[ 110], 99.50th=[ 110], 99.90th=[ 110], 99.95th=[ 110], | 99.99th=[ 110] bw ( KiB/s): min= 1809, max= 2023, per=59.45%, avg=1916.00, stdev=151.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1612KiB/s (1650kB/s)(10.0MiB/6354msec); 0 zone resets clat (msec): min=143, max=2539, avg=605.36, stdev=769.76 lat (msec): min=143, max=2539, avg=605.47, stdev=769.81 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 169], | 30.00th=[ 174], 40.00th=[ 218], 50.00th=[ 264], 60.00th=[ 317], | 70.00th=[ 330], 80.00th=[ 542], 90.00th=[ 1368], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1809, max= 4079, per=56.84%, avg=2564.43, stdev=1034.56, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.30%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179931: Thu Sep 10 11:50:21 2026 read: IOPS=1, BW=1748KiB/s (1790kB/s)(6144KiB/3514msec) clat (msec): min=60, max=460, avg=260.40, stdev=174.24 lat (msec): min=60, max=460, avg=260.41, stdev=174.24 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 251], 50.00th=[ 251], 60.00th=[ 266], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1625, max= 3992, per=73.26%, avg=2361.25, stdev=1100.11, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1748KiB/s (1790kB/s)(6144KiB/3514msec); 0 zone resets clat (msec): min=107, max=671, avg=320.90, stdev=212.76 lat (msec): min=107, max=671, avg=321.04, stdev=212.74 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 359], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1946, max= 5380, per=69.16%, avg=3120.33, stdev=1957.43, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=16.67%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=6.58%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179932: Thu Sep 10 11:50:21 2026 read: IOPS=0, BW=995KiB/s (1019kB/s)(5120KiB/5144msec) clat (msec): min=99, max=257, avg=171.71, stdev=65.73 lat (msec): min=99, max=257, avg=171.71, stdev=65.73 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 186], 60.00th=[ 186], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 257], 95.00th=[ 257], | 99.00th=[ 257], 99.50th=[ 257], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 1946, max= 5988, per=100.00%, avg=3967.00, stdev=2858.13, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1393KiB/s (1427kB/s)(7168KiB/5144msec); 0 zone resets clat (msec): min=116, max=1788, avg=603.09, stdev=551.34 lat (msec): min=116, max=1788, avg=603.20, stdev=551.31 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 220], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 527], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 592], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1625, max= 3771, per=50.53%, avg=2280.00, stdev=849.95, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=3.42%, ctx=81, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3223KiB/s (3301kB/s), 322KiB/s-1748KiB/s (330kB/s-1790kB/s), io=20.0MiB (20.0MB), run=3514-6354msec WRITE: bw=4512KiB/s (4621kB/s), 1146KiB/s-1748KiB/s (1173kB/s-1790kB/s), io=28.0MiB (29.4MB), run=3514-6354msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179934: Thu Sep 10 11:50:21 2026 read: IOPS=2, BW=2352KiB/s (2408kB/s)(7168KiB/3048msec) clat (msec): min=177, max=304, avg=240.65, stdev=49.53 lat (msec): min=177, max=304, avg=240.65, stdev=49.53 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 194], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 247], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 292], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2031, max= 3893, per=86.40%, avg=2850.50, stdev=955.37, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1680KiB/s (1720kB/s)(5120KiB/3048msec); 0 zone resets clat (msec): min=210, max=414, avg=270.07, stdev=83.22 lat (msec): min=210, max=414, avg=270.32, stdev=83.13 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2031, max= 3946, per=57.91%, avg=2675.00, stdev=1100.75, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.00%, sys=22.87%, ctx=293, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179935: Thu Sep 10 11:50:21 2026 read: IOPS=0, BW=330KiB/s (338kB/s)(2048KiB/6207msec) clat (usec): min=1428, max=192039, avg=96733.95, stdev=134781.82 lat (usec): min=1429, max=192040, avg=96734.72, stdev=134782.35 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1434], 10.00th=[ 1434], 20.00th=[ 1434], | 30.00th=[ 1434], 40.00th=[ 1434], 50.00th=[ 1434], 60.00th=[191890], | 70.00th=[191890], 80.00th=[191890], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 1542, max= 2007, per=53.79%, avg=1774.50, stdev=328.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1650KiB/s (1689kB/s)(10.0MiB/6207msec); 0 zone resets clat (msec): min=162, max=2312, avg=600.61, stdev=637.71 lat (msec): min=162, max=2312, avg=601.22, stdev=637.42 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 182], | 30.00th=[ 218], 40.00th=[ 300], 50.00th=[ 347], 60.00th=[ 498], | 70.00th=[ 527], 80.00th=[ 667], 90.00th=[ 802], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 1946, max= 4015, per=50.32%, avg=2324.17, stdev=829.06, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 2=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.70%, ctx=196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179936: Thu Sep 10 11:50:21 2026 read: IOPS=1, BW=1321KiB/s (1352kB/s)(6144KiB/4652msec) clat (usec): min=652, max=1979.8k, avg=466236.49, stdev=753869.19 lat (usec): min=654, max=1979.8k, avg=466237.81, stdev=753869.36 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], | 20.00th=[ 3326], 30.00th=[ 3326], 40.00th=[ 219153], | 50.00th=[ 219153], 60.00th=[ 270533], 70.00th=[ 325059], | 80.00th=[ 325059], 90.00th=[1988101], 95.00th=[1988101], | 99.00th=[1988101], 99.50th=[1988101], 99.90th=[1988101], | 99.95th=[1988101], 99.99th=[1988101] bw ( KiB/s): min= 1946, max= 6131, per=100.00%, avg=3350.00, stdev=2408.45, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1321KiB/s (1352kB/s)(6144KiB/4652msec); 0 zone resets clat (msec): min=150, max=596, avg=308.50, stdev=154.10 lat (msec): min=150, max=596, avg=308.78, stdev=154.12 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 313], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1605, max= 2043, per=41.56%, avg=1919.60, stdev=180.39, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.90%, ctx=496, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179937: Thu Sep 10 11:50:21 2026 read: IOPS=1, BW=1032KiB/s (1057kB/s)(5120KiB/4960msec) clat (usec): min=350, max=163588, avg=62551.92, stdev=84979.93 lat (usec): min=350, max=163590, avg=62553.15, stdev=84980.06 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 482], 40.00th=[ 482], 50.00th=[ 1074], 60.00th=[ 1074], | 70.00th=[147850], 80.00th=[147850], 90.00th=[164627], 95.00th=[164627], | 99.00th=[164627], 99.50th=[164627], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1445KiB/s (1480kB/s)(7168KiB/4960msec); 0 zone resets clat (msec): min=309, max=1457, avg=663.15, stdev=393.56 lat (msec): min=309, max=1457, avg=663.34, stdev=393.59 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 317], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 634], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 776], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 1939, max= 2048, per=42.92%, avg=1982.33, stdev=46.06, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 500=16.67% lat (msec) : 2=8.33%, 250=16.67%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=12.22%, ctx=112, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3300KiB/s (3379kB/s), 330KiB/s-2352KiB/s (338kB/s-2408kB/s), io=20.0MiB (20.0MB), run=3048-6207msec WRITE: bw=4619KiB/s (4730kB/s), 1321KiB/s-1680KiB/s (1352kB/s-1720kB/s), io=28.0MiB (29.4MB), run=3048-6207msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179944: Thu Sep 10 11:50:38 2026 read: IOPS=0, BW=2216KiB/s (2269kB/s)(12.0MiB/5545msec) clat (msec): min=848, max=3576, avg=1770.79, stdev=1563.93 lat (msec): min=848, max=3576, avg=1770.79, stdev=1563.93 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8062, max= 8143, per=100.00%, avg=8102.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=7.56%, ctx=416, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179946: Thu Sep 10 11:50:38 2026 read: IOPS=0, BW=760KiB/s (778kB/s)(4096KiB/5390msec) clat (nsec): min=2878.5M, max=2878.5M, avg=2878512492.00, stdev= 0.00 lat (nsec): min=2878.5M, max=2878.5M, avg=2878515443.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2869], 5.00th=[ 2869], 10.00th=[ 2869], 20.00th=[ 2869], | 30.00th=[ 2869], 40.00th=[ 2869], 50.00th=[ 2869], 60.00th=[ 2869], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1520KiB/s (1556kB/s)(8192KiB/5390msec); 0 zone resets clat (msec): min=642, max=1609, avg=1126.37, stdev=683.77 lat (msec): min=644, max=1610, avg=1127.63, stdev=682.96 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=5.73%, ctx=517, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179947: Thu Sep 10 11:50:38 2026 write: IOPS=0, BW=3122KiB/s (3197kB/s)(12.0MiB/3936msec); 0 zone resets clat (msec): min=542, max=2275, avg=1251.69, stdev=908.28 lat (msec): min=542, max=2275, avg=1252.86, stdev=908.02 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.48%, ctx=55, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179949: Thu Sep 10 11:50:38 2026 write: IOPS=0, BW=2162KiB/s (2214kB/s)(12.0MiB/5684msec); 0 zone resets clat (msec): min=587, max=2845, avg=1788.65, stdev=1136.13 lat (msec): min=588, max=2847, avg=1789.86, stdev=1136.43 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 7846, max= 8143, per=100.00%, avg=7994.50, stdev=210.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.83%, ctx=83, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2955KiB/s (3026kB/s), 760KiB/s-2216KiB/s (778kB/s-2269kB/s), io=16.0MiB (16.8MB), run=5390-5545msec WRITE: bw=5765KiB/s (5903kB/s), 1520KiB/s-3122KiB/s (1556kB/s-3197kB/s), io=32.0MiB (33.6MB), run=3936-5684msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179945: Thu Sep 10 11:50:39 2026 read: IOPS=0, BW=2104KiB/s (2155kB/s)(12.0MiB/5840msec) clat (msec): min=223, max=4294, avg=1871.69, stdev=2143.19 lat (msec): min=223, max=4294, avg=1871.69, stdev=2143.19 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 4279], 80.00th=[ 4279], 90.00th=[ 4279], 95.00th=[ 4279], | 99.00th=[ 4279], 99.50th=[ 4279], 99.90th=[ 4279], 99.95th=[ 4279], | 99.99th=[ 4279] bw ( KiB/s): min= 8062, max= 8175, per=100.00%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.56%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179948: Thu Sep 10 11:50:39 2026 read: IOPS=0, BW=692KiB/s (709kB/s)(4096KiB/5918msec) clat (nsec): min=3602.3M, max=3602.3M, avg=3602343314.00, stdev= 0.00 lat (nsec): min=3602.3M, max=3602.3M, avg=3602345549.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3608], 5.00th=[ 3608], 10.00th=[ 3608], 20.00th=[ 3608], | 30.00th=[ 3608], 40.00th=[ 3608], 50.00th=[ 3608], 60.00th=[ 3608], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1384KiB/s (1417kB/s)(8192KiB/5918msec); 0 zone resets clat (msec): min=320, max=1824, avg=1072.50, stdev=1063.36 lat (msec): min=321, max=1825, avg=1073.08, stdev=1063.50 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 1821], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.40%, ctx=93, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179950: Thu Sep 10 11:50:39 2026 write: IOPS=0, BW=2017KiB/s (2065kB/s)(12.0MiB/6093msec); 0 zone resets clat (msec): min=426, max=5056, avg=1975.77, stdev=2667.70 lat (msec): min=430, max=5056, avg=1977.24, stdev=2666.65 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 5067], 80.00th=[ 5067], 90.00th=[ 5067], 95.00th=[ 5067], | 99.00th=[ 5067], 99.50th=[ 5067], 99.90th=[ 5067], 99.95th=[ 5067], | 99.99th=[ 5067] bw ( KiB/s): min= 7816, max= 8175, per=100.00%, avg=7995.50, stdev=253.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.28%, ctx=60, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179951: Thu Sep 10 11:50:39 2026 write: IOPS=0, BW=2520KiB/s (2581kB/s)(12.0MiB/4876msec); 0 zone resets clat (msec): min=842, max=2282, avg=1561.03, stdev=720.09 lat (msec): min=844, max=2283, avg=1561.85, stdev=719.61 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.24%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2769KiB/s (2835kB/s), 692KiB/s-2104KiB/s (709kB/s-2155kB/s), io=16.0MiB (16.8MB), run=5840-5918msec WRITE: bw=5378KiB/s (5507kB/s), 1384KiB/s-2520KiB/s (1417kB/s-2581kB/s), io=32.0MiB (33.6MB), run=4876-6093msec