== sanity test 398b: DIO and buffer IO race ============== 03:34:43 (1776929683) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.29601 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179950: Thu Apr 23 03:36:52 2026 read: IOPS=13, BW=55.4KiB/s (56.7kB/s)(5992KiB/108230msec) clat (usec): min=60, max=1542.5k, avg=39721.47, stdev=43779.85 lat (usec): min=62, max=1542.5k, avg=39725.36, stdev=43779.33 clat percentiles (usec): | 1.00th=[ 186], 5.00th=[ 15795], 10.00th=[ 19006], | 20.00th=[ 23200], 30.00th=[ 27132], 40.00th=[ 31327], | 50.00th=[ 34866], 60.00th=[ 39584], 70.00th=[ 44827], | 80.00th=[ 52167], 90.00th=[ 62653], 95.00th=[ 74974], | 99.00th=[ 111674], 99.50th=[ 123208], 99.90th=[ 225444], | 99.95th=[1535116], 99.99th=[1535116] bw ( KiB/s): min= 7, max= 103, per=25.29%, avg=55.63, stdev=17.30, samples=212 iops : min= 1, max= 25, avg=13.31, stdev= 4.33, samples=212 write: IOPS=14, BW=58.2KiB/s (59.6kB/s)(6296KiB/108230msec); 0 zone resets clat (usec): min=1687, max=241864, avg=30556.13, stdev=23652.19 lat (usec): min=1688, max=241866, avg=30562.24, stdev=23649.58 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 14], 40.00th=[ 20], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 74], | 99.00th=[ 103], 99.50th=[ 113], 99.90th=[ 138], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 15, max= 143, per=25.40%, avg=58.67, stdev=20.82, samples=211 iops : min= 3, max= 35, avg=14.07, stdev= 5.23, samples=211 lat (usec) : 100=0.13%, 250=0.78%, 500=0.26%, 750=0.03%, 1000=0.03% lat (msec) : 2=0.16%, 4=0.91%, 10=10.71%, 20=13.31%, 50=52.28% lat (msec) : 100=20.15%, 250=1.20%, 2000=0.03% cpu : usr=0.10%, sys=24.05%, ctx=10598, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179952: Thu Apr 23 03:36:52 2026 read: IOPS=13, BW=55.0KiB/s (56.3kB/s)(5940KiB/107964msec) clat (usec): min=61, max=148285, avg=38504.03, stdev=19903.22 lat (usec): min=62, max=148288, avg=38506.89, stdev=19903.61 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 15008], 10.00th=[ 18482], 20.00th=[ 22938], | 30.00th=[ 26608], 40.00th=[ 30540], 50.00th=[ 34866], 60.00th=[ 39584], | 70.00th=[ 45351], 80.00th=[ 52691], 90.00th=[ 63177], 95.00th=[ 74974], | 99.00th=[105382], 99.50th=[116917], 99.90th=[141558], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 6, max= 111, per=25.07%, avg=55.15, stdev=17.22, samples=211 iops : min= 1, max= 27, avg=13.19, stdev= 4.34, samples=211 write: IOPS=14, BW=58.8KiB/s (60.2kB/s)(6348KiB/107964msec); 0 zone resets clat (msec): min=2, max=1514, avg=31.65, stdev=43.89 lat (msec): min=2, max=1514, avg=31.65, stdev=43.89 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 10], | 30.00th=[ 16], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 49], 90.00th=[ 64], 95.00th=[ 78], | 99.00th=[ 104], 99.50th=[ 109], 99.90th=[ 186], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 7, max= 111, per=25.51%, avg=58.93, stdev=21.42, samples=211 iops : min= 1, max= 27, avg=14.13, stdev= 5.37, samples=211 lat (usec) : 100=0.13%, 250=0.88%, 500=0.23%, 750=0.07% lat (msec) : 2=0.03%, 4=0.88%, 10=10.90%, 20=12.43%, 50=53.19% lat (msec) : 100=19.95%, 250=1.27%, 2000=0.03% cpu : usr=0.10%, sys=24.27%, ctx=10626, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179953: Thu Apr 23 03:36:52 2026 read: IOPS=14, BW=56.4KiB/s (57.7kB/s)(6028KiB/106891msec) clat (usec): min=65, max=191345, avg=36817.73, stdev=19072.28 lat (usec): min=66, max=191347, avg=36822.47, stdev=19074.27 clat percentiles (usec): | 1.00th=[ 176], 5.00th=[ 14484], 10.00th=[ 17695], 20.00th=[ 22152], | 30.00th=[ 25560], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 38536], | 70.00th=[ 43779], 80.00th=[ 50070], 90.00th=[ 60031], 95.00th=[ 69731], | 99.00th=[ 91751], 99.50th=[115868], 99.90th=[156238], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 15, max= 111, per=25.86%, avg=56.89, stdev=18.20, samples=208 iops : min= 3, max= 27, avg=13.63, stdev= 4.56, samples=208 write: IOPS=14, BW=58.6KiB/s (59.0kB/s)(6260KiB/106891msec); 0 zone resets clat (usec): min=1580, max=1546.9k, avg=32452.27, stdev=45389.02 lat (usec): min=1582, max=1546.9k, avg=32463.20, stdev=45392.03 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 14], 40.00th=[ 21], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 66], 95.00th=[ 80], | 99.00th=[ 104], 99.50th=[ 123], 99.90th=[ 199], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 6, max= 120, per=25.34%, avg=58.54, stdev=21.07, samples=210 iops : min= 1, max= 30, avg=14.04, stdev= 5.27, samples=210 lat (usec) : 100=0.07%, 250=1.04%, 500=0.20%, 750=0.07%, 1000=0.07% lat (msec) : 2=0.16%, 4=1.20%, 10=10.77%, 20=13.61%, 50=52.67% lat (msec) : 100=19.14%, 250=0.98%, 2000=0.03% cpu : usr=0.10%, sys=24.07%, ctx=10631, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179956: Thu Apr 23 03:36:52 2026 read: IOPS=13, BW=55.7KiB/s (57.0kB/s)(6052KiB/108670msec) clat (usec): min=76, max=148252, avg=36967.40, stdev=18533.99 lat (usec): min=78, max=148254, avg=36978.17, stdev=18528.78 clat percentiles (usec): | 1.00th=[ 167], 5.00th=[ 14222], 10.00th=[ 17957], 20.00th=[ 22152], | 30.00th=[ 25822], 40.00th=[ 30016], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 44303], 80.00th=[ 50594], 90.00th=[ 59507], 95.00th=[ 70779], | 99.00th=[ 93848], 99.50th=[105382], 99.90th=[141558], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 7, max= 128, per=25.54%, avg=56.18, stdev=18.81, samples=212 iops : min= 1, max= 32, avg=13.45, stdev= 4.73, samples=212 write: IOPS=14, BW=57.4KiB/s (58.8kB/s)(6236KiB/108670msec); 0 zone resets clat (usec): min=1612, max=1552.9k, avg=33436.34, stdev=45818.05 lat (usec): min=1614, max=1552.9k, avg=33451.19, stdev=45823.77 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 15], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 52], 90.00th=[ 68], 95.00th=[ 80], | 99.00th=[ 114], 99.50th=[ 126], 99.90th=[ 201], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8, max= 127, per=24.81%, avg=57.32, stdev=21.29, samples=214 iops : min= 2, max= 31, avg=13.74, stdev= 5.38, samples=214 lat (usec) : 100=0.03%, 250=0.98%, 500=0.29%, 750=0.10%, 1000=0.03% lat (msec) : 2=0.10%, 4=1.07%, 10=10.45%, 20=12.50%, 50=53.42% lat (msec) : 100=19.82%, 250=1.17%, 2000=0.03% cpu : usr=0.09%, sys=23.97%, ctx=10896, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=221KiB/s (226kB/s), 55.0KiB/s-56.4KiB/s (56.3kB/s-57.7kB/s), io=23.4MiB (24.6MB), run=106891-108670msec WRITE: bw=231KiB/s (237kB/s), 57.4KiB/s-58.8KiB/s (58.8kB/s-60.2kB/s), io=24.6MiB (25.7MB), run=106891-108670msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179949: Thu Apr 23 03:37:11 2026 read: IOPS=11, BW=47.2KiB/s (48.4kB/s)(5992KiB/126843msec) clat (msec): min=5, max=1553, avg=35.48, stdev=48.26 lat (msec): min=5, max=1553, avg=35.48, stdev=48.26 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 74], 95.00th=[ 94], | 99.00th=[ 138], 99.50th=[ 155], 99.90th=[ 222], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7, max= 168, per=25.16%, avg=47.56, stdev=33.07, samples=247 iops : min= 1, max= 42, avg=11.35, stdev= 8.33, samples=247 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6296KiB/126843msec); 0 zone resets clat (msec): min=11, max=223, avg=46.48, stdev=31.31 lat (msec): min=11, max=223, avg=46.49, stdev=31.31 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 69], 90.00th=[ 89], 95.00th=[ 108], | 99.00th=[ 150], 99.50th=[ 186], 99.90th=[ 220], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 7, max= 168, per=25.27%, avg=49.79, stdev=32.77, samples=248 iops : min= 1, max= 42, avg=11.90, stdev= 8.26, samples=248 lat (msec) : 10=3.84%, 20=24.48%, 50=43.13%, 100=23.24%, 250=5.27% lat (msec) : 2000=0.03% cpu : usr=0.08%, sys=11.90%, ctx=7511, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179951: Thu Apr 23 03:37:11 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5940KiB/126974msec) clat (msec): min=6, max=1564, avg=35.98, stdev=49.10 lat (msec): min=6, max=1564, avg=35.98, stdev=49.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 77], 95.00th=[ 96], | 99.00th=[ 142], 99.50th=[ 150], 99.90th=[ 203], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 192, per=24.79%, avg=46.85, stdev=33.98, samples=248 iops : min= 1, max= 48, avg=11.17, stdev= 8.58, samples=248 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6348KiB/126974msec); 0 zone resets clat (msec): min=10, max=260, avg=46.00, stdev=30.69 lat (msec): min=10, max=260, avg=46.01, stdev=30.69 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 56], 80.00th=[ 68], 90.00th=[ 87], 95.00th=[ 104], | 99.00th=[ 150], 99.50th=[ 163], 99.90th=[ 228], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 7, max= 160, per=25.28%, avg=49.81, stdev=32.49, samples=249 iops : min= 1, max= 40, avg=11.91, stdev= 8.18, samples=249 lat (msec) : 10=3.91%, 20=24.93%, 50=42.38%, 100=23.57%, 250=5.14% lat (msec) : 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=11.96%, ctx=7451, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179954: Thu Apr 23 03:37:11 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6028KiB/126355msec) clat (msec): min=5, max=165, avg=33.47, stdev=25.72 lat (msec): min=5, max=165, avg=33.47, stdev=25.72 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 70], 95.00th=[ 89], | 99.00th=[ 117], 99.50th=[ 138], 99.90th=[ 153], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 7, max= 167, per=25.55%, avg=48.28, stdev=33.19, samples=245 iops : min= 1, max= 41, avg=11.53, stdev= 8.35, samples=245 write: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6260KiB/126355msec); 0 zone resets clat (msec): min=8, max=1588, avg=48.15, stdev=49.95 lat (msec): min=8, max=1588, avg=48.15, stdev=49.95 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 59], 80.00th=[ 71], 90.00th=[ 90], 95.00th=[ 107], | 99.00th=[ 150], 99.50th=[ 163], 99.90th=[ 255], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7, max= 159, per=25.20%, avg=49.64, stdev=31.88, samples=247 iops : min= 1, max= 39, avg=11.87, stdev= 8.04, samples=247 lat (msec) : 10=3.48%, 20=25.00%, 50=42.81%, 100=24.19%, 250=4.46% lat (msec) : 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=11.93%, ctx=7567, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179955: Thu Apr 23 03:37:11 2026 read: IOPS=11, BW=47.6KiB/s (48.8kB/s)(6052KiB/127012msec) clat (msec): min=5, max=185, avg=35.29, stdev=28.82 lat (msec): min=5, max=185, avg=35.30, stdev=28.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 54], 90.00th=[ 77], 95.00th=[ 93], | 99.00th=[ 140], 99.50th=[ 150], 99.90th=[ 167], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 7, max= 200, per=25.27%, avg=47.75, stdev=34.09, samples=247 iops : min= 1, max= 50, avg=11.40, stdev= 8.59, samples=247 write: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6236KiB/127012msec); 0 zone resets clat (msec): min=10, max=1572, avg=46.86, stdev=50.19 lat (msec): min=10, max=1572, avg=46.86, stdev=50.19 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 87], 95.00th=[ 108], | 99.00th=[ 157], 99.50th=[ 197], 99.90th=[ 268], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7, max= 175, per=24.83%, avg=48.91, stdev=33.01, samples=249 iops : min= 1, max= 43, avg=11.68, stdev= 8.32, samples=249 lat (msec) : 10=3.97%, 20=24.74%, 50=42.15%, 100=24.02%, 250=5.05% lat (msec) : 500=0.03%, 2000=0.03% cpu : usr=0.09%, sys=11.82%, ctx=7539, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=189KiB/s (194kB/s), 46.8KiB/s-47.7KiB/s (47.9kB/s-48.9kB/s), io=23.4MiB (24.6MB), run=126355-127012msec WRITE: bw=198KiB/s (203kB/s), 49.1KiB/s-49.0KiB/s (50.3kB/s-51.2kB/s), io=24.6MiB (25.7MB), run=126355-127012msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179999: Thu Apr 23 03:37:55 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(5920KiB/31694msec) clat (usec): min=68, max=202214, avg=41953.30, stdev=25082.25 lat (usec): min=70, max=202216, avg=41956.02, stdev=25082.42 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 215], 10.00th=[ 15795], 20.00th=[ 25297], | 30.00th=[ 30278], 40.00th=[ 34866], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 50594], 80.00th=[ 57934], 90.00th=[ 69731], 95.00th=[ 82314], | 99.00th=[126354], 99.50th=[152044], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 351, per=24.47%, avg=184.75, stdev=60.24, samples=61 iops : min= 3, max= 21, avg=10.84, stdev= 3.73, samples=61 write: IOPS=12, BW=201KiB/s (206kB/s)(6368KiB/31694msec); 0 zone resets clat (msec): min=4, max=182, avg=40.57, stdev=26.79 lat (msec): min=4, max=182, avg=40.57, stdev=26.79 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 16], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 61], 90.00th=[ 77], 95.00th=[ 86], | 99.00th=[ 134], 99.50th=[ 146], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 351, per=24.92%, avg=198.08, stdev=62.60, samples=62 iops : min= 1, max= 21, avg=11.66, stdev= 3.95, samples=62 lat (usec) : 100=0.13%, 250=2.99%, 500=1.17%, 750=0.26% lat (msec) : 10=4.30%, 20=10.42%, 50=48.05%, 100=29.95%, 250=2.73% cpu : usr=0.12%, sys=25.50%, ctx=3255, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180000: Thu Apr 23 03:37:55 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(5744KiB/31331msec) clat (usec): min=108, max=201629, avg=43427.95, stdev=23051.03 lat (usec): min=110, max=201632, avg=43430.40, stdev=23050.85 clat percentiles (usec): | 1.00th=[ 165], 5.00th=[ 799], 10.00th=[ 21627], 20.00th=[ 26608], | 30.00th=[ 31327], 40.00th=[ 35390], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 60031], 90.00th=[ 68682], 95.00th=[ 80217], | 99.00th=[113771], 99.50th=[129500], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 94, max= 318, per=24.33%, avg=183.73, stdev=63.04, samples=62 iops : min= 5, max= 19, avg=10.77, stdev= 3.97, samples=62 write: IOPS=13, BW=209KiB/s (214kB/s)(6544KiB/31331msec); 0 zone resets clat (msec): min=3, max=155, avg=38.39, stdev=26.30 lat (msec): min=3, max=155, avg=38.39, stdev=26.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 27], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 57], 90.00th=[ 73], 95.00th=[ 96], | 99.00th=[ 118], 99.50th=[ 123], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 63, max= 384, per=26.15%, avg=207.85, stdev=70.80, samples=62 iops : min= 3, max= 24, avg=12.27, stdev= 4.52, samples=62 lat (usec) : 250=1.69%, 500=0.39%, 750=0.13%, 1000=0.26% lat (msec) : 2=0.26%, 4=0.26%, 10=4.95%, 20=10.81%, 50=50.78% lat (msec) : 100=27.86%, 250=2.60% cpu : usr=0.12%, sys=26.18%, ctx=3242, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180001: Thu Apr 23 03:37:55 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31359msec) clat (usec): min=77, max=212532, avg=42520.68, stdev=23772.58 lat (usec): min=79, max=212534, avg=42524.08, stdev=23772.61 clat percentiles (usec): | 1.00th=[ 163], 5.00th=[ 237], 10.00th=[ 19792], 20.00th=[ 26608], | 30.00th=[ 31065], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 45351], | 70.00th=[ 50594], 80.00th=[ 57410], 90.00th=[ 68682], 95.00th=[ 82314], | 99.00th=[114820], 99.50th=[132645], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 95, max= 382, per=26.49%, avg=200.02, stdev=59.15, samples=62 iops : min= 5, max= 23, avg=11.79, stdev= 3.77, samples=62 write: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31359msec); 0 zone resets clat (msec): min=3, max=170, avg=38.99, stdev=27.32 lat (msec): min=3, max=170, avg=38.99, stdev=27.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 16], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 77], 95.00th=[ 94], | 99.00th=[ 128], 99.50th=[ 148], 99.90th=[ 171], 99.95th=[ 171], | 99.99th=[ 171] bw ( KiB/s): min= 63, max= 380, per=24.04%, avg=191.15, stdev=73.90, samples=62 iops : min= 3, max= 23, avg=11.24, stdev= 4.63, samples=62 lat (usec) : 100=0.13%, 250=2.86%, 500=0.65%, 750=0.13%, 1000=0.13% lat (msec) : 4=0.13%, 10=4.43%, 20=9.77%, 50=52.47%, 100=26.56% lat (msec) : 250=2.73% cpu : usr=0.06%, sys=25.60%, ctx=3223, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180002: Thu Apr 23 03:37:55 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(6032KiB/30863msec) clat (usec): min=88, max=146484, avg=41174.06, stdev=24078.70 lat (usec): min=90, max=146486, avg=41176.50, stdev=24078.72 clat percentiles (usec): | 1.00th=[ 131], 5.00th=[ 215], 10.00th=[ 758], 20.00th=[ 23987], | 30.00th=[ 29754], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 58459], 90.00th=[ 70779], 95.00th=[ 83362], | 99.00th=[110625], 99.50th=[113771], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 63, max= 349, per=25.64%, avg=193.59, stdev=64.89, samples=61 iops : min= 3, max= 21, avg=11.39, stdev= 4.14, samples=61 write: IOPS=12, BW=203KiB/s (208kB/s)(6256KiB/30863msec); 0 zone resets clat (msec): min=3, max=126, avg=39.05, stdev=26.84 lat (msec): min=3, max=126, avg=39.05, stdev=26.84 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 21], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 81], 95.00th=[ 91], | 99.00th=[ 115], 99.50th=[ 124], 99.90th=[ 127], 99.95th=[ 127], | 99.99th=[ 127] bw ( KiB/s): min= 63, max= 349, per=25.44%, avg=202.28, stdev=59.70, samples=61 iops : min= 3, max= 21, avg=11.93, stdev= 3.79, samples=61 lat (usec) : 100=0.13%, 250=2.73%, 500=1.43%, 750=0.52%, 1000=0.39% lat (msec) : 4=0.13%, 10=4.69%, 20=12.24%, 50=48.57%, 100=26.17% lat (msec) : 250=2.99% cpu : usr=0.11%, sys=25.82%, ctx=3012, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=756KiB/s (774kB/s), 183KiB/s-199KiB/s (188kB/s-204kB/s), io=23.4MiB (24.5MB), run=30863-31694msec WRITE: bw=795KiB/s (814kB/s), 192KiB/s-209KiB/s (197kB/s-214kB/s), io=24.6MiB (25.8MB), run=30863-31694msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179994: Thu Apr 23 03:38:01 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(5920KiB/37918msec) clat (msec): min=6, max=178, avg=41.62, stdev=32.20 lat (msec): min=6, max=178, avg=41.62, stdev=32.20 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 87], 95.00th=[ 115], | 99.00th=[ 144], 99.50th=[ 176], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 31, max= 480, per=24.74%, avg=156.09, stdev=92.49, samples=74 iops : min= 1, max= 30, avg= 9.04, stdev= 5.83, samples=74 write: IOPS=10, BW=168KiB/s (172kB/s)(6368KiB/37918msec); 0 zone resets clat (msec): min=16, max=182, avg=56.45, stdev=33.24 lat (msec): min=16, max=182, avg=56.45, stdev=33.24 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 66], 80.00th=[ 83], 90.00th=[ 103], 95.00th=[ 126], | 99.00th=[ 165], 99.50th=[ 174], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 32, max= 480, per=25.47%, avg=169.11, stdev=89.04, samples=74 iops : min= 2, max= 30, avg= 9.85, stdev= 5.63, samples=74 lat (msec) : 10=0.26%, 20=13.15%, 50=49.09%, 100=27.34%, 250=10.16% cpu : usr=0.10%, sys=11.13%, ctx=2064, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179995: Thu Apr 23 03:38:01 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(5744KiB/37787msec) clat (msec): min=10, max=209, avg=42.73, stdev=31.34 lat (msec): min=10, max=209, avg=42.73, stdev=31.34 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 90], 95.00th=[ 116], | 99.00th=[ 155], 99.50th=[ 176], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 448, per=24.03%, avg=151.61, stdev=80.67, samples=75 iops : min= 1, max= 28, avg= 8.76, stdev= 5.08, samples=75 write: IOPS=10, BW=173KiB/s (177kB/s)(6544KiB/37787msec); 0 zone resets clat (msec): min=15, max=231, avg=54.68, stdev=31.28 lat (msec): min=15, max=231, avg=54.68, stdev=31.28 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 65], 80.00th=[ 80], 90.00th=[ 99], 95.00th=[ 118], | 99.00th=[ 140], 99.50th=[ 159], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 31, max= 480, per=25.94%, avg=172.24, stdev=92.81, samples=75 iops : min= 1, max= 30, avg=10.05, stdev= 5.85, samples=75 lat (msec) : 20=11.20%, 50=52.86%, 100=27.86%, 250=8.07% cpu : usr=0.08%, sys=11.09%, ctx=2123, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179996: Thu Apr 23 03:38:01 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(6256KiB/37740msec) clat (msec): min=8, max=242, avg=42.87, stdev=34.34 lat (msec): min=8, max=242, avg=42.87, stdev=34.34 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 116], | 99.00th=[ 174], 99.50th=[ 215], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 603, per=26.59%, avg=167.78, stdev=100.60, samples=74 iops : min= 1, max= 37, avg= 9.77, stdev= 6.29, samples=74 write: IOPS=9, BW=160KiB/s (164kB/s)(6032KiB/37740msec); 0 zone resets clat (msec): min=16, max=200, avg=55.38, stdev=30.94 lat (msec): min=16, max=200, avg=55.38, stdev=30.94 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 68], 80.00th=[ 79], 90.00th=[ 99], 95.00th=[ 112], | 99.00th=[ 153], 99.50th=[ 188], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 31, max= 416, per=24.29%, avg=161.30, stdev=82.70, samples=74 iops : min= 1, max= 26, avg= 9.36, stdev= 5.22, samples=74 lat (msec) : 10=0.39%, 20=12.50%, 50=50.00%, 100=28.91%, 250=8.20% cpu : usr=0.07%, sys=11.34%, ctx=2152, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179997: Thu Apr 23 03:38:01 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37464msec) clat (msec): min=8, max=203, avg=41.18, stdev=31.93 lat (msec): min=8, max=203, avg=41.18, stdev=31.93 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 167], 99.50th=[ 192], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 608, per=25.22%, avg=159.16, stdev=100.89, samples=74 iops : min= 1, max= 38, avg= 9.24, stdev= 6.33, samples=74 write: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37464msec); 0 zone resets clat (msec): min=15, max=240, avg=55.86, stdev=34.28 lat (msec): min=15, max=240, avg=55.87, stdev=34.28 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 82], 90.00th=[ 100], 95.00th=[ 117], | 99.00th=[ 182], 99.50th=[ 220], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 383, per=25.02%, avg=166.12, stdev=85.03, samples=74 iops : min= 1, max= 23, avg= 9.66, stdev= 5.35, samples=74 lat (msec) : 10=0.52%, 20=12.63%, 50=53.13%, 100=25.78%, 250=7.94% cpu : usr=0.09%, sys=11.08%, ctx=2050, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=632KiB/s (647kB/s), 152KiB/s-166KiB/s (156kB/s-170kB/s), io=23.4MiB (24.5MB), run=37464-37918msec WRITE: bw=665KiB/s (681kB/s), 160KiB/s-173KiB/s (164kB/s-177kB/s), io=24.6MiB (25.8MB), run=37464-37918msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180015: Thu Apr 23 03:38:23 2026 read: IOPS=1, BW=1142KiB/s (1169kB/s)(7168KiB/6277msec) clat (msec): min=74, max=2611, avg=563.60, stdev=906.90 lat (msec): min=74, max=2611, avg=563.60, stdev=906.90 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 167], | 30.00th=[ 213], 40.00th=[ 213], 50.00th=[ 257], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 326], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1935, max= 4096, per=98.01%, avg=2429.60, stdev=932.64, samples=5 iops : min= 1, max= 4, avg= 1.60, stdev= 1.34, samples=5 write: IOPS=0, BW=816KiB/s (835kB/s)(5120KiB/6277msec); 0 zone resets clat (msec): min=195, max=965, avg=454.11, stdev=320.96 lat (msec): min=195, max=965, avg=454.20, stdev=320.96 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1996, max= 4087, per=72.93%, avg=2531.25, stdev=1037.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=38.54%, ctx=1311, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180016: Thu Apr 23 03:38:23 2026 read: IOPS=0, BW=248KiB/s (254kB/s)(2048KiB/8260msec) clat (msec): min=365, max=567, avg=466.43, stdev=142.25 lat (msec): min=365, max=567, avg=466.43, stdev=142.24 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1617, max= 2043, per=73.82%, avg=1830.00, stdev=301.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1240KiB/s (1269kB/s)(10.0MiB/8260msec); 0 zone resets clat (msec): min=256, max=2864, avg=723.56, stdev=812.67 lat (msec): min=256, max=2864, avg=723.70, stdev=812.65 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 309], | 30.00th=[ 347], 40.00th=[ 355], 50.00th=[ 359], 60.00th=[ 409], | 70.00th=[ 414], 80.00th=[ 609], 90.00th=[ 1318], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 2039, max= 3871, per=73.73%, avg=2559.29, stdev=881.48, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 500=66.67%, 750=16.67%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=40.33%, ctx=332, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180017: Thu Apr 23 03:38:23 2026 read: IOPS=0, BW=966KiB/s (989kB/s)(6144KiB/6362msec) clat (usec): min=1107, max=636304, avg=247452.21, stdev=209185.79 lat (usec): min=1109, max=636307, avg=247454.58, stdev=209186.23 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1106], 10.00th=[ 1106], 20.00th=[189793], | 30.00th=[189793], 40.00th=[191890], 50.00th=[191890], 60.00th=[227541], | 70.00th=[238027], 80.00th=[238027], 90.00th=[633340], 95.00th=[633340], | 99.00th=[633340], 99.50th=[633340], 99.90th=[633340], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 2003, max= 4087, per=100.00%, avg=3320.33, stdev=1145.94, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=966KiB/s (989kB/s)(6144KiB/6362msec); 0 zone resets clat (msec): min=294, max=2973, avg=809.21, stdev=1062.24 lat (msec): min=295, max=2973, avg=809.33, stdev=1062.23 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 397], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1510, max= 2043, per=55.59%, avg=1929.50, stdev=209.79, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 2=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=30.00%, ctx=576, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180019: Thu Apr 23 03:38:23 2026 read: IOPS=0, BW=705KiB/s (722kB/s)(5120KiB/7266msec) clat (usec): min=739, max=432577, avg=261049.93, stdev=168284.63 lat (usec): min=741, max=432580, avg=261052.27, stdev=168284.53 clat percentiles (usec): | 1.00th=[ 742], 5.00th=[ 742], 10.00th=[ 742], 20.00th=[ 742], | 30.00th=[204473], 40.00th=[204473], 50.00th=[299893], 60.00th=[299893], | 70.00th=[367002], 80.00th=[367002], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 4007, max= 4087, per=100.00%, avg=4047.00, stdev=56.57, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=987KiB/s (1010kB/s)(7168KiB/7266msec); 0 zone resets clat (msec): min=239, max=2825, avg=840.05, stdev=917.00 lat (msec): min=239, max=2825, avg=840.14, stdev=917.02 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 275], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 447], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 953], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1512, max= 4079, per=65.17%, avg=2262.17, stdev=911.54, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=34.45%, ctx=532, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2479KiB/s (2539kB/s), 248KiB/s-1142KiB/s (254kB/s-1169kB/s), io=20.0MiB (20.0MB), run=6277-8260msec WRITE: bw=3471KiB/s (3554kB/s), 816KiB/s-1240KiB/s (835kB/s-1269kB/s), io=28.0MiB (29.4MB), run=6277-8260msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180018: Thu Apr 23 03:38:23 2026 read: IOPS=0, BW=810KiB/s (829kB/s)(7168KiB/8852msec) clat (msec): min=95, max=2381, avg=879.92, stdev=984.85 lat (msec): min=95, max=2381, avg=879.92, stdev=984.85 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 180], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 330], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 2198], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 2043, max= 4079, per=100.00%, avg=2452.20, stdev=909.41, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=0, BW=578KiB/s (592kB/s)(5120KiB/8852msec); 0 zone resets clat (msec): min=242, max=647, avg=465.17, stdev=166.98 lat (msec): min=242, max=647, avg=465.26, stdev=166.99 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1892, max= 2048, per=62.35%, avg=2001.50, stdev=73.79, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=25.00%, >=2000=16.67% cpu : usr=0.00%, sys=10.67%, ctx=191, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180020: Thu Apr 23 03:38:23 2026 read: IOPS=0, BW=233KiB/s (238kB/s)(2048KiB/8796msec) clat (msec): min=175, max=879, avg=527.65, stdev=497.73 lat (msec): min=175, max=879, avg=527.66, stdev=497.73 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 176], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2043, max= 2043, per=89.10%, avg=2043.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1164KiB/s (1192kB/s)(10.0MiB/8796msec); 0 zone resets clat (msec): min=136, max=3762, avg=769.22, stdev=1096.84 lat (msec): min=136, max=3762, avg=769.40, stdev=1096.82 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 146], | 30.00th=[ 209], 40.00th=[ 275], 50.00th=[ 351], 60.00th=[ 418], | 70.00th=[ 498], 80.00th=[ 743], 90.00th=[ 1150], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1892, max= 4096, per=81.10%, avg=2603.43, stdev=1015.28, samples=7 iops : min= 1, max= 4, avg= 1.86, stdev= 1.21, samples=7 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=16.79%, ctx=566, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180021: Thu Apr 23 03:38:23 2026 read: IOPS=0, BW=701KiB/s (717kB/s)(6144KiB/8770msec) clat (msec): min=143, max=1139, avg=397.09, stdev=391.92 lat (msec): min=143, max=1139, avg=397.10, stdev=391.92 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 228], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2023, max= 3785, per=100.00%, avg=2473.75, stdev=874.23, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=701KiB/s (717kB/s)(6144KiB/8770msec); 0 zone resets clat (msec): min=86, max=3758, avg=1008.48, stdev=1376.34 lat (msec): min=86, max=3758, avg=1008.64, stdev=1376.34 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 667], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 1892, max= 4096, per=94.38%, avg=3029.50, stdev=1227.85, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 750=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=10.40%, ctx=190, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180022: Thu Apr 23 03:38:23 2026 read: IOPS=0, BW=573KiB/s (587kB/s)(5120KiB/8931msec) clat (msec): min=64, max=618, avg=262.10, stdev=211.83 lat (msec): min=64, max=618, avg=262.11, stdev=211.83 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2043, max= 5678, per=100.00%, avg=3860.50, stdev=2570.33, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=803KiB/s (822kB/s)(7168KiB/8931msec); 0 zone resets clat (msec): min=87, max=3750, avg=1039.41, stdev=1235.51 lat (msec): min=87, max=3750, avg=1039.52, stdev=1235.50 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 426], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 625], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 1133], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 2023, max= 2048, per=63.53%, avg=2039.20, stdev= 9.60, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=25.00%, 500=8.33%, 750=33.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=12.73%, ctx=271, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2293KiB/s (2348kB/s), 233KiB/s-810KiB/s (238kB/s-829kB/s), io=20.0MiB (20.0MB), run=8770-8931msec WRITE: bw=3210KiB/s (3287kB/s), 578KiB/s-1164KiB/s (592kB/s-1192kB/s), io=28.0MiB (29.4MB), run=8770-8931msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180030: Thu Apr 23 03:38:43 2026 read: IOPS=0, BW=3213KiB/s (3291kB/s)(12.0MiB/3824msec) clat (msec): min=550, max=2294, avg=1267.39, stdev=912.11 lat (msec): min=550, max=2294, avg=1267.39, stdev=912.11 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=33.95%, ctx=2547, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180032: Thu Apr 23 03:38:43 2026 read: IOPS=0, BW=788KiB/s (807kB/s)(4096KiB/5195msec) clat (nsec): min=2795.6M, max=2795.6M, avg=2795610540.00, stdev= 0.00 lat (nsec): min=2795.6M, max=2795.6M, avg=2795612844.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2802], 5.00th=[ 2802], 10.00th=[ 2802], 20.00th=[ 2802], | 30.00th=[ 2802], 40.00th=[ 2802], 50.00th=[ 2802], 60.00th=[ 2802], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1577KiB/s (1615kB/s)(8192KiB/5195msec); 0 zone resets clat (msec): min=906, max=1350, avg=1128.66, stdev=314.42 lat (msec): min=906, max=1351, avg=1128.96, stdev=314.20 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=16.77%, ctx=757, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180034: Thu Apr 23 03:38:43 2026 write: IOPS=0, BW=2115KiB/s (2166kB/s)(12.0MiB/5810msec); 0 zone resets clat (msec): min=273, max=4553, avg=1922.67, stdev=2302.50 lat (msec): min=273, max=4553, avg=1923.04, stdev=2302.36 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 944], 50.00th=[ 944], 60.00th=[ 944], | 70.00th=[ 4530], 80.00th=[ 4530], 90.00th=[ 4530], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 7757, max= 8175, per=100.00%, avg=7966.00, stdev=295.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=10.07%, ctx=118, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180036: Thu Apr 23 03:38:43 2026 write: IOPS=0, BW=2312KiB/s (2367kB/s)(12.0MiB/5316msec); 0 zone resets clat (msec): min=480, max=3561, avg=1756.23, stdev=1607.65 lat (msec): min=480, max=3562, avg=1756.94, stdev=1607.79 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8110, max= 8192, per=100.00%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=10.18%, ctx=85, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3154KiB/s (3229kB/s), 788KiB/s-3213KiB/s (807kB/s-3291kB/s), io=16.0MiB (16.8MB), run=3824-5195msec WRITE: bw=5640KiB/s (5775kB/s), 1577KiB/s-2312KiB/s (1615kB/s-2367kB/s), io=32.0MiB (33.6MB), run=5195-5810msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180031: Thu Apr 23 03:38:43 2026 read: IOPS=0, BW=2370KiB/s (2427kB/s)(12.0MiB/5185msec) clat (msec): min=464, max=3902, avg=1672.95, stdev=1933.21 lat (msec): min=464, max=3902, avg=1672.95, stdev=1933.21 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.93%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180033: Thu Apr 23 03:38:43 2026 read: IOPS=0, BW=713KiB/s (730kB/s)(4096KiB/5742msec) clat (nsec): min=3068.0M, max=3068.0M, avg=3068959611.00, stdev= 0.00 lat (nsec): min=3068.0M, max=3068.0M, avg=3068964122.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3071], 5.00th=[ 3071], 10.00th=[ 3071], 20.00th=[ 3071], | 30.00th=[ 3071], 40.00th=[ 3071], 50.00th=[ 3071], 60.00th=[ 3071], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1427KiB/s (1461kB/s)(8192KiB/5742msec); 0 zone resets clat (msec): min=982, max=1546, avg=1264.43, stdev=398.94 lat (msec): min=982, max=1546, avg=1264.82, stdev=398.94 clat percentiles (msec): | 1.00th=[ 986], 5.00th=[ 986], 10.00th=[ 986], 20.00th=[ 986], | 30.00th=[ 986], 40.00th=[ 986], 50.00th=[ 986], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=8.64%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180035: Thu Apr 23 03:38:43 2026 write: IOPS=0, BW=2051KiB/s (2100kB/s)(12.0MiB/5992msec); 0 zone resets clat (msec): min=123, max=4703, avg=1951.57, stdev=2426.15 lat (msec): min=123, max=4705, avg=1952.50, stdev=2426.45 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 1028], 50.00th=[ 1028], 60.00th=[ 1028], | 70.00th=[ 4732], 80.00th=[ 4732], 90.00th=[ 4732], 95.00th=[ 4732], | 99.00th=[ 4732], 99.50th=[ 4732], 99.90th=[ 4732], 99.95th=[ 4732], | 99.99th=[ 4732] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=7.63%, ctx=91, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180037: Thu Apr 23 03:38:43 2026 write: IOPS=0, BW=2191KiB/s (2243kB/s)(12.0MiB/5609msec); 0 zone resets clat (msec): min=332, max=3923, avg=1861.46, stdev=1853.61 lat (msec): min=332, max=3923, avg=1861.76, stdev=1853.75 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 3910], 80.00th=[ 3910], 90.00th=[ 3910], 95.00th=[ 3910], | 99.00th=[ 3910], 99.50th=[ 3910], 99.90th=[ 3910], 99.95th=[ 3910], | 99.99th=[ 3910] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.81%, ctx=113, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2853KiB/s (2922kB/s), 713KiB/s-2370KiB/s (730kB/s-2427kB/s), io=16.0MiB (16.8MB), run=5185-5742msec WRITE: bw=5469KiB/s (5600kB/s), 1427KiB/s-2191KiB/s (1461kB/s-2243kB/s), io=32.0MiB (33.6MB), run=5609-5992msec