== sanity test 398b: DIO and buffer IO race ============== 14:09:06 (1780337346) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.35234 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181551: Mon Jun 1 14:11:46 2026 read: IOPS=10, BW=42.5KiB/s (43.5kB/s)(5992KiB/141105msec) clat (usec): min=37, max=233325, avg=51534.74, stdev=33205.15 lat (usec): min=37, max=233327, avg=51537.96, stdev=33204.88 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 13698], 10.00th=[ 19268], 20.00th=[ 25822], | 30.00th=[ 31851], 40.00th=[ 38011], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 61080], 80.00th=[ 73925], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[179307], 99.50th=[196084], 99.90th=[229639], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 111, per=24.83%, avg=42.20, stdev=17.53, samples=276 iops : min= 1, max= 27, avg= 9.88, stdev= 4.42, samples=276 write: IOPS=11, BW=44.6KiB/s (45.7kB/s)(6296KiB/141105msec); 0 zone resets clat (usec): min=1135, max=1508.7k, avg=40320.66, stdev=54598.54 lat (usec): min=1136, max=1508.7k, avg=40326.38, stdev=54598.32 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1663], 10.00th=[ 2638], | 20.00th=[ 5342], 30.00th=[ 9765], 40.00th=[ 19268], | 50.00th=[ 28705], 60.00th=[ 38536], 70.00th=[ 50070], | 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[ 117965], | 99.00th=[ 187696], 99.50th=[ 214959], 99.90th=[ 308282], | 99.95th=[1501561], 99.99th=[1501561] bw ( KiB/s): min= 7, max= 120, per=24.99%, avg=44.49, stdev=21.40, samples=275 iops : min= 1, max= 30, avg=10.46, stdev= 5.41, samples=275 lat (usec) : 50=0.16%, 100=1.30%, 250=0.07%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.29%, 4=4.39%, 10=7.94%, 20=9.15%, 50=37.11% lat (msec) : 100=28.78%, 250=7.52%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=5.06%, ctx=6905, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181552: Mon Jun 1 14:11:46 2026 read: IOPS=10, BW=42.3KiB/s (43.4kB/s)(5940KiB/140306msec) clat (usec): min=47, max=258510, avg=51759.06, stdev=32642.75 lat (usec): min=48, max=258511, avg=51762.40, stdev=32643.60 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 13042], 10.00th=[ 19792], 20.00th=[ 25822], | 30.00th=[ 32113], 40.00th=[ 38011], 50.00th=[ 45351], 60.00th=[ 53740], | 70.00th=[ 62653], 80.00th=[ 73925], 90.00th=[ 92799], 95.00th=[111674], | 99.00th=[170918], 99.50th=[189793], 99.90th=[256902], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 95, per=25.01%, avg=42.51, stdev=15.08, samples=271 iops : min= 1, max= 23, avg= 9.95, stdev= 3.81, samples=271 write: IOPS=11, BW=45.2KiB/s (46.3kB/s)(6348KiB/140306msec); 0 zone resets clat (usec): min=1060, max=1569.6k, avg=39683.16, stdev=54439.94 lat (usec): min=1060, max=1569.6k, avg=39686.73, stdev=54438.88 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 1582], 10.00th=[ 2474], | 20.00th=[ 5080], 30.00th=[ 10028], 40.00th=[ 19792], | 50.00th=[ 29754], 60.00th=[ 39060], 70.00th=[ 50070], | 80.00th=[ 64750], 90.00th=[ 90702], 95.00th=[ 112722], | 99.00th=[ 177210], 99.50th=[ 204473], 99.90th=[ 256902], | 99.95th=[1568670], 99.99th=[1568670] bw ( KiB/s): min= 7, max= 126, per=25.19%, avg=44.84, stdev=20.70, samples=274 iops : min= 1, max= 31, avg=10.54, stdev= 5.21, samples=274 lat (usec) : 50=0.03%, 100=1.33%, 250=0.16%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.10%, 4=4.33%, 10=7.29%, 20=8.63%, 50=37.01% lat (msec) : 100=29.13%, 250=7.75%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=4.96%, ctx=6947, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181553: Mon Jun 1 14:11:46 2026 read: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6028KiB/140109msec) clat (usec): min=35, max=235828, avg=51523.17, stdev=33788.18 lat (usec): min=35, max=235830, avg=51530.21, stdev=33785.87 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 14484], 10.00th=[ 19792], 20.00th=[ 25822], | 30.00th=[ 31327], 40.00th=[ 37487], 50.00th=[ 44303], 60.00th=[ 52167], | 70.00th=[ 60556], 80.00th=[ 72877], 90.00th=[ 92799], 95.00th=[113771], | 99.00th=[177210], 99.50th=[206570], 99.90th=[233833], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 7, max= 111, per=25.38%, avg=43.14, stdev=19.29, samples=272 iops : min= 1, max= 27, avg=10.11, stdev= 4.89, samples=272 write: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6260KiB/140109msec); 0 zone resets clat (usec): min=1163, max=1560.5k, avg=39596.48, stdev=55339.23 lat (usec): min=1165, max=1560.5k, avg=39600.82, stdev=55337.85 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1565], 10.00th=[ 2409], | 20.00th=[ 4752], 30.00th=[ 8356], 40.00th=[ 17433], | 50.00th=[ 28705], 60.00th=[ 38011], 70.00th=[ 50070], | 80.00th=[ 66847], 90.00th=[ 93848], 95.00th=[ 117965], | 99.00th=[ 177210], 99.50th=[ 210764], 99.90th=[ 295699], | 99.95th=[1568670], 99.99th=[1568670] bw ( KiB/s): min= 7, max= 118, per=25.10%, avg=44.68, stdev=21.05, samples=273 iops : min= 1, max= 29, avg=10.51, stdev= 5.29, samples=273 lat (usec) : 50=0.07%, 100=1.43%, 250=0.07%, 500=0.07%, 750=0.03% lat (msec) : 2=3.91%, 4=4.75%, 10=8.24%, 20=8.07%, 50=37.30% lat (msec) : 100=27.64%, 250=8.33%, 500=0.07%, 2000=0.03% cpu : usr=0.08%, sys=4.81%, ctx=6926, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181554: Mon Jun 1 14:11:46 2026 read: IOPS=10, BW=43.2KiB/s (44.2kB/s)(6052KiB/140191msec) clat (usec): min=36, max=1568.2k, avg=51929.65, stdev=52049.55 lat (usec): min=36, max=1568.2k, avg=51932.35, stdev=52049.99 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12256], 10.00th=[ 19530], | 20.00th=[ 25822], 30.00th=[ 31065], 40.00th=[ 37487], | 50.00th=[ 43254], 60.00th=[ 50070], 70.00th=[ 58983], | 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[ 114820], | 99.00th=[ 177210], 99.50th=[ 217056], 99.90th=[ 316670], | 99.95th=[1568670], 99.99th=[1568670] bw ( KiB/s): min= 7, max= 120, per=25.25%, avg=42.92, stdev=18.94, samples=274 iops : min= 1, max= 30, avg=10.06, stdev= 4.79, samples=274 write: IOPS=11, BW=44.5KiB/s (45.5kB/s)(6236KiB/140191msec); 0 zone resets clat (usec): min=1185, max=231768, avg=39191.27, stdev=39804.26 lat (usec): min=1186, max=231770, avg=39193.63, stdev=39804.17 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1549], 10.00th=[ 2474], 20.00th=[ 4948], | 30.00th=[ 8848], 40.00th=[ 16712], 50.00th=[ 26608], 60.00th=[ 38011], | 70.00th=[ 52167], 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[121111], | 99.00th=[168821], 99.50th=[181404], 99.90th=[206570], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 127, per=25.01%, avg=44.52, stdev=20.91, samples=272 iops : min= 1, max= 31, avg=10.46, stdev= 5.26, samples=272 lat (usec) : 50=0.13%, 100=1.24%, 250=0.29%, 500=0.10% lat (msec) : 2=3.94%, 4=4.65%, 10=8.11%, 20=8.50%, 50=37.47% lat (msec) : 100=26.66%, 250=8.79%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=4.84%, ctx=6935, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=170KiB/s (174kB/s), 42.3KiB/s-43.2KiB/s (43.4kB/s-44.2kB/s), io=23.4MiB (24.6MB), run=140109-141105msec WRITE: bw=178KiB/s (182kB/s), 44.5KiB/s-45.2KiB/s (45.5kB/s-46.3kB/s), io=24.6MiB (25.7MB), run=140109-141105msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181556: Mon Jun 1 14:12:22 2026 read: IOPS=8, BW=34.1KiB/s (34.9kB/s)(5992KiB/175780msec) clat (msec): min=6, max=1445, avg=46.95, stdev=57.60 lat (msec): min=6, max=1445, avg=46.95, stdev=57.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 66], 90.00th=[ 108], 95.00th=[ 142], | 99.00th=[ 228], 99.50th=[ 268], 99.90th=[ 368], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 7, max= 127, per=25.85%, avg=34.89, stdev=26.24, samples=334 iops : min= 1, max= 31, avg= 8.05, stdev= 6.61, samples=334 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6296KiB/175780msec); 0 zone resets clat (msec): min=10, max=354, avg=66.88, stdev=51.54 lat (msec): min=10, max=354, avg=66.89, stdev=51.54 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 59], | 70.00th=[ 80], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 169], | 99.00th=[ 271], 99.50th=[ 296], 99.90th=[ 351], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 118, per=25.21%, avg=35.55, stdev=25.10, samples=344 iops : min= 1, max= 29, avg= 8.22, stdev= 6.33, samples=344 lat (msec) : 10=1.53%, 20=15.79%, 50=45.64%, 100=20.87%, 250=15.30% lat (msec) : 500=0.85%, 2000=0.03% cpu : usr=0.06%, sys=2.09%, ctx=5037, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181557: Mon Jun 1 14:12:22 2026 read: IOPS=8, BW=33.5KiB/s (34.3kB/s)(5940KiB/177518msec) clat (msec): min=5, max=1634, avg=47.77, stdev=62.38 lat (msec): min=5, max=1634, avg=47.77, stdev=62.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 49], 80.00th=[ 69], 90.00th=[ 108], 95.00th=[ 150], | 99.00th=[ 228], 99.50th=[ 296], 99.90th=[ 376], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 7, max= 135, per=25.72%, avg=34.72, stdev=26.42, samples=331 iops : min= 1, max= 33, avg= 8.01, stdev= 6.65, samples=331 write: IOPS=8, BW=35.8KiB/s (36.6kB/s)(6348KiB/177518msec); 0 zone resets clat (msec): min=11, max=342, avg=67.04, stdev=51.88 lat (msec): min=11, max=342, avg=67.05, stdev=51.89 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 48], 60.00th=[ 61], | 70.00th=[ 79], 80.00th=[ 103], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 271], 99.50th=[ 288], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 135, per=25.35%, avg=35.74, stdev=25.76, samples=343 iops : min= 1, max= 33, avg= 8.27, stdev= 6.50, samples=343 lat (msec) : 10=1.50%, 20=16.41%, 50=43.55%, 100=22.20%, 250=15.33% lat (msec) : 500=0.98%, 2000=0.03% cpu : usr=0.07%, sys=2.08%, ctx=5104, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181558: Mon Jun 1 14:12:22 2026 read: IOPS=8, BW=34.2KiB/s (35.1kB/s)(6028KiB/176054msec) clat (msec): min=6, max=310, avg=46.29, stdev=43.62 lat (msec): min=6, max=310, avg=46.29, stdev=43.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 70], 90.00th=[ 109], 95.00th=[ 146], | 99.00th=[ 207], 99.50th=[ 234], 99.90th=[ 292], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 135, per=25.86%, avg=34.91, stdev=25.50, samples=334 iops : min= 1, max= 33, avg= 8.07, stdev= 6.42, samples=334 write: IOPS=8, BW=35.6KiB/s (36.4kB/s)(6260KiB/176054msec); 0 zone resets clat (msec): min=11, max=1609, avg=67.80, stdev=64.41 lat (msec): min=11, max=1609, avg=67.80, stdev=64.41 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 79], 80.00th=[ 104], 90.00th=[ 138], 95.00th=[ 169], | 99.00th=[ 266], 99.50th=[ 305], 99.90th=[ 368], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 7, max= 127, per=25.09%, avg=35.38, stdev=25.28, samples=342 iops : min= 1, max= 31, avg= 8.18, stdev= 6.37, samples=342 lat (msec) : 10=1.56%, 20=15.82%, 50=44.17%, 100=22.27%, 250=15.43% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.07%, sys=2.09%, ctx=4978, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181559: Mon Jun 1 14:12:22 2026 read: IOPS=8, BW=34.2KiB/s (35.0kB/s)(6052KiB/176968msec) clat (msec): min=6, max=373, avg=47.58, stdev=47.64 lat (msec): min=6, max=373, avg=47.59, stdev=47.64 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 38], | 70.00th=[ 50], 80.00th=[ 71], 90.00th=[ 111], 95.00th=[ 148], | 99.00th=[ 236], 99.50th=[ 271], 99.90th=[ 363], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 143, per=26.12%, avg=35.27, stdev=26.61, samples=332 iops : min= 1, max= 35, avg= 8.15, stdev= 6.71, samples=332 write: IOPS=8, BW=35.2KiB/s (36.1kB/s)(6236KiB/176968msec); 0 zone resets clat (msec): min=10, max=1527, avg=67.19, stdev=62.21 lat (msec): min=10, max=1527, avg=67.19, stdev=62.21 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 48], 60.00th=[ 62], | 70.00th=[ 79], 80.00th=[ 104], 90.00th=[ 136], 95.00th=[ 169], | 99.00th=[ 257], 99.50th=[ 288], 99.90th=[ 342], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 7, max= 111, per=25.09%, avg=35.38, stdev=25.62, samples=341 iops : min= 1, max= 27, avg= 8.18, stdev= 6.45, samples=341 lat (msec) : 10=1.73%, 20=16.05%, 50=43.55%, 100=21.97%, 250=15.72% lat (msec) : 500=0.94%, 2000=0.03% cpu : usr=0.06%, sys=2.10%, ctx=5043, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (139kB/s), 33.5KiB/s-34.2KiB/s (34.3kB/s-35.1kB/s), io=23.4MiB (24.6MB), run=175780-177518msec WRITE: bw=142KiB/s (145kB/s), 35.2KiB/s-35.8KiB/s (36.1kB/s-36.7kB/s), io=24.6MiB (25.7MB), run=175780-177518msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181602: Mon Jun 1 14:13:10 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(5920KiB/34639msec) clat (usec): min=36, max=188443, avg=51528.59, stdev=32490.55 lat (usec): min=36, max=188444, avg=51532.95, stdev=32489.92 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 68], 10.00th=[ 1713], 20.00th=[ 26608], | 30.00th=[ 33817], 40.00th=[ 41681], 50.00th=[ 48497], 60.00th=[ 56361], | 70.00th=[ 64226], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[109577], | 99.00th=[160433], 99.50th=[170918], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 92, max= 319, per=24.43%, avg=168.30, stdev=53.21, samples=67 iops : min= 5, max= 19, avg= 9.78, stdev= 3.38, samples=67 write: IOPS=11, BW=184KiB/s (188kB/s)(6368KiB/34639msec); 0 zone resets clat (usec): min=1652, max=221175, avg=38648.12, stdev=37346.91 lat (usec): min=1653, max=221177, avg=38652.84, stdev=37345.71 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2147], 10.00th=[ 3458], 20.00th=[ 6915], | 30.00th=[ 10814], 40.00th=[ 20579], 50.00th=[ 28967], 60.00th=[ 36963], | 70.00th=[ 47449], 80.00th=[ 64226], 90.00th=[ 91751], 95.00th=[119014], | 99.00th=[162530], 99.50th=[196084], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 414, per=25.19%, avg=182.64, stdev=77.90, samples=67 iops : min= 1, max= 25, avg=10.67, stdev= 4.89, samples=67 lat (usec) : 50=0.26%, 100=3.78%, 250=0.39% lat (msec) : 2=2.47%, 4=3.91%, 10=8.85%, 20=7.29%, 50=35.16% lat (msec) : 100=29.56%, 250=8.33% cpu : usr=0.07%, sys=5.39%, ctx=1807, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181603: Mon Jun 1 14:13:10 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5744KiB/34696msec) clat (usec): min=53, max=236636, avg=52127.39, stdev=34912.03 lat (usec): min=54, max=236637, avg=52128.79, stdev=34911.98 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 13698], 20.00th=[ 27919], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 46924], 60.00th=[ 54264], | 70.00th=[ 60556], 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[116917], | 99.00th=[166724], 99.50th=[221250], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 31, max= 350, per=23.94%, avg=164.94, stdev=60.00, samples=68 iops : min= 1, max= 21, avg= 9.59, stdev= 3.77, samples=68 write: IOPS=11, BW=189KiB/s (193kB/s)(6544KiB/34696msec); 0 zone resets clat (usec): min=1703, max=186030, avg=38490.79, stdev=33875.69 lat (usec): min=1705, max=186032, avg=38504.49, stdev=33879.57 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2540], 10.00th=[ 3752], 20.00th=[ 6390], | 30.00th=[ 11994], 40.00th=[ 21365], 50.00th=[ 30802], 60.00th=[ 42206], | 70.00th=[ 52691], 80.00th=[ 66847], 90.00th=[ 87557], 95.00th=[102237], | 99.00th=[152044], 99.50th=[156238], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 31, max= 440, per=25.87%, avg=187.56, stdev=83.19, samples=68 iops : min= 1, max= 27, avg=11.00, stdev= 5.29, samples=68 lat (usec) : 100=3.39%, 250=0.52%, 500=0.26% lat (msec) : 2=1.17%, 4=4.95%, 10=8.20%, 20=8.20%, 50=34.11% lat (msec) : 100=32.81%, 250=6.38% cpu : usr=0.09%, sys=5.45%, ctx=1766, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181604: Mon Jun 1 14:13:10 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(6256KiB/34758msec) clat (usec): min=39, max=351701, avg=53529.71, stdev=37132.81 lat (usec): min=39, max=351702, avg=53531.26, stdev=37133.06 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 72], 10.00th=[ 18482], 20.00th=[ 27132], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 47449], 60.00th=[ 53740], | 70.00th=[ 63177], 80.00th=[ 74974], 90.00th=[ 98042], 95.00th=[121111], | 99.00th=[168821], 99.50th=[191890], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 62, max= 416, per=26.07%, avg=179.65, stdev=67.26, samples=68 iops : min= 3, max= 26, avg=10.50, stdev= 4.29, samples=68 write: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34758msec); 0 zone resets clat (usec): min=1704, max=226939, avg=36409.97, stdev=35269.33 lat (usec): min=1705, max=226940, avg=36418.22, stdev=35267.72 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2114], 10.00th=[ 4113], 20.00th=[ 7242], | 30.00th=[ 10683], 40.00th=[ 17433], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 60031], 90.00th=[ 85459], 95.00th=[108528], | 99.00th=[166724], 99.50th=[189793], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 31, max= 391, per=23.52%, avg=170.49, stdev=73.49, samples=68 iops : min= 1, max= 24, avg= 9.93, stdev= 4.63, samples=68 lat (usec) : 50=0.13%, 100=3.12%, 250=0.39%, 1000=0.13% lat (msec) : 2=1.56%, 4=3.12%, 10=9.11%, 20=9.11%, 50=37.11% lat (msec) : 100=27.99%, 250=8.07%, 500=0.13% cpu : usr=0.06%, sys=5.46%, ctx=1822, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181605: Mon Jun 1 14:13:10 2026 read: IOPS=11, BW=183KiB/s (188kB/s)(6032KiB/32893msec) clat (usec): min=53, max=304982, avg=48815.96, stdev=34407.19 lat (usec): min=54, max=304983, avg=48848.81, stdev=34402.95 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 126], 20.00th=[ 25035], | 30.00th=[ 31065], 40.00th=[ 38011], 50.00th=[ 46400], 60.00th=[ 53216], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 88605], 95.00th=[101188], | 99.00th=[158335], 99.50th=[210764], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 31, max= 347, per=26.78%, avg=184.49, stdev=66.26, samples=63 iops : min= 1, max= 21, avg=10.81, stdev= 4.22, samples=63 write: IOPS=11, BW=190KiB/s (195kB/s)(6256KiB/32893msec); 0 zone resets clat (usec): min=1776, max=166584, avg=36461.40, stdev=34744.12 lat (usec): min=1778, max=166587, avg=36471.30, stdev=34746.57 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2376], 10.00th=[ 3458], 20.00th=[ 6194], | 30.00th=[ 9503], 40.00th=[ 15139], 50.00th=[ 24511], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 65799], 90.00th=[ 94897], 95.00th=[107480], | 99.00th=[135267], 99.50th=[154141], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 31, max= 404, per=26.15%, avg=189.58, stdev=83.21, samples=64 iops : min= 1, max= 25, avg=11.12, stdev= 5.25, samples=64 lat (usec) : 100=4.30%, 250=0.78%, 1000=0.13% lat (msec) : 2=1.43%, 4=5.73%, 10=10.16%, 20=8.20%, 50=33.20% lat (msec) : 100=29.82%, 250=6.12%, 500=0.13% cpu : usr=0.06%, sys=5.26%, ctx=1684, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=689KiB/s (706kB/s), 166KiB/s-183KiB/s (170kB/s-188kB/s), io=23.4MiB (24.5MB), run=32893-34758msec WRITE: bw=725KiB/s (742kB/s), 174KiB/s-190KiB/s (178kB/s-195kB/s), io=24.6MiB (25.8MB), run=32893-34758msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181607: Mon Jun 1 14:13:24 2026 read: IOPS=7, BW=122KiB/s (125kB/s)(5920KiB/48626msec) clat (msec): min=8, max=341, avg=55.27, stdev=42.79 lat (msec): min=8, max=341, avg=55.28, stdev=42.80 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 77], 90.00th=[ 103], 95.00th=[ 133], | 99.00th=[ 213], 99.50th=[ 305], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 286, per=25.19%, avg=122.70, stdev=68.70, samples=93 iops : min= 1, max= 17, avg= 6.87, stdev= 4.36, samples=93 write: IOPS=8, BW=131KiB/s (134kB/s)(6368KiB/48626msec); 0 zone resets clat (msec): min=15, max=254, avg=70.64, stdev=44.70 lat (msec): min=15, max=254, avg=70.65, stdev=44.70 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 56], 60.00th=[ 65], | 70.00th=[ 84], 80.00th=[ 107], 90.00th=[ 136], 95.00th=[ 157], | 99.00th=[ 228], 99.50th=[ 251], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 349, per=25.70%, avg=131.85, stdev=71.57, samples=94 iops : min= 1, max= 21, avg= 7.44, stdev= 4.50, samples=94 lat (msec) : 10=0.26%, 20=5.99%, 50=44.14%, 100=32.16%, 250=17.06% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.13%, ctx=1395, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181608: Mon Jun 1 14:13:24 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5744KiB/49103msec) clat (msec): min=6, max=327, avg=54.18, stdev=41.90 lat (msec): min=6, max=327, avg=54.18, stdev=41.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 62], 80.00th=[ 79], 90.00th=[ 114], 95.00th=[ 138], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 351, per=24.62%, avg=119.88, stdev=72.56, samples=92 iops : min= 1, max= 21, avg= 6.68, stdev= 4.58, samples=92 write: IOPS=8, BW=133KiB/s (136kB/s)(6544KiB/49103msec); 0 zone resets clat (msec): min=14, max=311, avg=72.29, stdev=48.07 lat (msec): min=14, max=311, avg=72.29, stdev=48.07 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 49], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 83], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 174], | 99.00th=[ 226], 99.50th=[ 241], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 381, per=25.37%, avg=130.15, stdev=73.37, samples=96 iops : min= 1, max= 23, avg= 7.33, stdev= 4.64, samples=96 lat (msec) : 10=0.91%, 20=7.68%, 50=41.67%, 100=31.64%, 250=17.71% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.00%, ctx=1324, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181609: Mon Jun 1 14:13:24 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(6256KiB/48608msec) clat (msec): min=5, max=229, avg=52.63, stdev=39.13 lat (msec): min=5, max=229, avg=52.63, stdev=39.13 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 75], 90.00th=[ 111], 95.00th=[ 134], | 99.00th=[ 190], 99.50th=[ 209], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 30, max= 480, per=26.43%, avg=128.69, stdev=88.82, samples=95 iops : min= 1, max= 30, avg= 7.24, stdev= 5.64, samples=95 write: IOPS=7, BW=124KiB/s (127kB/s)(6032KiB/48608msec); 0 zone resets clat (msec): min=17, max=240, avg=74.20, stdev=47.01 lat (msec): min=17, max=240, avg=74.21, stdev=47.00 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 72], | 70.00th=[ 89], 80.00th=[ 114], 90.00th=[ 150], 95.00th=[ 165], | 99.00th=[ 222], 99.50th=[ 234], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 319, per=23.98%, avg=123.01, stdev=62.39, samples=94 iops : min= 1, max= 19, avg= 6.88, stdev= 3.91, samples=94 lat (msec) : 10=0.65%, 20=5.21%, 50=47.40%, 100=27.99%, 250=18.75% cpu : usr=0.06%, sys=2.11%, ctx=1427, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181610: Mon Jun 1 14:13:24 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(6032KiB/48051msec) clat (msec): min=8, max=197, avg=52.74, stdev=37.24 lat (msec): min=8, max=197, avg=52.77, stdev=37.23 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 57], 80.00th=[ 69], 90.00th=[ 107], 95.00th=[ 140], | 99.00th=[ 188], 99.50th=[ 197], 99.90th=[ 199], 99.95th=[ 199], | 99.99th=[ 199] bw ( KiB/s): min= 30, max= 383, per=26.43%, avg=128.69, stdev=71.26, samples=91 iops : min= 1, max= 23, avg= 7.24, stdev= 4.48, samples=91 write: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48051msec); 0 zone resets clat (msec): min=14, max=268, avg=71.81, stdev=45.79 lat (msec): min=14, max=268, avg=71.82, stdev=45.79 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 58], 60.00th=[ 69], | 70.00th=[ 83], 80.00th=[ 105], 90.00th=[ 138], 95.00th=[ 163], | 99.00th=[ 239], 99.50th=[ 257], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 381, per=25.83%, avg=132.50, stdev=68.92, samples=92 iops : min= 1, max= 23, avg= 7.49, stdev= 4.39, samples=92 lat (msec) : 10=0.26%, 20=7.03%, 50=44.01%, 100=32.16%, 250=16.28% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.19%, ctx=1346, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=488KiB/s (499kB/s), 117KiB/s-129KiB/s (120kB/s-132kB/s), io=23.4MiB (24.5MB), run=48051-49103msec WRITE: bw=513KiB/s (526kB/s), 124KiB/s-133KiB/s (127kB/s-136kB/s), io=24.6MiB (25.8MB), run=48051-49103msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181622: Mon Jun 1 14:13:39 2026 read: IOPS=2, BW=2104KiB/s (2154kB/s)(7168KiB/3407msec) clat (msec): min=128, max=315, avg=208.84, stdev=66.03 lat (msec): min=128, max=315, avg=208.85, stdev=66.03 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 153], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 197], 60.00th=[ 207], | 70.00th=[ 207], 80.00th=[ 275], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 2035, max= 4179, per=87.91%, avg=3431.00, stdev=1210.00, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1503KiB/s (1539kB/s)(5120KiB/3407msec); 0 zone resets clat (msec): min=182, max=660, avg=384.61, stdev=224.28 lat (msec): min=182, max=660, avg=384.73, stdev=224.27 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 211], 40.00th=[ 211], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2023, max= 4079, per=46.60%, avg=2546.25, stdev=1021.88, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=18.23%, ctx=212, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181623: Mon Jun 1 14:13:39 2026 read: IOPS=0, BW=428KiB/s (438kB/s)(2048KiB/4789msec) clat (msec): min=25, max=153, avg=89.31, stdev=90.25 lat (msec): min=25, max=153, avg=89.31, stdev=90.25 clat percentiles (msec): | 1.00th=[ 26], 5.00th=[ 26], 10.00th=[ 26], 20.00th=[ 26], | 30.00th=[ 26], 40.00th=[ 26], 50.00th=[ 26], 60.00th=[ 155], | 70.00th=[ 155], 80.00th=[ 155], 90.00th=[ 155], 95.00th=[ 155], | 99.00th=[ 155], 99.50th=[ 155], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 1367, max= 2035, per=43.58%, avg=1701.00, stdev=472.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2138KiB/s (2190kB/s)(10.0MiB/4789msec); 0 zone resets clat (msec): min=191, max=802, avg=449.42, stdev=223.30 lat (msec): min=191, max=802, avg=449.50, stdev=223.30 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 211], | 30.00th=[ 220], 40.00th=[ 309], 50.00th=[ 355], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 592], 90.00th=[ 735], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2000, max= 4079, per=43.35%, avg=2368.67, stdev=838.05, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 50=8.33%, 250=33.33%, 500=16.67%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=12.66%, ctx=173, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181624: Mon Jun 1 14:13:39 2026 read: IOPS=1, BW=1171KiB/s (1199kB/s)(6144KiB/5247msec) clat (usec): min=447, max=319583, avg=195015.65, stdev=108458.90 lat (usec): min=448, max=319584, avg=195017.19, stdev=108459.05 clat percentiles (usec): | 1.00th=[ 449], 5.00th=[ 449], 10.00th=[ 449], 20.00th=[173016], | 30.00th=[173016], 40.00th=[187696], 50.00th=[187696], 60.00th=[238027], | 70.00th=[250610], 80.00th=[250610], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 2023, max= 4047, per=64.98%, avg=2536.00, stdev=1007.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1171KiB/s (1199kB/s)(6144KiB/5247msec); 0 zone resets clat (msec): min=302, max=1137, avg=637.02, stdev=309.52 lat (msec): min=302, max=1138, avg=637.67, stdev=309.67 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 709], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2000, max= 2048, per=37.15%, avg=2029.80, stdev=18.94, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=10.85%, ctx=147, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181625: Mon Jun 1 14:13:39 2026 read: IOPS=1, BW=1169KiB/s (1197kB/s)(5120KiB/4380msec) clat (msec): min=125, max=314, avg=228.29, stdev=73.72 lat (msec): min=125, max=314, avg=228.29, stdev=73.72 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2000, max= 4071, per=69.26%, avg=2703.33, stdev=1184.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1637KiB/s (1676kB/s)(7168KiB/4380msec); 0 zone resets clat (msec): min=233, max=882, avg=447.56, stdev=262.08 lat (msec): min=233, max=882, avg=447.72, stdev=262.02 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 239], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 372], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 743], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1414, max= 4047, per=41.44%, avg=2264.50, stdev=907.66, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=14.66%, ctx=273, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3903KiB/s (3997kB/s), 428KiB/s-2104KiB/s (438kB/s-2154kB/s), io=20.0MiB (20.0MB), run=3407-5247msec WRITE: bw=5464KiB/s (5596kB/s), 1171KiB/s-2138KiB/s (1199kB/s-2190kB/s), io=28.0MiB (29.4MB), run=3407-5247msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181628: Mon Jun 1 14:13:39 2026 read: IOPS=1, BW=1540KiB/s (1577kB/s)(7168KiB/4654msec) clat (msec): min=123, max=886, avg=291.14, stdev=269.77 lat (msec): min=123, max=886, avg=291.14, stdev=269.77 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 127], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 194], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 279], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 1822, max= 4071, per=60.39%, avg=2388.60, stdev=944.34, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1100KiB/s (1127kB/s)(5120KiB/4654msec); 0 zone resets clat (msec): min=118, max=875, avg=519.97, stdev=277.08 lat (msec): min=118, max=875, avg=520.81, stdev=277.27 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 426], 40.00th=[ 426], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 2011, max= 4055, per=45.65%, avg=2528.00, stdev=1018.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=3.68%, ctx=83, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181629: Mon Jun 1 14:13:39 2026 read: IOPS=0, BW=400KiB/s (409kB/s)(2048KiB/5122msec) clat (msec): min=157, max=412, avg=285.05, stdev=180.59 lat (msec): min=157, max=412, avg=285.05, stdev=180.59 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1906, max= 2011, per=49.52%, avg=1958.50, stdev=74.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1999KiB/s (2047kB/s)(10.0MiB/5122msec); 0 zone resets clat (msec): min=117, max=789, avg=454.81, stdev=208.04 lat (msec): min=118, max=789, avg=454.91, stdev=208.03 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 174], | 30.00th=[ 372], 40.00th=[ 380], 50.00th=[ 435], 60.00th=[ 498], | 70.00th=[ 542], 80.00th=[ 575], 90.00th=[ 667], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2011, max= 4063, per=47.01%, avg=2603.57, stdev=994.28, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=5.00%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181630: Mon Jun 1 14:13:39 2026 read: IOPS=1, BW=1187KiB/s (1215kB/s)(6144KiB/5177msec) clat (msec): min=95, max=189, avg=136.75, stdev=35.27 lat (msec): min=95, max=189, avg=136.75, stdev=35.27 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 127], 50.00th=[ 127], 60.00th=[ 150], | 70.00th=[ 157], 80.00th=[ 157], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 2027, max= 4039, per=85.03%, avg=3363.00, stdev=1157.04, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1187KiB/s (1215kB/s)(6144KiB/5177msec); 0 zone resets clat (msec): min=369, max=1374, avg=719.75, stdev=421.19 lat (msec): min=369, max=1374, avg=719.89, stdev=421.12 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 659], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 2011, max= 2035, per=36.53%, avg=2023.00, stdev= 9.47, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=16.67% cpu : usr=0.04%, sys=5.72%, ctx=132, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181631: Mon Jun 1 14:13:39 2026 read: IOPS=0, BW=1010KiB/s (1034kB/s)(5120KiB/5069msec) clat (msec): min=92, max=710, avg=238.05, stdev=265.00 lat (msec): min=92, max=710, avg=238.05, stdev=265.00 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 2011, max= 4039, per=68.07%, avg=2692.33, stdev=1166.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1414KiB/s (1448kB/s)(7168KiB/5069msec); 0 zone resets clat (msec): min=130, max=1229, avg=553.85, stdev=361.14 lat (msec): min=131, max=1229, avg=553.94, stdev=361.12 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 211], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 514], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 693], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 1928, max= 2027, per=35.96%, avg=1991.50, stdev=44.22, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=33.33%, 2000=8.33% cpu : usr=0.02%, sys=3.33%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3956KiB/s (4051kB/s), 400KiB/s-1540KiB/s (409kB/s-1577kB/s), io=20.0MiB (20.0MB), run=4654-5177msec WRITE: bw=5538KiB/s (5671kB/s), 1100KiB/s-1999KiB/s (1127kB/s-2047kB/s), io=28.0MiB (29.4MB), run=4654-5177msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181637: Mon Jun 1 14:13:54 2026 read: IOPS=0, BW=3576KiB/s (3662kB/s)(12.0MiB/3436msec) clat (msec): min=294, max=1590, avg=1104.96, stdev=706.23 lat (msec): min=294, max=1590, avg=1104.97, stdev=706.23 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.94%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181638: Mon Jun 1 14:13:54 2026 read: IOPS=0, BW=1172KiB/s (1200kB/s)(4096KiB/3496msec) clat (nsec): min=665872k, max=665872k, avg=665871913.00, stdev= 0.00 lat (nsec): min=665874k, max=665874k, avg=665874323.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2343KiB/s (2399kB/s)(8192KiB/3496msec); 0 zone resets clat (msec): min=1196, max=1564, avg=1380.45, stdev=260.76 lat (msec): min=1196, max=1565, avg=1380.69, stdev=260.78 clat percentiles (msec): | 1.00th=[ 1200], 5.00th=[ 1200], 10.00th=[ 1200], 20.00th=[ 1200], | 30.00th=[ 1200], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1569], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8110, max= 8110, per=86.53%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.06%, ctx=67, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181639: Mon Jun 1 14:13:54 2026 write: IOPS=1, BW=5378KiB/s (5507kB/s)(12.0MiB/2285msec); 0 zone resets clat (msec): min=269, max=1409, avg=711.43, stdev=611.31 lat (msec): min=269, max=1412, avg=712.99, stdev=613.27 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 6736, max= 8159, per=79.47%, avg=7447.50, stdev=1006.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.52%, ctx=64, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181640: Mon Jun 1 14:13:54 2026 write: IOPS=1, BW=5528KiB/s (5660kB/s)(12.0MiB/2223msec); 0 zone resets clat (msec): min=349, max=1317, avg=720.56, stdev=522.09 lat (msec): min=351, max=1317, avg=721.34, stdev=521.69 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 6023, max= 8159, per=75.66%, avg=7091.00, stdev=1510.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.68%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4686KiB/s (4799kB/s), 1172KiB/s-3576KiB/s (1200kB/s-3662kB/s), io=16.0MiB (16.8MB), run=3436-3496msec WRITE: bw=9373KiB/s (9598kB/s), 2343KiB/s-5528KiB/s (2399kB/s-5660kB/s), io=32.0MiB (33.6MB), run=2223-3496msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181642: Mon Jun 1 14:13:55 2026 read: IOPS=1, BW=5198KiB/s (5323kB/s)(12.0MiB/2364msec) clat (msec): min=600, max=881, avg=784.86, stdev=159.41 lat (msec): min=600, max=881, avg=784.86, stdev=159.41 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=17.65%, ctx=338, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181643: Mon Jun 1 14:13:55 2026 read: IOPS=0, BW=1128KiB/s (1155kB/s)(4096KiB/3630msec) clat (nsec): min=867313k, max=867313k, avg=867313441.00, stdev= 0.00 lat (nsec): min=867317k, max=867317k, avg=867316564.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2257KiB/s (2311kB/s)(8192KiB/3630msec); 0 zone resets clat (msec): min=1034, max=1717, avg=1376.02, stdev=482.70 lat (msec): min=1037, max=1719, avg=1378.33, stdev=482.26 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8110, max= 8110, per=89.85%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.28%, ctx=84, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181644: Mon Jun 1 14:13:55 2026 write: IOPS=0, BW=3619KiB/s (3706kB/s)(12.0MiB/3395msec); 0 zone resets clat (msec): min=553, max=1649, avg=1128.31, stdev=549.61 lat (msec): min=555, max=1649, avg=1129.15, stdev=549.32 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8143, max= 8159, per=90.31%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.30%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181645: Mon Jun 1 14:13:55 2026 write: IOPS=0, BW=3419KiB/s (3501kB/s)(12.0MiB/3594msec); 0 zone resets clat (msec): min=471, max=2466, avg=1195.47, stdev=1104.54 lat (msec): min=475, max=2468, avg=1197.68, stdev=1104.26 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 6177, max= 8143, per=79.33%, avg=7160.00, stdev=1390.17, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.17%, sys=4.23%, ctx=70, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4513KiB/s (4622kB/s), 1128KiB/s-5198KiB/s (1155kB/s-5323kB/s), io=16.0MiB (16.8MB), run=2364-3630msec WRITE: bw=9027KiB/s (9244kB/s), 2257KiB/s-3619KiB/s (2311kB/s-3706kB/s), io=32.0MiB (33.6MB), run=3395-3630msec