== sanity test 398b: DIO and buffer IO race ============== 19:34:14 (1788564854) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.23404 s, 11.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145440: Fri Sep 4 19:36:07 2026 read: IOPS=14, BW=59.9KiB/s (61.3kB/s)(5992KiB/100016msec) clat (usec): min=32, max=696726, avg=30427.40, stdev=28260.15 lat (usec): min=32, max=696727, avg=30431.72, stdev=28264.31 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 54], 10.00th=[ 73], 20.00th=[ 14615], | 30.00th=[ 17957], 40.00th=[ 21365], 50.00th=[ 25560], 60.00th=[ 30278], | 70.00th=[ 35914], 80.00th=[ 45351], 90.00th=[ 61604], 95.00th=[ 72877], | 99.00th=[103285], 99.50th=[117965], 99.90th=[160433], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 126, per=25.16%, avg=60.13, stdev=24.88, samples=196 iops : min= 1, max= 31, avg=14.41, stdev= 6.27, samples=196 write: IOPS=15, BW=62.9KiB/s (64.5kB/s)(6296KiB/100016msec); 0 zone resets clat (usec): min=947, max=404191, avg=34390.37, stdev=35801.39 lat (usec): min=948, max=404193, avg=34392.14, stdev=35801.34 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1549], 20.00th=[ 3687], | 30.00th=[ 7767], 40.00th=[ 17433], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 44827], 80.00th=[ 58983], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[141558], 99.50th=[175113], 99.90th=[308282], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 7, max= 143, per=25.00%, avg=62.75, stdev=22.34, samples=197 iops : min= 1, max= 35, avg=15.08, stdev= 5.62, samples=197 lat (usec) : 50=1.46%, 100=3.97%, 250=0.33%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=6.28%, 4=4.23%, 10=6.90%, 20=15.92%, 50=39.10% lat (msec) : 100=18.03%, 250=3.06%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=6.69%, ctx=6600, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145441: Fri Sep 4 19:36:07 2026 read: IOPS=15, BW=60.1KiB/s (61.5kB/s)(5940KiB/98854msec) clat (usec): min=28, max=189708, avg=31016.52, stdev=23929.70 lat (usec): min=29, max=189710, avg=31017.87, stdev=23929.99 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 55], 10.00th=[ 92], 20.00th=[ 14353], | 30.00th=[ 18220], 40.00th=[ 21890], 50.00th=[ 26346], 60.00th=[ 31327], | 70.00th=[ 38011], 80.00th=[ 46400], 90.00th=[ 60031], 95.00th=[ 76022], | 99.00th=[109577], 99.50th=[139461], 99.90th=[177210], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 7, max= 142, per=25.01%, avg=59.77, stdev=25.05, samples=195 iops : min= 1, max= 35, avg=14.33, stdev= 6.29, samples=195 write: IOPS=16, BW=64.2KiB/s (65.8kB/s)(6348KiB/98854msec); 0 zone resets clat (usec): min=929, max=674161, avg=33050.97, stdev=37184.30 lat (usec): min=930, max=674163, avg=33052.29, stdev=37184.28 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1565], 20.00th=[ 3458], | 30.00th=[ 7046], 40.00th=[ 15533], 50.00th=[ 24511], 60.00th=[ 32637], | 70.00th=[ 43254], 80.00th=[ 56361], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[170918], 99.90th=[295699], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 14, max= 133, per=25.40%, avg=63.75, stdev=24.26, samples=195 iops : min= 3, max= 33, avg=15.33, stdev= 6.15, samples=195 lat (usec) : 50=1.27%, 100=3.78%, 250=0.49%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=6.87%, 4=4.49%, 10=7.13%, 20=15.69%, 50=39.03% lat (msec) : 100=17.84%, 250=2.90%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=6.73%, ctx=6560, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145442: Fri Sep 4 19:36:07 2026 read: IOPS=15, BW=60.2KiB/s (61.7kB/s)(6028KiB/100073msec) clat (usec): min=26, max=217023, avg=30318.34, stdev=24627.13 lat (usec): min=27, max=217024, avg=30319.47, stdev=24627.18 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 67], 20.00th=[ 13304], | 30.00th=[ 17695], 40.00th=[ 21103], 50.00th=[ 25297], 60.00th=[ 30016], | 70.00th=[ 36963], 80.00th=[ 47449], 90.00th=[ 60556], 95.00th=[ 74974], | 99.00th=[107480], 99.50th=[147850], 99.90th=[193987], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 136, per=25.40%, avg=60.71, stdev=24.01, samples=195 iops : min= 1, max= 34, avg=14.56, stdev= 6.06, samples=195 write: IOPS=15, BW=62.6KiB/s (64.1kB/s)(6260KiB/100073msec); 0 zone resets clat (usec): min=847, max=885395, avg=34530.79, stdev=41404.64 lat (usec): min=848, max=885397, avg=34533.12, stdev=41403.90 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1582], 20.00th=[ 3458], | 30.00th=[ 7177], 40.00th=[ 16712], 50.00th=[ 26084], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[156238], 99.50th=[191890], 99.90th=[308282], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 7, max= 160, per=24.98%, avg=62.69, stdev=25.00, samples=196 iops : min= 1, max= 40, avg=15.07, stdev= 6.30, samples=196 lat (usec) : 50=1.53%, 100=4.62%, 250=0.52%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.48%, 4=4.82%, 10=7.03%, 20=14.81%, 50=38.87% lat (msec) : 100=17.64%, 250=3.42%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=6.48%, ctx=6568, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145443: Fri Sep 4 19:36:07 2026 read: IOPS=15, BW=60.5KiB/s (61.9kB/s)(6052KiB/100086msec) clat (usec): min=33, max=778202, avg=31858.78, stdev=33212.61 lat (usec): min=33, max=778204, avg=31859.90, stdev=33212.58 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 90], 20.00th=[ 14091], | 30.00th=[ 18744], 40.00th=[ 22152], 50.00th=[ 26084], 60.00th=[ 31589], | 70.00th=[ 38536], 80.00th=[ 47449], 90.00th=[ 60556], 95.00th=[ 73925], | 99.00th=[109577], 99.50th=[135267], 99.90th=[574620], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 7, max= 120, per=25.12%, avg=60.03, stdev=24.07, samples=198 iops : min= 1, max= 30, avg=14.39, stdev= 6.08, samples=198 write: IOPS=15, BW=62.3KiB/s (63.8kB/s)(6236KiB/100086msec); 0 zone resets clat (usec): min=862, max=347927, avg=33081.24, stdev=34131.70 lat (usec): min=863, max=347928, avg=33083.88, stdev=34130.94 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1172], 10.00th=[ 1631], 20.00th=[ 3294], | 30.00th=[ 6718], 40.00th=[ 13960], 50.00th=[ 24249], 60.00th=[ 34341], | 70.00th=[ 44303], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[133694], 99.50th=[149947], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 15, max= 128, per=24.86%, avg=62.40, stdev=22.92, samples=196 iops : min= 3, max= 32, avg=14.99, stdev= 5.76, samples=196 lat (usec) : 50=1.56%, 100=3.65%, 250=0.42%, 750=0.07%, 1000=0.33% lat (msec) : 2=6.22%, 4=5.24%, 10=6.90%, 20=15.36%, 50=39.26% lat (msec) : 100=17.51%, 250=3.35%, 500=0.07%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=6.59%, ctx=6515, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=240KiB/s (246kB/s), 59.9KiB/s-60.5KiB/s (61.3kB/s-61.9kB/s), io=23.4MiB (24.6MB), run=98854-100086msec WRITE: bw=251KiB/s (257kB/s), 62.3KiB/s-64.2KiB/s (63.8kB/s-65.8kB/s), io=24.6MiB (25.7MB), run=98854-100086msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145436: Fri Sep 4 19:38:20 2026 read: IOPS=6, BW=25.8KiB/s (26.4kB/s)(5992KiB/232678msec) clat (msec): min=4, max=711, avg=31.36, stdev=32.23 lat (msec): min=4, max=711, avg=31.36, stdev=32.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 62], 95.00th=[ 82], | 99.00th=[ 128], 99.50th=[ 167], 99.90th=[ 317], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 119, per=26.99%, avg=27.80, stdev=18.90, samples=418 iops : min= 1, max= 29, avg= 6.36, stdev= 4.75, samples=418 write: IOPS=6, BW=27.1KiB/s (27.7kB/s)(6296KiB/232678msec); 0 zone resets clat (msec): min=32, max=602, avg=117.77, stdev=51.50 lat (msec): min=32, max=602, avg=117.78, stdev=51.50 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 96], 50.00th=[ 108], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 186], 95.00th=[ 215], | 99.00th=[ 288], 99.50th=[ 317], 99.90th=[ 351], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 63, per=24.62%, avg=26.59, stdev=10.84, samples=458 iops : min= 1, max= 15, avg= 6.05, stdev= 2.79, samples=458 lat (msec) : 10=5.79%, 20=14.94%, 50=21.29%, 100=27.73%, 250=29.13% lat (msec) : 500=1.04%, 750=0.07% cpu : usr=0.04%, sys=1.32%, ctx=5346, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145437: Fri Sep 4 19:38:20 2026 read: IOPS=6, BW=25.8KiB/s (26.5kB/s)(5940KiB/229826msec) clat (msec): min=5, max=780, avg=31.28, stdev=33.74 lat (msec): min=5, max=780, avg=31.28, stdev=33.74 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 44], 90.00th=[ 64], 95.00th=[ 82], | 99.00th=[ 130], 99.50th=[ 165], 99.90th=[ 321], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 112, per=27.19%, avg=28.01, stdev=18.62, samples=412 iops : min= 1, max= 28, avg= 6.41, stdev= 4.71, samples=412 write: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6348KiB/229826msec); 0 zone resets clat (msec): min=34, max=518, avg=115.32, stdev=49.92 lat (msec): min=34, max=518, avg=115.33, stdev=49.92 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 118], | 70.00th=[ 133], 80.00th=[ 153], 90.00th=[ 182], 95.00th=[ 205], | 99.00th=[ 275], 99.50th=[ 300], 99.90th=[ 393], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 7, max= 55, per=25.18%, avg=27.19, stdev=10.81, samples=453 iops : min= 1, max= 13, avg= 6.20, stdev= 2.78, samples=453 lat (msec) : 10=5.18%, 20=16.41%, 50=20.48%, 100=28.26%, 250=28.65% lat (msec) : 500=0.98%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.33%, ctx=5490, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145438: Fri Sep 4 19:38:20 2026 read: IOPS=6, BW=25.9KiB/s (26.5kB/s)(6028KiB/232575msec) clat (msec): min=4, max=582, avg=32.76, stdev=31.21 lat (msec): min=4, max=582, avg=32.76, stdev=31.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 66], 95.00th=[ 84], | 99.00th=[ 129], 99.50th=[ 182], 99.90th=[ 321], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 7, max= 111, per=26.61%, avg=27.41, stdev=16.98, samples=426 iops : min= 1, max= 27, avg= 6.27, stdev= 4.32, samples=426 write: IOPS=6, BW=26.9KiB/s (27.6kB/s)(6260KiB/232575msec); 0 zone resets clat (msec): min=35, max=863, avg=116.85, stdev=53.00 lat (msec): min=35, max=863, avg=116.85, stdev=53.00 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 85], 40.00th=[ 95], 50.00th=[ 107], 60.00th=[ 118], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 182], 95.00th=[ 213], | 99.00th=[ 271], 99.50th=[ 300], 99.90th=[ 523], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 63, per=24.70%, avg=26.68, stdev=11.30, samples=454 iops : min= 1, max= 15, avg= 6.08, stdev= 2.90, samples=454 lat (msec) : 10=5.08%, 20=15.14%, 50=20.70%, 100=29.23%, 250=28.84% lat (msec) : 500=0.91%, 750=0.07%, 1000=0.03% cpu : usr=0.05%, sys=1.36%, ctx=5458, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145439: Fri Sep 4 19:38:20 2026 read: IOPS=6, BW=26.1KiB/s (26.7kB/s)(6052KiB/231762msec) clat (msec): min=4, max=322, avg=31.13, stdev=26.80 lat (msec): min=4, max=322, avg=31.13, stdev=26.80 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 64], 95.00th=[ 84], | 99.00th=[ 128], 99.50th=[ 155], 99.90th=[ 257], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 128, per=27.14%, avg=27.96, stdev=18.62, samples=421 iops : min= 1, max= 32, avg= 6.40, stdev= 4.70, samples=421 write: IOPS=6, BW=26.9KiB/s (27.6kB/s)(6236KiB/231762msec); 0 zone resets clat (msec): min=35, max=861, avg=118.23, stdev=53.83 lat (msec): min=35, max=861, avg=118.23, stdev=53.83 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 184], 95.00th=[ 213], | 99.00th=[ 275], 99.50th=[ 296], 99.90th=[ 609], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 56, per=24.52%, avg=26.48, stdev=10.85, samples=457 iops : min= 1, max= 14, avg= 6.03, stdev= 2.78, samples=457 lat (msec) : 10=5.37%, 20=15.85%, 50=21.13%, 100=27.21%, 250=29.23% lat (msec) : 500=1.14%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.32%, ctx=5391, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=103KiB/s (106kB/s), 25.8KiB/s-26.1KiB/s (26.4kB/s-26.7kB/s), io=23.4MiB (24.6MB), run=229826-232678msec WRITE: bw=108KiB/s (111kB/s), 26.9KiB/s-27.6KiB/s (27.6kB/s-28.3kB/s), io=24.6MiB (25.7MB), run=229826-232678msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145496: Fri Sep 4 19:38:47 2026 read: IOPS=19, BW=311KiB/s (319kB/s)(5920KiB/19006msec) clat (usec): min=28, max=163987, avg=25287.03, stdev=20735.37 lat (usec): min=29, max=163988, avg=25308.69, stdev=20742.12 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 68], 20.00th=[ 523], | 30.00th=[ 16319], 40.00th=[ 20055], 50.00th=[ 23725], 60.00th=[ 27132], | 70.00th=[ 31065], 80.00th=[ 36963], 90.00th=[ 49546], 95.00th=[ 64750], | 99.00th=[ 98042], 99.50th=[105382], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 94, max= 478, per=24.39%, avg=307.30, stdev=93.58, samples=37 iops : min= 5, max= 29, avg=18.43, stdev= 5.88, samples=37 write: IOPS=20, BW=335KiB/s (343kB/s)(6368KiB/19006msec); 0 zone resets clat (usec): min=1449, max=159310, avg=23694.95, stdev=24409.90 lat (usec): min=1451, max=159312, avg=23698.56, stdev=24409.56 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1975], 10.00th=[ 2507], 20.00th=[ 4080], | 30.00th=[ 6259], 40.00th=[ 9634], 50.00th=[ 14222], 60.00th=[ 21365], | 70.00th=[ 31065], 80.00th=[ 41681], 90.00th=[ 57934], 95.00th=[ 70779], | 99.00th=[120062], 99.50th=[143655], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 568, per=25.28%, avg=334.92, stdev=119.91, samples=37 iops : min= 3, max= 35, avg=20.19, stdev= 7.55, samples=37 lat (usec) : 50=1.17%, 100=6.64%, 250=1.43%, 500=0.13%, 750=0.52% lat (msec) : 2=2.99%, 4=7.16%, 10=11.07%, 20=17.97%, 50=38.93% lat (msec) : 100=10.94%, 250=1.04% cpu : usr=0.09%, sys=9.63%, ctx=1577, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145498: Fri Sep 4 19:38:47 2026 read: IOPS=19, BW=307KiB/s (314kB/s)(5744KiB/18728msec) clat (usec): min=33, max=107070, avg=25915.68, stdev=19667.50 lat (usec): min=33, max=107071, avg=25916.70, stdev=19667.50 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 8979], | 30.00th=[ 16450], 40.00th=[ 19792], 50.00th=[ 24511], 60.00th=[ 28443], | 70.00th=[ 33424], 80.00th=[ 40633], 90.00th=[ 51119], 95.00th=[ 62653], | 99.00th=[ 84411], 99.50th=[103285], 99.90th=[107480], 99.95th=[107480], | 99.99th=[107480] bw ( KiB/s): min= 30, max= 541, per=24.15%, avg=304.30, stdev=113.65, samples=37 iops : min= 1, max= 33, avg=18.24, stdev= 7.14, samples=37 write: IOPS=21, BW=349KiB/s (358kB/s)(6544KiB/18728msec); 0 zone resets clat (usec): min=1302, max=182739, avg=22467.98, stdev=25679.09 lat (usec): min=1304, max=182741, avg=22470.18, stdev=25679.86 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1991], 10.00th=[ 2835], 20.00th=[ 4178], | 30.00th=[ 5669], 40.00th=[ 8160], 50.00th=[ 11469], 60.00th=[ 17957], | 70.00th=[ 27657], 80.00th=[ 39584], 90.00th=[ 53740], 95.00th=[ 70779], | 99.00th=[121111], 99.50th=[145753], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 120, max= 539, per=26.13%, avg=346.19, stdev=109.98, samples=37 iops : min= 7, max= 33, avg=20.89, stdev= 6.81, samples=37 lat (usec) : 50=1.43%, 100=5.99%, 250=1.43%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.73%, 4=7.16%, 10=14.84%, 20=17.84%, 50=36.98% lat (msec) : 100=9.64%, 250=1.56% cpu : usr=0.07%, sys=9.55%, ctx=1529, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145500: Fri Sep 4 19:38:47 2026 read: IOPS=21, BW=348KiB/s (356kB/s)(6256KiB/17999msec) clat (usec): min=32, max=135603, avg=23055.30, stdev=18410.16 lat (usec): min=32, max=135605, avg=23056.51, stdev=18410.32 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 108], | 30.00th=[ 15139], 40.00th=[ 18744], 50.00th=[ 22414], 60.00th=[ 26084], | 70.00th=[ 31327], 80.00th=[ 37487], 90.00th=[ 42730], 95.00th=[ 50594], | 99.00th=[ 87557], 99.50th=[ 91751], 99.90th=[135267], 99.95th=[135267], | 99.99th=[135267] bw ( KiB/s): min= 31, max= 665, per=27.92%, avg=351.77, stdev=128.06, samples=35 iops : min= 1, max= 41, avg=21.23, stdev= 8.02, samples=35 write: IOPS=20, BW=335KiB/s (343kB/s)(6032KiB/17999msec); 0 zone resets clat (usec): min=1481, max=183483, avg=23126.60, stdev=23543.70 lat (usec): min=1481, max=183486, avg=23128.70, stdev=23543.52 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1926], 10.00th=[ 2737], 20.00th=[ 4686], | 30.00th=[ 6652], 40.00th=[ 10159], 50.00th=[ 14746], 60.00th=[ 21365], | 70.00th=[ 29492], 80.00th=[ 40109], 90.00th=[ 53740], 95.00th=[ 70779], | 99.00th=[109577], 99.50th=[126354], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 93, max= 478, per=25.09%, avg=332.49, stdev=84.27, samples=35 iops : min= 5, max= 29, avg=20.03, stdev= 5.36, samples=35 lat (usec) : 50=2.47%, 100=7.55%, 250=0.91%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.86%, 4=5.47%, 10=11.46%, 20=18.62%, 50=41.41% lat (msec) : 100=7.55%, 250=0.78% cpu : usr=0.11%, sys=9.77%, ctx=1501, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145502: Fri Sep 4 19:38:47 2026 read: IOPS=21, BW=337KiB/s (345kB/s)(6032KiB/17912msec) clat (usec): min=32, max=290370, avg=24001.91, stdev=23495.92 lat (usec): min=32, max=290371, avg=24003.37, stdev=23496.71 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 52], 10.00th=[ 58], 20.00th=[ 99], | 30.00th=[ 14615], 40.00th=[ 19006], 50.00th=[ 22152], 60.00th=[ 25822], | 70.00th=[ 31065], 80.00th=[ 36963], 90.00th=[ 46400], 95.00th=[ 62129], | 99.00th=[ 83362], 99.50th=[ 96994], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 158, max= 510, per=26.50%, avg=333.86, stdev=95.38, samples=35 iops : min= 9, max= 31, avg=20.14, stdev= 6.01, samples=35 write: IOPS=21, BW=349KiB/s (358kB/s)(6256KiB/17912msec); 0 zone resets clat (usec): min=1275, max=144219, avg=22520.63, stdev=23309.24 lat (usec): min=1276, max=144221, avg=22522.55, stdev=23309.29 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2278], 10.00th=[ 2999], 20.00th=[ 4752], | 30.00th=[ 6128], 40.00th=[ 8455], 50.00th=[ 14091], 60.00th=[ 19530], | 70.00th=[ 27132], 80.00th=[ 39060], 90.00th=[ 54789], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[115868], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 158, max= 634, per=26.28%, avg=348.17, stdev=102.65, samples=35 iops : min= 9, max= 39, avg=21.03, stdev= 6.52, samples=35 lat (usec) : 50=1.82%, 100=8.07%, 250=1.95%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=1.69%, 4=6.38%, 10=14.45%, 20=16.80%, 50=37.76% lat (msec) : 100=9.90%, 250=0.52%, 500=0.13% cpu : usr=0.11%, sys=9.75%, ctx=1479, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1260KiB/s (1290kB/s), 307KiB/s-348KiB/s (314kB/s-356kB/s), io=23.4MiB (24.5MB), run=17912-19006msec WRITE: bw=1326KiB/s (1358kB/s), 335KiB/s-349KiB/s (343kB/s-358kB/s), io=24.6MiB (25.8MB), run=17912-19006msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145495: Fri Sep 4 19:39:19 2026 read: IOPS=7, BW=117KiB/s (119kB/s)(5920KiB/50733msec) clat (msec): min=5, max=203, avg=28.40, stdev=24.19 lat (msec): min=5, max=203, avg=28.40, stdev=24.19 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 39], 90.00th=[ 52], 95.00th=[ 75], | 99.00th=[ 132], 99.50th=[ 180], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 31, max= 318, per=25.31%, avg=118.69, stdev=66.99, samples=97 iops : min= 1, max= 19, avg= 6.76, stdev= 4.23, samples=97 write: IOPS=7, BW=126KiB/s (129kB/s)(6368KiB/50733msec); 0 zone resets clat (msec): min=35, max=276, avg=100.48, stdev=36.92 lat (msec): min=35, max=276, avg=100.48, stdev=36.92 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 70], | 30.00th=[ 79], 40.00th=[ 86], 50.00th=[ 93], 60.00th=[ 103], | 70.00th=[ 112], 80.00th=[ 129], 90.00th=[ 157], 95.00th=[ 174], | 99.00th=[ 211], 99.50th=[ 266], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 224, per=25.26%, avg=124.78, stdev=42.26, samples=100 iops : min= 1, max= 14, avg= 7.13, stdev= 2.74, samples=100 lat (msec) : 10=3.26%, 20=19.14%, 50=21.48%, 100=33.46%, 250=22.40% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.68%, ctx=1317, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145497: Fri Sep 4 19:39:19 2026 read: IOPS=7, BW=113KiB/s (115kB/s)(5744KiB/50973msec) clat (msec): min=5, max=204, avg=26.37, stdev=21.94 lat (msec): min=5, max=204, avg=26.38, stdev=21.94 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 51], 95.00th=[ 70], | 99.00th=[ 111], 99.50th=[ 148], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 30, max= 352, per=25.29%, avg=118.61, stdev=74.07, samples=95 iops : min= 1, max= 22, avg= 6.76, stdev= 4.69, samples=95 write: IOPS=8, BW=128KiB/s (131kB/s)(6544KiB/50973msec); 0 zone resets clat (msec): min=42, max=282, avg=101.30, stdev=40.64 lat (msec): min=42, max=282, avg=101.30, stdev=40.64 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 53], 10.00th=[ 57], 20.00th=[ 68], | 30.00th=[ 75], 40.00th=[ 84], 50.00th=[ 93], 60.00th=[ 105], | 70.00th=[ 114], 80.00th=[ 131], 90.00th=[ 153], 95.00th=[ 176], | 99.00th=[ 241], 99.50th=[ 251], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 255, per=25.83%, avg=127.60, stdev=42.46, samples=101 iops : min= 1, max= 15, avg= 7.32, stdev= 2.73, samples=101 lat (msec) : 10=4.82%, 20=18.62%, 50=20.57%, 100=31.77%, 250=23.83% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.66%, ctx=1324, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145499: Fri Sep 4 19:39:19 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/49949msec) clat (msec): min=7, max=122, avg=25.88, stdev=19.41 lat (msec): min=7, max=122, avg=25.88, stdev=19.41 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 27], 80.00th=[ 34], 90.00th=[ 47], 95.00th=[ 71], | 99.00th=[ 112], 99.50th=[ 117], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 31, max= 319, per=27.87%, avg=130.72, stdev=77.22, samples=95 iops : min= 1, max= 19, avg= 7.48, stdev= 4.87, samples=95 write: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49949msec); 0 zone resets clat (msec): min=46, max=279, avg=105.12, stdev=39.60 lat (msec): min=46, max=279, avg=105.12, stdev=39.60 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 57], 10.00th=[ 63], 20.00th=[ 74], | 30.00th=[ 82], 40.00th=[ 90], 50.00th=[ 99], 60.00th=[ 107], | 70.00th=[ 117], 80.00th=[ 132], 90.00th=[ 155], 95.00th=[ 186], | 99.00th=[ 268], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 192, per=24.34%, avg=120.26, stdev=36.97, samples=99 iops : min= 1, max= 12, avg= 6.85, stdev= 2.39, samples=99 lat (msec) : 10=3.78%, 20=22.66%, 50=20.18%, 100=29.82%, 250=23.05% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.73%, ctx=1432, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145501: Fri Sep 4 19:39:19 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6032KiB/50105msec) clat (msec): min=6, max=227, avg=27.60, stdev=25.76 lat (msec): min=6, max=227, avg=27.60, stdev=25.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 35], 90.00th=[ 55], 95.00th=[ 79], | 99.00th=[ 138], 99.50th=[ 182], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 30, max= 416, per=27.02%, avg=126.72, stdev=73.97, samples=93 iops : min= 1, max= 26, avg= 7.26, stdev= 4.76, samples=93 write: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/50105msec); 0 zone resets clat (msec): min=43, max=246, avg=100.90, stdev=34.53 lat (msec): min=43, max=246, avg=100.91, stdev=34.53 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 60], 10.00th=[ 64], 20.00th=[ 71], | 30.00th=[ 79], 40.00th=[ 87], 50.00th=[ 93], 60.00th=[ 104], | 70.00th=[ 114], 80.00th=[ 128], 90.00th=[ 150], 95.00th=[ 167], | 99.00th=[ 203], 99.50th=[ 239], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 192, per=25.13%, avg=124.12, stdev=38.28, samples=99 iops : min= 1, max= 12, avg= 7.09, stdev= 2.47, samples=99 lat (msec) : 10=5.47%, 20=18.49%, 50=20.31%, 100=33.07%, 250=22.66% cpu : usr=0.05%, sys=1.69%, ctx=1386, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=470KiB/s (481kB/s), 113KiB/s-125KiB/s (115kB/s-128kB/s), io=23.4MiB (24.5MB), run=49949-50973msec WRITE: bw=494KiB/s (506kB/s), 121KiB/s-128KiB/s (124kB/s-131kB/s), io=24.6MiB (25.8MB), run=49949-50973msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145515: Fri Sep 4 19:39:33 2026 read: IOPS=2, BW=2750KiB/s (2816kB/s)(7168KiB/2607msec) clat (usec): min=533, max=316496, avg=215635.76, stdev=105693.63 lat (usec): min=534, max=316497, avg=215637.31, stdev=105693.73 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[183501], | 30.00th=[202376], 40.00th=[202376], 50.00th=[240124], 60.00th=[278922], | 70.00th=[278922], 80.00th=[287310], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 2027, max= 3900, per=91.35%, avg=2985.33, stdev=937.26, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1964KiB/s (2011kB/s)(5120KiB/2607msec); 0 zone resets clat (msec): min=151, max=229, avg=202.33, stdev=30.17 lat (msec): min=151, max=229, avg=202.40, stdev=30.17 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 213], 60.00th=[ 213], | 70.00th=[ 218], 80.00th=[ 218], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 2027, max= 4087, per=66.82%, avg=3057.00, stdev=1456.64, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=25.00% cpu : usr=0.00%, sys=25.10%, ctx=244, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145516: Fri Sep 4 19:39:33 2026 read: IOPS=0, BW=361KiB/s (369kB/s)(2048KiB/5677msec) clat (usec): min=1842, max=277313, avg=139577.98, stdev=194788.02 lat (usec): min=1843, max=277316, avg=139580.04, stdev=194789.00 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 1844], 10.00th=[ 1844], 20.00th=[ 1844], | 30.00th=[ 1844], 40.00th=[ 1844], 50.00th=[ 1844], 60.00th=[278922], | 70.00th=[278922], 80.00th=[278922], 90.00th=[278922], 95.00th=[278922], | 99.00th=[278922], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 1532, max= 2039, per=54.64%, avg=1785.50, stdev=358.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1804KiB/s (1847kB/s)(10.0MiB/5677msec); 0 zone resets clat (msec): min=203, max=2496, avg=533.14, stdev=701.03 lat (msec): min=203, max=2496, avg=533.22, stdev=701.01 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 205], | 30.00th=[ 232], 40.00th=[ 253], 50.00th=[ 264], 60.00th=[ 271], | 70.00th=[ 347], 80.00th=[ 489], 90.00th=[ 575], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2039, max= 4087, per=70.51%, avg=3225.80, stdev=1081.61, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 2=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=13.37%, ctx=127, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145517: Fri Sep 4 19:39:33 2026 read: IOPS=0, BW=981KiB/s (1004kB/s)(6144KiB/6266msec) clat (usec): min=1952, max=2990.5k, avg=634123.01, stdev=1157588.46 lat (usec): min=1953, max=2990.5k, avg=634124.47, stdev=1157588.33 clat percentiles (usec): | 1.00th=[ 1958], 5.00th=[ 1958], 10.00th=[ 1958], | 20.00th=[ 152044], 30.00th=[ 152044], 40.00th=[ 191890], | 50.00th=[ 191890], 60.00th=[ 229639], 70.00th=[ 240124], | 80.00th=[ 240124], 90.00th=[3003122], 95.00th=[3003122], | 99.00th=[3003122], 99.50th=[3003122], 99.90th=[3003122], | 99.95th=[3003122], 99.99th=[3003122] bw ( KiB/s): min= 1950, max= 4071, per=77.36%, avg=2528.00, stdev=1029.65, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=981KiB/s (1004kB/s)(6144KiB/6266msec); 0 zone resets clat (msec): min=107, max=996, avg=404.70, stdev=360.49 lat (msec): min=107, max=996, avg=404.76, stdev=360.51 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 215], 50.00th=[ 215], 60.00th=[ 218], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1950, max= 4071, per=60.05%, avg=2747.25, stdev=985.81, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 2=8.33%, 250=66.67%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.53%, ctx=577, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145518: Fri Sep 4 19:39:33 2026 read: IOPS=0, BW=989KiB/s (1013kB/s)(5120KiB/5178msec) clat (usec): min=560, max=236514, avg=119558.24, stdev=111151.32 lat (usec): min=561, max=236516, avg=119559.67, stdev=111151.48 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 562], | 30.00th=[ 2040], 40.00th=[ 2040], 50.00th=[162530], 60.00th=[162530], | 70.00th=[196084], 80.00th=[196084], 90.00th=[235930], 95.00th=[235930], | 99.00th=[235930], 99.50th=[235930], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1384KiB/s (1418kB/s)(7168KiB/5178msec); 0 zone resets clat (msec): min=116, max=2691, avg=639.51, stdev=922.05 lat (msec): min=116, max=2691, avg=639.59, stdev=922.07 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 199], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 300], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 667], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1512, max= 4079, per=62.94%, avg=2879.50, stdev=1300.90, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=13.98%, ctx=213, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3268KiB/s (3347kB/s), 361KiB/s-2750KiB/s (369kB/s-2816kB/s), io=20.0MiB (20.0MB), run=2607-6266msec WRITE: bw=4576KiB/s (4686kB/s), 981KiB/s-1964KiB/s (1004kB/s-2011kB/s), io=28.0MiB (29.4MB), run=2607-6266msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145520: Fri Sep 4 19:39:34 2026 read: IOPS=1, BW=1162KiB/s (1189kB/s)(7168KiB/6171msec) clat (msec): min=105, max=2704, avg=640.29, stdev=983.54 lat (msec): min=105, max=2704, avg=640.29, stdev=983.54 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 110], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 133], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 1133], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1706, max= 2011, per=62.39%, avg=1928.40, stdev=125.66, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=830KiB/s (850kB/s)(5120KiB/6171msec); 0 zone resets clat (msec): min=201, max=483, avg=299.76, stdev=110.56 lat (msec): min=201, max=483, avg=299.83, stdev=110.55 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 485], 95.00th=[ 485], | 99.00th=[ 485], 99.50th=[ 485], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 1961, max= 3961, per=68.43%, avg=2961.00, stdev=1414.21, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 250=58.33%, 500=25.00%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.39%, ctx=98, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145521: Fri Sep 4 19:39:34 2026 read: IOPS=0, BW=309KiB/s (317kB/s)(2048KiB/6620msec) clat (msec): min=118, max=166, avg=142.50, stdev=33.95 lat (msec): min=118, max=166, avg=142.50, stdev=33.95 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 167], | 70.00th=[ 167], 80.00th=[ 167], 90.00th=[ 167], 95.00th=[ 167], | 99.00th=[ 167], 99.50th=[ 167], 99.90th=[ 167], 99.95th=[ 167], | 99.99th=[ 167] bw ( KiB/s): min= 1980, max= 2000, per=64.38%, avg=1990.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1547KiB/s (1584kB/s)(10.0MiB/6620msec); 0 zone resets clat (msec): min=187, max=3293, avg=622.84, stdev=946.42 lat (msec): min=187, max=3293, avg=623.16, stdev=946.36 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 190], | 30.00th=[ 232], 40.00th=[ 245], 50.00th=[ 309], 60.00th=[ 355], | 70.00th=[ 376], 80.00th=[ 485], 90.00th=[ 558], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 1976, max= 4079, per=69.80%, avg=3020.17, stdev=1120.17, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.84%, ctx=90, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145522: Fri Sep 4 19:39:34 2026 read: IOPS=0, BW=984KiB/s (1007kB/s)(6144KiB/6247msec) clat (msec): min=108, max=2559, avg=549.34, stdev=986.82 lat (msec): min=108, max=2559, avg=549.34, stdev=986.82 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 114], | 30.00th=[ 114], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 121], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1961, max= 3961, per=80.37%, avg=2484.25, stdev=985.08, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=984KiB/s (1007kB/s)(6144KiB/6247msec); 0 zone resets clat (msec): min=180, max=1061, avg=479.65, stdev=375.32 lat (msec): min=180, max=1061, avg=479.73, stdev=375.32 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 347], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1961, max= 3915, per=57.17%, avg=2473.75, stdev=961.41, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=16.67%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.90%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145523: Fri Sep 4 19:39:34 2026 read: IOPS=0, BW=773KiB/s (791kB/s)(5120KiB/6625msec) clat (msec): min=102, max=762, avg=259.31, stdev=284.28 lat (msec): min=102, max=762, avg=259.31, stdev=284.28 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 105], 40.00th=[ 105], 50.00th=[ 126], 60.00th=[ 126], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1976, max= 3961, per=85.46%, avg=2641.67, stdev=1142.59, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1082KiB/s (1108kB/s)(7168KiB/6625msec); 0 zone resets clat (msec): min=136, max=2751, avg=747.38, stdev=935.56 lat (msec): min=136, max=2751, avg=747.54, stdev=935.51 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 199], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 326], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 1062], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1868, max= 2039, per=45.55%, avg=1971.00, stdev=65.11, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.93%, ctx=129, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3091KiB/s (3166kB/s), 309KiB/s-1162KiB/s (317kB/s-1189kB/s), io=20.0MiB (20.0MB), run=6171-6625msec WRITE: bw=4328KiB/s (4432kB/s), 830KiB/s-1547KiB/s (850kB/s-1584kB/s), io=28.0MiB (29.4MB), run=6171-6625msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145535: Fri Sep 4 19:39:50 2026 read: IOPS=0, BW=2168KiB/s (2220kB/s)(12.0MiB/5667msec) clat (msec): min=697, max=3886, avg=1798.47, stdev=1808.84 lat (msec): min=697, max=3886, avg=1798.47, stdev=1808.84 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 3876], 80.00th=[ 3876], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.72%, ctx=561, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145536: Fri Sep 4 19:39:50 2026 read: IOPS=0, BW=1919KiB/s (1965kB/s)(4096KiB/2134msec) clat (nsec): min=952859k, max=952859k, avg=952859233.00, stdev= 0.00 lat (nsec): min=952861k, max=952861k, avg=952861251.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3839KiB/s (3931kB/s)(8192KiB/2134msec); 0 zone resets clat (msec): min=356, max=539, avg=447.99, stdev=129.11 lat (msec): min=357, max=539, avg=448.34, stdev=129.14 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.09%, sys=9.05%, ctx=108, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145537: Fri Sep 4 19:39:50 2026 write: IOPS=0, BW=2020KiB/s (2068kB/s)(12.0MiB/6084msec); 0 zone resets clat (msec): min=508, max=4614, avg=1990.43, stdev=2278.54 lat (msec): min=509, max=4614, avg=1990.77, stdev=2278.51 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.50%, ctx=79, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145538: Fri Sep 4 19:39:50 2026 write: IOPS=0, BW=2281KiB/s (2336kB/s)(12.0MiB/5386msec); 0 zone resets clat (msec): min=312, max=3606, avg=1693.71, stdev=1710.26 lat (msec): min=313, max=3607, avg=1694.07, stdev=1710.26 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.04%, sys=2.10%, ctx=39, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2891KiB/s (2961kB/s), 1919KiB/s-2168KiB/s (1965kB/s-2220kB/s), io=16.0MiB (16.8MB), run=2134-5667msec WRITE: bw=5386KiB/s (5515kB/s), 2020KiB/s-3839KiB/s (2068kB/s-3931kB/s), io=32.0MiB (33.6MB), run=2134-6084msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145531: Fri Sep 4 19:39:51 2026 read: IOPS=1, BW=5697KiB/s (5834kB/s)(12.0MiB/2157msec) clat (msec): min=500, max=776, avg=679.08, stdev=154.80 lat (msec): min=500, max=776, avg=679.08, stdev=154.80 clat percentiles (msec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.05%, sys=6.26%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145532: Fri Sep 4 19:39:51 2026 read: IOPS=0, BW=2639KiB/s (2703kB/s)(4096KiB/1552msec) clat (nsec): min=239311k, max=239311k, avg=239311094.00, stdev= 0.00 lat (nsec): min=239313k, max=239313k, avg=239313466.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 241], 95.00th=[ 241], | 99.00th=[ 241], 99.50th=[ 241], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=5278KiB/s (5405kB/s)(8192KiB/1552msec); 0 zone resets clat (msec): min=262, max=1011, avg=637.40, stdev=529.64 lat (msec): min=263, max=1012, avg=637.64, stdev=529.69 clat percentiles (msec): | 1.00th=[ 264], 5.00th=[ 264], 10.00th=[ 264], 20.00th=[ 264], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.19%, sys=8.12%, ctx=47, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145533: Fri Sep 4 19:39:51 2026 write: IOPS=0, BW=1787KiB/s (1829kB/s)(12.0MiB/6878msec); 0 zone resets clat (msec): min=341, max=6022, avg=2267.63, stdev=3251.99 lat (msec): min=341, max=6022, avg=2267.92, stdev=3252.05 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 6007], 80.00th=[ 6007], 90.00th=[ 6007], 95.00th=[ 6007], | 99.00th=[ 6007], 99.50th=[ 6007], 99.90th=[ 6007], 99.95th=[ 6007], | 99.99th=[ 6007] bw ( KiB/s): min= 7627, max= 8159, per=100.00%, avg=7893.00, stdev=376.18, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=1.73%, ctx=51, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145534: Fri Sep 4 19:39:51 2026 write: IOPS=0, BW=2419KiB/s (2477kB/s)(12.0MiB/5080msec); 0 zone resets clat (msec): min=442, max=4121, avg=1672.75, stdev=2120.55 lat (msec): min=442, max=4121, avg=1673.01, stdev=2120.61 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 4111], 80.00th=[ 4111], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 5793, max= 8159, per=100.00%, avg=6976.00, stdev=1673.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.24%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7596KiB/s (7778kB/s), 2639KiB/s-5697KiB/s (2703kB/s-5834kB/s), io=16.0MiB (16.8MB), run=1552-2157msec WRITE: bw=4764KiB/s (4879kB/s), 1787KiB/s-5278KiB/s (1829kB/s-5405kB/s), io=32.0MiB (33.6MB), run=1552-6878msec