== sanity test 398b: DIO and buffer IO race ============== 13:43:20 (1780335800) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.9546 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146152: Mon Jun 1 13:45:35 2026 read: IOPS=12, BW=51.8KiB/s (53.1kB/s)(5992KiB/115636msec) clat (usec): min=30, max=633743, avg=37393.41, stdev=33006.34 lat (usec): min=31, max=633745, avg=37395.35, stdev=33006.57 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 16057], | 30.00th=[ 21103], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 46400], 80.00th=[ 58983], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[128451], 99.50th=[168821], 99.90th=[295699], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 127, per=25.29%, avg=51.59, stdev=21.82, samples=228 iops : min= 1, max= 31, avg=12.30, stdev= 5.49, samples=228 write: IOPS=13, BW=54.4KiB/s (55.8kB/s)(6296KiB/115636msec); 0 zone resets clat (usec): min=1076, max=255379, avg=37652.21, stdev=38551.26 lat (usec): min=1078, max=255381, avg=37656.98, stdev=38552.12 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1287], 10.00th=[ 1450], 20.00th=[ 3425], | 30.00th=[ 7701], 40.00th=[ 16581], 50.00th=[ 27657], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 66323], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[164627], 99.50th=[189793], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 134, per=25.31%, avg=54.16, stdev=22.07, samples=228 iops : min= 1, max= 33, avg=12.95, stdev= 5.54, samples=228 lat (usec) : 50=0.94%, 100=5.14%, 250=0.42%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=7.29%, 4=3.91%, 10=6.58%, 20=10.84%, 50=36.17% lat (msec) : 100=23.60%, 250=4.69%, 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=5.77%, ctx=6381, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146154: Mon Jun 1 13:45:35 2026 read: IOPS=12, BW=50.8KiB/s (52.0kB/s)(5940KiB/116913msec) clat (usec): min=20, max=255413, avg=36176.52, stdev=28797.23 lat (usec): min=20, max=255414, avg=36180.72, stdev=28797.87 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 56], 10.00th=[ 63], 20.00th=[ 15533], | 30.00th=[ 20841], 40.00th=[ 25822], 50.00th=[ 30802], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 55837], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[124257], 99.50th=[164627], 99.90th=[208667], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 5, max= 111, per=24.78%, avg=50.56, stdev=21.05, samples=230 iops : min= 1, max= 27, avg=12.01, stdev= 5.29, samples=230 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6348KiB/116913msec); 0 zone resets clat (usec): min=998, max=628744, avg=39607.47, stdev=42801.23 lat (usec): min=1000, max=628745, avg=39611.99, stdev=42803.90 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1500], 20.00th=[ 3982], | 30.00th=[ 8455], 40.00th=[ 19268], 50.00th=[ 28705], 60.00th=[ 39584], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 93848], 95.00th=[112722], | 99.00th=[158335], 99.50th=[225444], 99.90th=[383779], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 183, per=25.29%, avg=54.13, stdev=22.00, samples=230 iops : min= 1, max= 45, avg=12.90, stdev= 5.50, samples=230 lat (usec) : 50=1.17%, 100=5.05%, 250=0.36%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.61%, 4=3.94%, 10=6.25%, 20=11.36%, 50=36.95% lat (msec) : 100=22.53%, 250=5.53%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.76%, ctx=6450, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146155: Mon Jun 1 13:45:35 2026 read: IOPS=12, BW=51.6KiB/s (52.8kB/s)(6028KiB/116883msec) clat (usec): min=29, max=626182, avg=36835.65, stdev=33808.96 lat (usec): min=29, max=626183, avg=36837.85, stdev=33809.09 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 55], 10.00th=[ 64], 20.00th=[ 15664], | 30.00th=[ 20055], 40.00th=[ 25035], 50.00th=[ 30016], 60.00th=[ 35914], | 70.00th=[ 45351], 80.00th=[ 56361], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[145753], 99.50th=[164627], 99.90th=[267387], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 7, max= 127, per=25.02%, avg=51.04, stdev=23.11, samples=231 iops : min= 1, max= 31, avg=12.16, stdev= 5.81, samples=231 write: IOPS=13, BW=53.6KiB/s (54.8kB/s)(6260KiB/116883msec); 0 zone resets clat (usec): min=987, max=333699, avg=39022.24, stdev=39110.00 lat (usec): min=989, max=333701, avg=39024.89, stdev=39109.83 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1303], 10.00th=[ 1549], 20.00th=[ 4113], | 30.00th=[ 8029], 40.00th=[ 18744], 50.00th=[ 30016], 60.00th=[ 40633], | 70.00th=[ 52691], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[116917], | 99.00th=[166724], 99.50th=[177210], 99.90th=[246416], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 143, per=24.72%, avg=52.90, stdev=21.27, samples=231 iops : min= 1, max= 35, avg=12.63, stdev= 5.35, samples=231 lat (usec) : 50=1.24%, 100=5.05%, 250=0.36%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.38%, 4=3.81%, 10=7.13%, 20=11.26%, 50=35.97% lat (msec) : 100=23.21%, 250=5.27%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=5.62%, ctx=6293, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146157: Mon Jun 1 13:45:35 2026 read: IOPS=12, BW=51.5KiB/s (52.8kB/s)(6052KiB/117460msec) clat (usec): min=31, max=561057, avg=35671.71, stdev=31945.67 lat (usec): min=31, max=561058, avg=35676.97, stdev=31946.92 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 14877], | 30.00th=[ 20579], 40.00th=[ 24773], 50.00th=[ 29492], 60.00th=[ 35914], | 70.00th=[ 43779], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[119014], 99.50th=[158335], 99.90th=[379585], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 112, per=25.00%, avg=51.00, stdev=21.25, samples=232 iops : min= 1, max= 28, avg=12.12, stdev= 5.35, samples=232 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6236KiB/117460msec); 0 zone resets clat (usec): min=869, max=292788, avg=40520.07, stdev=39959.59 lat (usec): min=871, max=292790, avg=40522.13, stdev=39959.95 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1614], 20.00th=[ 4490], | 30.00th=[ 9241], 40.00th=[ 21627], 50.00th=[ 31327], 60.00th=[ 41681], | 70.00th=[ 54789], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[115868], | 99.00th=[177210], 99.50th=[196084], 99.90th=[287310], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 127, per=24.56%, avg=52.55, stdev=20.13, samples=232 iops : min= 1, max= 31, avg=12.50, stdev= 5.04, samples=232 lat (usec) : 50=1.33%, 100=5.27%, 250=0.29%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=5.89%, 4=3.55%, 10=6.67%, 20=10.19%, 50=36.78% lat (msec) : 100=24.67%, 250=4.79%, 500=0.16%, 750=0.03% cpu : usr=0.07%, sys=5.75%, ctx=6307, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (209kB/s), 50.8KiB/s-51.8KiB/s (52.0kB/s-53.1kB/s), io=23.4MiB (24.6MB), run=115636-117460msec WRITE: bw=214KiB/s (219kB/s), 53.1KiB/s-54.4KiB/s (54.4kB/s-55.8kB/s), io=24.6MiB (25.7MB), run=115636-117460msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146151: Mon Jun 1 13:48:11 2026 read: IOPS=5, BW=22.1KiB/s (22.6kB/s)(5992KiB/271501msec) clat (msec): min=5, max=654, avg=37.28, stdev=36.23 lat (msec): min=5, max=654, avg=37.28, stdev=36.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 71], 95.00th=[ 91], | 99.00th=[ 167], 99.50th=[ 207], 99.90th=[ 447], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 95, per=27.86%, avg=24.24, stdev=15.56, samples=478 iops : min= 1, max= 23, avg= 5.46, stdev= 3.94, samples=478 write: IOPS=5, BW=23.2KiB/s (23.7kB/s)(6296KiB/271501msec); 0 zone resets clat (msec): min=40, max=578, avg=136.82, stdev=57.63 lat (msec): min=40, max=578, avg=136.83, stdev=57.63 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 90], | 30.00th=[ 102], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 213], 95.00th=[ 247], | 99.00th=[ 317], 99.50th=[ 347], 99.90th=[ 485], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 48, per=24.76%, avg=22.78, stdev= 9.26, samples=533 iops : min= 1, max= 12, avg= 5.09, stdev= 2.40, samples=533 lat (msec) : 10=2.64%, 20=13.15%, 50=23.11%, 100=22.88%, 250=35.87% lat (msec) : 500=2.28%, 750=0.07% cpu : usr=0.04%, sys=1.36%, ctx=5583, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146153: Mon Jun 1 13:48:11 2026 read: IOPS=5, BW=21.7KiB/s (22.3kB/s)(5940KiB/273220msec) clat (msec): min=5, max=603, avg=36.40, stdev=35.27 lat (msec): min=5, max=603, avg=36.40, stdev=35.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 71], 95.00th=[ 93], | 99.00th=[ 157], 99.50th=[ 180], 99.90th=[ 418], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 7, max= 88, per=27.97%, avg=24.34, stdev=15.21, samples=471 iops : min= 1, max= 22, avg= 5.48, stdev= 3.86, samples=471 write: IOPS=5, BW=23.2KiB/s (23.8kB/s)(6348KiB/273220msec); 0 zone resets clat (msec): min=38, max=644, avg=137.89, stdev=60.80 lat (msec): min=38, max=644, avg=137.90, stdev=60.80 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 126], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 182], 90.00th=[ 224], 95.00th=[ 253], | 99.00th=[ 330], 99.50th=[ 372], 99.90th=[ 447], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 64, per=24.69%, avg=22.72, stdev=10.03, samples=538 iops : min= 1, max= 16, avg= 5.08, stdev= 2.58, samples=538 lat (msec) : 10=2.99%, 20=14.10%, 50=21.97%, 100=22.79%, 250=35.22% lat (msec) : 500=2.86%, 750=0.07% cpu : usr=0.04%, sys=1.33%, ctx=5531, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146156: Mon Jun 1 13:48:11 2026 read: IOPS=5, BW=22.3KiB/s (22.8kB/s)(6028KiB/270522msec) clat (msec): min=5, max=364, avg=37.26, stdev=33.06 lat (msec): min=5, max=364, avg=37.26, stdev=33.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 52], 90.00th=[ 72], 95.00th=[ 95], | 99.00th=[ 167], 99.50th=[ 218], 99.90th=[ 326], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 88, per=27.56%, avg=23.98, stdev=15.29, samples=486 iops : min= 1, max= 22, avg= 5.39, stdev= 3.84, samples=486 write: IOPS=5, BW=23.1KiB/s (23.7kB/s)(6260KiB/270522msec); 0 zone resets clat (msec): min=36, max=798, avg=136.79, stdev=61.97 lat (msec): min=36, max=798, avg=136.79, stdev=61.97 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 155], 80.00th=[ 178], 90.00th=[ 220], 95.00th=[ 249], | 99.00th=[ 334], 99.50th=[ 368], 99.90th=[ 527], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 56, per=24.74%, avg=22.76, stdev= 9.89, samples=530 iops : min= 1, max= 14, avg= 5.08, stdev= 2.55, samples=530 lat (msec) : 10=2.70%, 20=12.70%, 50=23.86%, 100=23.86%, 250=34.21% lat (msec) : 500=2.60%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.34%, ctx=5415, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146158: Mon Jun 1 13:48:11 2026 read: IOPS=5, BW=22.6KiB/s (23.2kB/s)(6052KiB/267415msec) clat (msec): min=5, max=455, avg=36.44, stdev=34.36 lat (msec): min=5, max=455, avg=36.44, stdev=34.36 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 51], 90.00th=[ 72], 95.00th=[ 96], | 99.00th=[ 165], 99.50th=[ 215], 99.90th=[ 368], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 112, per=29.03%, avg=25.26, stdev=17.13, samples=464 iops : min= 1, max= 28, avg= 5.71, stdev= 4.33, samples=464 write: IOPS=5, BW=23.3KiB/s (23.9kB/s)(6236KiB/267415msec); 0 zone resets clat (msec): min=39, max=742, avg=135.97, stdev=61.23 lat (msec): min=39, max=742, avg=135.97, stdev=61.23 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 110], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 157], 80.00th=[ 180], 90.00th=[ 209], 95.00th=[ 247], | 99.00th=[ 313], 99.50th=[ 380], 99.90th=[ 651], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 64, per=25.00%, avg=23.00, stdev= 9.50, samples=523 iops : min= 1, max= 16, avg= 5.15, stdev= 2.44, samples=523 lat (msec) : 10=2.67%, 20=13.74%, 50=23.14%, 100=23.44%, 250=34.60% lat (msec) : 500=2.31%, 750=0.10% cpu : usr=0.04%, sys=1.39%, ctx=5401, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=87.9KiB/s (89.0kB/s), 21.7KiB/s-22.6KiB/s (22.3kB/s-23.2kB/s), io=23.4MiB (24.6MB), run=267415-273220msec WRITE: bw=92.0KiB/s (94.2kB/s), 23.1KiB/s-23.3KiB/s (23.7kB/s-23.9kB/s), io=24.6MiB (25.7MB), run=267415-273220msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146212: Mon Jun 1 13:48:46 2026 read: IOPS=14, BW=239KiB/s (244kB/s)(5920KiB/24804msec) clat (usec): min=40, max=141224, avg=33451.88, stdev=27864.88 lat (usec): min=40, max=141225, avg=33481.90, stdev=27844.54 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 60], 20.00th=[ 73], | 30.00th=[ 17957], 40.00th=[ 26608], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 45876], 80.00th=[ 52691], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[120062], 99.50th=[124257], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 32, max= 446, per=25.16%, avg=236.04, stdev=94.42, samples=48 iops : min= 2, max= 27, avg=13.98, stdev= 5.89, samples=48 write: IOPS=16, BW=257KiB/s (263kB/s)(6368KiB/24804msec); 0 zone resets clat (usec): min=1477, max=207648, avg=30404.55, stdev=35345.60 lat (usec): min=1478, max=207654, avg=30407.73, stdev=35344.89 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1811], 10.00th=[ 2311], 20.00th=[ 4228], | 30.00th=[ 7111], 40.00th=[ 10683], 50.00th=[ 16581], 60.00th=[ 26346], | 70.00th=[ 39060], 80.00th=[ 51643], 90.00th=[ 69731], 95.00th=[ 92799], | 99.00th=[179307], 99.50th=[193987], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 566, per=26.60%, avg=262.55, stdev=105.05, samples=47 iops : min= 1, max= 35, avg=15.66, stdev= 6.60, samples=47 lat (usec) : 50=1.04%, 100=10.68%, 250=0.26%, 500=0.26% lat (msec) : 2=3.91%, 4=6.12%, 10=10.16%, 20=10.81%, 50=33.59% lat (msec) : 100=19.79%, 250=3.39% cpu : usr=0.11%, sys=6.70%, ctx=1388, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146213: Mon Jun 1 13:48:46 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(5744KiB/25526msec) clat (usec): min=37, max=239950, avg=32495.74, stdev=28299.40 lat (usec): min=37, max=239952, avg=32510.77, stdev=28300.44 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 54], 10.00th=[ 61], 20.00th=[ 77], | 30.00th=[ 19268], 40.00th=[ 26870], 50.00th=[ 32113], 60.00th=[ 35914], | 70.00th=[ 42206], 80.00th=[ 51119], 90.00th=[ 64226], 95.00th=[ 82314], | 99.00th=[117965], 99.50th=[149947], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 30, max= 472, per=24.91%, avg=233.63, stdev=105.28, samples=48 iops : min= 1, max= 29, avg=13.85, stdev= 6.59, samples=48 write: IOPS=16, BW=256KiB/s (263kB/s)(6544KiB/25526msec); 0 zone resets clat (usec): min=1220, max=294731, avg=33225.91, stdev=41983.17 lat (usec): min=1221, max=294735, avg=33228.63, stdev=41983.95 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1827], 10.00th=[ 2278], 20.00th=[ 4293], | 30.00th=[ 7635], 40.00th=[ 11469], 50.00th=[ 18482], 60.00th=[ 28443], | 70.00th=[ 37487], 80.00th=[ 53740], 90.00th=[ 79168], 95.00th=[112722], | 99.00th=[187696], 99.50th=[252707], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 606, per=25.85%, avg=255.12, stdev=106.18, samples=50 iops : min= 1, max= 37, avg=15.20, stdev= 6.70, samples=50 lat (usec) : 50=1.69%, 100=8.20%, 250=0.91%, 500=0.39% lat (msec) : 2=4.43%, 4=5.47%, 10=10.16%, 20=10.55%, 50=37.11% lat (msec) : 100=16.80%, 250=3.91%, 500=0.39% cpu : usr=0.12%, sys=6.32%, ctx=1420, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146216: Mon Jun 1 13:48:46 2026 read: IOPS=15, BW=251KiB/s (257kB/s)(6256KiB/24953msec) clat (usec): min=21, max=337632, avg=37265.03, stdev=33740.69 lat (usec): min=21, max=337633, avg=37266.48, stdev=33740.97 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 54], 10.00th=[ 62], 20.00th=[ 96], | 30.00th=[ 21627], 40.00th=[ 27395], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[139461], 99.50th=[164627], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 95, max= 480, per=27.48%, avg=257.77, stdev=96.80, samples=48 iops : min= 5, max= 30, avg=15.35, stdev= 6.09, samples=48 write: IOPS=15, BW=242KiB/s (248kB/s)(6032KiB/24953msec); 0 zone resets clat (usec): min=1437, max=183720, avg=26754.32, stdev=30061.20 lat (usec): min=1438, max=183722, avg=26757.24, stdev=30060.68 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1729], 10.00th=[ 1975], 20.00th=[ 3687], | 30.00th=[ 5735], 40.00th=[ 9110], 50.00th=[ 13566], 60.00th=[ 21627], | 70.00th=[ 32900], 80.00th=[ 50070], 90.00th=[ 71828], 95.00th=[ 89654], | 99.00th=[121111], 99.50th=[128451], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 61, max= 445, per=24.37%, avg=240.57, stdev=107.27, samples=49 iops : min= 3, max= 27, avg=14.29, stdev= 6.72, samples=49 lat (usec) : 50=1.95%, 100=8.33%, 250=0.52%, 500=0.13% lat (msec) : 2=5.21%, 4=5.60%, 10=10.42%, 20=11.33%, 50=32.81% lat (msec) : 100=19.92%, 250=3.65%, 500=0.13% cpu : usr=0.12%, sys=6.65%, ctx=1467, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146217: Mon Jun 1 13:48:46 2026 read: IOPS=15, BW=245KiB/s (251kB/s)(6032KiB/24602msec) clat (usec): min=32, max=152006, avg=31969.98, stdev=27402.90 lat (usec): min=32, max=152008, avg=31972.24, stdev=27401.71 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 61], 20.00th=[ 82], | 30.00th=[ 16909], 40.00th=[ 24249], 50.00th=[ 29754], 60.00th=[ 36963], | 70.00th=[ 43779], 80.00th=[ 52167], 90.00th=[ 64750], 95.00th=[ 78119], | 99.00th=[127402], 99.50th=[143655], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 63, max= 540, per=26.54%, avg=248.91, stdev=101.32, samples=47 iops : min= 3, max= 33, avg=14.81, stdev= 6.37, samples=47 write: IOPS=15, BW=254KiB/s (260kB/s)(6256KiB/24602msec); 0 zone resets clat (usec): min=1424, max=307201, avg=31789.79, stdev=36147.96 lat (usec): min=1426, max=307203, avg=31795.67, stdev=36148.91 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1795], 10.00th=[ 2606], 20.00th=[ 5014], | 30.00th=[ 7898], 40.00th=[ 12387], 50.00th=[ 21103], 60.00th=[ 28181], | 70.00th=[ 40109], 80.00th=[ 55313], 90.00th=[ 71828], 95.00th=[ 92799], | 99.00th=[185598], 99.50th=[283116], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 126, max= 445, per=25.77%, avg=254.37, stdev=94.31, samples=48 iops : min= 7, max= 27, avg=15.17, stdev= 5.97, samples=48 lat (usec) : 50=2.21%, 100=8.59%, 250=1.30%, 500=0.26%, 1000=0.26% lat (msec) : 2=3.65%, 4=4.82%, 10=10.29%, 20=9.64%, 50=35.42% lat (msec) : 100=20.70%, 250=2.60%, 500=0.26% cpu : usr=0.08%, sys=6.54%, ctx=1426, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=938KiB/s (961kB/s), 225KiB/s-251KiB/s (230kB/s-257kB/s), io=23.4MiB (24.5MB), run=24602-25526msec WRITE: bw=987KiB/s (1011kB/s), 242KiB/s-257KiB/s (248kB/s-263kB/s), io=24.6MiB (25.8MB), run=24602-25526msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146210: Mon Jun 1 13:49:24 2026 read: IOPS=5, BW=94.8KiB/s (97.1kB/s)(5920KiB/62425msec) clat (msec): min=6, max=292, avg=33.47, stdev=34.11 lat (msec): min=6, max=292, avg=33.47, stdev=34.11 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 44], 90.00th=[ 67], 95.00th=[ 101], | 99.00th=[ 201], 99.50th=[ 215], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 410, per=26.37%, avg=100.20, stdev=68.26, samples=115 iops : min= 1, max= 25, avg= 5.49, stdev= 4.32, samples=115 write: IOPS=6, BW=102KiB/s (104kB/s)(6368KiB/62425msec); 0 zone resets clat (msec): min=39, max=369, avg=124.95, stdev=59.49 lat (msec): min=39, max=369, avg=124.96, stdev=59.49 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 207], 95.00th=[ 247], | 99.00th=[ 342], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 30, max= 223, per=25.61%, avg=102.43, stdev=46.18, samples=122 iops : min= 1, max= 13, avg= 5.61, stdev= 3.00, samples=122 lat (msec) : 10=2.21%, 20=18.49%, 50=20.57%, 100=26.04%, 250=30.08% lat (msec) : 500=2.60% cpu : usr=0.06%, sys=1.48%, ctx=1369, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146211: Mon Jun 1 13:49:24 2026 read: IOPS=5, BW=91.3KiB/s (93.5kB/s)(5744KiB/62896msec) clat (msec): min=6, max=258, avg=35.12, stdev=35.52 lat (msec): min=6, max=258, avg=35.12, stdev=35.52 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 51], 90.00th=[ 75], 95.00th=[ 118], | 99.00th=[ 169], 99.50th=[ 245], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 29, max= 352, per=26.87%, avg=102.10, stdev=69.79, samples=110 iops : min= 1, max= 22, avg= 5.61, stdev= 4.46, samples=110 write: IOPS=6, BW=104KiB/s (107kB/s)(6544KiB/62896msec); 0 zone resets clat (msec): min=33, max=419, avg=122.77, stdev=61.44 lat (msec): min=33, max=419, avg=122.78, stdev=61.44 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 55], 10.00th=[ 62], 20.00th=[ 75], | 30.00th=[ 84], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 122], | 70.00th=[ 138], 80.00th=[ 159], 90.00th=[ 201], 95.00th=[ 257], | 99.00th=[ 330], 99.50th=[ 355], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 30, max= 223, per=25.97%, avg=103.89, stdev=49.08, samples=123 iops : min= 1, max= 13, avg= 5.71, stdev= 3.16, samples=123 lat (msec) : 10=3.78%, 20=16.67%, 50=18.23%, 100=27.86%, 250=30.08% lat (msec) : 500=3.39% cpu : usr=0.04%, sys=1.50%, ctx=1324, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146214: Mon Jun 1 13:49:24 2026 read: IOPS=6, BW=104KiB/s (106kB/s)(6256KiB/60181msec) clat (msec): min=6, max=268, avg=31.91, stdev=31.39 lat (msec): min=6, max=268, avg=31.92, stdev=31.39 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 31], 80.00th=[ 42], 90.00th=[ 64], 95.00th=[ 110], | 99.00th=[ 157], 99.50th=[ 205], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 30, max= 320, per=29.59%, avg=112.44, stdev=76.14, samples=110 iops : min= 1, max= 20, avg= 6.25, stdev= 4.82, samples=110 write: IOPS=6, BW=100KiB/s (103kB/s)(6032KiB/60181msec); 0 zone resets clat (msec): min=37, max=422, avg=125.89, stdev=59.11 lat (msec): min=37, max=422, avg=125.89, stdev=59.11 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 54], 10.00th=[ 63], 20.00th=[ 81], | 30.00th=[ 92], 40.00th=[ 104], 50.00th=[ 113], 60.00th=[ 128], | 70.00th=[ 140], 80.00th=[ 167], 90.00th=[ 205], 95.00th=[ 241], | 99.00th=[ 334], 99.50th=[ 363], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 223, per=24.85%, avg=99.39, stdev=45.46, samples=119 iops : min= 1, max= 13, avg= 5.41, stdev= 2.96, samples=119 lat (msec) : 10=3.78%, 20=19.01%, 50=22.27%, 100=21.22%, 250=31.51% lat (msec) : 500=2.21% cpu : usr=0.04%, sys=1.58%, ctx=1338, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146215: Mon Jun 1 13:49:24 2026 read: IOPS=6, BW=98.5KiB/s (101kB/s)(6032KiB/61219msec) clat (msec): min=6, max=259, avg=33.68, stdev=35.35 lat (msec): min=6, max=259, avg=33.68, stdev=35.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 102], | 99.00th=[ 224], 99.50th=[ 257], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 319, per=28.35%, avg=107.72, stdev=71.31, samples=109 iops : min= 1, max= 19, avg= 5.95, stdev= 4.51, samples=109 write: IOPS=6, BW=102KiB/s (105kB/s)(6256KiB/61219msec); 0 zone resets clat (msec): min=40, max=369, avg=123.43, stdev=55.91 lat (msec): min=40, max=369, avg=123.44, stdev=55.91 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 90], 40.00th=[ 100], 50.00th=[ 111], 60.00th=[ 123], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 197], 95.00th=[ 243], | 99.00th=[ 305], 99.50th=[ 355], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 30, max= 191, per=25.56%, avg=102.23, stdev=44.55, samples=120 iops : min= 1, max= 11, avg= 5.60, stdev= 2.88, samples=120 lat (msec) : 10=3.52%, 20=18.88%, 50=19.14%, 100=26.04%, 250=30.21% lat (msec) : 500=2.21% cpu : usr=0.05%, sys=1.40%, ctx=1347, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=381KiB/s (390kB/s), 91.3KiB/s-104KiB/s (93.5kB/s-106kB/s), io=23.4MiB (24.5MB), run=60181-62896msec WRITE: bw=401KiB/s (410kB/s), 100KiB/s-104KiB/s (103kB/s-107kB/s), io=24.6MiB (25.8MB), run=60181-62896msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146236: Mon Jun 1 13:49:42 2026 read: IOPS=1, BW=1558KiB/s (1595kB/s)(7168KiB/4602msec) clat (msec): min=98, max=890, avg=320.55, stdev=267.71 lat (msec): min=98, max=890, avg=320.55, stdev=267.71 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 146], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 222], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 384], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1648, max= 4007, per=65.52%, avg=2349.60, stdev=941.36, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1113KiB/s (1139kB/s)(5120KiB/4602msec); 0 zone resets clat (msec): min=151, max=854, avg=430.99, stdev=260.53 lat (msec): min=151, max=854, avg=431.07, stdev=260.53 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 363], 60.00th=[ 363], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 2007, max= 4079, per=53.98%, avg=2709.67, stdev=1186.01, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=16.67% cpu : usr=0.00%, sys=2.61%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146237: Mon Jun 1 13:49:42 2026 read: IOPS=0, BW=359KiB/s (367kB/s)(2048KiB/5711msec) clat (msec): min=86, max=164, avg=125.46, stdev=55.36 lat (msec): min=86, max=164, avg=125.46, stdev=55.37 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 87], 50.00th=[ 87], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 165], 95.00th=[ 165], | 99.00th=[ 165], 99.50th=[ 165], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 1393, max= 2043, per=47.91%, avg=1718.00, stdev=459.62, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1793KiB/s (1836kB/s)(10.0MiB/5711msec); 0 zone resets clat (msec): min=202, max=934, avg=518.91, stdev=226.92 lat (msec): min=202, max=934, avg=519.00, stdev=226.93 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 226], | 30.00th=[ 292], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 592], | 70.00th=[ 609], 80.00th=[ 651], 90.00th=[ 667], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1992, max= 4079, per=51.81%, avg=2600.86, stdev=985.57, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=8.33%, 750=50.00%, 1000=8.33% cpu : usr=0.00%, sys=1.94%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146238: Mon Jun 1 13:49:42 2026 read: IOPS=1, BW=1108KiB/s (1135kB/s)(6144KiB/5545msec) clat (msec): min=130, max=474, avg=307.95, stdev=154.07 lat (msec): min=130, max=474, avg=307.95, stdev=154.07 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 133], | 30.00th=[ 133], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 363], | 70.00th=[ 464], 80.00th=[ 464], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 2007, max= 2043, per=56.73%, avg=2034.20, stdev=15.34, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1108KiB/s (1135kB/s)(6144KiB/5545msec); 0 zone resets clat (msec): min=245, max=1318, avg=576.75, stdev=387.09 lat (msec): min=245, max=1318, avg=577.20, stdev=386.96 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 567], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1494, max= 2043, per=38.46%, avg=1930.80, stdev=244.18, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=50.00%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=2.74%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146239: Mon Jun 1 13:49:42 2026 read: IOPS=1, BW=1154KiB/s (1182kB/s)(5120KiB/4435msec) clat (msec): min=83, max=411, avg=231.22, stdev=137.47 lat (msec): min=83, max=411, avg=231.22, stdev=137.47 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 236], 60.00th=[ 236], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 2043, max= 6131, per=100.00%, avg=4087.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1616KiB/s (1655kB/s)(7168KiB/4435msec); 0 zone resets clat (msec): min=182, max=739, avg=447.95, stdev=167.69 lat (msec): min=183, max=739, avg=448.03, stdev=167.70 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 368], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 447], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 523], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1374, max= 2043, per=38.41%, avg=1928.14, stdev=245.20, samples=7 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.05%, sys=2.89%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3586KiB/s (3672kB/s), 359KiB/s-1558KiB/s (367kB/s-1595kB/s), io=20.0MiB (20.0MB), run=4435-5711msec WRITE: bw=5020KiB/s (5141kB/s), 1108KiB/s-1793KiB/s (1135kB/s-1836kB/s), io=28.0MiB (29.4MB), run=4435-5711msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146240: Mon Jun 1 13:49:43 2026 read: IOPS=2, BW=2106KiB/s (2156kB/s)(7168KiB/3404msec) clat (msec): min=8, max=448, avg=292.49, stdev=139.85 lat (msec): min=8, max=448, avg=292.49, stdev=139.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 9], 10.00th=[ 9], 20.00th=[ 271], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 313], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 397], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1481, max= 4055, per=63.13%, avg=2267.80, stdev=1021.75, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1504KiB/s (1540kB/s)(5120KiB/3404msec); 0 zone resets clat (msec): min=128, max=366, avg=213.48, stdev=92.68 lat (msec): min=128, max=366, avg=213.56, stdev=92.65 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 368], 95.00th=[ 368], | 99.00th=[ 368], 99.50th=[ 368], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 2015, max= 5919, per=66.04%, avg=3321.67, stdev=2249.37, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 10=8.33%, 250=33.33%, 500=58.33% cpu : usr=0.06%, sys=8.79%, ctx=148, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146241: Mon Jun 1 13:49:43 2026 read: IOPS=0, BW=359KiB/s (368kB/s)(2048KiB/5700msec) clat (msec): min=158, max=450, avg=304.87, stdev=206.44 lat (msec): min=158, max=450, avg=304.87, stdev=206.44 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 1519, max= 2019, per=49.25%, avg=1769.00, stdev=353.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1796KiB/s (1840kB/s)(10.0MiB/5700msec); 0 zone resets clat (msec): min=193, max=915, avg=486.99, stdev=239.24 lat (msec): min=193, max=915, avg=487.13, stdev=239.34 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 288], | 30.00th=[ 292], 40.00th=[ 334], 50.00th=[ 376], 60.00th=[ 527], | 70.00th=[ 535], 80.00th=[ 584], 90.00th=[ 827], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1973, max= 4063, per=45.86%, avg=2306.71, stdev=774.75, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=16.67% cpu : usr=0.00%, sys=8.40%, ctx=139, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146242: Mon Jun 1 13:49:43 2026 read: IOPS=1, BW=1547KiB/s (1584kB/s)(6144KiB/3972msec) clat (usec): min=381, max=246875, avg=65760.82, stdev=104779.43 lat (usec): min=396, max=246876, avg=65764.57, stdev=104777.35 clat percentiles (usec): | 1.00th=[ 383], 5.00th=[ 383], 10.00th=[ 383], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[ 2180], 50.00th=[ 2180], 60.00th=[ 3556], | 70.00th=[141558], 80.00th=[141558], 90.00th=[246416], 95.00th=[246416], | 99.00th=[246416], 99.50th=[246416], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 2019, max= 4031, per=92.76%, avg=3332.00, stdev=1137.89, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1547KiB/s (1584kB/s)(6144KiB/3972msec); 0 zone resets clat (msec): min=285, max=1214, avg=528.62, stdev=347.51 lat (msec): min=285, max=1214, avg=528.77, stdev=347.51 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 451], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1799, max= 4039, per=47.15%, avg=2371.40, stdev=936.77, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=16.67%, 250=16.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.00%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146243: Mon Jun 1 13:49:43 2026 read: IOPS=1, BW=1052KiB/s (1078kB/s)(5120KiB/4865msec) clat (usec): min=525, max=434862, avg=117772.60, stdev=188637.58 lat (usec): min=526, max=434863, avg=117773.53, stdev=188637.37 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 529], 40.00th=[ 529], 50.00th=[ 2704], 60.00th=[ 2704], | 70.00th=[149947], 80.00th=[149947], 90.00th=[434111], 95.00th=[434111], | 99.00th=[434111], 99.50th=[434111], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 4007, max= 4039, per=100.00%, avg=4023.00, stdev=22.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1473KiB/s (1509kB/s)(7168KiB/4865msec); 0 zone resets clat (msec): min=204, max=1375, avg=595.98, stdev=450.59 lat (msec): min=204, max=1376, avg=596.15, stdev=450.80 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 247], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 443], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 1070], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 1422, max= 4079, per=44.95%, avg=2260.83, stdev=921.89, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (usec) : 750=16.67% lat (msec) : 4=8.33%, 250=25.00%, 500=25.00%, 750=8.33%, 2000=16.67% cpu : usr=0.00%, sys=6.91%, ctx=108, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3593KiB/s (3679kB/s), 359KiB/s-2106KiB/s (368kB/s-2156kB/s), io=20.0MiB (20.0MB), run=3404-5700msec WRITE: bw=5030KiB/s (5151kB/s), 1473KiB/s-1796KiB/s (1509kB/s-1840kB/s), io=28.0MiB (29.4MB), run=3404-5700msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146253: Mon Jun 1 13:50:00 2026 read: IOPS=1, BW=4465KiB/s (4572kB/s)(12.0MiB/2752msec) clat (msec): min=423, max=1374, avg=896.57, stdev=475.60 lat (msec): min=423, max=1374, avg=896.57, stdev=475.60 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7937, max= 7984, per=100.00%, avg=7960.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.40%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146254: Mon Jun 1 13:50:00 2026 read: IOPS=0, BW=1376KiB/s (1409kB/s)(4096KiB/2977msec) clat (nsec): min=459799k, max=459799k, avg=459798561.00, stdev= 0.00 lat (nsec): min=459802k, max=459802k, avg=459801885.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 460], 5.00th=[ 460], 10.00th=[ 460], 20.00th=[ 460], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 6725, max= 6725, per=100.00%, avg=6725.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2752KiB/s (2818kB/s)(8192KiB/2977msec); 0 zone resets clat (msec): min=1135, max=1322, avg=1229.01, stdev=131.98 lat (msec): min=1136, max=1326, avg=1231.48, stdev=134.89 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.63%, ctx=43, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146256: Mon Jun 1 13:50:00 2026 write: IOPS=0, BW=2766KiB/s (2833kB/s)(12.0MiB/4442msec); 0 zone resets clat (msec): min=368, max=2744, avg=1388.72, stdev=1222.94 lat (msec): min=370, max=2748, avg=1391.07, stdev=1224.61 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 1053], 50.00th=[ 1053], 60.00th=[ 1053], | 70.00th=[ 2735], 80.00th=[ 2735], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 8062, max= 8175, per=100.00%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=3.56%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146258: Mon Jun 1 13:50:00 2026 write: IOPS=1, BW=4171KiB/s (4271kB/s)(12.0MiB/2946msec); 0 zone resets clat (msec): min=673, max=1283, avg=949.98, stdev=309.09 lat (msec): min=674, max=1284, avg=951.42, stdev=308.85 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 8000, max= 8015, per=100.00%, avg=8007.50, stdev=10.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.84%, ctx=51, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5504KiB/s (5636kB/s), 1376KiB/s-4465KiB/s (1409kB/s-4572kB/s), io=16.0MiB (16.8MB), run=2752-2977msec WRITE: bw=7377KiB/s (7554kB/s), 2752KiB/s-4171KiB/s (2818kB/s-4271kB/s), io=32.0MiB (33.6MB), run=2946-4442msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146252: Mon Jun 1 13:50:00 2026 read: IOPS=1, BW=4715KiB/s (4828kB/s)(12.0MiB/2606msec) clat (msec): min=701, max=995, avg=843.35, stdev=147.07 lat (msec): min=701, max=995, avg=843.35, stdev=147.07 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7968, max= 8159, per=100.00%, avg=8063.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.37%, ctx=151, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146255: Mon Jun 1 13:50:00 2026 read: IOPS=0, BW=1248KiB/s (1278kB/s)(4096KiB/3282msec) clat (nsec): min=835110k, max=835110k, avg=835110393.00, stdev= 0.00 lat (nsec): min=835113k, max=835113k, avg=835113285.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2496KiB/s (2556kB/s)(8192KiB/3282msec); 0 zone resets clat (msec): min=1098, max=1185, avg=1141.76, stdev=61.17 lat (msec): min=1100, max=1201, avg=1151.13, stdev=71.90 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.61%, ctx=92, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146257: Mon Jun 1 13:50:00 2026 write: IOPS=0, BW=2893KiB/s (2962kB/s)(12.0MiB/4248msec); 0 zone resets clat (msec): min=888, max=1704, avg=1355.36, stdev=420.88 lat (msec): min=889, max=1712, avg=1358.43, stdev=423.22 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.02%, sys=3.65%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146259: Mon Jun 1 13:50:00 2026 write: IOPS=1, BW=5242KiB/s (5368kB/s)(12.0MiB/2344msec); 0 zone resets clat (msec): min=368, max=1512, avg=761.94, stdev=650.42 lat (msec): min=369, max=1513, avg=762.72, stdev=650.73 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 1519], 80.00th=[ 1519], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 5483, max= 7968, per=87.20%, avg=6725.50, stdev=1757.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.41%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4992KiB/s (5112kB/s), 1248KiB/s-4715KiB/s (1278kB/s-4828kB/s), io=16.0MiB (16.8MB), run=2606-3282msec WRITE: bw=7714KiB/s (7899kB/s), 2496KiB/s-5242KiB/s (2556kB/s-5368kB/s), io=32.0MiB (33.6MB), run=2344-4248msec