== sanity test 398b: DIO and buffer IO race ============== 11:48:26 (1789141706) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.52479 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180905: Fri Sep 11 11:50:40 2026 read: IOPS=13, BW=52.4KiB/s (53.7kB/s)(5992KiB/114333msec) clat (usec): min=37, max=975673, avg=41221.96, stdev=35645.26 lat (usec): min=37, max=975673, avg=41223.89, stdev=35645.14 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8356], 10.00th=[ 14746], 20.00th=[ 20579], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 41157], | 70.00th=[ 47973], 80.00th=[ 58459], 90.00th=[ 72877], 95.00th=[ 84411], | 99.00th=[126354], 99.50th=[160433], 99.90th=[231736], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 142, per=24.72%, avg=51.91, stdev=20.90, samples=226 iops : min= 1, max= 35, avg=12.33, stdev= 5.26, samples=226 write: IOPS=13, BW=55.1KiB/s (56.4kB/s)(6296KiB/114333msec); 0 zone resets clat (usec): min=924, max=287391, avg=33128.06, stdev=33712.87 lat (usec): min=925, max=287393, avg=33132.74, stdev=33715.75 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1205], 10.00th=[ 1631], 20.00th=[ 4080], | 30.00th=[ 8455], 40.00th=[ 16712], 50.00th=[ 25035], 60.00th=[ 32637], | 70.00th=[ 41681], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[152044], 99.50th=[166724], 99.90th=[240124], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 135, per=25.00%, avg=54.76, stdev=22.23, samples=225 iops : min= 1, max= 33, avg=13.05, stdev= 5.59, samples=225 lat (usec) : 50=0.39%, 100=1.43%, 250=0.16%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=6.18%, 4=3.94%, 10=6.77%, 20=12.96%, 50=42.09% lat (msec) : 100=21.97%, 250=3.91%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.38%, ctx=6528, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180906: Fri Sep 11 11:50:40 2026 read: IOPS=13, BW=53.5KiB/s (54.8kB/s)(5940KiB/111094msec) clat (usec): min=43, max=421349, avg=39941.60, stdev=27548.16 lat (usec): min=44, max=421351, avg=39943.01, stdev=27548.11 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10159], 10.00th=[ 15270], 20.00th=[ 20055], | 30.00th=[ 24773], 40.00th=[ 29492], 50.00th=[ 34341], 60.00th=[ 40109], | 70.00th=[ 47973], 80.00th=[ 56886], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[135267], 99.50th=[143655], 99.90th=[256902], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 111, per=25.27%, avg=53.06, stdev=21.18, samples=219 iops : min= 1, max= 27, avg=12.63, stdev= 5.33, samples=219 write: IOPS=14, BW=57.1KiB/s (58.5kB/s)(6348KiB/111094msec); 0 zone resets clat (usec): min=1014, max=798930, avg=32355.38, stdev=38602.76 lat (usec): min=1015, max=798932, avg=32362.54, stdev=38604.79 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1713], 20.00th=[ 3458], | 30.00th=[ 6783], 40.00th=[ 13960], 50.00th=[ 22938], 60.00th=[ 30802], | 70.00th=[ 40633], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[175113], 99.90th=[320865], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 127, per=26.06%, avg=57.08, stdev=21.73, samples=217 iops : min= 1, max= 31, avg=13.64, stdev= 5.45, samples=217 lat (usec) : 50=0.13%, 100=1.79%, 250=0.16% lat (msec) : 2=6.38%, 4=5.27%, 10=6.84%, 20=12.83%, 50=41.28% lat (msec) : 100=21.88%, 250=3.32%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=5.38%, ctx=6324, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180907: Fri Sep 11 11:50:40 2026 read: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6028KiB/111451msec) clat (usec): min=34, max=187460, avg=40544.91, stdev=26255.60 lat (usec): min=34, max=187462, avg=40551.01, stdev=26254.72 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 807], 10.00th=[ 15008], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 30016], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 47973], 80.00th=[ 58459], 90.00th=[ 73925], 95.00th=[ 90702], | 99.00th=[129500], 99.50th=[145753], 99.90th=[177210], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 127, per=25.68%, avg=53.92, stdev=20.85, samples=218 iops : min= 1, max= 31, avg=12.84, stdev= 5.27, samples=218 write: IOPS=14, BW=56.2KiB/s (57.5kB/s)(6260KiB/111451msec); 0 zone resets clat (usec): min=900, max=953130, avg=31869.97, stdev=42094.95 lat (usec): min=903, max=953132, avg=31880.40, stdev=42092.54 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1369], 20.00th=[ 3261], | 30.00th=[ 6063], 40.00th=[ 12256], 50.00th=[ 21103], 60.00th=[ 28705], | 70.00th=[ 39060], 80.00th=[ 53740], 90.00th=[ 78119], 95.00th=[101188], | 99.00th=[160433], 99.50th=[181404], 99.90th=[312476], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 119, per=25.41%, avg=55.65, stdev=21.57, samples=219 iops : min= 1, max= 29, avg=13.27, stdev= 5.43, samples=219 lat (usec) : 50=0.42%, 100=1.79%, 250=0.10%, 500=0.10%, 1000=0.20% lat (msec) : 2=7.10%, 4=4.85%, 10=7.16%, 20=12.27%, 50=41.54% lat (msec) : 100=20.25%, 250=4.13%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=5.46%, ctx=6188, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180908: Fri Sep 11 11:50:40 2026 read: IOPS=13, BW=54.4KiB/s (55.7kB/s)(6052KiB/111298msec) clat (usec): min=32, max=812120, avg=40977.49, stdev=34875.43 lat (usec): min=32, max=812121, avg=40978.85, stdev=34875.49 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9372], 10.00th=[ 14877], 20.00th=[ 20055], | 30.00th=[ 24511], 40.00th=[ 29230], 50.00th=[ 34866], 60.00th=[ 40633], | 70.00th=[ 48497], 80.00th=[ 58459], 90.00th=[ 70779], 95.00th=[ 88605], | 99.00th=[147850], 99.50th=[183501], 99.90th=[408945], 99.95th=[809501], | 99.99th=[809501] bw ( KiB/s): min= 7, max= 103, per=25.62%, avg=53.80, stdev=19.92, samples=220 iops : min= 1, max= 25, avg=12.81, stdev= 4.99, samples=220 write: IOPS=14, BW=56.0KiB/s (57.4kB/s)(6236KiB/111298msec); 0 zone resets clat (usec): min=963, max=250532, avg=31351.54, stdev=32276.66 lat (usec): min=964, max=250534, avg=31357.82, stdev=32279.66 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1647], 20.00th=[ 3851], | 30.00th=[ 6718], 40.00th=[ 13698], 50.00th=[ 22152], 60.00th=[ 30802], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[135267], 99.50th=[156238], 99.90th=[221250], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 134, per=25.42%, avg=55.68, stdev=21.67, samples=219 iops : min= 1, max= 33, avg=13.27, stdev= 5.47, samples=219 lat (usec) : 50=0.29%, 100=1.66%, 250=0.16%, 500=0.10%, 1000=0.03% lat (msec) : 2=6.35%, 4=4.23%, 10=8.27%, 20=12.24%, 50=40.95% lat (msec) : 100=22.20%, 250=3.39%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=5.48%, ctx=6442, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=210KiB/s (215kB/s), 52.4KiB/s-54.4KiB/s (53.7kB/s-55.7kB/s), io=23.4MiB (24.6MB), run=111094-114333msec WRITE: bw=220KiB/s (225kB/s), 55.1KiB/s-57.1KiB/s (56.4kB/s-58.5kB/s), io=24.6MiB (25.7MB), run=111094-114333msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180910: Fri Sep 11 11:51:17 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(5992KiB/150422msec) clat (msec): min=5, max=1033, avg=38.97, stdev=43.10 lat (msec): min=5, max=1033, avg=38.97, stdev=43.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 85], 95.00th=[ 113], | 99.00th=[ 171], 99.50th=[ 190], 99.90th=[ 326], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 143, per=25.51%, avg=40.55, stdev=27.20, samples=287 iops : min= 1, max= 35, avg= 9.51, stdev= 6.84, samples=287 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6296KiB/150422msec); 0 zone resets clat (msec): min=8, max=403, avg=58.40, stdev=42.49 lat (msec): min=8, max=403, avg=58.40, stdev=42.49 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 215], 99.50th=[ 243], 99.90th=[ 368], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 127, per=24.96%, avg=41.68, stdev=25.90, samples=294 iops : min= 1, max= 31, avg= 9.79, stdev= 6.53, samples=294 lat (msec) : 10=3.26%, 20=18.20%, 50=45.15%, 100=22.66%, 250=10.48% lat (msec) : 500=0.23%, 2000=0.03% cpu : usr=0.05%, sys=1.86%, ctx=4798, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180911: Fri Sep 11 11:51:17 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(5940KiB/150502msec) clat (msec): min=5, max=909, avg=40.02, stdev=42.85 lat (msec): min=5, max=909, avg=40.03, stdev=42.85 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 88], 95.00th=[ 115], | 99.00th=[ 180], 99.50th=[ 186], 99.90th=[ 326], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 136, per=25.16%, avg=40.01, stdev=28.41, samples=290 iops : min= 1, max= 34, avg= 9.38, stdev= 7.15, samples=290 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6348KiB/150502msec); 0 zone resets clat (msec): min=8, max=383, avg=57.30, stdev=40.67 lat (msec): min=8, max=383, avg=57.30, stdev=40.67 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 86], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 188], 99.50th=[ 215], 99.90th=[ 326], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 135, per=25.19%, avg=42.06, stdev=26.71, samples=295 iops : min= 1, max= 33, avg= 9.89, stdev= 6.73, samples=295 lat (msec) : 10=3.55%, 20=17.68%, 50=44.69%, 100=23.67%, 250=10.09% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.05%, sys=1.76%, ctx=4801, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180912: Fri Sep 11 11:51:17 2026 read: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6028KiB/148837msec) clat (msec): min=5, max=365, avg=39.29, stdev=37.15 lat (msec): min=5, max=365, avg=39.30, stdev=37.15 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 85], 95.00th=[ 115], | 99.00th=[ 178], 99.50th=[ 203], 99.90th=[ 296], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 152, per=25.59%, avg=40.68, stdev=28.29, samples=289 iops : min= 1, max= 38, avg= 9.54, stdev= 7.13, samples=289 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6260KiB/148837msec); 0 zone resets clat (msec): min=10, max=899, avg=57.18, stdev=46.41 lat (msec): min=10, max=899, avg=57.19, stdev=46.41 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 66], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 138], | 99.00th=[ 209], 99.50th=[ 241], 99.90th=[ 363], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 127, per=25.21%, avg=42.10, stdev=26.86, samples=290 iops : min= 1, max= 31, avg= 9.89, stdev= 6.76, samples=290 lat (msec) : 10=3.91%, 20=17.64%, 50=46.06%, 100=22.01%, 250=10.03% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.85%, ctx=4826, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180913: Fri Sep 11 11:51:17 2026 read: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6052KiB/149793msec) clat (msec): min=4, max=304, avg=39.75, stdev=38.07 lat (msec): min=4, max=304, avg=39.75, stdev=38.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 123], | 99.00th=[ 178], 99.50th=[ 218], 99.90th=[ 288], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 135, per=25.87%, avg=41.14, stdev=28.19, samples=287 iops : min= 1, max= 33, avg= 9.66, stdev= 7.10, samples=287 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6236KiB/149793msec); 0 zone resets clat (msec): min=10, max=903, avg=57.41, stdev=46.45 lat (msec): min=10, max=903, avg=57.41, stdev=46.45 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 67], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 138], | 99.00th=[ 213], 99.50th=[ 251], 99.90th=[ 384], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 128, per=24.83%, avg=41.46, stdev=26.18, samples=293 iops : min= 1, max= 32, avg= 9.74, stdev= 6.59, samples=293 lat (msec) : 10=3.97%, 20=17.48%, 50=45.80%, 100=22.53%, 250=9.77% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.05%, sys=1.79%, ctx=4808, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=160KiB/s (163kB/s), 39.5KiB/s-40.5KiB/s (40.4kB/s-41.5kB/s), io=23.4MiB (24.6MB), run=148837-150502msec WRITE: bw=167KiB/s (171kB/s), 41.6KiB/s-42.2KiB/s (42.6kB/s-43.2kB/s), io=24.6MiB (25.7MB), run=148837-150502msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180955: Fri Sep 11 11:52:02 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(5920KiB/31659msec) clat (usec): min=32, max=261882, avg=43936.35, stdev=32536.69 lat (usec): min=33, max=261883, avg=43937.56, stdev=32536.73 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 63], 10.00th=[ 115], 20.00th=[ 22676], | 30.00th=[ 27395], 40.00th=[ 33424], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 62653], 90.00th=[ 77071], 95.00th=[ 87557], | 99.00th=[177210], 99.50th=[187696], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 62, max= 350, per=24.81%, avg=187.53, stdev=70.27, samples=62 iops : min= 3, max= 21, avg=10.90, stdev= 4.39, samples=62 write: IOPS=12, BW=201KiB/s (206kB/s)(6368KiB/31659msec); 0 zone resets clat (usec): min=1562, max=194902, avg=37709.01, stdev=37229.95 lat (usec): min=1564, max=194904, avg=37711.07, stdev=37230.03 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2147], 10.00th=[ 2933], 20.00th=[ 5997], | 30.00th=[ 10683], 40.00th=[ 18744], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 45876], 80.00th=[ 63701], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[160433], 99.50th=[173016], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 21, max= 509, per=25.45%, avg=202.29, stdev=93.42, samples=62 iops : min= 1, max= 31, avg=11.82, stdev= 5.85, samples=62 lat (usec) : 50=0.65%, 100=4.04%, 250=0.52%, 500=0.13% lat (msec) : 2=1.82%, 4=5.34%, 10=8.33%, 20=9.38%, 50=37.89% lat (msec) : 100=25.91%, 250=5.86%, 500=0.13% cpu : usr=0.07%, sys=5.49%, ctx=1678, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180956: Fri Sep 11 11:52:02 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(5744KiB/31553msec) clat (usec): min=43, max=201215, avg=46502.52, stdev=31324.91 lat (usec): min=44, max=201216, avg=46503.67, stdev=31324.91 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 71], 10.00th=[ 16909], 20.00th=[ 23987], | 30.00th=[ 28967], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 46924], | 70.00th=[ 54264], 80.00th=[ 64226], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[164627], 99.50th=[177210], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 21, max= 349, per=24.56%, avg=185.70, stdev=73.94, samples=60 iops : min= 1, max= 21, avg=10.78, stdev= 4.65, samples=60 write: IOPS=12, BW=207KiB/s (212kB/s)(6544KiB/31553msec); 0 zone resets clat (usec): min=1396, max=263844, avg=35227.38, stdev=38199.05 lat (usec): min=1398, max=263846, avg=35241.07, stdev=38206.70 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1876], 10.00th=[ 3130], 20.00th=[ 5538], | 30.00th=[ 9372], 40.00th=[ 17957], 50.00th=[ 23200], 60.00th=[ 31851], | 70.00th=[ 41681], 80.00th=[ 57410], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[183501], 99.50th=[229639], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 21, max= 477, per=26.24%, avg=208.59, stdev=101.50, samples=61 iops : min= 1, max= 29, avg=12.23, stdev= 6.36, samples=61 lat (usec) : 50=0.26%, 100=2.47%, 250=0.26%, 500=0.26% lat (msec) : 2=3.12%, 4=4.43%, 10=9.24%, 20=9.51%, 50=40.36% lat (msec) : 100=24.61%, 250=5.21%, 500=0.26% cpu : usr=0.06%, sys=5.98%, ctx=1689, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180957: Fri Sep 11 11:52:02 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6256KiB/31533msec) clat (usec): min=46, max=216599, avg=43558.52, stdev=30152.14 lat (usec): min=47, max=216601, avg=43559.70, stdev=30152.15 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 64], 10.00th=[ 88], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 62653], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[154141], 99.50th=[175113], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 350, per=26.28%, avg=198.69, stdev=79.83, samples=62 iops : min= 1, max= 21, avg=11.66, stdev= 5.04, samples=62 write: IOPS=11, BW=191KiB/s (196kB/s)(6032KiB/31533msec); 0 zone resets clat (usec): min=1586, max=194698, avg=37505.52, stdev=36651.55 lat (usec): min=1589, max=194701, avg=37521.61, stdev=36696.87 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2073], 10.00th=[ 2835], 20.00th=[ 6194], | 30.00th=[ 10683], 40.00th=[ 18482], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[158335], 99.50th=[168821], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 61, max= 406, per=23.84%, avg=189.56, stdev=84.82, samples=62 iops : min= 3, max= 25, avg=11.08, stdev= 5.34, samples=62 lat (usec) : 50=0.13%, 100=5.08%, 250=0.39% lat (msec) : 2=2.47%, 4=4.30%, 10=7.94%, 20=8.46%, 50=38.67% lat (msec) : 100=26.95%, 250=5.60% cpu : usr=0.05%, sys=5.58%, ctx=1760, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180958: Fri Sep 11 11:52:02 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6032KiB/30312msec) clat (usec): min=37, max=194646, avg=44058.68, stdev=31641.28 lat (usec): min=37, max=194647, avg=44059.89, stdev=31641.39 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 79], 20.00th=[ 21103], | 30.00th=[ 27395], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[139461], 99.50th=[177210], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 93, max= 408, per=26.16%, avg=197.79, stdev=78.38, samples=58 iops : min= 5, max= 25, avg=11.60, stdev= 4.96, samples=58 write: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30312msec); 0 zone resets clat (usec): min=1405, max=184124, avg=34736.72, stdev=34291.93 lat (usec): min=1407, max=184126, avg=34738.86, stdev=34291.99 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 2089], 10.00th=[ 2868], 20.00th=[ 5342], | 30.00th=[ 10552], 40.00th=[ 15008], 50.00th=[ 24773], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[154141], 99.50th=[177210], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 93, max= 437, per=25.65%, avg=203.95, stdev=81.83, samples=59 iops : min= 5, max= 27, avg=12.00, stdev= 5.19, samples=59 lat (usec) : 50=0.91%, 100=4.17%, 250=0.78%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=1.82%, 4=6.38%, 10=6.64%, 20=10.42%, 50=38.41% lat (msec) : 100=24.35%, 250=5.47% cpu : usr=0.09%, sys=6.16%, ctx=1639, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=757KiB/s (775kB/s), 182KiB/s-199KiB/s (186kB/s-204kB/s), io=23.4MiB (24.5MB), run=30312-31659msec WRITE: bw=796KiB/s (815kB/s), 191KiB/s-207KiB/s (196kB/s-212kB/s), io=24.6MiB (25.8MB), run=30312-31659msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180959: Fri Sep 11 11:52:13 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(5920KiB/42655msec) clat (msec): min=6, max=215, avg=45.25, stdev=34.42 lat (msec): min=6, max=215, avg=45.25, stdev=34.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 88], 95.00th=[ 121], | 99.00th=[ 171], 99.50th=[ 201], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 412, per=24.91%, avg=138.24, stdev=79.94, samples=83 iops : min= 1, max= 25, avg= 7.82, stdev= 5.02, samples=83 write: IOPS=9, BW=149KiB/s (153kB/s)(6368KiB/42655msec); 0 zone resets clat (msec): min=12, max=312, avg=64.77, stdev=43.45 lat (msec): min=12, max=312, avg=64.78, stdev=43.46 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 96], 90.00th=[ 124], 95.00th=[ 144], | 99.00th=[ 239], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 351, per=25.64%, avg=149.75, stdev=77.11, samples=83 iops : min= 1, max= 21, avg= 8.54, stdev= 4.85, samples=83 lat (msec) : 10=1.04%, 20=10.81%, 50=47.79%, 100=27.21%, 250=12.76% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.80%, ctx=1200, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180960: Fri Sep 11 11:52:13 2026 read: IOPS=8, BW=133KiB/s (137kB/s)(5744KiB/43089msec) clat (msec): min=8, max=205, avg=44.75, stdev=34.93 lat (msec): min=8, max=205, avg=44.75, stdev=34.93 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 90], 95.00th=[ 120], | 99.00th=[ 186], 99.50th=[ 194], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 28, max= 350, per=24.38%, avg=135.29, stdev=81.43, samples=83 iops : min= 1, max= 21, avg= 7.63, stdev= 5.10, samples=83 write: IOPS=9, BW=152KiB/s (156kB/s)(6544KiB/43089msec); 0 zone resets clat (msec): min=9, max=284, avg=65.28, stdev=44.09 lat (msec): min=9, max=284, avg=65.28, stdev=44.09 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 78], 80.00th=[ 96], 90.00th=[ 132], 95.00th=[ 155], | 99.00th=[ 218], 99.50th=[ 236], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 479, per=26.51%, avg=154.82, stdev=85.45, samples=83 iops : min= 1, max= 29, avg= 8.86, stdev= 5.35, samples=83 lat (msec) : 10=0.91%, 20=10.29%, 50=49.74%, 100=25.65%, 250=13.28% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.73%, ctx=1200, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180961: Fri Sep 11 11:52:13 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(6256KiB/42379msec) clat (msec): min=7, max=203, avg=46.30, stdev=37.70 lat (msec): min=7, max=203, avg=46.30, stdev=37.70 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 63], 90.00th=[ 105], 95.00th=[ 136], | 99.00th=[ 182], 99.50th=[ 188], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 435, per=27.03%, avg=150.00, stdev=94.87, samples=82 iops : min= 1, max= 27, avg= 8.56, stdev= 5.99, samples=82 write: IOPS=8, BW=142KiB/s (146kB/s)(6032KiB/42379msec); 0 zone resets clat (msec): min=15, max=262, avg=63.32, stdev=41.01 lat (msec): min=15, max=262, avg=63.32, stdev=41.01 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 224], 99.50th=[ 245], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 31, max= 350, per=24.35%, avg=142.18, stdev=75.90, samples=82 iops : min= 1, max= 21, avg= 8.07, stdev= 4.76, samples=82 lat (msec) : 10=0.91%, 20=10.94%, 50=48.05%, 100=26.82%, 250=13.15% lat (msec) : 500=0.13% cpu : usr=0.03%, sys=1.84%, ctx=1220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180962: Fri Sep 11 11:52:13 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42194msec) clat (msec): min=7, max=237, avg=42.46, stdev=34.05 lat (msec): min=7, max=237, avg=42.47, stdev=34.05 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 87], 95.00th=[ 113], | 99.00th=[ 194], 99.50th=[ 211], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 30, max= 447, per=25.80%, avg=143.17, stdev=85.26, samples=82 iops : min= 1, max= 27, avg= 8.12, stdev= 5.35, samples=82 write: IOPS=9, BW=148KiB/s (152kB/s)(6256KiB/42194msec); 0 zone resets clat (msec): min=14, max=314, avg=65.87, stdev=43.10 lat (msec): min=14, max=314, avg=65.88, stdev=43.10 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 79], 80.00th=[ 97], 90.00th=[ 127], 95.00th=[ 146], | 99.00th=[ 199], 99.50th=[ 218], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 29, max= 382, per=25.38%, avg=148.24, stdev=75.96, samples=83 iops : min= 1, max= 23, avg= 8.45, stdev= 4.78, samples=83 lat (msec) : 10=0.91%, 20=9.24%, 50=52.86%, 100=23.70%, 250=13.15% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.84%, ctx=1209, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=556KiB/s (569kB/s), 133KiB/s-148KiB/s (137kB/s-151kB/s), io=23.4MiB (24.5MB), run=42194-43089msec WRITE: bw=585KiB/s (599kB/s), 142KiB/s-152KiB/s (146kB/s-156kB/s), io=24.6MiB (25.8MB), run=42194-43089msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180975: Fri Sep 11 11:52:32 2026 read: IOPS=1, BW=1361KiB/s (1394kB/s)(7168KiB/5267msec) clat (usec): min=471, max=1891.3k, avg=424476.94, stdev=656005.65 lat (usec): min=472, max=1891.3k, avg=424478.29, stdev=656005.60 clat percentiles (usec): | 1.00th=[ 474], 5.00th=[ 474], 10.00th=[ 474], | 20.00th=[ 110625], 30.00th=[ 158335], 40.00th=[ 158335], | 50.00th=[ 196084], 60.00th=[ 278922], 70.00th=[ 278922], | 80.00th=[ 333448], 90.00th=[1887437], 95.00th=[1887437], | 99.00th=[1887437], 99.50th=[1887437], 99.90th=[1887437], | 99.95th=[1887437], 99.99th=[1887437] bw ( KiB/s): min= 1654, max= 4079, per=74.24%, avg=2332.00, stdev=987.00, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=972KiB/s (995kB/s)(5120KiB/5267msec); 0 zone resets clat (msec): min=311, max=583, avg=451.70, stdev=121.40 lat (msec): min=311, max=583, avg=451.77, stdev=121.40 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1965, max= 3871, per=59.60%, avg=2621.00, stdev=1082.98, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=9.19%, ctx=449, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180976: Fri Sep 11 11:52:32 2026 read: IOPS=0, BW=314KiB/s (322kB/s)(2048KiB/6519msec) clat (msec): min=315, max=495, avg=405.87, stdev=127.34 lat (msec): min=315, max=495, avg=405.88, stdev=127.34 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 1750, max= 1957, per=59.01%, avg=1853.50, stdev=146.37, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1571KiB/s (1608kB/s)(10.0MiB/6519msec); 0 zone resets clat (msec): min=141, max=2368, avg=561.67, stdev=704.14 lat (msec): min=141, max=2368, avg=561.75, stdev=704.13 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 180], | 30.00th=[ 232], 40.00th=[ 255], 50.00th=[ 275], 60.00th=[ 292], | 70.00th=[ 309], 80.00th=[ 363], 90.00th=[ 1200], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1935, max= 5976, per=81.13%, avg=3568.00, stdev=1680.76, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=8.24%, ctx=188, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180978: Fri Sep 11 11:52:32 2026 read: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5452msec) clat (msec): min=67, max=394, avg=285.34, stdev=141.16 lat (msec): min=67, max=394, avg=285.34, stdev=141.16 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 368], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 1957, max= 3930, per=100.00%, avg=3257.67, stdev=1126.63, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5452msec); 0 zone resets clat (msec): min=231, max=2324, avg=619.31, stdev=836.52 lat (msec): min=231, max=2325, avg=619.40, stdev=836.52 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 317], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1935, max= 3117, per=49.93%, avg=2195.80, stdev=516.25, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=58.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.22%, ctx=128, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180979: Fri Sep 11 11:52:32 2026 read: IOPS=0, BW=846KiB/s (867kB/s)(5120KiB/6049msec) clat (usec): min=310, max=9282, avg=2195.84, stdev=3962.42 lat (usec): min=310, max=9283, avg=2196.67, stdev=3962.10 clat percentiles (usec): | 1.00th=[ 310], 5.00th=[ 310], 10.00th=[ 310], 20.00th=[ 310], | 30.00th=[ 437], 40.00th=[ 437], 50.00th=[ 461], 60.00th=[ 461], | 70.00th=[ 490], 80.00th=[ 490], 90.00th=[ 9241], 95.00th=[ 9241], | 99.00th=[ 9241], 99.50th=[ 9241], 99.90th=[ 9241], 99.95th=[ 9241], | 99.99th=[ 9241] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1185KiB/s (1213kB/s)(7168KiB/6049msec); 0 zone resets clat (msec): min=135, max=3571, avg=826.85, stdev=1226.45 lat (msec): min=135, max=3571, avg=826.91, stdev=1226.46 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 182], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 439], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 667], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 1935, max= 3976, per=56.37%, avg=2479.00, stdev=999.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=33.33% lat (msec) : 10=8.33%, 250=25.00%, 500=8.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.17%, ctx=104, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3142KiB/s (3217kB/s), 314KiB/s-1361KiB/s (322kB/s-1394kB/s), io=20.0MiB (20.0MB), run=5267-6519msec WRITE: bw=4398KiB/s (4504kB/s), 972KiB/s-1571KiB/s (995kB/s-1608kB/s), io=28.0MiB (29.4MB), run=5267-6519msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180980: Fri Sep 11 11:52:32 2026 read: IOPS=1, BW=1335KiB/s (1367kB/s)(7168KiB/5371msec) clat (msec): min=85, max=1796, avg=521.83, stdev=626.03 lat (msec): min=85, max=1796, avg=521.83, stdev=626.03 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 121], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 264], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 894], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 2019, max= 4096, per=97.63%, avg=2930.00, stdev=1066.52, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 write: IOPS=0, BW=953KiB/s (976kB/s)(5120KiB/5371msec); 0 zone resets clat (msec): min=115, max=718, avg=338.09, stdev=244.94 lat (msec): min=115, max=718, avg=338.21, stdev=244.98 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1973, max= 4096, per=60.32%, avg=2534.00, stdev=1041.79, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=3.22%, ctx=103, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180981: Fri Sep 11 11:52:32 2026 read: IOPS=0, BW=306KiB/s (313kB/s)(2048KiB/6694msec) clat (msec): min=116, max=358, avg=237.33, stdev=171.01 lat (msec): min=116, max=358, avg=237.33, stdev=171.01 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 117], 50.00th=[ 117], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1380, max= 2035, per=56.90%, avg=1707.50, stdev=463.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1530KiB/s (1566kB/s)(10.0MiB/6694msec); 0 zone resets clat (msec): min=166, max=2690, avg=568.87, stdev=760.00 lat (msec): min=166, max=2690, avg=569.01, stdev=759.98 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 190], | 30.00th=[ 207], 40.00th=[ 222], 50.00th=[ 247], 60.00th=[ 409], | 70.00th=[ 489], 80.00th=[ 493], 90.00th=[ 575], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1988, max= 4063, per=67.21%, avg=2823.40, stdev=1113.61, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.71%, ctx=272, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180982: Fri Sep 11 11:52:32 2026 read: IOPS=0, BW=962KiB/s (985kB/s)(6144KiB/6386msec) clat (msec): min=58, max=562, avg=222.33, stdev=181.61 lat (msec): min=58, max=562, avg=222.33, stdev=181.61 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 59], 10.00th=[ 59], 20.00th=[ 105], | 30.00th=[ 105], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 188], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 2019, max= 4039, per=90.04%, avg=2702.00, stdev=1157.97, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=962KiB/s (985kB/s)(6144KiB/6386msec); 0 zone resets clat (msec): min=66, max=3391, avg=815.72, stdev=1272.74 lat (msec): min=66, max=3391, avg=816.19, stdev=1272.59 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 414], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 2003, max= 4023, per=60.06%, avg=2523.25, stdev=1000.01, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.38%, ctx=62, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180983: Fri Sep 11 11:52:32 2026 read: IOPS=0, BW=750KiB/s (768kB/s)(5120KiB/6824msec) clat (msec): min=64, max=805, avg=366.52, stdev=298.35 lat (msec): min=64, max=805, avg=366.52, stdev=298.35 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 65], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 321], 60.00th=[ 321], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2000, max= 4063, per=89.95%, avg=2699.33, stdev=1181.10, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1050KiB/s (1076kB/s)(7168KiB/6824msec); 0 zone resets clat (msec): min=143, max=2642, avg=698.26, stdev=872.95 lat (msec): min=143, max=2642, avg=698.40, stdev=872.96 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 186], | 30.00th=[ 368], 40.00th=[ 368], 50.00th=[ 426], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 575], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1452, max= 6071, per=64.58%, avg=2713.00, stdev=1892.99, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=25.00%, 750=25.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.15%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3001KiB/s (3073kB/s), 306KiB/s-1335KiB/s (313kB/s-1367kB/s), io=20.0MiB (20.0MB), run=5371-6824msec WRITE: bw=4202KiB/s (4302kB/s), 953KiB/s-1530KiB/s (976kB/s-1566kB/s), io=28.0MiB (29.4MB), run=5371-6824msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180990: Fri Sep 11 11:52:48 2026 read: IOPS=1, BW=4733KiB/s (4847kB/s)(12.0MiB/2596msec) clat (msec): min=663, max=983, avg=834.54, stdev=161.25 lat (msec): min=663, max=983, avg=834.54, stdev=161.25 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=14.91%, ctx=394, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180991: Fri Sep 11 11:52:48 2026 read: IOPS=0, BW=1298KiB/s (1329kB/s)(4096KiB/3156msec) clat (nsec): min=629209k, max=629209k, avg=629209145.00, stdev= 0.00 lat (nsec): min=629212k, max=629212k, avg=629212495.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2596KiB/s (2658kB/s)(8192KiB/3156msec); 0 zone resets clat (msec): min=1121, max=1297, avg=1209.56, stdev=123.92 lat (msec): min=1122, max=1298, avg=1210.54, stdev=124.76 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8175, max= 8175, per=81.78%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.95%, ctx=174, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180992: Fri Sep 11 11:52:48 2026 write: IOPS=0, BW=3749KiB/s (3839kB/s)(12.0MiB/3278msec); 0 zone resets clat (msec): min=240, max=2261, avg=1070.89, stdev=1057.55 lat (msec): min=243, max=2261, avg=1072.92, stdev=1056.19 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 7953, max= 8094, per=80.27%, avg=8023.50, stdev=99.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.81%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180993: Fri Sep 11 11:52:48 2026 write: IOPS=1, BW=5141KiB/s (5265kB/s)(12.0MiB/2390msec); 0 zone resets clat (msec): min=333, max=1176, avg=776.97, stdev=423.24 lat (msec): min=334, max=1177, avg=777.86, stdev=423.35 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 6311, max= 8175, per=72.46%, avg=7243.00, stdev=1318.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.60%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5191KiB/s (5316kB/s), 1298KiB/s-4733KiB/s (1329kB/s-4847kB/s), io=16.0MiB (16.8MB), run=2596-3156msec WRITE: bw=9996KiB/s (10.2MB/s), 2596KiB/s-5141KiB/s (2658kB/s-5265kB/s), io=32.0MiB (33.6MB), run=2390-3278msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180995: Fri Sep 11 11:52:48 2026 read: IOPS=1, BW=4240KiB/s (4342kB/s)(12.0MiB/2898msec) clat (msec): min=236, max=1374, avg=929.03, stdev=608.01 lat (msec): min=236, max=1374, avg=929.03, stdev=608.01 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.14%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180996: Fri Sep 11 11:52:48 2026 read: IOPS=0, BW=1222KiB/s (1251kB/s)(4096KiB/3352msec) clat (nsec): min=1745.6M, max=1745.6M, avg=1745586852.00, stdev= 0.00 lat (nsec): min=1745.6M, max=1745.6M, avg=1745587964.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1754], 5.00th=[ 1754], 10.00th=[ 1754], 20.00th=[ 1754], | 30.00th=[ 1754], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2444KiB/s (2503kB/s)(8192KiB/3352msec); 0 zone resets clat (msec): min=702, max=752, avg=727.66, stdev=35.72 lat (msec): min=702, max=753, avg=728.10, stdev=35.57 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8126, max= 8126, per=83.13%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.24%, ctx=65, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180997: Fri Sep 11 11:52:48 2026 write: IOPS=0, BW=3668KiB/s (3756kB/s)(12.0MiB/3350msec); 0 zone resets clat (msec): min=188, max=1993, avg=1066.55, stdev=903.56 lat (msec): min=188, max=1994, avg=1067.02, stdev=903.90 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 8015, max= 8175, per=82.81%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.76%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180998: Fri Sep 11 11:52:48 2026 write: IOPS=1, BW=4806KiB/s (4921kB/s)(12.0MiB/2557msec); 0 zone resets clat (msec): min=328, max=1156, avg=841.20, stdev=447.67 lat (msec): min=330, max=1157, avg=842.20, stdev=447.45 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8047, max= 8047, per=82.32%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.91%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4888KiB/s (5005kB/s), 1222KiB/s-4240KiB/s (1251kB/s-4342kB/s), io=16.0MiB (16.8MB), run=2898-3352msec WRITE: bw=9776KiB/s (10.0MB/s), 2444KiB/s-4806KiB/s (2503kB/s-4921kB/s), io=32.0MiB (33.6MB), run=2557-3352msec