== sanity test 398b: DIO and buffer IO race ============== 17:04:06 (1788469446) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.45515 s, 11.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178752: Thu Sep 3 17:06:38 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(5992KiB/128645msec) clat (usec): min=33, max=382937, avg=47723.56, stdev=38425.39 lat (usec): min=33, max=382938, avg=47732.00, stdev=38427.15 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8586], 10.00th=[ 14353], 20.00th=[ 20841], | 30.00th=[ 26870], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 54264], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[193987], 99.50th=[227541], 99.90th=[367002], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 134, per=24.88%, avg=46.03, stdev=22.72, samples=253 iops : min= 1, max= 33, avg=10.86, stdev= 5.71, samples=253 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6296KiB/128645msec); 0 zone resets clat (usec): min=856, max=314058, avg=36186.40, stdev=42061.91 lat (usec): min=856, max=314060, avg=36187.99, stdev=42061.97 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 2802], | 30.00th=[ 6194], 40.00th=[ 15533], 50.00th=[ 23725], 60.00th=[ 33162], | 70.00th=[ 43779], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[115868], | 99.00th=[202376], 99.50th=[225444], 99.90th=[283116], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 7, max= 132, per=25.25%, avg=48.74, stdev=24.84, samples=251 iops : min= 1, max= 33, avg=11.55, stdev= 6.28, samples=251 lat (usec) : 50=0.39%, 100=1.53%, 250=0.07%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.26% lat (msec) : 2=8.11%, 4=4.17%, 10=6.32%, 20=10.97%, 50=37.89% lat (msec) : 100=22.88%, 250=6.97%, 500=0.33% cpu : usr=0.08%, sys=4.67%, ctx=6136, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178753: Thu Sep 3 17:06:38 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5940KiB/129741msec) clat (usec): min=40, max=376173, avg=48852.74, stdev=39848.74 lat (usec): min=41, max=376174, avg=48863.91, stdev=39845.68 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10552], 10.00th=[ 15533], 20.00th=[ 20841], | 30.00th=[ 26608], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 46400], | 70.00th=[ 57410], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[225444], 99.50th=[250610], 99.90th=[337642], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 6, max= 104, per=24.50%, avg=45.32, stdev=21.91, samples=255 iops : min= 1, max= 26, avg=10.68, stdev= 5.53, samples=255 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6348KiB/129741msec); 0 zone resets clat (usec): min=671, max=398599, avg=35932.61, stdev=40197.07 lat (usec): min=672, max=398601, avg=35935.97, stdev=40196.49 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 3130], | 30.00th=[ 6915], 40.00th=[ 15533], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 45351], 80.00th=[ 62653], 90.00th=[ 85459], 95.00th=[113771], | 99.00th=[179307], 99.50th=[214959], 99.90th=[354419], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 168, per=25.22%, avg=48.68, stdev=25.89, samples=253 iops : min= 1, max= 42, avg=11.53, stdev= 6.53, samples=253 lat (usec) : 50=0.13%, 100=1.50%, 250=0.16%, 750=0.07%, 1000=0.39% lat (msec) : 2=7.13%, 4=4.36%, 10=6.18%, 20=12.14%, 50=36.00% lat (msec) : 100=24.38%, 250=7.13%, 500=0.42% cpu : usr=0.08%, sys=4.82%, ctx=6244, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178754: Thu Sep 3 17:06:38 2026 read: IOPS=11, BW=47.0KiB/s (48.2kB/s)(6028KiB/128181msec) clat (usec): min=36, max=394803, avg=46367.90, stdev=36308.40 lat (usec): min=37, max=394804, avg=46371.10, stdev=36306.30 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8848], 10.00th=[ 15139], 20.00th=[ 20579], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 66847], 90.00th=[ 90702], 95.00th=[112722], | 99.00th=[170918], 99.50th=[208667], 99.90th=[350225], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 118, per=25.33%, avg=46.85, stdev=22.38, samples=250 iops : min= 1, max= 29, avg=11.07, stdev= 5.65, samples=250 write: IOPS=12, BW=48.8KiB/s (50.0kB/s)(6260KiB/128181msec); 0 zone resets clat (usec): min=695, max=591253, avg=37137.19, stdev=44514.78 lat (usec): min=696, max=591255, avg=37140.28, stdev=44514.97 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 3261], | 30.00th=[ 7111], 40.00th=[ 15270], 50.00th=[ 24773], 60.00th=[ 33817], | 70.00th=[ 46924], 80.00th=[ 61604], 90.00th=[ 90702], 95.00th=[115868], | 99.00th=[189793], 99.50th=[246416], 99.90th=[375391], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 135, per=25.09%, avg=48.42, stdev=25.50, samples=251 iops : min= 1, max= 33, avg=11.46, stdev= 6.43, samples=251 lat (usec) : 50=0.33%, 100=1.60%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.42% lat (msec) : 2=6.71%, 4=4.10%, 10=6.64%, 20=11.59%, 50=37.86% lat (msec) : 100=23.11%, 250=7.13%, 500=0.29%, 750=0.03% cpu : usr=0.09%, sys=4.72%, ctx=6244, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178755: Thu Sep 3 17:06:38 2026 read: IOPS=11, BW=47.2KiB/s (48.4kB/s)(6052KiB/128118msec) clat (usec): min=34, max=327710, avg=47707.88, stdev=37035.29 lat (usec): min=35, max=327711, avg=47713.75, stdev=37035.43 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 396], 10.00th=[ 15664], 20.00th=[ 21365], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 55313], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[116917], | 99.00th=[191890], 99.50th=[212861], 99.90th=[325059], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 6, max= 127, per=25.26%, avg=46.72, stdev=23.12, samples=252 iops : min= 1, max= 31, avg=11.03, stdev= 5.82, samples=252 write: IOPS=12, BW=48.7KiB/s (49.8kB/s)(6236KiB/128118msec); 0 zone resets clat (usec): min=709, max=373944, avg=35775.71, stdev=41120.31 lat (usec): min=710, max=373946, avg=35779.91, stdev=41121.35 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 3130], | 30.00th=[ 7046], 40.00th=[ 15139], 50.00th=[ 25035], 60.00th=[ 32375], | 70.00th=[ 43779], 80.00th=[ 58459], 90.00th=[ 87557], 95.00th=[121111], | 99.00th=[177210], 99.50th=[191890], 99.90th=[333448], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 159, per=25.08%, avg=48.41, stdev=26.15, samples=250 iops : min= 1, max= 39, avg=11.46, stdev= 6.59, samples=250 lat (usec) : 50=0.23%, 100=1.99%, 250=0.10%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=7.23%, 4=4.13%, 10=6.05%, 20=11.04%, 50=38.80% lat (msec) : 100=21.97%, 250=7.62%, 500=0.33% cpu : usr=0.07%, sys=4.88%, ctx=6212, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=185KiB/s (190kB/s), 45.8KiB/s-47.2KiB/s (46.9kB/s-48.4kB/s), io=23.4MiB (24.6MB), run=128118-129741msec WRITE: bw=194KiB/s (198kB/s), 48.7KiB/s-48.9KiB/s (49.8kB/s-50.1kB/s), io=24.6MiB (25.7MB), run=128118-129741msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178747: Thu Sep 3 17:07:14 2026 read: IOPS=8, BW=35.9KiB/s (36.7kB/s)(5992KiB/167049msec) clat (msec): min=4, max=930, avg=42.05, stdev=49.78 lat (msec): min=4, max=930, avg=42.06, stdev=49.78 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 128], | 99.00th=[ 230], 99.50th=[ 305], 99.90th=[ 477], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 159, per=25.93%, avg=37.07, stdev=29.78, samples=314 iops : min= 1, max= 39, avg= 8.61, stdev= 7.50, samples=314 write: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6296KiB/167049msec); 0 zone resets clat (msec): min=9, max=623, avg=65.83, stdev=56.00 lat (msec): min=9, max=623, avg=65.83, stdev=56.00 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 176], | 99.00th=[ 262], 99.50th=[ 313], 99.90th=[ 430], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 160, per=25.49%, avg=38.24, stdev=28.83, samples=320 iops : min= 1, max= 40, avg= 8.89, stdev= 7.26, samples=320 lat (msec) : 10=4.59%, 20=19.99%, 50=38.90%, 100=21.81%, 250=13.77% lat (msec) : 500=0.88%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4806, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178748: Thu Sep 3 17:07:14 2026 read: IOPS=8, BW=35.7KiB/s (36.6kB/s)(5940KiB/166230msec) clat (msec): min=4, max=1022, avg=43.99, stdev=53.78 lat (msec): min=4, max=1022, avg=43.99, stdev=53.78 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 97], 95.00th=[ 142], | 99.00th=[ 236], 99.50th=[ 321], 99.90th=[ 485], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 151, per=26.15%, avg=37.39, stdev=29.66, samples=309 iops : min= 1, max= 37, avg= 8.69, stdev= 7.47, samples=309 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6348KiB/166230msec); 0 zone resets clat (msec): min=9, max=458, avg=63.29, stdev=53.04 lat (msec): min=9, max=458, avg=63.29, stdev=53.04 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 74], 80.00th=[ 94], 90.00th=[ 129], 95.00th=[ 163], | 99.00th=[ 268], 99.50th=[ 313], 99.90th=[ 426], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 7, max= 149, per=25.87%, avg=38.80, stdev=28.68, samples=317 iops : min= 1, max= 37, avg= 9.04, stdev= 7.24, samples=317 lat (msec) : 10=4.56%, 20=20.15%, 50=38.35%, 100=23.01%, 250=12.86% lat (msec) : 500=1.04%, 2000=0.03% cpu : usr=0.06%, sys=1.62%, ctx=4709, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178749: Thu Sep 3 17:07:14 2026 read: IOPS=9, BW=36.2KiB/s (37.0kB/s)(6028KiB/166647msec) clat (msec): min=4, max=392, avg=42.10, stdev=44.04 lat (msec): min=4, max=392, avg=42.10, stdev=44.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 213], 99.50th=[ 255], 99.90th=[ 372], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 175, per=25.96%, avg=37.13, stdev=29.10, samples=315 iops : min= 1, max= 43, avg= 8.62, stdev= 7.32, samples=315 write: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6260KiB/166647msec); 0 zone resets clat (msec): min=10, max=1063, avg=65.66, stdev=61.13 lat (msec): min=10, max=1063, avg=65.67, stdev=61.13 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 77], 80.00th=[ 100], 90.00th=[ 136], 95.00th=[ 178], | 99.00th=[ 259], 99.50th=[ 317], 99.90th=[ 510], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 172, per=25.39%, avg=38.09, stdev=30.02, samples=319 iops : min= 1, max= 43, avg= 8.86, stdev= 7.57, samples=319 lat (msec) : 10=4.39%, 20=19.76%, 50=39.42%, 100=22.04%, 250=13.61% lat (msec) : 500=0.72%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.60%, ctx=4765, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178750: Thu Sep 3 17:07:14 2026 read: IOPS=9, BW=36.3KiB/s (37.1kB/s)(6052KiB/166848msec) clat (msec): min=3, max=522, avg=43.00, stdev=47.70 lat (msec): min=3, max=522, avg=43.01, stdev=47.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 65], 90.00th=[ 97], 95.00th=[ 133], | 99.00th=[ 218], 99.50th=[ 313], 99.90th=[ 502], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 7, max= 191, per=26.41%, avg=37.77, stdev=30.86, samples=312 iops : min= 1, max= 47, avg= 8.79, stdev= 7.75, samples=312 write: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6236KiB/166848msec); 0 zone resets clat (msec): min=11, max=1074, avg=65.00, stdev=60.49 lat (msec): min=11, max=1074, avg=65.00, stdev=60.49 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 132], 95.00th=[ 167], | 99.00th=[ 262], 99.50th=[ 342], 99.90th=[ 617], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 159, per=25.40%, avg=38.10, stdev=28.02, samples=319 iops : min= 1, max= 39, avg= 8.86, stdev= 7.07, samples=319 lat (msec) : 4=0.03%, 10=4.72%, 20=19.92%, 50=38.64%, 100=22.14% lat (msec) : 250=13.74%, 500=0.65%, 750=0.13%, 2000=0.03% cpu : usr=0.05%, sys=1.64%, ctx=4810, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=144KiB/s (147kB/s), 35.7KiB/s-36.3KiB/s (36.6kB/s-37.1kB/s), io=23.4MiB (24.6MB), run=166230-167049msec WRITE: bw=150KiB/s (154kB/s), 37.4KiB/s-38.2KiB/s (38.3kB/s-39.1kB/s), io=24.6MiB (25.7MB), run=166230-167049msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178801: Thu Sep 3 17:07:58 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(5920KiB/31626msec) clat (usec): min=40, max=269544, avg=48252.66, stdev=36025.87 lat (usec): min=40, max=269546, avg=48253.85, stdev=36025.87 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 9634], 20.00th=[ 22938], | 30.00th=[ 28181], 40.00th=[ 34341], 50.00th=[ 41681], 60.00th=[ 50594], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[189793], 99.50th=[204473], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 379, per=25.23%, avg=185.47, stdev=67.53, samples=62 iops : min= 1, max= 23, avg=10.74, stdev= 4.26, samples=62 write: IOPS=12, BW=201KiB/s (206kB/s)(6368KiB/31626msec); 0 zone resets clat (usec): min=1482, max=183887, avg=34518.39, stdev=33168.60 lat (usec): min=1483, max=183889, avg=34521.28, stdev=33168.57 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1926], 10.00th=[ 3228], 20.00th=[ 5407], | 30.00th=[ 9241], 40.00th=[ 15795], 50.00th=[ 24511], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[ 92799], | 99.00th=[145753], 99.50th=[170918], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 30, max= 414, per=25.99%, avg=200.94, stdev=82.35, samples=62 iops : min= 1, max= 25, avg=11.71, stdev= 5.19, samples=62 lat (usec) : 50=0.13%, 100=3.78%, 250=0.13%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=4.04%, 10=9.51%, 20=10.03%, 50=35.29% lat (msec) : 100=28.13%, 250=5.47%, 500=0.13% cpu : usr=0.06%, sys=5.40%, ctx=1648, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178802: Thu Sep 3 17:07:58 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(5744KiB/32578msec) clat (usec): min=41, max=230342, avg=47776.53, stdev=32187.95 lat (usec): min=41, max=230343, avg=47788.56, stdev=32209.83 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 12780], 20.00th=[ 24773], | 30.00th=[ 30802], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 51119], | 70.00th=[ 58459], 80.00th=[ 68682], 90.00th=[ 84411], 95.00th=[107480], | 99.00th=[170918], 99.50th=[212861], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 31, max= 286, per=23.78%, avg=174.81, stdev=63.91, samples=64 iops : min= 1, max= 17, avg=10.06, stdev= 4.03, samples=64 write: IOPS=12, BW=201KiB/s (206kB/s)(6544KiB/32578msec); 0 zone resets clat (usec): min=1411, max=242872, avg=37489.34, stdev=36612.32 lat (usec): min=1414, max=242875, avg=37543.52, stdev=36624.18 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1958], 10.00th=[ 3458], 20.00th=[ 7046], | 30.00th=[ 11338], 40.00th=[ 19268], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 47973], 80.00th=[ 64750], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[168821], 99.50th=[181404], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 63, max= 475, per=25.80%, avg=199.42, stdev=85.50, samples=64 iops : min= 3, max= 29, avg=11.61, stdev= 5.36, samples=64 lat (usec) : 50=0.26%, 100=3.52%, 250=0.52% lat (msec) : 2=2.86%, 4=3.39%, 10=8.33%, 20=9.77%, 50=36.98% lat (msec) : 100=28.52%, 250=5.86% cpu : usr=0.09%, sys=5.32%, ctx=1685, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178803: Thu Sep 3 17:07:58 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32562msec) clat (usec): min=44, max=161390, avg=46233.14, stdev=30976.61 lat (usec): min=44, max=161391, avg=46249.66, stdev=30971.39 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 67], 10.00th=[ 8979], 20.00th=[ 23725], | 30.00th=[ 28705], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 47449], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[143655], 99.50th=[158335], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 31, max= 446, per=26.08%, avg=191.69, stdev=87.87, samples=64 iops : min= 1, max= 27, avg=11.13, stdev= 5.52, samples=64 write: IOPS=11, BW=185KiB/s (190kB/s)(6032KiB/32562msec); 0 zone resets clat (usec): min=1510, max=339522, avg=38293.46, stdev=40594.00 lat (usec): min=1512, max=339524, avg=38298.79, stdev=40596.13 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2147], 10.00th=[ 3130], 20.00th=[ 6390], | 30.00th=[ 11076], 40.00th=[ 16581], 50.00th=[ 25035], 60.00th=[ 38011], | 70.00th=[ 46924], 80.00th=[ 63177], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[158335], 99.50th=[229639], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 447, per=23.88%, avg=184.62, stdev=84.27, samples=63 iops : min= 1, max= 27, avg=10.68, stdev= 5.31, samples=63 lat (usec) : 50=0.26%, 100=3.78%, 250=0.26%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.21%, 4=4.56%, 10=7.03%, 20=10.68%, 50=38.67% lat (msec) : 100=24.35%, 250=7.29%, 500=0.13% cpu : usr=0.05%, sys=5.41%, ctx=1688, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178804: Thu Sep 3 17:07:58 2026 read: IOPS=11, BW=192KiB/s (196kB/s)(6032KiB/31495msec) clat (usec): min=32, max=186859, avg=47054.18, stdev=34247.12 lat (usec): min=32, max=186860, avg=47055.73, stdev=34246.53 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 59], 10.00th=[ 80], 20.00th=[ 20841], | 30.00th=[ 27657], 40.00th=[ 34866], 50.00th=[ 42206], 60.00th=[ 51119], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 90702], 95.00th=[107480], | 99.00th=[160433], 99.50th=[160433], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 63, max= 414, per=25.92%, avg=190.54, stdev=78.14, samples=61 iops : min= 3, max= 25, avg=11.11, stdev= 4.94, samples=61 write: IOPS=12, BW=199KiB/s (203kB/s)(6256KiB/31495msec); 0 zone resets clat (usec): min=1349, max=250990, avg=34945.10, stdev=36577.75 lat (usec): min=1352, max=250992, avg=34947.56, stdev=36577.76 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 2024], 10.00th=[ 2933], 20.00th=[ 5014], | 30.00th=[ 8455], 40.00th=[ 14877], 50.00th=[ 22414], 60.00th=[ 33424], | 70.00th=[ 46400], 80.00th=[ 58983], 90.00th=[ 88605], 95.00th=[104334], | 99.00th=[156238], 99.50th=[185598], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 31, max= 480, per=25.55%, avg=197.51, stdev=95.55, samples=61 iops : min= 1, max= 30, avg=11.56, stdev= 6.05, samples=61 lat (usec) : 50=0.78%, 100=5.34%, 250=0.13%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.86%, 4=5.47%, 10=9.38%, 20=8.85%, 50=33.46% lat (msec) : 100=26.82%, 250=6.25%, 500=0.13% cpu : usr=0.04%, sys=5.73%, ctx=1632, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=735KiB/s (753kB/s), 176KiB/s-192KiB/s (181kB/s-197kB/s), io=23.4MiB (24.5MB), run=31495-32578msec WRITE: bw=774KiB/s (792kB/s), 185KiB/s-201KiB/s (190kB/s-206kB/s), io=24.6MiB (25.8MB), run=31495-32578msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178796: Thu Sep 3 17:08:10 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5920KiB/45110msec) clat (msec): min=7, max=239, avg=45.26, stdev=38.16 lat (msec): min=7, max=239, avg=45.26, stdev=38.16 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 59], 90.00th=[ 94], 95.00th=[ 134], | 99.00th=[ 182], 99.50th=[ 213], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 381, per=25.50%, avg=133.36, stdev=78.60, samples=87 iops : min= 1, max= 23, avg= 7.52, stdev= 4.93, samples=87 write: IOPS=8, BW=141KiB/s (145kB/s)(6368KiB/45110msec); 0 zone resets clat (msec): min=14, max=367, avg=70.71, stdev=47.41 lat (msec): min=14, max=367, avg=70.71, stdev=47.41 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 68], | 70.00th=[ 83], 80.00th=[ 101], 90.00th=[ 138], 95.00th=[ 169], | 99.00th=[ 241], 99.50th=[ 284], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 351, per=25.60%, avg=140.82, stdev=76.09, samples=89 iops : min= 1, max= 21, avg= 7.98, stdev= 4.76, samples=89 lat (msec) : 10=0.65%, 20=8.98%, 50=49.35%, 100=26.30%, 250=14.32% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.73%, ctx=1124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178797: Thu Sep 3 17:08:10 2026 read: IOPS=7, BW=126KiB/s (129kB/s)(5744KiB/45430msec) clat (msec): min=7, max=200, avg=47.46, stdev=37.67 lat (msec): min=7, max=200, avg=47.46, stdev=37.67 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 44], | 70.00th=[ 54], 80.00th=[ 71], 90.00th=[ 104], 95.00th=[ 136], | 99.00th=[ 188], 99.50th=[ 192], 99.90th=[ 201], 99.95th=[ 201], | 99.99th=[ 201] bw ( KiB/s): min= 25, max= 379, per=24.43%, avg=127.75, stdev=76.61, samples=87 iops : min= 1, max= 23, avg= 7.16, stdev= 4.82, samples=87 write: IOPS=9, BW=144KiB/s (148kB/s)(6544KiB/45430msec); 0 zone resets clat (msec): min=9, max=332, avg=69.25, stdev=44.60 lat (msec): min=9, max=332, avg=69.26, stdev=44.60 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 35], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 80], 80.00th=[ 105], 90.00th=[ 134], 95.00th=[ 163], | 99.00th=[ 194], 99.50th=[ 209], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 383, per=25.77%, avg=141.72, stdev=77.87, samples=89 iops : min= 1, max= 23, avg= 8.04, stdev= 4.89, samples=89 lat (msec) : 10=0.78%, 20=10.03%, 50=43.75%, 100=29.17%, 250=16.15% lat (msec) : 500=0.13% cpu : usr=0.03%, sys=1.51%, ctx=1138, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178798: Thu Sep 3 17:08:10 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(6256KiB/45756msec) clat (msec): min=6, max=287, avg=48.18, stdev=41.05 lat (msec): min=6, max=287, avg=48.19, stdev=41.05 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 70], 90.00th=[ 102], 95.00th=[ 132], | 99.00th=[ 205], 99.50th=[ 213], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 26, max= 406, per=26.46%, avg=138.40, stdev=91.49, samples=89 iops : min= 1, max= 25, avg= 7.83, stdev= 5.73, samples=89 write: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45756msec); 0 zone resets clat (msec): min=15, max=360, avg=70.60, stdev=49.05 lat (msec): min=15, max=360, avg=70.62, stdev=49.06 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 101], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 245], 99.50th=[ 284], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 352, per=23.65%, avg=130.09, stdev=75.22, samples=90 iops : min= 1, max= 22, avg= 7.30, stdev= 4.74, samples=90 lat (msec) : 10=0.65%, 20=9.64%, 50=46.61%, 100=27.86%, 250=14.71% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.73%, ctx=1214, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178799: Thu Sep 3 17:08:10 2026 read: IOPS=8, BW=134KiB/s (138kB/s)(6032KiB/44860msec) clat (msec): min=7, max=213, avg=45.97, stdev=37.11 lat (msec): min=7, max=213, avg=45.99, stdev=37.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 100], 95.00th=[ 142], | 99.00th=[ 176], 99.50th=[ 190], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 411, per=26.09%, avg=136.48, stdev=83.72, samples=86 iops : min= 1, max= 25, avg= 7.70, stdev= 5.23, samples=86 write: IOPS=8, BW=139KiB/s (143kB/s)(6256KiB/44860msec); 0 zone resets clat (msec): min=14, max=323, avg=69.77, stdev=44.77 lat (msec): min=14, max=323, avg=69.78, stdev=44.77 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 82], 80.00th=[ 101], 90.00th=[ 128], 95.00th=[ 155], | 99.00th=[ 236], 99.50th=[ 271], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 380, per=25.22%, avg=138.70, stdev=76.39, samples=88 iops : min= 1, max= 23, avg= 7.85, stdev= 4.80, samples=88 lat (msec) : 10=0.91%, 20=9.51%, 50=46.35%, 100=28.13%, 250=14.84% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.59%, ctx=1182, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=523KiB/s (536kB/s), 126KiB/s-137KiB/s (129kB/s-140kB/s), io=23.4MiB (24.5MB), run=44860-45756msec WRITE: bw=551KiB/s (564kB/s), 132KiB/s-144KiB/s (135kB/s-148kB/s), io=24.6MiB (25.8MB), run=44860-45756msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178820: Thu Sep 3 17:08:26 2026 read: IOPS=2, BW=2371KiB/s (2428kB/s)(7168KiB/3023msec) clat (msec): min=102, max=487, avg=210.75, stdev=133.89 lat (msec): min=102, max=487, avg=210.76, stdev=133.89 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 114], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 197], 60.00th=[ 201], | 70.00th=[ 201], 80.00th=[ 253], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2027, max= 4432, per=69.57%, avg=2633.25, stdev=1199.18, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1694KiB/s (1734kB/s)(5120KiB/3023msec); 0 zone resets clat (msec): min=120, max=532, avg=295.08, stdev=182.46 lat (msec): min=120, max=533, avg=295.33, stdev=182.70 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 271], 60.00th=[ 271], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2027, max= 3670, per=48.66%, avg=2578.67, stdev=945.14, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=4.10%, ctx=74, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178821: Thu Sep 3 17:08:26 2026 read: IOPS=0, BW=394KiB/s (404kB/s)(2048KiB/5197msec) clat (usec): min=146193, max=146452, avg=146323.14, stdev=182.90 lat (usec): min=146195, max=146455, avg=146325.28, stdev=184.02 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 146], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 146], 95.00th=[ 146], | 99.00th=[ 146], 99.50th=[ 146], 99.90th=[ 146], 99.95th=[ 146], | 99.99th=[ 146] bw ( KiB/s): min= 1774, max= 2035, per=50.32%, avg=1904.50, stdev=184.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1970KiB/s (2018kB/s)(10.0MiB/5197msec); 0 zone resets clat (msec): min=119, max=946, avg=478.76, stdev=271.73 lat (msec): min=119, max=946, avg=478.86, stdev=271.74 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 203], | 30.00th=[ 313], 40.00th=[ 351], 50.00th=[ 376], 60.00th=[ 405], | 70.00th=[ 592], 80.00th=[ 609], 90.00th=[ 869], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 1835, max= 4079, per=48.77%, avg=2584.14, stdev=1020.86, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=16.67% cpu : usr=0.02%, sys=3.87%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178822: Thu Sep 3 17:08:26 2026 read: IOPS=1, BW=1136KiB/s (1163kB/s)(6144KiB/5410msec) clat (msec): min=85, max=627, avg=307.45, stdev=229.87 lat (msec): min=85, max=627, avg=307.45, stdev=229.87 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 101], | 30.00th=[ 101], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 296], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1835, max= 4023, per=65.57%, avg=2482.00, stdev=1031.65, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1136KiB/s (1163kB/s)(6144KiB/5410msec); 0 zone resets clat (msec): min=222, max=982, avg=564.03, stdev=308.39 lat (msec): min=222, max=983, avg=564.14, stdev=308.38 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 550], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1553, max= 4071, per=43.47%, avg=2303.40, stdev=1007.16, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=33.33%, 1000=16.67% cpu : usr=0.06%, sys=3.97%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178823: Thu Sep 3 17:08:26 2026 read: IOPS=1, BW=1189KiB/s (1218kB/s)(5120KiB/4306msec) clat (msec): min=128, max=731, avg=285.98, stdev=253.14 lat (msec): min=128, max=731, avg=285.98, stdev=253.14 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 129], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1835, max= 4055, per=69.79%, avg=2641.67, stdev=1228.06, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1665KiB/s (1705kB/s)(7168KiB/4306msec); 0 zone resets clat (msec): min=111, max=517, avg=346.51, stdev=160.59 lat (msec): min=112, max=517, avg=346.85, stdev=160.23 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 150], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 384], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 502], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 2027, max= 4023, per=52.05%, avg=2758.00, stdev=1001.48, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=25.00% cpu : usr=0.02%, sys=4.39%, ctx=106, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3786KiB/s (3876kB/s), 394KiB/s-2371KiB/s (404kB/s-2428kB/s), io=20.0MiB (20.0MB), run=3023-5410msec WRITE: bw=5300KiB/s (5427kB/s), 1136KiB/s-1970KiB/s (1163kB/s-2018kB/s), io=28.0MiB (29.4MB), run=3023-5410msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178824: Thu Sep 3 17:08:26 2026 read: IOPS=2, BW=2185KiB/s (2237kB/s)(7168KiB/3281msec) clat (usec): min=522, max=287697, avg=181021.84, stdev=90893.22 lat (usec): min=523, max=287698, avg=181023.24, stdev=90893.25 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[145753], | 30.00th=[191890], 40.00th=[191890], 50.00th=[196084], 60.00th=[202376], | 70.00th=[202376], 80.00th=[240124], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 1648, max= 4023, per=61.32%, avg=2352.80, stdev=948.32, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1560KiB/s (1598kB/s)(5120KiB/3281msec); 0 zone resets clat (msec): min=270, max=435, avg=344.01, stdev=62.60 lat (msec): min=270, max=436, avg=344.46, stdev=62.34 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 435], 95.00th=[ 435], | 99.00th=[ 435], 99.50th=[ 435], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 2011, max= 2043, per=37.71%, avg=2026.00, stdev=14.00, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=41.67%, 500=50.00% cpu : usr=0.06%, sys=13.45%, ctx=240, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178825: Thu Sep 3 17:08:26 2026 read: IOPS=0, BW=384KiB/s (393kB/s)(2048KiB/5337msec) clat (msec): min=32, max=451, avg=241.98, stdev=296.48 lat (msec): min=32, max=451, avg=241.98, stdev=296.48 clat percentiles (msec): | 1.00th=[ 33], 5.00th=[ 33], 10.00th=[ 33], 20.00th=[ 33], | 30.00th=[ 33], 40.00th=[ 33], 50.00th=[ 33], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2011, max= 2019, per=52.51%, avg=2015.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1919KiB/s (1965kB/s)(10.0MiB/5337msec); 0 zone resets clat (msec): min=124, max=1030, avg=449.94, stdev=326.55 lat (msec): min=124, max=1030, avg=450.05, stdev=326.55 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 126], | 30.00th=[ 150], 40.00th=[ 230], 50.00th=[ 368], 60.00th=[ 376], | 70.00th=[ 527], 80.00th=[ 659], 90.00th=[ 911], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 2011, max= 4087, per=50.48%, avg=2711.67, stdev=1062.29, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 50=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=10.40%, ctx=162, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178826: Thu Sep 3 17:08:26 2026 read: IOPS=1, BW=1923KiB/s (1969kB/s)(6144KiB/3195msec) clat (usec): min=572, max=200436, avg=34705.23, stdev=81195.95 lat (usec): min=573, max=200437, avg=34962.08, stdev=81073.79 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 627], | 30.00th=[ 627], 40.00th=[ 1778], 50.00th=[ 1778], 60.00th=[ 2024], | 70.00th=[ 2802], 80.00th=[ 2802], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 2019, max= 4063, per=87.79%, avg=3368.33, stdev=1168.73, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1923KiB/s (1969kB/s)(6144KiB/3195msec); 0 zone resets clat (msec): min=254, max=815, avg=473.55, stdev=255.91 lat (msec): min=254, max=815, avg=473.82, stdev=255.77 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 384], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1638, max= 2043, per=36.27%, avg=1948.40, stdev=173.94, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 4=16.67%, 250=8.33%, 500=33.33%, 1000=16.67% cpu : usr=0.03%, sys=9.17%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178827: Thu Sep 3 17:08:26 2026 read: IOPS=1, BW=1164KiB/s (1192kB/s)(5120KiB/4399msec) clat (usec): min=938, max=297585, avg=132504.20, stdev=129402.56 lat (usec): min=939, max=297586, avg=132505.32, stdev=129402.54 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 938], | 30.00th=[ 996], 40.00th=[ 996], 50.00th=[168821], 60.00th=[168821], | 70.00th=[193987], 80.00th=[193987], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 3757, max= 4039, per=100.00%, avg=3898.00, stdev=199.40, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1629KiB/s (1669kB/s)(7168KiB/4399msec); 0 zone resets clat (msec): min=129, max=940, avg=477.31, stdev=274.91 lat (msec): min=129, max=940, avg=478.25, stdev=275.02 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 161], | 30.00th=[ 468], 40.00th=[ 468], 50.00th=[ 527], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 592], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2011, max= 4023, per=47.02%, avg=2526.00, stdev=998.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=16.67% lat (msec) : 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=10.39%, ctx=191, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3837KiB/s (3929kB/s), 384KiB/s-2185KiB/s (393kB/s-2237kB/s), io=20.0MiB (20.0MB), run=3195-5337msec WRITE: bw=5372KiB/s (5501kB/s), 1560KiB/s-1923KiB/s (1598kB/s-1969kB/s), io=28.0MiB (29.4MB), run=3195-5337msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178839: Thu Sep 3 17:08:41 2026 read: IOPS=0, BW=3757KiB/s (3847kB/s)(12.0MiB/3271msec) clat (msec): min=408, max=1576, avg=1062.39, stdev=596.39 lat (msec): min=408, max=1576, avg=1062.39, stdev=596.39 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.06%, ctx=46, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178840: Thu Sep 3 17:08:41 2026 read: IOPS=0, BW=1309KiB/s (1340kB/s)(4096KiB/3130msec) clat (nsec): min=1232.2M, max=1232.2M, avg=1232201541.00, stdev= 0.00 lat (nsec): min=1232.2M, max=1232.2M, avg=1232204321.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2617KiB/s (2680kB/s)(8192KiB/3130msec); 0 zone resets clat (msec): min=533, max=1297, avg=915.64, stdev=540.50 lat (msec): min=533, max=1298, avg=916.15, stdev=540.45 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8126, max= 8126, per=77.62%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.26%, ctx=59, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178841: Thu Sep 3 17:08:41 2026 write: IOPS=1, BW=4965KiB/s (5084kB/s)(12.0MiB/2475msec); 0 zone resets clat (msec): min=337, max=1063, avg=811.58, stdev=410.85 lat (msec): min=337, max=1063, avg=812.11, stdev=410.94 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8126, max= 8192, per=77.93%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.12%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178842: Thu Sep 3 17:08:41 2026 write: IOPS=1, BW=6053KiB/s (6198kB/s)(12.0MiB/2030msec); 0 zone resets clat (msec): min=282, max=1078, avg=642.78, stdev=403.38 lat (msec): min=283, max=1079, avg=645.82, stdev=403.10 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 6311, max= 8192, per=69.27%, avg=7251.50, stdev=1330.07, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.79%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5009KiB/s (5129kB/s), 1309KiB/s-3757KiB/s (1340kB/s-3847kB/s), io=16.0MiB (16.8MB), run=3130-3271msec WRITE: bw=10.2MiB/s (10.7MB/s), 2617KiB/s-6053KiB/s (2680kB/s-6198kB/s), io=32.0MiB (33.6MB), run=2030-3130msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178835: Thu Sep 3 17:08:42 2026 read: IOPS=1, BW=5319KiB/s (5447kB/s)(12.0MiB/2310msec) clat (msec): min=472, max=1077, avg=750.21, stdev=305.58 lat (msec): min=472, max=1077, avg=750.22, stdev=305.58 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 5893, max= 7801, per=100.00%, avg=6847.00, stdev=1349.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=14.08%, ctx=260, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178836: Thu Sep 3 17:08:42 2026 read: IOPS=0, BW=1520KiB/s (1556kB/s)(4096KiB/2695msec) clat (nsec): min=481747k, max=481747k, avg=481746769.00, stdev= 0.00 lat (nsec): min=481750k, max=481750k, avg=481749992.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3040KiB/s (3113kB/s)(8192KiB/2695msec); 0 zone resets clat (msec): min=671, max=1339, avg=1005.73, stdev=472.24 lat (msec): min=672, max=1340, avg=1006.20, stdev=472.16 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 1334], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7876, max= 7876, per=86.94%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.07%, sys=6.53%, ctx=111, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178837: Thu Sep 3 17:08:42 2026 write: IOPS=0, BW=3397KiB/s (3479kB/s)(12.0MiB/3617msec); 0 zone resets clat (msec): min=140, max=1883, avg=1159.61, stdev=908.11 lat (msec): min=140, max=1887, avg=1161.30, stdev=909.67 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8015, max= 8143, per=89.18%, avg=8079.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.73%, ctx=57, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178838: Thu Sep 3 17:08:42 2026 write: IOPS=1, BW=4168KiB/s (4268kB/s)(12.0MiB/2948msec); 0 zone resets clat (msec): min=343, max=1794, avg=944.19, stdev=757.35 lat (msec): min=343, max=1795, avg=944.60, stdev=757.41 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7787, max= 7953, per=86.87%, avg=7870.00, stdev=117.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.34%, ctx=68, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6079KiB/s (6225kB/s), 1520KiB/s-5319KiB/s (1556kB/s-5447kB/s), io=16.0MiB (16.8MB), run=2310-2695msec WRITE: bw=9059KiB/s (9277kB/s), 3040KiB/s-4168KiB/s (3113kB/s-4268kB/s), io=32.0MiB (33.6MB), run=2695-3617msec