== sanity test 398b: DIO and buffer IO race ============== 09:40:52 (1788529252) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.02644 s, 8.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180445: Fri Sep 4 09:43:15 2026 read: IOPS=12, BW=48.7KiB/s (49.9kB/s)(5992KiB/122919msec) clat (usec): min=38, max=673483, avg=44237.55, stdev=33124.35 lat (usec): min=39, max=673484, avg=44238.62, stdev=33124.35 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10552], 10.00th=[ 16712], 20.00th=[ 22152], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[175113], 99.90th=[270533], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 119, per=25.25%, avg=48.73, stdev=18.27, samples=241 iops : min= 1, max= 29, avg=11.54, stdev= 4.62, samples=241 write: IOPS=12, BW=51.2KiB/s (52.5kB/s)(6296KiB/122919msec); 0 zone resets clat (usec): min=1006, max=471977, avg=35733.61, stdev=39128.87 lat (usec): min=1006, max=471978, avg=35746.48, stdev=39129.67 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1598], 20.00th=[ 3326], | 30.00th=[ 6652], 40.00th=[ 15664], 50.00th=[ 24511], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[158335], 99.50th=[189793], 99.90th=[304088], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 143, per=25.31%, avg=51.13, stdev=21.63, samples=241 iops : min= 1, max= 35, avg=12.15, stdev= 5.46, samples=241 lat (usec) : 50=0.33%, 100=1.60%, 250=0.10% lat (msec) : 2=6.87%, 4=4.88%, 10=6.54%, 20=10.45%, 50=39.45% lat (msec) : 100=24.35%, 250=5.27%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.14%, ctx=6580, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180446: Fri Sep 4 09:43:15 2026 read: IOPS=11, BW=47.9KiB/s (49.1kB/s)(5940KiB/123943msec) clat (usec): min=41, max=248093, avg=44931.75, stdev=29477.20 lat (usec): min=41, max=248094, avg=44933.83, stdev=29477.83 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11207], 10.00th=[ 16712], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 54789], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[139461], 99.50th=[173016], 99.90th=[246416], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 126, per=24.66%, avg=47.59, stdev=19.06, samples=244 iops : min= 1, max= 31, avg=11.26, stdev= 4.83, samples=244 write: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6348KiB/123943msec); 0 zone resets clat (usec): min=986, max=968444, avg=35793.48, stdev=42840.77 lat (usec): min=987, max=968445, avg=35797.68, stdev=42844.11 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1795], 20.00th=[ 3687], | 30.00th=[ 6718], 40.00th=[ 16319], 50.00th=[ 26084], 60.00th=[ 33817], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[156238], 99.50th=[177210], 99.90th=[240124], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 127, per=25.12%, avg=50.73, stdev=21.68, samples=244 iops : min= 1, max= 31, avg=12.05, stdev= 5.46, samples=244 lat (usec) : 50=0.16%, 100=1.40%, 250=0.20%, 1000=0.13% lat (msec) : 2=5.76%, 4=5.24%, 10=6.93%, 20=10.22%, 50=39.00% lat (msec) : 100=25.42%, 250=5.50%, 1000=0.03% cpu : usr=0.08%, sys=5.11%, ctx=6567, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180447: Fri Sep 4 09:43:15 2026 read: IOPS=12, BW=49.0KiB/s (50.2kB/s)(6028KiB/122987msec) clat (usec): min=36, max=991286, avg=44805.23, stdev=37862.08 lat (usec): min=37, max=991287, avg=44808.80, stdev=37861.81 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 6980], 10.00th=[ 16319], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 39060], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[154141], 99.50th=[177210], 99.90th=[221250], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 112, per=25.34%, avg=48.91, stdev=19.20, samples=241 iops : min= 1, max= 28, avg=11.59, stdev= 4.85, samples=241 write: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6260KiB/122987msec); 0 zone resets clat (usec): min=946, max=334640, avg=35196.14, stdev=38602.77 lat (usec): min=946, max=334641, avg=35198.57, stdev=38602.49 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1205], 10.00th=[ 1532], 20.00th=[ 3064], | 30.00th=[ 6063], 40.00th=[ 15008], 50.00th=[ 24249], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 60031], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[162530], 99.50th=[189793], 99.90th=[295699], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 152, per=25.02%, avg=50.55, stdev=22.84, samples=242 iops : min= 1, max= 38, avg=12.00, stdev= 5.76, samples=242 lat (usec) : 50=0.52%, 100=1.73%, 250=0.10%, 500=0.03%, 1000=0.10% lat (msec) : 2=6.58%, 4=5.66%, 10=5.96%, 20=9.60%, 50=40.66% lat (msec) : 100=23.31%, 250=5.66%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=5.08%, ctx=6605, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180448: Fri Sep 4 09:43:15 2026 read: IOPS=12, BW=49.2KiB/s (50.3kB/s)(6052KiB/123132msec) clat (usec): min=33, max=976619, avg=45437.97, stdev=38854.33 lat (usec): min=34, max=976620, avg=45439.96, stdev=38854.19 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 8586], 10.00th=[ 15533], 20.00th=[ 21365], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[156238], 99.50th=[196084], 99.90th=[267387], 99.95th=[977273], | 99.99th=[977273] bw ( KiB/s): min= 7, max= 110, per=25.48%, avg=49.17, stdev=18.25, samples=240 iops : min= 1, max= 27, avg=11.66, stdev= 4.61, samples=240 write: IOPS=12, BW=50.6KiB/s (51.9kB/s)(6236KiB/123132msec); 0 zone resets clat (usec): min=954, max=213344, avg=34637.66, stdev=35563.90 lat (usec): min=955, max=213344, avg=34640.38, stdev=35563.39 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1582], 20.00th=[ 3490], | 30.00th=[ 6915], 40.00th=[ 16188], 50.00th=[ 24511], 60.00th=[ 33817], | 70.00th=[ 45876], 80.00th=[ 60556], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[152044], 99.50th=[175113], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 144, per=24.95%, avg=50.40, stdev=21.68, samples=241 iops : min= 1, max= 36, avg=11.97, stdev= 5.46, samples=241 lat (usec) : 50=0.29%, 100=1.66%, 250=0.23%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=6.25%, 4=4.85%, 10=6.84%, 20=11.00%, 50=38.09% lat (msec) : 100=25.20%, 250=5.24%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.16%, ctx=6633, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=194KiB/s (198kB/s), 47.9KiB/s-49.2KiB/s (49.1kB/s-50.3kB/s), io=23.4MiB (24.6MB), run=122919-123943msec WRITE: bw=203KiB/s (208kB/s), 50.6KiB/s-51.2KiB/s (51.9kB/s-52.5kB/s), io=24.6MiB (25.7MB), run=122919-123943msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180449: Fri Sep 4 09:44:09 2026 read: IOPS=8, BW=34.0KiB/s (34.9kB/s)(5992KiB/176041msec) clat (msec): min=4, max=713, avg=45.20, stdev=41.32 lat (msec): min=4, max=713, avg=45.21, stdev=41.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 65], 90.00th=[ 95], 95.00th=[ 122], | 99.00th=[ 186], 99.50th=[ 230], 99.90th=[ 317], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 143, per=25.37%, avg=34.25, stdev=21.79, samples=340 iops : min= 1, max= 35, avg= 7.92, stdev= 5.50, samples=340 write: IOPS=8, BW=35.8KiB/s (36.6kB/s)(6296KiB/176041msec); 0 zone resets clat (msec): min=13, max=526, avg=68.64, stdev=44.51 lat (msec): min=13, max=526, avg=68.64, stdev=44.51 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 236], 99.90th=[ 393], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 96, per=25.14%, avg=35.45, stdev=18.74, samples=345 iops : min= 1, max= 24, avg= 8.22, stdev= 4.73, samples=345 lat (msec) : 10=1.33%, 20=10.97%, 50=44.69%, 100=29.72%, 250=12.99% lat (msec) : 500=0.23%, 750=0.07% cpu : usr=0.06%, sys=1.70%, ctx=4647, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180450: Fri Sep 4 09:44:09 2026 read: IOPS=8, BW=33.5KiB/s (34.3kB/s)(5940KiB/177080msec) clat (msec): min=5, max=985, avg=46.21, stdev=47.00 lat (msec): min=5, max=985, avg=46.21, stdev=47.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 63], 90.00th=[ 99], 95.00th=[ 131], | 99.00th=[ 213], 99.50th=[ 264], 99.90th=[ 326], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 7, max= 125, per=25.19%, avg=34.01, stdev=19.96, samples=339 iops : min= 1, max= 31, avg= 7.86, stdev= 5.05, samples=339 write: IOPS=8, BW=35.8KiB/s (36.7kB/s)(6348KiB/177080msec); 0 zone resets clat (msec): min=13, max=535, avg=68.18, stdev=44.67 lat (msec): min=13, max=535, avg=68.18, stdev=44.67 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 78], 80.00th=[ 96], 90.00th=[ 121], 95.00th=[ 153], | 99.00th=[ 232], 99.50th=[ 271], 99.90th=[ 380], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 7, max= 104, per=25.37%, avg=35.77, stdev=18.59, samples=344 iops : min= 1, max= 26, avg= 8.30, stdev= 4.70, samples=344 lat (msec) : 10=0.98%, 20=10.94%, 50=45.05%, 100=28.94%, 250=13.48% lat (msec) : 500=0.55%, 750=0.03%, 1000=0.03% cpu : usr=0.05%, sys=1.65%, ctx=4649, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180451: Fri Sep 4 09:44:09 2026 read: IOPS=8, BW=34.0KiB/s (34.8kB/s)(6028KiB/177238msec) clat (msec): min=6, max=336, avg=47.18, stdev=42.15 lat (msec): min=6, max=336, avg=47.18, stdev=42.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 100], 95.00th=[ 132], | 99.00th=[ 218], 99.50th=[ 271], 99.90th=[ 317], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 119, per=25.07%, avg=33.85, stdev=20.91, samples=345 iops : min= 1, max= 29, avg= 7.81, stdev= 5.28, samples=345 write: IOPS=8, BW=35.3KiB/s (36.2kB/s)(6260KiB/177238msec); 0 zone resets clat (msec): min=12, max=1003, avg=67.60, stdev=49.14 lat (msec): min=12, max=1003, avg=67.60, stdev=49.14 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 64], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 125], 95.00th=[ 153], | 99.00th=[ 234], 99.50th=[ 257], 99.90th=[ 330], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=35.34, stdev=19.47, samples=343 iops : min= 1, max= 25, avg= 8.19, stdev= 4.92, samples=343 lat (msec) : 10=1.04%, 20=10.94%, 50=45.15%, 100=29.23%, 250=13.05% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.06%, sys=1.62%, ctx=4610, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180452: Fri Sep 4 09:44:09 2026 read: IOPS=8, BW=34.3KiB/s (35.1kB/s)(6052KiB/176457msec) clat (msec): min=5, max=321, avg=45.12, stdev=37.66 lat (msec): min=5, max=321, avg=45.12, stdev=37.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 64], 90.00th=[ 92], 95.00th=[ 120], | 99.00th=[ 188], 99.50th=[ 234], 99.90th=[ 266], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 110, per=25.73%, avg=34.73, stdev=20.85, samples=339 iops : min= 1, max= 27, avg= 8.04, stdev= 5.28, samples=339 write: IOPS=8, BW=35.3KiB/s (36.2kB/s)(6236KiB/176457msec); 0 zone resets clat (msec): min=10, max=1022, avg=69.19, stdev=50.13 lat (msec): min=10, max=1022, avg=69.19, stdev=50.13 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 77], 80.00th=[ 97], 90.00th=[ 125], 95.00th=[ 155], | 99.00th=[ 228], 99.50th=[ 271], 99.90th=[ 380], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 7, max= 104, per=25.08%, avg=35.37, stdev=18.43, samples=343 iops : min= 1, max= 26, avg= 8.20, stdev= 4.65, samples=343 lat (msec) : 10=0.98%, 20=11.26%, 50=44.73%, 100=29.39%, 250=13.18% lat (msec) : 500=0.42%, 2000=0.03% cpu : usr=0.05%, sys=1.63%, ctx=4730, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (139kB/s), 33.5KiB/s-34.3KiB/s (34.3kB/s-35.1kB/s), io=23.4MiB (24.6MB), run=176041-177238msec WRITE: bw=142KiB/s (145kB/s), 35.3KiB/s-35.8KiB/s (36.2kB/s-36.7kB/s), io=24.6MiB (25.7MB), run=176041-177238msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180495: Fri Sep 4 09:44:54 2026 read: IOPS=11, BW=176KiB/s (180kB/s)(5920KiB/33618msec) clat (usec): min=46, max=240400, avg=48463.12, stdev=34493.11 lat (usec): min=47, max=240401, avg=48464.28, stdev=34493.14 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 94], 20.00th=[ 25035], | 30.00th=[ 31589], 40.00th=[ 37487], 50.00th=[ 43254], 60.00th=[ 49546], | 70.00th=[ 57934], 80.00th=[ 66323], 90.00th=[ 86508], 95.00th=[115868], | 99.00th=[175113], 99.50th=[189793], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 31, max= 416, per=26.99%, avg=178.68, stdev=69.04, samples=65 iops : min= 1, max= 26, avg=10.35, stdev= 4.36, samples=65 write: IOPS=11, BW=189KiB/s (194kB/s)(6368KiB/33618msec); 0 zone resets clat (usec): min=1442, max=373768, avg=39102.02, stdev=42453.64 lat (usec): min=1443, max=373769, avg=39104.05, stdev=42453.62 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1876], 10.00th=[ 2802], 20.00th=[ 5866], | 30.00th=[ 10028], 40.00th=[ 17957], 50.00th=[ 27132], 60.00th=[ 37487], | 70.00th=[ 47973], 80.00th=[ 64226], 90.00th=[ 92799], 95.00th=[120062], | 99.00th=[183501], 99.50th=[223347], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 31, max= 383, per=27.26%, avg=189.71, stdev=78.51, samples=66 iops : min= 1, max= 23, avg=11.06, stdev= 4.96, samples=66 lat (usec) : 50=0.52%, 100=4.30%, 250=0.26%, 1000=0.13% lat (msec) : 2=3.65%, 4=4.69%, 10=7.16%, 20=7.94%, 50=37.50% lat (msec) : 100=26.30%, 250=7.42%, 500=0.13% cpu : usr=0.09%, sys=5.24%, ctx=1714, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180496: Fri Sep 4 09:44:54 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5744KiB/34618msec) clat (usec): min=40, max=256778, avg=50568.50, stdev=35243.34 lat (usec): min=40, max=256780, avg=50571.39, stdev=35242.63 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 1123], 20.00th=[ 25560], | 30.00th=[ 32637], 40.00th=[ 38536], 50.00th=[ 45876], 60.00th=[ 53740], | 70.00th=[ 62129], 80.00th=[ 70779], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[185598], 99.50th=[225444], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 285, per=25.02%, avg=165.66, stdev=57.33, samples=68 iops : min= 1, max= 17, avg= 9.53, stdev= 3.61, samples=68 write: IOPS=11, BW=189KiB/s (194kB/s)(6544KiB/34618msec); 0 zone resets clat (usec): min=1507, max=360578, avg=39463.84, stdev=39627.01 lat (usec): min=1509, max=360580, avg=39465.97, stdev=39627.24 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2008], 10.00th=[ 3326], 20.00th=[ 5997], | 30.00th=[ 9634], 40.00th=[ 17695], 50.00th=[ 30016], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[156238], 99.50th=[168821], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 375, per=27.12%, avg=188.75, stdev=70.77, samples=68 iops : min= 1, max= 23, avg=11.00, stdev= 4.50, samples=68 lat (usec) : 50=0.26%, 100=4.17%, 750=0.13% lat (msec) : 2=2.73%, 4=4.04%, 10=9.90%, 20=7.42%, 50=34.11% lat (msec) : 100=29.95%, 250=7.03%, 500=0.26% cpu : usr=0.05%, sys=5.07%, ctx=1653, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180497: Fri Sep 4 09:44:54 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(6256KiB/36176msec) clat (usec): min=35, max=244774, avg=50851.27, stdev=37252.72 lat (usec): min=35, max=244776, avg=50852.65, stdev=37252.38 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 122], 20.00th=[ 25035], | 30.00th=[ 33424], 40.00th=[ 39060], 50.00th=[ 45351], 60.00th=[ 52167], | 70.00th=[ 62129], 80.00th=[ 72877], 90.00th=[ 91751], 95.00th=[112722], | 99.00th=[204473], 99.50th=[227541], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 62, max= 314, per=26.15%, avg=173.10, stdev=62.39, samples=71 iops : min= 3, max= 19, avg=10.01, stdev= 3.92, samples=71 write: IOPS=10, BW=167KiB/s (171kB/s)(6032KiB/36176msec); 0 zone resets clat (usec): min=1511, max=227307, avg=43087.59, stdev=41043.83 lat (usec): min=1512, max=227309, avg=43089.74, stdev=41043.61 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2057], 10.00th=[ 3752], 20.00th=[ 7635], | 30.00th=[ 13829], 40.00th=[ 22938], 50.00th=[ 32375], 60.00th=[ 41681], | 70.00th=[ 53216], 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[187696], 99.50th=[214959], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 61, max= 409, per=23.79%, avg=165.56, stdev=77.75, samples=71 iops : min= 3, max= 25, avg= 9.54, stdev= 4.94, samples=71 lat (usec) : 50=0.91%, 100=4.04%, 250=0.52%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=3.12%, 10=6.90%, 20=6.77%, 50=36.59% lat (msec) : 100=30.08%, 250=8.20% cpu : usr=0.05%, sys=4.58%, ctx=1646, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180498: Fri Sep 4 09:44:54 2026 read: IOPS=11, BW=182KiB/s (186kB/s)(6032KiB/33132msec) clat (usec): min=35, max=192296, avg=49779.24, stdev=35491.45 lat (usec): min=35, max=192297, avg=49781.27, stdev=35491.38 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 100], 20.00th=[ 21890], | 30.00th=[ 31327], 40.00th=[ 38536], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 62129], 80.00th=[ 77071], 90.00th=[ 88605], 95.00th=[120062], | 99.00th=[166724], 99.50th=[187696], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 62, max= 343, per=27.33%, avg=180.92, stdev=63.31, samples=65 iops : min= 3, max= 21, avg=10.51, stdev= 4.00, samples=65 write: IOPS=11, BW=189KiB/s (193kB/s)(6256KiB/33132msec); 0 zone resets clat (usec): min=1465, max=203854, avg=36198.88, stdev=38382.00 lat (usec): min=1468, max=203855, avg=36200.91, stdev=38381.93 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1778], 10.00th=[ 2540], 20.00th=[ 4752], | 30.00th=[ 7898], 40.00th=[ 13566], 50.00th=[ 20317], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[111674], | 99.00th=[162530], 99.50th=[200279], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 31, max= 414, per=27.60%, avg=192.11, stdev=81.72, samples=64 iops : min= 1, max= 25, avg=11.22, stdev= 5.17, samples=64 lat (usec) : 50=0.65%, 100=4.30%, 250=0.52%, 500=0.13%, 750=0.26% lat (msec) : 2=4.56%, 4=4.17%, 10=9.24%, 20=10.68%, 50=30.08% lat (msec) : 100=28.26%, 250=7.16% cpu : usr=0.05%, sys=5.23%, ctx=1609, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=662KiB/s (678kB/s), 166KiB/s-182KiB/s (170kB/s-186kB/s), io=23.4MiB (24.5MB), run=33132-36176msec WRITE: bw=697KiB/s (713kB/s), 167KiB/s-189KiB/s (171kB/s-194kB/s), io=24.6MiB (25.8MB), run=33132-36176msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180500: Fri Sep 4 09:45:08 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(5920KiB/50042msec) clat (msec): min=8, max=401, avg=51.96, stdev=42.53 lat (msec): min=8, max=401, avg=51.96, stdev=42.53 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 71], 90.00th=[ 97], 95.00th=[ 132], | 99.00th=[ 218], 99.50th=[ 234], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 350, per=25.25%, avg=120.45, stdev=66.10, samples=94 iops : min= 1, max= 21, avg= 6.69, stdev= 4.17, samples=94 write: IOPS=7, BW=127KiB/s (130kB/s)(6368KiB/50042msec); 0 zone resets clat (msec): min=18, max=377, avg=76.89, stdev=48.72 lat (msec): min=18, max=377, avg=76.90, stdev=48.71 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 55], 50.00th=[ 62], 60.00th=[ 73], | 70.00th=[ 89], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 174], | 99.00th=[ 271], 99.50th=[ 351], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 31, max= 318, per=25.32%, avg=127.11, stdev=58.27, samples=97 iops : min= 1, max= 19, avg= 7.12, stdev= 3.67, samples=97 lat (msec) : 10=0.26%, 20=6.51%, 50=41.41%, 100=35.81%, 250=15.36% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.61%, ctx=1158, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180501: Fri Sep 4 09:45:08 2026 read: IOPS=7, BW=115KiB/s (118kB/s)(5744KiB/50013msec) clat (msec): min=8, max=302, avg=51.62, stdev=46.00 lat (msec): min=8, max=302, avg=51.63, stdev=46.00 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 70], 90.00th=[ 108], 95.00th=[ 161], | 99.00th=[ 239], 99.50th=[ 266], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 30, max= 351, per=24.52%, avg=116.95, stdev=71.87, samples=95 iops : min= 1, max= 21, avg= 6.47, stdev= 4.52, samples=95 write: IOPS=8, BW=131KiB/s (134kB/s)(6544KiB/50013msec); 0 zone resets clat (msec): min=15, max=352, avg=76.73, stdev=49.49 lat (msec): min=15, max=352, avg=76.75, stdev=49.48 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 74], | 70.00th=[ 87], 80.00th=[ 103], 90.00th=[ 132], 95.00th=[ 182], | 99.00th=[ 251], 99.50th=[ 317], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 349, per=26.07%, avg=130.85, stdev=65.72, samples=96 iops : min= 1, max= 21, avg= 7.35, stdev= 4.15, samples=96 lat (msec) : 10=0.39%, 20=7.16%, 50=43.49%, 100=32.16%, 250=15.76% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.53%, ctx=1108, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180502: Fri Sep 4 09:45:08 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/49933msec) clat (msec): min=9, max=402, avg=54.38, stdev=48.32 lat (msec): min=9, max=402, avg=54.38, stdev=48.32 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 47], | 70.00th=[ 58], 80.00th=[ 78], 90.00th=[ 114], 95.00th=[ 155], | 99.00th=[ 224], 99.50th=[ 230], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 399, per=26.08%, avg=124.41, stdev=81.00, samples=98 iops : min= 1, max= 24, avg= 6.95, stdev= 5.08, samples=98 write: IOPS=7, BW=121KiB/s (124kB/s)(6032KiB/49933msec); 0 zone resets clat (msec): min=14, max=288, avg=75.59, stdev=43.84 lat (msec): min=14, max=288, avg=75.60, stdev=43.84 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 40], | 30.00th=[ 47], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 73], | 70.00th=[ 87], 80.00th=[ 108], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 211], 99.50th=[ 257], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 319, per=23.76%, avg=119.27, stdev=63.14, samples=97 iops : min= 1, max= 19, avg= 6.62, stdev= 3.96, samples=97 lat (msec) : 10=0.52%, 20=8.20%, 50=41.41%, 100=31.77%, 250=17.71% lat (msec) : 500=0.39% cpu : usr=0.03%, sys=1.53%, ctx=1167, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180503: Fri Sep 4 09:45:08 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6032KiB/50128msec) clat (msec): min=8, max=262, avg=58.21, stdev=49.82 lat (msec): min=8, max=262, avg=58.21, stdev=49.82 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 50], | 70.00th=[ 63], 80.00th=[ 86], 90.00th=[ 126], 95.00th=[ 165], | 99.00th=[ 245], 99.50th=[ 262], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 30, max= 382, per=25.23%, avg=120.36, stdev=74.64, samples=98 iops : min= 1, max= 23, avg= 6.68, stdev= 4.70, samples=98 write: IOPS=7, BW=125KiB/s (128kB/s)(6256KiB/50128msec); 0 zone resets clat (msec): min=18, max=258, avg=71.42, stdev=39.98 lat (msec): min=18, max=258, avg=71.42, stdev=39.98 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 46], 40.00th=[ 52], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 81], 80.00th=[ 103], 90.00th=[ 132], 95.00th=[ 159], | 99.00th=[ 194], 99.50th=[ 207], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 318, per=25.57%, avg=128.35, stdev=65.20, samples=96 iops : min= 1, max= 19, avg= 7.20, stdev= 4.11, samples=96 lat (msec) : 10=0.65%, 20=6.64%, 50=41.67%, 100=32.42%, 250=18.10% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.54%, ctx=1109, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=478KiB/s (489kB/s), 115KiB/s-125KiB/s (118kB/s-128kB/s), io=23.4MiB (24.5MB), run=49933-50128msec WRITE: bw=503KiB/s (515kB/s), 121KiB/s-131KiB/s (124kB/s-134kB/s), io=24.6MiB (25.8MB), run=49933-50128msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180521: Fri Sep 4 09:45:22 2026 read: IOPS=2, BW=2215KiB/s (2268kB/s)(7168KiB/3236msec) clat (usec): min=497, max=282432, avg=180263.59, stdev=95733.24 lat (usec): min=498, max=282434, avg=180265.02, stdev=95733.35 clat percentiles (usec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[125305], | 30.00th=[185598], 40.00th=[185598], 50.00th=[189793], 60.00th=[206570], | 70.00th=[206570], 80.00th=[270533], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 1481, max= 4007, per=53.03%, avg=3114.67, stdev=1416.81, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1582KiB/s (1620kB/s)(5120KiB/3236msec); 0 zone resets clat (msec): min=206, max=523, avg=339.82, stdev=128.73 lat (msec): min=206, max=523, avg=339.93, stdev=128.79 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 1928, max= 1992, per=23.89%, avg=1964.33, stdev=32.87, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=12.74%, ctx=184, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180522: Fri Sep 4 09:45:22 2026 read: IOPS=0, BW=587KiB/s (601kB/s)(2048KiB/3487msec) clat (msec): min=61, max=261, avg=161.54, stdev=140.89 lat (msec): min=61, max=261, avg=161.54, stdev=140.89 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 63], | 30.00th=[ 63], 40.00th=[ 63], 50.00th=[ 63], 60.00th=[ 262], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 262], 95.00th=[ 262], | 99.00th=[ 262], 99.50th=[ 262], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 1440, max= 1973, per=29.06%, avg=1706.50, stdev=376.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2937KiB/s (3007kB/s)(10.0MiB/3487msec); 0 zone resets clat (msec): min=87, max=788, avg=286.94, stdev=192.31 lat (msec): min=87, max=788, avg=287.02, stdev=192.31 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 171], | 30.00th=[ 178], 40.00th=[ 205], 50.00th=[ 234], 60.00th=[ 259], | 70.00th=[ 271], 80.00th=[ 317], 90.00th=[ 355], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 3946, max= 6144, per=54.98%, avg=4520.25, stdev=1082.79, samples=4 iops : min= 3, max= 6, avg= 3.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=13.34%, ctx=143, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180523: Fri Sep 4 09:45:22 2026 read: IOPS=1, BW=1885KiB/s (1930kB/s)(6144KiB/3260msec) clat (usec): min=493, max=281301, avg=133753.80, stdev=138562.14 lat (usec): min=495, max=281302, avg=133755.12, stdev=138562.16 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 1876], | 30.00th=[ 1876], 40.00th=[ 21365], 50.00th=[ 21365], 60.00th=[244319], | 70.00th=[252707], 80.00th=[252707], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 3856, max= 3946, per=66.42%, avg=3901.00, stdev=63.64, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1885KiB/s (1930kB/s)(6144KiB/3260msec); 0 zone resets clat (msec): min=220, max=724, avg=393.86, stdev=213.22 lat (msec): min=220, max=724, avg=393.93, stdev=213.22 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 334], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1418, max= 2003, per=22.46%, avg=1846.50, stdev=285.94, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 50=8.33%, 250=25.00%, 500=33.33%, 750=16.67% cpu : usr=0.09%, sys=10.59%, ctx=120, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180524: Fri Sep 4 09:45:22 2026 read: IOPS=1, BW=1585KiB/s (1623kB/s)(5120KiB/3231msec) clat (usec): min=455, max=260560, avg=99246.01, stdev=135391.86 lat (usec): min=457, max=260561, avg=99247.10, stdev=135391.96 clat percentiles (usec): | 1.00th=[ 457], 5.00th=[ 457], 10.00th=[ 457], 20.00th=[ 457], | 30.00th=[ 586], 40.00th=[ 586], 50.00th=[ 791], 60.00th=[ 791], | 70.00th=[233833], 80.00th=[233833], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2219KiB/s (2272kB/s)(7168KiB/3231msec); 0 zone resets clat (msec): min=150, max=765, avg=349.23, stdev=210.86 lat (msec): min=150, max=765, avg=349.29, stdev=210.85 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 184], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 317], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 464], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1462, max= 3984, per=29.90%, avg=2458.00, stdev=1341.94, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33%, 1000=8.33% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.06%, sys=10.06%, ctx=93, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5873KiB/s (6014kB/s), 587KiB/s-2215KiB/s (601kB/s-2268kB/s), io=20.0MiB (20.0MB), run=3231-3487msec WRITE: bw=8223KiB/s (8420kB/s), 1582KiB/s-2937KiB/s (1620kB/s-3007kB/s), io=28.0MiB (29.4MB), run=3231-3487msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180516: Fri Sep 4 09:45:23 2026 read: IOPS=2, BW=2559KiB/s (2621kB/s)(7168KiB/2801msec) clat (msec): min=102, max=419, avg=196.87, stdev=128.20 lat (msec): min=102, max=419, avg=196.87, stdev=128.20 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 111], | 30.00th=[ 121], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 148], 80.00th=[ 342], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 2015, max= 4055, per=59.55%, avg=2710.00, stdev=955.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1828KiB/s (1872kB/s)(5120KiB/2801msec); 0 zone resets clat (msec): min=111, max=549, avg=236.57, stdev=182.30 lat (msec): min=111, max=549, avg=236.86, stdev=182.31 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1954, max= 4055, per=52.53%, avg=3346.67, stdev=1206.14, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 250=75.00%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=4.32%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180517: Fri Sep 4 09:45:23 2026 read: IOPS=0, BW=455KiB/s (466kB/s)(2048KiB/4500msec) clat (msec): min=170, max=796, avg=483.74, stdev=442.79 lat (msec): min=170, max=796, avg=483.74, stdev=442.79 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1965, max= 2043, per=44.03%, avg=2004.00, stdev=55.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2276KiB/s (2330kB/s)(10.0MiB/4500msec); 0 zone resets clat (msec): min=133, max=645, avg=327.75, stdev=149.84 lat (msec): min=133, max=645, avg=327.87, stdev=149.81 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 165], | 30.00th=[ 182], 40.00th=[ 292], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 372], 80.00th=[ 393], 90.00th=[ 414], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 1965, max= 6000, per=46.98%, avg=2993.00, stdev=1657.00, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=6.00%, ctx=107, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180518: Fri Sep 4 09:45:23 2026 read: IOPS=1, BW=1380KiB/s (1413kB/s)(6144KiB/4453msec) clat (msec): min=87, max=502, avg=208.90, stdev=161.88 lat (msec): min=87, max=502, avg=208.90, stdev=161.88 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 105], 50.00th=[ 105], 60.00th=[ 174], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 2000, max= 3930, per=72.06%, avg=3279.33, stdev=1107.99, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1380KiB/s (1413kB/s)(6144KiB/4453msec); 0 zone resets clat (msec): min=171, max=734, avg=476.08, stdev=224.87 lat (msec): min=171, max=734, avg=476.21, stdev=224.83 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 575], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2015, max= 4000, per=38.07%, avg=2425.60, stdev=880.20, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=8.33%, 750=41.67% cpu : usr=0.00%, sys=4.78%, ctx=100, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180519: Fri Sep 4 09:45:23 2026 read: IOPS=1, BW=1718KiB/s (1759kB/s)(5120KiB/2980msec) clat (msec): min=81, max=243, avg=186.81, stdev=66.80 lat (msec): min=81, max=243, avg=186.81, stdev=66.80 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 2027, max= 6047, per=88.71%, avg=4037.00, stdev=2842.57, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2405KiB/s (2463kB/s)(7168KiB/2980msec); 0 zone resets clat (msec): min=132, max=618, avg=286.63, stdev=160.39 lat (msec): min=132, max=618, avg=286.73, stdev=160.38 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 157], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 268], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 305], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 2027, max= 5862, per=49.92%, avg=3180.50, stdev=1822.76, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 lat (msec) : 100=8.33%, 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=2.32%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4551KiB/s (4660kB/s), 455KiB/s-2559KiB/s (466kB/s-2621kB/s), io=20.0MiB (20.0MB), run=2801-4500msec WRITE: bw=6372KiB/s (6524kB/s), 1380KiB/s-2405KiB/s (1413kB/s-2463kB/s), io=28.0MiB (29.4MB), run=2801-4500msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180535: Fri Sep 4 09:45:39 2026 read: IOPS=0, BW=3386KiB/s (3467kB/s)(12.0MiB/3629msec) clat (msec): min=412, max=2494, avg=1151.11, stdev=1165.72 lat (msec): min=412, max=2494, avg=1151.11, stdev=1165.72 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.00%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180536: Fri Sep 4 09:45:39 2026 read: IOPS=0, BW=1170KiB/s (1198kB/s)(4096KiB/3500msec) clat (nsec): min=1941.5M, max=1941.5M, avg=1941505436.00, stdev= 0.00 lat (nsec): min=1941.5M, max=1941.5M, avg=1941507879.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1938], 5.00th=[ 1938], 10.00th=[ 1938], 20.00th=[ 1938], | 30.00th=[ 1938], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2341KiB/s (2397kB/s)(8192KiB/3500msec); 0 zone resets clat (msec): min=269, max=1201, avg=735.42, stdev=658.76 lat (msec): min=270, max=1201, avg=735.81, stdev=658.50 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 271], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.77%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180537: Fri Sep 4 09:45:39 2026 write: IOPS=1, BW=4214KiB/s (4315kB/s)(12.0MiB/2916msec); 0 zone resets clat (msec): min=682, max=1325, avg=945.48, stdev=337.26 lat (msec): min=683, max=1326, avg=945.94, stdev=337.27 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8094, max= 8143, per=86.72%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=5.97%, ctx=65, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180538: Fri Sep 4 09:45:39 2026 write: IOPS=0, BW=4082KiB/s (4180kB/s)(12.0MiB/3010msec); 0 zone resets clat (msec): min=287, max=2372, avg=986.79, stdev=1200.36 lat (msec): min=288, max=2373, avg=987.29, stdev=1200.25 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 6574, max= 8143, per=78.60%, avg=7358.50, stdev=1109.45, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.06%, ctx=32, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4515KiB/s (4623kB/s), 1170KiB/s-3386KiB/s (1198kB/s-3467kB/s), io=16.0MiB (16.8MB), run=3500-3629msec WRITE: bw=9362KiB/s (9587kB/s), 2341KiB/s-4214KiB/s (2397kB/s-4315kB/s), io=32.0MiB (33.6MB), run=2916-3500msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180531: Fri Sep 4 09:45:39 2026 read: IOPS=1, BW=4407KiB/s (4513kB/s)(12.0MiB/2788msec) clat (msec): min=679, max=1260, avg=887.79, stdev=323.63 lat (msec): min=679, max=1260, avg=887.79, stdev=323.62 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7831, max= 8126, per=100.00%, avg=7978.50, stdev=208.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=13.13%, ctx=284, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180532: Fri Sep 4 09:45:39 2026 read: IOPS=0, BW=1375KiB/s (1408kB/s)(4096KiB/2979msec) clat (nsec): min=1302.5M, max=1302.5M, avg=1302511644.00, stdev= 0.00 lat (nsec): min=1302.5M, max=1302.5M, avg=1302514427.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1301], 5.00th=[ 1301], 10.00th=[ 1301], 20.00th=[ 1301], | 30.00th=[ 1301], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7831, max= 7831, per=100.00%, avg=7831.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2750KiB/s (2816kB/s)(8192KiB/2979msec); 0 zone resets clat (msec): min=529, max=1078, avg=804.03, stdev=387.78 lat (msec): min=530, max=1078, avg=804.43, stdev=387.91 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 1083], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.94%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180533: Fri Sep 4 09:45:39 2026 write: IOPS=0, BW=2963KiB/s (3034kB/s)(12.0MiB/4147msec); 0 zone resets clat (msec): min=187, max=3424, avg=1326.02, stdev=1819.91 lat (msec): min=187, max=3433, avg=1330.23, stdev=1823.84 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.51%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180534: Fri Sep 4 09:45:39 2026 write: IOPS=0, BW=3344KiB/s (3424kB/s)(12.0MiB/3675msec); 0 zone resets clat (msec): min=360, max=2648, avg=1167.82, stdev=1284.06 lat (msec): min=360, max=2648, avg=1168.18, stdev=1284.05 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 6400, max= 8110, per=91.82%, avg=7255.00, stdev=1209.15, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.24%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5500KiB/s (5632kB/s), 1375KiB/s-4407KiB/s (1408kB/s-4513kB/s), io=16.0MiB (16.8MB), run=2788-2979msec WRITE: bw=7902KiB/s (8091kB/s), 2750KiB/s-3344KiB/s (2816kB/s-3424kB/s), io=32.0MiB (33.6MB), run=2979-4147msec