== sanity test 398b: DIO and buffer IO race ============== 21:32:43 (1788658363) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.68705 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179635: Sat Sep 5 21:35:02 2026 read: IOPS=12, BW=50.2KiB/s (51.4kB/s)(5992KiB/119271msec) clat (usec): min=38, max=277891, avg=43050.77, stdev=28873.63 lat (usec): min=39, max=277892, avg=43060.03, stdev=28879.24 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 1434], 10.00th=[ 15270], 20.00th=[ 21365], | 30.00th=[ 26084], 40.00th=[ 30802], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[145753], 99.50th=[158335], 99.90th=[225444], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 110, per=25.00%, avg=49.76, stdev=17.53, samples=236 iops : min= 1, max= 27, avg=11.81, stdev= 4.41, samples=236 write: IOPS=13, BW=52.8KiB/s (54.1kB/s)(6296KiB/119271msec); 0 zone resets clat (usec): min=890, max=685562, avg=34586.71, stdev=38176.60 lat (usec): min=892, max=685564, avg=34589.86, stdev=38176.99 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1647], 20.00th=[ 3884], | 30.00th=[ 7701], 40.00th=[ 16319], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[156238], 99.50th=[173016], 99.90th=[244319], 99.95th=[683672], | 99.99th=[683672] bw ( KiB/s): min= 15, max= 119, per=25.22%, avg=52.46, stdev=22.11, samples=235 iops : min= 3, max= 29, avg=12.50, stdev= 5.57, samples=235 lat (usec) : 50=0.39%, 100=1.92%, 250=0.07%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.79%, 4=4.79%, 10=7.10%, 20=10.90%, 50=40.01% lat (msec) : 100=24.32%, 250=4.56%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=5.39%, ctx=6420, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179636: Sat Sep 5 21:35:02 2026 read: IOPS=12, BW=49.4KiB/s (50.6kB/s)(5940KiB/120294msec) clat (usec): min=39, max=242678, avg=44662.29, stdev=30030.88 lat (usec): min=40, max=242680, avg=44670.55, stdev=30045.87 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11207], 10.00th=[ 16450], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 32637], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[162530], 99.50th=[177210], 99.90th=[231736], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 7, max= 111, per=24.64%, avg=49.04, stdev=18.94, samples=237 iops : min= 1, max= 27, avg=11.63, stdev= 4.77, samples=237 write: IOPS=13, BW=52.8KiB/s (54.0kB/s)(6348KiB/120294msec); 0 zone resets clat (usec): min=876, max=703867, avg=33775.41, stdev=38630.60 lat (usec): min=877, max=703868, avg=33779.17, stdev=38633.29 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1598], 20.00th=[ 3490], | 30.00th=[ 7111], 40.00th=[ 15795], 50.00th=[ 23987], 60.00th=[ 32637], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[152044], 99.50th=[179307], 99.90th=[274727], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 191, per=25.15%, avg=52.31, stdev=23.28, samples=237 iops : min= 1, max= 47, avg=12.46, stdev= 5.83, samples=237 lat (usec) : 50=0.16%, 100=1.73%, 500=0.07%, 1000=0.26% lat (msec) : 2=6.48%, 4=4.46%, 10=6.77%, 20=10.87%, 50=40.10% lat (msec) : 100=23.99%, 250=5.05%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.45%, ctx=6541, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179637: Sat Sep 5 21:35:02 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6028KiB/118912msec) clat (usec): min=33, max=689135, avg=42424.77, stdev=32822.55 lat (usec): min=33, max=689136, avg=42436.85, stdev=32839.29 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 1090], 10.00th=[ 15533], 20.00th=[ 21890], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[152044], 99.50th=[179307], 99.90th=[246416], 99.95th=[692061], | 99.99th=[692061] bw ( KiB/s): min= 6, max= 110, per=25.21%, avg=50.17, stdev=19.15, samples=235 iops : min= 1, max= 27, avg=11.92, stdev= 4.83, samples=235 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6260KiB/118912msec); 0 zone resets clat (usec): min=919, max=268347, avg=34893.74, stdev=36613.16 lat (usec): min=920, max=268348, avg=34896.18, stdev=36613.01 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1598], 20.00th=[ 3458], | 30.00th=[ 6128], 40.00th=[ 14746], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 61080], 90.00th=[ 84411], 95.00th=[100140], | 99.00th=[166724], 99.50th=[179307], 99.90th=[246416], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 112, per=25.04%, avg=52.08, stdev=19.89, samples=235 iops : min= 1, max= 28, avg=12.40, stdev= 5.01, samples=235 lat (usec) : 50=0.49%, 100=1.82%, 250=0.10%, 1000=0.23% lat (msec) : 2=6.38%, 4=4.88%, 10=7.13%, 20=9.77%, 50=40.49% lat (msec) : 100=24.41%, 250=4.23%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.39%, ctx=6354, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179638: Sat Sep 5 21:35:02 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6052KiB/117592msec) clat (usec): min=34, max=726378, avg=43488.08, stdev=32801.54 lat (usec): min=34, max=726379, avg=43489.50, stdev=32801.43 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 412], 10.00th=[ 16188], 20.00th=[ 21890], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 44303], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[137364], 99.50th=[160433], 99.90th=[263193], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 110, per=25.61%, avg=50.96, stdev=19.41, samples=232 iops : min= 1, max= 27, avg=12.13, stdev= 4.90, samples=232 write: IOPS=13, BW=53.0KiB/s (54.3kB/s)(6236KiB/117592msec); 0 zone resets clat (usec): min=919, max=212869, avg=33003.53, stdev=33242.58 lat (usec): min=921, max=212870, avg=33005.37, stdev=33242.76 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1827], 20.00th=[ 3851], | 30.00th=[ 6718], 40.00th=[ 14746], 50.00th=[ 24511], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[164627], 99.90th=[198181], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 126, per=25.34%, avg=52.70, stdev=20.85, samples=231 iops : min= 1, max= 31, avg=12.55, stdev= 5.26, samples=231 lat (usec) : 50=0.26%, 100=1.95%, 250=0.20%, 500=0.13%, 1000=0.07% lat (msec) : 2=5.66%, 4=4.62%, 10=7.98%, 20=9.73%, 50=40.69% lat (msec) : 100=24.22%, 250=4.43%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.37%, ctx=6435, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=200KiB/s (204kB/s), 49.4KiB/s-51.5KiB/s (50.6kB/s-52.7kB/s), io=23.4MiB (24.6MB), run=117592-120294msec WRITE: bw=209KiB/s (214kB/s), 52.6KiB/s-53.0KiB/s (53.9kB/s-54.3kB/s), io=24.6MiB (25.7MB), run=117592-120294msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179630: Sat Sep 5 21:35:43 2026 read: IOPS=9, BW=37.1KiB/s (38.0kB/s)(5992KiB/161412msec) clat (msec): min=5, max=743, avg=41.41, stdev=41.20 lat (msec): min=5, max=743, avg=41.41, stdev=41.20 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 117], | 99.00th=[ 171], 99.50th=[ 209], 99.90th=[ 330], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 143, per=25.61%, avg=37.90, stdev=25.89, samples=308 iops : min= 1, max= 35, avg= 8.84, stdev= 6.50, samples=308 write: IOPS=9, BW=39.0KiB/s (39.9kB/s)(6296KiB/161412msec); 0 zone resets clat (msec): min=11, max=410, avg=62.92, stdev=45.24 lat (msec): min=11, max=410, avg=62.93, stdev=45.24 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 122], 95.00th=[ 150], | 99.00th=[ 222], 99.50th=[ 255], 99.90th=[ 397], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 118, per=24.89%, avg=38.58, stdev=24.53, samples=318 iops : min= 1, max= 29, avg= 9.01, stdev= 6.17, samples=318 lat (msec) : 10=2.64%, 20=15.85%, 50=44.21%, 100=24.71%, 250=12.17% lat (msec) : 500=0.39%, 750=0.03% cpu : usr=0.05%, sys=1.83%, ctx=4902, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179632: Sat Sep 5 21:35:43 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(5940KiB/159073msec) clat (msec): min=4, max=764, avg=39.53, stdev=38.12 lat (msec): min=4, max=764, avg=39.53, stdev=38.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 82], 95.00th=[ 109], | 99.00th=[ 165], 99.50th=[ 184], 99.90th=[ 266], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 7, max= 135, per=25.83%, avg=38.22, stdev=26.83, samples=303 iops : min= 1, max= 33, avg= 8.91, stdev= 6.74, samples=303 write: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6348KiB/159073msec); 0 zone resets clat (msec): min=9, max=405, avg=63.04, stdev=44.75 lat (msec): min=9, max=405, avg=63.04, stdev=44.75 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 253], 99.90th=[ 397], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 119, per=25.48%, avg=39.50, stdev=23.88, samples=313 iops : min= 1, max= 29, avg= 9.23, stdev= 6.00, samples=313 lat (msec) : 10=2.25%, 20=16.15%, 50=44.89%, 100=24.58%, 250=11.78% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.81%, ctx=4773, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179633: Sat Sep 5 21:35:43 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6028KiB/159550msec) clat (msec): min=5, max=324, avg=40.99, stdev=36.85 lat (msec): min=5, max=324, avg=40.99, stdev=36.85 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 89], 95.00th=[ 120], | 99.00th=[ 178], 99.50th=[ 199], 99.90th=[ 259], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 150, per=25.39%, avg=37.57, stdev=25.06, samples=312 iops : min= 1, max= 37, avg= 8.76, stdev= 6.30, samples=312 write: IOPS=9, BW=39.2KiB/s (40.2kB/s)(6260KiB/159550msec); 0 zone resets clat (msec): min=11, max=732, avg=62.23, stdev=46.76 lat (msec): min=11, max=732, avg=62.24, stdev=46.76 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 40], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 144], | 99.00th=[ 213], 99.50th=[ 257], 99.90th=[ 468], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 111, per=25.20%, avg=39.05, stdev=23.98, samples=312 iops : min= 1, max= 27, avg= 9.12, stdev= 6.02, samples=312 lat (msec) : 10=2.73%, 20=15.66%, 50=45.18%, 100=24.19%, 250=11.88% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.05%, sys=1.81%, ctx=4884, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179634: Sat Sep 5 21:35:43 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6052KiB/160384msec) clat (msec): min=5, max=270, avg=40.31, stdev=36.92 lat (msec): min=5, max=270, avg=40.31, stdev=36.92 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 89], 95.00th=[ 120], | 99.00th=[ 184], 99.50th=[ 207], 99.90th=[ 262], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 143, per=26.08%, avg=38.60, stdev=26.66, samples=306 iops : min= 1, max= 35, avg= 9.01, stdev= 6.70, samples=306 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6236KiB/160384msec); 0 zone resets clat (msec): min=11, max=785, avg=63.54, stdev=48.61 lat (msec): min=11, max=785, avg=63.54, stdev=48.61 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 125], 95.00th=[ 150], | 99.00th=[ 222], 99.50th=[ 271], 99.90th=[ 468], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 119, per=24.80%, avg=38.44, stdev=23.87, samples=316 iops : min= 1, max= 29, avg= 8.97, stdev= 5.99, samples=316 lat (msec) : 10=3.48%, 20=15.56%, 50=44.47%, 100=23.93%, 250=12.24% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.05%, sys=1.81%, ctx=4791, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (152kB/s), 37.1KiB/s-37.8KiB/s (38.0kB/s-38.7kB/s), io=23.4MiB (24.6MB), run=159073-161412msec WRITE: bw=156KiB/s (159kB/s), 38.9KiB/s-39.9KiB/s (39.8kB/s-40.9kB/s), io=24.6MiB (25.7MB), run=159073-161412msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179679: Sat Sep 5 21:36:25 2026 read: IOPS=12, BW=195KiB/s (200kB/s)(5920KiB/30360msec) clat (usec): min=38, max=192838, avg=44362.04, stdev=30810.88 lat (usec): min=38, max=192838, avg=44363.11, stdev=30810.88 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 537], 20.00th=[ 22414], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 39584], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 85459], 95.00th=[ 96994], | 99.00th=[177210], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 92, max= 380, per=25.55%, avg=194.68, stdev=72.57, samples=60 iops : min= 5, max= 23, avg=11.43, stdev= 4.65, samples=60 write: IOPS=13, BW=210KiB/s (215kB/s)(6368KiB/30360msec); 0 zone resets clat (usec): min=1350, max=320692, avg=34746.66, stdev=35989.14 lat (usec): min=1352, max=320694, avg=34749.82, stdev=35990.41 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1926], 10.00th=[ 3294], 20.00th=[ 6390], | 30.00th=[ 8848], 40.00th=[ 15664], 50.00th=[ 24249], 60.00th=[ 31851], | 70.00th=[ 44303], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[ 99091], | 99.00th=[141558], 99.50th=[227541], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 30, max= 350, per=26.08%, avg=209.13, stdev=72.43, samples=60 iops : min= 1, max= 21, avg=12.33, stdev= 4.61, samples=60 lat (usec) : 50=0.91%, 100=3.26%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=2.73%, 4=3.78%, 10=10.68%, 20=8.59%, 50=39.58% lat (msec) : 100=25.91%, 250=3.78%, 500=0.13% cpu : usr=0.07%, sys=5.75%, ctx=1691, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179680: Sat Sep 5 21:36:25 2026 read: IOPS=11, BW=187KiB/s (192kB/s)(5744KiB/30640msec) clat (usec): min=46, max=247337, avg=42434.58, stdev=29737.82 lat (usec): min=47, max=247338, avg=42435.62, stdev=29737.83 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 99], 20.00th=[ 23200], | 30.00th=[ 26870], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[183501], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 31, max= 384, per=24.42%, avg=186.08, stdev=83.07, samples=60 iops : min= 1, max= 24, avg=10.87, stdev= 5.26, samples=60 write: IOPS=13, BW=214KiB/s (219kB/s)(6544KiB/30640msec); 0 zone resets clat (usec): min=1362, max=290814, avg=36641.95, stdev=38452.00 lat (usec): min=1364, max=290815, avg=36643.88, stdev=38452.01 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2057], 10.00th=[ 2737], 20.00th=[ 5145], | 30.00th=[ 9372], 40.00th=[ 18482], 50.00th=[ 25822], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[116917], | 99.00th=[154141], 99.50th=[177210], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 62, max= 441, per=26.46%, avg=212.23, stdev=88.80, samples=60 iops : min= 3, max= 27, avg=12.52, stdev= 5.62, samples=60 lat (usec) : 50=0.52%, 100=4.17%, 250=0.39% lat (msec) : 2=2.34%, 4=6.12%, 10=8.07%, 20=8.20%, 50=41.93% lat (msec) : 100=22.53%, 250=5.60%, 500=0.13% cpu : usr=0.09%, sys=5.67%, ctx=1628, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179681: Sat Sep 5 21:36:25 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6256KiB/31401msec) clat (usec): min=43, max=345578, avg=42590.97, stdev=35096.39 lat (usec): min=44, max=345579, avg=42592.17, stdev=35096.39 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 81], 20.00th=[ 19268], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 53216], 80.00th=[ 63177], 90.00th=[ 82314], 95.00th=[104334], | 99.00th=[166724], 99.50th=[196084], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 31, max= 382, per=26.59%, avg=202.61, stdev=77.15, samples=61 iops : min= 1, max= 23, avg=11.92, stdev= 4.92, samples=61 write: IOPS=12, BW=192KiB/s (197kB/s)(6032KiB/31401msec); 0 zone resets clat (usec): min=1404, max=184542, avg=37894.64, stdev=36046.77 lat (usec): min=1406, max=184545, avg=37910.70, stdev=36068.36 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2311], 10.00th=[ 3458], 20.00th=[ 5866], | 30.00th=[ 10814], 40.00th=[ 19006], 50.00th=[ 26084], 60.00th=[ 37487], | 70.00th=[ 50070], 80.00th=[ 61604], 90.00th=[ 92799], 95.00th=[110625], | 99.00th=[152044], 99.50th=[175113], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 63, max= 478, per=23.78%, avg=190.73, stdev=84.55, samples=62 iops : min= 3, max= 29, avg=11.16, stdev= 5.38, samples=62 lat (usec) : 50=0.78%, 100=5.34%, 250=0.91%, 500=0.13%, 750=0.13% lat (msec) : 2=1.82%, 4=4.56%, 10=8.07%, 20=9.24%, 50=37.50% lat (msec) : 100=24.35%, 250=7.03%, 500=0.13% cpu : usr=0.05%, sys=5.81%, ctx=1728, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179682: Sat Sep 5 21:36:25 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30456msec) clat (usec): min=40, max=208952, avg=45707.81, stdev=30135.65 lat (usec): min=40, max=208953, avg=45723.27, stdev=30132.80 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 14746], 20.00th=[ 25560], | 30.00th=[ 29230], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 56361], 80.00th=[ 64750], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[154141], 99.50th=[162530], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 31, max= 406, per=26.29%, avg=200.32, stdev=72.36, samples=59 iops : min= 1, max= 25, avg=11.78, stdev= 4.64, samples=59 write: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30456msec); 0 zone resets clat (usec): min=1273, max=178141, avg=32600.65, stdev=33123.87 lat (usec): min=1275, max=178144, avg=32611.87, stdev=33130.34 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1795], 10.00th=[ 2671], 20.00th=[ 5211], | 30.00th=[ 8848], 40.00th=[ 14484], 50.00th=[ 21365], 60.00th=[ 28967], | 70.00th=[ 41157], 80.00th=[ 55837], 90.00th=[ 80217], 95.00th=[105382], | 99.00th=[137364], 99.50th=[145753], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 94, max= 414, per=26.14%, avg=209.68, stdev=74.23, samples=59 iops : min= 5, max= 25, avg=12.36, stdev= 4.74, samples=59 lat (usec) : 50=0.52%, 100=3.26%, 250=0.26%, 750=0.13% lat (msec) : 2=3.52%, 4=4.43%, 10=8.59%, 20=10.03%, 50=39.84% lat (msec) : 100=23.83%, 250=5.60% cpu : usr=0.06%, sys=6.11%, ctx=1668, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=763KiB/s (781kB/s), 187KiB/s-199KiB/s (192kB/s-204kB/s), io=23.4MiB (24.5MB), run=30360-31401msec WRITE: bw=803KiB/s (822kB/s), 192KiB/s-214KiB/s (197kB/s-219kB/s), io=24.6MiB (25.8MB), run=30360-31401msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179675: Sat Sep 5 21:36:35 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(5920KiB/41495msec) clat (msec): min=7, max=277, avg=44.27, stdev=39.90 lat (msec): min=7, max=277, avg=44.27, stdev=39.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 91], 95.00th=[ 132], | 99.00th=[ 188], 99.50th=[ 236], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 380, per=24.60%, avg=141.70, stdev=89.41, samples=80 iops : min= 1, max= 23, avg= 8.04, stdev= 5.60, samples=80 write: IOPS=9, BW=153KiB/s (157kB/s)(6368KiB/41495msec); 0 zone resets clat (msec): min=14, max=248, avg=62.50, stdev=41.42 lat (msec): min=14, max=248, avg=62.50, stdev=41.42 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 92], 90.00th=[ 128], 95.00th=[ 153], | 99.00th=[ 190], 99.50th=[ 239], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 21, max= 383, per=25.18%, avg=152.62, stdev=92.38, samples=81 iops : min= 1, max= 23, avg= 8.73, stdev= 5.80, samples=81 lat (msec) : 10=1.17%, 20=14.06%, 50=46.74%, 100=24.74%, 250=13.15% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.87%, ctx=1200, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179676: Sat Sep 5 21:36:35 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5744KiB/41576msec) clat (msec): min=7, max=222, avg=41.00, stdev=34.68 lat (msec): min=7, max=222, avg=41.00, stdev=34.68 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 167], 99.50th=[ 215], 99.90th=[ 222], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 31, max= 415, per=24.75%, avg=142.56, stdev=88.37, samples=78 iops : min= 1, max= 25, avg= 8.08, stdev= 5.55, samples=78 write: IOPS=9, BW=157KiB/s (161kB/s)(6544KiB/41576msec); 0 zone resets clat (msec): min=15, max=254, avg=65.34, stdev=43.34 lat (msec): min=15, max=254, avg=65.35, stdev=43.34 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 64], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 128], 95.00th=[ 157], | 99.00th=[ 192], 99.50th=[ 222], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 31, max= 415, per=25.46%, avg=154.27, stdev=91.19, samples=81 iops : min= 1, max= 25, avg= 8.83, stdev= 5.73, samples=81 lat (msec) : 10=1.43%, 20=13.02%, 50=47.27%, 100=23.83%, 250=14.32% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.83%, ctx=1221, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179677: Sat Sep 5 21:36:35 2026 read: IOPS=9, BW=153KiB/s (156kB/s)(6256KiB/41017msec) clat (msec): min=7, max=191, avg=41.47, stdev=35.56 lat (msec): min=7, max=191, avg=41.47, stdev=35.56 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 125], | 99.00th=[ 161], 99.50th=[ 186], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 31, max= 507, per=26.63%, avg=153.40, stdev=111.64, samples=80 iops : min= 1, max= 31, avg= 8.78, stdev= 7.01, samples=80 write: IOPS=9, BW=147KiB/s (151kB/s)(6032KiB/41017msec); 0 zone resets clat (msec): min=13, max=260, avg=65.13, stdev=43.96 lat (msec): min=13, max=260, avg=65.14, stdev=43.96 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 64], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 128], 95.00th=[ 167], | 99.00th=[ 197], 99.50th=[ 249], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 383, per=23.94%, avg=145.06, stdev=83.55, samples=80 iops : min= 1, max= 23, avg= 8.25, stdev= 5.23, samples=80 lat (msec) : 10=1.43%, 20=15.36%, 50=45.83%, 100=24.35%, 250=12.89% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.90%, ctx=1201, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179678: Sat Sep 5 21:36:35 2026 read: IOPS=9, BW=146KiB/s (150kB/s)(6032KiB/41298msec) clat (msec): min=6, max=242, avg=44.80, stdev=39.41 lat (msec): min=6, max=242, avg=44.80, stdev=39.41 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 99], 95.00th=[ 136], | 99.00th=[ 192], 99.50th=[ 207], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 479, per=26.13%, avg=150.50, stdev=98.28, samples=78 iops : min= 1, max= 29, avg= 8.59, stdev= 6.17, samples=78 write: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41298msec); 0 zone resets clat (msec): min=10, max=256, avg=62.26, stdev=41.93 lat (msec): min=10, max=256, avg=62.27, stdev=41.93 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 74], 80.00th=[ 87], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 209], 99.50th=[ 241], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 414, per=24.98%, avg=151.40, stdev=90.08, samples=81 iops : min= 1, max= 25, avg= 8.65, stdev= 5.63, samples=81 lat (msec) : 10=1.04%, 20=14.97%, 50=45.18%, 100=25.78%, 250=12.89% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.80%, ctx=1162, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=576KiB/s (590kB/s), 138KiB/s-153KiB/s (141kB/s-156kB/s), io=23.4MiB (24.5MB), run=41017-41576msec WRITE: bw=606KiB/s (621kB/s), 147KiB/s-157KiB/s (151kB/s-161kB/s), io=24.6MiB (25.8MB), run=41017-41576msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Sat Sep 5 21:36:50 2026 read: IOPS=2, BW=2688KiB/s (2752kB/s)(7168KiB/2667msec) clat (usec): min=1723, max=254963, avg=172108.39, stdev=83655.31 lat (usec): min=1724, max=254964, avg=172109.65, stdev=83655.29 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1729], 10.00th=[ 1729], 20.00th=[154141], | 30.00th=[160433], 40.00th=[160433], 50.00th=[185598], 60.00th=[223347], | 70.00th=[223347], 80.00th=[225444], 90.00th=[254804], 95.00th=[254804], | 99.00th=[254804], 99.50th=[254804], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 1906, max= 4087, per=90.87%, avg=3026.00, stdev=1212.71, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1920KiB/s (1966kB/s)(5120KiB/2667msec); 0 zone resets clat (msec): min=81, max=300, avg=230.69, stdev=85.92 lat (msec): min=81, max=300, avg=230.79, stdev=85.92 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 259], 60.00th=[ 259], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2031, max= 4096, per=73.03%, avg=3404.67, stdev=1189.64, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (msec) : 2=8.33%, 100=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=18.53%, ctx=205, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Sat Sep 5 21:36:50 2026 read: IOPS=0, BW=333KiB/s (341kB/s)(2048KiB/6150msec) clat (msec): min=82, max=309, avg=195.87, stdev=160.55 lat (msec): min=82, max=309, avg=195.88, stdev=160.55 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 309], 95.00th=[ 309], | 99.00th=[ 309], 99.50th=[ 309], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 2015, max= 2048, per=61.01%, avg=2031.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1665KiB/s (1705kB/s)(10.0MiB/6150msec); 0 zone resets clat (msec): min=122, max=2688, avg=571.73, stdev=764.03 lat (msec): min=122, max=2688, avg=571.80, stdev=764.03 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 161], | 30.00th=[ 194], 40.00th=[ 296], 50.00th=[ 334], 60.00th=[ 342], | 70.00th=[ 372], 80.00th=[ 481], 90.00th=[ 726], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2043, max= 6144, per=78.73%, avg=3670.60, stdev=1710.47, samples=5 iops : min= 1, max= 6, avg= 3.00, stdev= 1.87, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.23%, ctx=193, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179701: Sat Sep 5 21:36:50 2026 read: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5453msec) clat (usec): min=475, max=2527.1k, avg=474037.22, stdev=1013144.15 lat (usec): min=476, max=2527.1k, avg=474038.33, stdev=1013144.16 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], | 20.00th=[ 1037], 30.00th=[ 1037], 40.00th=[ 3752], | 50.00th=[ 3752], 60.00th=[ 4424], 70.00th=[ 308282], | 80.00th=[ 308282], 90.00th=[2533360], 95.00th=[2533360], | 99.00th=[2533360], 99.50th=[2533360], 99.90th=[2533360], | 99.95th=[2533360], 99.99th=[2533360] bw ( KiB/s): min= 4096, max= 6035, per=100.00%, avg=5065.50, stdev=1371.08, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1127KiB/s (1154kB/s)(6144KiB/5453msec); 0 zone resets clat (msec): min=126, max=1470, avg=405.08, stdev=526.23 lat (msec): min=126, max=1470, avg=405.15, stdev=526.26 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 127], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 243], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1980, max= 4096, per=54.26%, avg=2529.50, stdev=1044.54, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 4=8.33%, 10=8.33%, 250=33.33%, 500=16.67% lat (msec) : 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.79%, ctx=511, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179702: Sat Sep 5 21:36:50 2026 read: IOPS=0, BW=847KiB/s (867kB/s)(5120KiB/6044msec) clat (usec): min=443, max=401856, avg=139940.48, stdev=192671.42 lat (usec): min=444, max=401857, avg=139941.56, stdev=192671.58 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 445], | 30.00th=[ 1450], 40.00th=[ 1450], 50.00th=[ 4555], 60.00th=[ 4555], | 70.00th=[291505], 80.00th=[291505], 90.00th=[400557], 95.00th=[400557], | 99.00th=[400557], 99.50th=[400557], 99.90th=[400557], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1186KiB/s (1214kB/s)(7168KiB/6044msec); 0 zone resets clat (msec): min=198, max=2572, avg=726.89, stdev=851.14 lat (msec): min=198, max=2572, avg=726.96, stdev=851.14 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 292], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 351], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 961], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1939, max= 2048, per=43.44%, avg=2025.33, stdev=42.75, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 10=8.33%, 250=8.33%, 500=50.00%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.63%, ctx=146, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3330KiB/s (3410kB/s), 333KiB/s-2688KiB/s (341kB/s-2752kB/s), io=20.0MiB (20.0MB), run=2667-6150msec WRITE: bw=4662KiB/s (4774kB/s), 1127KiB/s-1920KiB/s (1154kB/s-1966kB/s), io=28.0MiB (29.4MB), run=2667-6150msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Sat Sep 5 21:36:51 2026 read: IOPS=0, BW=977KiB/s (1001kB/s)(7168KiB/7334msec) clat (msec): min=104, max=811, avg=485.35, stdev=304.90 lat (msec): min=104, max=811, avg=485.36, stdev=304.90 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 122], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 584], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 793], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1452, max= 2039, per=64.62%, avg=1804.20, stdev=256.77, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=698KiB/s (715kB/s)(5120KiB/7334msec); 0 zone resets clat (msec): min=78, max=3241, avg=761.36, stdev=1387.04 lat (msec): min=78, max=3241, avg=761.47, stdev=1387.07 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 138], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 2043, max= 4079, per=78.31%, avg=3061.00, stdev=1439.67, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 100=8.33%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.71%, ctx=96, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Sat Sep 5 21:36:51 2026 read: IOPS=0, BW=305KiB/s (313kB/s)(2048KiB/6704msec) clat (msec): min=93, max=2639, avg=1366.53, stdev=1799.64 lat (msec): min=93, max=2639, avg=1366.53, stdev=1799.64 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 2635], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1430, max= 2043, per=62.20%, avg=1736.50, stdev=433.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1527KiB/s (1564kB/s)(10.0MiB/6704msec); 0 zone resets clat (msec): min=91, max=932, avg=393.66, stdev=266.03 lat (msec): min=91, max=932, avg=393.73, stdev=266.03 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 146], | 30.00th=[ 159], 40.00th=[ 211], 50.00th=[ 317], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 584], 90.00th=[ 642], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1430, max= 4039, per=65.58%, avg=2563.67, stdev=1134.02, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=5.15%, ctx=134, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Sat Sep 5 21:36:51 2026 read: IOPS=0, BW=906KiB/s (928kB/s)(6144KiB/6778msec) clat (msec): min=65, max=3336, avg=748.72, stdev=1285.89 lat (msec): min=65, max=3336, avg=748.72, stdev=1285.89 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 165], 50.00th=[ 165], 60.00th=[ 171], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1914, max= 3900, per=88.43%, avg=2469.00, stdev=955.64, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=906KiB/s (928kB/s)(6144KiB/6778msec); 0 zone resets clat (msec): min=144, max=793, avg=375.68, stdev=264.62 lat (msec): min=144, max=793, avg=375.76, stdev=264.62 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 146], | 30.00th=[ 146], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 481], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1865, max= 4047, per=76.11%, avg=2975.25, stdev=1233.42, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=2.94%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179700: Sat Sep 5 21:36:51 2026 read: IOPS=0, BW=912KiB/s (934kB/s)(5120KiB/5612msec) clat (msec): min=88, max=232, avg=141.05, stdev=56.74 lat (msec): min=88, max=232, avg=141.05, stdev=56.74 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 101], 40.00th=[ 101], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 146], 80.00th=[ 146], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 3961, max= 3992, per=100.00%, avg=3976.50, stdev=21.92, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1277KiB/s (1308kB/s)(7168KiB/5612msec); 0 zone resets clat (msec): min=122, max=3118, avg=693.51, stdev=1073.73 lat (msec): min=122, max=3118, avg=693.60, stdev=1073.74 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 253], | 30.00th=[ 255], 40.00th=[ 255], 50.00th=[ 313], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 443], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 1617, max= 4357, per=77.01%, avg=3010.25, stdev=1411.35, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.07%, ctx=75, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2792KiB/s (2859kB/s), 305KiB/s-977KiB/s (313kB/s-1001kB/s), io=20.0MiB (20.0MB), run=5612-7334msec WRITE: bw=3909KiB/s (4003kB/s), 698KiB/s-1527KiB/s (715kB/s-1564kB/s), io=28.0MiB (29.4MB), run=5612-7334msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179714: Sat Sep 5 21:37:06 2026 read: IOPS=1, BW=4483KiB/s (4591kB/s)(12.0MiB/2741msec) clat (msec): min=698, max=948, avg=856.70, stdev=137.50 lat (msec): min=698, max=948, avg=856.70, stdev=137.50 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7543, max= 7937, per=100.00%, avg=7740.00, stdev=278.60, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=11.17%, ctx=237, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179715: Sat Sep 5 21:37:06 2026 read: IOPS=0, BW=1326KiB/s (1358kB/s)(4096KiB/3088msec) clat (nsec): min=814544k, max=814544k, avg=814543513.00, stdev= 0.00 lat (nsec): min=814546k, max=814546k, avg=814545601.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7543, max= 7543, per=100.00%, avg=7543.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2653KiB/s (2717kB/s)(8192KiB/3088msec); 0 zone resets clat (msec): min=447, max=1740, avg=1093.94, stdev=914.49 lat (msec): min=447, max=1740, avg=1094.23, stdev=914.51 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8143, max= 8143, per=80.17%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.70%, ctx=92, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179716: Sat Sep 5 21:37:06 2026 write: IOPS=0, BW=3809KiB/s (3900kB/s)(12.0MiB/3226msec); 0 zone resets clat (msec): min=321, max=1654, avg=1047.47, stdev=674.57 lat (msec): min=324, max=1654, avg=1048.59, stdev=673.30 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8062, max= 8175, per=79.93%, avg=8118.50, stdev=79.90, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.50%, ctx=58, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179717: Sat Sep 5 21:37:06 2026 write: IOPS=1, BW=4443KiB/s (4549kB/s)(12.0MiB/2766msec); 0 zone resets clat (msec): min=417, max=1462, avg=857.12, stdev=541.73 lat (msec): min=419, max=1462, avg=857.78, stdev=541.33 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 5818, max= 7937, per=67.71%, avg=6877.50, stdev=1498.36, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.45%, ctx=78, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5306KiB/s (5433kB/s), 1326KiB/s-4483KiB/s (1358kB/s-4591kB/s), io=16.0MiB (16.8MB), run=2741-3088msec WRITE: bw=9.92MiB/s (10.4MB/s), 2653KiB/s-4443KiB/s (2717kB/s-4549kB/s), io=32.0MiB (33.6MB), run=2766-3226msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179710: Sat Sep 5 21:37:07 2026 read: IOPS=2, BW=9.80MiB/s (10.3MB/s)(12.0MiB/1224msec) clat (msec): min=236, max=604, avg=361.93, stdev=209.88 lat (msec): min=236, max=604, avg=361.93, stdev=209.88 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 6770, max= 8175, per=100.00%, avg=7472.50, stdev=993.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=66.67%, 750=33.33% cpu : usr=0.00%, sys=8.26%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179711: Sat Sep 5 21:37:07 2026 read: IOPS=0, BW=1119KiB/s (1146kB/s)(4096KiB/3661msec) clat (nsec): min=1453.5M, max=1453.5M, avg=1453497491.00, stdev= 0.00 lat (nsec): min=1453.5M, max=1453.5M, avg=1453499737.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1452], 5.00th=[ 1452], 10.00th=[ 1452], 20.00th=[ 1452], | 30.00th=[ 1452], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2238KiB/s (2291kB/s)(8192KiB/3661msec); 0 zone resets clat (msec): min=833, max=1274, avg=1053.60, stdev=311.73 lat (msec): min=833, max=1274, avg=1054.10, stdev=312.05 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8192, max= 8192, per=91.53%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.43%, ctx=56, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179712: Sat Sep 5 21:37:07 2026 write: IOPS=0, BW=3372KiB/s (3453kB/s)(12.0MiB/3644msec); 0 zone resets clat (msec): min=297, max=1895, avg=1158.19, stdev=806.25 lat (msec): min=297, max=1895, avg=1158.51, stdev=806.24 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1284], 50.00th=[ 1284], 60.00th=[ 1284], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8031, max= 8031, per=89.73%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.69%, ctx=45, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179713: Sat Sep 5 21:37:07 2026 write: IOPS=1, BW=4766KiB/s (4881kB/s)(12.0MiB/2578msec); 0 zone resets clat (msec): min=310, max=1244, avg=807.13, stdev=470.09 lat (msec): min=311, max=1245, avg=808.23, stdev=469.66 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 6380, max= 8062, per=80.68%, avg=7221.00, stdev=1189.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.92%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4475KiB/s (4583kB/s), 1119KiB/s-9.80MiB/s (1146kB/s-10.3MB/s), io=16.0MiB (16.8MB), run=1224-3661msec WRITE: bw=8951KiB/s (9165kB/s), 2238KiB/s-4766KiB/s (2291kB/s-4881kB/s), io=32.0MiB (33.6MB), run=2578-3661msec