== sanity test 398b: DIO and buffer IO race ============== 17:10:56 (1777583456) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.81367 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144861: Thu Apr 30 17:13:14 2026 read: IOPS=12, BW=49.8KiB/s (51.0kB/s)(5992KiB/120303msec) clat (usec): min=28, max=928761, avg=37979.86, stdev=36614.39 lat (usec): min=29, max=928762, avg=37981.24, stdev=36614.29 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 68], 20.00th=[ 16319], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 45351], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[129500], 99.50th=[147850], 99.90th=[221250], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 111, per=25.08%, avg=49.41, stdev=21.46, samples=236 iops : min= 1, max= 27, avg=11.71, stdev= 5.41, samples=236 write: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6296KiB/120303msec); 0 zone resets clat (usec): min=1013, max=445279, avg=39948.52, stdev=41827.69 lat (usec): min=1014, max=445280, avg=39951.64, stdev=41826.35 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1565], 20.00th=[ 4015], | 30.00th=[ 8455], 40.00th=[ 17433], 50.00th=[ 28443], 60.00th=[ 39584], | 70.00th=[ 52167], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[170918], 99.50th=[225444], 99.90th=[270533], 99.95th=[446694], | 99.99th=[446694] bw ( KiB/s): min= 7, max= 110, per=25.23%, avg=51.97, stdev=21.52, samples=236 iops : min= 1, max= 27, avg=12.35, stdev= 5.41, samples=236 lat (usec) : 50=1.30%, 100=4.62%, 250=0.33%, 500=0.26%, 750=0.03% lat (msec) : 2=6.64%, 4=3.71%, 10=7.00%, 20=10.03%, 50=37.17% lat (msec) : 100=22.82%, 250=5.96%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=5.68%, ctx=6567, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144862: Thu Apr 30 17:13:14 2026 read: IOPS=12, BW=49.2KiB/s (50.4kB/s)(5940KiB/120716msec) clat (usec): min=26, max=278730, avg=37683.95, stdev=28861.99 lat (usec): min=26, max=278732, avg=37686.79, stdev=28862.18 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 16909], | 30.00th=[ 22152], 40.00th=[ 27395], 50.00th=[ 32375], 60.00th=[ 39060], | 70.00th=[ 46924], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 87557], | 99.00th=[129500], 99.50th=[147850], 99.90th=[189793], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 119, per=25.06%, avg=49.37, stdev=18.68, samples=235 iops : min= 1, max= 29, avg=11.70, stdev= 4.70, samples=235 write: IOPS=13, BW=52.6KiB/s (53.8kB/s)(6348KiB/120716msec); 0 zone resets clat (usec): min=982, max=819826, avg=40478.93, stdev=45446.97 lat (usec): min=984, max=819827, avg=40484.41, stdev=45445.86 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1713], 20.00th=[ 4621], | 30.00th=[ 8586], 40.00th=[ 17957], 50.00th=[ 29754], 60.00th=[ 41157], | 70.00th=[ 52691], 80.00th=[ 68682], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[177210], 99.50th=[206570], 99.90th=[379585], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 15, max= 128, per=25.35%, avg=52.22, stdev=20.61, samples=237 iops : min= 3, max= 32, avg=12.42, stdev= 5.19, samples=237 lat (usec) : 50=1.17%, 100=5.01%, 250=0.42%, 500=0.13%, 750=0.16% lat (usec) : 1000=0.07% lat (msec) : 2=5.99%, 4=3.55%, 10=7.49%, 20=9.86%, 50=36.26% lat (msec) : 100=23.89%, 250=5.83%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=5.75%, ctx=6442, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144863: Thu Apr 30 17:13:14 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6028KiB/121575msec) clat (usec): min=33, max=303266, avg=37218.66, stdev=28308.30 lat (usec): min=33, max=303267, avg=37220.03, stdev=28308.27 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 56], 10.00th=[ 69], 20.00th=[ 16450], | 30.00th=[ 22414], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 38011], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[123208], 99.50th=[147850], 99.90th=[240124], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 110, per=25.10%, avg=49.45, stdev=20.86, samples=237 iops : min= 1, max= 27, avg=11.72, stdev= 5.26, samples=237 write: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6260KiB/121575msec); 0 zone resets clat (usec): min=991, max=834150, avg=41542.26, stdev=45601.06 lat (usec): min=992, max=834151, avg=41546.92, stdev=45600.80 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 2008], 20.00th=[ 4490], | 30.00th=[ 8848], 40.00th=[ 17957], 50.00th=[ 29230], 60.00th=[ 42730], | 70.00th=[ 55313], 80.00th=[ 70779], 90.00th=[ 98042], 95.00th=[122160], | 99.00th=[173016], 99.50th=[200279], 99.90th=[283116], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 127, per=24.79%, avg=51.07, stdev=21.41, samples=238 iops : min= 1, max= 31, avg=12.13, stdev= 5.41, samples=238 lat (usec) : 50=1.04%, 100=4.82%, 250=0.49%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.08%, 4=4.39%, 10=6.97%, 20=10.74%, 50=35.19% lat (msec) : 100=24.87%, 250=6.09%, 500=0.07%, 1000=0.03% cpu : usr=0.10%, sys=5.73%, ctx=6467, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144864: Thu Apr 30 17:13:14 2026 read: IOPS=12, BW=49.9KiB/s (51.1kB/s)(6052KiB/121385msec) clat (usec): min=32, max=205111, avg=37923.02, stdev=28691.41 lat (usec): min=33, max=205111, avg=37924.28, stdev=28691.40 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 68], 20.00th=[ 16450], | 30.00th=[ 22414], 40.00th=[ 27919], 50.00th=[ 33162], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 88605], | 99.00th=[137364], 99.50th=[154141], 99.90th=[183501], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 7, max= 103, per=25.13%, avg=49.51, stdev=20.55, samples=239 iops : min= 1, max= 25, avg=11.73, stdev= 5.19, samples=239 write: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6236KiB/121385msec); 0 zone resets clat (usec): min=886, max=847326, avg=40756.39, stdev=45940.64 lat (usec): min=887, max=847327, avg=40759.85, stdev=45939.90 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1319], 10.00th=[ 1876], 20.00th=[ 4359], | 30.00th=[ 7898], 40.00th=[ 16712], 50.00th=[ 29230], 60.00th=[ 40109], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[ 98042], 95.00th=[123208], | 99.00th=[166724], 99.50th=[204473], 99.90th=[270533], 99.95th=[851444], | 99.99th=[851444] bw ( KiB/s): min= 7, max= 134, per=24.78%, avg=51.05, stdev=21.32, samples=239 iops : min= 1, max= 33, avg=12.12, stdev= 5.35, samples=239 lat (usec) : 50=1.30%, 100=4.79%, 250=0.39%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.53%, 4=4.07%, 10=7.85%, 20=10.25%, 50=35.55% lat (msec) : 100=23.63%, 250=6.22%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.87%, ctx=6498, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=198KiB/s (202kB/s), 49.2KiB/s-49.9KiB/s (50.4kB/s-51.1kB/s), io=23.4MiB (24.6MB), run=120303-121575msec WRITE: bw=207KiB/s (212kB/s), 51.4KiB/s-52.6KiB/s (52.6kB/s-53.8kB/s), io=24.6MiB (25.7MB), run=120303-121575msec fio: pid=144865, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144865: Thu Apr 30 17:15:31 2026 read: IOPS=5, BW=21.9KiB/s (22.4kB/s)(5348KiB/244227msec) clat (msec): min=4, max=981, avg=37.78, stdev=42.35 lat (msec): min=4, max=981, avg=37.78, stdev=42.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 83], 95.00th=[ 106], | 99.00th=[ 159], 99.50th=[ 220], 99.90th=[ 284], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 87, per=27.46%, avg=24.71, stdev=16.38, samples=419 iops : min= 1, max= 21, avg= 5.57, stdev= 4.14, samples=419 write: IOPS=5, BW=23.1KiB/s (23.6kB/s)(5632KiB/244227msec); 0 zone resets clat (msec): min=30, max=578, avg=137.49, stdev=69.30 lat (msec): min=30, max=578, avg=137.49, stdev=69.30 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 136], | 70.00th=[ 157], 80.00th=[ 190], 90.00th=[ 234], 95.00th=[ 268], | 99.00th=[ 376], 99.50th=[ 422], 99.90th=[ 502], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 63, per=24.18%, avg=22.73, stdev=11.25, samples=478 iops : min= 1, max= 15, avg= 5.07, stdev= 2.88, samples=478 lat (msec) : 10=3.64%, 20=14.71%, 50=20.58%, 100=25.27%, 250=31.86% lat (msec) : 500=3.79%, 750=0.07%, 1000=0.04% cpu : usr=0.03%, sys=1.30%, ctx=4756, majf=0, minf=22 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1338,1408,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144866: Thu Apr 30 17:15:31 2026 read: IOPS=5, BW=23.0KiB/s (23.6kB/s)(5940KiB/258242msec) clat (msec): min=4, max=916, avg=35.31, stdev=39.67 lat (msec): min=4, max=916, avg=35.31, stdev=39.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 72], 95.00th=[ 96], | 99.00th=[ 169], 99.50th=[ 220], 99.90th=[ 296], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7, max= 111, per=29.16%, avg=26.25, stdev=17.21, samples=439 iops : min= 1, max= 27, avg= 5.96, stdev= 4.36, samples=439 write: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6348KiB/258242msec); 0 zone resets clat (msec): min=30, max=592, avg=129.60, stdev=69.11 lat (msec): min=30, max=592, avg=129.60, stdev=69.11 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 97], 50.00th=[ 110], 60.00th=[ 127], | 70.00th=[ 148], 80.00th=[ 178], 90.00th=[ 220], 95.00th=[ 264], | 99.00th=[ 372], 99.50th=[ 405], 99.90th=[ 550], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7, max= 63, per=25.91%, avg=24.36, stdev=12.09, samples=504 iops : min= 1, max= 15, avg= 5.48, stdev= 3.09, samples=504 lat (msec) : 10=4.13%, 20=14.23%, 50=22.30%, 100=27.64%, 250=28.29% lat (msec) : 500=3.32%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.37%, ctx=5671, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144867: Thu Apr 30 17:15:31 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6028KiB/258033msec) clat (msec): min=4, max=376, avg=36.40, stdev=34.10 lat (msec): min=4, max=376, avg=36.41, stdev=34.10 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 39], 80.00th=[ 54], 90.00th=[ 78], 95.00th=[ 97], | 99.00th=[ 174], 99.50th=[ 205], 99.90th=[ 347], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 111, per=29.03%, avg=26.12, stdev=17.32, samples=447 iops : min= 1, max= 27, avg= 5.93, stdev= 4.35, samples=447 write: IOPS=6, BW=24.3KiB/s (24.8kB/s)(6260KiB/258033msec); 0 zone resets clat (msec): min=34, max=1052, avg=129.74, stdev=71.97 lat (msec): min=34, max=1052, avg=129.74, stdev=71.97 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 111], 60.00th=[ 125], | 70.00th=[ 146], 80.00th=[ 174], 90.00th=[ 222], 95.00th=[ 264], | 99.00th=[ 359], 99.50th=[ 456], 99.90th=[ 558], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 64, per=25.60%, avg=24.06, stdev=11.92, samples=502 iops : min= 1, max= 16, avg= 5.41, stdev= 3.05, samples=502 lat (msec) : 10=3.97%, 20=14.52%, 50=20.90%, 100=28.84%, 250=28.35% lat (msec) : 500=3.35%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5564, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144868: Thu Apr 30 17:15:31 2026 read: IOPS=5, BW=23.5KiB/s (24.1kB/s)(6052KiB/256983msec) clat (msec): min=5, max=350, avg=35.22, stdev=32.63 lat (msec): min=5, max=350, avg=35.22, stdev=32.63 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 50], 90.00th=[ 78], 95.00th=[ 100], | 99.00th=[ 153], 99.50th=[ 186], 99.90th=[ 268], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 95, per=29.03%, avg=26.13, stdev=18.20, samples=449 iops : min= 1, max= 23, avg= 5.93, stdev= 4.59, samples=449 write: IOPS=6, BW=24.3KiB/s (24.8kB/s)(6236KiB/256983msec); 0 zone resets clat (msec): min=35, max=1168, avg=130.58, stdev=71.79 lat (msec): min=35, max=1168, avg=130.59, stdev=71.79 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 86], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 130], | 70.00th=[ 153], 80.00th=[ 178], 90.00th=[ 220], 95.00th=[ 257], | 99.00th=[ 359], 99.50th=[ 405], 99.90th=[ 584], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 56, per=25.57%, avg=24.03, stdev=11.87, samples=501 iops : min= 1, max= 14, avg= 5.40, stdev= 3.03, samples=501 lat (msec) : 10=4.46%, 20=15.10%, 50=21.35%, 100=27.15%, 250=29.00% lat (msec) : 500=2.86%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5551, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=90.5KiB/s (92.7kB/s), 21.9KiB/s-23.5KiB/s (22.4kB/s-24.1kB/s), io=22.8MiB (23.9MB), run=244227-258242msec WRITE: bw=94.8KiB/s (97.1kB/s), 23.1KiB/s-24.6KiB/s (23.6kB/s-25.2kB/s), io=23.9MiB (25.1MB), run=244227-258242msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144921: Thu Apr 30 17:16:06 2026 read: IOPS=14, BW=231KiB/s (236kB/s)(5920KiB/25638msec) clat (usec): min=35, max=180657, avg=33772.38, stdev=28751.22 lat (usec): min=35, max=180658, avg=33773.66, stdev=28750.93 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 119], | 30.00th=[ 20317], 40.00th=[ 25297], 50.00th=[ 30540], 60.00th=[ 35390], | 70.00th=[ 43254], 80.00th=[ 52167], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[131597], 99.50th=[164627], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 510, per=24.59%, avg=229.66, stdev=97.22, samples=50 iops : min= 3, max= 31, avg=13.52, stdev= 6.12, samples=50 write: IOPS=15, BW=248KiB/s (254kB/s)(6368KiB/25638msec); 0 zone resets clat (usec): min=1526, max=273434, avg=32266.17, stdev=35115.39 lat (usec): min=1528, max=273437, avg=32269.36, stdev=35114.44 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1942], 10.00th=[ 2737], 20.00th=[ 5407], | 30.00th=[ 8717], 40.00th=[ 12780], 50.00th=[ 22938], 60.00th=[ 29754], | 70.00th=[ 40633], 80.00th=[ 54264], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[173016], 99.50th=[235930], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 638, per=25.37%, avg=249.14, stdev=114.25, samples=50 iops : min= 1, max= 39, avg=14.76, stdev= 7.13, samples=50 lat (usec) : 50=1.04%, 100=8.33%, 250=0.52%, 500=0.52%, 750=0.13% lat (msec) : 2=2.99%, 4=4.30%, 10=10.42%, 20=10.03%, 50=38.54% lat (msec) : 100=19.92%, 250=3.12%, 500=0.13% cpu : usr=0.07%, sys=7.00%, ctx=1555, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144922: Thu Apr 30 17:16:06 2026 read: IOPS=14, BW=232KiB/s (237kB/s)(5744KiB/24768msec) clat (usec): min=38, max=224771, avg=37034.76, stdev=28965.71 lat (usec): min=38, max=224771, avg=37042.05, stdev=28958.31 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 14746], | 30.00th=[ 22676], 40.00th=[ 28443], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 46924], 80.00th=[ 55313], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[132645], 99.50th=[181404], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 446, per=24.76%, avg=231.27, stdev=96.11, samples=48 iops : min= 1, max= 27, avg=13.63, stdev= 6.06, samples=48 write: IOPS=16, BW=264KiB/s (271kB/s)(6544KiB/24768msec); 0 zone resets clat (usec): min=1517, max=170915, avg=27494.91, stdev=30734.51 lat (usec): min=1520, max=170918, avg=27497.08, stdev=30735.47 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2089], 10.00th=[ 2933], 20.00th=[ 4424], | 30.00th=[ 6980], 40.00th=[ 9503], 50.00th=[ 15139], 60.00th=[ 22938], | 70.00th=[ 33817], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 92799], | 99.00th=[139461], 99.50th=[156238], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 93, max= 507, per=26.71%, avg=262.33, stdev=115.33, samples=48 iops : min= 5, max= 31, avg=15.58, stdev= 7.24, samples=48 lat (usec) : 50=0.52%, 100=5.86%, 250=0.91%, 750=0.26% lat (msec) : 2=2.86%, 4=6.77%, 10=12.89%, 20=11.07%, 50=36.98% lat (msec) : 100=18.62%, 250=3.26% cpu : usr=0.08%, sys=7.44%, ctx=1549, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144924: Thu Apr 30 17:16:06 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(6256KiB/24055msec) clat (usec): min=35, max=137299, avg=33181.69, stdev=25687.47 lat (usec): min=35, max=137300, avg=33182.92, stdev=25687.48 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 65], 20.00th=[ 108], | 30.00th=[ 20317], 40.00th=[ 26870], 50.00th=[ 32900], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 52691], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[107480], 99.50th=[132645], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 127, max= 444, per=28.08%, avg=262.28, stdev=83.49, samples=47 iops : min= 7, max= 27, avg=15.60, stdev= 5.20, samples=47 write: IOPS=15, BW=251KiB/s (257kB/s)(6032KiB/24055msec); 0 zone resets clat (usec): min=1573, max=316395, avg=28749.33, stdev=33383.31 lat (usec): min=1574, max=316397, avg=28766.16, stdev=33395.37 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2089], 10.00th=[ 3195], 20.00th=[ 5080], | 30.00th=[ 7373], 40.00th=[ 11076], 50.00th=[ 19530], 60.00th=[ 26084], | 70.00th=[ 33817], 80.00th=[ 47973], 90.00th=[ 67634], 95.00th=[ 89654], | 99.00th=[125305], 99.50th=[263193], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 95, max= 637, per=25.51%, avg=250.51, stdev=103.64, samples=47 iops : min= 5, max= 39, avg=14.85, stdev= 6.51, samples=47 lat (usec) : 50=1.04%, 100=8.59%, 250=1.04%, 500=0.39%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.21%, 4=5.21%, 10=10.94%, 20=10.68%, 50=39.32% lat (msec) : 100=17.84%, 250=2.21%, 500=0.26% cpu : usr=0.08%, sys=7.08%, ctx=1519, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144926: Thu Apr 30 17:16:06 2026 read: IOPS=15, BW=246KiB/s (252kB/s)(6032KiB/24505msec) clat (usec): min=35, max=254859, avg=35001.79, stdev=31774.70 lat (usec): min=35, max=254860, avg=35002.84, stdev=31774.69 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 61], 20.00th=[ 251], | 30.00th=[ 21103], 40.00th=[ 25822], 50.00th=[ 29492], 60.00th=[ 36439], | 70.00th=[ 43254], 80.00th=[ 52691], 90.00th=[ 69731], 95.00th=[ 93848], | 99.00th=[168821], 99.50th=[191890], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 63, max= 507, per=26.10%, avg=243.79, stdev=89.45, samples=48 iops : min= 3, max= 31, avg=14.42, stdev= 5.64, samples=48 write: IOPS=15, BW=255KiB/s (261kB/s)(6256KiB/24505msec); 0 zone resets clat (usec): min=1399, max=282157, avg=28625.65, stdev=34528.34 lat (usec): min=1401, max=282160, avg=28627.71, stdev=34528.51 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1975], 10.00th=[ 2442], 20.00th=[ 4113], | 30.00th=[ 6456], 40.00th=[ 10290], 50.00th=[ 16450], 60.00th=[ 24249], | 70.00th=[ 34866], 80.00th=[ 47973], 90.00th=[ 71828], 95.00th=[ 93848], | 99.00th=[152044], 99.50th=[274727], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 32, max= 509, per=26.04%, avg=255.67, stdev=107.56, samples=48 iops : min= 2, max= 31, avg=15.17, stdev= 6.72, samples=48 lat (usec) : 50=1.17%, 100=7.81%, 250=0.78%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.73%, 4=7.42%, 10=9.90%, 20=11.33%, 50=37.63% lat (msec) : 100=17.45%, 250=2.99%, 500=0.39% cpu : usr=0.07%, sys=7.49%, ctx=1512, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=934KiB/s (957kB/s), 231KiB/s-260KiB/s (236kB/s-266kB/s), io=23.4MiB (24.5MB), run=24055-25638msec WRITE: bw=983KiB/s (1007kB/s), 248KiB/s-264KiB/s (254kB/s-271kB/s), io=24.6MiB (25.8MB), run=24055-25638msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Thu Apr 30 17:16:44 2026 read: IOPS=5, BW=92.8KiB/s (95.1kB/s)(5920KiB/63762msec) clat (msec): min=5, max=217, avg=34.74, stdev=31.26 lat (msec): min=5, max=217, avg=34.74, stdev=31.27 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 96], | 99.00th=[ 182], 99.50th=[ 194], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 319, per=27.70%, avg=103.04, stdev=62.69, samples=113 iops : min= 1, max= 19, avg= 5.70, stdev= 3.93, samples=113 write: IOPS=6, BW=99.9KiB/s (102kB/s)(6368KiB/63762msec); 0 zone resets clat (msec): min=40, max=370, avg=127.74, stdev=49.39 lat (msec): min=40, max=370, avg=127.74, stdev=49.39 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 68], 10.00th=[ 77], 20.00th=[ 89], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 117], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 194], 95.00th=[ 230], | 99.00th=[ 279], 99.50th=[ 296], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 191, per=25.30%, avg=99.17, stdev=37.97, samples=126 iops : min= 1, max= 11, avg= 5.44, stdev= 2.44, samples=126 lat (msec) : 10=2.08%, 20=14.45%, 50=24.48%, 100=22.14%, 250=35.29% lat (msec) : 500=1.56% cpu : usr=0.04%, sys=1.52%, ctx=1391, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144920: Thu Apr 30 17:16:44 2026 read: IOPS=5, BW=89.4KiB/s (91.6kB/s)(5744KiB/64218msec) clat (msec): min=6, max=183, avg=34.65, stdev=30.66 lat (msec): min=6, max=183, avg=34.65, stdev=30.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 28], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 79], 95.00th=[ 109], | 99.00th=[ 148], 99.50th=[ 159], 99.90th=[ 184], 99.95th=[ 184], | 99.99th=[ 184] bw ( KiB/s): min= 31, max= 415, per=27.22%, avg=101.25, stdev=70.78, samples=111 iops : min= 1, max= 25, avg= 5.59, stdev= 4.43, samples=111 write: IOPS=6, BW=102KiB/s (104kB/s)(6544KiB/64218msec); 0 zone resets clat (msec): min=41, max=468, avg=125.96, stdev=53.82 lat (msec): min=41, max=468, avg=125.96, stdev=53.82 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 125], | 70.00th=[ 138], 80.00th=[ 157], 90.00th=[ 194], 95.00th=[ 236], | 99.00th=[ 292], 99.50th=[ 334], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 31, max= 191, per=26.00%, avg=101.94, stdev=37.58, samples=126 iops : min= 1, max= 11, avg= 5.62, stdev= 2.42, samples=126 lat (msec) : 10=3.52%, 20=14.32%, 50=20.96%, 100=24.48%, 250=34.64% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.52%, ctx=1360, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144923: Thu Apr 30 17:16:44 2026 read: IOPS=6, BW=100KiB/s (102kB/s)(6256KiB/62522msec) clat (msec): min=6, max=226, avg=33.92, stdev=32.11 lat (msec): min=6, max=226, avg=33.92, stdev=32.12 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 96], | 99.00th=[ 186], 99.50th=[ 224], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 30, max= 414, per=29.44%, avg=109.52, stdev=73.19, samples=113 iops : min= 1, max= 25, avg= 6.11, stdev= 4.60, samples=113 write: IOPS=6, BW=96.5KiB/s (98.8kB/s)(6032KiB/62522msec); 0 zone resets clat (msec): min=43, max=461, avg=130.07, stdev=54.73 lat (msec): min=43, max=461, avg=130.07, stdev=54.73 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 68], 10.00th=[ 75], 20.00th=[ 87], | 30.00th=[ 100], 40.00th=[ 107], 50.00th=[ 117], 60.00th=[ 132], | 70.00th=[ 148], 80.00th=[ 165], 90.00th=[ 192], 95.00th=[ 232], | 99.00th=[ 321], 99.50th=[ 380], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 31, max= 191, per=24.67%, avg=96.71, stdev=34.26, samples=123 iops : min= 1, max= 11, avg= 5.29, stdev= 2.19, samples=123 lat (msec) : 10=2.08%, 20=19.40%, 50=21.48%, 100=21.09%, 250=34.11% lat (msec) : 500=1.82% cpu : usr=0.04%, sys=1.55%, ctx=1300, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144925: Thu Apr 30 17:16:44 2026 read: IOPS=5, BW=95.5KiB/s (97.8kB/s)(6032KiB/63179msec) clat (msec): min=5, max=244, avg=35.90, stdev=33.20 lat (msec): min=5, max=244, avg=35.90, stdev=33.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 67], 95.00th=[ 111], | 99.00th=[ 190], 99.50th=[ 236], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 286, per=27.81%, avg=103.45, stdev=64.25, samples=114 iops : min= 1, max= 17, avg= 5.71, stdev= 4.08, samples=114 write: IOPS=6, BW=99.0KiB/s (101kB/s)(6256KiB/63179msec); 0 zone resets clat (msec): min=37, max=320, avg=126.38, stdev=48.61 lat (msec): min=37, max=320, avg=126.38, stdev=48.61 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 118], 60.00th=[ 130], | 70.00th=[ 144], 80.00th=[ 157], 90.00th=[ 188], 95.00th=[ 224], | 99.00th=[ 279], 99.50th=[ 317], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 223, per=25.12%, avg=98.48, stdev=36.83, samples=125 iops : min= 1, max= 13, avg= 5.40, stdev= 2.39, samples=125 lat (msec) : 10=1.43%, 20=16.41%, 50=23.05%, 100=21.88%, 250=35.81% lat (msec) : 500=1.43% cpu : usr=0.05%, sys=1.62%, ctx=1409, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=373KiB/s (382kB/s), 89.4KiB/s-100KiB/s (91.6kB/s-102kB/s), io=23.4MiB (24.5MB), run=62522-64218msec WRITE: bw=392KiB/s (402kB/s), 96.5KiB/s-102KiB/s (98.8kB/s-104kB/s), io=24.6MiB (25.8MB), run=62522-64218msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144944: Thu Apr 30 17:16:58 2026 read: IOPS=2, BW=2418KiB/s (2476kB/s)(7168KiB/2965msec) clat (msec): min=90, max=462, avg=230.39, stdev=151.07 lat (msec): min=90, max=462, avg=230.39, stdev=151.07 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 104], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 132], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 359], 90.00th=[ 464], 95.00th=[ 464], | 99.00th=[ 464], 99.50th=[ 464], 99.90th=[ 464], 99.95th=[ 464], | 99.99th=[ 464] bw ( KiB/s): min= 1875, max= 4243, per=57.51%, avg=2551.25, stdev=1130.63, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=1, BW=1727KiB/s (1768kB/s)(5120KiB/2965msec); 0 zone resets clat (msec): min=205, max=329, avg=258.99, stdev=49.64 lat (msec): min=206, max=329, avg=259.15, stdev=49.53 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1414, max= 4007, per=37.61%, avg=2336.00, stdev=1145.69, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.03%, sys=3.95%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144945: Thu Apr 30 17:16:58 2026 read: IOPS=0, BW=444KiB/s (454kB/s)(2048KiB/4616msec) clat (msec): min=95, max=141, avg=118.93, stdev=32.44 lat (msec): min=95, max=141, avg=118.93, stdev=32.44 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 96], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 1430, max= 2048, per=39.20%, avg=1739.00, stdev=436.99, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2218KiB/s (2272kB/s)(10.0MiB/4616msec); 0 zone resets clat (msec): min=231, max=842, avg=427.54, stdev=213.14 lat (msec): min=231, max=842, avg=427.64, stdev=213.15 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 236], | 30.00th=[ 241], 40.00th=[ 262], 50.00th=[ 338], 60.00th=[ 397], | 70.00th=[ 451], 80.00th=[ 634], 90.00th=[ 651], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1980, max= 4047, per=44.74%, avg=2778.50, stdev=933.52, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=5.16%, ctx=115, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144946: Thu Apr 30 17:16:58 2026 read: IOPS=1, BW=1442KiB/s (1476kB/s)(6144KiB/4262msec) clat (msec): min=95, max=333, avg=264.08, stdev=89.39 lat (msec): min=95, max=333, avg=264.08, stdev=89.39 clat percentiles (msec): | 1.00th=[ 95], 5.00th=[ 95], 10.00th=[ 95], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 300], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 1875, max= 2048, per=44.80%, avg=1987.40, stdev=68.02, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1442KiB/s (1476kB/s)(6144KiB/4262msec); 0 zone resets clat (msec): min=247, max=727, avg=428.12, stdev=184.22 lat (msec): min=247, max=727, avg=428.74, stdev=184.22 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 422], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1875, max= 2880, per=35.35%, avg=2195.75, stdev=461.68, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=58.33%, 750=16.67% cpu : usr=0.02%, sys=4.67%, ctx=101, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144947: Thu Apr 30 17:16:58 2026 read: IOPS=1, BW=1348KiB/s (1380kB/s)(5120KiB/3798msec) clat (msec): min=257, max=419, avg=328.92, stdev=74.98 lat (msec): min=257, max=419, avg=328.92, stdev=74.98 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1875, max= 4096, per=59.92%, avg=2658.00, stdev=1246.99, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=1, BW=1887KiB/s (1933kB/s)(7168KiB/3798msec); 0 zone resets clat (msec): min=202, max=489, avg=294.81, stdev=100.72 lat (msec): min=202, max=490, avg=294.93, stdev=100.73 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 205], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 288], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 347], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1875, max= 4063, per=41.40%, avg=2571.40, stdev=928.85, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=75.00% cpu : usr=0.05%, sys=4.08%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4437KiB/s (4543kB/s), 444KiB/s-2418KiB/s (454kB/s-2476kB/s), io=20.0MiB (20.0MB), run=2965-4616msec WRITE: bw=6211KiB/s (6361kB/s), 1442KiB/s-2218KiB/s (1476kB/s-2272kB/s), io=28.0MiB (29.4MB), run=2965-4616msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144951: Thu Apr 30 17:16:58 2026 read: IOPS=1, BW=1997KiB/s (2045kB/s)(7168KiB/3589msec) clat (usec): min=483, max=344742, avg=178648.24, stdev=129858.50 lat (usec): min=484, max=344743, avg=178649.42, stdev=129858.63 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 578], | 30.00th=[198181], 40.00th=[198181], 50.00th=[229639], 60.00th=[238027], | 70.00th=[238027], 80.00th=[238027], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 2035, max= 4047, per=68.35%, avg=3360.67, stdev=1148.30, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1427KiB/s (1461kB/s)(5120KiB/3589msec); 0 zone resets clat (msec): min=189, max=659, avg=467.27, stdev=186.29 lat (msec): min=189, max=659, avg=467.33, stdev=186.28 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 418], 40.00th=[ 418], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1980, max= 2023, per=29.12%, avg=2004.67, stdev=22.19, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=11.12%, ctx=166, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144952: Thu Apr 30 17:16:58 2026 read: IOPS=0, BW=492KiB/s (504kB/s)(2048KiB/4165msec) clat (msec): min=108, max=209, avg=159.03, stdev=71.79 lat (msec): min=108, max=209, avg=159.03, stdev=71.79 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 211], 90.00th=[ 211], 95.00th=[ 211], | 99.00th=[ 211], 99.50th=[ 211], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 1943, max= 2019, per=40.29%, avg=1981.00, stdev=53.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2459KiB/s (2518kB/s)(10.0MiB/4165msec); 0 zone resets clat (msec): min=123, max=891, avg=384.22, stdev=244.55 lat (msec): min=123, max=893, avg=384.48, stdev=244.93 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 184], | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 266], 60.00th=[ 376], | 70.00th=[ 435], 80.00th=[ 584], 90.00th=[ 600], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1943, max= 4063, per=43.40%, avg=2987.67, stdev=1092.15, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=11.70%, ctx=135, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144953: Thu Apr 30 17:16:58 2026 read: IOPS=1, BW=1555KiB/s (1592kB/s)(6144KiB/3951msec) clat (usec): min=1622, max=242105, avg=153335.28, stdev=88248.60 lat (usec): min=1623, max=242107, avg=153336.50, stdev=88248.65 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1631], 10.00th=[ 1631], 20.00th=[125305], | 30.00th=[125305], 40.00th=[147850], 50.00th=[147850], 60.00th=[164627], | 70.00th=[238027], 80.00th=[238027], 90.00th=[242222], 95.00th=[242222], | 99.00th=[242222], 99.50th=[242222], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 1943, max= 3961, per=50.18%, avg=2467.50, stdev=996.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1555KiB/s (1592kB/s)(6144KiB/3951msec); 0 zone resets clat (msec): min=168, max=844, avg=504.91, stdev=227.66 lat (msec): min=169, max=845, avg=504.96, stdev=227.65 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 1906, max= 2023, per=28.62%, avg=1970.40, stdev=46.46, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 2=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=9.87%, ctx=135, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144954: Thu Apr 30 17:16:58 2026 read: IOPS=1, BW=1488KiB/s (1524kB/s)(5120KiB/3440msec) clat (usec): min=344, max=332371, avg=155501.72, stdev=149961.05 lat (usec): min=345, max=332373, avg=155502.81, stdev=149961.36 clat percentiles (usec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 437], 40.00th=[ 437], 50.00th=[193987], 60.00th=[193987], | 70.00th=[250610], 80.00th=[250610], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 1943, max= 5941, per=80.17%, avg=3942.00, stdev=2827.01, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2084KiB/s (2134kB/s)(7168KiB/3440msec); 0 zone resets clat (msec): min=242, max=646, avg=378.88, stdev=139.40 lat (msec): min=242, max=646, avg=380.22, stdev=140.45 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 271], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 334], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 477], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 1878, max= 4023, per=34.48%, avg=2373.40, stdev=923.86, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67% lat (msec) : 250=16.67%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=13.23%, ctx=231, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4917KiB/s (5035kB/s), 492KiB/s-1997KiB/s (504kB/s-2045kB/s), io=20.0MiB (20.0MB), run=3440-4165msec WRITE: bw=6884KiB/s (7049kB/s), 1427KiB/s-2459KiB/s (1461kB/s-2518kB/s), io=28.0MiB (29.4MB), run=3440-4165msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144960: Thu Apr 30 17:17:12 2026 read: IOPS=1, BW=4428KiB/s (4534kB/s)(12.0MiB/2775msec) clat (msec): min=715, max=851, avg=805.91, stdev=77.92 lat (msec): min=715, max=851, avg=805.92, stdev=77.92 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.04%, sys=13.19%, ctx=364, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144962: Thu Apr 30 17:17:12 2026 read: IOPS=0, BW=1133KiB/s (1160kB/s)(4096KiB/3616msec) clat (nsec): min=836671k, max=836671k, avg=836671358.00, stdev= 0.00 lat (nsec): min=836674k, max=836674k, avg=836673912.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2265KiB/s (2320kB/s)(8192KiB/3616msec); 0 zone resets clat (msec): min=689, max=1855, avg=1272.72, stdev=824.11 lat (msec): min=690, max=1855, avg=1273.17, stdev=823.89 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 1854], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8175, max= 8175, per=92.36%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.65%, ctx=102, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144963: Thu Apr 30 17:17:12 2026 write: IOPS=0, BW=3319KiB/s (3399kB/s)(12.0MiB/3702msec); 0 zone resets clat (msec): min=1036, max=1181, avg=1112.46, stdev=72.87 lat (msec): min=1036, max=1181, avg=1112.76, stdev=72.82 clat percentiles (msec): | 1.00th=[ 1036], 5.00th=[ 1036], 10.00th=[ 1036], 20.00th=[ 1036], | 30.00th=[ 1036], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7984, max= 8110, per=90.92%, avg=8047.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=4.81%, ctx=84, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144965: Thu Apr 30 17:17:12 2026 write: IOPS=1, BW=5406KiB/s (5536kB/s)(12.0MiB/2273msec); 0 zone resets clat (msec): min=362, max=1160, avg=678.26, stdev=424.55 lat (msec): min=362, max=1190, avg=688.56, stdev=441.45 clat percentiles (msec): | 1.00th=[ 363], 5.00th=[ 363], 10.00th=[ 363], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 510], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8110, max= 8175, per=92.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.87%, ctx=43, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4531KiB/s (4640kB/s), 1133KiB/s-4428KiB/s (1160kB/s-4534kB/s), io=16.0MiB (16.8MB), run=2775-3616msec WRITE: bw=8851KiB/s (9064kB/s), 2265KiB/s-5406KiB/s (2320kB/s-5536kB/s), io=32.0MiB (33.6MB), run=2273-3702msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144964: Thu Apr 30 17:17:12 2026 read: IOPS=0, BW=3421KiB/s (3503kB/s)(12.0MiB/3592msec) clat (msec): min=436, max=1655, avg=1182.46, stdev=653.57 lat (msec): min=436, max=1655, avg=1182.46, stdev=653.57 clat percentiles (msec): | 1.00th=[ 439], 5.00th=[ 439], 10.00th=[ 439], 20.00th=[ 439], | 30.00th=[ 439], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7892, max= 8078, per=100.00%, avg=7985.00, stdev=131.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.20%, ctx=68, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144966: Thu Apr 30 17:17:12 2026 read: IOPS=0, BW=1118KiB/s (1145kB/s)(4096KiB/3664msec) clat (nsec): min=1638.7M, max=1638.7M, avg=1638680820.00, stdev= 0.00 lat (nsec): min=1638.7M, max=1638.7M, avg=1638682838.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1636], 5.00th=[ 1636], 10.00th=[ 1636], 20.00th=[ 1636], | 30.00th=[ 1636], 40.00th=[ 1636], 50.00th=[ 1636], 60.00th=[ 1636], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2236KiB/s (2289kB/s)(8192KiB/3664msec); 0 zone resets clat (msec): min=938, max=1003, avg=970.85, stdev=46.01 lat (msec): min=938, max=1003, avg=971.17, stdev=46.02 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8159, max= 8159, per=91.23%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.90%, ctx=45, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144967: Thu Apr 30 17:17:12 2026 write: IOPS=0, BW=3972KiB/s (4067kB/s)(12.0MiB/3094msec); 0 zone resets clat (msec): min=555, max=1475, avg=996.35, stdev=461.24 lat (msec): min=560, max=1476, avg=998.20, stdev=459.05 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8126, max= 8175, per=91.14%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.08%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144968: Thu Apr 30 17:17:12 2026 write: IOPS=0, BW=4041KiB/s (4138kB/s)(12.0MiB/3041msec); 0 zone resets clat (msec): min=285, max=1552, avg=988.19, stdev=644.73 lat (msec): min=288, max=1553, avg=989.35, stdev=643.73 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7892, max= 7892, per=88.25%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.52%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4472KiB/s (4579kB/s), 1118KiB/s-3421KiB/s (1145kB/s-3503kB/s), io=16.0MiB (16.8MB), run=3592-3664msec WRITE: bw=8943KiB/s (9158kB/s), 2236KiB/s-4041KiB/s (2289kB/s-4138kB/s), io=32.0MiB (33.6MB), run=3041-3664msec