== sanity test 398b: DIO and buffer IO race ============== 10:43:30 (1781621010) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.32782 s, 8.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186473: Tue Jun 16 10:45:19 2026 read: IOPS=16, BW=67.3KiB/s (68.9kB/s)(5992KiB/89027msec) clat (usec): min=36, max=1038.5k, avg=33492.56, stdev=32980.98 lat (usec): min=36, max=1038.5k, avg=33494.05, stdev=32980.96 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9241], 10.00th=[ 13042], | 20.00th=[ 17171], 30.00th=[ 20841], 40.00th=[ 25035], | 50.00th=[ 28967], 60.00th=[ 33424], 70.00th=[ 39060], | 80.00th=[ 46924], 90.00th=[ 56886], 95.00th=[ 69731], | 99.00th=[ 101188], 99.50th=[ 119014], 99.90th=[ 191890], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 15, max= 127, per=25.00%, avg=67.00, stdev=19.06, samples=175 iops : min= 3, max= 31, avg=16.13, stdev= 4.82, samples=175 write: IOPS=17, BW=70.7KiB/s (72.4kB/s)(6296KiB/89027msec); 0 zone resets clat (usec): min=866, max=122968, avg=24422.96, stdev=22121.49 lat (usec): min=867, max=122969, avg=24424.97, stdev=22121.87 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1614], 10.00th=[ 2278], 20.00th=[ 4015], | 30.00th=[ 7570], 40.00th=[ 13829], 50.00th=[ 19268], 60.00th=[ 24773], | 70.00th=[ 31327], 80.00th=[ 41681], 90.00th=[ 55837], 95.00th=[ 69731], | 99.00th=[ 93848], 99.50th=[101188], 99.90th=[116917], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 15, max= 151, per=25.17%, avg=70.47, stdev=26.15, samples=175 iops : min= 3, max= 37, avg=17.01, stdev= 6.58, samples=175 lat (usec) : 50=0.23%, 100=1.27%, 250=0.29%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=3.94%, 4=6.22%, 10=8.04%, 20=19.56%, 50=45.83% lat (msec) : 100=13.70%, 250=0.72%, 2000=0.03% cpu : usr=0.13%, sys=8.98%, ctx=7401, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186474: Tue Jun 16 10:45:19 2026 read: IOPS=16, BW=66.3KiB/s (67.9kB/s)(5940KiB/89553msec) clat (usec): min=40, max=246295, avg=33346.64, stdev=21174.23 lat (usec): min=42, max=246296, avg=33350.66, stdev=21175.80 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 10159], 10.00th=[ 13435], 20.00th=[ 17695], | 30.00th=[ 21103], 40.00th=[ 24773], 50.00th=[ 29754], 60.00th=[ 34341], | 70.00th=[ 39060], 80.00th=[ 46400], 90.00th=[ 57934], 95.00th=[ 68682], | 99.00th=[108528], 99.50th=[126354], 99.90th=[210764], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 23, max= 135, per=24.61%, avg=65.94, stdev=20.96, samples=176 iops : min= 5, max= 33, avg=15.87, stdev= 5.30, samples=176 write: IOPS=17, BW=70.9KiB/s (72.6kB/s)(6348KiB/89553msec); 0 zone resets clat (usec): min=843, max=1024.6k, avg=24944.92, stdev=34887.73 lat (usec): min=844, max=1024.6k, avg=24947.00, stdev=34887.62 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1450], 10.00th=[ 1942], | 20.00th=[ 3818], 30.00th=[ 6325], 40.00th=[ 12125], | 50.00th=[ 18220], 60.00th=[ 23462], 70.00th=[ 30802], | 80.00th=[ 40109], 90.00th=[ 56886], 95.00th=[ 72877], | 99.00th=[ 103285], 99.50th=[ 119014], 99.90th=[ 208667], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 167, per=25.11%, avg=70.30, stdev=27.28, samples=176 iops : min= 1, max= 41, avg=16.95, stdev= 6.84, samples=176 lat (usec) : 50=0.16%, 100=0.94%, 250=0.26%, 500=0.16%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.34%, 4=5.50%, 10=9.05%, 20=18.98%, 50=44.01% lat (msec) : 100=14.29%, 250=1.14%, 2000=0.03% cpu : usr=0.10%, sys=9.05%, ctx=7368, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186475: Tue Jun 16 10:45:19 2026 read: IOPS=17, BW=68.7KiB/s (70.3kB/s)(6028KiB/87781msec) clat (usec): min=34, max=252824, avg=32091.26, stdev=20525.01 lat (usec): min=34, max=252824, avg=32095.37, stdev=20527.30 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 9241], 10.00th=[ 12911], 20.00th=[ 16712], | 30.00th=[ 20317], 40.00th=[ 24249], 50.00th=[ 27919], 60.00th=[ 32375], | 70.00th=[ 37487], 80.00th=[ 45351], 90.00th=[ 57410], 95.00th=[ 68682], | 99.00th=[ 98042], 99.50th=[114820], 99.90th=[164627], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 7, max= 144, per=25.61%, avg=68.64, stdev=23.33, samples=173 iops : min= 1, max= 36, avg=16.54, stdev= 5.86, samples=173 write: IOPS=17, BW=71.3KiB/s (73.0kB/s)(6260KiB/87781msec); 0 zone resets clat (usec): min=938, max=1046.5k, avg=24944.30, stdev=34752.88 lat (usec): min=939, max=1046.5k, avg=24949.04, stdev=34756.26 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1598], 10.00th=[ 2180], | 20.00th=[ 3752], 30.00th=[ 6849], 40.00th=[ 12780], | 50.00th=[ 18482], 60.00th=[ 23200], 70.00th=[ 31589], | 80.00th=[ 41681], 90.00th=[ 57410], 95.00th=[ 69731], | 99.00th=[ 98042], 99.50th=[ 108528], 99.90th=[ 202376], | 99.95th=[1044382], 99.99th=[1044382] bw ( KiB/s): min= 15, max= 159, per=25.41%, avg=71.14, stdev=24.79, samples=173 iops : min= 3, max= 39, avg=17.17, stdev= 6.26, samples=173 lat (usec) : 50=0.20%, 100=1.14%, 250=0.49%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=4.49%, 4=6.28%, 10=8.30%, 20=20.64%, 50=43.78% lat (msec) : 100=13.67%, 250=0.78%, 500=0.03%, 2000=0.03% cpu : usr=0.10%, sys=9.35%, ctx=7312, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186476: Tue Jun 16 10:45:19 2026 read: IOPS=17, BW=68.6KiB/s (70.3kB/s)(6052KiB/88180msec) clat (usec): min=30, max=1049.6k, avg=32184.08, stdev=33069.43 lat (usec): min=30, max=1049.6k, avg=32191.10, stdev=33071.32 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 6259], 10.00th=[ 12387], | 20.00th=[ 16319], 30.00th=[ 20055], 40.00th=[ 23462], | 50.00th=[ 27395], 60.00th=[ 31851], 70.00th=[ 37487], | 80.00th=[ 45351], 90.00th=[ 56361], 95.00th=[ 69731], | 99.00th=[ 95945], 99.50th=[ 117965], 99.90th=[ 181404], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 15, max= 135, per=25.72%, avg=68.92, stdev=21.96, samples=173 iops : min= 3, max= 33, avg=16.61, stdev= 5.52, samples=173 write: IOPS=17, BW=70.7KiB/s (72.4kB/s)(6236KiB/88180msec); 0 zone resets clat (usec): min=844, max=172031, avg=25046.00, stdev=24747.79 lat (usec): min=845, max=172034, avg=25054.92, stdev=24743.60 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1500], 10.00th=[ 2278], 20.00th=[ 4015], | 30.00th=[ 6259], 40.00th=[ 11994], 50.00th=[ 18482], 60.00th=[ 24511], | 70.00th=[ 31589], 80.00th=[ 43254], 90.00th=[ 59507], 95.00th=[ 73925], | 99.00th=[109577], 99.50th=[122160], 99.90th=[170918], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 7, max= 166, per=25.21%, avg=70.57, stdev=26.90, samples=174 iops : min= 1, max= 41, avg=17.02, stdev= 6.78, samples=174 lat (usec) : 50=0.07%, 100=1.63%, 250=0.52%, 500=0.10%, 1000=0.13% lat (msec) : 2=4.10%, 4=5.92%, 10=10.06%, 20=18.95%, 50=43.46% lat (msec) : 100=13.96%, 250=1.07%, 2000=0.03% cpu : usr=0.11%, sys=9.17%, ctx=7283, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=268KiB/s (275kB/s), 66.3KiB/s-68.7KiB/s (67.9kB/s-70.3kB/s), io=23.4MiB (24.6MB), run=87781-89553msec WRITE: bw=281KiB/s (287kB/s), 70.7KiB/s-71.3KiB/s (72.4kB/s-73.0kB/s), io=24.6MiB (25.7MB), run=87781-89553msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186478: Tue Jun 16 10:45:45 2026 read: IOPS=13, BW=52.1KiB/s (53.3kB/s)(5992KiB/115021msec) clat (msec): min=4, max=1103, avg=31.31, stdev=38.23 lat (msec): min=4, max=1103, avg=31.32, stdev=38.23 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 45], 90.00th=[ 67], 95.00th=[ 87], | 99.00th=[ 136], 99.50th=[ 153], 99.90th=[ 186], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 160, per=25.07%, avg=52.14, stdev=33.61, samples=226 iops : min= 1, max= 40, avg=12.41, stdev= 8.47, samples=226 write: IOPS=13, BW=54.7KiB/s (56.1kB/s)(6296KiB/115021msec); 0 zone resets clat (msec): min=8, max=269, avg=43.17, stdev=31.13 lat (msec): min=8, max=269, avg=43.17, stdev=31.13 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 84], 95.00th=[ 100], | 99.00th=[ 163], 99.50th=[ 197], 99.90th=[ 253], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 151, per=25.12%, avg=54.76, stdev=31.92, samples=226 iops : min= 1, max= 37, avg=13.07, stdev= 8.02, samples=226 lat (msec) : 10=5.70%, 20=27.28%, 50=43.75%, 100=19.30%, 250=3.87% lat (msec) : 500=0.07%, 2000=0.03% cpu : usr=0.10%, sys=3.79%, ctx=5269, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186479: Tue Jun 16 10:45:45 2026 read: IOPS=12, BW=51.7KiB/s (52.0kB/s)(5940KiB/114811msec) clat (msec): min=5, max=1079, avg=30.82, stdev=37.33 lat (msec): min=5, max=1079, avg=30.82, stdev=37.33 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 33], 80.00th=[ 44], 90.00th=[ 63], 95.00th=[ 85], | 99.00th=[ 136], 99.50th=[ 150], 99.90th=[ 205], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 166, per=24.88%, avg=51.76, stdev=34.36, samples=225 iops : min= 1, max= 41, avg=12.32, stdev= 8.63, samples=225 write: IOPS=13, BW=55.3KiB/s (56.6kB/s)(6348KiB/114811msec); 0 zone resets clat (msec): min=7, max=223, avg=43.42, stdev=29.97 lat (msec): min=7, max=223, avg=43.42, stdev=29.97 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 89], 95.00th=[ 105], | 99.00th=[ 153], 99.50th=[ 165], 99.90th=[ 190], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 7, max= 160, per=25.21%, avg=54.96, stdev=32.56, samples=226 iops : min= 1, max= 40, avg=13.12, stdev= 8.18, samples=226 lat (msec) : 10=5.63%, 20=28.45%, 50=42.19%, 100=19.47%, 250=4.23% lat (msec) : 2000=0.03% cpu : usr=0.10%, sys=3.88%, ctx=5379, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186480: Tue Jun 16 10:45:45 2026 read: IOPS=13, BW=52.5KiB/s (53.7kB/s)(6028KiB/114897msec) clat (msec): min=4, max=185, avg=30.83, stdev=26.01 lat (msec): min=4, max=185, avg=30.84, stdev=26.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 34], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 87], | 99.00th=[ 125], 99.50th=[ 144], 99.90th=[ 178], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 7, max= 184, per=25.24%, avg=52.51, stdev=33.08, samples=224 iops : min= 1, max= 46, avg=12.50, stdev= 8.31, samples=224 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6260KiB/114897msec); 0 zone resets clat (msec): min=9, max=1088, avg=43.64, stdev=39.97 lat (msec): min=9, max=1088, avg=43.64, stdev=39.97 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 65], 90.00th=[ 85], 95.00th=[ 100], | 99.00th=[ 163], 99.50th=[ 182], 99.90th=[ 234], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 160, per=24.79%, avg=54.05, stdev=33.57, samples=226 iops : min= 1, max= 40, avg=12.88, stdev= 8.44, samples=226 lat (msec) : 10=6.15%, 20=26.27%, 50=43.62%, 100=20.02%, 250=3.91% lat (msec) : 2000=0.03% cpu : usr=0.09%, sys=3.84%, ctx=5214, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186481: Tue Jun 16 10:45:45 2026 read: IOPS=13, BW=52.6KiB/s (53.8kB/s)(6052KiB/115133msec) clat (msec): min=4, max=214, avg=31.39, stdev=27.20 lat (msec): min=4, max=214, avg=31.39, stdev=27.20 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 27], | 70.00th=[ 35], 80.00th=[ 46], 90.00th=[ 71], 95.00th=[ 90], | 99.00th=[ 128], 99.50th=[ 150], 99.90th=[ 205], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 7, max= 159, per=25.46%, avg=52.96, stdev=33.03, samples=224 iops : min= 1, max= 39, avg=12.62, stdev= 8.31, samples=224 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6236KiB/115133msec); 0 zone resets clat (msec): min=8, max=1104, avg=43.29, stdev=41.04 lat (msec): min=8, max=1104, avg=43.29, stdev=41.04 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 82], 95.00th=[ 101], | 99.00th=[ 155], 99.50th=[ 182], 99.90th=[ 264], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 160, per=24.77%, avg=54.00, stdev=32.89, samples=226 iops : min= 1, max= 40, avg=12.87, stdev= 8.27, samples=226 lat (msec) : 10=5.86%, 20=27.83%, 50=42.58%, 100=19.73%, 250=3.91% lat (msec) : 500=0.07%, 2000=0.03% cpu : usr=0.09%, sys=3.82%, ctx=5394, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=209KiB/s (214kB/s), 51.7KiB/s-52.6KiB/s (52.0kB/s-53.8kB/s), io=23.4MiB (24.6MB), run=114811-115133msec WRITE: bw=218KiB/s (224kB/s), 54.2KiB/s-55.3KiB/s (55.5kB/s-56.6kB/s), io=24.6MiB (25.7MB), run=114811-115133msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186520: Tue Jun 16 10:46:15 2026 read: IOPS=16, BW=259KiB/s (265kB/s)(5920KiB/22860msec) clat (usec): min=43, max=124434, avg=32130.31, stdev=18460.50 lat (usec): min=44, max=124435, avg=32131.69, stdev=18460.62 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 108], 10.00th=[ 12780], 20.00th=[ 17695], | 30.00th=[ 22152], 40.00th=[ 26346], 50.00th=[ 30016], 60.00th=[ 34341], | 70.00th=[ 38536], 80.00th=[ 43779], 90.00th=[ 54264], 95.00th=[ 67634], | 99.00th=[ 89654], 99.50th=[100140], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 127, max= 447, per=25.26%, avg=258.13, stdev=76.22, samples=45 iops : min= 7, max= 27, avg=15.44, stdev= 4.85, samples=45 write: IOPS=17, BW=279KiB/s (285kB/s)(6368KiB/22860msec); 0 zone resets clat (usec): min=1248, max=125777, avg=27465.52, stdev=23244.59 lat (usec): min=1249, max=125780, avg=27468.20, stdev=23244.86 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2737], 10.00th=[ 3687], 20.00th=[ 6456], | 30.00th=[ 10552], 40.00th=[ 16188], 50.00th=[ 21890], 60.00th=[ 27132], | 70.00th=[ 35390], 80.00th=[ 48497], 90.00th=[ 60556], 95.00th=[ 70779], | 99.00th=[101188], 99.50th=[115868], 99.90th=[125305], 99.95th=[125305], | 99.99th=[125305] bw ( KiB/s): min= 64, max= 508, per=25.93%, avg=279.02, stdev=79.93, samples=45 iops : min= 4, max= 31, avg=16.78, stdev= 5.04, samples=45 lat (usec) : 50=0.26%, 100=1.95%, 250=0.65%, 500=0.26% lat (msec) : 2=0.78%, 4=5.34%, 10=9.38%, 20=17.84%, 50=47.27% lat (msec) : 100=15.63%, 250=0.65% cpu : usr=0.14%, sys=10.80%, ctx=1996, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186521: Tue Jun 16 10:46:15 2026 read: IOPS=15, BW=255KiB/s (261kB/s)(5744KiB/22507msec) clat (usec): min=45, max=115481, avg=33613.27, stdev=18460.68 lat (usec): min=46, max=115482, avg=33615.40, stdev=18460.34 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 95], 10.00th=[ 14222], 20.00th=[ 19268], | 30.00th=[ 24249], 40.00th=[ 28181], 50.00th=[ 31327], 60.00th=[ 35390], | 70.00th=[ 40109], 80.00th=[ 45876], 90.00th=[ 56361], 95.00th=[ 66323], | 99.00th=[ 91751], 99.50th=[111674], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 95, max= 384, per=24.93%, avg=254.77, stdev=75.90, samples=44 iops : min= 5, max= 24, avg=15.25, stdev= 4.80, samples=44 write: IOPS=18, BW=291KiB/s (298kB/s)(6544KiB/22507msec); 0 zone resets clat (usec): min=1613, max=106844, avg=25385.66, stdev=20936.20 lat (usec): min=1614, max=106846, avg=25391.74, stdev=20936.17 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2376], 10.00th=[ 3294], 20.00th=[ 5669], | 30.00th=[ 10552], 40.00th=[ 15926], 50.00th=[ 20579], 60.00th=[ 25560], | 70.00th=[ 33817], 80.00th=[ 41681], 90.00th=[ 55313], 95.00th=[ 66847], | 99.00th=[ 90702], 99.50th=[ 95945], 99.90th=[106431], 99.95th=[106431], | 99.99th=[106431] bw ( KiB/s): min= 128, max= 479, per=26.89%, avg=289.32, stdev=80.33, samples=44 iops : min= 8, max= 29, avg=17.41, stdev= 5.12, samples=44 lat (usec) : 50=0.13%, 100=2.21%, 250=0.13% lat (msec) : 2=1.56%, 4=5.34%, 10=8.72%, 20=17.97%, 50=48.96% lat (msec) : 100=14.45%, 250=0.52% cpu : usr=0.08%, sys=10.73%, ctx=2046, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186522: Tue Jun 16 10:46:15 2026 read: IOPS=16, BW=267KiB/s (274kB/s)(6256KiB/23418msec) clat (usec): min=46, max=120892, avg=32499.35, stdev=20178.84 lat (usec): min=47, max=120894, avg=32500.70, stdev=20178.88 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 79], 10.00th=[ 10945], 20.00th=[ 17695], | 30.00th=[ 21890], 40.00th=[ 24773], 50.00th=[ 29754], 60.00th=[ 34866], | 70.00th=[ 39584], 80.00th=[ 45351], 90.00th=[ 60031], 95.00th=[ 69731], | 99.00th=[ 95945], 99.50th=[ 99091], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 62, max= 446, per=26.21%, avg=267.83, stdev=89.91, samples=46 iops : min= 3, max= 27, avg=16.07, stdev= 5.74, samples=46 write: IOPS=16, BW=258KiB/s (264kB/s)(6032KiB/23418msec); 0 zone resets clat (usec): min=1554, max=121965, avg=28257.17, stdev=23977.40 lat (usec): min=1556, max=121967, avg=28261.84, stdev=23978.46 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2769], 10.00th=[ 3621], 20.00th=[ 6325], | 30.00th=[ 10683], 40.00th=[ 16450], 50.00th=[ 22414], 60.00th=[ 27395], | 70.00th=[ 38011], 80.00th=[ 45876], 90.00th=[ 64750], 95.00th=[ 74974], | 99.00th=[101188], 99.50th=[105382], 99.90th=[122160], 99.95th=[122160], | 99.99th=[122160] bw ( KiB/s): min= 125, max= 478, per=23.52%, avg=253.04, stdev=81.96, samples=46 iops : min= 7, max= 29, avg=15.13, stdev= 5.08, samples=46 lat (usec) : 50=0.26%, 100=3.26%, 250=0.78%, 500=0.13% lat (msec) : 2=1.04%, 4=4.95%, 10=8.72%, 20=16.02%, 50=48.31% lat (msec) : 100=15.89%, 250=0.65% cpu : usr=0.11%, sys=10.35%, ctx=2008, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186523: Tue Jun 16 10:46:15 2026 read: IOPS=16, BW=266KiB/s (272kB/s)(6032KiB/22672msec) clat (usec): min=42, max=137624, avg=33751.68, stdev=21260.57 lat (usec): min=44, max=137625, avg=33759.69, stdev=21262.15 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 98], 10.00th=[ 523], 20.00th=[ 18744], | 30.00th=[ 23200], 40.00th=[ 26608], 50.00th=[ 31851], 60.00th=[ 36963], | 70.00th=[ 42206], 80.00th=[ 49021], 90.00th=[ 58459], 95.00th=[ 71828], | 99.00th=[112722], 99.50th=[133694], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 63, max= 446, per=25.76%, avg=263.30, stdev=73.29, samples=44 iops : min= 3, max= 27, avg=15.80, stdev= 4.66, samples=44 write: IOPS=17, BW=276KiB/s (283kB/s)(6256KiB/22672msec); 0 zone resets clat (usec): min=1088, max=105333, avg=25330.18, stdev=22375.35 lat (usec): min=1090, max=105334, avg=25339.94, stdev=22369.04 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 2212], 10.00th=[ 2933], 20.00th=[ 5211], | 30.00th=[ 8455], 40.00th=[ 13566], 50.00th=[ 19006], 60.00th=[ 25035], | 70.00th=[ 34866], 80.00th=[ 43254], 90.00th=[ 57410], 95.00th=[ 69731], | 99.00th=[101188], 99.50th=[102237], 99.90th=[105382], 99.95th=[105382], | 99.99th=[105382] bw ( KiB/s): min= 127, max= 479, per=25.51%, avg=274.48, stdev=84.71, samples=44 iops : min= 7, max= 29, avg=16.50, stdev= 5.35, samples=44 lat (usec) : 50=0.26%, 100=2.21%, 250=2.34%, 750=0.13% lat (msec) : 2=2.08%, 4=6.12%, 10=8.98%, 20=15.36%, 50=45.57% lat (msec) : 100=15.89%, 250=1.04% cpu : usr=0.10%, sys=10.31%, ctx=1915, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1023KiB/s (1047kB/s), 255KiB/s-267KiB/s (261kB/s-274kB/s), io=23.4MiB (24.5MB), run=22507-23418msec WRITE: bw=1076KiB/s (1102kB/s), 258KiB/s-291KiB/s (264kB/s-298kB/s), io=24.6MiB (25.8MB), run=22507-23418msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186515: Tue Jun 16 10:46:22 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(5920KiB/30032msec) clat (msec): min=5, max=135, avg=29.81, stdev=23.38 lat (msec): min=5, max=135, avg=29.81, stdev=23.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 26], | 70.00th=[ 30], 80.00th=[ 42], 90.00th=[ 62], 95.00th=[ 85], | 99.00th=[ 118], 99.50th=[ 123], 99.90th=[ 136], 99.95th=[ 136], | 99.99th=[ 136] bw ( KiB/s): min= 31, max= 480, per=24.28%, avg=192.80, stdev=106.18, samples=59 iops : min= 1, max= 30, avg=11.31, stdev= 6.72, samples=59 write: IOPS=13, BW=212KiB/s (217kB/s)(6368KiB/30032msec); 0 zone resets clat (msec): min=10, max=179, avg=47.44, stdev=29.81 lat (msec): min=10, max=179, avg=47.44, stdev=29.81 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 68], 90.00th=[ 88], 95.00th=[ 112], | 99.00th=[ 155], 99.50th=[ 178], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 31, max= 544, per=25.08%, avg=209.68, stdev=102.44, samples=59 iops : min= 1, max= 34, avg=12.37, stdev= 6.53, samples=59 lat (msec) : 10=3.91%, 20=22.53%, 50=48.18%, 100=20.70%, 250=4.69% cpu : usr=0.07%, sys=4.32%, ctx=1351, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186516: Tue Jun 16 10:46:22 2026 read: IOPS=12, BW=193KiB/s (197kB/s)(5744KiB/29836msec) clat (msec): min=5, max=172, avg=33.35, stdev=26.89 lat (msec): min=5, max=172, avg=33.35, stdev=26.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 48], 90.00th=[ 75], 95.00th=[ 96], | 99.00th=[ 132], 99.50th=[ 138], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 61, max= 480, per=24.18%, avg=192.02, stdev=110.15, samples=59 iops : min= 3, max= 30, avg=11.27, stdev= 6.93, samples=59 write: IOPS=13, BW=219KiB/s (225kB/s)(6544KiB/29836msec); 0 zone resets clat (msec): min=9, max=142, avg=43.42, stdev=25.76 lat (msec): min=9, max=142, avg=43.43, stdev=25.76 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 50], 80.00th=[ 63], 90.00th=[ 79], 95.00th=[ 95], | 99.00th=[ 136], 99.50th=[ 140], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 510, per=26.16%, avg=218.68, stdev=113.89, samples=59 iops : min= 1, max= 31, avg=12.93, stdev= 7.22, samples=59 lat (msec) : 10=2.99%, 20=22.53%, 50=50.39%, 100=20.31%, 250=3.78% cpu : usr=0.09%, sys=4.26%, ctx=1344, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186517: Tue Jun 16 10:46:22 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(6256KiB/30132msec) clat (msec): min=6, max=161, avg=32.17, stdev=24.56 lat (msec): min=6, max=161, avg=32.17, stdev=24.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 66], 95.00th=[ 85], | 99.00th=[ 115], 99.50th=[ 136], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 62, max= 512, per=25.86%, avg=205.34, stdev=106.13, samples=59 iops : min= 3, max= 32, avg=12.10, stdev= 6.74, samples=59 write: IOPS=12, BW=200KiB/s (205kB/s)(6032KiB/30132msec); 0 zone resets clat (msec): min=11, max=151, avg=46.41, stdev=28.38 lat (msec): min=11, max=151, avg=46.41, stdev=28.38 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 54], 80.00th=[ 67], 90.00th=[ 88], 95.00th=[ 105], | 99.00th=[ 140], 99.50th=[ 146], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 63, max= 480, per=23.31%, avg=194.83, stdev=96.10, samples=59 iops : min= 3, max= 30, avg=11.44, stdev= 6.07, samples=59 lat (msec) : 10=2.47%, 20=24.09%, 50=47.66%, 100=21.48%, 250=4.30% cpu : usr=0.13%, sys=4.26%, ctx=1374, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186518: Tue Jun 16 10:46:22 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6032KiB/29744msec) clat (msec): min=5, max=165, avg=31.03, stdev=24.25 lat (msec): min=5, max=165, avg=31.03, stdev=24.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 65], 95.00th=[ 81], | 99.00th=[ 118], 99.50th=[ 157], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 62, max= 606, per=25.27%, avg=200.62, stdev=106.72, samples=58 iops : min= 3, max= 37, avg=11.79, stdev= 6.75, samples=58 write: IOPS=13, BW=210KiB/s (215kB/s)(6256KiB/29744msec); 0 zone resets clat (msec): min=10, max=243, avg=45.76, stdev=29.37 lat (msec): min=10, max=243, avg=45.77, stdev=29.37 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 63], 90.00th=[ 82], 95.00th=[ 107], | 99.00th=[ 146], 99.50th=[ 199], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 94, max= 542, per=24.97%, avg=208.78, stdev=99.53, samples=58 iops : min= 5, max= 33, avg=12.31, stdev= 6.28, samples=58 lat (msec) : 10=2.47%, 20=22.79%, 50=51.04%, 100=19.92%, 250=3.78% cpu : usr=0.08%, sys=4.26%, ctx=1339, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=795KiB/s (814kB/s), 193KiB/s-208KiB/s (197kB/s-213kB/s), io=23.4MiB (24.5MB), run=29744-30132msec WRITE: bw=836KiB/s (856kB/s), 200KiB/s-219KiB/s (205kB/s-225kB/s), io=24.6MiB (25.8MB), run=29744-30132msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186532: Tue Jun 16 10:46:30 2026 read: IOPS=3, BW=3661KiB/s (3749kB/s)(7168KiB/1958msec) clat (msec): min=4, max=263, avg=135.80, stdev=87.06 lat (msec): min=4, max=263, avg=135.80, stdev=87.06 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 89], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 104], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 205], 90.00th=[ 264], 95.00th=[ 264], | 99.00th=[ 264], 99.50th=[ 264], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 4063, max= 5333, per=72.20%, avg=4698.00, stdev=898.03, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2615KiB/s (2678kB/s)(5120KiB/1958msec); 0 zone resets clat (msec): min=76, max=371, avg=196.92, stdev=114.95 lat (msec): min=76, max=371, avg=196.99, stdev=114.94 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 78], | 30.00th=[ 125], 40.00th=[ 125], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 1777, max= 6144, per=43.47%, avg=3960.50, stdev=3087.94, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 10=8.33%, 100=16.67%, 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=27.59%, ctx=180, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186533: Tue Jun 16 10:46:30 2026 read: IOPS=0, BW=651KiB/s (666kB/s)(2048KiB/3147msec) clat (usec): min=492, max=90893, avg=45692.99, stdev=63923.55 lat (usec): min=493, max=90896, avg=45695.06, stdev=63925.10 clat percentiles (usec): | 1.00th=[ 494], 5.00th=[ 494], 10.00th=[ 494], 20.00th=[ 494], | 30.00th=[ 494], 40.00th=[ 494], 50.00th=[ 494], 60.00th=[90702], | 70.00th=[90702], 80.00th=[90702], 90.00th=[90702], 95.00th=[90702], | 99.00th=[90702], 99.50th=[90702], 99.90th=[90702], 99.95th=[90702], | 99.99th=[90702] bw ( KiB/s): min= 1841, max= 2043, per=29.84%, avg=1942.00, stdev=142.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3254KiB/s (3332kB/s)(10.0MiB/3147msec); 0 zone resets clat (msec): min=157, max=494, avg=302.10, stdev=119.53 lat (msec): min=158, max=494, avg=302.29, stdev=119.36 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 226], 50.00th=[ 228], 60.00th=[ 292], | 70.00th=[ 321], 80.00th=[ 409], 90.00th=[ 477], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2043, max= 4096, per=40.38%, avg=3678.80, stdev=914.55, samples=5 iops : min= 1, max= 4, avg= 3.20, stdev= 1.30, samples=5 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=23.46%, ctx=185, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186534: Tue Jun 16 10:46:30 2026 read: IOPS=2, BW=2795KiB/s (2862kB/s)(6144KiB/2198msec) clat (usec): min=356, max=214731, avg=82440.78, stdev=94647.95 lat (usec): min=356, max=214733, avg=82442.02, stdev=94648.16 clat percentiles (usec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 453], | 30.00th=[ 453], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[121111], | 70.00th=[158335], 80.00th=[158335], 90.00th=[214959], 95.00th=[214959], | 99.00th=[214959], 99.50th=[214959], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 4063, max= 6131, per=78.33%, avg=5097.00, stdev=1462.30, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2795KiB/s (2862kB/s)(6144KiB/2198msec); 0 zone resets clat (msec): min=113, max=677, avg=274.99, stdev=206.84 lat (msec): min=113, max=677, avg=275.05, stdev=206.86 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 124], | 30.00th=[ 124], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 247], | 70.00th=[ 251], 80.00th=[ 251], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2031, max= 4087, per=35.60%, avg=3243.00, stdev=1076.27, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 250=58.33%, 500=8.33%, 750=8.33% cpu : usr=0.05%, sys=19.89%, ctx=146, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186535: Tue Jun 16 10:46:30 2026 read: IOPS=2, BW=2833KiB/s (2901kB/s)(5120KiB/1807msec) clat (usec): min=376, max=189603, avg=66085.12, stdev=91541.56 lat (usec): min=376, max=189604, avg=66086.18, stdev=91541.70 clat percentiles (usec): | 1.00th=[ 375], 5.00th=[ 375], 10.00th=[ 375], 20.00th=[ 375], | 30.00th=[ 519], 40.00th=[ 519], 50.00th=[ 627], 60.00th=[ 627], | 70.00th=[139461], 80.00th=[139461], 90.00th=[189793], 95.00th=[189793], | 99.00th=[189793], 99.50th=[189793], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=3, BW=3967KiB/s (4062kB/s)(7168KiB/1807msec); 0 zone resets clat (msec): min=130, max=305, avg=204.79, stdev=70.17 lat (msec): min=130, max=306, avg=204.88, stdev=70.19 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 133], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 197], 60.00th=[ 234], | 70.00th=[ 234], 80.00th=[ 279], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1831, max= 6095, per=36.49%, avg=3324.67, stdev=2401.63, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=58.33%, 500=16.67% cpu : usr=0.00%, sys=33.72%, ctx=165, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6508KiB/s (6664kB/s), 651KiB/s-3661KiB/s (666kB/s-3749kB/s), io=20.0MiB (20.0MB), run=1807-3147msec WRITE: bw=9111KiB/s (9330kB/s), 2615KiB/s-3967KiB/s (2678kB/s-4062kB/s), io=28.0MiB (29.4MB), run=1807-3147msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186537: Tue Jun 16 10:46:30 2026 read: IOPS=2, BW=2600KiB/s (2662kB/s)(7168KiB/2757msec) clat (msec): min=50, max=676, avg=215.49, stdev=239.96 lat (msec): min=50, max=676, avg=215.49, stdev=239.96 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 51], 10.00th=[ 51], 20.00th=[ 55], | 30.00th=[ 68], 40.00th=[ 68], 50.00th=[ 103], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 418], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2043, max= 4071, per=44.15%, avg=3042.25, stdev=1151.25, samples=4 iops : min= 1, max= 3, avg= 2.25, stdev= 0.96, samples=4 write: IOPS=1, BW=1857KiB/s (1902kB/s)(5120KiB/2757msec); 0 zone resets clat (msec): min=100, max=351, avg=239.15, stdev=116.70 lat (msec): min=100, max=351, avg=239.24, stdev=116.70 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 101], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2039, max= 6144, per=42.41%, avg=4091.50, stdev=2902.67, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=10.67%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186538: Tue Jun 16 10:46:30 2026 read: IOPS=0, BW=689KiB/s (706kB/s)(2048KiB/2972msec) clat (msec): min=90, max=431, avg=260.89, stdev=241.51 lat (msec): min=90, max=431, avg=260.89, stdev=241.51 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 430], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 1426, max= 2048, per=25.21%, avg=1737.00, stdev=439.82, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=3, BW=3445KiB/s (3528kB/s)(10.0MiB/2972msec); 0 zone resets clat (msec): min=82, max=763, avg=242.89, stdev=211.54 lat (msec): min=82, max=763, avg=243.02, stdev=211.58 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 86], | 30.00th=[ 109], 40.00th=[ 115], 50.00th=[ 126], 60.00th=[ 161], | 70.00th=[ 284], 80.00th=[ 326], 90.00th=[ 376], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2007, max= 6144, per=36.99%, avg=3568.50, stdev=1977.03, samples=4 iops : min= 1, max= 6, avg= 3.00, stdev= 2.45, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=9.56%, ctx=105, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186539: Tue Jun 16 10:46:30 2026 read: IOPS=2, BW=2300KiB/s (2355kB/s)(6144KiB/2671msec) clat (msec): min=68, max=295, avg=153.46, stdev=86.99 lat (msec): min=68, max=295, avg=153.46, stdev=86.99 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 124], 50.00th=[ 124], 60.00th=[ 129], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 4015, max= 4096, per=58.86%, avg=4055.50, stdev=57.28, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2300KiB/s (2355kB/s)(6144KiB/2671msec); 0 zone resets clat (msec): min=93, max=528, avg=285.21, stdev=166.83 lat (msec): min=93, max=528, avg=285.37, stdev=166.86 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 317], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 2007, max= 2782, per=23.62%, avg=2279.00, stdev=436.09, samples=3 iops : min= 1, max= 2, avg= 1.67, stdev= 0.58, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.11%, sys=9.25%, ctx=183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186540: Tue Jun 16 10:46:30 2026 read: IOPS=1, BW=1809KiB/s (1853kB/s)(5120KiB/2830msec) clat (msec): min=56, max=638, avg=195.26, stdev=248.37 lat (msec): min=56, max=638, avg=195.26, stdev=248.37 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 57], | 30.00th=[ 80], 40.00th=[ 80], 50.00th=[ 92], 60.00th=[ 92], | 70.00th=[ 112], 80.00th=[ 112], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 4055, max= 4096, per=59.15%, avg=4075.50, stdev=28.99, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2533KiB/s (2594kB/s)(7168KiB/2830msec); 0 zone resets clat (msec): min=101, max=431, avg=260.63, stdev=108.58 lat (msec): min=101, max=431, avg=260.71, stdev=108.59 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 201], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 236], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 363], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2007, max= 4096, per=28.36%, avg=2735.75, stdev=981.44, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 lat (msec) : 100=25.00%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.07%, sys=7.39%, ctx=89, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6891KiB/s (7056kB/s), 689KiB/s-2600KiB/s (706kB/s-2662kB/s), io=20.0MiB (20.0MB), run=2671-2972msec WRITE: bw=9647KiB/s (9879kB/s), 1857KiB/s-3445KiB/s (1902kB/s-3528kB/s), io=28.0MiB (29.4MB), run=2671-2972msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=186546: Tue Jun 16 10:46:40 2026 read: IOPS=1, BW=7010KiB/s (7178kB/s)(12.0MiB/1753msec) clat (msec): min=184, max=813, avg=564.20, stdev=334.09 lat (msec): min=184, max=813, avg=564.20, stdev=334.09 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 5876, max= 8015, per=93.02%, avg=6945.50, stdev=1512.50, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.88%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186547: Tue Jun 16 10:46:40 2026 read: IOPS=0, BW=1867KiB/s (1912kB/s)(4096KiB/2194msec) clat (nsec): min=636321k, max=636321k, avg=636320657.00, stdev= 0.00 lat (nsec): min=636323k, max=636323k, avg=636323477.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3734KiB/s (3823kB/s)(8192KiB/2194msec); 0 zone resets clat (msec): min=568, max=913, avg=740.63, stdev=244.03 lat (msec): min=568, max=913, avg=741.22, stdev=244.34 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 911], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8126, max= 8126, per=54.41%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.11%, ctx=49, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186550: Tue Jun 16 10:46:40 2026 write: IOPS=1, BW=6253KiB/s (6404kB/s)(12.0MiB/1965msec); 0 zone resets clat (msec): min=318, max=797, avg=601.89, stdev=251.43 lat (msec): min=319, max=798, avg=602.48, stdev=251.43 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 8015, max= 8126, per=54.04%, avg=8070.50, stdev=78.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.05%, sys=8.96%, ctx=92, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186552: Tue Jun 16 10:46:40 2026 write: IOPS=1, BW=6568KiB/s (6725kB/s)(12.0MiB/1871msec); 0 zone resets clat (msec): min=204, max=1196, avg=598.63, stdev=526.08 lat (msec): min=205, max=1196, avg=599.21, stdev=525.99 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7801, max= 8159, per=53.43%, avg=7980.00, stdev=253.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.81%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7468KiB/s (7647kB/s), 1867KiB/s-7010KiB/s (1912kB/s-7178kB/s), io=16.0MiB (16.8MB), run=1753-2194msec WRITE: bw=14.6MiB/s (15.3MB/s), 3734KiB/s-6568KiB/s (3823kB/s-6725kB/s), io=32.0MiB (33.6MB), run=1871-2194msec rand-rw: (groupid=0, jobs=1): err= 0: pid=186548: Tue Jun 16 10:46:40 2026 read: IOPS=1, BW=6693KiB/s (6853kB/s)(12.0MiB/1836msec) clat (msec): min=528, max=653, avg=587.68, stdev=62.71 lat (msec): min=528, max=653, avg=587.68, stdev=62.71 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 6470, max= 8192, per=86.41%, avg=7331.00, stdev=1217.64, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=21.09%, ctx=573, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186549: Tue Jun 16 10:46:40 2026 read: IOPS=0, BW=2121KiB/s (2172kB/s)(4096KiB/1931msec) clat (nsec): min=482291k, max=482291k, avg=482291239.00, stdev= 0.00 lat (nsec): min=482311k, max=482311k, avg=482310829.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 6481, max= 6481, per=76.39%, avg=6481.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4242KiB/s (4344kB/s)(8192KiB/1931msec); 0 zone resets clat (msec): min=403, max=922, avg=663.44, stdev=367.01 lat (msec): min=404, max=923, avg=663.89, stdev=367.14 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8192, max= 8192, per=53.15%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 1000=33.33% cpu : usr=0.05%, sys=9.43%, ctx=440, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186551: Tue Jun 16 10:46:40 2026 write: IOPS=1, BW=5780KiB/s (5919kB/s)(12.0MiB/2126msec); 0 zone resets clat (msec): min=138, max=924, avg=631.29, stdev=428.99 lat (msec): min=139, max=924, avg=631.63, stdev=429.04 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8175, max= 8192, per=53.10%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 1000=66.67% cpu : usr=0.00%, sys=7.34%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=186553: Tue Jun 16 10:46:40 2026 write: IOPS=1, BW=6498KiB/s (6654kB/s)(12.0MiB/1891msec); 0 zone resets clat (msec): min=340, max=1012, avg=573.80, stdev=380.42 lat (msec): min=340, max=1013, avg=574.21, stdev=380.43 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 6606, max= 8192, per=48.01%, avg=7399.00, stdev=1121.47, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.73%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8485KiB/s (8688kB/s), 2121KiB/s-6693KiB/s (2172kB/s-6853kB/s), io=16.0MiB (16.8MB), run=1836-1931msec WRITE: bw=15.1MiB/s (15.8MB/s), 4242KiB/s-6498KiB/s (4344kB/s-6654kB/s), io=32.0MiB (33.6MB), run=1891-2126msec