== sanity test 398b: DIO and buffer IO race ============== 20:03:57 (1787875437) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.71979 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179521: Thu Aug 27 20:06:17 2026 read: IOPS=12, BW=51.4KiB/s (52.6kB/s)(5992KiB/116685msec) clat (usec): min=21, max=863075, avg=43218.85, stdev=35811.89 lat (usec): min=21, max=863076, avg=43220.20, stdev=35811.91 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 10814], 10.00th=[ 17171], 20.00th=[ 21627], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[158335], 99.50th=[177210], 99.90th=[242222], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 111, per=24.99%, avg=50.97, stdev=19.82, samples=229 iops : min= 1, max= 27, avg=12.10, stdev= 5.00, samples=229 write: IOPS=13, BW=53.0KiB/s (55.3kB/s)(6296KiB/116685msec); 0 zone resets clat (usec): min=825, max=201591, avg=32892.84, stdev=33943.60 lat (usec): min=826, max=201592, avg=32919.20, stdev=33934.50 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1516], 20.00th=[ 3228], | 30.00th=[ 6521], 40.00th=[ 14877], 50.00th=[ 23987], 60.00th=[ 30802], | 70.00th=[ 42730], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[145753], 99.50th=[160433], 99.90th=[181404], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 7, max= 134, per=25.15%, avg=53.56, stdev=22.56, samples=229 iops : min= 1, max= 33, avg=12.76, stdev= 5.68, samples=229 lat (usec) : 50=0.16%, 100=1.46%, 250=0.07%, 500=0.10%, 1000=0.23% lat (msec) : 2=6.90%, 4=4.82%, 10=6.77%, 20=10.64%, 50=41.08% lat (msec) : 100=23.01%, 250=4.72%, 1000=0.03% cpu : usr=0.08%, sys=5.26%, ctx=6348, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179522: Thu Aug 27 20:06:17 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(5940KiB/117334msec) clat (usec): min=38, max=877131, avg=43760.73, stdev=34807.82 lat (usec): min=38, max=877134, avg=43768.61, stdev=34806.51 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12125], 10.00th=[ 16909], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 44303], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[145753], 99.50th=[166724], 99.90th=[214959], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 127, per=24.67%, avg=50.33, stdev=19.13, samples=231 iops : min= 1, max= 31, avg=11.95, stdev= 4.81, samples=231 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6348KiB/117334msec); 0 zone resets clat (usec): min=970, max=217131, avg=32883.62, stdev=33402.77 lat (usec): min=972, max=217133, avg=32885.65, stdev=33402.52 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1237], 10.00th=[ 1565], 20.00th=[ 3326], | 30.00th=[ 7111], 40.00th=[ 15664], 50.00th=[ 23987], 60.00th=[ 32637], | 70.00th=[ 44827], 80.00th=[ 57934], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[139461], 99.50th=[177210], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 7, max= 142, per=25.25%, avg=53.79, stdev=21.92, samples=231 iops : min= 1, max= 35, avg=12.83, stdev= 5.55, samples=231 lat (usec) : 50=0.26%, 100=1.24%, 250=0.07%, 500=0.07%, 1000=0.07% lat (msec) : 2=6.54%, 4=4.98%, 10=6.22%, 20=11.49%, 50=41.28% lat (msec) : 100=23.47%, 250=4.30%, 1000=0.03% cpu : usr=0.08%, sys=5.25%, ctx=6445, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179523: Thu Aug 27 20:06:17 2026 read: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6028KiB/114809msec) clat (usec): min=40, max=214219, avg=41184.74, stdev=26000.35 lat (usec): min=40, max=214221, avg=41188.16, stdev=25999.59 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10290], 10.00th=[ 16188], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 30802], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[127402], 99.50th=[149947], 99.90th=[198181], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 15, max= 104, per=25.73%, avg=52.48, stdev=18.94, samples=225 iops : min= 3, max= 26, avg=12.48, stdev= 4.79, samples=225 write: IOPS=13, BW=54.5KiB/s (55.8kB/s)(6260KiB/114809msec); 0 zone resets clat (usec): min=866, max=950107, avg=33603.06, stdev=39522.48 lat (usec): min=868, max=950109, avg=33605.07, stdev=39522.52 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1582], 20.00th=[ 3621], | 30.00th=[ 7439], 40.00th=[ 18482], 50.00th=[ 25560], 60.00th=[ 33162], | 70.00th=[ 43254], 80.00th=[ 56886], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[137364], 99.50th=[152044], 99.90th=[177210], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 135, per=25.45%, avg=54.20, stdev=22.95, samples=226 iops : min= 1, max= 33, avg=12.92, stdev= 5.80, samples=226 lat (usec) : 50=0.29%, 100=1.33%, 250=0.20%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=6.41%, 4=4.62%, 10=6.25%, 20=10.74%, 50=43.00% lat (msec) : 100=23.01%, 250=3.84%, 1000=0.03% cpu : usr=0.09%, sys=5.17%, ctx=6326, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179524: Thu Aug 27 20:06:17 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6052KiB/117544msec) clat (usec): min=39, max=231307, avg=42203.54, stdev=26955.90 lat (usec): min=39, max=231308, avg=42204.87, stdev=26955.89 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 10421], 10.00th=[ 16057], 20.00th=[ 21627], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[130548], 99.50th=[160433], 99.90th=[227541], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 7, max= 103, per=25.14%, avg=51.28, stdev=18.84, samples=230 iops : min= 1, max= 25, avg=12.19, stdev= 4.75, samples=230 write: IOPS=13, BW=53.1KiB/s (54.3kB/s)(6236KiB/117544msec); 0 zone resets clat (usec): min=648, max=952754, avg=34319.69, stdev=42784.42 lat (usec): min=649, max=952756, avg=34325.41, stdev=42785.99 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1467], 20.00th=[ 3294], | 30.00th=[ 6587], 40.00th=[ 14746], 50.00th=[ 23200], 60.00th=[ 31589], | 70.00th=[ 43779], 80.00th=[ 57934], 90.00th=[ 83362], 95.00th=[106431], | 99.00th=[152044], 99.50th=[198181], 99.90th=[217056], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 127, per=24.67%, avg=52.55, stdev=21.82, samples=231 iops : min= 1, max= 31, avg=12.51, stdev= 5.50, samples=231 lat (usec) : 50=0.20%, 100=1.63%, 250=0.10%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.97%, 4=4.52%, 10=6.45%, 20=11.75%, 50=40.62% lat (msec) : 100=22.75%, 250=4.82%, 1000=0.03% cpu : usr=0.09%, sys=5.20%, ctx=6380, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=204KiB/s (209kB/s), 50.6KiB/s-52.5KiB/s (51.8kB/s-53.8kB/s), io=23.4MiB (24.6MB), run=114809-117544msec WRITE: bw=214KiB/s (219kB/s), 53.1KiB/s-54.5KiB/s (54.3kB/s-55.8kB/s), io=24.6MiB (25.7MB), run=114809-117544msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179516: Thu Aug 27 20:06:56 2026 read: IOPS=9, BW=38.1KiB/s (39.0kB/s)(5992KiB/157182msec) clat (msec): min=4, max=938, avg=41.17, stdev=43.06 lat (msec): min=4, max=938, avg=41.18, stdev=43.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 91], 95.00th=[ 126], | 99.00th=[ 176], 99.50th=[ 190], 99.90th=[ 245], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 160, per=25.36%, avg=38.54, stdev=27.05, samples=303 iops : min= 1, max= 40, avg= 8.98, stdev= 6.82, samples=303 write: IOPS=10, BW=40.1KiB/s (41.0kB/s)(6296KiB/157182msec); 0 zone resets clat (msec): min=8, max=414, avg=60.44, stdev=43.63 lat (msec): min=8, max=414, avg=60.44, stdev=43.63 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 90], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 239], 99.90th=[ 342], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 7, max= 127, per=25.23%, avg=40.12, stdev=24.65, samples=306 iops : min= 1, max= 31, avg= 9.37, stdev= 6.22, samples=306 lat (msec) : 10=3.26%, 20=17.64%, 50=43.36%, 100=23.86%, 250=11.65% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.05%, sys=1.80%, ctx=4721, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179517: Thu Aug 27 20:06:56 2026 read: IOPS=9, BW=38.0KiB/s (38.9kB/s)(5940KiB/156231msec) clat (msec): min=4, max=976, avg=40.91, stdev=43.21 lat (msec): min=4, max=976, avg=40.91, stdev=43.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 87], 95.00th=[ 113], | 99.00th=[ 182], 99.50th=[ 194], 99.90th=[ 334], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 168, per=25.45%, avg=38.69, stdev=26.33, samples=299 iops : min= 1, max= 42, avg= 9.02, stdev= 6.66, samples=299 write: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6348KiB/156231msec); 0 zone resets clat (msec): min=11, max=318, avg=59.90, stdev=40.90 lat (msec): min=11, max=318, avg=59.90, stdev=40.90 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 87], 90.00th=[ 115], 95.00th=[ 144], | 99.00th=[ 197], 99.50th=[ 239], 99.90th=[ 305], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 131, per=25.43%, avg=40.44, stdev=23.87, samples=306 iops : min= 1, max= 32, avg= 9.45, stdev= 6.02, samples=306 lat (msec) : 10=3.45%, 20=14.97%, 50=44.95%, 100=25.65%, 250=10.74% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.06%, sys=1.81%, ctx=4668, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179518: Thu Aug 27 20:06:56 2026 read: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6028KiB/156406msec) clat (msec): min=5, max=271, avg=41.53, stdev=37.66 lat (msec): min=5, max=271, avg=41.53, stdev=37.66 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 96], 95.00th=[ 124], | 99.00th=[ 178], 99.50th=[ 203], 99.90th=[ 264], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 152, per=25.75%, avg=39.14, stdev=25.62, samples=300 iops : min= 1, max= 38, avg= 9.12, stdev= 6.44, samples=300 write: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6260KiB/156406msec); 0 zone resets clat (msec): min=7, max=1025, avg=59.72, stdev=48.15 lat (msec): min=7, max=1025, avg=59.73, stdev=48.15 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 414], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 147, per=25.11%, avg=39.93, stdev=26.10, samples=305 iops : min= 1, max= 36, avg= 9.32, stdev= 6.58, samples=305 lat (msec) : 10=2.99%, 20=17.22%, 50=43.46%, 100=24.38%, 250=11.72% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.07%, sys=1.85%, ctx=4756, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179520: Thu Aug 27 20:06:56 2026 read: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6052KiB/157339msec) clat (msec): min=4, max=274, avg=41.20, stdev=36.04 lat (msec): min=4, max=274, avg=41.20, stdev=36.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 89], 95.00th=[ 121], | 99.00th=[ 180], 99.50th=[ 192], 99.90th=[ 232], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 7, max= 198, per=25.75%, avg=39.13, stdev=27.16, samples=301 iops : min= 1, max= 49, avg= 9.12, stdev= 6.82, samples=301 write: IOPS=9, BW=39.6KiB/s (40.6kB/s)(6236KiB/157339msec); 0 zone resets clat (msec): min=8, max=1011, avg=60.72, stdev=50.15 lat (msec): min=8, max=1011, avg=60.72, stdev=50.15 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 117], 95.00th=[ 144], | 99.00th=[ 224], 99.50th=[ 279], 99.90th=[ 388], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 131, per=24.67%, avg=39.22, stdev=24.95, samples=309 iops : min= 1, max= 32, avg= 9.15, stdev= 6.30, samples=309 lat (msec) : 10=3.03%, 20=16.44%, 50=43.98%, 100=24.90%, 250=11.33% lat (msec) : 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=1.81%, ctx=4799, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=153KiB/s (156kB/s), 38.0KiB/s-38.5KiB/s (38.9kB/s-39.5kB/s), io=23.4MiB (24.6MB), run=156231-157339msec WRITE: bw=160KiB/s (164kB/s), 39.6KiB/s-40.6KiB/s (40.6kB/s-41.6kB/s), io=24.6MiB (25.7MB), run=156231-157339msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179565: Thu Aug 27 20:07:33 2026 read: IOPS=13, BW=221KiB/s (226kB/s)(5920KiB/26793msec) clat (usec): min=23, max=240744, avg=38269.91, stdev=30032.98 lat (usec): min=23, max=240746, avg=38270.92, stdev=30032.98 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 709], 20.00th=[ 18482], | 30.00th=[ 23987], 40.00th=[ 28181], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 44303], 80.00th=[ 52167], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[160433], 99.50th=[212861], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 63, max= 608, per=25.67%, avg=221.56, stdev=87.07, samples=52 iops : min= 3, max= 38, avg=13.15, stdev= 5.55, samples=52 write: IOPS=14, BW=238KiB/s (243kB/s)(6368KiB/26793msec); 0 zone resets clat (usec): min=1201, max=150827, avg=31420.27, stdev=31788.86 lat (usec): min=1202, max=150829, avg=31423.17, stdev=31788.48 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 2802], 20.00th=[ 4555], | 30.00th=[ 7635], 40.00th=[ 14353], 50.00th=[ 21890], 60.00th=[ 29754], | 70.00th=[ 40633], 80.00th=[ 53216], 90.00th=[ 72877], 95.00th=[104334], | 99.00th=[137364], 99.50th=[147850], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 93, max= 476, per=26.42%, avg=239.90, stdev=97.31, samples=52 iops : min= 5, max= 29, avg=14.31, stdev= 6.18, samples=52 lat (usec) : 50=1.04%, 100=2.86%, 250=0.65%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.47%, 4=6.64%, 10=8.59%, 20=12.24%, 50=42.71% lat (msec) : 100=17.97%, 250=4.43% cpu : usr=0.06%, sys=7.20%, ctx=1788, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179566: Thu Aug 27 20:07:33 2026 read: IOPS=13, BW=215KiB/s (221kB/s)(5744KiB/26667msec) clat (usec): min=51, max=212576, avg=39112.35, stdev=28729.94 lat (usec): min=52, max=212578, avg=39113.37, stdev=28729.98 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 11863], 20.00th=[ 19792], | 30.00th=[ 23725], 40.00th=[ 28443], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 46400], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 91751], | 99.00th=[152044], 99.50th=[166724], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 383, per=24.86%, avg=214.58, stdev=83.76, samples=52 iops : min= 1, max= 23, avg=12.71, stdev= 5.34, samples=52 write: IOPS=15, BW=245KiB/s (251kB/s)(6544KiB/26667msec); 0 zone resets clat (usec): min=1241, max=177991, avg=30629.36, stdev=30503.74 lat (usec): min=1242, max=177993, avg=30632.67, stdev=30504.73 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1909], 10.00th=[ 2933], 20.00th=[ 5211], | 30.00th=[ 9896], 40.00th=[ 14877], 50.00th=[ 21627], 60.00th=[ 28443], | 70.00th=[ 38536], 80.00th=[ 51119], 90.00th=[ 70779], 95.00th=[ 94897], | 99.00th=[135267], 99.50th=[139461], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 512, per=27.01%, avg=245.29, stdev=114.02, samples=52 iops : min= 1, max= 32, avg=14.65, stdev= 7.26, samples=52 lat (usec) : 100=3.26%, 250=0.52%, 500=0.13% lat (msec) : 2=3.26%, 4=4.30%, 10=8.72%, 20=14.71%, 50=42.19% lat (msec) : 100=18.88%, 250=4.04% cpu : usr=0.08%, sys=7.19%, ctx=1774, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179567: Thu Aug 27 20:07:33 2026 read: IOPS=14, BW=226KiB/s (231kB/s)(6256KiB/27740msec) clat (usec): min=31, max=171749, avg=39223.82, stdev=28395.91 lat (usec): min=31, max=171750, avg=39231.11, stdev=28396.44 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 67], 10.00th=[ 11731], 20.00th=[ 18482], | 30.00th=[ 23200], 40.00th=[ 27657], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 47449], 80.00th=[ 54789], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[135267], 99.50th=[158335], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 63, max= 480, per=26.23%, avg=226.37, stdev=94.78, samples=54 iops : min= 3, max= 30, avg=13.44, stdev= 6.05, samples=54 write: IOPS=13, BW=217KiB/s (223kB/s)(6032KiB/27740msec); 0 zone resets clat (usec): min=1483, max=157424, avg=32408.95, stdev=32763.01 lat (usec): min=1485, max=157425, avg=32428.50, stdev=32799.48 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1844], 10.00th=[ 2868], 20.00th=[ 5014], | 30.00th=[ 8455], 40.00th=[ 15270], 50.00th=[ 20841], 60.00th=[ 30278], | 70.00th=[ 39584], 80.00th=[ 55837], 90.00th=[ 79168], 95.00th=[107480], | 99.00th=[141558], 99.50th=[143655], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 63, max= 411, per=23.72%, avg=215.33, stdev=90.85, samples=54 iops : min= 3, max= 25, avg=12.74, stdev= 5.74, samples=54 lat (usec) : 50=0.52%, 100=3.52%, 250=0.13%, 500=0.13% lat (msec) : 2=3.39%, 4=4.17%, 10=8.85%, 20=14.97%, 50=40.10% lat (msec) : 100=18.75%, 250=5.47% cpu : usr=0.09%, sys=6.77%, ctx=1766, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179568: Thu Aug 27 20:07:33 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(6032KiB/25550msec) clat (usec): min=36, max=148103, avg=36652.35, stdev=26806.49 lat (usec): min=37, max=148104, avg=36653.48, stdev=26806.46 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 60], 10.00th=[ 82], 20.00th=[ 16450], | 30.00th=[ 21103], 40.00th=[ 25560], 50.00th=[ 32113], 60.00th=[ 37487], | 70.00th=[ 44827], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[123208], 99.50th=[147850], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 94, max= 509, per=27.23%, avg=235.02, stdev=90.56, samples=50 iops : min= 5, max= 31, avg=13.98, stdev= 5.73, samples=50 write: IOPS=15, BW=245KiB/s (251kB/s)(6256KiB/25550msec); 0 zone resets clat (usec): min=1046, max=176025, avg=29626.38, stdev=30417.29 lat (usec): min=1047, max=176025, avg=29628.26, stdev=30417.41 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 2008], 10.00th=[ 3032], 20.00th=[ 5473], | 30.00th=[ 8979], 40.00th=[ 13173], 50.00th=[ 17957], 60.00th=[ 25822], | 70.00th=[ 36439], 80.00th=[ 51119], 90.00th=[ 72877], 95.00th=[ 99091], | 99.00th=[131597], 99.50th=[139461], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 63, max= 473, per=27.05%, avg=245.62, stdev=99.53, samples=50 iops : min= 3, max= 29, avg=14.66, stdev= 6.34, samples=50 lat (usec) : 50=0.78%, 100=4.69%, 250=0.13%, 750=0.13% lat (msec) : 2=2.47%, 4=3.65%, 10=10.55%, 20=18.49%, 50=36.33% lat (msec) : 100=18.88%, 250=3.91% cpu : usr=0.08%, sys=7.32%, ctx=1729, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=863KiB/s (884kB/s), 215KiB/s-236KiB/s (221kB/s-242kB/s), io=23.4MiB (24.5MB), run=25550-27740msec WRITE: bw=908KiB/s (930kB/s), 217KiB/s-245KiB/s (223kB/s-251kB/s), io=24.6MiB (25.8MB), run=25550-27740msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179570: Thu Aug 27 20:07:45 2026 read: IOPS=9, BW=152KiB/s (156kB/s)(5920KiB/38983msec) clat (msec): min=7, max=213, avg=42.79, stdev=32.40 lat (msec): min=7, max=213, avg=42.79, stdev=32.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 60], 90.00th=[ 89], 95.00th=[ 112], | 99.00th=[ 148], 99.50th=[ 207], 99.90th=[ 213], 99.95th=[ 213], | 99.99th=[ 213] bw ( KiB/s): min= 31, max= 351, per=24.97%, avg=153.34, stdev=77.58, samples=76 iops : min= 1, max= 21, avg= 8.76, stdev= 4.87, samples=76 write: IOPS=10, BW=163KiB/s (167kB/s)(6368KiB/38983msec); 0 zone resets clat (msec): min=13, max=230, avg=58.01, stdev=35.51 lat (msec): min=13, max=230, avg=58.01, stdev=35.51 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 82], 90.00th=[ 108], 95.00th=[ 129], | 99.00th=[ 178], 99.50th=[ 222], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 63, max= 376, per=25.22%, avg=162.91, stdev=69.65, samples=77 iops : min= 3, max= 23, avg= 9.36, stdev= 4.37, samples=77 lat (msec) : 10=0.78%, 20=11.72%, 50=50.52%, 100=27.34%, 250=9.64% cpu : usr=0.07%, sys=2.25%, ctx=1173, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179571: Thu Aug 27 20:07:45 2026 read: IOPS=9, BW=148KiB/s (151kB/s)(5744KiB/38884msec) clat (msec): min=6, max=226, avg=42.87, stdev=35.42 lat (msec): min=6, max=226, avg=42.87, stdev=35.42 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 91], 95.00th=[ 109], | 99.00th=[ 186], 99.50th=[ 222], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 383, per=24.18%, avg=148.45, stdev=77.45, samples=75 iops : min= 1, max= 23, avg= 8.45, stdev= 4.86, samples=75 write: IOPS=10, BW=168KiB/s (172kB/s)(6544KiB/38884msec); 0 zone resets clat (msec): min=10, max=315, avg=57.29, stdev=36.51 lat (msec): min=10, max=315, avg=57.29, stdev=36.51 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 103], 95.00th=[ 124], | 99.00th=[ 184], 99.50th=[ 236], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 350, per=25.78%, avg=166.57, stdev=77.98, samples=76 iops : min= 1, max= 21, avg= 9.61, stdev= 4.88, samples=76 lat (msec) : 10=0.52%, 20=14.06%, 50=48.18%, 100=27.99%, 250=9.11% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=2.16%, ctx=1092, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179572: Thu Aug 27 20:07:45 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38770msec) clat (msec): min=7, max=256, avg=40.55, stdev=30.48 lat (msec): min=7, max=256, avg=40.55, stdev=30.49 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 80], 95.00th=[ 106], | 99.00th=[ 142], 99.50th=[ 176], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 383, per=26.35%, avg=161.78, stdev=89.39, samples=76 iops : min= 1, max= 23, avg= 9.29, stdev= 5.64, samples=76 write: IOPS=9, BW=156KiB/s (159kB/s)(6032KiB/38770msec); 0 zone resets clat (msec): min=11, max=249, avg=60.65, stdev=38.72 lat (msec): min=12, max=249, avg=60.66, stdev=38.72 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 84], 90.00th=[ 116], 95.00th=[ 146], | 99.00th=[ 180], 99.50th=[ 234], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 382, per=23.81%, avg=153.79, stdev=71.44, samples=76 iops : min= 1, max= 23, avg= 8.79, stdev= 4.47, samples=76 lat (msec) : 10=0.26%, 20=13.02%, 50=50.91%, 100=26.17%, 250=9.51% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.14%, ctx=1196, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179573: Thu Aug 27 20:07:45 2026 read: IOPS=9, BW=156KiB/s (160kB/s)(6032KiB/38546msec) clat (msec): min=7, max=204, avg=40.57, stdev=33.41 lat (msec): min=7, max=204, avg=40.60, stdev=33.41 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 84], 95.00th=[ 108], | 99.00th=[ 176], 99.50th=[ 197], 99.90th=[ 205], 99.95th=[ 205], | 99.99th=[ 205] bw ( KiB/s): min= 31, max= 351, per=25.27%, avg=155.18, stdev=85.86, samples=76 iops : min= 1, max= 21, avg= 8.88, stdev= 5.40, samples=76 write: IOPS=10, BW=162KiB/s (166kB/s)(6256KiB/38546msec); 0 zone resets clat (msec): min=15, max=316, avg=59.30, stdev=39.65 lat (msec): min=15, max=316, avg=59.30, stdev=39.65 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 56], | 70.00th=[ 67], 80.00th=[ 79], 90.00th=[ 105], 95.00th=[ 142], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 32, max= 351, per=25.11%, avg=162.24, stdev=74.39, samples=76 iops : min= 2, max= 21, avg= 9.32, stdev= 4.64, samples=76 lat (msec) : 10=0.91%, 20=13.67%, 50=49.35%, 100=26.95%, 250=8.98% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.30%, ctx=1217, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=614KiB/s (629kB/s), 148KiB/s-161KiB/s (151kB/s-165kB/s), io=23.4MiB (24.5MB), run=38546-38983msec WRITE: bw=646KiB/s (662kB/s), 156KiB/s-168KiB/s (159kB/s-172kB/s), io=24.6MiB (25.8MB), run=38546-38983msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179584: Thu Aug 27 20:07:58 2026 read: IOPS=3, BW=3156KiB/s (3232kB/s)(7168KiB/2271msec) clat (usec): min=697, max=357798, avg=151655.35, stdev=108246.35 lat (usec): min=698, max=357800, avg=151656.86, stdev=108246.41 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 93848], | 30.00th=[129500], 40.00th=[129500], 50.00th=[135267], 60.00th=[170918], | 70.00th=[170918], 80.00th=[175113], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 2007, max= 5204, per=67.65%, avg=3605.50, stdev=2260.62, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2255KiB/s (2309kB/s)(5120KiB/2271msec); 0 zone resets clat (msec): min=154, max=514, avg=235.72, stdev=156.04 lat (msec): min=154, max=514, avg=235.85, stdev=156.01 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 165], 40.00th=[ 165], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 176], 80.00th=[ 176], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 1301, max= 3908, per=34.90%, avg=2604.50, stdev=1843.43, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=66.67%, 500=8.33%, 750=8.33% cpu : usr=0.04%, sys=18.50%, ctx=244, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179585: Thu Aug 27 20:07:58 2026 read: IOPS=0, BW=533KiB/s (546kB/s)(2048KiB/3842msec) clat (msec): min=89, max=152, avg=121.14, stdev=44.33 lat (msec): min=89, max=152, avg=121.15, stdev=44.34 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 1311, max= 2011, per=31.16%, avg=1661.00, stdev=494.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2665KiB/s (2729kB/s)(10.0MiB/3842msec); 0 zone resets clat (msec): min=115, max=634, avg=351.09, stdev=194.71 lat (msec): min=115, max=634, avg=351.29, stdev=194.76 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 161], | 30.00th=[ 171], 40.00th=[ 186], 50.00th=[ 309], 60.00th=[ 321], | 70.00th=[ 498], 80.00th=[ 550], 90.00th=[ 558], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1311, max= 5862, per=35.46%, avg=2646.00, stdev=1823.81, samples=5 iops : min= 1, max= 5, avg= 1.80, stdev= 1.79, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=14.63%, ctx=139, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179586: Thu Aug 27 20:07:58 2026 read: IOPS=1, BW=1846KiB/s (1890kB/s)(6144KiB/3329msec) clat (usec): min=476, max=303600, avg=184565.19, stdev=101176.64 lat (usec): min=477, max=303602, avg=184566.59, stdev=101176.63 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[173016], | 30.00th=[173016], 40.00th=[185598], 50.00th=[185598], 60.00th=[212861], | 70.00th=[231736], 80.00th=[231736], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 3908, max= 4023, per=74.40%, avg=3965.50, stdev=81.32, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1846KiB/s (1890kB/s)(6144KiB/3329msec); 0 zone resets clat (msec): min=210, max=574, avg=355.43, stdev=161.54 lat (msec): min=210, max=575, avg=355.50, stdev=161.56 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 351], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1954, max= 2612, per=28.87%, avg=2154.00, stdev=307.51, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=8.33% lat (msec) : 250=58.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=12.56%, ctx=117, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179587: Thu Aug 27 20:07:58 2026 read: IOPS=1, BW=1775KiB/s (1818kB/s)(5120KiB/2884msec) clat (usec): min=500, max=181043, avg=49999.49, stdev=78763.71 lat (usec): min=501, max=181044, avg=50000.43, stdev=78763.56 clat percentiles (usec): | 1.00th=[ 502], 5.00th=[ 502], 10.00th=[ 502], 20.00th=[ 502], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 586], 60.00th=[ 586], | 70.00th=[ 67634], 80.00th=[ 67634], 90.00th=[181404], 95.00th=[181404], | 99.00th=[181404], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2485KiB/s (2545kB/s)(7168KiB/2884msec); 0 zone resets clat (msec): min=173, max=861, avg=365.34, stdev=228.18 lat (msec): min=173, max=861, avg=365.82, stdev=228.08 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 232], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 317], 60.00th=[ 334], | 70.00th=[ 334], 80.00th=[ 363], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2007, max= 6131, per=42.91%, avg=3202.00, stdev=1976.56, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 lat (usec) : 750=25.00% lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 1000=8.33% cpu : usr=0.00%, sys=12.31%, ctx=128, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5331KiB/s (5458kB/s), 533KiB/s-3156KiB/s (546kB/s-3232kB/s), io=20.0MiB (20.0MB), run=2271-3842msec WRITE: bw=7463KiB/s (7642kB/s), 1846KiB/s-2665KiB/s (1890kB/s-2729kB/s), io=28.0MiB (29.4MB), run=2271-3842msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179589: Thu Aug 27 20:07:58 2026 read: IOPS=2, BW=2117KiB/s (2168kB/s)(7168KiB/3386msec) clat (msec): min=89, max=535, avg=291.93, stdev=177.58 lat (msec): min=89, max=535, avg=291.93, stdev=177.58 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 97], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 342], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 456], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1488, max= 4079, per=54.87%, avg=2902.25, stdev=1352.24, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1512KiB/s (1548kB/s)(5120KiB/3386msec); 0 zone resets clat (msec): min=72, max=465, avg=256.79, stdev=183.32 lat (msec): min=73, max=466, avg=256.89, stdev=183.32 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2003, max= 4071, per=36.38%, avg=2693.67, stdev=1192.81, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=8.33%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=4.02%, ctx=58, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179590: Thu Aug 27 20:07:58 2026 read: IOPS=0, BW=531KiB/s (544kB/s)(2048KiB/3855msec) clat (msec): min=91, max=626, avg=359.03, stdev=377.77 lat (msec): min=91, max=626, avg=359.03, stdev=377.77 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 92], | 30.00th=[ 92], 40.00th=[ 92], 50.00th=[ 92], 60.00th=[ 625], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2019, max= 2035, per=38.32%, avg=2027.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2656KiB/s (2720kB/s)(10.0MiB/3855msec); 0 zone resets clat (msec): min=130, max=739, avg=309.28, stdev=193.65 lat (msec): min=130, max=739, avg=309.38, stdev=193.66 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 132], | 30.00th=[ 180], 40.00th=[ 188], 50.00th=[ 239], 60.00th=[ 249], | 70.00th=[ 351], 80.00th=[ 372], 90.00th=[ 518], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 2003, max= 6071, per=41.00%, avg=3035.67, stdev=1700.66, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=25.00% cpu : usr=0.08%, sys=6.18%, ctx=124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179591: Thu Aug 27 20:07:58 2026 read: IOPS=1, BW=1597KiB/s (1635kB/s)(6144KiB/3848msec) clat (msec): min=39, max=811, avg=288.50, stdev=274.95 lat (msec): min=39, max=811, avg=288.50, stdev=274.95 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 40], 10.00th=[ 40], 20.00th=[ 95], | 30.00th=[ 95], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 253], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2003, max= 2039, per=38.22%, avg=2021.40, stdev=16.15, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1597KiB/s (1635kB/s)(6144KiB/3848msec); 0 zone resets clat (msec): min=111, max=632, avg=350.51, stdev=181.50 lat (msec): min=111, max=633, avg=351.21, stdev=181.28 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 309], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2007, max= 4047, per=40.95%, avg=3032.00, stdev=1167.46, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 50=8.33%, 100=8.33%, 250=16.67%, 500=50.00%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.05%, sys=4.19%, ctx=89, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179592: Thu Aug 27 20:07:58 2026 read: IOPS=1, BW=1322KiB/s (1354kB/s)(5120KiB/3872msec) clat (msec): min=108, max=489, avg=244.42, stdev=160.56 lat (msec): min=108, max=489, avg=244.42, stdev=160.56 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 114], 40.00th=[ 114], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 2035, max= 6011, per=76.06%, avg=4023.00, stdev=2811.46, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1851KiB/s (1896kB/s)(7168KiB/3872msec); 0 zone resets clat (msec): min=68, max=654, avg=368.80, stdev=240.61 lat (msec): min=68, max=654, avg=368.97, stdev=240.54 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 94], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 456], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 617], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 4039, max= 4079, per=54.77%, avg=4055.00, stdev=21.17, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=4.29%, ctx=110, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5289KiB/s (5416kB/s), 531KiB/s-2117KiB/s (544kB/s-2168kB/s), io=20.0MiB (20.0MB), run=3386-3872msec WRITE: bw=7405KiB/s (7583kB/s), 1512KiB/s-2656KiB/s (1548kB/s-2720kB/s), io=28.0MiB (29.4MB), run=3386-3872msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179600: Thu Aug 27 20:08:12 2026 read: IOPS=1, BW=4842KiB/s (4958kB/s)(12.0MiB/2538msec) clat (msec): min=377, max=1086, avg=836.67, stdev=398.22 lat (msec): min=377, max=1086, avg=836.68, stdev=398.22 clat percentiles (msec): | 1.00th=[ 376], 5.00th=[ 376], 10.00th=[ 376], 20.00th=[ 376], | 30.00th=[ 376], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8078, max= 8192, per=100.00%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.74%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179601: Thu Aug 27 20:08:12 2026 read: IOPS=0, BW=1563KiB/s (1600kB/s)(4096KiB/2621msec) clat (nsec): min=242867k, max=242867k, avg=242867244.00, stdev= 0.00 lat (nsec): min=242869k, max=242869k, avg=242869492.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 7223, max= 7223, per=100.00%, avg=7223.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3126KiB/s (3201kB/s)(8192KiB/2621msec); 0 zone resets clat (msec): min=1130, max=1204, avg=1167.56, stdev=51.80 lat (msec): min=1131, max=1204, avg=1168.03, stdev=51.75 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8126, max= 8126, per=79.14%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.28%, ctx=42, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179602: Thu Aug 27 20:08:12 2026 write: IOPS=0, BW=3851KiB/s (3943kB/s)(12.0MiB/3191msec); 0 zone resets clat (msec): min=372, max=2131, avg=1046.93, stdev=948.85 lat (msec): min=372, max=2132, avg=1047.91, stdev=948.47 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 5769, max= 5769, per=56.18%, avg=5769.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.82%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179603: Thu Aug 27 20:08:12 2026 write: IOPS=1, BW=4686KiB/s (4799kB/s)(12.0MiB/2622msec); 0 zone resets clat (msec): min=510, max=1283, avg=834.36, stdev=401.26 lat (msec): min=511, max=1284, avg=835.15, stdev=401.57 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1284], 80.00th=[ 1284], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 5970, max= 8110, per=68.56%, avg=7040.00, stdev=1513.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=4.96%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6251KiB/s (6401kB/s), 1563KiB/s-4842KiB/s (1600kB/s-4958kB/s), io=16.0MiB (16.8MB), run=2538-2621msec WRITE: bw=10.0MiB/s (10.5MB/s), 3126KiB/s-4686KiB/s (3201kB/s-4799kB/s), io=32.0MiB (33.6MB), run=2621-3191msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179604: Thu Aug 27 20:08:12 2026 read: IOPS=1, BW=6126KiB/s (6273kB/s)(12.0MiB/2006msec) clat (msec): min=572, max=701, avg=643.06, stdev=65.70 lat (msec): min=572, max=701, avg=643.07, stdev=65.70 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=17.51%, ctx=399, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179605: Thu Aug 27 20:08:12 2026 read: IOPS=0, BW=1383KiB/s (1417kB/s)(4096KiB/2961msec) clat (nsec): min=585297k, max=585297k, avg=585296644.00, stdev= 0.00 lat (nsec): min=585300k, max=585300k, avg=585300171.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2767KiB/s (2833kB/s)(8192KiB/2961msec); 0 zone resets clat (msec): min=840, max=1352, avg=1096.47, stdev=361.83 lat (msec): min=841, max=1352, avg=1096.91, stdev=361.86 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8175, max= 8175, per=73.87%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.99%, ctx=192, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179606: Thu Aug 27 20:08:12 2026 write: IOPS=1, BW=4184KiB/s (4284kB/s)(12.0MiB/2937msec); 0 zone resets clat (msec): min=294, max=1502, avg=961.23, stdev=613.75 lat (msec): min=294, max=1503, avg=961.99, stdev=614.20 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8143, max= 8175, per=73.73%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.41%, ctx=37, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179607: Thu Aug 27 20:08:12 2026 write: IOPS=1, BW=5352KiB/s (5480kB/s)(12.0MiB/2296msec); 0 zone resets clat (msec): min=171, max=1858, avg=754.69, stdev=956.82 lat (msec): min=175, max=1859, avg=756.41, stdev=955.66 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 234], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min=11441, max=11441, per=100.00%, avg=11441.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.66%, ctx=49, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5533KiB/s (5666kB/s), 1383KiB/s-6126KiB/s (1417kB/s-6273kB/s), io=16.0MiB (16.8MB), run=2006-2961msec WRITE: bw=10.8MiB/s (11.3MB/s), 2767KiB/s-5352KiB/s (2833kB/s-5480kB/s), io=32.0MiB (33.6MB), run=2296-2961msec