== sanity test 398b: DIO and buffer IO race ============== 23:54:13 (1788753253) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.15663 s, 6.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179992: Sun Sep 6 23:57:14 2026 read: IOPS=9, BW=38.9KiB/s (39.8kB/s)(5992KiB/154211msec) clat (usec): min=38, max=1138.8k, avg=56987.00, stdev=45275.99 lat (usec): min=39, max=1138.8k, avg=56993.58, stdev=45277.20 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12911], 10.00th=[ 20841], | 20.00th=[ 28443], 30.00th=[ 34866], 40.00th=[ 41681], | 50.00th=[ 50070], 60.00th=[ 57934], 70.00th=[ 68682], | 80.00th=[ 81265], 90.00th=[ 99091], 95.00th=[ 122160], | 99.00th=[ 183501], 99.50th=[ 210764], 99.90th=[ 263193], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=38.84, stdev=16.38, samples=300 iops : min= 1, max= 25, avg= 9.02, stdev= 4.12, samples=300 write: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6296KiB/154211msec); 0 zone resets clat (usec): min=808, max=275878, avg=43380.30, stdev=43024.94 lat (usec): min=809, max=275881, avg=43382.84, stdev=43025.69 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1319], 10.00th=[ 1663], 20.00th=[ 4883], | 30.00th=[ 9634], 40.00th=[ 21627], 50.00th=[ 33817], 60.00th=[ 43779], | 70.00th=[ 56361], 80.00th=[ 74974], 90.00th=[103285], 95.00th=[130548], | 99.00th=[185598], 99.50th=[212861], 99.90th=[270533], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 126, per=24.93%, avg=40.63, stdev=18.83, samples=301 iops : min= 1, max= 31, avg= 9.48, stdev= 4.76, samples=301 lat (usec) : 50=0.10%, 100=1.66%, 250=0.23%, 1000=0.13% lat (msec) : 2=5.63%, 4=3.52%, 10=6.35%, 20=6.77%, 50=33.40% lat (msec) : 100=31.71%, 250=10.35%, 500=0.13%, 2000=0.03% cpu : usr=0.08%, sys=4.06%, ctx=6492, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179993: Sun Sep 6 23:57:14 2026 read: IOPS=9, BW=38.5KiB/s (39.4kB/s)(5940KiB/154209msec) clat (usec): min=33, max=430458, avg=56664.84, stdev=38125.38 lat (usec): min=33, max=430459, avg=56671.24, stdev=38136.05 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12387], 10.00th=[ 20317], 20.00th=[ 28181], | 30.00th=[ 34866], 40.00th=[ 41681], 50.00th=[ 49021], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 82314], 90.00th=[102237], 95.00th=[120062], | 99.00th=[179307], 99.50th=[221250], 99.90th=[325059], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 6, max= 95, per=24.85%, avg=38.51, stdev=15.48, samples=300 iops : min= 1, max= 23, avg= 8.93, stdev= 3.89, samples=300 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6348KiB/154209msec); 0 zone resets clat (usec): min=760, max=1137.7k, avg=43757.82, stdev=51824.09 lat (usec): min=761, max=1137.7k, avg=43764.14, stdev=51825.42 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1303], 10.00th=[ 1598], | 20.00th=[ 4817], 30.00th=[ 9634], 40.00th=[ 21365], | 50.00th=[ 32375], 60.00th=[ 42206], 70.00th=[ 55837], | 80.00th=[ 74974], 90.00th=[ 103285], 95.00th=[ 131597], | 99.00th=[ 185598], 99.50th=[ 221250], 99.90th=[ 291505], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 143, per=25.50%, avg=41.56, stdev=18.91, samples=297 iops : min= 1, max= 35, avg= 9.72, stdev= 4.78, samples=297 lat (usec) : 50=0.10%, 100=1.86%, 250=0.13%, 500=0.03%, 1000=0.20% lat (msec) : 2=5.70%, 4=3.35%, 10=6.58%, 20=6.93%, 50=34.15% lat (msec) : 100=29.98%, 250=10.61%, 500=0.36%, 2000=0.03% cpu : usr=0.08%, sys=4.11%, ctx=6542, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179994: Sun Sep 6 23:57:14 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(6028KiB/152974msec) clat (usec): min=36, max=304408, avg=55442.05, stdev=35156.93 lat (usec): min=37, max=304409, avg=55445.07, stdev=35157.32 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 11338], 10.00th=[ 20579], 20.00th=[ 28443], | 30.00th=[ 34341], 40.00th=[ 41157], 50.00th=[ 47973], 60.00th=[ 56886], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[100140], 95.00th=[119014], | 99.00th=[166724], 99.50th=[200279], 99.90th=[265290], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 102, per=25.36%, avg=39.31, stdev=17.21, samples=298 iops : min= 1, max= 25, avg= 9.14, stdev= 4.34, samples=298 write: IOPS=10, BW=40.9KiB/s (41.9kB/s)(6260KiB/152974msec); 0 zone resets clat (usec): min=671, max=1214.6k, avg=43971.76, stdev=53016.80 lat (usec): min=672, max=1214.6k, avg=43982.09, stdev=53029.28 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1270], 10.00th=[ 1467], | 20.00th=[ 4146], 30.00th=[ 8848], 40.00th=[ 19268], | 50.00th=[ 31327], 60.00th=[ 42206], 70.00th=[ 57410], | 80.00th=[ 77071], 90.00th=[ 106431], 95.00th=[ 132645], | 99.00th=[ 187696], 99.50th=[ 212861], 99.90th=[ 256902], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 120, per=25.13%, avg=40.96, stdev=19.17, samples=297 iops : min= 1, max= 30, avg= 9.56, stdev= 4.83, samples=297 lat (usec) : 50=0.20%, 100=1.82%, 250=0.16%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.20% lat (msec) : 2=7.13%, 4=2.64%, 10=6.12%, 20=6.93%, 50=33.59% lat (msec) : 100=30.18%, 250=10.77%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=4.13%, ctx=6446, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179995: Sun Sep 6 23:57:14 2026 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(6052KiB/151406msec) clat (usec): min=41, max=251491, avg=55239.94, stdev=36066.89 lat (usec): min=42, max=251493, avg=55250.80, stdev=36067.20 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12256], 10.00th=[ 20579], 20.00th=[ 27657], | 30.00th=[ 34341], 40.00th=[ 40633], 50.00th=[ 47449], 60.00th=[ 56361], | 70.00th=[ 66323], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[120062], | 99.00th=[183501], 99.50th=[212861], 99.90th=[248513], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 7, max= 103, per=25.88%, avg=40.12, stdev=16.04, samples=293 iops : min= 1, max= 25, avg= 9.34, stdev= 4.05, samples=293 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6236KiB/151406msec); 0 zone resets clat (usec): min=823, max=1063.7k, avg=43042.04, stdev=50351.32 lat (usec): min=824, max=1063.7k, avg=43056.26, stdev=50348.39 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 1614], | 20.00th=[ 4621], 30.00th=[ 8586], 40.00th=[ 19530], | 50.00th=[ 31065], 60.00th=[ 42206], 70.00th=[ 55313], | 80.00th=[ 72877], 90.00th=[ 104334], 95.00th=[ 132645], | 99.00th=[ 185598], 99.50th=[ 210764], 99.90th=[ 227541], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 7, max= 118, per=25.08%, avg=40.88, stdev=19.70, samples=296 iops : min= 1, max= 29, avg= 9.54, stdev= 4.97, samples=296 lat (usec) : 50=0.10%, 100=1.86%, 250=0.20%, 1000=0.10% lat (msec) : 2=5.86%, 4=3.29%, 10=7.42%, 20=6.25%, 50=34.28% lat (msec) : 100=30.40%, 250=10.19%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=4.06%, ctx=6442, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (159kB/s), 38.5KiB/s-39.0KiB/s (39.4kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=151406-154211msec WRITE: bw=163KiB/s (167kB/s), 40.8KiB/s-41.2KiB/s (41.8kB/s-42.2kB/s), io=24.6MiB (25.7MB), run=151406-154211msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179996: Sun Sep 6 23:57:59 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(5992KiB/198997msec) clat (msec): min=5, max=1181, avg=53.23, stdev=54.95 lat (msec): min=5, max=1181, avg=53.23, stdev=54.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 77], 90.00th=[ 117], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 284], 99.90th=[ 359], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 135, per=26.19%, avg=31.43, stdev=22.70, samples=369 iops : min= 1, max= 33, avg= 7.17, stdev= 5.72, samples=369 write: IOPS=7, BW=31.6KiB/s (32.4kB/s)(6296KiB/198997msec); 0 zone resets clat (msec): min=14, max=443, avg=75.50, stdev=55.37 lat (msec): min=14, max=443, avg=75.50, stdev=55.37 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 72], | 70.00th=[ 91], 80.00th=[ 114], 90.00th=[ 153], 95.00th=[ 182], | 99.00th=[ 288], 99.50th=[ 313], 99.90th=[ 363], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 103, per=25.19%, avg=31.74, stdev=20.68, samples=383 iops : min= 1, max= 25, avg= 7.25, stdev= 5.21, samples=383 lat (msec) : 10=1.33%, 20=11.59%, 50=41.05%, 100=26.04%, 250=18.95% lat (msec) : 500=1.01%, 2000=0.03% cpu : usr=0.06%, sys=1.53%, ctx=4852, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179997: Sun Sep 6 23:57:59 2026 read: IOPS=7, BW=30.1KiB/s (30.8kB/s)(5940KiB/197597msec) clat (msec): min=6, max=1003, avg=52.20, stdev=52.88 lat (msec): min=6, max=1003, avg=52.20, stdev=52.88 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 163], | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 347], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 134, per=26.22%, avg=31.47, stdev=23.13, samples=365 iops : min= 1, max= 33, avg= 7.17, stdev= 5.82, samples=365 write: IOPS=8, BW=32.1KiB/s (32.9kB/s)(6348KiB/197597msec); 0 zone resets clat (msec): min=12, max=446, avg=75.30, stdev=54.30 lat (msec): min=12, max=446, avg=75.31, stdev=54.30 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 71], | 70.00th=[ 92], 80.00th=[ 114], 90.00th=[ 150], 95.00th=[ 184], | 99.00th=[ 255], 99.50th=[ 300], 99.90th=[ 397], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 109, per=25.78%, avg=32.48, stdev=20.91, samples=377 iops : min= 1, max= 27, avg= 7.43, stdev= 5.27, samples=377 lat (msec) : 10=1.63%, 20=11.00%, 50=41.83%, 100=26.37%, 250=18.33% lat (msec) : 500=0.81%, 2000=0.03% cpu : usr=0.06%, sys=1.43%, ctx=4761, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179998: Sun Sep 6 23:57:59 2026 read: IOPS=7, BW=30.3KiB/s (31.0kB/s)(6028KiB/199114msec) clat (msec): min=6, max=349, avg=52.53, stdev=46.76 lat (msec): min=6, max=349, avg=52.54, stdev=46.76 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 57], 80.00th=[ 75], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 279], 99.90th=[ 334], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 135, per=25.86%, avg=31.03, stdev=21.50, samples=375 iops : min= 1, max= 33, avg= 7.07, stdev= 5.40, samples=375 write: IOPS=7, BW=31.4KiB/s (32.2kB/s)(6260KiB/199114msec); 0 zone resets clat (msec): min=8, max=1171, avg=76.38, stdev=60.25 lat (msec): min=8, max=1171, avg=76.39, stdev=60.25 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 73], | 70.00th=[ 91], 80.00th=[ 115], 90.00th=[ 150], 95.00th=[ 180], | 99.00th=[ 247], 99.50th=[ 317], 99.90th=[ 485], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 109, per=24.96%, avg=31.46, stdev=20.46, samples=384 iops : min= 1, max= 27, avg= 7.18, stdev= 5.17, samples=384 lat (msec) : 10=1.43%, 20=11.30%, 50=39.62%, 100=28.55%, 250=18.29% lat (msec) : 500=0.78%, 2000=0.03% cpu : usr=0.05%, sys=1.45%, ctx=4857, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179999: Sun Sep 6 23:57:59 2026 read: IOPS=7, BW=30.4KiB/s (31.1kB/s)(6052KiB/199398msec) clat (msec): min=5, max=312, avg=51.53, stdev=46.18 lat (msec): min=5, max=312, avg=51.53, stdev=46.18 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 75], 90.00th=[ 114], 95.00th=[ 150], | 99.00th=[ 234], 99.50th=[ 247], 99.90th=[ 300], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 119, per=26.15%, avg=31.38, stdev=22.25, samples=372 iops : min= 1, max= 29, avg= 7.14, stdev= 5.59, samples=372 write: IOPS=7, BW=31.3KiB/s (32.0kB/s)(6236KiB/199398msec); 0 zone resets clat (msec): min=12, max=1076, avg=77.56, stdev=62.90 lat (msec): min=12, max=1076, avg=77.56, stdev=62.90 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 58], 60.00th=[ 72], | 70.00th=[ 93], 80.00th=[ 120], 90.00th=[ 150], 95.00th=[ 188], | 99.00th=[ 288], 99.50th=[ 347], 99.90th=[ 493], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 109, per=24.72%, avg=31.15, stdev=20.63, samples=385 iops : min= 1, max= 27, avg= 7.08, stdev= 5.18, samples=385 lat (msec) : 10=1.37%, 20=11.91%, 50=41.34%, 100=25.33%, 250=18.98% lat (msec) : 500=1.04%, 2000=0.03% cpu : usr=0.06%, sys=1.40%, ctx=4773, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=120KiB/s (123kB/s), 30.1KiB/s-30.4KiB/s (30.8kB/s-31.1kB/s), io=23.4MiB (24.6MB), run=197597-199398msec WRITE: bw=126KiB/s (129kB/s), 31.3KiB/s-32.1KiB/s (32.0kB/s-32.9kB/s), io=24.6MiB (25.7MB), run=197597-199398msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180049: Sun Sep 6 23:58:58 2026 read: IOPS=8, BW=136KiB/s (140kB/s)(5920KiB/43407msec) clat (usec): min=53, max=290555, avg=62150.23, stdev=41598.94 lat (usec): min=55, max=290557, avg=62157.58, stdev=41601.11 clat percentiles (usec): | 1.00th=[ 65], 5.00th=[ 80], 10.00th=[ 3851], 20.00th=[ 32375], | 30.00th=[ 40633], 40.00th=[ 46924], 50.00th=[ 56361], 60.00th=[ 65274], | 70.00th=[ 76022], 80.00th=[ 88605], 90.00th=[111674], 95.00th=[132645], | 99.00th=[177210], 99.50th=[278922], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 30, max= 285, per=26.75%, avg=137.50, stdev=60.25, samples=84 iops : min= 1, max= 17, avg= 7.81, stdev= 3.80, samples=84 write: IOPS=9, BW=147KiB/s (150kB/s)(6368KiB/43407msec); 0 zone resets clat (usec): min=1068, max=387202, avg=50916.55, stdev=55409.45 lat (usec): min=1070, max=387205, avg=50919.18, stdev=55409.56 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1991], 10.00th=[ 3326], 20.00th=[ 8029], | 30.00th=[ 12780], 40.00th=[ 26084], 50.00th=[ 36439], 60.00th=[ 46924], | 70.00th=[ 62653], 80.00th=[ 86508], 90.00th=[110625], 95.00th=[145753], | 99.00th=[320865], 99.50th=[362808], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 352, per=27.03%, avg=146.22, stdev=65.90, samples=85 iops : min= 1, max= 22, avg= 8.36, stdev= 4.19, samples=85 lat (usec) : 100=3.39%, 250=0.91%, 500=0.26%, 1000=0.13% lat (msec) : 2=2.99%, 4=3.52%, 10=5.86%, 20=7.68%, 50=28.13% lat (msec) : 100=32.29%, 250=13.93%, 500=0.91% cpu : usr=0.05%, sys=4.24%, ctx=1620, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180050: Sun Sep 6 23:58:58 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5744KiB/43613msec) clat (usec): min=49, max=259882, avg=67277.32, stdev=41864.23 lat (usec): min=50, max=259884, avg=67294.20, stdev=41857.56 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 70], 10.00th=[ 16319], 20.00th=[ 34341], | 30.00th=[ 44303], 40.00th=[ 53216], 50.00th=[ 62129], 60.00th=[ 72877], | 70.00th=[ 84411], 80.00th=[101188], 90.00th=[119014], 95.00th=[141558], | 99.00th=[204473], 99.50th=[223347], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 30, max= 311, per=26.04%, avg=133.87, stdev=56.11, samples=83 iops : min= 1, max= 19, avg= 7.58, stdev= 3.56, samples=83 write: IOPS=9, BW=150KiB/s (154kB/s)(6544KiB/43613msec); 0 zone resets clat (usec): min=1257, max=370420, avg=46666.86, stdev=48922.22 lat (usec): min=1260, max=370424, avg=46672.31, stdev=48920.38 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1958], 10.00th=[ 3130], 20.00th=[ 7242], | 30.00th=[ 11863], 40.00th=[ 19792], 50.00th=[ 31851], 60.00th=[ 44303], | 70.00th=[ 62129], 80.00th=[ 80217], 90.00th=[111674], 95.00th=[132645], | 99.00th=[202376], 99.50th=[291505], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 30, max= 349, per=27.86%, avg=150.71, stdev=71.67, samples=84 iops : min= 1, max= 21, avg= 8.64, stdev= 4.52, samples=84 lat (usec) : 50=0.13%, 100=3.65%, 250=0.52% lat (msec) : 2=3.12%, 4=4.04%, 10=7.42%, 20=7.29%, 50=24.74% lat (msec) : 100=32.42%, 250=16.15%, 500=0.52% cpu : usr=0.08%, sys=4.32%, ctx=1653, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180051: Sun Sep 6 23:58:58 2026 read: IOPS=8, BW=134KiB/s (138kB/s)(6256KiB/46554msec) clat (usec): min=36, max=297633, avg=68175.47, stdev=46257.64 lat (usec): min=36, max=297635, avg=68177.15, stdev=46257.57 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 77], 10.00th=[ 20317], 20.00th=[ 33424], | 30.00th=[ 43254], 40.00th=[ 51643], 50.00th=[ 60556], 60.00th=[ 71828], | 70.00th=[ 82314], 80.00th=[ 98042], 90.00th=[124257], 95.00th=[152044], | 99.00th=[242222], 99.50th=[283116], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 30, max= 281, per=26.39%, avg=135.66, stdev=60.10, samples=90 iops : min= 1, max= 17, avg= 7.69, stdev= 3.84, samples=90 write: IOPS=8, BW=130KiB/s (133kB/s)(6032KiB/46554msec); 0 zone resets clat (usec): min=1530, max=333159, avg=52054.59, stdev=53365.24 lat (usec): min=1532, max=333163, avg=52084.36, stdev=53373.03 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 5080], 20.00th=[ 8979], | 30.00th=[ 14353], 40.00th=[ 23200], 50.00th=[ 36439], 60.00th=[ 47973], | 70.00th=[ 65799], 80.00th=[ 85459], 90.00th=[123208], 95.00th=[162530], | 99.00th=[231736], 99.50th=[312476], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 30, max= 285, per=24.10%, avg=130.40, stdev=62.82, samples=89 iops : min= 1, max= 17, avg= 7.36, stdev= 3.98, samples=89 lat (usec) : 50=0.39%, 100=3.52%, 250=0.13%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.47%, 4=1.82%, 10=7.03%, 20=7.55%, 50=26.04% lat (msec) : 100=34.11%, 250=16.02%, 500=0.65% cpu : usr=0.07%, sys=3.95%, ctx=1715, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180052: Sun Sep 6 23:58:58 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6032KiB/42229msec) clat (usec): min=44, max=284158, avg=60151.82, stdev=42175.04 lat (usec): min=45, max=284158, avg=60154.39, stdev=42175.13 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 68], 10.00th=[ 97], 20.00th=[ 29754], | 30.00th=[ 39060], 40.00th=[ 46400], 50.00th=[ 54789], 60.00th=[ 62653], | 70.00th=[ 73925], 80.00th=[ 86508], 90.00th=[113771], 95.00th=[139461], | 99.00th=[189793], 99.50th=[242222], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 30, max= 287, per=28.36%, avg=145.78, stdev=61.56, samples=81 iops : min= 1, max= 17, avg= 8.33, stdev= 3.90, samples=81 write: IOPS=9, BW=148KiB/s (152kB/s)(6256KiB/42229msec); 0 zone resets clat (usec): min=1255, max=253981, avg=49021.02, stdev=48389.48 lat (usec): min=1256, max=253983, avg=49026.44, stdev=48386.91 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1926], 10.00th=[ 4490], 20.00th=[ 9896], | 30.00th=[ 15008], 40.00th=[ 22676], 50.00th=[ 34341], 60.00th=[ 46400], | 70.00th=[ 59507], 80.00th=[ 81265], 90.00th=[122160], 95.00th=[139461], | 99.00th=[225444], 99.50th=[248513], 99.90th=[254804], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 31, max= 342, per=27.35%, avg=147.95, stdev=63.40, samples=83 iops : min= 1, max= 21, avg= 8.47, stdev= 4.01, samples=83 lat (usec) : 50=0.52%, 100=4.43%, 250=0.39%, 500=0.26%, 750=0.13% lat (msec) : 2=2.86%, 4=2.34%, 10=5.47%, 20=8.59%, 50=28.52% lat (msec) : 100=31.77%, 250=14.45%, 500=0.26% cpu : usr=0.07%, sys=4.13%, ctx=1651, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=514KiB/s (527kB/s), 132KiB/s-143KiB/s (135kB/s-146kB/s), io=23.4MiB (24.5MB), run=42229-46554msec WRITE: bw=541KiB/s (554kB/s), 130KiB/s-150KiB/s (133kB/s-154kB/s), io=24.6MiB (25.8MB), run=42229-46554msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180044: Sun Sep 6 23:59:12 2026 read: IOPS=6, BW=97.2KiB/s (99.5kB/s)(5920KiB/60901msec) clat (msec): min=8, max=390, avg=63.48, stdev=58.71 lat (msec): min=8, max=390, avg=63.48, stdev=58.71 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 94], 90.00th=[ 133], 95.00th=[ 176], | 99.00th=[ 347], 99.50th=[ 372], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 30, max= 380, per=26.03%, avg=101.77, stdev=67.81, samples=112 iops : min= 1, max= 23, avg= 5.51, stdev= 4.29, samples=112 write: IOPS=6, BW=105KiB/s (107kB/s)(6368KiB/60901msec); 0 zone resets clat (msec): min=15, max=396, avg=93.79, stdev=63.89 lat (msec): min=15, max=396, avg=93.80, stdev=63.88 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 52], 40.00th=[ 63], 50.00th=[ 75], 60.00th=[ 88], | 70.00th=[ 111], 80.00th=[ 142], 90.00th=[ 180], 95.00th=[ 218], | 99.00th=[ 351], 99.50th=[ 355], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 30, max= 410, per=26.04%, avg=107.27, stdev=67.59, samples=115 iops : min= 1, max= 25, avg= 5.86, stdev= 4.28, samples=115 lat (msec) : 10=0.52%, 20=6.12%, 50=35.68%, 100=31.38%, 250=23.57% lat (msec) : 500=2.73% cpu : usr=0.05%, sys=1.29%, ctx=1153, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180045: Sun Sep 6 23:59:12 2026 read: IOPS=5, BW=93.0KiB/s (96.2kB/s)(5744KiB/61132msec) clat (msec): min=8, max=478, avg=63.75, stdev=60.14 lat (msec): min=8, max=478, avg=63.77, stdev=60.14 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 87], 90.00th=[ 140], 95.00th=[ 186], | 99.00th=[ 305], 99.50th=[ 351], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 21, max= 403, per=26.11%, avg=102.10, stdev=72.42, samples=110 iops : min= 1, max= 25, avg= 5.55, stdev= 4.62, samples=110 write: IOPS=6, BW=107KiB/s (110kB/s)(6544KiB/61132msec); 0 zone resets clat (msec): min=15, max=434, avg=92.74, stdev=62.68 lat (msec): min=15, max=434, avg=92.76, stdev=62.69 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 33], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 60], 50.00th=[ 74], 60.00th=[ 91], | 70.00th=[ 113], 80.00th=[ 138], 90.00th=[ 188], 95.00th=[ 215], | 99.00th=[ 284], 99.50th=[ 309], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 410, per=26.28%, avg=108.28, stdev=70.87, samples=118 iops : min= 1, max= 25, avg= 5.92, stdev= 4.47, samples=118 lat (msec) : 10=0.39%, 20=6.51%, 50=34.77%, 100=31.64%, 250=24.22% lat (msec) : 500=2.47% cpu : usr=0.04%, sys=1.24%, ctx=1084, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180046: Sun Sep 6 23:59:12 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(6256KiB/60501msec) clat (msec): min=7, max=368, avg=61.48, stdev=52.68 lat (msec): min=7, max=368, avg=61.48, stdev=52.68 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 64], 80.00th=[ 89], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 232], 99.50th=[ 241], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 30, max= 445, per=27.44%, avg=107.30, stdev=75.77, samples=114 iops : min= 1, max= 27, avg= 5.85, stdev= 4.78, samples=114 write: IOPS=6, BW=99.7KiB/s (102kB/s)(6032KiB/60501msec); 0 zone resets clat (msec): min=18, max=432, avg=96.09, stdev=66.23 lat (msec): min=18, max=432, avg=96.09, stdev=66.23 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 54], 40.00th=[ 64], 50.00th=[ 75], 60.00th=[ 92], | 70.00th=[ 111], 80.00th=[ 142], 90.00th=[ 194], 95.00th=[ 230], | 99.00th=[ 334], 99.50th=[ 380], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 30, max= 411, per=24.42%, avg=100.61, stdev=63.18, samples=115 iops : min= 1, max= 25, avg= 5.44, stdev= 3.99, samples=115 lat (msec) : 10=0.65%, 20=6.38%, 50=37.76%, 100=28.78%, 250=24.87% lat (msec) : 500=1.56% cpu : usr=0.05%, sys=1.29%, ctx=1132, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180047: Sun Sep 6 23:59:12 2026 read: IOPS=6, BW=99.4KiB/s (102kB/s)(6032KiB/60705msec) clat (msec): min=7, max=365, avg=63.11, stdev=56.03 lat (msec): min=7, max=365, avg=63.11, stdev=56.03 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 67], 80.00th=[ 92], 90.00th=[ 142], 95.00th=[ 178], | 99.00th=[ 292], 99.50th=[ 321], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 22, max= 378, per=26.54%, avg=103.78, stdev=64.59, samples=113 iops : min= 1, max= 23, avg= 5.64, stdev= 4.08, samples=113 write: IOPS=6, BW=103KiB/s (106kB/s)(6256KiB/60705msec); 0 zone resets clat (msec): min=18, max=402, avg=93.97, stdev=61.62 lat (msec): min=18, max=402, avg=93.97, stdev=61.62 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 63], 50.00th=[ 73], 60.00th=[ 94], | 70.00th=[ 111], 80.00th=[ 142], 90.00th=[ 178], 95.00th=[ 209], | 99.00th=[ 334], 99.50th=[ 363], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 30, max= 315, per=25.30%, avg=104.22, stdev=62.03, samples=117 iops : min= 1, max= 19, avg= 5.67, stdev= 3.93, samples=117 lat (msec) : 10=0.39%, 20=6.64%, 50=37.11%, 100=29.30%, 250=24.48% lat (msec) : 500=2.08% cpu : usr=0.05%, sys=1.27%, ctx=1134, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=392KiB/s (401kB/s), 93.0KiB/s-103KiB/s (96.2kB/s-106kB/s), io=23.4MiB (24.5MB), run=60501-61132msec WRITE: bw=412KiB/s (422kB/s), 99.7KiB/s-107KiB/s (102kB/s-110kB/s), io=24.6MiB (25.8MB), run=60501-61132msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180073: Sun Sep 6 23:59:29 2026 read: IOPS=1, BW=1344KiB/s (1376kB/s)(7168KiB/5334msec) clat (usec): min=1648, max=2303.0k, avg=526946.76, stdev=803390.30 lat (usec): min=1649, max=2303.0k, avg=526948.65, stdev=803390.26 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1647], 10.00th=[ 1647], | 20.00th=[ 2606], 30.00th=[ 191890], 40.00th=[ 191890], | 50.00th=[ 350225], 60.00th=[ 404751], 70.00th=[ 404751], | 80.00th=[ 438305], 90.00th=[2298479], 95.00th=[2298479], | 99.00th=[2298479], 99.50th=[2298479], 99.90th=[2298479], | 99.95th=[2298479], 99.99th=[2298479] bw ( KiB/s): min= 1347, max= 2027, per=59.39%, avg=1844.67, stdev=271.94, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=960KiB/s (983kB/s)(5120KiB/5334msec); 0 zone resets clat (msec): min=171, max=479, avg=314.43, stdev=113.14 lat (msec): min=171, max=479, avg=314.55, stdev=113.12 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2000, max= 4055, per=61.87%, avg=2690.00, stdev=1182.15, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 2=8.33%, 4=8.33%, 250=16.67%, 500=58.33%, >=2000=8.33% cpu : usr=0.09%, sys=8.62%, ctx=213, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180074: Sun Sep 6 23:59:29 2026 read: IOPS=0, BW=311KiB/s (318kB/s)(2048KiB/6593msec) clat (usec): min=897, max=322770, avg=161833.86, stdev=227598.42 lat (usec): min=898, max=322773, avg=161836.25, stdev=227599.82 clat percentiles (usec): | 1.00th=[ 898], 5.00th=[ 898], 10.00th=[ 898], 20.00th=[ 898], | 30.00th=[ 898], 40.00th=[ 898], 50.00th=[ 898], 60.00th=[320865], | 70.00th=[320865], 80.00th=[320865], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1617, max= 1965, per=57.66%, avg=1791.00, stdev=246.07, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1553KiB/s (1590kB/s)(10.0MiB/6593msec); 0 zone resets clat (msec): min=118, max=2847, avg=618.60, stdev=819.94 lat (msec): min=118, max=2847, avg=618.69, stdev=819.95 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 207], | 30.00th=[ 209], 40.00th=[ 236], 50.00th=[ 296], 60.00th=[ 405], | 70.00th=[ 414], 80.00th=[ 477], 90.00th=[ 986], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 2003, max= 5896, per=82.68%, avg=3595.00, stdev=1628.12, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=41.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.09%, sys=7.77%, ctx=111, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180075: Sun Sep 6 23:59:29 2026 read: IOPS=0, BW=1005KiB/s (1030kB/s)(6144KiB/6111msec) clat (usec): min=546, max=284660, avg=117690.18, stdev=135406.83 lat (usec): min=546, max=284661, avg=117691.35, stdev=135406.86 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 4686], 50.00th=[ 4686], 60.00th=[147850], | 70.00th=[270533], 80.00th=[270533], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 2043, max= 4055, per=100.00%, avg=3342.67, stdev=1127.28, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=1005KiB/s (1030kB/s)(6144KiB/6111msec); 0 zone resets clat (msec): min=250, max=2552, avg=833.01, stdev=867.42 lat (msec): min=251, max=2553, avg=833.20, stdev=867.33 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 709], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1706, max= 2043, per=45.00%, avg=1956.80, stdev=143.84, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=8.33%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=4.71%, ctx=143, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180076: Sun Sep 6 23:59:29 2026 read: IOPS=0, BW=782KiB/s (801kB/s)(5120KiB/6545msec) clat (usec): min=1744, max=517896, avg=225764.66, stdev=227638.40 lat (usec): min=1745, max=517897, avg=225765.95, stdev=227638.33 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1745], 10.00th=[ 1745], 20.00th=[ 1745], | 30.00th=[ 2147], 40.00th=[ 2147], 50.00th=[233833], 60.00th=[233833], | 70.00th=[371196], 80.00th=[371196], 90.00th=[517997], 95.00th=[517997], | 99.00th=[517997], 99.50th=[517997], 99.90th=[517997], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1095KiB/s (1121kB/s)(7168KiB/6545msec); 0 zone resets clat (msec): min=183, max=2592, avg=721.70, stdev=848.42 lat (msec): min=184, max=2592, avg=721.89, stdev=848.38 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 271], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 388], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 776], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1706, max= 4007, per=52.89%, avg=2299.67, stdev=845.99, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 2=8.33%, 4=8.33%, 250=16.67%, 500=33.33%, 750=16.67% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.39%, ctx=122, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3106KiB/s (3181kB/s), 311KiB/s-1344KiB/s (318kB/s-1376kB/s), io=20.0MiB (20.0MB), run=5334-6593msec WRITE: bw=4349KiB/s (4453kB/s), 960KiB/s-1553KiB/s (983kB/s-1590kB/s), io=28.0MiB (29.4MB), run=5334-6593msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180069: Sun Sep 6 23:59:30 2026 read: IOPS=1, BW=1078KiB/s (1104kB/s)(7168KiB/6648msec) clat (msec): min=113, max=2359, avg=542.32, stdev=808.14 lat (msec): min=113, max=2359, avg=542.32, stdev=808.14 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 159], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 220], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 443], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1408, max= 4079, per=81.23%, avg=2289.80, stdev=1032.69, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=770KiB/s (789kB/s)(5120KiB/6648msec); 0 zone resets clat (msec): min=151, max=892, avg=526.98, stdev=314.95 lat (msec): min=152, max=893, avg=527.09, stdev=314.94 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 481], 60.00th=[ 481], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 2023, max= 4055, per=68.52%, avg=2704.33, stdev=1169.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=33.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.02%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180070: Sun Sep 6 23:59:30 2026 read: IOPS=0, BW=282KiB/s (289kB/s)(2048KiB/7263msec) clat (msec): min=115, max=259, avg=187.76, stdev=102.07 lat (msec): min=115, max=259, avg=187.76, stdev=102.07 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 116], | 30.00th=[ 116], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 259], 95.00th=[ 259], | 99.00th=[ 259], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 1651, max= 2023, per=65.16%, avg=1837.00, stdev=263.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1410KiB/s (1444kB/s)(10.0MiB/7263msec); 0 zone resets clat (msec): min=189, max=2389, avg=675.98, stdev=657.46 lat (msec): min=189, max=2390, avg=676.24, stdev=657.45 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 234], | 30.00th=[ 264], 40.00th=[ 342], 50.00th=[ 414], 60.00th=[ 542], | 70.00th=[ 567], 80.00th=[ 776], 90.00th=[ 1036], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 1980, max= 4079, per=59.67%, avg=2355.17, stdev=844.67, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=25.00%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.80%, ctx=97, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180071: Sun Sep 6 23:59:30 2026 read: IOPS=0, BW=899KiB/s (920kB/s)(6144KiB/6835msec) clat (msec): min=71, max=548, avg=272.92, stdev=212.67 lat (msec): min=71, max=548, avg=272.92, stdev=212.67 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 91], | 30.00th=[ 91], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 264], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2015, max= 4047, per=100.00%, avg=3301.33, stdev=1118.70, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=899KiB/s (920kB/s)(6144KiB/6835msec); 0 zone resets clat (msec): min=157, max=2557, avg=803.32, stdev=904.46 lat (msec): min=157, max=2557, avg=803.47, stdev=904.43 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 418], 50.00th=[ 418], 60.00th=[ 456], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 1921, max= 2048, per=50.99%, avg=2012.40, stdev=51.85, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=2.27%, ctx=92, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180072: Sun Sep 6 23:59:30 2026 read: IOPS=0, BW=883KiB/s (905kB/s)(5120KiB/5796msec) clat (msec): min=119, max=237, avg=180.59, stdev=47.07 lat (msec): min=119, max=237, avg=180.59, stdev=47.07 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 190], 60.00th=[ 190], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 239], 95.00th=[ 239], | 99.00th=[ 239], 99.50th=[ 239], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 2039, max= 5763, per=100.00%, avg=3901.00, stdev=2633.27, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1237KiB/s (1266kB/s)(7168KiB/5796msec); 0 zone resets clat (msec): min=120, max=2738, avg=651.65, stdev=929.41 lat (msec): min=120, max=2738, avg=651.81, stdev=929.41 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 222], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 292], 60.00th=[ 430], | 70.00th=[ 430], 80.00th=[ 514], 90.00th=[ 2735], 95.00th=[ 2735], | 99.00th=[ 2735], 99.50th=[ 2735], 99.90th=[ 2735], 99.95th=[ 2735], | 99.99th=[ 2735] bw ( KiB/s): min= 1675, max= 4079, per=70.31%, avg=2775.00, stdev=1195.31, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=66.67%, 500=16.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.24%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2820KiB/s (2887kB/s), 282KiB/s-1078KiB/s (289kB/s-1104kB/s), io=20.0MiB (20.0MB), run=5796-7263msec WRITE: bw=3948KiB/s (4042kB/s), 770KiB/s-1410KiB/s (789kB/s-1444kB/s), io=28.0MiB (29.4MB), run=5796-7263msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180088: Sun Sep 6 23:59:49 2026 read: IOPS=1, BW=4468KiB/s (4576kB/s)(12.0MiB/2750msec) clat (msec): min=772, max=1024, avg=885.32, stdev=127.81 lat (msec): min=772, max=1024, avg=885.32, stdev=127.81 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 1028], 80.00th=[ 1028], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7968, max= 8094, per=100.00%, avg=8031.00, stdev=89.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.91%, ctx=253, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180089: Sun Sep 6 23:59:49 2026 read: IOPS=0, BW=1160KiB/s (1188kB/s)(4096KiB/3530msec) clat (nsec): min=846841k, max=846841k, avg=846841108.00, stdev= 0.00 lat (nsec): min=846844k, max=846844k, avg=846844173.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2321KiB/s (2376kB/s)(8192KiB/3530msec); 0 zone resets clat (msec): min=1083, max=1492, avg=1288.21, stdev=289.19 lat (msec): min=1084, max=1493, avg=1288.75, stdev=289.35 clat percentiles (msec): | 1.00th=[ 1083], 5.00th=[ 1083], 10.00th=[ 1083], 20.00th=[ 1083], | 30.00th=[ 1083], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1485], | 70.00th=[ 1485], 80.00th=[ 1485], 90.00th=[ 1485], 95.00th=[ 1485], | 99.00th=[ 1485], 99.50th=[ 1485], 99.90th=[ 1485], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 8078, max= 8078, per=91.51%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.76%, ctx=103, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180090: Sun Sep 6 23:59:49 2026 write: IOPS=0, BW=3310KiB/s (3390kB/s)(12.0MiB/3712msec); 0 zone resets clat (msec): min=402, max=1709, avg=1217.84, stdev=710.98 lat (msec): min=403, max=1711, avg=1219.36, stdev=711.35 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8078, max= 8110, per=91.70%, avg=8094.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.72%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180091: Sun Sep 6 23:59:49 2026 write: IOPS=0, BW=3814KiB/s (3905kB/s)(12.0MiB/3222msec); 0 zone resets clat (msec): min=309, max=2123, avg=1048.92, stdev=952.45 lat (msec): min=309, max=2124, avg=1049.39, stdev=952.48 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 7937, max= 8159, per=91.17%, avg=8048.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.60%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4641KiB/s (4753kB/s), 1160KiB/s-4468KiB/s (1188kB/s-4576kB/s), io=16.0MiB (16.8MB), run=2750-3530msec WRITE: bw=8828KiB/s (9039kB/s), 2321KiB/s-3814KiB/s (2376kB/s-3905kB/s), io=32.0MiB (33.6MB), run=3222-3712msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180084: Sun Sep 6 23:59:49 2026 read: IOPS=1, BW=6126KiB/s (6273kB/s)(12.0MiB/2006msec) clat (msec): min=234, max=1313, avg=633.85, stdev=591.38 lat (msec): min=234, max=1313, avg=633.88, stdev=591.42 clat percentiles (msec): | 1.00th=[ 234], 5.00th=[ 234], 10.00th=[ 234], 20.00th=[ 234], | 30.00th=[ 234], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 6068, max= 8175, per=100.00%, avg=7121.50, stdev=1489.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.69%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180085: Sun Sep 6 23:59:49 2026 read: IOPS=0, BW=1035KiB/s (1060kB/s)(4096KiB/3956msec) clat (nsec): min=1296.2M, max=1296.2M, avg=1296196501.00, stdev= 0.00 lat (nsec): min=1296.2M, max=1296.2M, avg=1296199390.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1301], 5.00th=[ 1301], 10.00th=[ 1301], 20.00th=[ 1301], | 30.00th=[ 1301], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2071KiB/s (2120kB/s)(8192KiB/3956msec); 0 zone resets clat (msec): min=652, max=1900, avg=1276.44, stdev=882.55 lat (msec): min=653, max=1900, avg=1277.38, stdev=881.78 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 1905], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 8015, max= 8015, per=96.76%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.05%, sys=3.39%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180086: Sun Sep 6 23:59:49 2026 write: IOPS=0, BW=3485KiB/s (3569kB/s)(12.0MiB/3526msec); 0 zone resets clat (msec): min=670, max=1930, avg=1157.14, stdev=677.17 lat (msec): min=670, max=1930, avg=1157.55, stdev=677.19 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 7953, max= 8175, per=97.36%, avg=8064.00, stdev=156.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=2.87%, ctx=52, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180087: Sun Sep 6 23:59:49 2026 write: IOPS=1, BW=4580KiB/s (4690kB/s)(12.0MiB/2683msec); 0 zone resets clat (msec): min=467, max=1213, avg=843.99, stdev=373.07 lat (msec): min=468, max=1214, avg=844.74, stdev=373.04 clat percentiles (msec): | 1.00th=[ 468], 5.00th=[ 468], 10.00th=[ 468], 20.00th=[ 468], | 30.00th=[ 468], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7984, max= 8175, per=97.54%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.28%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4142KiB/s (4241kB/s), 1035KiB/s-6126KiB/s (1060kB/s-6273kB/s), io=16.0MiB (16.8MB), run=2006-3956msec WRITE: bw=8283KiB/s (8482kB/s), 2071KiB/s-4580KiB/s (2120kB/s-4690kB/s), io=32.0MiB (33.6MB), run=2683-3956msec