== sanity test 398b: DIO and buffer IO race ============== 20:12:11 (1786407131) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.53008 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178810: Mon Aug 10 20:14:30 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(5992KiB/120411msec) clat (usec): min=45, max=238957, avg=43216.16, stdev=28156.77 lat (usec): min=45, max=238958, avg=43217.90, stdev=28157.07 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 8717], 10.00th=[ 15664], 20.00th=[ 22414], | 30.00th=[ 27132], 40.00th=[ 31851], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[139461], 99.50th=[145753], 99.90th=[200279], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 111, per=25.01%, avg=49.28, stdev=18.75, samples=236 iops : min= 1, max= 27, avg=11.67, stdev= 4.73, samples=236 write: IOPS=13, BW=52.3KiB/s (53.5kB/s)(6296KiB/120411msec); 0 zone resets clat (usec): min=880, max=371012, avg=35097.68, stdev=36581.65 lat (usec): min=881, max=371013, avg=35100.21, stdev=36582.50 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1582], 20.00th=[ 4621], | 30.00th=[ 8848], 40.00th=[ 17433], 50.00th=[ 24511], 60.00th=[ 32637], | 70.00th=[ 43779], 80.00th=[ 60556], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[158335], 99.50th=[187696], 99.90th=[223347], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 5, max= 149, per=24.98%, avg=51.70, stdev=21.84, samples=237 iops : min= 1, max= 37, avg=12.27, stdev= 5.47, samples=237 lat (usec) : 50=0.10%, 100=1.76%, 250=0.10%, 500=0.03%, 750=0.10% lat (usec) : 1000=0.10% lat (msec) : 2=6.05%, 4=3.35%, 10=7.10%, 20=11.65%, 50=41.50% lat (msec) : 100=22.69%, 250=5.44%, 500=0.03% cpu : usr=0.10%, sys=5.37%, ctx=6435, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178811: Mon Aug 10 20:14:30 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(5940KiB/119928msec) clat (usec): min=48, max=363480, avg=44761.68, stdev=30833.82 lat (usec): min=48, max=363483, avg=44765.56, stdev=30832.27 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11207], 10.00th=[ 16319], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[189793], 99.90th=[240124], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 5, max= 111, per=25.10%, avg=49.45, stdev=19.71, samples=234 iops : min= 1, max= 27, avg=11.71, stdev= 4.95, samples=234 write: IOPS=13, BW=52.9KiB/s (54.2kB/s)(6348KiB/119928msec); 0 zone resets clat (usec): min=862, max=400308, avg=33393.53, stdev=35747.63 lat (usec): min=863, max=400309, avg=33394.96, stdev=35747.62 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1516], 20.00th=[ 3949], | 30.00th=[ 7242], 40.00th=[ 14484], 50.00th=[ 22152], 60.00th=[ 30540], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 80217], 95.00th=[103285], | 99.00th=[154141], 99.50th=[168821], 99.90th=[238027], 99.95th=[400557], | 99.99th=[400557] bw ( KiB/s): min= 7, max= 142, per=25.25%, avg=52.27, stdev=22.86, samples=236 iops : min= 1, max= 35, avg=12.42, stdev= 5.76, samples=236 lat (usec) : 50=0.03%, 100=1.66%, 250=0.20%, 500=0.07%, 1000=0.10% lat (msec) : 2=6.93%, 4=3.42%, 10=7.06%, 20=12.30%, 50=38.74% lat (msec) : 100=24.41%, 250=5.01%, 500=0.07% cpu : usr=0.08%, sys=5.38%, ctx=6354, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178813: Mon Aug 10 20:14:30 2026 read: IOPS=12, BW=50.9KiB/s (52.1kB/s)(6028KiB/118496msec) clat (usec): min=33, max=394886, avg=43588.56, stdev=30042.92 lat (usec): min=34, max=394887, avg=43592.94, stdev=30041.87 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10552], 10.00th=[ 16188], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[173016], 99.90th=[240124], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 7, max= 119, per=25.70%, avg=50.63, stdev=20.10, samples=232 iops : min= 1, max= 29, avg=12.01, stdev= 5.05, samples=232 write: IOPS=13, BW=52.8KiB/s (54.1kB/s)(6260KiB/118496msec); 0 zone resets clat (usec): min=927, max=230250, avg=33448.55, stdev=35376.63 lat (usec): min=928, max=230252, avg=33450.83, stdev=35376.05 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1336], 10.00th=[ 1483], 20.00th=[ 3195], | 30.00th=[ 6390], 40.00th=[ 13173], 50.00th=[ 22938], 60.00th=[ 31327], | 70.00th=[ 43254], 80.00th=[ 60031], 90.00th=[ 85459], 95.00th=[106431], | 99.00th=[149947], 99.50th=[158335], 99.90th=[221250], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 7, max= 127, per=25.28%, avg=52.33, stdev=24.01, samples=233 iops : min= 1, max= 31, avg=12.43, stdev= 6.03, samples=233 lat (usec) : 50=0.39%, 100=1.56%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=7.26%, 4=4.52%, 10=7.00%, 20=10.58%, 50=39.45% lat (msec) : 100=23.54%, 250=5.37%, 500=0.03% cpu : usr=0.08%, sys=5.32%, ctx=6323, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178814: Mon Aug 10 20:14:30 2026 read: IOPS=12, BW=49.8KiB/s (51.0kB/s)(6052KiB/121405msec) clat (usec): min=35, max=397991, avg=43666.34, stdev=29844.42 lat (usec): min=36, max=397992, avg=43668.27, stdev=29844.61 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 9503], 10.00th=[ 16450], 20.00th=[ 21890], | 30.00th=[ 26608], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[177210], 99.90th=[221250], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 5, max= 126, per=25.07%, avg=49.38, stdev=19.74, samples=239 iops : min= 1, max= 31, avg=11.69, stdev= 4.97, samples=239 write: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6236KiB/121405msec); 0 zone resets clat (usec): min=930, max=227887, avg=35162.79, stdev=36442.58 lat (usec): min=932, max=227888, avg=35173.91, stdev=36438.36 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1319], 10.00th=[ 1532], 20.00th=[ 3851], | 30.00th=[ 7767], 40.00th=[ 15401], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 45351], 80.00th=[ 61080], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[147850], 99.50th=[173016], 99.90th=[223347], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 15, max= 126, per=24.64%, avg=51.01, stdev=20.99, samples=238 iops : min= 3, max= 31, avg=12.10, stdev= 5.30, samples=238 lat (usec) : 50=0.16%, 100=1.73%, 250=0.10%, 500=0.03%, 1000=0.13% lat (msec) : 2=6.35%, 4=3.94%, 10=7.52%, 20=10.84%, 50=39.78% lat (msec) : 100=24.02%, 250=5.37%, 500=0.03% cpu : usr=0.08%, sys=5.28%, ctx=6359, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=198KiB/s (203kB/s), 49.5KiB/s-50.9KiB/s (50.7kB/s-52.1kB/s), io=23.4MiB (24.6MB), run=118496-121405msec WRITE: bw=207KiB/s (212kB/s), 51.4KiB/s-52.9KiB/s (52.6kB/s-54.2kB/s), io=24.6MiB (25.7MB), run=118496-121405msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178816: Mon Aug 10 20:15:12 2026 read: IOPS=9, BW=36.8KiB/s (37.7kB/s)(5992KiB/162926msec) clat (msec): min=5, max=406, avg=42.24, stdev=40.34 lat (msec): min=5, max=406, avg=42.25, stdev=40.34 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 89], 95.00th=[ 123], | 99.00th=[ 213], 99.50th=[ 236], 99.90th=[ 300], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 144, per=25.29%, avg=37.18, stdev=24.74, samples=314 iops : min= 1, max= 36, avg= 8.63, stdev= 6.23, samples=314 write: IOPS=9, BW=38.6KiB/s (39.6kB/s)(6296KiB/162926msec); 0 zone resets clat (msec): min=9, max=367, avg=63.08, stdev=44.63 lat (msec): min=9, max=367, avg=63.08, stdev=44.63 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 120], 95.00th=[ 153], | 99.00th=[ 232], 99.50th=[ 259], 99.90th=[ 347], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 127, per=24.87%, avg=38.31, stdev=22.94, samples=320 iops : min= 1, max= 31, avg= 8.92, stdev= 5.78, samples=320 lat (msec) : 10=2.34%, 20=14.65%, 50=46.29%, 100=24.51%, 250=11.65% lat (msec) : 500=0.55% cpu : usr=0.04%, sys=2.06%, ctx=5010, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178817: Mon Aug 10 20:15:12 2026 read: IOPS=9, BW=36.5KiB/s (37.3kB/s)(5940KiB/162889msec) clat (msec): min=4, max=436, avg=42.43, stdev=38.90 lat (msec): min=4, max=436, avg=42.44, stdev=38.90 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 92], 95.00th=[ 123], | 99.00th=[ 186], 99.50th=[ 226], 99.90th=[ 292], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 159, per=25.06%, avg=36.84, stdev=25.29, samples=313 iops : min= 1, max= 39, avg= 8.55, stdev= 6.38, samples=313 write: IOPS=9, BW=38.0KiB/s (39.9kB/s)(6348KiB/162889msec); 0 zone resets clat (msec): min=11, max=367, avg=62.71, stdev=44.25 lat (msec): min=11, max=367, avg=62.71, stdev=44.24 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 93], 90.00th=[ 121], 95.00th=[ 150], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 309], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 119, per=25.43%, avg=39.16, stdev=23.36, samples=314 iops : min= 1, max= 29, avg= 9.13, stdev= 5.89, samples=314 lat (msec) : 10=2.15%, 20=14.88%, 50=45.96%, 100=24.38%, 250=12.24% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.02%, ctx=4926, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178818: Mon Aug 10 20:15:12 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6028KiB/162522msec) clat (msec): min=5, max=272, avg=43.34, stdev=40.44 lat (msec): min=5, max=272, avg=43.34, stdev=40.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 60], 90.00th=[ 97], 95.00th=[ 127], | 99.00th=[ 203], 99.50th=[ 243], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 7, max= 134, per=25.74%, avg=37.83, stdev=24.32, samples=310 iops : min= 1, max= 33, avg= 8.80, stdev= 6.14, samples=310 write: IOPS=9, BW=38.5KiB/s (39.4kB/s)(6260KiB/162522msec); 0 zone resets clat (msec): min=9, max=438, avg=61.89, stdev=43.47 lat (msec): min=9, max=438, avg=61.89, stdev=43.47 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 118], 95.00th=[ 144], | 99.00th=[ 218], 99.50th=[ 249], 99.90th=[ 313], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 151, per=24.81%, avg=38.20, stdev=24.08, samples=319 iops : min= 1, max= 37, avg= 8.89, stdev= 6.06, samples=319 lat (msec) : 10=2.21%, 20=14.78%, 50=46.32%, 100=24.12%, 250=12.14% lat (msec) : 500=0.42% cpu : usr=0.05%, sys=2.06%, ctx=4917, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178819: Mon Aug 10 20:15:12 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6052KiB/161623msec) clat (msec): min=5, max=304, avg=43.01, stdev=38.37 lat (msec): min=5, max=304, avg=43.01, stdev=38.37 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 122], | 99.00th=[ 186], 99.50th=[ 236], 99.90th=[ 275], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 166, per=25.94%, avg=38.14, stdev=24.99, samples=309 iops : min= 1, max= 41, avg= 8.87, stdev= 6.29, samples=309 write: IOPS=9, BW=38.6KiB/s (39.5kB/s)(6236KiB/161623msec); 0 zone resets clat (msec): min=12, max=403, avg=61.71, stdev=44.11 lat (msec): min=12, max=403, avg=61.72, stdev=44.11 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 48], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 118], 95.00th=[ 146], | 99.00th=[ 224], 99.50th=[ 259], 99.90th=[ 347], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 127, per=24.89%, avg=38.33, stdev=23.25, samples=316 iops : min= 1, max= 31, avg= 8.93, stdev= 5.86, samples=316 lat (msec) : 10=2.25%, 20=14.78%, 50=46.32%, 100=24.97%, 250=11.26% lat (msec) : 500=0.42% cpu : usr=0.05%, sys=2.07%, ctx=4830, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (151kB/s), 36.5KiB/s-37.4KiB/s (37.3kB/s-38.3kB/s), io=23.4MiB (24.6MB), run=161623-162926msec WRITE: bw=154KiB/s (158kB/s), 38.5KiB/s-38.0KiB/s (39.4kB/s-39.9kB/s), io=24.6MiB (25.7MB), run=161623-162926msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178865: Mon Aug 10 20:16:05 2026 read: IOPS=8, BW=143KiB/s (147kB/s)(5920KiB/41285msec) clat (usec): min=48, max=284998, avg=57830.20, stdev=38133.03 lat (usec): min=48, max=285000, avg=57831.72, stdev=38133.02 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 76], 10.00th=[ 18744], 20.00th=[ 30278], | 30.00th=[ 36963], 40.00th=[ 45351], 50.00th=[ 52691], 60.00th=[ 61080], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[101188], 95.00th=[117965], | 99.00th=[196084], 99.50th=[225444], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 31, max= 316, per=25.27%, avg=146.56, stdev=61.25, samples=79 iops : min= 1, max= 19, avg= 8.41, stdev= 3.90, samples=79 write: IOPS=9, BW=154KiB/s (158kB/s)(6368KiB/41285msec); 0 zone resets clat (usec): min=1622, max=246737, avg=49844.91, stdev=47795.03 lat (usec): min=1624, max=246739, avg=49859.92, stdev=47806.92 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2212], 10.00th=[ 5080], 20.00th=[ 9896], | 30.00th=[ 17433], 40.00th=[ 24511], 50.00th=[ 34341], 60.00th=[ 44303], | 70.00th=[ 63177], 80.00th=[ 86508], 90.00th=[116917], 95.00th=[149947], | 99.00th=[214959], 99.50th=[242222], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 30, max= 282, per=25.21%, avg=153.77, stdev=57.45, samples=81 iops : min= 1, max= 17, avg= 8.86, stdev= 3.57, samples=81 lat (usec) : 50=0.13%, 100=3.26%, 250=0.52% lat (msec) : 2=0.65%, 4=3.65%, 10=6.38%, 20=8.33%, 50=32.55% lat (msec) : 100=31.77%, 250=12.63%, 500=0.13% cpu : usr=0.09%, sys=5.07%, ctx=1751, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178866: Mon Aug 10 20:16:05 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(5744KiB/40416msec) clat (usec): min=54, max=224927, avg=57786.75, stdev=36560.08 lat (usec): min=54, max=224927, avg=57788.29, stdev=36560.16 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 75], 10.00th=[ 23462], 20.00th=[ 31589], | 30.00th=[ 39060], 40.00th=[ 45351], 50.00th=[ 52167], 60.00th=[ 59507], | 70.00th=[ 67634], 80.00th=[ 77071], 90.00th=[ 98042], 95.00th=[121111], | 99.00th=[208667], 99.50th=[221250], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 30, max= 286, per=24.88%, avg=144.32, stdev=57.69, samples=77 iops : min= 1, max= 17, avg= 8.26, stdev= 3.62, samples=77 write: IOPS=10, BW=162KiB/s (166kB/s)(6544KiB/40416msec); 0 zone resets clat (usec): min=1470, max=309924, avg=47888.77, stdev=46027.29 lat (usec): min=1472, max=309928, avg=47891.56, stdev=46027.45 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2114], 10.00th=[ 3949], 20.00th=[ 8356], | 30.00th=[ 14877], 40.00th=[ 25297], 50.00th=[ 34341], 60.00th=[ 45351], | 70.00th=[ 57934], 80.00th=[ 81265], 90.00th=[114820], 95.00th=[141558], | 99.00th=[181404], 99.50th=[200279], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 440, per=26.21%, avg=159.89, stdev=78.24, samples=79 iops : min= 1, max= 27, avg= 9.27, stdev= 4.95, samples=79 lat (usec) : 100=2.60%, 250=0.13% lat (msec) : 2=1.95%, 4=3.39%, 10=6.90%, 20=7.03%, 50=33.85% lat (msec) : 100=32.55%, 250=11.46%, 500=0.13% cpu : usr=0.09%, sys=5.07%, ctx=1725, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178867: Mon Aug 10 20:16:05 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40258msec) clat (usec): min=58, max=308165, avg=58292.48, stdev=37624.83 lat (usec): min=58, max=308167, avg=58295.57, stdev=37625.27 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 85], 10.00th=[ 20579], 20.00th=[ 30540], | 30.00th=[ 39060], 40.00th=[ 47449], 50.00th=[ 53216], 60.00th=[ 60031], | 70.00th=[ 68682], 80.00th=[ 80217], 90.00th=[102237], 95.00th=[123208], | 99.00th=[198181], 99.50th=[219153], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 31, max= 339, per=26.82%, avg=155.53, stdev=64.39, samples=79 iops : min= 1, max= 21, avg= 9.00, stdev= 4.10, samples=79 write: IOPS=9, BW=150KiB/s (153kB/s)(6032KiB/40258msec); 0 zone resets clat (usec): min=1281, max=291157, avg=46176.45, stdev=44495.17 lat (usec): min=1283, max=291159, avg=46181.31, stdev=44494.41 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2245], 10.00th=[ 4080], 20.00th=[ 8979], | 30.00th=[ 15139], 40.00th=[ 25560], 50.00th=[ 34341], 60.00th=[ 44827], | 70.00th=[ 58459], 80.00th=[ 77071], 90.00th=[103285], 95.00th=[128451], | 99.00th=[210764], 99.50th=[278922], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 30, max= 352, per=24.35%, avg=148.56, stdev=75.67, samples=79 iops : min= 1, max= 22, avg= 8.53, stdev= 4.82, samples=79 lat (usec) : 100=3.12%, 250=0.39%, 750=0.13% lat (msec) : 2=1.17%, 4=3.39%, 10=6.25%, 20=7.94%, 50=31.64% lat (msec) : 100=34.38%, 250=11.20%, 500=0.39% cpu : usr=0.05%, sys=4.94%, ctx=1688, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178868: Mon Aug 10 20:16:05 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(6032KiB/40289msec) clat (usec): min=39, max=322231, avg=58834.97, stdev=40961.20 lat (usec): min=39, max=322233, avg=58836.55, stdev=40961.23 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 79], 10.00th=[ 19268], 20.00th=[ 30278], | 30.00th=[ 37487], 40.00th=[ 45351], 50.00th=[ 51643], 60.00th=[ 58983], | 70.00th=[ 68682], 80.00th=[ 82314], 90.00th=[108528], 95.00th=[135267], | 99.00th=[191890], 99.50th=[246416], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 314, per=25.46%, avg=147.67, stdev=56.43, samples=79 iops : min= 1, max= 19, avg= 8.48, stdev= 3.55, samples=79 write: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40289msec); 0 zone resets clat (usec): min=1608, max=218509, avg=46098.61, stdev=41142.07 lat (usec): min=1611, max=218513, avg=46107.72, stdev=41137.61 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2868], 10.00th=[ 5473], 20.00th=[ 9241], | 30.00th=[ 13698], 40.00th=[ 24773], 50.00th=[ 36963], 60.00th=[ 46924], | 70.00th=[ 60031], 80.00th=[ 76022], 90.00th=[105382], 95.00th=[123208], | 99.00th=[168821], 99.50th=[214959], 99.90th=[219153], 99.95th=[219153], | 99.99th=[219153] bw ( KiB/s): min= 28, max= 349, per=25.26%, avg=154.11, stdev=69.26, samples=79 iops : min= 1, max= 21, avg= 8.90, stdev= 4.40, samples=79 lat (usec) : 50=0.13%, 100=2.99%, 250=0.26%, 500=0.26% lat (msec) : 2=1.04%, 4=3.26%, 10=7.29%, 20=7.68%, 50=32.16% lat (msec) : 100=32.94%, 250=11.85%, 500=0.13% cpu : usr=0.07%, sys=5.01%, ctx=1704, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=580KiB/s (594kB/s), 142KiB/s-155KiB/s (146kB/s-159kB/s), io=23.4MiB (24.5MB), run=40258-41285msec WRITE: bw=610KiB/s (625kB/s), 150KiB/s-162KiB/s (153kB/s-166kB/s), io=24.6MiB (25.8MB), run=40258-41285msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178860: Mon Aug 10 20:16:19 2026 read: IOPS=6, BW=107KiB/s (109kB/s)(5920KiB/55583msec) clat (msec): min=9, max=405, avg=58.03, stdev=51.27 lat (msec): min=9, max=405, avg=58.03, stdev=51.27 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 25], | 30.00th=[ 28], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 77], 90.00th=[ 129], 95.00th=[ 161], | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 380, per=25.85%, avg=110.64, stdev=67.31, samples=104 iops : min= 1, max= 23, avg= 6.07, stdev= 4.27, samples=104 write: IOPS=7, BW=115KiB/s (117kB/s)(6368KiB/55583msec); 0 zone resets clat (msec): min=17, max=354, avg=85.35, stdev=55.89 lat (msec): min=17, max=354, avg=85.35, stdev=55.89 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 51], 40.00th=[ 59], 50.00th=[ 69], 60.00th=[ 79], | 70.00th=[ 96], 80.00th=[ 123], 90.00th=[ 161], 95.00th=[ 199], | 99.00th=[ 313], 99.50th=[ 351], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 347, per=26.26%, avg=118.18, stdev=65.57, samples=105 iops : min= 1, max= 21, avg= 6.54, stdev= 4.16, samples=105 lat (msec) : 10=0.13%, 20=5.73%, 50=39.58%, 100=33.20%, 250=19.92% lat (msec) : 500=1.43% cpu : usr=0.04%, sys=1.83%, ctx=1269, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178861: Mon Aug 10 20:16:19 2026 read: IOPS=6, BW=103KiB/s (105kB/s)(5744KiB/55878msec) clat (msec): min=8, max=246, avg=57.75, stdev=46.70 lat (msec): min=8, max=246, avg=57.75, stdev=46.70 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 65], 80.00th=[ 86], 90.00th=[ 125], 95.00th=[ 163], | 99.00th=[ 232], 99.50th=[ 241], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 415, per=24.87%, avg=106.44, stdev=71.45, samples=104 iops : min= 1, max= 25, avg= 5.80, stdev= 4.53, samples=104 write: IOPS=7, BW=117KiB/s (120kB/s)(6544KiB/55878msec); 0 zone resets clat (msec): min=17, max=285, avg=85.59, stdev=54.04 lat (msec): min=17, max=285, avg=85.60, stdev=54.04 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 52], 40.00th=[ 63], 50.00th=[ 69], 60.00th=[ 81], | 70.00th=[ 99], 80.00th=[ 118], 90.00th=[ 171], 95.00th=[ 203], | 99.00th=[ 264], 99.50th=[ 271], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 317, per=25.85%, avg=116.31, stdev=65.08, samples=108 iops : min= 1, max= 19, avg= 6.43, stdev= 4.12, samples=108 lat (msec) : 10=0.26%, 20=6.77%, 50=35.29%, 100=34.51%, 250=22.14% lat (msec) : 500=1.04% cpu : usr=0.04%, sys=1.78%, ctx=1233, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178862: Mon Aug 10 20:16:19 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6256KiB/54947msec) clat (msec): min=10, max=287, avg=59.15, stdev=48.29 lat (msec): min=10, max=287, avg=59.15, stdev=48.29 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 67], 80.00th=[ 87], 90.00th=[ 124], 95.00th=[ 167], | 99.00th=[ 253], 99.50th=[ 259], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 30, max= 411, per=27.86%, avg=119.25, stdev=70.11, samples=103 iops : min= 1, max= 25, avg= 6.61, stdev= 4.42, samples=103 write: IOPS=6, BW=110KiB/s (112kB/s)(6032KiB/54947msec); 0 zone resets clat (msec): min=12, max=332, avg=84.13, stdev=52.68 lat (msec): min=12, max=332, avg=84.13, stdev=52.68 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 41], | 30.00th=[ 49], 40.00th=[ 59], 50.00th=[ 68], 60.00th=[ 84], | 70.00th=[ 100], 80.00th=[ 122], 90.00th=[ 165], 95.00th=[ 192], | 99.00th=[ 251], 99.50th=[ 305], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 30, max= 317, per=24.76%, avg=111.43, stdev=61.41, samples=105 iops : min= 1, max= 19, avg= 6.11, stdev= 3.91, samples=105 lat (msec) : 20=6.77%, 50=38.41%, 100=31.90%, 250=21.88%, 500=1.04% cpu : usr=0.05%, sys=1.76%, ctx=1223, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178863: Mon Aug 10 20:16:19 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55660msec) clat (msec): min=8, max=405, avg=61.10, stdev=54.19 lat (msec): min=8, max=405, avg=61.13, stdev=54.17 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 18], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 65], 80.00th=[ 89], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 266], 99.50th=[ 321], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 344, per=25.93%, avg=110.99, stdev=69.39, samples=105 iops : min= 1, max= 21, avg= 6.09, stdev= 4.43, samples=105 write: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55660msec); 0 zone resets clat (msec): min=16, max=358, avg=83.06, stdev=54.05 lat (msec): min=16, max=358, avg=83.07, stdev=54.06 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 48], 40.00th=[ 56], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 100], 80.00th=[ 121], 90.00th=[ 161], 95.00th=[ 186], | 99.00th=[ 275], 99.50th=[ 351], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 31, max= 344, per=24.96%, avg=112.31, stdev=67.61, samples=108 iops : min= 1, max= 21, avg= 6.18, stdev= 4.26, samples=108 lat (msec) : 10=0.65%, 20=5.99%, 50=39.84%, 100=30.08%, 250=22.27% lat (msec) : 500=1.17% cpu : usr=0.06%, sys=1.78%, ctx=1237, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=429KiB/s (439kB/s), 103KiB/s-114KiB/s (105kB/s-117kB/s), io=23.4MiB (24.5MB), run=54947-55878msec WRITE: bw=451KiB/s (462kB/s), 110KiB/s-117KiB/s (112kB/s-120kB/s), io=24.6MiB (25.8MB), run=54947-55878msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178888: Mon Aug 10 20:16:42 2026 read: IOPS=0, BW=658KiB/s (674kB/s)(7168KiB/10893msec) clat (usec): min=476, max=5671.5k, avg=1319777.95, stdev=2270174.57 lat (usec): min=476, max=5671.5k, avg=1319780.01, stdev=2270174.46 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], | 20.00th=[ 660], 30.00th=[ 1369], 40.00th=[ 1369], | 50.00th=[ 2540], 60.00th=[ 263193], 70.00th=[ 263193], | 80.00th=[3305112], 90.00th=[5670700], 95.00th=[5670700], | 99.00th=[5670700], 99.50th=[5670700], 99.90th=[5670700], | 99.95th=[5670700], 99.99th=[5670700] bw ( KiB/s): min= 1508, max= 6119, per=100.00%, avg=2926.50, stdev=2143.04, samples=4 iops : min= 1, max= 5, avg= 2.25, stdev= 1.89, samples=4 write: IOPS=0, BW=470KiB/s (481kB/s)(5120KiB/10893msec); 0 zone resets clat (msec): min=210, max=509, avg=302.16, stdev=123.89 lat (msec): min=210, max=510, avg=302.98, stdev=123.64 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2031, max= 4079, per=100.00%, avg=2716.33, stdev=1180.11, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=16.67%, 750=8.33% lat (msec) : >=2000=16.67% cpu : usr=0.00%, sys=5.25%, ctx=927, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178889: Mon Aug 10 20:16:42 2026 read: IOPS=0, BW=177KiB/s (181kB/s)(2048KiB/11581msec) clat (msec): min=171, max=591, avg=381.77, stdev=297.31 lat (msec): min=171, max=591, avg=381.77, stdev=297.31 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1992, max= 2043, per=100.00%, avg=2017.50, stdev=36.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=884KiB/s (905kB/s)(10.0MiB/11581msec); 0 zone resets clat (msec): min=169, max=4174, avg=1056.40, stdev=1488.34 lat (msec): min=169, max=4174, avg=1056.54, stdev=1488.35 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 222], | 30.00th=[ 330], 40.00th=[ 363], 50.00th=[ 372], 60.00th=[ 380], | 70.00th=[ 405], 80.00th=[ 617], 90.00th=[ 3540], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 1957, max= 4087, per=100.00%, avg=2586.43, stdev=988.10, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, >=2000=16.67% cpu : usr=0.02%, sys=5.14%, ctx=150, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178890: Mon Aug 10 20:16:42 2026 read: IOPS=0, BW=581KiB/s (595kB/s)(6144KiB/10574msec) clat (usec): min=652, max=384855, avg=167494.16, stdev=184843.27 lat (usec): min=654, max=384858, avg=167516.70, stdev=184821.37 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], 20.00th=[ 2671], | 30.00th=[ 2671], 40.00th=[ 5800], 50.00th=[ 5800], 60.00th=[258999], | 70.00th=[350225], 80.00th=[350225], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 3984, max= 4087, per=100.00%, avg=4035.50, stdev=72.83, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=581KiB/s (595kB/s)(6144KiB/10574msec); 0 zone resets clat (msec): min=209, max=4103, avg=1550.09, stdev=1938.37 lat (msec): min=210, max=4103, avg=1550.53, stdev=1938.13 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 468], | 70.00th=[ 4010], 80.00th=[ 4010], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 1585, max= 2043, per=77.71%, avg=1923.20, stdev=192.36, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=16.67%, 500=41.67%, >=2000=16.67% cpu : usr=0.01%, sys=4.34%, ctx=158, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178891: Mon Aug 10 20:16:42 2026 read: IOPS=0, BW=467KiB/s (478kB/s)(5120KiB/10966msec) clat (usec): min=572, max=286696, avg=105754.03, stdev=144798.64 lat (usec): min=574, max=286696, avg=105755.84, stdev=144797.92 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 644], 40.00th=[ 644], 50.00th=[ 881], 60.00th=[ 881], | 70.00th=[240124], 80.00th=[240124], 90.00th=[287310], 95.00th=[287310], | 99.00th=[287310], 99.50th=[287310], 99.90th=[287310], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 3984, max= 4087, per=100.00%, avg=4035.50, stdev=72.83, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=654KiB/s (669kB/s)(7168KiB/10966msec); 0 zone resets clat (msec): min=219, max=4222, avg=1439.65, stdev=1878.21 lat (msec): min=219, max=4223, avg=1439.90, stdev=1878.31 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 230], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 388], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 4144], 90.00th=[ 4212], 95.00th=[ 4212], | 99.00th=[ 4212], 99.50th=[ 4212], 99.90th=[ 4212], 99.95th=[ 4212], | 99.99th=[ 4212] bw ( KiB/s): min= 1957, max= 4063, per=97.76%, avg=2419.60, stdev=919.41, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67%, 1000=8.33% lat (msec) : 250=25.00%, 500=25.00%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=4.33%, ctx=245, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1768KiB/s (1811kB/s), 177KiB/s-658KiB/s (181kB/s-674kB/s), io=20.0MiB (20.0MB), run=10574-11581msec WRITE: bw=2476KiB/s (2535kB/s), 470KiB/s-884KiB/s (481kB/s-905kB/s), io=28.0MiB (29.4MB), run=10574-11581msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178883: Mon Aug 10 20:16:43 2026 read: IOPS=0, BW=581KiB/s (595kB/s)(7168KiB/12341msec) clat (msec): min=81, max=5262, avg=1465.81, stdev=2195.90 lat (msec): min=81, max=5262, avg=1465.81, stdev=2195.90 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 87], | 30.00th=[ 129], 40.00th=[ 129], 50.00th=[ 180], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 3977], 90.00th=[ 5269], 95.00th=[ 5269], | 99.00th=[ 5269], 99.50th=[ 5269], 99.90th=[ 5269], 99.95th=[ 5269], | 99.99th=[ 5269] bw ( KiB/s): min= 1418, max= 2043, per=100.00%, avg=1907.00, stdev=273.92, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=415KiB/s (425kB/s)(5120KiB/12341msec); 0 zone resets clat (msec): min=141, max=541, avg=364.73, stdev=164.39 lat (msec): min=141, max=542, avg=364.86, stdev=164.39 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 266], 40.00th=[ 266], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 2035, max= 2043, per=87.83%, avg=2040.33, stdev= 4.62, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, >=2000=16.67% cpu : usr=0.00%, sys=2.04%, ctx=88, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178884: Mon Aug 10 20:16:43 2026 read: IOPS=0, BW=177KiB/s (182kB/s)(2048KiB/11545msec) clat (msec): min=138, max=242, avg=190.92, stdev=73.64 lat (msec): min=138, max=242, avg=190.92, stdev=73.64 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 140], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 243], 95.00th=[ 243], | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 1434, max= 2039, per=100.00%, avg=1736.50, stdev=427.80, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=0, BW=887KiB/s (908kB/s)(10.0MiB/11545msec); 0 zone resets clat (msec): min=123, max=4128, avg=1097.29, stdev=1575.85 lat (msec): min=123, max=4128, avg=1097.47, stdev=1575.84 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 142], | 30.00th=[ 197], 40.00th=[ 201], 50.00th=[ 334], 60.00th=[ 363], | 70.00th=[ 642], 80.00th=[ 869], 90.00th=[ 3977], 95.00th=[ 4144], | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4144], 99.95th=[ 4144], | 99.99th=[ 4144] bw ( KiB/s): min= 1969, max= 4087, per=100.00%, avg=3037.50, stdev=1141.23, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33%, >=2000=16.67% cpu : usr=0.02%, sys=1.85%, ctx=90, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178885: Mon Aug 10 20:16:43 2026 read: IOPS=0, BW=520KiB/s (532kB/s)(6144KiB/11815msec) clat (msec): min=105, max=459, avg=317.36, stdev=147.47 lat (msec): min=105, max=459, avg=317.37, stdev=147.47 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 347], 50.00th=[ 347], 60.00th=[ 372], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1969, max= 2043, per=100.00%, avg=2012.40, stdev=36.83, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=520KiB/s (532kB/s)(6144KiB/11815msec); 0 zone resets clat (msec): min=168, max=4396, avg=1639.99, stdev=2071.46 lat (msec): min=168, max=4396, avg=1640.17, stdev=2071.46 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 651], | 70.00th=[ 4212], 80.00th=[ 4212], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 1976, max= 2797, per=95.21%, avg=2211.75, stdev=391.26, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.48%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178886: Mon Aug 10 20:16:43 2026 read: IOPS=0, BW=478KiB/s (490kB/s)(5120KiB/10709msec) clat (msec): min=125, max=388, avg=231.20, stdev=113.00 lat (msec): min=125, max=388, avg=231.20, stdev=113.00 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 127], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 180], 60.00th=[ 180], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2031, max= 3938, per=100.00%, avg=2669.33, stdev=1098.70, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=669KiB/s (685kB/s)(7168KiB/10709msec); 0 zone resets clat (msec): min=184, max=4082, avg=1343.77, stdev=1828.50 lat (msec): min=184, max=4083, avg=1344.25, stdev=1828.26 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 211], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 355], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 3943], 90.00th=[ 4077], 95.00th=[ 4077], | 99.00th=[ 4077], 99.50th=[ 4077], 99.90th=[ 4077], 99.95th=[ 4077], | 99.99th=[ 4077] bw ( KiB/s): min= 1477, max= 4087, per=100.00%, avg=2920.50, stdev=1365.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=50.00%, 500=33.33%, >=2000=16.67% cpu : usr=0.00%, sys=1.23%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1660KiB/s (1699kB/s), 177KiB/s-581KiB/s (182kB/s-595kB/s), io=20.0MiB (20.0MB), run=10709-12341msec WRITE: bw=2323KiB/s (2379kB/s), 415KiB/s-887KiB/s (425kB/s-908kB/s), io=28.0MiB (29.4MB), run=10709-12341msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178900: Mon Aug 10 20:17:03 2026 read: IOPS=0, BW=1899KiB/s (1944kB/s)(12.0MiB/6472msec) clat (msec): min=294, max=3598, avg=2069.78, stdev=1666.03 lat (msec): min=294, max=3598, avg=2069.78, stdev=1666.03 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 2333], 50.00th=[ 2333], 60.00th=[ 2333], | 70.00th=[ 3608], 80.00th=[ 3608], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 7984, max= 8159, per=100.00%, avg=8071.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.02%, sys=2.23%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178901: Mon Aug 10 20:17:03 2026 read: IOPS=0, BW=638KiB/s (653kB/s)(4096KiB/6420msec) clat (nsec): min=4100.8M, max=4100.8M, avg=4100846990.00, stdev= 0.00 lat (nsec): min=4100.8M, max=4100.8M, avg=4100850862.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4111], 5.00th=[ 4111], 10.00th=[ 4111], 20.00th=[ 4111], | 30.00th=[ 4111], 40.00th=[ 4111], 50.00th=[ 4111], 60.00th=[ 4111], | 70.00th=[ 4111], 80.00th=[ 4111], 90.00th=[ 4111], 95.00th=[ 4111], | 99.00th=[ 4111], 99.50th=[ 4111], 99.90th=[ 4111], 99.95th=[ 4111], | 99.99th=[ 4111] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1276KiB/s (1307kB/s)(8192KiB/6420msec); 0 zone resets clat (msec): min=797, max=1450, avg=1124.16, stdev=461.33 lat (msec): min=810, max=1460, avg=1135.72, stdev=459.49 clat percentiles (msec): | 1.00th=[ 802], 5.00th=[ 802], 10.00th=[ 802], 20.00th=[ 802], | 30.00th=[ 802], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 1452], | 70.00th=[ 1452], 80.00th=[ 1452], 90.00th=[ 1452], 95.00th=[ 1452], | 99.00th=[ 1452], 99.50th=[ 1452], 99.90th=[ 1452], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.46%, ctx=36, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178902: Mon Aug 10 20:17:03 2026 write: IOPS=0, BW=2094KiB/s (2144kB/s)(12.0MiB/5868msec); 0 zone resets clat (msec): min=896, max=3006, avg=1936.00, stdev=1055.23 lat (msec): min=897, max=3007, avg=1936.98, stdev=1055.27 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 1905], 50.00th=[ 1905], 60.00th=[ 1905], | 70.00th=[ 3004], 80.00th=[ 3004], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 7876, max= 8175, per=100.00%, avg=8025.50, stdev=211.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.27%, ctx=81, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178904: Mon Aug 10 20:17:03 2026 write: IOPS=0, BW=2275KiB/s (2329kB/s)(12.0MiB/5402msec); 0 zone resets clat (msec): min=407, max=2501, avg=1778.11, stdev=1187.96 lat (msec): min=407, max=2505, avg=1779.74, stdev=1188.81 clat percentiles (msec): | 1.00th=[ 409], 5.00th=[ 409], 10.00th=[ 409], 20.00th=[ 409], | 30.00th=[ 409], 40.00th=[ 2433], 50.00th=[ 2433], 60.00th=[ 2433], | 70.00th=[ 2500], 80.00th=[ 2500], 90.00th=[ 2500], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 5801, max= 7861, per=100.00%, avg=6831.00, stdev=1456.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=2.04%, ctx=31, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2532KiB/s (2592kB/s), 638KiB/s-1899KiB/s (653kB/s-1944kB/s), io=16.0MiB (16.8MB), run=6420-6472msec WRITE: bw=5104KiB/s (5227kB/s), 1276KiB/s-2275KiB/s (1307kB/s-2329kB/s), io=32.0MiB (33.6MB), run=5402-6420msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178903: Mon Aug 10 20:17:03 2026 read: IOPS=0, BW=2273KiB/s (2328kB/s)(12.0MiB/5406msec) clat (msec): min=1044, max=3168, avg=1788.56, stdev=1196.31 lat (msec): min=1044, max=3168, avg=1788.56, stdev=1196.31 clat percentiles (msec): | 1.00th=[ 1045], 5.00th=[ 1045], 10.00th=[ 1045], 20.00th=[ 1045], | 30.00th=[ 1045], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8000, max= 8159, per=100.00%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=5.61%, ctx=266, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178905: Mon Aug 10 20:17:03 2026 read: IOPS=0, BW=656KiB/s (671kB/s)(4096KiB/6248msec) clat (nsec): min=3292.3M, max=3292.3M, avg=3292325806.00, stdev= 0.00 lat (nsec): min=3292.3M, max=3292.3M, avg=3292328765.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3306], 5.00th=[ 3306], 10.00th=[ 3306], 20.00th=[ 3306], | 30.00th=[ 3306], 40.00th=[ 3306], 50.00th=[ 3306], 60.00th=[ 3306], | 70.00th=[ 3306], 80.00th=[ 3306], 90.00th=[ 3306], 95.00th=[ 3306], | 99.00th=[ 3306], 99.50th=[ 3306], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1311KiB/s (1343kB/s)(8192KiB/6248msec); 0 zone resets clat (msec): min=867, max=2027, avg=1447.23, stdev=819.93 lat (msec): min=867, max=2027, avg=1447.74, stdev=819.95 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 2022], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, >=2000=66.67% cpu : usr=0.06%, sys=3.97%, ctx=538, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178906: Mon Aug 10 20:17:03 2026 write: IOPS=0, BW=1875KiB/s (1920kB/s)(12.0MiB/6552msec); 0 zone resets clat (msec): min=158, max=4938, avg=2165.25, stdev=2480.28 lat (msec): min=158, max=4938, avg=2165.88, stdev=2480.27 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 4933], 80.00th=[ 4933], 90.00th=[ 4933], 95.00th=[ 4933], | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], | 99.99th=[ 4933] bw ( KiB/s): min= 7892, max= 7892, per=100.00%, avg=7892.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=1.48%, ctx=40, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178907: Mon Aug 10 20:17:03 2026 write: IOPS=0, BW=2202KiB/s (2255kB/s)(12.0MiB/5580msec); 0 zone resets clat (msec): min=529, max=3411, avg=1845.45, stdev=1457.05 lat (msec): min=530, max=3411, avg=1846.17, stdev=1456.97 clat percentiles (msec): | 1.00th=[ 531], 5.00th=[ 531], 10.00th=[ 531], 20.00th=[ 531], | 30.00th=[ 531], 40.00th=[ 1603], 50.00th=[ 1603], 60.00th=[ 1603], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 6681, max= 8015, per=100.00%, avg=7348.00, stdev=943.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.79%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2622KiB/s (2685kB/s), 656KiB/s-2273KiB/s (671kB/s-2328kB/s), io=16.0MiB (16.8MB), run=5406-6248msec WRITE: bw=5001KiB/s (5121kB/s), 1311KiB/s-2202KiB/s (1343kB/s-2255kB/s), io=32.0MiB (33.6MB), run=5580-6552msec