== sanity test 398b: DIO and buffer IO race ============== 00:02:01 (1787889721) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.32501 s, 9.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178737: Fri Aug 28 00:04:18 2026 read: IOPS=12, BW=49.0KiB/s (51.2kB/s)(5992KiB/119879msec) clat (usec): min=37, max=639449, avg=43029.14, stdev=32505.16 lat (usec): min=37, max=639450, avg=43033.51, stdev=32505.04 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 137], 10.00th=[ 15401], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[152044], 99.50th=[166724], 99.90th=[283116], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 5, max= 111, per=24.83%, avg=49.41, stdev=19.23, samples=236 iops : min= 1, max= 27, avg=11.71, stdev= 4.85, samples=236 write: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6296KiB/119879msec); 0 zone resets clat (usec): min=968, max=393622, avg=34897.57, stdev=35870.00 lat (usec): min=968, max=393623, avg=34908.15, stdev=35870.10 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1319], 10.00th=[ 1860], 20.00th=[ 3818], | 30.00th=[ 7832], 40.00th=[ 17433], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[102237], | 99.00th=[152044], 99.50th=[173016], 99.90th=[287310], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 167, per=25.10%, avg=52.20, stdev=24.01, samples=235 iops : min= 1, max= 41, avg=12.42, stdev= 6.00, samples=235 lat (usec) : 50=0.16%, 100=2.08%, 250=0.29%, 500=0.13%, 1000=0.13% lat (msec) : 2=5.70%, 4=4.85%, 10=6.71%, 20=9.96%, 50=41.70% lat (msec) : 100=23.54%, 250=4.62%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.34%, ctx=6668, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178738: Fri Aug 28 00:04:18 2026 read: IOPS=12, BW=50.8KiB/s (51.0kB/s)(5940KiB/117011msec) clat (usec): min=39, max=273262, avg=42661.46, stdev=29881.24 lat (usec): min=39, max=273264, avg=42663.82, stdev=29881.22 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 86], 10.00th=[ 15270], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[147850], 99.50th=[175113], 99.90th=[219153], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 5, max= 104, per=25.27%, avg=50.29, stdev=19.84, samples=231 iops : min= 1, max= 26, avg=11.94, stdev= 4.98, samples=231 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6348KiB/117011msec); 0 zone resets clat (usec): min=958, max=613694, avg=33529.26, stdev=38321.50 lat (usec): min=959, max=613695, avg=33534.19, stdev=38324.88 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1385], 10.00th=[ 1942], 20.00th=[ 3654], | 30.00th=[ 6718], 40.00th=[ 12518], 50.00th=[ 23725], 60.00th=[ 32375], | 70.00th=[ 42730], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[106431], | 99.00th=[158335], 99.50th=[183501], 99.90th=[329253], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 7, max= 119, per=25.99%, avg=54.06, stdev=23.05, samples=230 iops : min= 1, max= 29, avg=12.87, stdev= 5.81, samples=230 lat (usec) : 50=0.33%, 100=2.34%, 250=0.20%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.24%, 4=6.05%, 10=8.20%, 20=10.38%, 50=39.39% lat (msec) : 100=22.49%, 250=5.05%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.50%, ctx=6694, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178740: Fri Aug 28 00:04:18 2026 read: IOPS=12, BW=50.1KiB/s (51.3kB/s)(6028KiB/120372msec) clat (usec): min=35, max=285459, avg=43777.11, stdev=30151.06 lat (usec): min=35, max=285460, avg=43782.04, stdev=30150.24 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 8717], 10.00th=[ 16188], 20.00th=[ 21365], | 30.00th=[ 26870], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[156238], 99.50th=[179307], 99.90th=[225444], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 103, per=25.12%, avg=49.98, stdev=19.68, samples=235 iops : min= 1, max= 25, avg=11.85, stdev= 4.92, samples=235 write: IOPS=13, BW=52.0KiB/s (53.3kB/s)(6260KiB/120372msec); 0 zone resets clat (usec): min=948, max=653246, avg=34456.96, stdev=38230.20 lat (usec): min=949, max=653251, avg=34459.75, stdev=38230.25 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1385], 10.00th=[ 2024], 20.00th=[ 3720], | 30.00th=[ 7111], 40.00th=[ 16712], 50.00th=[ 25822], 60.00th=[ 33817], | 70.00th=[ 44303], 80.00th=[ 59507], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[158335], 99.50th=[181404], 99.90th=[392168], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 143, per=24.82%, avg=51.64, stdev=21.51, samples=236 iops : min= 1, max= 35, avg=12.27, stdev= 5.41, samples=236 lat (usec) : 50=0.23%, 100=1.66%, 250=0.29%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=5.11%, 4=5.66%, 10=7.10%, 20=10.29%, 50=40.49% lat (msec) : 100=24.48%, 250=4.43%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.27%, ctx=6768, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178742: Fri Aug 28 00:04:18 2026 read: IOPS=12, BW=51.8KiB/s (53.0kB/s)(6052KiB/116857msec) clat (usec): min=29, max=589825, avg=41613.09, stdev=30292.12 lat (usec): min=30, max=589826, avg=41618.81, stdev=30290.88 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 9241], 10.00th=[ 15008], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 59507], 90.00th=[ 76022], 95.00th=[ 91751], | 99.00th=[128451], 99.50th=[160433], 99.90th=[223347], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 119, per=25.86%, avg=51.45, stdev=21.49, samples=229 iops : min= 1, max= 29, avg=12.23, stdev= 5.42, samples=229 write: IOPS=13, BW=53.4KiB/s (54.6kB/s)(6236KiB/116857msec); 0 zone resets clat (usec): min=1001, max=324667, avg=34294.30, stdev=37326.65 lat (usec): min=1002, max=324669, avg=34299.16, stdev=37327.06 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1434], 10.00th=[ 2089], 20.00th=[ 3785], | 30.00th=[ 6521], 40.00th=[ 14091], 50.00th=[ 23462], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[106431], | 99.00th=[164627], 99.50th=[204473], 99.90th=[316670], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 158, per=25.36%, avg=52.75, stdev=21.34, samples=230 iops : min= 1, max= 39, avg=12.56, stdev= 5.36, samples=230 lat (usec) : 50=0.16%, 100=1.66%, 250=0.26%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.75%, 4=6.12%, 10=7.78%, 20=11.23%, 50=40.79% lat (msec) : 100=22.40%, 250=4.62%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.57%, ctx=6682, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=199KiB/s (204kB/s), 49.0KiB/s-51.8KiB/s (51.2kB/s-53.0kB/s), io=23.4MiB (24.6MB), run=116857-120372msec WRITE: bw=209KiB/s (214kB/s), 52.0KiB/s-54.3KiB/s (53.3kB/s-55.6kB/s), io=24.6MiB (25.7MB), run=116857-120372msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178736: Fri Aug 28 00:04:58 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(5992KiB/160696msec) clat (msec): min=5, max=638, avg=41.42, stdev=40.40 lat (msec): min=5, max=638, avg=41.42, stdev=40.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 122], | 99.00th=[ 182], 99.50th=[ 226], 99.90th=[ 313], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 159, per=25.56%, avg=38.09, stdev=25.88, samples=307 iops : min= 1, max= 39, avg= 8.85, stdev= 6.50, samples=307 write: IOPS=9, BW=39.2KiB/s (40.1kB/s)(6296KiB/160696msec); 0 zone resets clat (msec): min=12, max=531, avg=62.42, stdev=46.18 lat (msec): min=12, max=531, avg=62.42, stdev=46.18 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 243], 99.90th=[ 401], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 7, max= 135, per=25.06%, avg=39.09, stdev=24.39, samples=314 iops : min= 1, max= 33, avg= 9.10, stdev= 6.14, samples=314 lat (msec) : 10=2.28%, 20=15.89%, 50=45.54%, 100=23.99%, 250=11.91% lat (msec) : 500=0.33%, 750=0.07% cpu : usr=0.06%, sys=1.89%, ctx=4809, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178739: Fri Aug 28 00:04:58 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(5940KiB/160946msec) clat (msec): min=5, max=621, avg=42.23, stdev=44.00 lat (msec): min=5, max=621, avg=42.24, stdev=44.00 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 92], 95.00th=[ 133], | 99.00th=[ 218], 99.50th=[ 253], 99.90th=[ 405], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 144, per=25.27%, avg=37.65, stdev=26.34, samples=307 iops : min= 1, max= 36, avg= 8.75, stdev= 6.64, samples=307 write: IOPS=9, BW=39.4KiB/s (40.4kB/s)(6348KiB/160946msec); 0 zone resets clat (msec): min=11, max=511, avg=61.63, stdev=43.42 lat (msec): min=11, max=511, avg=61.63, stdev=43.42 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 70], 80.00th=[ 88], 90.00th=[ 117], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 241], 99.90th=[ 401], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 7, max= 143, per=24.99%, avg=38.99, stdev=23.89, samples=316 iops : min= 1, max= 35, avg= 9.08, stdev= 6.00, samples=316 lat (msec) : 10=2.47%, 20=15.66%, 50=45.41%, 100=24.32%, 250=11.69% lat (msec) : 500=0.39%, 750=0.07% cpu : usr=0.06%, sys=1.85%, ctx=4730, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178741: Fri Aug 28 00:04:58 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6028KiB/159443msec) clat (msec): min=5, max=238, avg=41.41, stdev=34.95 lat (msec): min=5, max=238, avg=41.42, stdev=34.95 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 116], | 99.00th=[ 163], 99.50th=[ 182], 99.90th=[ 201], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 127, per=25.66%, avg=38.23, stdev=25.04, samples=307 iops : min= 1, max= 31, avg= 8.89, stdev= 6.29, samples=307 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6260KiB/159443msec); 0 zone resets clat (msec): min=12, max=640, avg=61.74, stdev=48.24 lat (msec): min=12, max=640, avg=61.74, stdev=48.24 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 69], 80.00th=[ 88], 90.00th=[ 114], 95.00th=[ 148], | 99.00th=[ 232], 99.50th=[ 309], 99.90th=[ 527], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 7, max= 127, per=25.02%, avg=39.03, stdev=25.26, samples=312 iops : min= 1, max= 31, avg= 9.09, stdev= 6.35, samples=312 lat (msec) : 10=1.82%, 20=15.85%, 50=45.61%, 100=25.23%, 250=11.17% lat (msec) : 500=0.26%, 750=0.07% cpu : usr=0.07%, sys=1.84%, ctx=4886, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178743: Fri Aug 28 00:04:58 2026 read: IOPS=9, BW=37.7KiB/s (38.6kB/s)(6052KiB/160599msec) clat (msec): min=5, max=407, avg=42.02, stdev=38.79 lat (msec): min=5, max=407, avg=42.03, stdev=38.79 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 90], 95.00th=[ 121], | 99.00th=[ 190], 99.50th=[ 228], 99.90th=[ 393], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 159, per=25.81%, avg=38.45, stdev=26.27, samples=306 iops : min= 1, max= 39, avg= 8.94, stdev= 6.60, samples=306 write: IOPS=9, BW=38.8KiB/s (39.8kB/s)(6236KiB/160599msec); 0 zone resets clat (msec): min=9, max=628, avg=61.96, stdev=45.35 lat (msec): min=9, max=628, avg=61.97, stdev=45.34 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 123], 95.00th=[ 146], | 99.00th=[ 218], 99.50th=[ 243], 99.90th=[ 376], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 111, per=24.65%, avg=38.45, stdev=23.78, samples=315 iops : min= 1, max= 27, avg= 8.94, stdev= 5.99, samples=315 lat (msec) : 10=1.99%, 20=15.46%, 50=46.61%, 100=23.44%, 250=12.17% lat (msec) : 500=0.29%, 750=0.03% cpu : usr=0.07%, sys=1.89%, ctx=4857, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 36.9KiB/s-37.8KiB/s (37.8kB/s-38.7kB/s), io=23.4MiB (24.6MB), run=159443-160946msec WRITE: bw=156KiB/s (160kB/s), 38.8KiB/s-39.4KiB/s (39.8kB/s-40.4kB/s), io=24.6MiB (25.7MB), run=159443-160946msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178784: Fri Aug 28 00:05:39 2026 read: IOPS=12, BW=197KiB/s (202kB/s)(5920KiB/30054msec) clat (usec): min=37, max=192584, avg=43967.83, stdev=29461.47 lat (usec): min=37, max=192586, avg=43969.34, stdev=29461.40 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 12387], 20.00th=[ 23462], | 30.00th=[ 28967], 40.00th=[ 33424], 50.00th=[ 39584], 60.00th=[ 44827], | 70.00th=[ 51643], 80.00th=[ 61604], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[179307], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 63, max= 347, per=24.78%, avg=194.51, stdev=68.96, samples=59 iops : min= 3, max= 21, avg=11.39, stdev= 4.37, samples=59 write: IOPS=13, BW=212KiB/s (217kB/s)(6368KiB/30054msec); 0 zone resets clat (usec): min=1475, max=162608, avg=34184.97, stdev=35121.50 lat (usec): min=1477, max=162610, avg=34191.48, stdev=35119.59 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2089], 10.00th=[ 3228], 20.00th=[ 5080], | 30.00th=[ 7963], 40.00th=[ 13435], 50.00th=[ 22152], 60.00th=[ 31065], | 70.00th=[ 44303], 80.00th=[ 60556], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[156238], 99.50th=[158335], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 62, max= 416, per=25.47%, avg=210.39, stdev=82.63, samples=59 iops : min= 3, max= 26, avg=12.39, stdev= 5.27, samples=59 lat (usec) : 50=0.26%, 100=3.65%, 250=0.52% lat (msec) : 2=2.21%, 4=5.34%, 10=11.07%, 20=7.81%, 50=39.71% lat (msec) : 100=24.35%, 250=5.08% cpu : usr=0.05%, sys=5.78%, ctx=1742, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178785: Fri Aug 28 00:05:39 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(5744KiB/30072msec) clat (usec): min=37, max=165322, avg=43935.01, stdev=28517.82 lat (usec): min=37, max=165323, avg=43937.58, stdev=28517.26 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 71], 10.00th=[ 11469], 20.00th=[ 23200], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 40109], 60.00th=[ 45351], | 70.00th=[ 54264], 80.00th=[ 61080], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[154141], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 382, per=24.04%, avg=188.75, stdev=75.75, samples=59 iops : min= 3, max= 23, avg=11.03, stdev= 4.75, samples=59 write: IOPS=13, BW=218KiB/s (223kB/s)(6544KiB/30072msec); 0 zone resets clat (usec): min=1535, max=230074, avg=34487.02, stdev=35442.10 lat (usec): min=1538, max=230075, avg=34498.89, stdev=35444.89 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 2278], 10.00th=[ 3490], 20.00th=[ 5473], | 30.00th=[ 9372], 40.00th=[ 14877], 50.00th=[ 23987], 60.00th=[ 32637], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 86508], 95.00th=[107480], | 99.00th=[143655], 99.50th=[164627], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 63, max= 477, per=26.02%, avg=214.90, stdev=85.40, samples=59 iops : min= 3, max= 29, avg=12.68, stdev= 5.45, samples=59 lat (usec) : 50=0.13%, 100=3.12%, 250=0.65%, 500=0.13% lat (msec) : 2=1.56%, 4=4.69%, 10=11.07%, 20=9.38%, 50=40.23% lat (msec) : 100=23.57%, 250=5.47% cpu : usr=0.10%, sys=5.73%, ctx=1789, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178786: Fri Aug 28 00:05:39 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(6256KiB/30499msec) clat (usec): min=31, max=159828, avg=43767.02, stdev=26673.45 lat (usec): min=31, max=159830, avg=43768.48, stdev=26673.46 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 77], 10.00th=[ 15270], 20.00th=[ 24773], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 63701], 90.00th=[ 76022], 95.00th=[ 84411], | 99.00th=[131597], 99.50th=[158335], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 31, max= 351, per=26.18%, avg=205.52, stdev=74.84, samples=60 iops : min= 1, max= 21, avg=12.08, stdev= 4.72, samples=60 write: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30499msec); 0 zone resets clat (usec): min=1697, max=163306, avg=35302.44, stdev=35006.67 lat (usec): min=1699, max=163309, avg=35306.40, stdev=35006.92 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2278], 10.00th=[ 3589], 20.00th=[ 6194], | 30.00th=[ 9896], 40.00th=[ 15008], 50.00th=[ 22676], 60.00th=[ 31065], | 70.00th=[ 43254], 80.00th=[ 61604], 90.00th=[ 90702], 95.00th=[105382], | 99.00th=[149947], 99.50th=[152044], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 63, max= 384, per=23.80%, avg=196.62, stdev=83.56, samples=60 iops : min= 3, max= 24, avg=11.52, stdev= 5.32, samples=60 lat (usec) : 50=0.13%, 100=3.26%, 250=0.65%, 750=0.13% lat (msec) : 2=1.82%, 4=4.69%, 10=9.11%, 20=8.98%, 50=40.89% lat (msec) : 100=25.00%, 250=5.34% cpu : usr=0.08%, sys=5.64%, ctx=1798, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178787: Fri Aug 28 00:05:39 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28836msec) clat (usec): min=53, max=257979, avg=44596.26, stdev=33490.88 lat (usec): min=53, max=257980, avg=44599.04, stdev=33490.12 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 68], 10.00th=[ 186], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 32900], 50.00th=[ 40633], 60.00th=[ 46924], | 70.00th=[ 53740], 80.00th=[ 65799], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[166724], 99.50th=[248513], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 63, max= 383, per=26.57%, avg=208.58, stdev=67.82, samples=57 iops : min= 3, max= 23, avg=12.28, stdev= 4.28, samples=57 write: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28836msec); 0 zone resets clat (usec): min=1633, max=165326, avg=30392.43, stdev=30761.35 lat (usec): min=1635, max=165328, avg=30400.15, stdev=30756.74 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2409], 10.00th=[ 3097], 20.00th=[ 5276], | 30.00th=[ 8586], 40.00th=[ 12649], 50.00th=[ 20841], 60.00th=[ 28443], | 70.00th=[ 35914], 80.00th=[ 50070], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[133694], 99.50th=[154141], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 445, per=26.27%, avg=216.98, stdev=81.97, samples=57 iops : min= 3, max= 27, avg=12.81, stdev= 5.20, samples=57 lat (usec) : 100=4.17%, 250=0.78%, 500=0.52%, 750=0.13% lat (msec) : 2=1.95%, 4=6.25%, 10=8.98%, 20=10.94%, 50=39.19% lat (msec) : 100=22.92%, 250=4.04%, 500=0.13% cpu : usr=0.08%, sys=6.01%, ctx=1716, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=785KiB/s (804kB/s), 191KiB/s-209KiB/s (196kB/s-214kB/s), io=23.4MiB (24.5MB), run=28836-30499msec WRITE: bw=826KiB/s (846kB/s), 198KiB/s-218KiB/s (203kB/s-223kB/s), io=24.6MiB (25.8MB), run=28836-30499msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178789: Fri Aug 28 00:05:53 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5920KiB/43247msec) clat (msec): min=7, max=259, avg=45.58, stdev=38.39 lat (msec): min=7, max=259, avg=45.58, stdev=38.39 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 97], 95.00th=[ 128], | 99.00th=[ 197], 99.50th=[ 218], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 416, per=24.94%, avg=137.14, stdev=78.42, samples=84 iops : min= 1, max= 26, avg= 7.80, stdev= 4.94, samples=84 write: IOPS=9, BW=147KiB/s (151kB/s)(6368KiB/43247msec); 0 zone resets clat (msec): min=17, max=304, avg=66.04, stdev=40.45 lat (msec): min=17, max=304, avg=66.04, stdev=40.45 clat percentiles (msec): | 1.00th=[ 21], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 63], | 70.00th=[ 72], 80.00th=[ 92], 90.00th=[ 125], 95.00th=[ 140], | 99.00th=[ 224], 99.50th=[ 296], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 25, max= 349, per=25.61%, avg=148.31, stdev=76.67, samples=84 iops : min= 1, max= 21, avg= 8.50, stdev= 4.87, samples=84 lat (msec) : 10=0.13%, 20=9.64%, 50=47.79%, 100=28.91%, 250=13.02% lat (msec) : 500=0.52% cpu : usr=0.07%, sys=1.79%, ctx=1163, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178790: Fri Aug 28 00:05:53 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5744KiB/43221msec) clat (msec): min=8, max=259, avg=44.86, stdev=37.41 lat (msec): min=8, max=259, avg=44.86, stdev=37.41 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 61], 90.00th=[ 104], 95.00th=[ 130], | 99.00th=[ 192], 99.50th=[ 222], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 26, max= 415, per=24.60%, avg=135.29, stdev=82.88, samples=83 iops : min= 1, max= 25, avg= 7.67, stdev= 5.24, samples=83 write: IOPS=9, BW=151KiB/s (155kB/s)(6544KiB/43221msec); 0 zone resets clat (msec): min=18, max=313, avg=66.05, stdev=37.91 lat (msec): min=18, max=313, avg=66.07, stdev=37.91 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 29], 10.00th=[ 32], 20.00th=[ 38], | 30.00th=[ 43], 40.00th=[ 49], 50.00th=[ 57], 60.00th=[ 64], | 70.00th=[ 75], 80.00th=[ 90], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 207], 99.50th=[ 245], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 320, per=25.97%, avg=150.39, stdev=70.85, samples=85 iops : min= 1, max= 20, avg= 8.64, stdev= 4.51, samples=85 lat (msec) : 10=0.39%, 20=8.20%, 50=47.53%, 100=31.77%, 250=11.72% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.91%, ctx=1141, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178791: Fri Aug 28 00:05:53 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6256KiB/43062msec) clat (msec): min=7, max=216, avg=43.50, stdev=34.98 lat (msec): min=7, max=216, avg=43.50, stdev=34.98 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 92], 95.00th=[ 125], | 99.00th=[ 182], 99.50th=[ 186], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 437, per=26.76%, avg=147.19, stdev=94.92, samples=84 iops : min= 1, max= 27, avg= 8.43, stdev= 6.05, samples=84 write: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43062msec); 0 zone resets clat (msec): min=20, max=283, avg=68.87, stdev=43.54 lat (msec): min=20, max=283, avg=68.88, stdev=43.54 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 128], 95.00th=[ 150], | 99.00th=[ 230], 99.50th=[ 259], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 351, per=24.36%, avg=141.02, stdev=66.30, samples=84 iops : min= 1, max= 21, avg= 8.04, stdev= 4.24, samples=84 lat (msec) : 10=0.65%, 20=10.16%, 50=48.57%, 100=26.95%, 250=13.41% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.86%, ctx=1193, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178792: Fri Aug 28 00:05:53 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6032KiB/43520msec) clat (msec): min=9, max=215, avg=46.35, stdev=37.55 lat (msec): min=9, max=215, avg=46.36, stdev=37.55 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 133], | 99.00th=[ 192], 99.50th=[ 203], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 343, per=25.48%, avg=140.13, stdev=79.86, samples=82 iops : min= 1, max= 21, avg= 7.99, stdev= 5.01, samples=82 write: IOPS=8, BW=144KiB/s (147kB/s)(6256KiB/43520msec); 0 zone resets clat (msec): min=15, max=307, avg=66.26, stdev=44.41 lat (msec): min=15, max=307, avg=66.27, stdev=44.41 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 36], | 30.00th=[ 41], 40.00th=[ 46], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 89], 90.00th=[ 123], 95.00th=[ 165], | 99.00th=[ 241], 99.50th=[ 253], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 351, per=24.44%, avg=141.51, stdev=73.92, samples=85 iops : min= 1, max= 21, avg= 8.07, stdev= 4.76, samples=85 lat (msec) : 10=0.26%, 20=10.42%, 50=49.61%, 100=26.69%, 250=12.76% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=1.84%, ctx=1179, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=550KiB/s (564kB/s), 133KiB/s-145KiB/s (136kB/s-149kB/s), io=23.4MiB (24.5MB), run=43062-43520msec WRITE: bw=579KiB/s (593kB/s), 140KiB/s-151KiB/s (143kB/s-155kB/s), io=24.6MiB (25.8MB), run=43062-43520msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178804: Fri Aug 28 00:06:08 2026 read: IOPS=2, BW=2119KiB/s (2170kB/s)(7168KiB/3382msec) clat (usec): min=554, max=378153, avg=170564.08, stdev=116789.37 lat (usec): min=555, max=378155, avg=170566.48, stdev=116789.13 clat percentiles (usec): | 1.00th=[ 553], 5.00th=[ 553], 10.00th=[ 553], 20.00th=[ 82314], | 30.00th=[164627], 40.00th=[164627], 50.00th=[170918], 60.00th=[181404], | 70.00th=[181404], 80.00th=[214959], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2023, max= 3992, per=68.69%, avg=3010.50, stdev=1128.75, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1514KiB/s (1550kB/s)(5120KiB/3382msec); 0 zone resets clat (msec): min=177, max=600, avg=414.16, stdev=163.70 lat (msec): min=177, max=600, avg=414.26, stdev=163.70 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1935, max= 2043, per=32.63%, avg=2002.00, stdev=47.03, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=17.63%, ctx=274, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178805: Fri Aug 28 00:06:08 2026 read: IOPS=0, BW=438KiB/s (449kB/s)(2048KiB/4672msec) clat (msec): min=117, max=299, avg=208.57, stdev=128.43 lat (msec): min=117, max=299, avg=208.58, stdev=128.41 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2031, max= 2043, per=46.48%, avg=2037.00, stdev= 8.49, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2192KiB/s (2244kB/s)(10.0MiB/4672msec); 0 zone resets clat (msec): min=163, max=695, avg=421.65, stdev=183.82 lat (msec): min=163, max=695, avg=421.74, stdev=183.81 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 222], | 30.00th=[ 321], 40.00th=[ 338], 50.00th=[ 355], 60.00th=[ 368], | 70.00th=[ 481], 80.00th=[ 634], 90.00th=[ 642], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1935, max= 4087, per=42.29%, avg=2595.14, stdev=1016.95, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=50.00%, 750=25.00% cpu : usr=0.00%, sys=17.92%, ctx=246, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178806: Fri Aug 28 00:06:08 2026 read: IOPS=1, BW=1990KiB/s (2038kB/s)(6144KiB/3087msec) clat (usec): min=537, max=363420, avg=84638.29, stdev=140702.24 lat (usec): min=538, max=363421, avg=84639.65, stdev=140702.24 clat percentiles (usec): | 1.00th=[ 537], 5.00th=[ 537], 10.00th=[ 537], 20.00th=[ 1188], | 30.00th=[ 1188], 40.00th=[ 3032], 50.00th=[ 3032], 60.00th=[ 61604], | 70.00th=[ 78119], 80.00th=[ 78119], 90.00th=[362808], 95.00th=[362808], | 99.00th=[362808], 99.50th=[362808], 99.90th=[362808], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 3778, max= 4071, per=89.54%, avg=3924.50, stdev=207.18, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1990KiB/s (2038kB/s)(6144KiB/3087msec); 0 zone resets clat (msec): min=220, max=916, avg=411.78, stdev=256.88 lat (msec): min=220, max=916, avg=411.88, stdev=256.87 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 317], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1395, max= 2035, per=30.50%, avg=1871.40, stdev=273.00, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=16.67%, 250=8.33%, 500=41.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=17.89%, ctx=149, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178807: Fri Aug 28 00:06:08 2026 read: IOPS=1, BW=1473KiB/s (1509kB/s)(5120KiB/3475msec) clat (msec): min=3, max=348, avg=180.77, stdev=166.49 lat (msec): min=3, max=348, avg=180.77, stdev=166.49 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 4], | 30.00th=[ 4], 40.00th=[ 4], 50.00th=[ 241], 60.00th=[ 241], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2063KiB/s (2112kB/s)(7168KiB/3475msec); 0 zone resets clat (msec): min=159, max=659, avg=360.22, stdev=191.12 lat (msec): min=160, max=659, avg=360.54, stdev=190.85 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 218], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 284], 60.00th=[ 351], | 70.00th=[ 351], 80.00th=[ 592], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 1444, max= 4087, per=43.50%, avg=2669.40, stdev=1181.81, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 4=16.67%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.00%, sys=19.14%, ctx=184, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4384KiB/s (4489kB/s), 438KiB/s-2119KiB/s (449kB/s-2170kB/s), io=20.0MiB (20.0MB), run=3087-4672msec WRITE: bw=6137KiB/s (6284kB/s), 1514KiB/s-2192KiB/s (1550kB/s-2244kB/s), io=28.0MiB (29.4MB), run=3087-4672msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178809: Fri Aug 28 00:06:08 2026 read: IOPS=1, BW=1665KiB/s (1705kB/s)(7168KiB/4305msec) clat (msec): min=67, max=807, avg=371.74, stdev=333.39 lat (msec): min=67, max=807, avg=371.74, stdev=333.39 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 105], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 148], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 776], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 1744, max= 2043, per=44.39%, avg=1968.33, stdev=113.88, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=1, BW=1189KiB/s (1218kB/s)(5120KiB/4305msec); 0 zone resets clat (msec): min=135, max=478, avg=325.23, stdev=160.93 lat (msec): min=136, max=478, avg=325.34, stdev=160.93 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2031, max= 4096, per=43.83%, avg=2720.67, stdev=1191.08, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=4.00%, ctx=76, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178810: Fri Aug 28 00:06:08 2026 read: IOPS=0, BW=443KiB/s (454kB/s)(2048KiB/4618msec) clat (msec): min=129, max=191, avg=160.49, stdev=43.65 lat (msec): min=129, max=191, avg=160.49, stdev=43.65 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 130], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1670, max= 2048, per=41.93%, avg=1859.00, stdev=267.29, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2217KiB/s (2271kB/s)(10.0MiB/4618msec); 0 zone resets clat (msec): min=70, max=824, avg=417.93, stdev=228.30 lat (msec): min=70, max=824, avg=418.32, stdev=228.41 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 199], | 30.00th=[ 255], 40.00th=[ 313], 50.00th=[ 326], 60.00th=[ 485], | 70.00th=[ 489], 80.00th=[ 567], 90.00th=[ 659], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1965, max= 4063, per=37.99%, avg=2358.33, stdev=835.76, samples=6 iops : min= 1, max= 3, avg= 1.50, stdev= 0.84, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.02%, sys=7.39%, ctx=143, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178811: Fri Aug 28 00:06:08 2026 read: IOPS=1, BW=1455KiB/s (1489kB/s)(6144KiB/4224msec) clat (msec): min=72, max=379, avg=227.72, stdev=127.21 lat (msec): min=72, max=379, avg=227.72, stdev=127.21 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 117], | 30.00th=[ 117], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 266], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1992, max= 3930, per=56.39%, avg=2500.25, stdev=953.45, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1455KiB/s (1489kB/s)(6144KiB/4224msec); 0 zone resets clat (msec): min=129, max=1265, avg=445.16, stdev=426.29 lat (msec): min=129, max=1265, avg=445.25, stdev=426.31 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 305], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1762, max= 2048, per=31.79%, avg=1973.50, stdev=108.47, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.68%, ctx=107, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178812: Fri Aug 28 00:06:08 2026 read: IOPS=1, BW=1112KiB/s (1138kB/s)(5120KiB/4606msec) clat (msec): min=83, max=267, avg=162.16, stdev=77.76 lat (msec): min=83, max=267, avg=162.18, stdev=77.74 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 84], | 30.00th=[ 112], 40.00th=[ 112], 50.00th=[ 130], 60.00th=[ 130], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 268], 95.00th=[ 268], | 99.00th=[ 268], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 4063, max= 4096, per=92.00%, avg=4079.50, stdev=23.33, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1556KiB/s (1594kB/s)(7168KiB/4606msec); 0 zone resets clat (msec): min=73, max=1149, avg=513.89, stdev=368.92 lat (msec): min=73, max=1149, avg=514.00, stdev=368.91 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 136], | 30.00th=[ 351], 40.00th=[ 351], 50.00th=[ 592], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 701], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 1992, max= 2048, per=32.71%, avg=2030.50, stdev=25.93, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=8.03%, ctx=114, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4435KiB/s (4541kB/s), 443KiB/s-1665KiB/s (454kB/s-1705kB/s), io=20.0MiB (20.0MB), run=4224-4618msec WRITE: bw=6209KiB/s (6358kB/s), 1189KiB/s-2217KiB/s (1218kB/s-2271kB/s), io=28.0MiB (29.4MB), run=4224-4618msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178818: Fri Aug 28 00:06:22 2026 read: IOPS=1, BW=4415KiB/s (4521kB/s)(12.0MiB/2783msec) clat (msec): min=821, max=997, avg=905.00, stdev=88.08 lat (msec): min=821, max=997, avg=905.01, stdev=88.08 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=15.03%, ctx=326, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178819: Fri Aug 28 00:06:22 2026 read: IOPS=0, BW=1339KiB/s (1371kB/s)(4096KiB/3059msec) clat (nsec): min=763271k, max=763271k, avg=763271474.00, stdev= 0.00 lat (nsec): min=763275k, max=763275k, avg=763274873.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2678KiB/s (2742kB/s)(8192KiB/3059msec); 0 zone resets clat (msec): min=1073, max=1109, avg=1091.23, stdev=25.55 lat (msec): min=1073, max=1110, avg=1091.74, stdev=25.94 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8110, max= 8110, per=95.86%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.62%, ctx=121, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178820: Fri Aug 28 00:06:22 2026 write: IOPS=0, BW=3173KiB/s (3249kB/s)(12.0MiB/3873msec); 0 zone resets clat (msec): min=221, max=2365, avg=1250.80, stdev=1074.85 lat (msec): min=221, max=2368, avg=1252.03, stdev=1075.94 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8175, max= 8175, per=96.63%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.31%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178821: Fri Aug 28 00:06:22 2026 write: IOPS=1, BW=4115KiB/s (4214kB/s)(12.0MiB/2986msec); 0 zone resets clat (msec): min=556, max=1550, avg=955.27, stdev=525.43 lat (msec): min=557, max=1551, avg=955.70, stdev=525.42 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 760], 50.00th=[ 760], 60.00th=[ 760], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 5461, max= 8126, per=80.30%, avg=6793.50, stdev=1884.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.56%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5356KiB/s (5485kB/s), 1339KiB/s-4415KiB/s (1371kB/s-4521kB/s), io=16.0MiB (16.8MB), run=2783-3059msec WRITE: bw=8461KiB/s (8664kB/s), 2678KiB/s-4115KiB/s (2742kB/s-4214kB/s), io=32.0MiB (33.6MB), run=2986-3873msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178823: Fri Aug 28 00:06:23 2026 read: IOPS=0, BW=3992KiB/s (4088kB/s)(12.0MiB/3078msec) clat (msec): min=235, max=1656, avg=1024.66, stdev=723.48 lat (msec): min=235, max=1656, avg=1024.66, stdev=723.49 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.06%, sys=3.74%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178824: Fri Aug 28 00:06:23 2026 read: IOPS=0, BW=1200KiB/s (1229kB/s)(4096KiB/3412msec) clat (nsec): min=1376.4M, max=1376.4M, avg=1376411282.00, stdev= 0.00 lat (nsec): min=1376.4M, max=1376.4M, avg=1376412740.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2401KiB/s (2459kB/s)(8192KiB/3412msec); 0 zone resets clat (msec): min=832, max=1201, avg=1016.75, stdev=260.71 lat (msec): min=832, max=1201, avg=1017.28, stdev=260.75 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8143, max= 8143, per=84.80%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.13%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178825: Fri Aug 28 00:06:23 2026 write: IOPS=1, BW=4180KiB/s (4280kB/s)(12.0MiB/2940msec); 0 zone resets clat (msec): min=942, max=996, avg=966.03, stdev=27.82 lat (msec): min=942, max=997, avg=966.47, stdev=27.88 clat percentiles (msec): | 1.00th=[ 944], 5.00th=[ 944], 10.00th=[ 944], 20.00th=[ 944], | 30.00th=[ 944], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8126, max= 8143, per=84.71%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=3.88%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178826: Fri Aug 28 00:06:23 2026 write: IOPS=1, BW=4228KiB/s (4330kB/s)(12.0MiB/2906msec); 0 zone resets clat (msec): min=685, max=1175, avg=937.43, stdev=245.21 lat (msec): min=686, max=1175, avg=938.65, stdev=244.68 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8126, max= 8143, per=84.71%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.89%, ctx=77, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4802KiB/s (4917kB/s), 1200KiB/s-3992KiB/s (1229kB/s-4088kB/s), io=16.0MiB (16.8MB), run=3078-3412msec WRITE: bw=9604KiB/s (9834kB/s), 2401KiB/s-4228KiB/s (2459kB/s-4330kB/s), io=32.0MiB (33.6MB), run=2906-3412msec