== sanity test 398b: DIO and buffer IO race ============== 21:16:41 (1789607801) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.36583 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179143: Wed Sep 16 21:18:39 2026 read: IOPS=14, BW=59.7KiB/s (61.2kB/s)(5992KiB/100337msec) clat (usec): min=38, max=779122, avg=36789.80, stdev=30296.27 lat (usec): min=38, max=779125, avg=36792.82, stdev=30296.35 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10028], 10.00th=[ 14353], 20.00th=[ 18220], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 43779], 80.00th=[ 51119], 90.00th=[ 65274], 95.00th=[ 78119], | 99.00th=[121111], 99.50th=[160433], 99.90th=[200279], 99.95th=[775947], | 99.99th=[775947] bw ( KiB/s): min= 7, max= 128, per=24.96%, avg=59.40, stdev=21.31, samples=197 iops : min= 1, max= 32, avg=14.21, stdev= 5.36, samples=197 write: IOPS=15, BW=62.7KiB/s (64.3kB/s)(6296KiB/100337msec); 0 zone resets clat (usec): min=765, max=186681, avg=28519.24, stdev=27981.08 lat (usec): min=766, max=186682, avg=28527.70, stdev=27978.90 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1467], 20.00th=[ 3228], | 30.00th=[ 6652], 40.00th=[ 14222], 50.00th=[ 21365], 60.00th=[ 28705], | 70.00th=[ 37487], 80.00th=[ 50070], 90.00th=[ 67634], 95.00th=[ 83362], | 99.00th=[119014], 99.50th=[135267], 99.90th=[166724], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 151, per=25.24%, avg=62.84, stdev=24.41, samples=196 iops : min= 1, max= 37, avg=15.08, stdev= 6.13, samples=196 lat (usec) : 50=0.20%, 100=1.73%, 250=0.20%, 1000=0.39% lat (msec) : 2=6.93%, 4=4.72%, 10=6.18%, 20=15.92%, 50=43.03% lat (msec) : 100=18.68%, 250=1.99%, 1000=0.03% cpu : usr=0.07%, sys=5.89%, ctx=6470, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179144: Wed Sep 16 21:18:39 2026 read: IOPS=15, BW=60.6KiB/s (62.0kB/s)(5940KiB/98070msec) clat (usec): min=35, max=790655, avg=36936.74, stdev=29919.72 lat (usec): min=36, max=790657, avg=36940.42, stdev=29919.98 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10814], 10.00th=[ 15008], 20.00th=[ 18744], | 30.00th=[ 22938], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 36963], | 70.00th=[ 43254], 80.00th=[ 51119], 90.00th=[ 64750], 95.00th=[ 77071], | 99.00th=[123208], 99.50th=[135267], 99.90th=[185598], 99.95th=[792724], | 99.99th=[792724] bw ( KiB/s): min= 7, max= 111, per=25.37%, avg=60.37, stdev=19.47, samples=193 iops : min= 1, max= 27, avg=14.45, stdev= 4.89, samples=193 write: IOPS=16, BW=64.7KiB/s (66.3kB/s)(6348KiB/98070msec); 0 zone resets clat (usec): min=820, max=314903, avg=27020.13, stdev=29990.64 lat (usec): min=822, max=314904, avg=27022.79, stdev=29990.06 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1205], 10.00th=[ 1418], 20.00th=[ 2671], | 30.00th=[ 4883], 40.00th=[ 10290], 50.00th=[ 18744], 60.00th=[ 25035], | 70.00th=[ 34341], 80.00th=[ 46924], 90.00th=[ 67634], 95.00th=[ 84411], | 99.00th=[131597], 99.50th=[154141], 99.90th=[200279], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 7, max= 142, per=25.91%, avg=64.52, stdev=26.28, samples=193 iops : min= 1, max= 35, avg=15.50, stdev= 6.62, samples=193 lat (usec) : 50=0.29%, 100=1.30%, 250=0.03%, 750=0.03%, 1000=0.39% lat (msec) : 2=7.81%, 4=6.05%, 10=6.74%, 20=14.88%, 50=43.20% lat (msec) : 100=16.93%, 250=2.28%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.84%, ctx=6273, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179145: Wed Sep 16 21:18:39 2026 read: IOPS=15, BW=60.8KiB/s (62.2kB/s)(6028KiB/99204msec) clat (usec): min=34, max=838453, avg=36860.72, stdev=31151.58 lat (usec): min=35, max=838454, avg=36863.91, stdev=31152.02 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 8586], 10.00th=[ 13829], 20.00th=[ 18744], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 31851], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 51643], 90.00th=[ 64226], 95.00th=[ 79168], | 99.00th=[120062], 99.50th=[129500], 99.90th=[193987], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 15, max= 126, per=25.41%, avg=60.49, stdev=21.09, samples=195 iops : min= 3, max= 31, avg=14.49, stdev= 5.31, samples=195 write: IOPS=15, BW=63.1KiB/s (64.6kB/s)(6260KiB/99204msec); 0 zone resets clat (usec): min=879, max=180105, avg=27712.54, stdev=28212.10 lat (usec): min=881, max=180106, avg=27720.54, stdev=28211.18 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1385], 20.00th=[ 2999], | 30.00th=[ 5997], 40.00th=[ 12911], 50.00th=[ 20055], 60.00th=[ 27395], | 70.00th=[ 35390], 80.00th=[ 47973], 90.00th=[ 66847], 95.00th=[ 82314], | 99.00th=[126354], 99.50th=[137364], 99.90th=[162530], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 7, max= 119, per=25.19%, avg=62.71, stdev=22.91, samples=195 iops : min= 1, max= 29, avg=15.04, stdev= 5.74, samples=195 lat (usec) : 50=0.20%, 100=1.63%, 250=0.20%, 1000=0.16% lat (msec) : 2=7.39%, 4=4.82%, 10=6.87%, 20=15.53%, 50=43.00% lat (msec) : 100=17.77%, 250=2.41%, 1000=0.03% cpu : usr=0.11%, sys=5.95%, ctx=6303, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179146: Wed Sep 16 21:18:39 2026 read: IOPS=15, BW=60.1KiB/s (61.6kB/s)(6052KiB/100621msec) clat (usec): min=36, max=273520, avg=36579.65, stdev=23098.00 lat (usec): min=37, max=273521, avg=36584.63, stdev=23100.40 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9765], 10.00th=[ 14615], 20.00th=[ 19006], | 30.00th=[ 22676], 40.00th=[ 27395], 50.00th=[ 32113], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 52167], 90.00th=[ 64226], 95.00th=[ 76022], | 99.00th=[109577], 99.50th=[133694], 99.90th=[200279], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 127, per=25.31%, avg=60.23, stdev=20.49, samples=197 iops : min= 1, max= 31, avg=14.42, stdev= 5.17, samples=197 write: IOPS=15, BW=61.0KiB/s (63.5kB/s)(6236KiB/100621msec); 0 zone resets clat (usec): min=831, max=798918, avg=28825.65, stdev=34322.28 lat (usec): min=832, max=798922, avg=28833.26, stdev=34329.85 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1172], 10.00th=[ 1352], 20.00th=[ 2966], | 30.00th=[ 5604], 40.00th=[ 13698], 50.00th=[ 21365], 60.00th=[ 27657], | 70.00th=[ 37487], 80.00th=[ 50594], 90.00th=[ 67634], 95.00th=[ 86508], | 99.00th=[121111], 99.50th=[126354], 99.90th=[183501], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 127, per=24.79%, avg=61.72, stdev=23.88, samples=198 iops : min= 1, max= 31, avg=14.79, stdev= 6.00, samples=198 lat (usec) : 50=0.33%, 100=1.50%, 250=0.07%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.46% lat (msec) : 2=7.16%, 4=4.88%, 10=6.15%, 20=15.04%, 50=42.58% lat (msec) : 100=19.86%, 250=1.86%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.94%, ctx=6489, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=239KiB/s (244kB/s), 59.7KiB/s-60.8KiB/s (61.2kB/s-62.2kB/s), io=23.4MiB (24.6MB), run=98070-100621msec WRITE: bw=250KiB/s (256kB/s), 61.0KiB/s-64.7KiB/s (63.5kB/s-66.3kB/s), io=24.6MiB (25.7MB), run=98070-100621msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179138: Wed Sep 16 21:19:14 2026 read: IOPS=11, BW=44.2KiB/s (45.3kB/s)(5992KiB/135516msec) clat (msec): min=5, max=839, avg=35.96, stdev=38.43 lat (msec): min=5, max=839, avg=35.97, stdev=38.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 79], 95.00th=[ 106], | 99.00th=[ 163], 99.50th=[ 186], 99.90th=[ 271], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 151, per=25.07%, avg=44.13, stdev=27.74, samples=265 iops : min= 1, max= 37, avg=10.39, stdev= 6.99, samples=265 write: IOPS=11, BW=46.5KiB/s (47.6kB/s)(6296KiB/135516msec); 0 zone resets clat (msec): min=8, max=288, avg=51.65, stdev=34.41 lat (msec): min=8, max=288, avg=51.65, stdev=34.41 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 96], 95.00th=[ 116], | 99.00th=[ 174], 99.50th=[ 205], 99.90th=[ 275], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 136, per=24.94%, avg=46.15, stdev=26.71, samples=266 iops : min= 1, max= 34, avg=10.90, stdev= 6.73, samples=266 lat (msec) : 10=3.45%, 20=20.21%, 50=46.88%, 100=22.04%, 250=7.26% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=1.99%, ctx=4751, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179139: Wed Sep 16 21:19:14 2026 read: IOPS=10, BW=43.8KiB/s (44.9kB/s)(5940KiB/135495msec) clat (msec): min=5, max=827, avg=36.19, stdev=38.99 lat (msec): min=5, max=827, avg=36.20, stdev=39.01 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 80], 95.00th=[ 105], | 99.00th=[ 163], 99.50th=[ 178], 99.90th=[ 342], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 135, per=25.16%, avg=44.27, stdev=28.10, samples=262 iops : min= 1, max= 33, avg=10.43, stdev= 7.07, samples=262 write: IOPS=11, BW=46.8KiB/s (47.0kB/s)(6348KiB/135495msec); 0 zone resets clat (msec): min=9, max=283, avg=51.29, stdev=33.22 lat (msec): min=9, max=283, avg=51.30, stdev=33.22 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 59], 80.00th=[ 72], 90.00th=[ 95], 95.00th=[ 114], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 271], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 143, per=25.12%, avg=46.48, stdev=27.41, samples=266 iops : min= 1, max= 35, avg=10.98, stdev= 6.90, samples=266 lat (msec) : 10=3.84%, 20=19.47%, 50=47.01%, 100=22.43%, 250=7.13% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=2.02%, ctx=4736, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179140: Wed Sep 16 21:19:14 2026 read: IOPS=11, BW=44.4KiB/s (45.5kB/s)(6028KiB/135719msec) clat (msec): min=5, max=338, avg=35.86, stdev=32.01 lat (msec): min=5, max=338, avg=35.87, stdev=32.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 52], 90.00th=[ 79], 95.00th=[ 105], | 99.00th=[ 153], 99.50th=[ 178], 99.90th=[ 234], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 142, per=25.07%, avg=44.12, stdev=26.67, samples=265 iops : min= 1, max= 35, avg=10.39, stdev= 6.73, samples=265 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6260KiB/135719msec); 0 zone resets clat (msec): min=9, max=814, avg=51.94, stdev=38.91 lat (msec): min=9, max=814, avg=51.95, stdev=38.91 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 60], 80.00th=[ 72], 90.00th=[ 96], 95.00th=[ 121], | 99.00th=[ 165], 99.50th=[ 213], 99.90th=[ 279], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 7, max= 160, per=24.90%, avg=46.07, stdev=26.72, samples=263 iops : min= 1, max= 40, avg=10.88, stdev= 6.73, samples=263 lat (msec) : 10=3.26%, 20=19.99%, 50=46.42%, 100=22.88%, 250=7.29% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.08%, sys=1.96%, ctx=4713, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179141: Wed Sep 16 21:19:14 2026 read: IOPS=11, BW=44.7KiB/s (45.8kB/s)(6052KiB/135411msec) clat (msec): min=4, max=237, avg=34.66, stdev=31.46 lat (msec): min=4, max=237, avg=34.67, stdev=31.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 73], 95.00th=[ 103], | 99.00th=[ 157], 99.50th=[ 197], 99.90th=[ 236], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 7, max= 135, per=25.84%, avg=45.47, stdev=26.84, samples=260 iops : min= 1, max= 33, avg=10.73, stdev= 6.77, samples=260 write: IOPS=11, BW=46.1KiB/s (47.2kB/s)(6236KiB/135411msec); 0 zone resets clat (msec): min=8, max=829, avg=53.00, stdev=39.57 lat (msec): min=8, max=829, avg=53.01, stdev=39.57 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 61], 80.00th=[ 77], 90.00th=[ 101], 95.00th=[ 122], | 99.00th=[ 169], 99.50th=[ 199], 99.90th=[ 288], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 134, per=24.82%, avg=45.92, stdev=26.05, samples=265 iops : min= 1, max= 33, avg=10.85, stdev= 6.57, samples=265 lat (msec) : 10=2.99%, 20=20.12%, 50=47.82%, 100=21.39%, 250=7.62% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=1.99%, ctx=4696, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=177KiB/s (181kB/s), 43.8KiB/s-44.7KiB/s (44.9kB/s-45.8kB/s), io=23.4MiB (24.6MB), run=135411-135719msec WRITE: bw=185KiB/s (190kB/s), 46.1KiB/s-46.8KiB/s (47.2kB/s-47.0kB/s), io=24.6MiB (25.7MB), run=135411-135719msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179180: Wed Sep 16 21:19:56 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(5920KiB/32390msec) clat (usec): min=39, max=267509, avg=46137.93, stdev=34530.91 lat (usec): min=40, max=267510, avg=46139.17, stdev=34530.98 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 77], 20.00th=[ 20055], | 30.00th=[ 28443], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[166724], 99.50th=[254804], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 352, per=24.40%, avg=179.33, stdev=73.60, samples=63 iops : min= 1, max= 22, avg=10.48, stdev= 4.73, samples=63 write: IOPS=12, BW=197KiB/s (201kB/s)(6368KiB/32390msec); 0 zone resets clat (usec): min=1287, max=409135, avg=38148.30, stdev=40494.68 lat (usec): min=1288, max=409136, avg=38151.07, stdev=40495.11 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1762], 10.00th=[ 2769], 20.00th=[ 5276], | 30.00th=[ 10290], 40.00th=[ 18220], 50.00th=[ 26870], 60.00th=[ 36439], | 70.00th=[ 49021], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[162530], 99.50th=[198181], 99.90th=[408945], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 31, max= 448, per=25.12%, avg=194.46, stdev=91.42, samples=63 iops : min= 1, max= 28, avg=11.43, stdev= 5.74, samples=63 lat (usec) : 50=0.65%, 100=4.43%, 250=0.65% lat (msec) : 2=3.65%, 4=4.04%, 10=7.68%, 20=10.16%, 50=34.90% lat (msec) : 100=27.34%, 250=6.12%, 500=0.39% cpu : usr=0.07%, sys=5.35%, ctx=1594, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179181: Wed Sep 16 21:19:56 2026 read: IOPS=11, BW=176KiB/s (181kB/s)(5744KiB/32545msec) clat (usec): min=46, max=193016, avg=47703.79, stdev=34085.35 lat (usec): min=46, max=193511, avg=47707.56, stdev=34090.98 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 169], 20.00th=[ 21627], | 30.00th=[ 28705], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 60556], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[105382], | 99.00th=[187696], 99.50th=[191890], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 30, max= 382, per=24.27%, avg=178.39, stdev=74.74, samples=62 iops : min= 1, max= 23, avg=10.44, stdev= 4.73, samples=62 write: IOPS=12, BW=201KiB/s (206kB/s)(6544KiB/32545msec); 0 zone resets clat (usec): min=1276, max=406373, avg=37257.16, stdev=40461.81 lat (usec): min=1278, max=406375, avg=37259.19, stdev=40461.85 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1795], 10.00th=[ 2311], 20.00th=[ 5669], | 30.00th=[ 9372], 40.00th=[ 18482], 50.00th=[ 28443], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[112722], | 99.00th=[168821], 99.50th=[175113], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 63, max= 380, per=25.54%, avg=197.67, stdev=79.89, samples=63 iops : min= 3, max= 23, avg=11.65, stdev= 5.03, samples=63 lat (usec) : 50=0.13%, 100=4.43%, 250=0.13%, 500=0.13%, 750=0.13% lat (msec) : 2=4.43%, 4=3.52%, 10=9.51%, 20=7.29%, 50=37.37% lat (msec) : 100=26.69%, 250=6.12%, 500=0.13% cpu : usr=0.09%, sys=5.53%, ctx=1611, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179182: Wed Sep 16 21:19:56 2026 read: IOPS=12, BW=193KiB/s (197kB/s)(6256KiB/32476msec) clat (usec): min=24, max=201307, avg=46413.29, stdev=32057.61 lat (usec): min=24, max=201308, avg=46415.07, stdev=32057.09 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 122], 20.00th=[ 23462], | 30.00th=[ 29754], 40.00th=[ 36439], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[102237], | 99.00th=[143655], 99.50th=[196084], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 374, per=26.22%, avg=192.73, stdev=78.55, samples=63 iops : min= 1, max= 23, avg=11.33, stdev= 5.02, samples=63 write: IOPS=11, BW=186KiB/s (190kB/s)(6032KiB/32476msec); 0 zone resets clat (usec): min=1470, max=233991, avg=37827.40, stdev=38556.14 lat (usec): min=1471, max=233994, avg=37832.70, stdev=38554.08 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1827], 10.00th=[ 2409], 20.00th=[ 5407], | 30.00th=[ 9634], 40.00th=[ 16057], 50.00th=[ 27395], 60.00th=[ 39584], | 70.00th=[ 49546], 80.00th=[ 62653], 90.00th=[ 86508], 95.00th=[126354], | 99.00th=[166724], 99.50th=[198181], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 31, max= 382, per=23.59%, avg=182.56, stdev=86.86, samples=63 iops : min= 1, max= 23, avg=10.68, stdev= 5.51, samples=63 lat (usec) : 50=0.26%, 100=4.82%, 250=0.26% lat (msec) : 2=4.17%, 4=2.86%, 10=8.85%, 20=9.24%, 50=36.33% lat (msec) : 100=27.08%, 250=6.12% cpu : usr=0.07%, sys=5.28%, ctx=1596, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179183: Wed Sep 16 21:19:56 2026 read: IOPS=11, BW=191KiB/s (196kB/s)(6032KiB/31561msec) clat (usec): min=33, max=173125, avg=45569.65, stdev=30541.32 lat (usec): min=34, max=173125, avg=45576.44, stdev=30538.97 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 23987], | 30.00th=[ 29754], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 58459], 80.00th=[ 66847], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[133694], 99.50th=[164627], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 30, max= 380, per=25.94%, avg=190.69, stdev=64.72, samples=62 iops : min= 1, max= 23, avg=11.19, stdev= 4.11, samples=62 write: IOPS=12, BW=198KiB/s (203kB/s)(6256KiB/31561msec); 0 zone resets clat (usec): min=1321, max=257828, avg=36240.82, stdev=40492.74 lat (usec): min=1322, max=257830, avg=36253.88, stdev=40485.44 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1811], 10.00th=[ 2737], 20.00th=[ 4817], | 30.00th=[ 8094], 40.00th=[ 11863], 50.00th=[ 21103], 60.00th=[ 31589], | 70.00th=[ 45351], 80.00th=[ 61080], 90.00th=[ 94897], 95.00th=[123208], | 99.00th=[173016], 99.50th=[221250], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 62, max= 467, per=25.55%, avg=197.76, stdev=91.23, samples=62 iops : min= 3, max= 29, avg=11.65, stdev= 5.85, samples=62 lat (usec) : 50=0.78%, 100=4.69%, 250=0.13%, 500=0.26% lat (msec) : 2=3.91%, 4=4.43%, 10=10.29%, 20=8.46%, 50=35.16% lat (msec) : 100=24.87%, 250=6.90%, 500=0.13% cpu : usr=0.09%, sys=5.27%, ctx=1533, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=736KiB/s (754kB/s), 176KiB/s-193KiB/s (181kB/s-197kB/s), io=23.4MiB (24.5MB), run=31561-32545msec WRITE: bw=774KiB/s (793kB/s), 186KiB/s-201KiB/s (190kB/s-206kB/s), io=24.6MiB (25.8MB), run=31561-32545msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179185: Wed Sep 16 21:20:08 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5920KiB/43608msec) clat (msec): min=5, max=293, avg=46.90, stdev=45.83 lat (msec): min=5, max=293, avg=46.91, stdev=45.83 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 50], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 253], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 415, per=24.41%, avg=133.99, stdev=90.67, samples=84 iops : min= 1, max= 25, avg= 7.58, stdev= 5.73, samples=84 write: IOPS=9, BW=146KiB/s (150kB/s)(6368KiB/43608msec); 0 zone resets clat (msec): min=10, max=268, avg=65.76, stdev=48.84 lat (msec): min=10, max=268, avg=65.78, stdev=48.85 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 49], 60.00th=[ 58], | 70.00th=[ 78], 80.00th=[ 101], 90.00th=[ 134], 95.00th=[ 174], | 99.00th=[ 241], 99.50th=[ 268], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 22, max= 416, per=25.25%, avg=145.70, stdev=100.06, samples=84 iops : min= 1, max= 26, avg= 8.32, stdev= 6.33, samples=84 lat (msec) : 10=2.08%, 20=16.41%, 50=41.80%, 100=22.92%, 250=16.15% lat (msec) : 500=0.65% cpu : usr=0.06%, sys=1.84%, ctx=1291, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179186: Wed Sep 16 21:20:08 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(5744KiB/43428msec) clat (msec): min=6, max=258, avg=44.30, stdev=40.30 lat (msec): min=6, max=258, avg=44.30, stdev=40.30 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 69], 90.00th=[ 96], 95.00th=[ 123], | 99.00th=[ 226], 99.50th=[ 239], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 22, max= 447, per=25.81%, avg=141.70, stdev=101.80, samples=79 iops : min= 1, max= 27, avg= 8.08, stdev= 6.40, samples=79 write: IOPS=9, BW=151KiB/s (154kB/s)(6544KiB/43428msec); 0 zone resets clat (msec): min=10, max=280, avg=67.04, stdev=48.65 lat (msec): min=10, max=280, avg=67.06, stdev=48.67 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 51], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 101], 90.00th=[ 138], 95.00th=[ 165], | 99.00th=[ 241], 99.50th=[ 262], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 30, max= 447, per=26.04%, avg=150.26, stdev=99.79, samples=85 iops : min= 1, max= 27, avg= 8.60, stdev= 6.31, samples=85 lat (msec) : 10=1.43%, 20=14.97%, 50=44.53%, 100=24.61%, 250=13.93% lat (msec) : 500=0.52% cpu : usr=0.03%, sys=1.73%, ctx=1235, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179187: Wed Sep 16 21:20:08 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6256KiB/43089msec) clat (msec): min=7, max=458, avg=44.51, stdev=42.16 lat (msec): min=7, max=458, avg=44.52, stdev=42.16 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 49], 80.00th=[ 68], 90.00th=[ 95], 95.00th=[ 124], | 99.00th=[ 180], 99.50th=[ 222], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 31, max= 508, per=26.37%, avg=144.77, stdev=110.80, samples=84 iops : min= 1, max= 31, avg= 8.25, stdev= 7.01, samples=84 write: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43089msec); 0 zone resets clat (msec): min=10, max=291, avg=67.95, stdev=48.85 lat (msec): min=10, max=291, avg=67.96, stdev=48.84 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 99], 90.00th=[ 144], 95.00th=[ 165], | 99.00th=[ 239], 99.50th=[ 245], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 30, max= 447, per=23.89%, avg=137.85, stdev=87.78, samples=84 iops : min= 1, max= 27, avg= 7.82, stdev= 5.53, samples=84 lat (msec) : 10=1.56%, 20=15.76%, 50=43.10%, 100=25.65%, 250=13.67% lat (msec) : 500=0.26% cpu : usr=0.07%, sys=1.76%, ctx=1204, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179188: Wed Sep 16 21:20:08 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6032KiB/43508msec) clat (msec): min=5, max=459, avg=47.99, stdev=49.87 lat (msec): min=5, max=459, avg=48.00, stdev=49.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 65], 90.00th=[ 114], 95.00th=[ 157], | 99.00th=[ 232], 99.50th=[ 292], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 30, max= 479, per=25.93%, avg=142.37, stdev=92.29, samples=82 iops : min= 1, max= 29, avg= 8.11, stdev= 5.83, samples=82 write: IOPS=8, BW=144KiB/s (147kB/s)(6256KiB/43508msec); 0 zone resets clat (msec): min=10, max=291, avg=64.86, stdev=50.20 lat (msec): min=10, max=291, avg=64.86, stdev=50.20 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 100], 90.00th=[ 136], 95.00th=[ 165], | 99.00th=[ 241], 99.50th=[ 264], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 29, max= 447, per=24.73%, avg=142.72, stdev=103.94, samples=85 iops : min= 1, max= 27, avg= 8.13, stdev= 6.57, samples=85 lat (msec) : 10=1.43%, 20=15.63%, 50=45.83%, 100=21.22%, 250=15.23% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.69%, ctx=1212, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=549KiB/s (562kB/s), 132KiB/s-145KiB/s (135kB/s-149kB/s), io=23.4MiB (24.5MB), run=43089-43608msec WRITE: bw=578KiB/s (592kB/s), 140KiB/s-151KiB/s (143kB/s-154kB/s), io=24.6MiB (25.8MB), run=43089-43608msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179201: Wed Sep 16 21:20:24 2026 read: IOPS=1, BW=2001KiB/s (2049kB/s)(7168KiB/3583msec) clat (usec): min=481, max=757491, avg=254077.69, stdev=248513.87 lat (usec): min=482, max=757493, avg=254079.14, stdev=248513.77 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 88605], | 30.00th=[127402], 40.00th=[127402], 50.00th=[227541], 60.00th=[231736], | 70.00th=[231736], 80.00th=[346031], 90.00th=[759170], 95.00th=[759170], | 99.00th=[759170], 99.50th=[759170], 99.90th=[759170], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 1762, max= 2027, per=46.91%, avg=1931.20, stdev=103.80, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1429KiB/s (1463kB/s)(5120KiB/3583msec); 0 zone resets clat (msec): min=235, max=547, avg=344.63, stdev=130.71 lat (msec): min=235, max=548, avg=344.70, stdev=130.70 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 259], 40.00th=[ 259], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 401], 80.00th=[ 401], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1762, max= 4071, per=45.10%, avg=2599.33, stdev=1278.54, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=11.78%, ctx=155, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179202: Wed Sep 16 21:20:24 2026 read: IOPS=0, BW=412KiB/s (422kB/s)(2048KiB/4974msec) clat (usec): min=443, max=134014, avg=67228.91, stdev=94449.33 lat (usec): min=444, max=134016, avg=67230.86, stdev=94449.86 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 445], | 30.00th=[ 445], 40.00th=[ 445], 50.00th=[ 445], 60.00th=[133694], | 70.00th=[133694], 80.00th=[133694], 90.00th=[133694], 95.00th=[133694], | 99.00th=[133694], 99.50th=[133694], 99.90th=[133694], 99.95th=[133694], | 99.99th=[133694] bw ( KiB/s): min= 1815, max= 2043, per=46.85%, avg=1929.00, stdev=161.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2059KiB/s (2108kB/s)(10.0MiB/4974msec); 0 zone resets clat (msec): min=161, max=1304, avg=478.00, stdev=349.61 lat (msec): min=161, max=1304, avg=480.13, stdev=348.44 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 190], | 30.00th=[ 209], 40.00th=[ 296], 50.00th=[ 321], 60.00th=[ 397], | 70.00th=[ 550], 80.00th=[ 600], 90.00th=[ 760], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1762, max= 4087, per=45.67%, avg=2632.33, stdev=1082.65, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.31%, ctx=121, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179203: Wed Sep 16 21:20:24 2026 read: IOPS=1, BW=1495KiB/s (1531kB/s)(6144KiB/4109msec) clat (usec): min=459, max=333169, avg=171482.97, stdev=153800.41 lat (usec): min=461, max=333170, avg=171484.20, stdev=153800.39 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[117965], 50.00th=[117965], 60.00th=[246416], | 70.00th=[329253], 80.00th=[329253], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2031, max= 4071, per=81.22%, avg=3344.00, stdev=1139.27, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1495KiB/s (1531kB/s)(6144KiB/4109msec); 0 zone resets clat (msec): min=294, max=1057, avg=500.35, stdev=284.85 lat (msec): min=294, max=1057, avg=500.41, stdev=284.87 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 472], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1762, max= 4055, per=42.87%, avg=2470.75, stdev=1063.87, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.78%, ctx=157, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179204: Wed Sep 16 21:20:24 2026 read: IOPS=1, BW=1536KiB/s (1573kB/s)(5120KiB/3333msec) clat (usec): min=527, max=281971, avg=102663.99, stdev=138892.47 lat (usec): min=529, max=281973, avg=102665.46, stdev=138892.57 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 5932], 60.00th=[ 5932], | 70.00th=[223347], 80.00th=[223347], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2151KiB/s (2202kB/s)(7168KiB/3333msec); 0 zone resets clat (msec): min=165, max=674, avg=393.33, stdev=162.66 lat (msec): min=165, max=674, avg=393.71, stdev=162.45 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 288], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 359], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 510], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1992, max= 3524, per=41.54%, avg=2394.50, stdev=753.23, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 10=8.33%, 250=16.67%, 500=41.67%, 750=16.67% cpu : usr=0.03%, sys=13.93%, ctx=185, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4117KiB/s (4216kB/s), 412KiB/s-2001KiB/s (422kB/s-2049kB/s), io=20.0MiB (20.0MB), run=3333-4974msec WRITE: bw=5764KiB/s (5903kB/s), 1429KiB/s-2151KiB/s (1463kB/s-2202kB/s), io=28.0MiB (29.4MB), run=3333-4974msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179206: Wed Sep 16 21:20:24 2026 read: IOPS=1, BW=1503KiB/s (1539kB/s)(7168KiB/4768msec) clat (msec): min=93, max=1001, avg=339.71, stdev=314.97 lat (msec): min=93, max=1001, avg=339.71, stdev=314.97 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 95], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 279], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 430], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1872, max= 4031, per=75.41%, avg=2963.50, stdev=1164.81, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1074KiB/s (1100kB/s)(5120KiB/4768msec); 0 zone resets clat (msec): min=174, max=626, avg=477.60, stdev=183.80 lat (msec): min=174, max=626, avg=477.69, stdev=183.80 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 176], | 30.00th=[ 451], 40.00th=[ 451], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1896, max= 2043, per=36.47%, avg=2006.40, stdev=63.15, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=4.01%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179207: Wed Sep 16 21:20:24 2026 read: IOPS=0, BW=402KiB/s (412kB/s)(2048KiB/5090msec) clat (msec): min=120, max=479, avg=300.07, stdev=253.67 lat (msec): min=120, max=479, avg=300.07, stdev=253.67 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 122], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 122], 60.00th=[ 481], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1980, max= 2043, per=51.18%, avg=2011.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2012KiB/s (2060kB/s)(10.0MiB/5090msec); 0 zone resets clat (msec): min=69, max=921, avg=448.56, stdev=286.61 lat (msec): min=69, max=921, avg=448.67, stdev=286.61 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 186], | 30.00th=[ 251], 40.00th=[ 305], 50.00th=[ 326], 60.00th=[ 334], | 70.00th=[ 617], 80.00th=[ 651], 90.00th=[ 827], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1896, max= 4087, per=42.50%, avg=2338.33, stdev=858.49, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=5.70%, ctx=156, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179208: Wed Sep 16 21:20:24 2026 read: IOPS=1, BW=1358KiB/s (1391kB/s)(6144KiB/4523msec) clat (msec): min=90, max=425, avg=195.47, stdev=122.49 lat (msec): min=90, max=425, avg=195.47, stdev=122.49 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 194], | 70.00th=[ 213], 80.00th=[ 213], 90.00th=[ 426], 95.00th=[ 426], | 99.00th=[ 426], 99.50th=[ 426], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 2011, max= 4087, per=83.88%, avg=3296.67, stdev=1123.15, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1358KiB/s (1391kB/s)(6144KiB/4523msec); 0 zone resets clat (msec): min=179, max=1552, avg=546.86, stdev=512.87 lat (msec): min=179, max=1552, avg=547.10, stdev=512.89 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 422], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 1954, max= 4071, per=45.80%, avg=2519.75, stdev=1034.82, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.02%, sys=6.79%, ctx=125, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179209: Wed Sep 16 21:20:24 2026 read: IOPS=0, BW=983KiB/s (1006kB/s)(5120KiB/5211msec) clat (msec): min=33, max=395, avg=197.90, stdev=143.19 lat (msec): min=33, max=395, avg=197.90, stdev=143.19 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 34], 10.00th=[ 34], 20.00th=[ 34], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2039, max= 4087, per=69.29%, avg=2723.00, stdev=1181.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1376KiB/s (1409kB/s)(7168KiB/5211msec); 0 zone resets clat (msec): min=56, max=2198, avg=595.46, stdev=764.25 lat (msec): min=56, max=2198, avg=595.66, stdev=764.17 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 57], 10.00th=[ 57], 20.00th=[ 105], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 222], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 860], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1896, max= 4079, per=43.85%, avg=2412.80, stdev=933.30, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=41.67%, 500=16.67%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.26%, ctx=85, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3930KiB/s (4024kB/s), 402KiB/s-1503KiB/s (412kB/s-1539kB/s), io=20.0MiB (20.0MB), run=4523-5211msec WRITE: bw=5502KiB/s (5634kB/s), 1074KiB/s-2012KiB/s (1100kB/s-2060kB/s), io=28.0MiB (29.4MB), run=4523-5211msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179215: Wed Sep 16 21:20:40 2026 read: IOPS=0, BW=2677KiB/s (2741kB/s)(12.0MiB/4591msec) clat (msec): min=503, max=2984, avg=1515.29, stdev=1301.80 lat (msec): min=503, max=2984, avg=1515.29, stdev=1301.80 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 2970], 80.00th=[ 2970], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 8062, max= 8192, per=100.00%, avg=8127.00, stdev=91.92, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=10.35%, ctx=700, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179216: Wed Sep 16 21:20:40 2026 read: IOPS=0, BW=801KiB/s (820kB/s)(4096KiB/5112msec) clat (nsec): min=3499.1M, max=3499.1M, avg=3499126581.00, stdev= 0.00 lat (nsec): min=3499.1M, max=3499.1M, avg=3499129448.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3507], 5.00th=[ 3507], 10.00th=[ 3507], 20.00th=[ 3507], | 30.00th=[ 3507], 40.00th=[ 3507], 50.00th=[ 3507], 60.00th=[ 3507], | 70.00th=[ 3507], 80.00th=[ 3507], 90.00th=[ 3507], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1603KiB/s (1641kB/s)(8192KiB/5112msec); 0 zone resets clat (msec): min=522, max=1037, avg=780.08, stdev=364.05 lat (msec): min=522, max=1037, avg=780.40, stdev=364.08 clat percentiles (msec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.85%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179217: Wed Sep 16 21:20:40 2026 write: IOPS=0, BW=3094KiB/s (3169kB/s)(12.0MiB/3971msec); 0 zone resets clat (msec): min=370, max=2829, avg=1279.53, stdev=1349.02 lat (msec): min=371, max=2831, avg=1280.47, stdev=1349.89 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 2836], 80.00th=[ 2836], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.52%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179219: Wed Sep 16 21:20:40 2026 write: IOPS=0, BW=2567KiB/s (2629kB/s)(12.0MiB/4787msec); 0 zone resets clat (msec): min=430, max=2883, avg=1566.81, stdev=1236.63 lat (msec): min=430, max=2888, avg=1568.44, stdev=1238.91 clat percentiles (msec): | 1.00th=[ 430], 5.00th=[ 430], 10.00th=[ 430], 20.00th=[ 430], | 30.00th=[ 430], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 2869], 80.00th=[ 2869], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.82%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3205KiB/s (3282kB/s), 801KiB/s-2677KiB/s (820kB/s-2741kB/s), io=16.0MiB (16.8MB), run=4591-5112msec WRITE: bw=6410KiB/s (6564kB/s), 1603KiB/s-3094KiB/s (1641kB/s-3169kB/s), io=32.0MiB (33.6MB), run=3971-5112msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179220: Wed Sep 16 21:20:41 2026 read: IOPS=0, BW=2205KiB/s (2257kB/s)(12.0MiB/5574msec) clat (msec): min=339, max=3944, avg=1809.02, stdev=1892.43 lat (msec): min=339, max=3944, avg=1809.02, stdev=1892.43 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 3943], 80.00th=[ 3943], 90.00th=[ 3943], 95.00th=[ 3943], | 99.00th=[ 3943], 99.50th=[ 3943], 99.90th=[ 3943], 99.95th=[ 3943], | 99.99th=[ 3943] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.61%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179221: Wed Sep 16 21:20:41 2026 read: IOPS=0, BW=726KiB/s (744kB/s)(4096KiB/5638msec) clat (nsec): min=3455.1M, max=3455.1M, avg=3455052404.00, stdev= 0.00 lat (nsec): min=3455.1M, max=3455.1M, avg=3455055425.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3440], 5.00th=[ 3440], 10.00th=[ 3440], 20.00th=[ 3440], | 30.00th=[ 3440], 40.00th=[ 3440], 50.00th=[ 3440], 60.00th=[ 3440], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1453KiB/s (1488kB/s)(8192KiB/5638msec); 0 zone resets clat (msec): min=955, max=1064, avg=1009.57, stdev=76.98 lat (msec): min=955, max=1065, avg=1010.46, stdev=77.58 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.54%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179222: Wed Sep 16 21:20:41 2026 write: IOPS=0, BW=2470KiB/s (2529kB/s)(12.0MiB/4975msec); 0 zone resets clat (msec): min=213, max=3786, avg=1605.22, stdev=1913.07 lat (msec): min=214, max=3787, avg=1605.87, stdev=1912.92 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.23%, ctx=47, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179223: Wed Sep 16 21:20:41 2026 write: IOPS=0, BW=2556KiB/s (2617kB/s)(12.0MiB/4808msec); 0 zone resets clat (msec): min=217, max=3337, avg=1578.55, stdev=1597.81 lat (msec): min=217, max=3338, avg=1579.05, stdev=1598.14 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.77%, ctx=34, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2906KiB/s (2976kB/s), 726KiB/s-2205KiB/s (744kB/s-2257kB/s), io=16.0MiB (16.8MB), run=5574-5638msec WRITE: bw=5812KiB/s (5951kB/s), 1453KiB/s-2556KiB/s (1488kB/s-2617kB/s), io=32.0MiB (33.6MB), run=4808-5638msec