== sanity test 398b: DIO and buffer IO race ============== 11:00:07 (1783954807) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.96629 s, 7.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178446: Mon Jul 13 11:03:00 2026 read: IOPS=10, BW=40.0KiB/s (40.0kB/s)(5992KiB/149733msec) clat (usec): min=40, max=304185, avg=55714.66, stdev=34323.15 lat (usec): min=40, max=304186, avg=55725.84, stdev=34323.70 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 14615], 10.00th=[ 21103], 20.00th=[ 28967], | 30.00th=[ 35914], 40.00th=[ 42206], 50.00th=[ 50594], 60.00th=[ 57934], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[ 96994], 95.00th=[115868], | 99.00th=[179307], 99.50th=[204473], 99.90th=[238027], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 87, per=25.12%, avg=39.69, stdev=15.72, samples=293 iops : min= 1, max= 21, avg= 9.24, stdev= 3.94, samples=293 write: IOPS=10, BW=42.0KiB/s (43.1kB/s)(6296KiB/149733msec); 0 zone resets clat (usec): min=1045, max=1000.0k, avg=41656.57, stdev=46112.83 lat (usec): min=1046, max=1000.0k, avg=41661.61, stdev=46112.57 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1696], 10.00th=[ 2999], | 20.00th=[ 6521], 30.00th=[ 11994], 40.00th=[ 23200], | 50.00th=[ 30802], 60.00th=[ 40109], 70.00th=[ 51643], | 80.00th=[ 68682], 90.00th=[ 96994], 95.00th=[ 122160], | 99.00th=[ 162530], 99.50th=[ 181404], 99.90th=[ 325059], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 102, per=25.12%, avg=41.70, stdev=18.83, samples=293 iops : min= 1, max= 25, avg= 9.75, stdev= 4.75, samples=293 lat (usec) : 50=0.10%, 100=1.69%, 250=0.20%, 500=0.03% lat (msec) : 2=3.35%, 4=3.39%, 10=7.13%, 20=6.90%, 50=36.36% lat (msec) : 100=32.16%, 250=8.56%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=4.57%, ctx=6907, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178447: Mon Jul 13 11:03:00 2026 read: IOPS=10, BW=40.3KiB/s (41.3kB/s)(5940KiB/147297msec) clat (usec): min=48, max=275495, avg=53948.22, stdev=34998.58 lat (usec): min=48, max=275496, avg=53956.23, stdev=34999.77 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11207], 10.00th=[ 20579], 20.00th=[ 28181], | 30.00th=[ 33817], 40.00th=[ 39584], 50.00th=[ 46924], 60.00th=[ 55837], | 70.00th=[ 65799], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[177210], 99.50th=[214959], 99.90th=[261096], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 102, per=25.48%, avg=40.25, stdev=16.98, samples=287 iops : min= 1, max= 25, avg= 9.38, stdev= 4.26, samples=287 write: IOPS=10, BW=43.1KiB/s (44.1kB/s)(6348KiB/147297msec); 0 zone resets clat (usec): min=975, max=1057.8k, avg=41957.63, stdev=48274.78 lat (usec): min=977, max=1057.8k, avg=41968.40, stdev=48277.90 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1582], 10.00th=[ 2311], | 20.00th=[ 5735], 30.00th=[ 10814], 40.00th=[ 20579], | 50.00th=[ 30278], 60.00th=[ 41157], 70.00th=[ 53216], | 80.00th=[ 71828], 90.00th=[ 95945], 95.00th=[ 123208], | 99.00th=[ 170918], 99.50th=[ 219153], 99.90th=[ 299893], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 7, max= 103, per=26.03%, avg=43.22, stdev=18.72, samples=285 iops : min= 1, max= 25, avg=10.13, stdev= 4.71, samples=285 lat (usec) : 50=0.03%, 100=1.82%, 250=0.42%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.46%, 4=3.58%, 10=6.77%, 20=7.71%, 50=36.17% lat (msec) : 100=30.21%, 250=8.53%, 500=0.16%, 2000=0.03% cpu : usr=0.08%, sys=4.68%, ctx=6756, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178448: Mon Jul 13 11:03:00 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(6028KiB/151406msec) clat (usec): min=40, max=239737, avg=55647.80, stdev=35110.18 lat (usec): min=41, max=239739, avg=55655.12, stdev=35109.55 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 13960], 10.00th=[ 21103], 20.00th=[ 28443], | 30.00th=[ 34866], 40.00th=[ 41157], 50.00th=[ 47973], 60.00th=[ 56886], | 70.00th=[ 66323], 80.00th=[ 79168], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[183501], 99.50th=[198181], 99.90th=[233833], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 111, per=24.95%, avg=39.42, stdev=17.35, samples=296 iops : min= 1, max= 27, avg= 9.17, stdev= 4.35, samples=296 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6260KiB/151406msec); 0 zone resets clat (usec): min=894, max=910084, avg=42761.64, stdev=46881.90 lat (usec): min=895, max=910086, avg=42765.19, stdev=46882.15 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1565], 10.00th=[ 2343], 20.00th=[ 5342], | 30.00th=[ 10421], 40.00th=[ 19530], 50.00th=[ 30540], 60.00th=[ 41681], | 70.00th=[ 56886], 80.00th=[ 73925], 90.00th=[104334], 95.00th=[125305], | 99.00th=[166724], 99.50th=[185598], 99.90th=[256902], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 95, per=24.52%, avg=40.70, stdev=18.33, samples=297 iops : min= 1, max= 23, avg= 9.50, stdev= 4.61, samples=297 lat (usec) : 50=0.20%, 100=1.17%, 250=0.20%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.36%, 4=3.68%, 10=6.87%, 20=8.30%, 50=34.44% lat (msec) : 100=30.34%, 250=10.22%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.43%, ctx=6836, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178449: Mon Jul 13 11:03:00 2026 read: IOPS=10, BW=42.0KiB/s (43.0kB/s)(6052KiB/144092msec) clat (usec): min=39, max=244660, avg=52634.15, stdev=34136.76 lat (usec): min=40, max=244663, avg=52648.73, stdev=34148.08 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 14484], 10.00th=[ 19530], 20.00th=[ 27132], | 30.00th=[ 33162], 40.00th=[ 38536], 50.00th=[ 45351], 60.00th=[ 53216], | 70.00th=[ 61604], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[115868], | 99.00th=[173016], 99.50th=[193987], 99.90th=[223347], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 87, per=26.51%, avg=41.88, stdev=16.41, samples=281 iops : min= 1, max= 21, avg= 9.79, stdev= 4.12, samples=281 write: IOPS=10, BW=43.3KiB/s (44.3kB/s)(6236KiB/144092msec); 0 zone resets clat (usec): min=881, max=909070, avg=40904.56, stdev=46093.96 lat (usec): min=883, max=909072, avg=40907.19, stdev=46094.38 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1582], 10.00th=[ 2212], 20.00th=[ 5145], | 30.00th=[ 9110], 40.00th=[ 18482], 50.00th=[ 29754], 60.00th=[ 39584], | 70.00th=[ 53216], 80.00th=[ 71828], 90.00th=[ 94897], 95.00th=[120062], | 99.00th=[170918], 99.50th=[208667], 99.90th=[299893], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 134, per=25.91%, avg=43.01, stdev=20.91, samples=282 iops : min= 1, max= 33, avg=10.07, stdev= 5.26, samples=282 lat (usec) : 50=0.23%, 100=1.66%, 250=0.13%, 500=0.03%, 1000=0.03% lat (msec) : 2=4.43%, 4=3.71%, 10=7.68%, 20=7.94%, 50=36.04% lat (msec) : 100=29.52%, 250=8.50%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=4.66%, ctx=6674, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=159KiB/s (162kB/s), 39.8KiB/s-42.0KiB/s (40.8kB/s-43.0kB/s), io=23.4MiB (24.6MB), run=144092-151406msec WRITE: bw=166KiB/s (170kB/s), 41.3KiB/s-43.3KiB/s (42.3kB/s-44.3kB/s), io=24.6MiB (25.7MB), run=144092-151406msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178452: Mon Jul 13 11:03:42 2026 read: IOPS=7, BW=31.1KiB/s (31.8kB/s)(5992KiB/192681msec) clat (msec): min=5, max=1052, avg=51.31, stdev=52.19 lat (msec): min=5, max=1052, avg=51.32, stdev=52.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 56], 80.00th=[ 77], 90.00th=[ 114], 95.00th=[ 146], | 99.00th=[ 218], 99.50th=[ 243], 99.90th=[ 393], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 166, per=25.71%, avg=31.88, stdev=23.82, samples=364 iops : min= 1, max= 41, avg= 7.27, stdev= 5.99, samples=364 write: IOPS=8, BW=32.7KiB/s (33.5kB/s)(6296KiB/192681msec); 0 zone resets clat (msec): min=11, max=393, avg=73.47, stdev=51.16 lat (msec): min=11, max=393, avg=73.48, stdev=51.16 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 110], 90.00th=[ 142], 95.00th=[ 174], | 99.00th=[ 255], 99.50th=[ 288], 99.90th=[ 384], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 135, per=25.01%, avg=32.51, stdev=21.53, samples=375 iops : min= 1, max= 33, avg= 7.42, stdev= 5.40, samples=375 lat (msec) : 10=1.66%, 20=11.78%, 50=40.33%, 100=28.09%, 250=17.38% lat (msec) : 500=0.72%, 2000=0.03% cpu : usr=0.06%, sys=1.92%, ctx=4948, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178453: Mon Jul 13 11:03:42 2026 read: IOPS=7, BW=30.8KiB/s (31.5kB/s)(5940KiB/192980msec) clat (msec): min=4, max=959, avg=51.08, stdev=51.42 lat (msec): min=4, max=959, avg=51.09, stdev=51.42 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 43], | 70.00th=[ 54], 80.00th=[ 78], 90.00th=[ 113], 95.00th=[ 144], | 99.00th=[ 230], 99.50th=[ 247], 99.90th=[ 380], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 151, per=25.63%, avg=31.78, stdev=23.33, samples=361 iops : min= 1, max= 37, avg= 7.24, stdev= 5.86, samples=361 write: IOPS=8, BW=32.9KiB/s (33.7kB/s)(6348KiB/192980msec); 0 zone resets clat (msec): min=9, max=447, avg=73.68, stdev=52.57 lat (msec): min=9, max=447, avg=73.69, stdev=52.58 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 32], | 30.00th=[ 40], 40.00th=[ 48], 50.00th=[ 59], 60.00th=[ 71], | 70.00th=[ 87], 80.00th=[ 110], 90.00th=[ 148], 95.00th=[ 178], | 99.00th=[ 255], 99.50th=[ 296], 99.90th=[ 359], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7, max= 126, per=24.94%, avg=32.43, stdev=21.42, samples=377 iops : min= 1, max= 31, avg= 7.41, stdev= 5.39, samples=377 lat (msec) : 10=1.66%, 20=12.86%, 50=39.81%, 100=27.18%, 250=17.71% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.05%, sys=1.91%, ctx=4941, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178454: Mon Jul 13 11:03:42 2026 read: IOPS=7, BW=31.7KiB/s (32.4kB/s)(6028KiB/190446msec) clat (msec): min=4, max=339, avg=50.63, stdev=45.45 lat (msec): min=4, max=339, avg=50.64, stdev=45.45 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 55], 80.00th=[ 73], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 218], 99.50th=[ 247], 99.90th=[ 338], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 151, per=26.10%, avg=32.36, stdev=22.33, samples=360 iops : min= 1, max= 37, avg= 7.39, stdev= 5.61, samples=360 write: IOPS=8, BW=32.9KiB/s (33.7kB/s)(6260KiB/190446msec); 0 zone resets clat (msec): min=10, max=979, avg=72.80, stdev=55.43 lat (msec): min=10, max=979, avg=72.81, stdev=55.43 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 87], 80.00th=[ 108], 90.00th=[ 142], 95.00th=[ 169], | 99.00th=[ 249], 99.50th=[ 292], 99.90th=[ 439], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 119, per=25.30%, avg=32.89, stdev=21.73, samples=368 iops : min= 1, max= 29, avg= 7.51, stdev= 5.45, samples=368 lat (msec) : 10=1.95%, 20=11.52%, 50=41.18%, 100=27.31%, 250=17.38% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.05%, sys=1.93%, ctx=4916, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178455: Mon Jul 13 11:03:42 2026 read: IOPS=7, BW=31.4KiB/s (32.2kB/s)(6052KiB/192446msec) clat (msec): min=4, max=397, avg=52.87, stdev=48.08 lat (msec): min=4, max=397, avg=52.87, stdev=48.08 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 57], 80.00th=[ 79], 90.00th=[ 121], 95.00th=[ 161], | 99.00th=[ 226], 99.50th=[ 251], 99.90th=[ 334], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 135, per=25.69%, avg=31.86, stdev=23.31, samples=367 iops : min= 1, max= 33, avg= 7.26, stdev= 5.85, samples=367 write: IOPS=8, BW=32.4KiB/s (33.2kB/s)(6236KiB/192446msec); 0 zone resets clat (msec): min=9, max=952, avg=72.01, stdev=55.64 lat (msec): min=9, max=952, avg=72.02, stdev=55.64 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 56], 60.00th=[ 68], | 70.00th=[ 85], 80.00th=[ 108], 90.00th=[ 144], 95.00th=[ 171], | 99.00th=[ 251], 99.50th=[ 288], 99.90th=[ 397], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 111, per=24.81%, avg=32.25, stdev=21.90, samples=373 iops : min= 1, max= 27, avg= 7.36, stdev= 5.49, samples=373 lat (msec) : 10=1.89%, 20=11.46%, 50=41.50%, 100=26.63%, 250=17.71% lat (msec) : 500=0.78%, 1000=0.03% cpu : usr=0.06%, sys=1.89%, ctx=4955, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=124KiB/s (127kB/s), 30.8KiB/s-31.7KiB/s (31.5kB/s-32.4kB/s), io=23.4MiB (24.6MB), run=190446-192980msec WRITE: bw=130KiB/s (133kB/s), 32.4KiB/s-32.9KiB/s (33.2kB/s-33.7kB/s), io=24.6MiB (25.7MB), run=190446-192980msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178514: Mon Jul 13 11:04:36 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(5920KiB/40701msec) clat (usec): min=41, max=224746, avg=54668.28, stdev=34513.02 lat (usec): min=42, max=224748, avg=54669.87, stdev=34513.02 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 87], 10.00th=[ 16581], 20.00th=[ 29230], | 30.00th=[ 35390], 40.00th=[ 43779], 50.00th=[ 49546], 60.00th=[ 56361], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[ 91751], 95.00th=[113771], | 99.00th=[175113], 99.50th=[189793], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 314, per=24.71%, avg=144.53, stdev=56.79, samples=80 iops : min= 1, max= 19, avg= 8.20, stdev= 3.59, samples=80 write: IOPS=9, BW=156KiB/s (160kB/s)(6368KiB/40701msec); 0 zone resets clat (usec): min=1636, max=249463, avg=50546.70, stdev=46643.80 lat (usec): min=1638, max=249466, avg=50550.36, stdev=46643.11 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2376], 10.00th=[ 4490], 20.00th=[ 8356], | 30.00th=[ 13435], 40.00th=[ 25035], 50.00th=[ 36963], 60.00th=[ 51119], | 70.00th=[ 68682], 80.00th=[ 91751], 90.00th=[116917], 95.00th=[139461], | 99.00th=[202376], 99.50th=[214959], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 30, max= 349, per=25.26%, avg=155.59, stdev=67.26, samples=80 iops : min= 1, max= 21, avg= 8.90, stdev= 4.24, samples=80 lat (usec) : 50=0.13%, 100=2.73%, 250=0.39% lat (msec) : 2=1.82%, 4=3.39%, 10=7.94%, 20=7.81%, 50=30.99% lat (msec) : 100=33.07%, 250=11.72% cpu : usr=0.05%, sys=4.90%, ctx=1760, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178515: Mon Jul 13 11:04:36 2026 read: IOPS=8, BW=140KiB/s (144kB/s)(5744KiB/40906msec) clat (usec): min=65, max=232815, avg=57668.59, stdev=33377.12 lat (usec): min=66, max=232816, avg=57671.34, stdev=33377.58 clat percentiles (usec): | 1.00th=[ 69], 5.00th=[ 523], 10.00th=[ 24249], 20.00th=[ 32637], | 30.00th=[ 39584], 40.00th=[ 45876], 50.00th=[ 51643], 60.00th=[ 57934], | 70.00th=[ 69731], 80.00th=[ 83362], 90.00th=[100140], 95.00th=[114820], | 99.00th=[166724], 99.50th=[208667], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 30, max= 287, per=24.00%, avg=140.42, stdev=61.40, samples=79 iops : min= 1, max= 17, avg= 7.94, stdev= 3.88, samples=79 write: IOPS=9, BW=160KiB/s (164kB/s)(6544KiB/40906msec); 0 zone resets clat (usec): min=1693, max=251456, avg=48447.69, stdev=44627.39 lat (usec): min=1696, max=251459, avg=48453.10, stdev=44624.72 clat percentiles (usec): | 1.00th=[ 1926], 5.00th=[ 2769], 10.00th=[ 4555], 20.00th=[ 9503], | 30.00th=[ 17433], 40.00th=[ 25822], 50.00th=[ 35390], 60.00th=[ 47449], | 70.00th=[ 61080], 80.00th=[ 85459], 90.00th=[110625], 95.00th=[130548], | 99.00th=[196084], 99.50th=[221250], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 30, max= 466, per=25.67%, avg=158.13, stdev=75.47, samples=80 iops : min= 1, max= 29, avg= 9.08, stdev= 4.84, samples=80 lat (usec) : 100=1.95%, 250=0.26%, 750=0.26% lat (msec) : 2=1.17%, 4=3.26%, 10=7.16%, 20=6.64%, 50=33.98% lat (msec) : 100=33.59%, 250=11.59%, 500=0.13% cpu : usr=0.06%, sys=4.65%, ctx=1812, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178516: Mon Jul 13 11:04:36 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40307msec) clat (usec): min=47, max=275994, avg=58739.22, stdev=36747.03 lat (usec): min=49, max=275996, avg=58740.94, stdev=36747.05 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 717], 10.00th=[ 22938], 20.00th=[ 32375], | 30.00th=[ 38011], 40.00th=[ 45876], 50.00th=[ 54264], 60.00th=[ 60556], | 70.00th=[ 69731], 80.00th=[ 80217], 90.00th=[101188], 95.00th=[123208], | 99.00th=[227541], 99.50th=[246416], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 31, max= 319, per=26.58%, avg=155.51, stdev=63.89, samples=79 iops : min= 1, max= 19, avg= 8.90, stdev= 4.03, samples=79 write: IOPS=9, BW=150KiB/s (153kB/s)(6032KiB/40307msec); 0 zone resets clat (usec): min=1660, max=312138, avg=45533.03, stdev=46515.09 lat (usec): min=1662, max=312142, avg=45541.96, stdev=46512.58 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2704], 10.00th=[ 3982], 20.00th=[ 7177], | 30.00th=[ 12387], 40.00th=[ 21627], 50.00th=[ 31065], 60.00th=[ 42206], | 70.00th=[ 56361], 80.00th=[ 80217], 90.00th=[106431], 95.00th=[137364], | 99.00th=[198181], 99.50th=[308282], 99.90th=[312476], 99.95th=[312476], | 99.99th=[312476] bw ( KiB/s): min= 31, max= 349, per=23.95%, avg=147.53, stdev=68.25, samples=79 iops : min= 1, max= 21, avg= 8.39, stdev= 4.29, samples=79 lat (usec) : 50=0.13%, 100=1.95%, 250=0.13%, 500=0.13%, 750=0.26% lat (msec) : 2=1.04%, 4=4.17%, 10=8.07%, 20=6.25%, 50=33.20% lat (msec) : 100=33.59%, 250=10.68%, 500=0.39% cpu : usr=0.08%, sys=4.83%, ctx=1858, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178517: Mon Jul 13 11:04:36 2026 read: IOPS=9, BW=154KiB/s (158kB/s)(6032KiB/39070msec) clat (usec): min=43, max=389460, avg=57560.95, stdev=40025.76 lat (usec): min=43, max=389462, avg=57563.05, stdev=40025.74 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 66], 10.00th=[ 420], 20.00th=[ 27919], | 30.00th=[ 36963], 40.00th=[ 45351], 50.00th=[ 53740], 60.00th=[ 63177], | 70.00th=[ 70779], 80.00th=[ 84411], 90.00th=[104334], 95.00th=[124257], | 99.00th=[170918], 99.50th=[208667], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 411, per=26.52%, avg=155.12, stdev=72.43, samples=76 iops : min= 1, max= 25, avg= 8.87, stdev= 4.54, samples=76 write: IOPS=10, BW=160KiB/s (164kB/s)(6256KiB/39070msec); 0 zone resets clat (usec): min=1311, max=271365, avg=43206.02, stdev=43285.75 lat (usec): min=1313, max=271369, avg=43219.55, stdev=43287.26 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 2376], 10.00th=[ 3884], 20.00th=[ 6390], | 30.00th=[ 11338], 40.00th=[ 18220], 50.00th=[ 30278], 60.00th=[ 43254], | 70.00th=[ 54789], 80.00th=[ 73925], 90.00th=[103285], 95.00th=[135267], | 99.00th=[179307], 99.50th=[221250], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 415, per=26.35%, avg=162.34, stdev=73.41, samples=76 iops : min= 1, max= 25, avg= 9.32, stdev= 4.63, samples=76 lat (usec) : 50=0.39%, 100=3.52%, 250=0.78%, 500=0.26%, 750=0.13% lat (msec) : 2=1.43%, 4=4.43%, 10=9.11%, 20=7.03%, 50=28.26% lat (msec) : 100=33.33%, 250=11.07%, 500=0.26% cpu : usr=0.06%, sys=5.21%, ctx=1809, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=586KiB/s (600kB/s), 140KiB/s-155KiB/s (144kB/s-159kB/s), io=23.4MiB (24.5MB), run=39070-40906msec WRITE: bw=616KiB/s (631kB/s), 150KiB/s-160KiB/s (153kB/s-164kB/s), io=24.6MiB (25.8MB), run=39070-40906msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178510: Mon Jul 13 11:04:50 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(5920KiB/54622msec) clat (msec): min=9, max=417, avg=60.37, stdev=54.12 lat (msec): min=9, max=417, avg=60.37, stdev=54.12 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 57], 80.00th=[ 82], 90.00th=[ 126], 95.00th=[ 182], | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 409, per=24.91%, avg=109.11, stdev=66.90, samples=105 iops : min= 1, max= 25, avg= 6.02, stdev= 4.24, samples=105 write: IOPS=7, BW=117KiB/s (119kB/s)(6368KiB/54622msec); 0 zone resets clat (msec): min=16, max=306, avg=80.34, stdev=48.75 lat (msec): min=16, max=306, avg=80.35, stdev=48.75 clat percentiles (msec): | 1.00th=[ 22], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 42], | 30.00th=[ 47], 40.00th=[ 55], 50.00th=[ 64], 60.00th=[ 77], | 70.00th=[ 96], 80.00th=[ 117], 90.00th=[ 153], 95.00th=[ 186], | 99.00th=[ 239], 99.50th=[ 255], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 22, max= 351, per=25.99%, avg=119.82, stdev=65.76, samples=104 iops : min= 1, max= 21, avg= 6.68, stdev= 4.16, samples=104 lat (msec) : 10=0.13%, 20=5.47%, 50=40.36%, 100=32.03%, 250=21.09% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.74%, ctx=1188, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178511: Mon Jul 13 11:04:50 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(5744KiB/54416msec) clat (msec): min=8, max=294, avg=57.74, stdev=45.74 lat (msec): min=8, max=294, avg=57.75, stdev=45.74 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 52], | 70.00th=[ 63], 80.00th=[ 85], 90.00th=[ 126], 95.00th=[ 165], | 99.00th=[ 207], 99.50th=[ 251], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 351, per=25.05%, avg=109.74, stdev=68.64, samples=103 iops : min= 1, max= 21, avg= 6.05, stdev= 4.36, samples=103 write: IOPS=7, BW=120KiB/s (123kB/s)(6544KiB/54416msec); 0 zone resets clat (msec): min=18, max=334, avg=82.11, stdev=49.92 lat (msec): min=18, max=334, avg=82.11, stdev=49.92 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 49], 40.00th=[ 57], 50.00th=[ 68], 60.00th=[ 81], | 70.00th=[ 96], 80.00th=[ 120], 90.00th=[ 155], 95.00th=[ 186], | 99.00th=[ 226], 99.50th=[ 257], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 31, max= 287, per=26.46%, avg=121.97, stdev=59.34, samples=105 iops : min= 1, max= 17, avg= 6.82, stdev= 3.75, samples=105 lat (msec) : 10=0.13%, 20=5.60%, 50=38.02%, 100=34.24%, 250=21.48% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.86%, ctx=1243, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178512: Mon Jul 13 11:04:50 2026 read: IOPS=7, BW=116KiB/s (119kB/s)(6256KiB/53928msec) clat (msec): min=12, max=426, avg=56.54, stdev=47.71 lat (msec): min=12, max=426, avg=56.54, stdev=47.71 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 113], 95.00th=[ 159], | 99.00th=[ 222], 99.50th=[ 300], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 350, per=26.81%, avg=117.44, stdev=72.51, samples=105 iops : min= 1, max= 21, avg= 6.53, stdev= 4.59, samples=105 write: IOPS=6, BW=112KiB/s (115kB/s)(6032KiB/53928msec); 0 zone resets clat (msec): min=17, max=339, avg=82.99, stdev=53.85 lat (msec): min=17, max=339, avg=83.02, stdev=53.85 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 30], 10.00th=[ 35], 20.00th=[ 41], | 30.00th=[ 48], 40.00th=[ 53], 50.00th=[ 65], 60.00th=[ 78], | 70.00th=[ 96], 80.00th=[ 125], 90.00th=[ 165], 95.00th=[ 197], | 99.00th=[ 262], 99.50th=[ 279], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 281, per=24.09%, avg=111.05, stdev=61.84, samples=106 iops : min= 1, max= 17, avg= 6.13, stdev= 3.94, samples=106 lat (msec) : 20=5.99%, 50=41.80%, 100=31.64%, 250=19.66%, 500=0.91% cpu : usr=0.06%, sys=1.89%, ctx=1249, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178513: Mon Jul 13 11:04:50 2026 read: IOPS=6, BW=111KiB/s (114kB/s)(6032KiB/54136msec) clat (msec): min=7, max=306, avg=60.88, stdev=53.06 lat (msec): min=7, max=306, avg=60.89, stdev=53.06 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 51], | 70.00th=[ 61], 80.00th=[ 86], 90.00th=[ 144], 95.00th=[ 182], | 99.00th=[ 275], 99.50th=[ 292], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 351, per=25.69%, avg=112.52, stdev=68.56, samples=104 iops : min= 1, max= 21, avg= 6.22, stdev= 4.32, samples=104 write: IOPS=7, BW=116KiB/s (118kB/s)(6256KiB/54136msec); 0 zone resets clat (msec): min=12, max=341, avg=78.76, stdev=49.14 lat (msec): min=12, max=341, avg=78.76, stdev=49.14 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 29], 10.00th=[ 35], 20.00th=[ 43], | 30.00th=[ 50], 40.00th=[ 56], 50.00th=[ 64], 60.00th=[ 72], | 70.00th=[ 89], 80.00th=[ 110], 90.00th=[ 148], 95.00th=[ 182], | 99.00th=[ 249], 99.50th=[ 288], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 377, per=26.19%, avg=120.72, stdev=65.04, samples=101 iops : min= 1, max= 23, avg= 6.75, stdev= 4.13, samples=101 lat (msec) : 10=0.13%, 20=5.21%, 50=40.10%, 100=34.11%, 250=19.27% lat (msec) : 500=1.17% cpu : usr=0.03%, sys=1.74%, ctx=1221, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=439KiB/s (449kB/s), 106KiB/s-116KiB/s (108kB/s-119kB/s), io=23.4MiB (24.5MB), run=53928-54622msec WRITE: bw=461KiB/s (472kB/s), 112KiB/s-120KiB/s (115kB/s-123kB/s), io=24.6MiB (25.8MB), run=53928-54622msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178531: Mon Jul 13 11:05:07 2026 read: IOPS=1, BW=1286KiB/s (1317kB/s)(7168KiB/5572msec) clat (msec): min=2, max=3281, avg=611.46, stdev=1182.31 lat (msec): min=2, max=3281, avg=611.46, stdev=1182.31 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 31], | 30.00th=[ 228], 40.00th=[ 228], 50.00th=[ 230], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 259], 90.00th=[ 3272], 95.00th=[ 3272], | 99.00th=[ 3272], 99.50th=[ 3272], 99.90th=[ 3272], 99.95th=[ 3272], | 99.99th=[ 3272] bw ( KiB/s): min= 1535, max= 4071, per=66.25%, avg=2310.80, stdev=1004.96, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=919KiB/s (941kB/s)(5120KiB/5572msec); 0 zone resets clat (msec): min=106, max=322, avg=215.50, stdev=98.19 lat (msec): min=106, max=322, avg=215.60, stdev=98.13 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 107], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 321], 95.00th=[ 321], | 99.00th=[ 321], 99.50th=[ 321], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 2043, max= 5636, per=78.63%, avg=3839.50, stdev=2540.63, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 4=8.33%, 50=8.33%, 250=50.00%, 500=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=6.73%, ctx=365, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178532: Mon Jul 13 11:05:07 2026 read: IOPS=0, BW=368KiB/s (377kB/s)(2048KiB/5569msec) clat (usec): min=279680, max=280961, avg=280320.57, stdev=905.88 lat (usec): min=279681, max=280963, avg=280322.46, stdev=906.73 clat percentiles (msec): | 1.00th=[ 279], 5.00th=[ 279], 10.00th=[ 279], 20.00th=[ 279], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1475, max= 2039, per=50.37%, avg=1757.00, stdev=398.81, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1839KiB/s (1883kB/s)(10.0MiB/5569msec); 0 zone resets clat (msec): min=107, max=2252, avg=489.31, stdev=638.39 lat (msec): min=107, max=2252, avg=489.40, stdev=638.38 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 142], | 30.00th=[ 197], 40.00th=[ 201], 50.00th=[ 226], 60.00th=[ 334], | 70.00th=[ 380], 80.00th=[ 439], 90.00th=[ 617], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1878, max= 4087, per=62.06%, avg=3030.17, stdev=1150.35, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.64%, ctx=142, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178533: Mon Jul 13 11:05:07 2026 read: IOPS=1, BW=1046KiB/s (1072kB/s)(6144KiB/5871msec) clat (usec): min=490, max=382956, avg=171503.45, stdev=169176.83 lat (usec): min=491, max=382958, avg=171504.86, stdev=169176.85 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 7046], | 30.00th=[ 7046], 40.00th=[ 81265], 50.00th=[ 81265], 60.00th=[204473], | 70.00th=[354419], 80.00th=[354419], 90.00th=[383779], 95.00th=[383779], | 99.00th=[383779], 99.50th=[383779], 99.90th=[383779], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 1878, max= 6107, per=95.80%, avg=3341.33, stdev=2396.49, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1046KiB/s (1072kB/s)(6144KiB/5871msec); 0 zone resets clat (msec): min=160, max=2318, avg=785.53, stdev=801.81 lat (msec): min=160, max=2318, avg=785.73, stdev=801.83 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 642], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 1973, max= 4071, per=62.12%, avg=3033.50, stdev=1189.05, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 500=8.33% lat (msec) : 10=8.33%, 100=8.33%, 250=25.00%, 500=16.67%, 750=16.67% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=5.86%, ctx=157, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178534: Mon Jul 13 11:05:07 2026 read: IOPS=0, BW=1012KiB/s (1036kB/s)(5120KiB/5060msec) clat (msec): min=2, max=301, avg=145.63, stdev=109.45 lat (msec): min=2, max=301, avg=145.63, stdev=109.45 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 122], 60.00th=[ 122], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 2035, max= 6119, per=100.00%, avg=4077.00, stdev=2887.82, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1417KiB/s (1451kB/s)(7168KiB/5060msec); 0 zone resets clat (msec): min=156, max=2483, avg=613.71, stdev=851.14 lat (msec): min=156, max=2483, avg=613.81, stdev=851.12 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 184], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 768], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 1479, max= 4071, per=59.61%, avg=2911.00, stdev=1349.73, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 4=8.33%, 250=66.67%, 500=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=9.19%, ctx=281, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3488KiB/s (3572kB/s), 368KiB/s-1286KiB/s (377kB/s-1317kB/s), io=20.0MiB (20.0MB), run=5060-5871msec WRITE: bw=4884KiB/s (5001kB/s), 919KiB/s-1839KiB/s (941kB/s-1883kB/s), io=28.0MiB (29.4MB), run=5060-5871msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178535: Mon Jul 13 11:05:07 2026 read: IOPS=1, BW=1135KiB/s (1163kB/s)(7168KiB/6313msec) clat (msec): min=76, max=2801, avg=588.49, stdev=995.96 lat (msec): min=76, max=2801, avg=588.49, stdev=995.96 clat percentiles (msec): | 1.00th=[ 78], 5.00th=[ 78], 10.00th=[ 78], 20.00th=[ 112], | 30.00th=[ 118], 40.00th=[ 118], 50.00th=[ 159], 60.00th=[ 199], | 70.00th=[ 199], 80.00th=[ 651], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1560, max= 2035, per=59.05%, avg=1915.67, stdev=182.41, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=811KiB/s (830kB/s)(5120KiB/6313msec); 0 zone resets clat (msec): min=178, max=547, avg=360.49, stdev=161.55 lat (msec): min=178, max=547, avg=360.84, stdev=161.24 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1885, max= 4039, per=54.70%, avg=2483.75, stdev=1038.60, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=3.17%, ctx=103, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178536: Mon Jul 13 11:05:07 2026 read: IOPS=0, BW=336KiB/s (344kB/s)(2048KiB/6098msec) clat (msec): min=61, max=329, avg=195.34, stdev=189.19 lat (msec): min=61, max=329, avg=195.34, stdev=189.19 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 62], | 30.00th=[ 62], 40.00th=[ 62], 50.00th=[ 62], 60.00th=[ 330], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 330], 95.00th=[ 330], | 99.00th=[ 330], 99.50th=[ 330], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 1553, max= 2039, per=55.36%, avg=1796.00, stdev=343.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1679KiB/s (1720kB/s)(10.0MiB/6098msec); 0 zone resets clat (msec): min=131, max=2158, avg=551.50, stdev=608.42 lat (msec): min=131, max=2158, avg=551.60, stdev=608.43 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 211], | 30.00th=[ 232], 40.00th=[ 326], 50.00th=[ 334], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 414], 90.00th=[ 969], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 2003, max= 4096, per=66.77%, avg=3032.00, stdev=1113.51, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.00%, ctx=78, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178537: Mon Jul 13 11:05:07 2026 read: IOPS=1, BW=1029KiB/s (1054kB/s)(6144KiB/5970msec) clat (msec): min=82, max=377, avg=230.06, stdev=117.11 lat (msec): min=82, max=377, avg=230.06, stdev=117.11 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 113], | 30.00th=[ 113], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 279], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1885, max= 4079, per=100.00%, avg=3323.67, stdev=1246.44, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1029KiB/s (1054kB/s)(6144KiB/5970msec); 0 zone resets clat (msec): min=84, max=2192, avg=756.63, stdev=742.78 lat (msec): min=84, max=2192, avg=756.73, stdev=742.77 clat percentiles (msec): | 1.00th=[ 85], 5.00th=[ 85], 10.00th=[ 85], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 542], 50.00th=[ 542], 60.00th=[ 676], | 70.00th=[ 735], 80.00th=[ 735], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1595, max= 2048, per=42.18%, avg=1915.60, stdev=190.65, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=16.67%, 250=16.67%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.68%, ctx=76, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178538: Mon Jul 13 11:05:07 2026 read: IOPS=0, BW=831KiB/s (851kB/s)(5120KiB/6163msec) clat (msec): min=139, max=572, avg=269.35, stdev=189.28 lat (msec): min=139, max=572, avg=269.35, stdev=189.28 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 150], 60.00th=[ 150], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 4079, max= 4096, per=100.00%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1163KiB/s (1191kB/s)(7168KiB/6163msec); 0 zone resets clat (msec): min=126, max=2384, avg=621.94, stdev=801.48 lat (msec): min=126, max=2385, avg=622.03, stdev=801.48 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 197], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 251], 60.00th=[ 489], | 70.00th=[ 489], 80.00th=[ 684], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 2015, max= 4063, per=66.73%, avg=3030.00, stdev=1160.73, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.44%, ctx=84, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3244KiB/s (3322kB/s), 336KiB/s-1135KiB/s (344kB/s-1163kB/s), io=20.0MiB (20.0MB), run=5970-6313msec WRITE: bw=4542KiB/s (4651kB/s), 811KiB/s-1679KiB/s (830kB/s-1720kB/s), io=28.0MiB (29.4MB), run=5970-6313msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178545: Mon Jul 13 11:05:21 2026 read: IOPS=1, BW=6568KiB/s (6725kB/s)(12.0MiB/1871msec) clat (msec): min=294, max=858, avg=605.80, stdev=286.69 lat (msec): min=294, max=858, avg=605.80, stdev=286.69 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 5580, max= 8062, per=100.00%, avg=6821.00, stdev=1755.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.36%, ctx=72, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178546: Mon Jul 13 11:05:21 2026 read: IOPS=0, BW=1200KiB/s (1229kB/s)(4096KiB/3414msec) clat (nsec): min=1067.6M, max=1067.6M, avg=1067550854.00, stdev= 0.00 lat (nsec): min=1067.6M, max=1067.6M, avg=1067553670.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2400KiB/s (2457kB/s)(8192KiB/3414msec); 0 zone resets clat (msec): min=851, max=1377, avg=1114.51, stdev=371.36 lat (msec): min=852, max=1377, avg=1115.00, stdev=371.39 clat percentiles (msec): | 1.00th=[ 852], 5.00th=[ 852], 10.00th=[ 852], 20.00th=[ 852], | 30.00th=[ 852], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8110, max= 8110, per=84.50%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.54%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178547: Mon Jul 13 11:05:21 2026 write: IOPS=0, BW=4004KiB/s (4100kB/s)(12.0MiB/3069msec); 0 zone resets clat (msec): min=231, max=1798, avg=1014.19, stdev=783.13 lat (msec): min=232, max=1798, avg=1014.53, stdev=783.25 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1804], 80.00th=[ 1804], 90.00th=[ 1804], 95.00th=[ 1804], | 99.00th=[ 1804], 99.50th=[ 1804], 99.90th=[ 1804], 99.95th=[ 1804], | 99.99th=[ 1804] bw ( KiB/s): min= 8062, max= 8062, per=84.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.47%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178548: Mon Jul 13 11:05:21 2026 write: IOPS=1, BW=4451KiB/s (4557kB/s)(12.0MiB/2761msec); 0 zone resets clat (msec): min=322, max=1572, avg=880.14, stdev=635.96 lat (msec): min=323, max=1575, avg=881.28, stdev=637.08 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 743], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7488, max= 8159, per=81.51%, avg=7823.50, stdev=474.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.51%, ctx=71, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4799KiB/s (4914kB/s), 1200KiB/s-6568KiB/s (1229kB/s-6725kB/s), io=16.0MiB (16.8MB), run=1871-3414msec WRITE: bw=9598KiB/s (9828kB/s), 2400KiB/s-4451KiB/s (2457kB/s-4557kB/s), io=32.0MiB (33.6MB), run=2761-3414msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178549: Mon Jul 13 11:05:21 2026 read: IOPS=1, BW=5157KiB/s (5280kB/s)(12.0MiB/2383msec) clat (msec): min=724, max=877, avg=776.36, stdev=87.20 lat (msec): min=724, max=877, avg=776.36, stdev=87.20 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.04%, sys=15.07%, ctx=403, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178550: Mon Jul 13 11:05:21 2026 read: IOPS=0, BW=1419KiB/s (1453kB/s)(4096KiB/2887msec) clat (nsec): min=604818k, max=604818k, avg=604817918.00, stdev= 0.00 lat (nsec): min=604821k, max=604821k, avg=604821004.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2838KiB/s (2906kB/s)(8192KiB/2887msec); 0 zone resets clat (msec): min=487, max=1729, avg=1108.16, stdev=878.32 lat (msec): min=487, max=1731, avg=1109.75, stdev=879.80 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 1737], | 70.00th=[ 1737], 80.00th=[ 1737], 90.00th=[ 1737], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 8192, max= 8192, per=83.68%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.88%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178551: Mon Jul 13 11:05:21 2026 write: IOPS=0, BW=3671KiB/s (3759kB/s)(12.0MiB/3347msec); 0 zone resets clat (msec): min=257, max=1974, avg=1082.11, stdev=860.81 lat (msec): min=258, max=1977, avg=1083.34, stdev=861.61 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1972], 80.00th=[ 1972], 90.00th=[ 1972], 95.00th=[ 1972], | 99.00th=[ 1972], 99.50th=[ 1972], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 8159, max= 8159, per=83.34%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.56%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178552: Mon Jul 13 11:05:21 2026 write: IOPS=1, BW=4521KiB/s (4629kB/s)(12.0MiB/2718msec); 0 zone resets clat (msec): min=212, max=1580, avg=852.56, stdev=687.89 lat (msec): min=213, max=1589, avg=856.05, stdev=692.80 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8159, max= 8175, per=83.42%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.24%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5675KiB/s (5811kB/s), 1419KiB/s-5157KiB/s (1453kB/s-5280kB/s), io=16.0MiB (16.8MB), run=2383-2887msec WRITE: bw=9790KiB/s (10.0MB/s), 2838KiB/s-4521KiB/s (2906kB/s-4629kB/s), io=32.0MiB (33.6MB), run=2718-3347msec