== sanity test 398b: DIO and buffer IO race ============== 14:41:37 (1790102497) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.79569 s, 8.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180064: Tue Sep 22 14:43:56 2026 read: IOPS=13, BW=53.4KiB/s (54.7kB/s)(5992KiB/112164msec) clat (usec): min=42, max=782931, avg=41374.30, stdev=35043.21 lat (usec): min=43, max=782935, avg=41377.26, stdev=35043.57 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 9110], 10.00th=[ 15008], 20.00th=[ 20055], | 30.00th=[ 24249], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 40633], | 70.00th=[ 47449], 80.00th=[ 56886], 90.00th=[ 74974], 95.00th=[ 93848], | 99.00th=[154141], 99.50th=[189793], 99.90th=[291505], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 7, max= 133, per=26.36%, avg=53.51, stdev=21.33, samples=219 iops : min= 1, max= 33, avg=12.74, stdev= 5.39, samples=219 write: IOPS=14, BW=56.1KiB/s (57.5kB/s)(6296KiB/112164msec); 0 zone resets clat (usec): min=805, max=249309, avg=31429.80, stdev=33224.14 lat (usec): min=806, max=249310, avg=31442.55, stdev=33215.75 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1418], 20.00th=[ 3064], | 30.00th=[ 6521], 40.00th=[ 14353], 50.00th=[ 22414], 60.00th=[ 30802], | 70.00th=[ 41157], 80.00th=[ 53216], 90.00th=[ 76022], 95.00th=[ 94897], | 99.00th=[145753], 99.50th=[168821], 99.90th=[244319], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 7, max= 127, per=26.53%, avg=56.25, stdev=24.48, samples=219 iops : min= 1, max= 31, avg=13.43, stdev= 6.14, samples=219 lat (usec) : 50=0.26%, 100=1.56%, 250=0.16%, 1000=0.39% lat (msec) : 2=6.71%, 4=5.08%, 10=6.64%, 20=12.70%, 50=41.67% lat (msec) : 100=20.51%, 250=4.26%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.25%, ctx=6281, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180065: Tue Sep 22 14:43:56 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(5940KiB/115419msec) clat (usec): min=40, max=209759, avg=41779.87, stdev=27085.67 lat (usec): min=41, max=209760, avg=41781.57, stdev=27086.05 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10421], 10.00th=[ 15270], 20.00th=[ 20579], | 30.00th=[ 25297], 40.00th=[ 30278], 50.00th=[ 35390], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 60031], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[152044], 99.90th=[185598], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 6, max= 111, per=25.21%, avg=51.17, stdev=20.42, samples=226 iops : min= 1, max= 27, avg=12.15, stdev= 5.16, samples=226 write: IOPS=13, BW=54.0KiB/s (56.3kB/s)(6348KiB/115419msec); 0 zone resets clat (usec): min=876, max=785572, avg=33280.45, stdev=39208.16 lat (usec): min=876, max=785574, avg=33282.28, stdev=39207.95 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1385], 20.00th=[ 3294], | 30.00th=[ 7308], 40.00th=[ 14222], 50.00th=[ 23987], 60.00th=[ 31851], | 70.00th=[ 41681], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[154141], 99.50th=[185598], 99.90th=[287310], 99.95th=[784335], | 99.99th=[784335] bw ( KiB/s): min= 15, max= 190, per=25.88%, avg=54.86, stdev=25.11, samples=225 iops : min= 3, max= 47, avg=13.08, stdev= 6.33, samples=225 lat (usec) : 50=0.39%, 100=1.04%, 250=0.16%, 500=0.03%, 1000=0.20% lat (msec) : 2=7.32%, 4=4.04%, 10=6.74%, 20=12.70%, 50=39.94% lat (msec) : 100=22.95%, 250=4.43%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.40%, ctx=6486, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180066: Tue Sep 22 14:43:56 2026 read: IOPS=12, BW=51.4KiB/s (52.6kB/s)(6028KiB/117246msec) clat (usec): min=39, max=225451, avg=41869.08, stdev=28234.02 lat (usec): min=40, max=225452, avg=41871.34, stdev=28233.53 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 10945], 10.00th=[ 14877], 20.00th=[ 20317], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49546], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[132645], 99.50th=[173016], 99.90th=[214959], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=51.29, stdev=20.56, samples=229 iops : min= 1, max= 29, avg=12.20, stdev= 5.16, samples=229 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6260KiB/117246msec); 0 zone resets clat (usec): min=707, max=769826, avg=34225.72, stdev=39439.75 lat (usec): min=708, max=769827, avg=34231.65, stdev=39444.01 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1418], 20.00th=[ 3228], | 30.00th=[ 7177], 40.00th=[ 16319], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 58983], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[147850], 99.50th=[170918], 99.90th=[304088], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 119, per=25.02%, avg=53.05, stdev=23.47, samples=230 iops : min= 1, max= 29, avg=12.63, stdev= 5.91, samples=230 lat (usec) : 50=0.10%, 100=1.46%, 250=0.07%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=7.10%, 4=4.72%, 10=5.99%, 20=12.21%, 50=40.72% lat (msec) : 100=22.79%, 250=4.46%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.34%, ctx=6508, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180067: Tue Sep 22 14:43:56 2026 read: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6052KiB/118042msec) clat (usec): min=37, max=349161, avg=43153.96, stdev=30879.44 lat (usec): min=37, max=349163, avg=43165.72, stdev=30877.82 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9241], 10.00th=[ 15139], 20.00th=[ 20579], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[154141], 99.50th=[175113], 99.90th=[263193], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 7, max= 134, per=25.24%, avg=51.24, stdev=20.87, samples=231 iops : min= 1, max= 33, avg=12.17, stdev= 5.22, samples=231 write: IOPS=13, BW=52.8KiB/s (54.1kB/s)(6236KiB/118042msec); 0 zone resets clat (usec): min=818, max=1017.0k, avg=33472.61, stdev=43127.30 lat (usec): min=818, max=1017.0k, avg=33474.95, stdev=43127.16 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1303], | 20.00th=[ 3032], 30.00th=[ 6063], 40.00th=[ 14091], | 50.00th=[ 22676], 60.00th=[ 30540], 70.00th=[ 41157], | 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[ 103285], | 99.00th=[ 152044], 99.50th=[ 179307], 99.90th=[ 231736], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 173, per=24.78%, avg=52.53, stdev=24.01, samples=232 iops : min= 1, max= 43, avg=12.50, stdev= 6.05, samples=232 lat (usec) : 50=0.36%, 100=1.53%, 250=0.13%, 750=0.03%, 1000=0.33% lat (msec) : 2=7.16%, 4=4.26%, 10=6.64%, 20=12.40%, 50=39.10% lat (msec) : 100=22.92%, 250=5.05%, 500=0.07%, 2000=0.03% cpu : usr=0.08%, sys=5.25%, ctx=6459, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=203KiB/s (208kB/s), 51.3KiB/s-53.4KiB/s (52.5kB/s-54.7kB/s), io=23.4MiB (24.6MB), run=112164-118042msec WRITE: bw=213KiB/s (218kB/s), 52.8KiB/s-56.1KiB/s (54.1kB/s-57.5kB/s), io=24.6MiB (25.7MB), run=112164-118042msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180069: Tue Sep 22 14:44:33 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(5992KiB/154796msec) clat (msec): min=4, max=835, avg=39.23, stdev=41.69 lat (msec): min=4, max=835, avg=39.23, stdev=41.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 116], | 99.00th=[ 186], 99.50th=[ 220], 99.90th=[ 338], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 172, per=25.16%, avg=38.75, stdev=27.78, samples=301 iops : min= 1, max= 43, avg= 9.04, stdev= 7.00, samples=301 write: IOPS=10, BW=40.7KiB/s (41.6kB/s)(6296KiB/154796msec); 0 zone resets clat (msec): min=10, max=431, avg=60.75, stdev=44.39 lat (msec): min=10, max=431, avg=60.75, stdev=44.39 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 89], 90.00th=[ 122], 95.00th=[ 146], | 99.00th=[ 213], 99.50th=[ 259], 99.90th=[ 347], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 7, max= 127, per=25.14%, avg=40.48, stdev=24.62, samples=303 iops : min= 1, max= 31, avg= 9.47, stdev= 6.19, samples=303 lat (msec) : 10=3.29%, 20=17.35%, 50=44.69%, 100=23.08%, 250=11.17% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.07%, sys=1.77%, ctx=4764, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180070: Tue Sep 22 14:44:33 2026 read: IOPS=9, BW=38.2KiB/s (39.2kB/s)(5940KiB/155354msec) clat (msec): min=4, max=1043, avg=40.29, stdev=43.87 lat (msec): min=4, max=1043, avg=40.29, stdev=43.87 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 87], 95.00th=[ 112], | 99.00th=[ 190], 99.50th=[ 205], 99.90th=[ 279], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 7, max= 135, per=25.46%, avg=39.21, stdev=26.87, samples=295 iops : min= 1, max= 33, avg= 9.15, stdev= 6.76, samples=295 write: IOPS=10, BW=40.9KiB/s (41.8kB/s)(6348KiB/155354msec); 0 zone resets clat (msec): min=11, max=471, avg=59.97, stdev=42.95 lat (msec): min=11, max=471, avg=59.97, stdev=42.95 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 70], 80.00th=[ 92], 90.00th=[ 118], 95.00th=[ 142], | 99.00th=[ 192], 99.50th=[ 236], 99.90th=[ 363], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 136, per=25.26%, avg=40.66, stdev=24.85, samples=304 iops : min= 1, max= 34, avg= 9.51, stdev= 6.26, samples=304 lat (msec) : 10=3.22%, 20=15.63%, 50=46.81%, 100=21.78%, 250=12.30% lat (msec) : 500=0.23%, 2000=0.03% cpu : usr=0.07%, sys=1.87%, ctx=4877, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180071: Tue Sep 22 14:44:33 2026 read: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6028KiB/154947msec) clat (msec): min=4, max=338, avg=41.54, stdev=39.46 lat (msec): min=4, max=338, avg=41.54, stdev=39.46 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 92], 95.00th=[ 122], | 99.00th=[ 201], 99.50th=[ 241], 99.90th=[ 288], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 7, max= 159, per=25.11%, avg=38.67, stdev=25.51, samples=303 iops : min= 1, max= 39, avg= 9.01, stdev= 6.41, samples=303 write: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6260KiB/154947msec); 0 zone resets clat (msec): min=11, max=953, avg=58.73, stdev=46.41 lat (msec): min=11, max=953, avg=58.73, stdev=46.41 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 111], 95.00th=[ 136], | 99.00th=[ 194], 99.50th=[ 241], 99.90th=[ 435], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 160, per=24.97%, avg=40.21, stdev=25.63, samples=303 iops : min= 1, max= 40, avg= 9.40, stdev= 6.44, samples=303 lat (msec) : 10=3.22%, 20=16.24%, 50=45.18%, 100=24.38%, 250=10.58% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.07%, sys=1.81%, ctx=4833, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180072: Tue Sep 22 14:44:33 2026 read: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6052KiB/154170msec) clat (msec): min=4, max=303, avg=40.56, stdev=38.72 lat (msec): min=4, max=303, avg=40.57, stdev=38.74 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 90], 95.00th=[ 124], | 99.00th=[ 190], 99.50th=[ 234], 99.90th=[ 275], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 135, per=26.11%, avg=40.21, stdev=27.08, samples=294 iops : min= 1, max= 33, avg= 9.40, stdev= 6.81, samples=294 write: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6236KiB/154170msec); 0 zone resets clat (msec): min=10, max=1066, avg=59.29, stdev=51.00 lat (msec): min=10, max=1066, avg=59.29, stdev=51.00 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 87], 90.00th=[ 115], 95.00th=[ 148], | 99.00th=[ 205], 99.50th=[ 305], 99.90th=[ 468], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 128, per=24.95%, avg=40.16, stdev=25.97, samples=303 iops : min= 1, max= 32, avg= 9.39, stdev= 6.53, samples=303 lat (msec) : 10=3.32%, 20=16.89%, 50=45.54%, 100=22.92%, 250=10.90% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.04%, sys=1.83%, ctx=4775, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=155KiB/s (158kB/s), 38.2KiB/s-39.3KiB/s (39.2kB/s-40.2kB/s), io=23.4MiB (24.6MB), run=154170-155354msec WRITE: bw=162KiB/s (166kB/s), 40.4KiB/s-40.9KiB/s (41.4kB/s-41.8kB/s), io=24.6MiB (25.7MB), run=154170-155354msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180116: Tue Sep 22 14:45:12 2026 read: IOPS=12, BW=202KiB/s (207kB/s)(5920KiB/29348msec) clat (usec): min=38, max=156176, avg=41810.66, stdev=24052.04 lat (usec): min=39, max=156177, avg=41811.86, stdev=24052.05 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 78], 10.00th=[ 17171], 20.00th=[ 24773], | 30.00th=[ 28967], 40.00th=[ 32900], 50.00th=[ 38536], 60.00th=[ 43779], | 70.00th=[ 48497], 80.00th=[ 56886], 90.00th=[ 71828], 95.00th=[ 88605], | 99.00th=[120062], 99.50th=[131597], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 63, max= 352, per=24.22%, avg=197.61, stdev=73.49, samples=57 iops : min= 3, max= 22, avg=11.61, stdev= 4.70, samples=57 write: IOPS=13, BW=217KiB/s (222kB/s)(6368KiB/29348msec); 0 zone resets clat (usec): min=1569, max=160347, avg=34108.51, stdev=32161.75 lat (usec): min=1571, max=160348, avg=34119.50, stdev=32154.92 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2073], 10.00th=[ 3359], 20.00th=[ 5669], | 30.00th=[ 9634], 40.00th=[ 17171], 50.00th=[ 25297], 60.00th=[ 32637], | 70.00th=[ 43779], 80.00th=[ 57410], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[141558], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 63, max= 442, per=25.04%, avg=214.81, stdev=80.57, samples=57 iops : min= 3, max= 27, avg=12.70, stdev= 5.08, samples=57 lat (usec) : 50=0.39%, 100=2.34%, 250=0.13%, 500=0.13% lat (msec) : 2=2.47%, 4=4.17%, 10=9.64%, 20=9.64%, 50=44.27% lat (msec) : 100=23.05%, 250=3.78% cpu : usr=0.09%, sys=6.09%, ctx=1731, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180117: Tue Sep 22 14:45:12 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(5744KiB/29308msec) clat (usec): min=39, max=173979, avg=43990.18, stdev=28351.37 lat (usec): min=39, max=173981, avg=43991.47, stdev=28351.62 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 16319], 20.00th=[ 23200], | 30.00th=[ 28181], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 45351], | 70.00th=[ 53740], 80.00th=[ 65274], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[173016], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 53, max= 349, per=24.18%, avg=197.29, stdev=69.46, samples=56 iops : min= 3, max= 21, avg=11.59, stdev= 4.33, samples=56 write: IOPS=13, BW=223KiB/s (229kB/s)(6544KiB/29308msec); 0 zone resets clat (usec): min=1206, max=194539, avg=32217.53, stdev=31241.18 lat (usec): min=1208, max=194541, avg=32222.46, stdev=31240.70 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 1942], 10.00th=[ 2671], 20.00th=[ 4359], | 30.00th=[ 8979], 40.00th=[ 15926], 50.00th=[ 23462], 60.00th=[ 31065], | 70.00th=[ 41157], 80.00th=[ 55313], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[127402], 99.50th=[139461], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 442, per=25.60%, avg=219.67, stdev=82.18, samples=57 iops : min= 3, max= 27, avg=13.02, stdev= 5.15, samples=57 lat (usec) : 50=0.39%, 100=2.34%, 250=0.52% lat (msec) : 2=2.99%, 4=6.25%, 10=7.55%, 20=11.59%, 50=40.23% lat (msec) : 100=24.61%, 250=3.52% cpu : usr=0.08%, sys=5.96%, ctx=1668, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180118: Tue Sep 22 14:45:12 2026 read: IOPS=13, BW=217KiB/s (222kB/s)(6256KiB/28867msec) clat (usec): min=36, max=163926, avg=43371.07, stdev=27495.68 lat (usec): min=36, max=163927, avg=43380.84, stdev=27508.05 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 67], 10.00th=[ 14353], 20.00th=[ 22152], | 30.00th=[ 27919], 40.00th=[ 32637], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 79168], 95.00th=[ 93848], | 99.00th=[133694], 99.50th=[147850], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 63, max= 447, per=26.56%, avg=216.71, stdev=79.85, samples=56 iops : min= 3, max= 27, avg=12.82, stdev= 5.00, samples=56 write: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28867msec); 0 zone resets clat (usec): min=1283, max=211060, avg=31254.57, stdev=31546.15 lat (usec): min=1286, max=211062, avg=31256.72, stdev=31546.15 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1876], 10.00th=[ 2704], 20.00th=[ 5473], | 30.00th=[ 9241], 40.00th=[ 14222], 50.00th=[ 19792], 60.00th=[ 29754], | 70.00th=[ 39584], 80.00th=[ 53740], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[135267], 99.50th=[166724], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 416, per=23.98%, avg=205.79, stdev=82.34, samples=56 iops : min= 1, max= 26, avg=12.12, stdev= 5.29, samples=56 lat (usec) : 50=0.52%, 100=3.12%, 500=0.13% lat (msec) : 2=3.39%, 4=5.21%, 10=7.94%, 20=12.63%, 50=39.06% lat (msec) : 100=23.96%, 250=4.04% cpu : usr=0.07%, sys=5.97%, ctx=1722, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180119: Tue Sep 22 14:45:12 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6032KiB/28219msec) clat (usec): min=47, max=178048, avg=40955.99, stdev=28893.65 lat (usec): min=47, max=178048, avg=40965.39, stdev=28901.46 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 63], 10.00th=[ 86], 20.00th=[ 21627], | 30.00th=[ 27132], 40.00th=[ 30802], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 58983], 90.00th=[ 74974], 95.00th=[ 96994], | 99.00th=[158335], 99.50th=[168821], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 62, max= 476, per=25.87%, avg=211.11, stdev=81.77, samples=55 iops : min= 3, max= 29, avg=12.45, stdev= 5.16, samples=55 write: IOPS=13, BW=222KiB/s (227kB/s)(6256KiB/28219msec); 0 zone resets clat (usec): min=1050, max=170315, avg=32088.90, stdev=33184.63 lat (usec): min=1051, max=170316, avg=32091.11, stdev=33184.42 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1713], 10.00th=[ 1909], 20.00th=[ 4817], | 30.00th=[ 8094], 40.00th=[ 13042], 50.00th=[ 19006], 60.00th=[ 28967], | 70.00th=[ 40109], 80.00th=[ 60556], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[152044], 99.50th=[168821], 99.90th=[170918], 99.95th=[170918], | 99.99th=[170918] bw ( KiB/s): min= 63, max= 476, per=25.55%, avg=219.25, stdev=84.05, samples=55 iops : min= 3, max= 29, avg=12.96, stdev= 5.29, samples=55 lat (usec) : 50=0.26%, 100=4.82%, 250=0.39% lat (msec) : 2=5.60%, 4=4.30%, 10=8.59%, 20=10.55%, 50=38.54% lat (msec) : 100=22.66%, 250=4.30% cpu : usr=0.10%, sys=5.85%, ctx=1571, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=816KiB/s (836kB/s), 196KiB/s-217KiB/s (201kB/s-222kB/s), io=23.4MiB (24.5MB), run=28219-29348msec WRITE: bw=859KiB/s (879kB/s), 209KiB/s-223KiB/s (214kB/s-229kB/s), io=24.6MiB (25.8MB), run=28219-29348msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180112: Tue Sep 22 14:45:24 2026 read: IOPS=8, BW=143KiB/s (147kB/s)(5920KiB/41272msec) clat (msec): min=7, max=217, avg=43.11, stdev=35.44 lat (msec): min=7, max=217, avg=43.12, stdev=35.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 93], 95.00th=[ 126], | 99.00th=[ 169], 99.50th=[ 199], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 31, max= 438, per=24.84%, avg=143.82, stdev=87.99, samples=80 iops : min= 1, max= 27, avg= 8.17, stdev= 5.54, samples=80 write: IOPS=9, BW=154KiB/s (158kB/s)(6368KiB/41272msec); 0 zone resets clat (msec): min=11, max=229, avg=63.16, stdev=41.39 lat (msec): min=11, max=229, avg=63.17, stdev=41.39 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 95], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 192], 99.50th=[ 203], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 446, per=25.55%, avg=155.84, stdev=88.50, samples=80 iops : min= 1, max= 27, avg= 8.92, stdev= 5.61, samples=80 lat (msec) : 10=1.04%, 20=15.49%, 50=43.75%, 100=26.43%, 250=13.28% cpu : usr=0.06%, sys=2.02%, ctx=1271, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180113: Tue Sep 22 14:45:24 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(5744KiB/41297msec) clat (msec): min=5, max=185, avg=42.35, stdev=32.77 lat (msec): min=5, max=185, avg=42.35, stdev=32.77 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 47], 80.00th=[ 59], 90.00th=[ 85], 95.00th=[ 110], | 99.00th=[ 163], 99.50th=[ 184], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 31, max= 448, per=24.20%, avg=140.10, stdev=90.85, samples=80 iops : min= 1, max= 28, avg= 7.94, stdev= 5.74, samples=80 write: IOPS=9, BW=158KiB/s (162kB/s)(6544KiB/41297msec); 0 zone resets clat (msec): min=13, max=325, avg=63.31, stdev=42.40 lat (msec): min=13, max=325, avg=63.31, stdev=42.40 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 57], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 146], | 99.00th=[ 205], 99.50th=[ 218], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 62, max= 351, per=25.80%, avg=157.38, stdev=77.97, samples=81 iops : min= 3, max= 21, avg= 9.02, stdev= 4.93, samples=81 lat (msec) : 10=1.69%, 20=12.24%, 50=46.88%, 100=27.47%, 250=11.59% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.76%, ctx=1172, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180114: Tue Sep 22 14:45:24 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40415msec) clat (msec): min=7, max=268, avg=42.12, stdev=33.33 lat (msec): min=7, max=268, avg=42.12, stdev=33.34 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 86], 95.00th=[ 109], | 99.00th=[ 171], 99.50th=[ 186], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 445, per=26.77%, avg=154.99, stdev=98.87, samples=79 iops : min= 1, max= 27, avg= 8.87, stdev= 6.22, samples=79 write: IOPS=9, BW=149KiB/s (153kB/s)(6032KiB/40415msec); 0 zone resets clat (msec): min=12, max=232, avg=63.37, stdev=42.68 lat (msec): min=12, max=232, avg=63.37, stdev=42.68 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 94], 90.00th=[ 128], 95.00th=[ 165], | 99.00th=[ 194], 99.50th=[ 205], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 480, per=24.02%, avg=146.51, stdev=83.71, samples=79 iops : min= 1, max= 30, avg= 8.34, stdev= 5.33, samples=79 lat (msec) : 10=1.04%, 20=13.93%, 50=47.66%, 100=25.52%, 250=11.72% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=1.85%, ctx=1191, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180115: Tue Sep 22 14:45:24 2026 read: IOPS=9, BW=147KiB/s (150kB/s)(6032KiB/41163msec) clat (msec): min=6, max=234, avg=45.50, stdev=36.62 lat (msec): min=6, max=234, avg=45.51, stdev=36.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 65], 90.00th=[ 100], 95.00th=[ 117], | 99.00th=[ 197], 99.50th=[ 213], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 352, per=25.45%, avg=147.36, stdev=80.14, samples=80 iops : min= 1, max= 22, avg= 8.39, stdev= 5.06, samples=80 write: IOPS=9, BW=152KiB/s (156kB/s)(6256KiB/41163msec); 0 zone resets clat (msec): min=15, max=328, avg=60.70, stdev=38.89 lat (msec): min=15, max=328, avg=60.70, stdev=38.89 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 89], 90.00th=[ 117], 95.00th=[ 132], | 99.00th=[ 184], 99.50th=[ 220], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 31, max= 414, per=24.92%, avg=152.04, stdev=87.22, samples=81 iops : min= 1, max= 25, avg= 8.68, stdev= 5.52, samples=81 lat (msec) : 10=2.34%, 20=10.68%, 50=47.14%, 100=27.08%, 250=12.63% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.92%, ctx=1247, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=580KiB/s (594kB/s), 139KiB/s-155KiB/s (142kB/s-159kB/s), io=23.4MiB (24.5MB), run=40415-41297msec WRITE: bw=610KiB/s (625kB/s), 149KiB/s-158KiB/s (153kB/s-162kB/s), io=24.6MiB (25.8MB), run=40415-41297msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180131: Tue Sep 22 14:45:40 2026 read: IOPS=1, BW=1597KiB/s (1635kB/s)(7168KiB/4488msec) clat (usec): min=546, max=2138.5k, avg=402241.41, stdev=770184.68 lat (usec): min=548, max=2138.5k, avg=402242.96, stdev=770185.10 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], | 20.00th=[ 5014], 30.00th=[ 133694], 40.00th=[ 133694], | 50.00th=[ 137364], 60.00th=[ 173016], 70.00th=[ 173016], | 80.00th=[ 227541], 90.00th=[2139096], 95.00th=[2139096], | 99.00th=[2139096], 99.50th=[2139096], 99.90th=[2139096], | 99.95th=[2139096], 99.99th=[2139096] bw ( KiB/s): min= 4071, max= 6095, per=100.00%, avg=5083.00, stdev=1431.18, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1141KiB/s (1168kB/s)(5120KiB/4488msec); 0 zone resets clat (msec): min=112, max=590, avg=305.23, stdev=223.96 lat (msec): min=115, max=590, avg=305.96, stdev=223.28 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1976, max= 2031, per=40.42%, avg=2008.67, stdev=28.92, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=58.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.02%, sys=10.10%, ctx=586, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180132: Tue Sep 22 14:45:40 2026 read: IOPS=0, BW=355KiB/s (364kB/s)(2048KiB/5768msec) clat (msec): min=224, max=357, avg=290.86, stdev=94.13 lat (msec): min=224, max=357, avg=290.86, stdev=94.13 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 224], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 1434, max= 2048, per=49.04%, avg=1741.00, stdev=434.16, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1775KiB/s (1818kB/s)(10.0MiB/5768msec); 0 zone resets clat (msec): min=91, max=2452, avg=505.15, stdev=707.77 lat (msec): min=93, max=2452, avg=505.44, stdev=707.63 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 105], | 30.00th=[ 184], 40.00th=[ 205], 50.00th=[ 232], 60.00th=[ 234], | 70.00th=[ 359], 80.00th=[ 531], 90.00th=[ 659], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 2019, max= 4079, per=65.07%, avg=3234.00, stdev=1097.08, samples=5 iops : min= 1, max= 3, avg= 2.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.69%, ctx=123, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180133: Tue Sep 22 14:45:40 2026 read: IOPS=1, BW=1275KiB/s (1306kB/s)(6144KiB/4819msec) clat (usec): min=424, max=318376, avg=62403.28, stdev=127218.34 lat (usec): min=424, max=318377, avg=62404.05, stdev=127218.49 clat percentiles (usec): | 1.00th=[ 424], 5.00th=[ 424], 10.00th=[ 424], 20.00th=[ 461], | 30.00th=[ 461], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 586], | 70.00th=[ 54264], 80.00th=[ 54264], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 2035, max= 5930, per=94.02%, avg=3337.67, stdev=2245.04, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1275KiB/s (1306kB/s)(6144KiB/4819msec); 0 zone resets clat (msec): min=115, max=2695, avg=735.99, stdev=968.47 lat (msec): min=115, max=2695, avg=736.18, stdev=968.43 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 388], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 2702], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 1976, max= 2955, per=45.20%, avg=2246.25, stdev=473.16, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 500=16.67%, 750=16.67% lat (msec) : 100=8.33%, 250=8.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.97%, ctx=94, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180134: Tue Sep 22 14:45:40 2026 read: IOPS=1, BW=1046KiB/s (1072kB/s)(5120KiB/4893msec) clat (usec): min=517, max=173752, avg=96710.30, stdev=88564.17 lat (usec): min=519, max=173753, avg=96711.61, stdev=88564.13 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 519], | 30.00th=[ 1647], 40.00th=[ 1647], 50.00th=[135267], 60.00th=[135267], | 70.00th=[170918], 80.00th=[170918], 90.00th=[173016], 95.00th=[173016], | 99.00th=[173016], 99.50th=[173016], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1465KiB/s (1500kB/s)(7168KiB/4893msec); 0 zone resets clat (msec): min=125, max=2435, avg=610.91, stdev=842.39 lat (msec): min=126, max=2436, avg=611.21, stdev=842.29 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 194], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 222], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 860], 90.00th=[ 2433], 95.00th=[ 2433], | 99.00th=[ 2433], 99.50th=[ 2433], 99.90th=[ 2433], 99.95th=[ 2433], | 99.99th=[ 2433] bw ( KiB/s): min= 1462, max= 6107, per=77.85%, avg=3869.33, stdev=2327.14, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=66.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=7.73%, ctx=110, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3551KiB/s (3636kB/s), 355KiB/s-1597KiB/s (364kB/s-1635kB/s), io=20.0MiB (20.0MB), run=4488-5768msec WRITE: bw=4971KiB/s (5090kB/s), 1141KiB/s-1775KiB/s (1168kB/s-1818kB/s), io=28.0MiB (29.4MB), run=4488-5768msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180136: Tue Sep 22 14:45:41 2026 read: IOPS=1, BW=1263KiB/s (1293kB/s)(7168KiB/5676msec) clat (msec): min=61, max=1952, avg=648.90, stdev=773.21 lat (msec): min=61, max=1952, avg=648.90, stdev=773.20 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 62], 10.00th=[ 62], 20.00th=[ 66], | 30.00th=[ 102], 40.00th=[ 102], 50.00th=[ 113], 60.00th=[ 844], | 70.00th=[ 844], 80.00th=[ 1418], 90.00th=[ 1955], 95.00th=[ 1955], | 99.00th=[ 1955], 99.50th=[ 1955], 99.90th=[ 1955], 99.95th=[ 1955], | 99.99th=[ 1955] bw ( KiB/s): min= 1771, max= 4055, per=70.04%, avg=2382.20, stdev=941.75, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=902KiB/s (924kB/s)(5120KiB/5676msec); 0 zone resets clat (msec): min=110, max=314, avg=224.15, stdev=90.92 lat (msec): min=110, max=314, avg=224.26, stdev=90.95 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 111], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 279], 80.00th=[ 279], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 2027, max= 6071, per=70.93%, avg=3377.67, stdev=2332.50, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=25.00%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.26%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180137: Tue Sep 22 14:45:41 2026 read: IOPS=0, BW=340KiB/s (348kB/s)(2048KiB/6020msec) clat (msec): min=172, max=304, avg=238.48, stdev=93.92 lat (msec): min=172, max=304, avg=238.48, stdev=93.92 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 305], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 1815, max= 2035, per=56.60%, avg=1925.00, stdev=155.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1701KiB/s (1742kB/s)(10.0MiB/6020msec); 0 zone resets clat (msec): min=130, max=2754, avg=547.53, stdev=789.98 lat (msec): min=130, max=2754, avg=547.63, stdev=789.98 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 150], | 30.00th=[ 236], 40.00th=[ 239], 50.00th=[ 245], 60.00th=[ 288], | 70.00th=[ 305], 80.00th=[ 542], 90.00th=[ 592], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 3543, max= 4071, per=82.51%, avg=3929.00, stdev=257.53, samples=4 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=4.02%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180138: Tue Sep 22 14:45:41 2026 read: IOPS=1, BW=1152KiB/s (1180kB/s)(6144KiB/5332msec) clat (msec): min=73, max=489, avg=202.06, stdev=155.97 lat (msec): min=73, max=489, avg=202.06, stdev=155.97 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 116], 50.00th=[ 116], 60.00th=[ 176], | 70.00th=[ 262], 80.00th=[ 262], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1771, max= 4071, per=72.49%, avg=2465.25, stdev=1076.48, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1152KiB/s (1180kB/s)(6144KiB/5332msec); 0 zone resets clat (msec): min=98, max=2816, avg=673.91, stdev=1058.43 lat (msec): min=101, max=2816, avg=674.37, stdev=1058.19 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 213], 50.00th=[ 213], 60.00th=[ 305], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1771, max= 3561, per=49.32%, avg=2348.50, stdev=817.58, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=33.33%, >=2000=8.33% cpu : usr=0.08%, sys=3.75%, ctx=71, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180139: Tue Sep 22 14:45:41 2026 read: IOPS=0, BW=911KiB/s (933kB/s)(5120KiB/5620msec) clat (msec): min=69, max=358, avg=147.38, stdev=120.30 lat (msec): min=69, max=358, avg=147.38, stdev=120.30 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 69], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 115], 60.00th=[ 115], | 70.00th=[ 123], 80.00th=[ 123], 90.00th=[ 359], 95.00th=[ 359], | 99.00th=[ 359], 99.50th=[ 359], 99.90th=[ 359], 99.95th=[ 359], | 99.99th=[ 359] bw ( KiB/s): min= 2027, max= 6107, per=100.00%, avg=4067.00, stdev=2885.00, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1275KiB/s (1306kB/s)(7168KiB/5620msec); 0 zone resets clat (msec): min=135, max=2797, avg=688.06, stdev=943.14 lat (msec): min=135, max=2798, avg=688.17, stdev=943.13 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 201], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 321], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 592], 90.00th=[ 2802], 95.00th=[ 2802], | 99.00th=[ 2802], 99.50th=[ 2802], 99.90th=[ 2802], 99.95th=[ 2802], | 99.99th=[ 2802] bw ( KiB/s): min= 1796, max= 3543, per=49.35%, avg=2350.25, stdev=802.85, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=3.61%, ctx=91, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3402KiB/s (3484kB/s), 340KiB/s-1263KiB/s (348kB/s-1293kB/s), io=20.0MiB (20.0MB), run=5332-6020msec WRITE: bw=4763KiB/s (4877kB/s), 902KiB/s-1701KiB/s (924kB/s-1742kB/s), io=28.0MiB (29.4MB), run=5332-6020msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180151: Tue Sep 22 14:45:55 2026 read: IOPS=1, BW=5146KiB/s (5269kB/s)(12.0MiB/2388msec) clat (msec): min=678, max=851, avg=783.88, stdev=92.14 lat (msec): min=678, max=851, avg=783.88, stdev=92.14 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7968, max= 8015, per=100.00%, avg=7991.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=10.77%, ctx=188, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180152: Tue Sep 22 14:45:55 2026 read: IOPS=0, BW=1495KiB/s (1531kB/s)(4096KiB/2740msec) clat (nsec): min=807388k, max=807388k, avg=807388072.00, stdev= 0.00 lat (nsec): min=807391k, max=807391k, avg=807390572.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 810], 5.00th=[ 810], 10.00th=[ 810], 20.00th=[ 810], | 30.00th=[ 810], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 810], 80.00th=[ 810], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2990KiB/s (3062kB/s)(8192KiB/2740msec); 0 zone resets clat (msec): min=881, max=1005, avg=943.52, stdev=88.25 lat (msec): min=881, max=1006, avg=943.88, stdev=88.21 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8175, max= 8175, per=70.96%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.04%, sys=6.35%, ctx=141, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180153: Tue Sep 22 14:45:55 2026 write: IOPS=1, BW=4321KiB/s (4424kB/s)(12.0MiB/2844msec); 0 zone resets clat (msec): min=775, max=1262, avg=941.68, stdev=278.03 lat (msec): min=775, max=1263, avg=942.07, stdev=278.01 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7968, max= 8062, per=69.57%, avg=8015.00, stdev=66.47, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.31%, ctx=48, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180154: Tue Sep 22 14:45:55 2026 write: IOPS=1, BW=4733KiB/s (4847kB/s)(12.0MiB/2596msec); 0 zone resets clat (msec): min=751, max=1001, avg=851.09, stdev=132.63 lat (msec): min=752, max=1002, avg=851.62, stdev=132.49 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8015, max= 8062, per=69.77%, avg=8038.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.82%, ctx=54, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5980KiB/s (6123kB/s), 1495KiB/s-5146KiB/s (1531kB/s-5269kB/s), io=16.0MiB (16.8MB), run=2388-2740msec WRITE: bw=11.3MiB/s (11.8MB/s), 2990KiB/s-4733KiB/s (3062kB/s-4847kB/s), io=32.0MiB (33.6MB), run=2596-2844msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180147: Tue Sep 22 14:45:55 2026 read: IOPS=1, BW=7082KiB/s (7252kB/s)(12.0MiB/1735msec) clat (msec): min=236, max=932, avg=551.97, stdev=352.69 lat (msec): min=236, max=932, avg=551.98, stdev=352.69 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 485], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 5535, max= 8175, per=100.00%, avg=6855.00, stdev=1866.76, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.00%, sys=6.29%, ctx=55, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180148: Tue Sep 22 14:45:55 2026 read: IOPS=0, BW=1339KiB/s (1372kB/s)(4096KiB/3058msec) clat (nsec): min=1442.6M, max=1442.6M, avg=1442643561.00, stdev= 0.00 lat (nsec): min=1442.6M, max=1442.6M, avg=1442646136.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2679KiB/s (2743kB/s)(8192KiB/3058msec); 0 zone resets clat (msec): min=492, max=1010, avg=751.13, stdev=366.40 lat (msec): min=492, max=1010, avg=751.72, stdev=366.63 clat percentiles (msec): | 1.00th=[ 493], 5.00th=[ 493], 10.00th=[ 493], 20.00th=[ 493], | 30.00th=[ 493], 40.00th=[ 493], 50.00th=[ 493], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 8110, max= 8110, per=81.88%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.19%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180149: Tue Sep 22 14:45:55 2026 write: IOPS=0, BW=3715KiB/s (3804kB/s)(12.0MiB/3308msec); 0 zone resets clat (msec): min=258, max=1856, avg=1080.68, stdev=799.74 lat (msec): min=259, max=1861, avg=1082.60, stdev=801.98 clat percentiles (msec): | 1.00th=[ 259], 5.00th=[ 259], 10.00th=[ 259], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8126, max= 8175, per=82.29%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.87%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180150: Tue Sep 22 14:45:55 2026 write: IOPS=1, BW=5681KiB/s (5817kB/s)(12.0MiB/2163msec); 0 zone resets clat (msec): min=405, max=1253, avg=712.01, stdev=470.54 lat (msec): min=406, max=1254, avg=712.41, stdev=470.52 clat percentiles (msec): | 1.00th=[ 405], 5.00th=[ 405], 10.00th=[ 405], 20.00th=[ 405], | 30.00th=[ 405], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 6350, max= 8159, per=73.24%, avg=7254.50, stdev=1279.16, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.09%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5358KiB/s (5486kB/s), 1339KiB/s-7082KiB/s (1372kB/s-7252kB/s), io=16.0MiB (16.8MB), run=1735-3058msec WRITE: bw=9906KiB/s (10.1MB/s), 2679KiB/s-5681KiB/s (2743kB/s-5817kB/s), io=32.0MiB (33.6MB), run=2163-3308msec