== sanity test 398b: DIO and buffer IO race ============== 16:06:52 (1789589212) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.58221 s, 7.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179188: Wed Sep 16 16:09:07 2026 read: IOPS=12, BW=51.6KiB/s (52.8kB/s)(5992KiB/116191msec) clat (usec): min=33, max=233987, avg=42365.89, stdev=28500.59 lat (usec): min=34, max=233989, avg=42373.67, stdev=28494.56 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 112], 10.00th=[ 14615], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 30540], 50.00th=[ 36439], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 62129], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[128451], 99.50th=[143655], 99.90th=[193987], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 111, per=24.71%, avg=50.91, stdev=21.13, samples=229 iops : min= 1, max= 27, avg=12.09, stdev= 5.30, samples=229 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6296KiB/116191msec); 0 zone resets clat (usec): min=800, max=595855, avg=33240.77, stdev=36860.78 lat (usec): min=800, max=595856, avg=33243.62, stdev=36861.62 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1172], 10.00th=[ 1401], 20.00th=[ 3130], | 30.00th=[ 6718], 40.00th=[ 14615], 50.00th=[ 23987], 60.00th=[ 31851], | 70.00th=[ 42206], 80.00th=[ 57410], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[152044], 99.50th=[175113], 99.90th=[250610], 99.95th=[599786], | 99.99th=[599786] bw ( KiB/s): min= 7, max= 126, per=24.91%, avg=53.81, stdev=22.47, samples=228 iops : min= 1, max= 31, avg=12.82, stdev= 5.65, samples=228 lat (usec) : 50=0.26%, 100=2.12%, 250=0.13%, 500=0.07%, 1000=0.42% lat (msec) : 2=6.97%, 4=4.33%, 10=6.71%, 20=11.43%, 50=39.81% lat (msec) : 100=23.24%, 250=4.46%, 500=0.03%, 750=0.03% cpu : usr=0.06%, sys=4.78%, ctx=6464, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179189: Wed Sep 16 16:09:07 2026 read: IOPS=12, BW=51.2KiB/s (52.5kB/s)(5940KiB/115944msec) clat (usec): min=36, max=261967, avg=42056.63, stdev=27780.76 lat (usec): min=36, max=261968, avg=42059.14, stdev=27780.45 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9634], 10.00th=[ 15533], 20.00th=[ 20841], | 30.00th=[ 25560], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 91751], | 99.00th=[135267], 99.50th=[152044], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 5, max= 103, per=24.61%, avg=50.69, stdev=19.94, samples=229 iops : min= 1, max= 25, avg=12.03, stdev= 4.99, samples=229 write: IOPS=13, BW=54.8KiB/s (56.1kB/s)(6348KiB/115944msec); 0 zone resets clat (usec): min=668, max=627015, avg=33445.65, stdev=37702.68 lat (usec): min=669, max=627017, avg=33450.23, stdev=37704.52 clat percentiles (usec): | 1.00th=[ 971], 5.00th=[ 1156], 10.00th=[ 1385], 20.00th=[ 3163], | 30.00th=[ 6587], 40.00th=[ 15795], 50.00th=[ 23987], 60.00th=[ 32375], | 70.00th=[ 43779], 80.00th=[ 58459], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[152044], 99.50th=[175113], 99.90th=[325059], 99.95th=[624952], | 99.99th=[624952] bw ( KiB/s): min= 5, max= 136, per=25.02%, avg=54.05, stdev=23.51, samples=229 iops : min= 1, max= 34, avg=12.88, stdev= 5.93, samples=229 lat (usec) : 50=0.36%, 100=1.43%, 250=0.16%, 750=0.03%, 1000=0.55% lat (msec) : 2=7.06%, 4=4.30%, 10=6.84%, 20=11.43%, 50=40.49% lat (msec) : 100=22.98%, 250=4.20%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=4.64%, ctx=6308, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179190: Wed Sep 16 16:09:07 2026 read: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6028KiB/113437msec) clat (usec): min=24, max=650713, avg=42144.37, stdev=32113.42 lat (usec): min=24, max=650714, avg=42147.92, stdev=32112.91 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9896], 10.00th=[ 15270], 20.00th=[ 20317], | 30.00th=[ 25297], 40.00th=[ 29492], 50.00th=[ 36439], 60.00th=[ 42206], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[156238], 99.90th=[299893], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 103, per=25.55%, avg=52.62, stdev=20.04, samples=224 iops : min= 1, max= 25, avg=12.51, stdev= 5.04, samples=224 write: IOPS=13, BW=55.2KiB/s (56.5kB/s)(6260KiB/113437msec); 0 zone resets clat (usec): min=714, max=247074, avg=31618.66, stdev=33847.98 lat (usec): min=715, max=247075, avg=31623.94, stdev=33846.48 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1172], 10.00th=[ 1303], 20.00th=[ 2802], | 30.00th=[ 5997], 40.00th=[ 13304], 50.00th=[ 22676], 60.00th=[ 30540], | 70.00th=[ 39584], 80.00th=[ 54264], 90.00th=[ 78119], 95.00th=[100140], | 99.00th=[141558], 99.50th=[168821], 99.90th=[231736], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 119, per=25.23%, avg=54.50, stdev=22.27, samples=224 iops : min= 1, max= 29, avg=12.99, stdev= 5.61, samples=224 lat (usec) : 50=0.39%, 100=1.60%, 250=0.03%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.42% lat (msec) : 2=7.62%, 4=4.46%, 10=6.64%, 20=11.98%, 50=40.95% lat (msec) : 100=21.26%, 250=4.49%, 500=0.03%, 750=0.03% cpu : usr=0.06%, sys=4.93%, ctx=6261, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179191: Wed Sep 16 16:09:07 2026 read: IOPS=13, BW=52.7KiB/s (53.9kB/s)(6052KiB/114881msec) clat (usec): min=33, max=245365, avg=41401.02, stdev=27821.28 lat (usec): min=34, max=245367, avg=41404.26, stdev=27820.91 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 685], 10.00th=[ 14615], 20.00th=[ 20841], | 30.00th=[ 25297], 40.00th=[ 29492], 50.00th=[ 34866], 60.00th=[ 41681], | 70.00th=[ 50070], 80.00th=[ 58983], 90.00th=[ 73925], 95.00th=[ 95945], | 99.00th=[137364], 99.50th=[147850], 99.90th=[179307], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 15, max= 119, per=25.43%, avg=52.39, stdev=20.49, samples=226 iops : min= 3, max= 29, avg=12.46, stdev= 5.14, samples=226 write: IOPS=13, BW=54.3KiB/s (55.6kB/s)(6236KiB/114881msec); 0 zone resets clat (usec): min=605, max=652010, avg=33283.80, stdev=38138.52 lat (usec): min=605, max=652012, avg=33286.88, stdev=38137.33 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1188], 10.00th=[ 1401], 20.00th=[ 2769], | 30.00th=[ 5866], 40.00th=[ 14353], 50.00th=[ 23462], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 56886], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[141558], 99.50th=[162530], 99.90th=[278922], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 135, per=24.94%, avg=53.87, stdev=24.10, samples=226 iops : min= 1, max= 33, avg=12.83, stdev= 6.04, samples=226 lat (usec) : 50=0.39%, 100=1.89%, 250=0.10%, 500=0.03%, 750=0.13% lat (usec) : 1000=0.29% lat (msec) : 2=7.23%, 4=4.75%, 10=6.80%, 20=10.71%, 50=40.72% lat (msec) : 100=21.71%, 250=5.18%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=4.82%, ctx=6330, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=207KiB/s (212kB/s), 51.2KiB/s-53.1KiB/s (52.5kB/s-54.4kB/s), io=23.4MiB (24.6MB), run=113437-116191msec WRITE: bw=216KiB/s (222kB/s), 54.2KiB/s-55.2KiB/s (55.5kB/s-56.5kB/s), io=24.6MiB (25.7MB), run=113437-116191msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179192: Wed Sep 16 16:09:38 2026 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(5992KiB/147547msec) clat (msec): min=3, max=710, avg=38.83, stdev=42.25 lat (msec): min=3, max=710, avg=38.83, stdev=42.25 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 41], 80.00th=[ 55], 90.00th=[ 89], 95.00th=[ 118], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 409], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 191, per=25.33%, avg=41.04, stdev=31.49, samples=285 iops : min= 1, max= 47, avg= 9.59, stdev= 7.93, samples=285 write: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6296KiB/147547msec); 0 zone resets clat (msec): min=8, max=314, avg=56.54, stdev=42.91 lat (msec): min=8, max=314, avg=56.55, stdev=42.91 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 67], 80.00th=[ 85], 90.00th=[ 112], 95.00th=[ 138], | 99.00th=[ 220], 99.50th=[ 249], 99.90th=[ 309], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 151, per=25.07%, avg=42.61, stdev=29.07, samples=288 iops : min= 1, max= 37, avg= 9.99, stdev= 7.32, samples=288 lat (msec) : 4=0.07%, 10=5.21%, 20=20.51%, 50=41.05%, 100=22.36% lat (msec) : 250=10.42%, 500=0.36%, 750=0.03% cpu : usr=0.06%, sys=1.72%, ctx=4721, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179193: Wed Sep 16 16:09:38 2026 read: IOPS=10, BW=40.3KiB/s (41.2kB/s)(5940KiB/147490msec) clat (msec): min=3, max=679, avg=38.46, stdev=40.79 lat (msec): min=3, max=679, avg=38.46, stdev=40.79 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 56], 90.00th=[ 84], 95.00th=[ 117], | 99.00th=[ 188], 99.50th=[ 207], 99.90th=[ 313], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 152, per=25.24%, avg=40.89, stdev=31.10, samples=283 iops : min= 1, max= 38, avg= 9.55, stdev= 7.82, samples=283 write: IOPS=10, BW=43.0KiB/s (44.1kB/s)(6348KiB/147490msec); 0 zone resets clat (msec): min=8, max=309, avg=56.75, stdev=43.37 lat (msec): min=8, max=309, avg=56.76, stdev=43.37 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 68], 80.00th=[ 85], 90.00th=[ 114], 95.00th=[ 144], | 99.00th=[ 222], 99.50th=[ 241], 99.90th=[ 279], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 151, per=25.31%, avg=43.02, stdev=29.86, samples=288 iops : min= 1, max= 37, avg=10.09, stdev= 7.53, samples=288 lat (msec) : 4=0.03%, 10=5.24%, 20=19.82%, 50=41.76%, 100=22.62% lat (msec) : 250=10.19%, 500=0.29%, 750=0.03% cpu : usr=0.06%, sys=1.73%, ctx=4613, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179194: Wed Sep 16 16:09:38 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6028KiB/147693msec) clat (msec): min=4, max=406, avg=39.10, stdev=38.35 lat (msec): min=4, max=406, avg=39.10, stdev=38.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 42], 80.00th=[ 58], 90.00th=[ 91], 95.00th=[ 118], | 99.00th=[ 176], 99.50th=[ 207], 99.90th=[ 284], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 167, per=25.30%, avg=40.99, stdev=30.37, samples=286 iops : min= 1, max= 41, avg= 9.58, stdev= 7.65, samples=286 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6260KiB/147693msec); 0 zone resets clat (msec): min=6, max=681, avg=56.55, stdev=45.75 lat (msec): min=6, max=681, avg=56.55, stdev=45.75 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 65], 80.00th=[ 86], 90.00th=[ 115], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 234], 99.90th=[ 313], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 7, max= 143, per=24.88%, avg=42.30, stdev=30.52, samples=288 iops : min= 1, max= 35, avg= 9.91, stdev= 7.67, samples=288 lat (msec) : 10=4.79%, 20=20.96%, 50=40.98%, 100=21.88%, 250=11.17% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.05%, sys=1.69%, ctx=4747, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179195: Wed Sep 16 16:09:38 2026 read: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6052KiB/146774msec) clat (msec): min=3, max=568, avg=38.29, stdev=38.48 lat (msec): min=3, max=568, avg=38.29, stdev=38.48 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 85], 95.00th=[ 114], | 99.00th=[ 178], 99.50th=[ 220], 99.90th=[ 309], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 7, max= 165, per=25.78%, avg=41.76, stdev=29.76, samples=282 iops : min= 1, max= 41, avg= 9.77, stdev= 7.51, samples=282 write: IOPS=10, BW=42.5KiB/s (43.5kB/s)(6236KiB/146774msec); 0 zone resets clat (msec): min=6, max=611, avg=56.77, stdev=43.76 lat (msec): min=6, max=611, avg=56.78, stdev=43.76 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 52], | 70.00th=[ 68], 80.00th=[ 88], 90.00th=[ 116], 95.00th=[ 142], | 99.00th=[ 197], 99.50th=[ 232], 99.90th=[ 284], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 7, max= 174, per=24.82%, avg=42.19, stdev=29.76, samples=287 iops : min= 1, max= 43, avg= 9.88, stdev= 7.50, samples=287 lat (msec) : 4=0.07%, 10=4.85%, 20=20.48%, 50=41.73%, 100=21.84% lat (msec) : 250=10.74%, 500=0.23%, 750=0.07% cpu : usr=0.04%, sys=1.69%, ctx=4638, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (166kB/s), 40.3KiB/s-41.2KiB/s (41.2kB/s-42.2kB/s), io=23.4MiB (24.6MB), run=146774-147693msec WRITE: bw=170KiB/s (174kB/s), 42.4KiB/s-43.0KiB/s (43.4kB/s-44.1kB/s), io=24.6MiB (25.7MB), run=146774-147693msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179231: Wed Sep 16 16:10:23 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5920KiB/35147msec) clat (usec): min=35, max=256645, avg=48787.36, stdev=33648.28 lat (usec): min=35, max=256647, avg=48788.63, stdev=33648.27 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 75], 10.00th=[ 14222], 20.00th=[ 23987], | 30.00th=[ 31851], 40.00th=[ 36963], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 57934], 80.00th=[ 70779], 90.00th=[ 88605], 95.00th=[116917], | 99.00th=[160433], 99.50th=[183501], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 384, per=24.47%, avg=166.65, stdev=73.44, samples=69 iops : min= 1, max= 24, avg= 9.65, stdev= 4.62, samples=69 write: IOPS=11, BW=181KiB/s (186kB/s)(6368KiB/35147msec); 0 zone resets clat (usec): min=1105, max=268467, avg=42785.24, stdev=42568.49 lat (usec): min=1106, max=268469, avg=42789.50, stdev=42566.59 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1991], 10.00th=[ 2835], 20.00th=[ 6325], | 30.00th=[ 11207], 40.00th=[ 22152], 50.00th=[ 31065], 60.00th=[ 43254], | 70.00th=[ 54789], 80.00th=[ 72877], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[217056], 99.50th=[233833], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 31, max= 412, per=25.21%, avg=180.48, stdev=88.69, samples=69 iops : min= 1, max= 25, avg=10.52, stdev= 5.63, samples=69 lat (usec) : 50=0.52%, 100=2.60%, 250=0.52%, 1000=0.13% lat (msec) : 2=2.60%, 4=4.17%, 10=7.68%, 20=8.59%, 50=37.63% lat (msec) : 100=27.34%, 250=7.94%, 500=0.26% cpu : usr=0.04%, sys=4.55%, ctx=1721, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179233: Wed Sep 16 16:10:23 2026 read: IOPS=10, BW=166KiB/s (170kB/s)(5744KiB/34647msec) clat (usec): min=51, max=177835, avg=51620.30, stdev=33350.51 lat (usec): min=52, max=177835, avg=51621.94, stdev=33350.43 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 16188], 20.00th=[ 25035], | 30.00th=[ 32900], 40.00th=[ 39060], 50.00th=[ 46924], 60.00th=[ 55837], | 70.00th=[ 63177], 80.00th=[ 76022], 90.00th=[ 94897], 95.00th=[113771], | 99.00th=[154141], 99.50th=[162530], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 380, per=24.21%, avg=164.85, stdev=71.62, samples=68 iops : min= 1, max= 23, avg= 9.54, stdev= 4.54, samples=68 write: IOPS=11, BW=189KiB/s (193kB/s)(6544KiB/34647msec); 0 zone resets clat (usec): min=1482, max=198348, avg=38973.11, stdev=40667.33 lat (usec): min=1485, max=198352, avg=38975.29, stdev=40667.32 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1909], 10.00th=[ 2474], 20.00th=[ 4817], | 30.00th=[ 9503], 40.00th=[ 18220], 50.00th=[ 25560], 60.00th=[ 35914], | 70.00th=[ 48497], 80.00th=[ 66847], 90.00th=[ 98042], 95.00th=[129500], | 99.00th=[173016], 99.50th=[185598], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 30, max= 603, per=26.23%, avg=187.78, stdev=103.68, samples=68 iops : min= 1, max= 37, avg=10.99, stdev= 6.49, samples=68 lat (usec) : 100=3.12%, 250=0.39%, 500=0.13% lat (msec) : 2=3.12%, 4=6.77%, 10=6.77%, 20=8.46%, 50=33.59% lat (msec) : 100=28.52%, 250=9.11% cpu : usr=0.06%, sys=4.84%, ctx=1686, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179234: Wed Sep 16 16:10:23 2026 read: IOPS=11, BW=183KiB/s (187kB/s)(6256KiB/34179msec) clat (usec): min=44, max=199121, avg=47747.34, stdev=30822.12 lat (usec): min=45, max=199123, avg=47755.53, stdev=30822.79 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 15270], 20.00th=[ 23987], | 30.00th=[ 30540], 40.00th=[ 36963], 50.00th=[ 43254], 60.00th=[ 49021], | 70.00th=[ 58983], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[105382], | 99.00th=[152044], 99.50th=[156238], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 383, per=27.04%, avg=184.13, stdev=87.87, samples=67 iops : min= 1, max= 23, avg=10.73, stdev= 5.51, samples=67 write: IOPS=11, BW=176KiB/s (181kB/s)(6032KiB/34179msec); 0 zone resets clat (usec): min=1382, max=240312, avg=39956.99, stdev=40965.72 lat (usec): min=1385, max=240317, avg=39962.45, stdev=40967.26 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1926], 10.00th=[ 3458], 20.00th=[ 5604], | 30.00th=[ 11076], 40.00th=[ 19530], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[123208], | 99.00th=[214959], 99.50th=[235930], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 30, max= 473, per=24.67%, avg=176.61, stdev=86.32, samples=67 iops : min= 1, max= 29, avg=10.27, stdev= 5.45, samples=67 lat (usec) : 50=0.13%, 100=2.99%, 250=0.39%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.86%, 4=3.52%, 10=7.68%, 20=9.24%, 50=38.54% lat (msec) : 100=27.08%, 250=7.03% cpu : usr=0.07%, sys=5.20%, ctx=1749, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179235: Wed Sep 16 16:10:23 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(6032KiB/34084msec) clat (usec): min=41, max=198182, avg=48872.07, stdev=34073.80 lat (usec): min=42, max=198183, avg=48873.49, stdev=34073.79 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 131], 20.00th=[ 23987], | 30.00th=[ 29754], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 52167], | 70.00th=[ 60031], 80.00th=[ 69731], 90.00th=[ 90702], 95.00th=[117965], | 99.00th=[160433], 99.50th=[179307], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 30, max= 439, per=26.63%, avg=181.37, stdev=83.46, samples=65 iops : min= 1, max= 27, avg=10.58, stdev= 5.26, samples=65 write: IOPS=11, BW=184KiB/s (188kB/s)(6256KiB/34084msec); 0 zone resets clat (usec): min=1368, max=224677, avg=39507.03, stdev=43082.15 lat (usec): min=1370, max=224679, avg=39512.67, stdev=43079.46 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1942], 10.00th=[ 3032], 20.00th=[ 5014], | 30.00th=[ 8979], 40.00th=[ 15926], 50.00th=[ 26870], 60.00th=[ 35914], | 70.00th=[ 47449], 80.00th=[ 63177], 90.00th=[ 96994], 95.00th=[131597], | 99.00th=[187696], 99.50th=[221250], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 383, per=25.75%, avg=184.39, stdev=90.09, samples=67 iops : min= 1, max= 23, avg=10.79, stdev= 5.66, samples=67 lat (usec) : 50=0.39%, 100=4.30%, 250=0.39%, 500=0.13% lat (msec) : 2=3.12%, 4=4.56%, 10=9.51%, 20=8.46%, 50=33.46% lat (msec) : 100=27.21%, 250=8.46% cpu : usr=0.06%, sys=4.64%, ctx=1601, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=681KiB/s (698kB/s), 166KiB/s-183KiB/s (170kB/s-187kB/s), io=23.4MiB (24.5MB), run=34084-35147msec WRITE: bw=717KiB/s (734kB/s), 176KiB/s-189KiB/s (181kB/s-193kB/s), io=24.6MiB (25.8MB), run=34084-35147msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179236: Wed Sep 16 16:10:36 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(5920KiB/47358msec) clat (msec): min=5, max=367, avg=52.00, stdev=47.23 lat (msec): min=5, max=367, avg=52.00, stdev=47.23 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 108], 95.00th=[ 153], | 99.00th=[ 236], 99.50th=[ 268], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 351, per=25.19%, avg=126.69, stdev=72.96, samples=88 iops : min= 1, max= 21, avg= 7.09, stdev= 4.63, samples=88 write: IOPS=8, BW=134KiB/s (138kB/s)(6368KiB/47358msec); 0 zone resets clat (msec): min=11, max=285, avg=70.39, stdev=51.08 lat (msec): min=11, max=285, avg=70.39, stdev=51.08 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 64], | 70.00th=[ 81], 80.00th=[ 104], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 253], 99.50th=[ 259], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 21, max= 381, per=25.52%, avg=134.99, stdev=76.10, samples=90 iops : min= 1, max= 23, avg= 7.61, stdev= 4.83, samples=90 lat (msec) : 10=0.65%, 20=10.29%, 50=45.83%, 100=26.82%, 250=15.63% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.59%, ctx=1227, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179237: Wed Sep 16 16:10:36 2026 read: IOPS=7, BW=121KiB/s (124kB/s)(5744KiB/47587msec) clat (msec): min=7, max=253, avg=52.51, stdev=40.28 lat (msec): min=7, max=253, avg=52.51, stdev=40.28 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 23], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 61], 80.00th=[ 75], 90.00th=[ 104], 95.00th=[ 136], | 99.00th=[ 224], 99.50th=[ 247], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 21, max= 343, per=25.12%, avg=126.36, stdev=75.22, samples=88 iops : min= 1, max= 21, avg= 7.06, stdev= 4.75, samples=88 write: IOPS=8, BW=138KiB/s (141kB/s)(6544KiB/47587msec); 0 zone resets clat (msec): min=8, max=275, avg=69.26, stdev=47.83 lat (msec): min=8, max=275, avg=69.26, stdev=47.83 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 84], 80.00th=[ 103], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 236], 99.50th=[ 247], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 478, per=26.34%, avg=139.33, stdev=80.86, samples=91 iops : min= 1, max= 29, avg= 7.87, stdev= 5.10, samples=91 lat (msec) : 10=1.30%, 20=8.33%, 50=43.62%, 100=30.47%, 250=15.89% lat (msec) : 500=0.39% cpu : usr=0.04%, sys=1.73%, ctx=1259, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179238: Wed Sep 16 16:10:36 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/47053msec) clat (msec): min=7, max=267, avg=50.51, stdev=45.13 lat (msec): min=7, max=267, avg=50.51, stdev=45.12 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 53], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 153], | 99.00th=[ 236], 99.50th=[ 253], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 29, max= 447, per=26.81%, avg=134.87, stdev=89.49, samples=90 iops : min= 1, max= 27, avg= 7.63, stdev= 5.67, samples=90 write: IOPS=8, BW=128KiB/s (131kB/s)(6032KiB/47053msec); 0 zone resets clat (msec): min=12, max=268, avg=71.45, stdev=49.77 lat (msec): min=12, max=268, avg=71.45, stdev=49.77 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 27], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 53], 60.00th=[ 64], | 70.00th=[ 84], 80.00th=[ 103], 90.00th=[ 140], 95.00th=[ 178], | 99.00th=[ 255], 99.50th=[ 264], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 317, per=23.94%, avg=126.65, stdev=69.39, samples=91 iops : min= 1, max= 19, avg= 7.12, stdev= 4.42, samples=91 lat (msec) : 10=1.30%, 20=9.24%, 50=47.53%, 100=25.65%, 250=15.49% lat (msec) : 500=0.78% cpu : usr=0.05%, sys=1.54%, ctx=1192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179239: Wed Sep 16 16:10:36 2026 read: IOPS=8, BW=128KiB/s (131kB/s)(6032KiB/47088msec) clat (msec): min=6, max=279, avg=50.81, stdev=44.62 lat (msec): min=6, max=279, avg=50.82, stdev=44.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 45], | 70.00th=[ 52], 80.00th=[ 65], 90.00th=[ 109], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 266], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 349, per=26.33%, avg=132.42, stdev=76.87, samples=88 iops : min= 1, max= 21, avg= 7.44, stdev= 4.85, samples=88 write: IOPS=8, BW=133KiB/s (136kB/s)(6256KiB/47088msec); 0 zone resets clat (msec): min=14, max=322, avg=70.57, stdev=50.19 lat (msec): min=14, max=322, avg=70.57, stdev=50.19 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 46], 50.00th=[ 53], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 101], 90.00th=[ 136], 95.00th=[ 176], | 99.00th=[ 275], 99.50th=[ 309], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 29, max= 381, per=25.05%, avg=132.49, stdev=73.54, samples=92 iops : min= 1, max= 23, avg= 7.43, stdev= 4.67, samples=92 lat (msec) : 10=0.78%, 20=8.98%, 50=47.40%, 100=27.21%, 250=14.58% lat (msec) : 500=1.04% cpu : usr=0.06%, sys=1.57%, ctx=1189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=503KiB/s (515kB/s), 121KiB/s-133KiB/s (124kB/s-136kB/s), io=23.4MiB (24.5MB), run=47053-47587msec WRITE: bw=530KiB/s (542kB/s), 128KiB/s-138KiB/s (131kB/s-141kB/s), io=24.6MiB (25.8MB), run=47053-47587msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179257: Wed Sep 16 16:10:50 2026 read: IOPS=2, BW=2334KiB/s (2390kB/s)(7168KiB/3071msec) clat (msec): min=116, max=316, avg=209.81, stdev=78.00 lat (msec): min=116, max=316, avg=209.81, stdev=78.00 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 167], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 296], 90.00th=[ 317], 95.00th=[ 317], | 99.00th=[ 317], 99.50th=[ 317], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 1988, max= 3984, per=55.53%, avg=2983.25, stdev=1129.26, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1667KiB/s (1707kB/s)(5120KiB/3071msec); 0 zone resets clat (msec): min=195, max=375, avg=258.24, stdev=78.74 lat (msec): min=195, max=375, avg=258.35, stdev=78.76 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 203], 40.00th=[ 203], 50.00th=[ 215], 60.00th=[ 215], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 1969, max= 3976, per=33.26%, avg=2501.75, stdev=983.29, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=58.33%, 500=41.67% cpu : usr=0.03%, sys=18.96%, ctx=217, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179258: Wed Sep 16 16:10:50 2026 read: IOPS=0, BW=558KiB/s (572kB/s)(2048KiB/3667msec) clat (msec): min=159, max=173, avg=166.49, stdev= 9.58 lat (msec): min=159, max=173, avg=166.49, stdev= 9.58 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1969, max= 1988, per=36.83%, avg=1978.50, stdev=13.44, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2792KiB/s (2859kB/s)(10.0MiB/3667msec); 0 zone resets clat (msec): min=113, max=574, avg=327.26, stdev=147.58 lat (msec): min=113, max=574, avg=327.48, stdev=147.44 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 153], | 30.00th=[ 213], 40.00th=[ 259], 50.00th=[ 279], 60.00th=[ 363], | 70.00th=[ 422], 80.00th=[ 430], 90.00th=[ 464], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1969, max= 6119, per=34.38%, avg=2585.57, stdev=1558.32, samples=7 iops : min= 1, max= 5, avg= 1.57, stdev= 1.51, samples=7 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=17.68%, ctx=157, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179259: Wed Sep 16 16:10:50 2026 read: IOPS=2, BW=2095KiB/s (2145kB/s)(6144KiB/2933msec) clat (usec): min=470, max=191298, avg=50855.69, stdev=81893.24 lat (usec): min=471, max=191298, avg=50856.57, stdev=81893.00 clat percentiles (usec): | 1.00th=[ 469], 5.00th=[ 469], 10.00th=[ 469], 20.00th=[ 482], | 30.00th=[ 482], 40.00th=[ 529], 50.00th=[ 529], 60.00th=[ 758], | 70.00th=[111674], 80.00th=[111674], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 1988, max= 4079, per=62.08%, avg=3335.00, stdev=1168.66, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2095KiB/s (2145kB/s)(6144KiB/2933msec); 0 zone resets clat (msec): min=218, max=636, avg=414.21, stdev=138.41 lat (msec): min=218, max=636, avg=414.29, stdev=138.43 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 414], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1969, max= 2039, per=26.54%, avg=1996.00, stdev=25.86, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 250=25.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=11.02%, ctx=110, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179260: Wed Sep 16 16:10:50 2026 read: IOPS=1, BW=1343KiB/s (1375kB/s)(5120KiB/3812msec) clat (usec): min=399, max=390342, avg=115768.25, stdev=173421.91 lat (usec): min=400, max=390343, avg=115769.40, stdev=173421.96 clat percentiles (usec): | 1.00th=[ 400], 5.00th=[ 400], 10.00th=[ 400], 20.00th=[ 400], | 30.00th=[ 578], 40.00th=[ 578], 50.00th=[ 586], 60.00th=[ 586], | 70.00th=[187696], 80.00th=[187696], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1880KiB/s (1926kB/s)(7168KiB/3812msec); 0 zone resets clat (msec): min=153, max=717, avg=422.40, stdev=221.48 lat (msec): min=153, max=718, avg=422.69, stdev=221.50 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 188], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 535], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 1973, max= 4063, per=32.14%, avg=2417.40, stdev=920.36, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=33.33%, 500=8.33%, 750=33.33% cpu : usr=0.03%, sys=12.02%, ctx=157, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5373KiB/s (5501kB/s), 558KiB/s-2334KiB/s (572kB/s-2390kB/s), io=20.0MiB (20.0MB), run=2933-3812msec WRITE: bw=7522KiB/s (7702kB/s), 1667KiB/s-2792KiB/s (1707kB/s-2859kB/s), io=28.0MiB (29.4MB), run=2933-3812msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179253: Wed Sep 16 16:10:50 2026 read: IOPS=2, BW=2633KiB/s (2697kB/s)(7168KiB/2722msec) clat (msec): min=72, max=323, avg=170.92, stdev=84.09 lat (msec): min=72, max=323, avg=170.93, stdev=84.09 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 95], | 30.00th=[ 140], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 211], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1882, max= 5575, per=86.09%, avg=3824.00, stdev=1853.89, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1881KiB/s (1926kB/s)(5120KiB/2722msec); 0 zone resets clat (msec): min=153, max=447, avg=294.30, stdev=118.99 lat (msec): min=153, max=448, avg=294.56, stdev=118.98 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 262], 60.00th=[ 262], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 2043, max= 3764, per=50.66%, avg=3150.33, stdev=960.85, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=50.00%, 500=33.33% cpu : usr=0.04%, sys=5.33%, ctx=60, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179254: Wed Sep 16 16:10:50 2026 read: IOPS=0, BW=464KiB/s (475kB/s)(2048KiB/4413msec) clat (msec): min=343, max=403, avg=373.70, stdev=42.80 lat (msec): min=343, max=403, avg=373.71, stdev=42.80 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2011, max= 2043, per=45.63%, avg=2027.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2320KiB/s (2376kB/s)(10.0MiB/4413msec); 0 zone resets clat (msec): min=71, max=566, avg=330.81, stdev=159.55 lat (msec): min=71, max=566, avg=330.91, stdev=159.53 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 174], | 30.00th=[ 230], 40.00th=[ 247], 50.00th=[ 264], 60.00th=[ 363], | 70.00th=[ 409], 80.00th=[ 481], 90.00th=[ 506], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1882, max= 3992, per=43.58%, avg=2710.40, stdev=1020.07, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=6.05%, ctx=118, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179255: Wed Sep 16 16:10:50 2026 read: IOPS=1, BW=1462KiB/s (1497kB/s)(6144KiB/4202msec) clat (msec): min=108, max=864, avg=263.44, stdev=296.79 lat (msec): min=108, max=864, avg=263.44, stdev=296.79 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 111], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 125], 60.00th=[ 178], | 70.00th=[ 194], 80.00th=[ 194], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1996, max= 4023, per=73.41%, avg=3261.00, stdev=1103.15, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1462KiB/s (1497kB/s)(6144KiB/4202msec); 0 zone resets clat (msec): min=99, max=566, avg=377.98, stdev=194.64 lat (msec): min=99, max=566, avg=378.13, stdev=194.66 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 430], 50.00th=[ 430], 60.00th=[ 502], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1822, max= 3992, per=37.77%, avg=2349.20, stdev=922.75, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.02%, sys=4.59%, ctx=118, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179256: Wed Sep 16 16:10:50 2026 read: IOPS=1, BW=1111KiB/s (1137kB/s)(5120KiB/4610msec) clat (msec): min=97, max=747, avg=355.92, stdev=257.64 lat (msec): min=97, max=747, avg=355.92, stdev=257.64 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 97], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 255], 60.00th=[ 255], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1882, max= 3992, per=59.17%, avg=2628.33, stdev=1182.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1555KiB/s (1592kB/s)(7168KiB/4610msec); 0 zone resets clat (msec): min=102, max=792, avg=360.55, stdev=235.82 lat (msec): min=102, max=792, avg=360.65, stdev=235.83 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 169], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 347], 60.00th=[ 422], | 70.00th=[ 422], 80.00th=[ 485], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1822, max= 2043, per=31.17%, avg=1938.50, stdev=103.89, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=4.82%, ctx=88, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4443KiB/s (4549kB/s), 464KiB/s-2633KiB/s (475kB/s-2697kB/s), io=20.0MiB (20.0MB), run=2722-4610msec WRITE: bw=6220KiB/s (6369kB/s), 1462KiB/s-2320KiB/s (1497kB/s-2376kB/s), io=28.0MiB (29.4MB), run=2722-4610msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179266: Wed Sep 16 16:11:05 2026 read: IOPS=1, BW=5761KiB/s (5899kB/s)(12.0MiB/2133msec) clat (msec): min=628, max=700, avg=670.19, stdev=37.45 lat (msec): min=628, max=700, avg=670.19, stdev=37.45 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7327, max= 7656, per=97.53%, avg=7491.50, stdev=232.64, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=2.20%, ctx=77, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179267: Wed Sep 16 16:11:05 2026 read: IOPS=0, BW=1942KiB/s (1989kB/s)(4096KiB/2109msec) clat (nsec): min=287795k, max=287795k, avg=287795260.00, stdev= 0.00 lat (nsec): min=287798k, max=287798k, avg=287797730.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 288], 5.00th=[ 288], 10.00th=[ 288], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 5298, max= 5298, per=68.98%, avg=5298.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3884KiB/s (3978kB/s)(8192KiB/2109msec); 0 zone resets clat (msec): min=471, max=1268, avg=870.13, stdev=563.30 lat (msec): min=476, max=1271, avg=874.04, stdev=561.84 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 472], 50.00th=[ 472], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7488, max= 7488, per=83.57%, avg=7488.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=2.47%, ctx=32, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179268: Wed Sep 16 16:11:05 2026 write: IOPS=0, BW=3360KiB/s (3441kB/s)(12.0MiB/3657msec); 0 zone resets clat (msec): min=645, max=1665, avg=1178.35, stdev=511.76 lat (msec): min=647, max=1666, avg=1182.57, stdev=510.98 clat percentiles (msec): | 1.00th=[ 642], 5.00th=[ 642], 10.00th=[ 642], 20.00th=[ 642], | 30.00th=[ 642], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 7327, max= 8192, per=86.60%, avg=7759.50, stdev=611.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.16%, sys=5.03%, ctx=101, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179269: Wed Sep 16 16:11:05 2026 write: IOPS=1, BW=4695KiB/s (4808kB/s)(12.0MiB/2617msec); 0 zone resets clat (msec): min=379, max=1753, avg=869.00, stdev=767.42 lat (msec): min=380, max=1753, avg=869.73, stdev=767.16 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 477], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 5809, max= 7488, per=74.20%, avg=6648.50, stdev=1187.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=3.36%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7681KiB/s (7866kB/s), 1942KiB/s-5761KiB/s (1989kB/s-5899kB/s), io=16.0MiB (16.8MB), run=2109-2133msec WRITE: bw=8960KiB/s (9175kB/s), 3360KiB/s-4695KiB/s (3441kB/s-4808kB/s), io=32.0MiB (33.6MB), run=2109-3657msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179271: Wed Sep 16 16:11:05 2026 read: IOPS=1, BW=5003KiB/s (5123kB/s)(12.0MiB/2456msec) clat (msec): min=674, max=917, avg=817.80, stdev=126.92 lat (msec): min=674, max=917, avg=817.81, stdev=126.92 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.29%, sys=12.67%, ctx=366, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179272: Wed Sep 16 16:11:05 2026 read: IOPS=0, BW=1202KiB/s (1231kB/s)(4096KiB/3407msec) clat (nsec): min=1117.1M, max=1117.1M, avg=1117077702.00, stdev= 0.00 lat (nsec): min=1117.1M, max=1117.1M, avg=1117079102.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1116], 50.00th=[ 1116], 60.00th=[ 1116], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2404KiB/s (2462kB/s)(8192KiB/3407msec); 0 zone resets clat (msec): min=781, max=1505, avg=1143.73, stdev=512.06 lat (msec): min=781, max=1507, avg=1144.58, stdev=512.77 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8192, max= 8192, per=85.18%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.21%, sys=2.08%, ctx=187, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179273: Wed Sep 16 16:11:05 2026 write: IOPS=0, BW=3634KiB/s (3722kB/s)(12.0MiB/3381msec); 0 zone resets clat (msec): min=323, max=1747, avg=1124.30, stdev=728.32 lat (msec): min=324, max=1749, avg=1125.25, stdev=728.98 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 7876, max= 8062, per=82.86%, avg=7969.00, stdev=131.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.02%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179274: Wed Sep 16 16:11:05 2026 write: IOPS=1, BW=4253KiB/s (4355kB/s)(12.0MiB/2889msec); 0 zone resets clat (msec): min=352, max=2175, avg=962.14, stdev=1050.71 lat (msec): min=352, max=2175, avg=962.51, stdev=1050.68 clat percentiles (msec): | 1.00th=[ 355], 5.00th=[ 355], 10.00th=[ 355], 20.00th=[ 355], | 30.00th=[ 355], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 7571, max= 7984, per=80.87%, avg=7777.50, stdev=292.04, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.14%, sys=2.22%, ctx=38, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4809KiB/s (4924kB/s), 1202KiB/s-5003KiB/s (1231kB/s-5123kB/s), io=16.0MiB (16.8MB), run=2456-3407msec WRITE: bw=9618KiB/s (9849kB/s), 2404KiB/s-4253KiB/s (2462kB/s-4355kB/s), io=32.0MiB (33.6MB), run=2889-3407msec