== sanity test 398b: DIO and buffer IO race ============== 10:15:52 (1788531352) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.38671 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179692: Fri Sep 4 10:17:44 2026 read: IOPS=16, BW=65.2KiB/s (66.7kB/s)(5992KiB/91956msec) clat (usec): min=42, max=762618, avg=33997.44, stdev=29065.50 lat (usec): min=43, max=762619, avg=33999.38, stdev=29066.32 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 9765], 10.00th=[ 13566], 20.00th=[ 17171], | 30.00th=[ 20579], 40.00th=[ 24249], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 39584], 80.00th=[ 46924], 90.00th=[ 59507], 95.00th=[ 71828], | 99.00th=[110625], 99.50th=[143655], 99.90th=[214959], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 7, max= 118, per=25.91%, avg=65.02, stdev=20.68, samples=181 iops : min= 1, max= 29, avg=15.65, stdev= 5.20, samples=181 write: IOPS=17, BW=68.5KiB/s (70.1kB/s)(6296KiB/91956msec); 0 zone resets clat (usec): min=959, max=174677, avg=25824.57, stdev=25539.42 lat (usec): min=960, max=174678, avg=25826.13, stdev=25539.53 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1303], 10.00th=[ 1860], 20.00th=[ 3294], | 30.00th=[ 6521], 40.00th=[ 13829], 50.00th=[ 19006], 60.00th=[ 25560], | 70.00th=[ 33424], 80.00th=[ 43779], 90.00th=[ 60556], 95.00th=[ 74974], | 99.00th=[113771], 99.50th=[123208], 99.90th=[162530], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 7, max= 135, per=26.10%, avg=68.65, stdev=25.15, samples=180 iops : min= 1, max= 33, avg=16.56, stdev= 6.34, samples=180 lat (usec) : 50=0.36%, 100=1.01%, 250=0.16%, 500=0.07%, 1000=0.07% lat (msec) : 2=5.70%, 4=5.96%, 10=7.19%, 20=19.92%, 50=43.75% lat (msec) : 100=14.13%, 250=1.66%, 1000=0.03% cpu : usr=0.11%, sys=6.95%, ctx=6786, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179693: Fri Sep 4 10:17:44 2026 read: IOPS=15, BW=63.2KiB/s (64.7kB/s)(5940KiB/93973msec) clat (usec): min=40, max=764471, avg=34700.15, stdev=30562.95 lat (usec): min=41, max=764472, avg=34701.78, stdev=30562.90 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9372], 10.00th=[ 13435], 20.00th=[ 17433], | 30.00th=[ 20579], 40.00th=[ 23987], 50.00th=[ 28705], 60.00th=[ 33817], | 70.00th=[ 40109], 80.00th=[ 47973], 90.00th=[ 62129], 95.00th=[ 79168], | 99.00th=[119014], 99.50th=[139461], 99.90th=[278922], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 127, per=25.02%, avg=62.80, stdev=23.70, samples=186 iops : min= 1, max= 31, avg=15.09, stdev= 5.95, samples=186 write: IOPS=16, BW=67.6KiB/s (69.2kB/s)(6348KiB/93973msec); 0 zone resets clat (usec): min=960, max=207807, avg=26485.90, stdev=27562.31 lat (usec): min=961, max=207807, avg=26487.87, stdev=27562.15 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1729], 20.00th=[ 3032], | 30.00th=[ 5342], 40.00th=[ 11994], 50.00th=[ 19268], 60.00th=[ 26346], | 70.00th=[ 33817], 80.00th=[ 46400], 90.00th=[ 62653], 95.00th=[ 81265], | 99.00th=[116917], 99.50th=[130548], 99.90th=[198181], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 15, max= 199, per=25.67%, avg=67.51, stdev=26.34, samples=185 iops : min= 3, max= 49, avg=16.28, stdev= 6.63, samples=185 lat (usec) : 50=0.29%, 100=1.14%, 250=0.20%, 500=0.10%, 1000=0.13% lat (msec) : 2=6.64%, 4=6.28%, 10=7.62%, 20=18.07%, 50=41.83% lat (msec) : 100=15.07%, 250=2.57%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=6.83%, ctx=6754, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179694: Fri Sep 4 10:17:44 2026 read: IOPS=15, BW=63.2KiB/s (64.7kB/s)(6028KiB/95413msec) clat (usec): min=34, max=298683, avg=34577.88, stdev=23144.08 lat (usec): min=35, max=298684, avg=34579.19, stdev=23144.12 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8979], 10.00th=[ 13304], 20.00th=[ 17171], | 30.00th=[ 21627], 40.00th=[ 26084], 50.00th=[ 30540], 60.00th=[ 34866], | 70.00th=[ 40633], 80.00th=[ 47973], 90.00th=[ 61604], 95.00th=[ 73925], | 99.00th=[109577], 99.50th=[145753], 99.90th=[187696], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 23, max= 128, per=25.28%, avg=63.45, stdev=21.45, samples=187 iops : min= 5, max= 32, avg=15.25, stdev= 5.40, samples=187 write: IOPS=16, BW=65.6KiB/s (67.2kB/s)(6260KiB/95413msec); 0 zone resets clat (usec): min=819, max=803718, avg=27400.51, stdev=32836.17 lat (usec): min=820, max=803720, avg=27402.25, stdev=32836.04 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1778], 20.00th=[ 3326], | 30.00th=[ 6259], 40.00th=[ 14222], 50.00th=[ 20317], 60.00th=[ 25822], | 70.00th=[ 34341], 80.00th=[ 46924], 90.00th=[ 65274], 95.00th=[ 78119], | 99.00th=[114820], 99.50th=[125305], 99.90th=[187696], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 158, per=24.92%, avg=65.53, stdev=25.42, samples=188 iops : min= 1, max= 39, avg=15.78, stdev= 6.36, samples=188 lat (usec) : 50=0.42%, 100=1.17%, 250=0.16%, 500=0.03%, 1000=0.13% lat (msec) : 2=5.79%, 4=5.73%, 10=7.16%, 20=17.61%, 50=44.21% lat (msec) : 100=15.89%, 250=1.63%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=6.75%, ctx=6782, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179695: Fri Sep 4 10:17:44 2026 read: IOPS=16, BW=64.7KiB/s (66.3kB/s)(6052KiB/93493msec) clat (usec): min=33, max=157402, avg=33902.69, stdev=21687.08 lat (usec): min=33, max=157404, avg=33905.62, stdev=21686.39 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 8586], 10.00th=[ 12780], 20.00th=[ 17171], | 30.00th=[ 21103], 40.00th=[ 25035], 50.00th=[ 29492], 60.00th=[ 34866], | 70.00th=[ 40633], 80.00th=[ 47973], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[108528], 99.50th=[127402], 99.90th=[154141], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 23, max= 120, per=25.94%, avg=65.10, stdev=21.70, samples=183 iops : min= 5, max= 30, avg=15.66, stdev= 5.49, samples=183 write: IOPS=16, BW=66.7KiB/s (68.3kB/s)(6236KiB/93493msec); 0 zone resets clat (usec): min=974, max=749736, avg=26818.34, stdev=32347.89 lat (usec): min=975, max=749740, avg=26819.88, stdev=32347.96 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1909], 20.00th=[ 3523], | 30.00th=[ 6390], 40.00th=[ 12780], 50.00th=[ 19006], 60.00th=[ 25822], | 70.00th=[ 33424], 80.00th=[ 45351], 90.00th=[ 64226], 95.00th=[ 78119], | 99.00th=[123208], 99.50th=[143655], 99.90th=[164627], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 15, max= 157, per=25.32%, avg=66.60, stdev=25.92, samples=184 iops : min= 3, max= 39, avg=16.05, stdev= 6.53, samples=184 lat (usec) : 50=0.46%, 100=1.30%, 250=0.29%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.34%, 4=6.09%, 10=7.78%, 20=18.00%, 50=42.84% lat (msec) : 100=15.92%, 250=1.79%, 750=0.03% cpu : usr=0.09%, sys=6.79%, ctx=6850, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=252KiB/s (258kB/s), 63.2KiB/s-65.2KiB/s (64.7kB/s-66.7kB/s), io=23.4MiB (24.6MB), run=91956-95413msec WRITE: bw=263KiB/s (270kB/s), 65.6KiB/s-68.5KiB/s (67.2kB/s-70.1kB/s), io=24.6MiB (25.7MB), run=91956-95413msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179696: Fri Sep 4 10:18:18 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(5992KiB/128048msec) clat (msec): min=5, max=778, avg=33.40, stdev=34.28 lat (msec): min=5, max=778, avg=33.40, stdev=34.28 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 69], 95.00th=[ 93], | 99.00th=[ 144], 99.50th=[ 169], 99.90th=[ 264], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 152, per=25.51%, avg=47.20, stdev=28.04, samples=249 iops : min= 1, max= 38, avg=11.19, stdev= 7.02, samples=249 write: IOPS=12, BW=49.2KiB/s (50.3kB/s)(6296KiB/128048msec); 0 zone resets clat (msec): min=10, max=285, avg=49.37, stdev=32.79 lat (msec): min=10, max=285, avg=49.37, stdev=32.79 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 40], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 70], 90.00th=[ 90], 95.00th=[ 108], | 99.00th=[ 180], 99.50th=[ 209], 99.90th=[ 268], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 7, max= 135, per=25.25%, avg=48.98, stdev=25.46, samples=252 iops : min= 1, max= 33, avg=11.63, stdev= 6.40, samples=252 lat (msec) : 10=3.06%, 20=22.36%, 50=47.10%, 100=22.04%, 250=5.31% lat (msec) : 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=2.35%, ctx=4745, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179697: Fri Sep 4 10:18:18 2026 read: IOPS=11, BW=45.9KiB/s (47.0kB/s)(5940KiB/129299msec) clat (msec): min=5, max=730, avg=32.31, stdev=31.29 lat (msec): min=5, max=730, avg=32.31, stdev=31.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 45], 90.00th=[ 68], 95.00th=[ 84], | 99.00th=[ 123], 99.50th=[ 148], 99.90th=[ 239], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 7, max= 152, per=24.85%, avg=45.98, stdev=27.61, samples=253 iops : min= 1, max= 38, avg=10.88, stdev= 6.93, samples=253 write: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6348KiB/129299msec); 0 zone resets clat (msec): min=10, max=302, avg=51.04, stdev=33.18 lat (msec): min=10, max=302, avg=51.04, stdev=33.19 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 31], 40.00th=[ 35], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 59], 80.00th=[ 71], 90.00th=[ 90], 95.00th=[ 115], | 99.00th=[ 184], 99.50th=[ 199], 99.90th=[ 271], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 111, per=25.12%, avg=48.73, stdev=23.64, samples=255 iops : min= 1, max= 27, avg=11.57, stdev= 5.95, samples=255 lat (msec) : 10=3.45%, 20=19.76%, 50=48.24%, 100=23.54%, 250=4.92% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.06%, sys=2.28%, ctx=4828, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179698: Fri Sep 4 10:18:18 2026 read: IOPS=11, BW=46.6KiB/s (47.7kB/s)(6028KiB/129392msec) clat (msec): min=5, max=216, avg=33.85, stdev=28.29 lat (msec): min=5, max=216, avg=33.86, stdev=28.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 73], 95.00th=[ 95], | 99.00th=[ 138], 99.50th=[ 169], 99.90th=[ 192], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 7, max= 160, per=25.27%, avg=46.76, stdev=27.95, samples=252 iops : min= 1, max= 40, avg=11.08, stdev= 7.01, samples=252 write: IOPS=12, BW=48.4KiB/s (49.5kB/s)(6260KiB/129392msec); 0 zone resets clat (msec): min=10, max=748, avg=49.89, stdev=37.82 lat (msec): min=10, max=748, avg=49.89, stdev=37.82 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 47], | 70.00th=[ 57], 80.00th=[ 69], 90.00th=[ 94], 95.00th=[ 113], | 99.00th=[ 180], 99.50th=[ 205], 99.90th=[ 305], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 136, per=24.73%, avg=47.98, stdev=26.46, samples=255 iops : min= 1, max= 34, avg=11.38, stdev= 6.65, samples=255 lat (msec) : 10=3.35%, 20=20.35%, 50=48.44%, 100=21.91%, 250=5.86% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.06%, sys=2.26%, ctx=4815, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179699: Fri Sep 4 10:18:18 2026 read: IOPS=11, BW=46.8KiB/s (47.9kB/s)(6052KiB/129371msec) clat (msec): min=4, max=242, avg=32.90, stdev=28.55 lat (msec): min=4, max=242, avg=32.90, stdev=28.55 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 70], 95.00th=[ 91], | 99.00th=[ 140], 99.50th=[ 174], 99.90th=[ 239], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 7, max= 136, per=25.49%, avg=47.16, stdev=27.87, samples=251 iops : min= 1, max= 34, avg=11.18, stdev= 7.01, samples=251 write: IOPS=12, BW=48.2KiB/s (49.4kB/s)(6236KiB/129371msec); 0 zone resets clat (msec): min=8, max=750, avg=50.85, stdev=37.70 lat (msec): min=8, max=750, avg=50.86, stdev=37.70 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 58], 80.00th=[ 72], 90.00th=[ 94], 95.00th=[ 114], | 99.00th=[ 174], 99.50th=[ 220], 99.90th=[ 321], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 127, per=24.61%, avg=47.75, stdev=25.59, samples=255 iops : min= 1, max= 31, avg=11.33, stdev= 6.44, samples=255 lat (msec) : 10=3.74%, 20=20.51%, 50=47.95%, 100=21.91%, 250=5.79% lat (msec) : 500=0.07%, 1000=0.03% cpu : usr=0.06%, sys=2.32%, ctx=4770, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=186KiB/s (190kB/s), 45.9KiB/s-46.8KiB/s (47.0kB/s-47.9kB/s), io=23.4MiB (24.6MB), run=128048-129392msec WRITE: bw=194KiB/s (199kB/s), 48.2KiB/s-49.2KiB/s (49.4kB/s-50.3kB/s), io=24.6MiB (25.7MB), run=128048-129392msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Fri Sep 4 10:19:01 2026 read: IOPS=11, BW=177KiB/s (181kB/s)(5920KiB/33424msec) clat (usec): min=41, max=220424, avg=46483.91, stdev=32785.70 lat (usec): min=41, max=220425, avg=46484.87, stdev=32785.72 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 59], 10.00th=[ 239], 20.00th=[ 21103], | 30.00th=[ 28181], 40.00th=[ 33424], 50.00th=[ 40633], 60.00th=[ 49546], | 70.00th=[ 58983], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[105382], | 99.00th=[141558], 99.50th=[185598], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 351, per=25.17%, avg=175.97, stdev=73.50, samples=65 iops : min= 1, max= 21, avg=10.22, stdev= 4.60, samples=65 write: IOPS=11, BW=191KiB/s (195kB/s)(6368KiB/33424msec); 0 zone resets clat (usec): min=1443, max=217017, avg=40682.24, stdev=38874.00 lat (usec): min=1444, max=217018, avg=40684.22, stdev=38874.21 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1926], 10.00th=[ 3097], 20.00th=[ 7701], | 30.00th=[ 12518], 40.00th=[ 19792], 50.00th=[ 29492], 60.00th=[ 40109], | 70.00th=[ 52167], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[179307], 99.50th=[193987], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 447, per=25.84%, avg=190.18, stdev=79.60, samples=65 iops : min= 1, max= 27, avg=11.11, stdev= 4.99, samples=65 lat (usec) : 50=0.52%, 100=4.04%, 250=0.26%, 500=0.26% lat (msec) : 2=2.86%, 4=3.78%, 10=6.77%, 20=10.94%, 50=35.16% lat (msec) : 100=27.73%, 250=7.68% cpu : usr=0.07%, sys=5.47%, ctx=1677, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Fri Sep 4 10:19:01 2026 read: IOPS=10, BW=168KiB/s (172kB/s)(5744KiB/34219msec) clat (usec): min=40, max=301618, avg=48273.59, stdev=35905.21 lat (usec): min=40, max=301619, avg=48274.53, stdev=35905.22 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 97], 20.00th=[ 22414], | 30.00th=[ 31327], 40.00th=[ 36963], 50.00th=[ 41681], 60.00th=[ 49546], | 70.00th=[ 59507], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[177210], 99.50th=[225444], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 442, per=23.91%, avg=167.15, stdev=72.68, samples=67 iops : min= 1, max= 27, avg= 9.66, stdev= 4.53, samples=67 write: IOPS=11, BW=191KiB/s (196kB/s)(6544KiB/34219msec); 0 zone resets clat (usec): min=1273, max=236675, avg=41138.56, stdev=39973.97 lat (usec): min=1274, max=236677, avg=41157.65, stdev=39987.91 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1909], 10.00th=[ 3720], 20.00th=[ 8586], | 30.00th=[ 13566], 40.00th=[ 22152], 50.00th=[ 30016], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 64226], 90.00th=[ 95945], 95.00th=[123208], | 99.00th=[173016], 99.50th=[208667], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 63, max= 415, per=25.80%, avg=189.87, stdev=77.87, samples=67 iops : min= 3, max= 25, avg=11.10, stdev= 4.90, samples=67 lat (usec) : 50=0.52%, 100=4.17%, 250=0.26% lat (msec) : 2=2.99%, 4=2.73%, 10=7.68%, 20=9.24%, 50=37.76% lat (msec) : 100=26.82%, 250=7.68%, 500=0.13% cpu : usr=0.06%, sys=5.84%, ctx=1707, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Fri Sep 4 10:19:01 2026 read: IOPS=11, BW=190KiB/s (194kB/s)(6256KiB/32980msec) clat (usec): min=37, max=207710, avg=46382.68, stdev=32403.57 lat (usec): min=37, max=207711, avg=46386.52, stdev=32405.83 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 1188], 20.00th=[ 21103], | 30.00th=[ 27657], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 83362], 95.00th=[108528], | 99.00th=[154141], 99.50th=[168821], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 63, max= 350, per=27.30%, avg=190.83, stdev=71.55, samples=64 iops : min= 3, max= 21, avg=11.16, stdev= 4.48, samples=64 write: IOPS=11, BW=183KiB/s (187kB/s)(6032KiB/32980msec); 0 zone resets clat (usec): min=1590, max=251860, avg=39217.83, stdev=37969.62 lat (usec): min=1591, max=251862, avg=39219.57, stdev=37969.60 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 3392], 20.00th=[ 5997], | 30.00th=[ 12649], 40.00th=[ 20055], 50.00th=[ 30540], 60.00th=[ 38011], | 70.00th=[ 49546], 80.00th=[ 66323], 90.00th=[ 91751], 95.00th=[113771], | 99.00th=[166724], 99.50th=[200279], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 62, max= 380, per=24.55%, avg=180.70, stdev=67.30, samples=64 iops : min= 3, max= 23, avg=10.52, stdev= 4.24, samples=64 lat (usec) : 50=0.52%, 100=3.52%, 250=0.52%, 500=0.26% lat (msec) : 2=2.73%, 4=4.17%, 10=7.16%, 20=9.38%, 50=37.37% lat (msec) : 100=27.60%, 250=6.64%, 500=0.13% cpu : usr=0.06%, sys=5.59%, ctx=1752, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179743: Fri Sep 4 10:19:01 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(6032KiB/31846msec) clat (usec): min=38, max=262822, avg=47270.40, stdev=36731.41 lat (usec): min=38, max=262823, avg=47271.41, stdev=36731.50 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 87], 20.00th=[ 21103], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 41157], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[106431], | 99.00th=[177210], 99.50th=[233833], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 383, per=26.97%, avg=188.50, stdev=78.77, samples=62 iops : min= 1, max= 23, avg=11.00, stdev= 4.88, samples=62 write: IOPS=12, BW=196KiB/s (201kB/s)(6256KiB/31846msec); 0 zone resets clat (usec): min=1390, max=222904, avg=35740.38, stdev=35979.75 lat (usec): min=1392, max=222904, avg=35751.63, stdev=35972.33 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2802], 10.00th=[ 4228], 20.00th=[ 6718], | 30.00th=[ 10814], 40.00th=[ 16188], 50.00th=[ 23725], 60.00th=[ 31589], | 70.00th=[ 43779], 80.00th=[ 59507], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[156238], 99.50th=[189793], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 383, per=26.78%, avg=197.13, stdev=79.41, samples=62 iops : min= 1, max= 23, avg=11.55, stdev= 4.98, samples=62 lat (usec) : 50=0.65%, 100=4.95%, 250=0.13%, 750=0.13%, 1000=0.26% lat (msec) : 2=1.30%, 4=3.65%, 10=9.38%, 20=10.81%, 50=36.98% lat (msec) : 100=24.74%, 250=6.90%, 500=0.13% cpu : usr=0.05%, sys=5.46%, ctx=1618, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=700KiB/s (717kB/s), 168KiB/s-190KiB/s (172kB/s-194kB/s), io=23.4MiB (24.5MB), run=31846-34219msec WRITE: bw=736KiB/s (754kB/s), 183KiB/s-196KiB/s (187kB/s-201kB/s), io=24.6MiB (25.8MB), run=31846-34219msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179735: Fri Sep 4 10:19:09 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(5920KiB/41828msec) clat (msec): min=5, max=229, avg=44.00, stdev=40.35 lat (msec): min=5, max=229, avg=44.00, stdev=40.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 95], 95.00th=[ 136], | 99.00th=[ 222], 99.50th=[ 228], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 542, per=25.40%, avg=142.00, stdev=104.15, samples=80 iops : min= 1, max= 33, avg= 8.08, stdev= 6.57, samples=80 write: IOPS=9, BW=152KiB/s (156kB/s)(6368KiB/41828msec); 0 zone resets clat (msec): min=11, max=243, avg=64.04, stdev=46.19 lat (msec): min=11, max=243, avg=64.07, stdev=46.27 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 26], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 49], 60.00th=[ 61], | 70.00th=[ 79], 80.00th=[ 104], 90.00th=[ 126], 95.00th=[ 159], | 99.00th=[ 215], 99.50th=[ 243], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 31, max= 576, per=25.60%, avg=150.52, stdev=101.00, samples=82 iops : min= 1, max= 36, avg= 8.61, stdev= 6.37, samples=82 lat (msec) : 10=2.99%, 20=15.89%, 50=42.06%, 100=23.96%, 250=15.10% cpu : usr=0.04%, sys=1.88%, ctx=1206, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179736: Fri Sep 4 10:19:09 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(5744KiB/42830msec) clat (msec): min=5, max=246, avg=44.40, stdev=41.49 lat (msec): min=5, max=246, avg=44.40, stdev=41.49 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 36], | 70.00th=[ 48], 80.00th=[ 68], 90.00th=[ 105], 95.00th=[ 134], | 99.00th=[ 211], 99.50th=[ 241], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 30, max= 479, per=24.90%, avg=139.20, stdev=100.46, samples=80 iops : min= 1, max= 29, avg= 7.90, stdev= 6.34, samples=80 write: IOPS=9, BW=153KiB/s (156kB/s)(6544KiB/42830msec); 0 zone resets clat (msec): min=11, max=298, avg=65.44, stdev=48.64 lat (msec): min=11, max=298, avg=65.44, stdev=48.64 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 51], 60.00th=[ 64], | 70.00th=[ 80], 80.00th=[ 104], 90.00th=[ 131], 95.00th=[ 157], | 99.00th=[ 236], 99.50th=[ 249], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 479, per=25.64%, avg=150.79, stdev=106.54, samples=84 iops : min= 1, max= 29, avg= 8.64, stdev= 6.73, samples=84 lat (msec) : 10=3.26%, 20=14.97%, 50=41.15%, 100=24.74%, 250=15.63% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=1.99%, ctx=1244, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179737: Fri Sep 4 10:19:09 2026 read: IOPS=9, BW=146KiB/s (150kB/s)(6256KiB/42828msec) clat (msec): min=6, max=269, avg=43.87, stdev=41.35 lat (msec): min=6, max=269, avg=43.87, stdev=41.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 70], 90.00th=[ 95], 95.00th=[ 126], | 99.00th=[ 199], 99.50th=[ 213], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 31, max= 640, per=26.42%, avg=147.67, stdev=116.56, samples=83 iops : min= 1, max= 40, avg= 8.45, stdev= 7.37, samples=83 write: IOPS=8, BW=141KiB/s (144kB/s)(6032KiB/42828msec); 0 zone resets clat (msec): min=11, max=299, avg=67.77, stdev=48.49 lat (msec): min=11, max=299, avg=67.78, stdev=48.49 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 169], | 99.00th=[ 226], 99.50th=[ 243], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 384, per=23.75%, avg=139.63, stdev=92.56, samples=83 iops : min= 1, max= 24, avg= 7.94, stdev= 5.87, samples=83 lat (msec) : 10=3.39%, 20=17.71%, 50=38.54%, 100=25.65%, 250=14.45% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.85%, ctx=1258, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179738: Fri Sep 4 10:19:09 2026 read: IOPS=8, BW=142KiB/s (146kB/s)(6032KiB/42373msec) clat (msec): min=5, max=277, avg=46.03, stdev=46.83 lat (msec): min=5, max=277, avg=46.03, stdev=46.83 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 103], 95.00th=[ 155], | 99.00th=[ 236], 99.50th=[ 243], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 544, per=26.06%, avg=145.70, stdev=105.52, samples=80 iops : min= 1, max= 34, avg= 8.31, stdev= 6.68, samples=80 write: IOPS=9, BW=148KiB/s (151kB/s)(6256KiB/42373msec); 0 zone resets clat (msec): min=9, max=288, avg=63.71, stdev=45.98 lat (msec): min=9, max=288, avg=63.72, stdev=45.99 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 41], 50.00th=[ 50], 60.00th=[ 63], | 70.00th=[ 74], 80.00th=[ 94], 90.00th=[ 124], 95.00th=[ 159], | 99.00th=[ 239], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 479, per=24.93%, avg=146.57, stdev=105.49, samples=83 iops : min= 1, max= 29, avg= 8.36, stdev= 6.63, samples=83 lat (msec) : 10=3.65%, 20=18.10%, 50=39.19%, 100=24.87%, 250=13.80% lat (msec) : 500=0.39% cpu : usr=0.03%, sys=1.94%, ctx=1204, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=559KiB/s (573kB/s), 134KiB/s-146KiB/s (137kB/s-150kB/s), io=23.4MiB (24.5MB), run=41828-42830msec WRITE: bw=588KiB/s (602kB/s), 141KiB/s-153KiB/s (144kB/s-156kB/s), io=24.6MiB (25.8MB), run=41828-42830msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179754: Fri Sep 4 10:19:24 2026 read: IOPS=2, BW=2237KiB/s (2291kB/s)(7168KiB/3204msec) clat (usec): min=1305, max=373125, avg=181171.21, stdev=112349.46 lat (usec): min=1306, max=373126, avg=181172.36, stdev=112349.27 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1303], 10.00th=[ 1303], 20.00th=[127402], | 30.00th=[158335], 40.00th=[158335], 50.00th=[177210], 60.00th=[196084], | 70.00th=[196084], 80.00th=[233833], 90.00th=[371196], 95.00th=[371196], | 99.00th=[371196], 99.50th=[371196], 99.90th=[371196], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 3755, max= 4047, per=93.89%, avg=3901.00, stdev=206.48, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1598KiB/s (1636kB/s)(5120KiB/3204msec); 0 zone resets clat (msec): min=322, max=530, avg=380.76, stdev=86.42 lat (msec): min=322, max=530, avg=380.83, stdev=86.42 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 338], 60.00th=[ 338], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1921, max= 2048, per=34.53%, avg=2008.75, stdev=59.49, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 2=8.33%, 250=41.67%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=21.48%, ctx=176, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179755: Fri Sep 4 10:19:24 2026 read: IOPS=0, BW=416KiB/s (426kB/s)(2048KiB/4928msec) clat (usec): min=952, max=125850, avg=63401.61, stdev=88316.75 lat (usec): min=953, max=125853, avg=63403.22, stdev=88317.61 clat percentiles (usec): | 1.00th=[ 955], 5.00th=[ 955], 10.00th=[ 955], 20.00th=[ 955], | 30.00th=[ 955], 40.00th=[ 955], 50.00th=[ 955], 60.00th=[126354], | 70.00th=[126354], 80.00th=[126354], 90.00th=[126354], 95.00th=[126354], | 99.00th=[126354], 99.50th=[126354], 99.90th=[126354], 99.95th=[126354], | 99.99th=[126354] bw ( KiB/s): min= 1283, max= 2043, per=40.02%, avg=1663.00, stdev=537.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2078KiB/s (2128kB/s)(10.0MiB/4928msec); 0 zone resets clat (msec): min=153, max=901, avg=476.70, stdev=259.99 lat (msec): min=153, max=902, avg=476.86, stdev=260.04 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 171], | 30.00th=[ 197], 40.00th=[ 342], 50.00th=[ 481], 60.00th=[ 518], | 70.00th=[ 542], 80.00th=[ 726], 90.00th=[ 735], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1283, max= 4087, per=42.87%, avg=2494.29, stdev=1112.51, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=16.67%, 750=33.33%, 1000=8.33% cpu : usr=0.02%, sys=14.15%, ctx=126, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179756: Fri Sep 4 10:19:24 2026 read: IOPS=1, BW=1787KiB/s (1829kB/s)(6144KiB/3439msec) clat (usec): min=522, max=304151, avg=157187.63, stdev=145806.27 lat (usec): min=523, max=304152, avg=157188.73, stdev=145806.06 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 2008], | 30.00th=[ 2008], 40.00th=[ 79168], 50.00th=[ 79168], 60.00th=[261096], | 70.00th=[295699], 80.00th=[295699], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 4096, max= 5763, per=100.00%, avg=4929.50, stdev=1178.75, samples=2 iops : min= 4, max= 5, avg= 4.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1787KiB/s (1829kB/s)(6144KiB/3439msec); 0 zone resets clat (msec): min=284, max=570, avg=409.05, stdev=100.76 lat (msec): min=284, max=570, avg=409.12, stdev=100.76 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 418], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 1264, max= 2048, per=32.41%, avg=1885.67, stdev=308.03, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 100=8.33%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=16.26%, ctx=257, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179757: Fri Sep 4 10:19:24 2026 read: IOPS=1, BW=1293KiB/s (1324kB/s)(5120KiB/3959msec) clat (usec): min=335, max=405591, avg=192124.47, stdev=191016.97 lat (usec): min=336, max=405592, avg=192125.45, stdev=191017.03 clat percentiles (usec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 1516], 40.00th=[ 1516], 50.00th=[196084], 60.00th=[196084], | 70.00th=[358613], 80.00th=[358613], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1811KiB/s (1854kB/s)(7168KiB/3959msec); 0 zone resets clat (msec): min=150, max=792, avg=423.23, stdev=192.70 lat (msec): min=151, max=792, avg=423.31, stdev=192.71 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 351], | 30.00th=[ 376], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 464], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 1281, max= 4096, per=45.67%, avg=2657.00, stdev=1239.68, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=5 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=58.33%, 1000=8.33% cpu : usr=0.00%, sys=14.30%, ctx=206, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4156KiB/s (4256kB/s), 416KiB/s-2237KiB/s (426kB/s-2291kB/s), io=20.0MiB (20.0MB), run=3204-4928msec WRITE: bw=5818KiB/s (5958kB/s), 1598KiB/s-2078KiB/s (1636kB/s-2128kB/s), io=28.0MiB (29.4MB), run=3204-4928msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179759: Fri Sep 4 10:19:24 2026 read: IOPS=1, BW=1807KiB/s (1850kB/s)(7168KiB/3967msec) clat (msec): min=60, max=680, avg=341.18, stdev=228.67 lat (msec): min=60, max=680, avg=341.18, stdev=228.67 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 61], 10.00th=[ 61], 20.00th=[ 150], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 334], 60.00th=[ 472], | 70.00th=[ 472], 80.00th=[ 527], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1380, max= 4000, per=55.41%, avg=2282.20, stdev=998.65, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1291KiB/s (1322kB/s)(5120KiB/3967msec); 0 zone resets clat (msec): min=139, max=548, avg=275.97, stdev=167.24 lat (msec): min=140, max=549, avg=276.23, stdev=167.59 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2015, max= 3938, per=43.49%, avg=2507.75, stdev=953.57, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=25.00% cpu : usr=0.05%, sys=8.19%, ctx=100, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179760: Fri Sep 4 10:19:24 2026 read: IOPS=0, BW=412KiB/s (422kB/s)(2048KiB/4972msec) clat (msec): min=135, max=512, avg=324.11, stdev=266.24 lat (msec): min=135, max=512, avg=324.12, stdev=266.24 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 514], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2000, max= 2039, per=49.03%, avg=2019.50, stdev=27.58, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2060KiB/s (2109kB/s)(10.0MiB/4972msec); 0 zone resets clat (msec): min=133, max=1430, avg=402.25, stdev=384.98 lat (msec): min=133, max=1431, avg=402.85, stdev=385.22 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 165], | 30.00th=[ 201], 40.00th=[ 222], 50.00th=[ 249], 60.00th=[ 300], | 70.00th=[ 334], 80.00th=[ 401], 90.00th=[ 592], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 2000, max= 6107, per=56.33%, avg=3248.00, stdev=1830.57, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=6.76%, ctx=243, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179761: Fri Sep 4 10:19:24 2026 read: IOPS=1, BW=1386KiB/s (1419kB/s)(6144KiB/4434msec) clat (msec): min=123, max=1029, avg=342.44, stdev=359.22 lat (msec): min=123, max=1029, avg=342.45, stdev=359.22 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 176], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 1028], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 2023, max= 4079, per=61.76%, avg=2544.00, stdev=1023.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1386KiB/s (1419kB/s)(6144KiB/4434msec); 0 zone resets clat (msec): min=202, max=596, avg=349.74, stdev=147.23 lat (msec): min=203, max=596, avg=349.84, stdev=147.20 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 321], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2015, max= 4000, per=43.74%, avg=2522.25, stdev=985.22, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.29%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179762: Fri Sep 4 10:19:24 2026 read: IOPS=1, BW=1284KiB/s (1315kB/s)(5120KiB/3988msec) clat (msec): min=111, max=233, avg=157.05, stdev=51.76 lat (msec): min=111, max=233, avg=157.05, stdev=51.76 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 112], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 234], 95.00th=[ 234], | 99.00th=[ 234], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 2039, max= 5907, per=96.46%, avg=3973.00, stdev=2735.09, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1797KiB/s (1841kB/s)(7168KiB/3988msec); 0 zone resets clat (msec): min=181, max=735, avg=431.83, stdev=219.70 lat (msec): min=181, max=735, avg=431.93, stdev=219.68 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 220], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 460], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 600], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2000, max= 4079, per=52.61%, avg=3033.25, stdev=1180.02, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=66.67%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=6.67%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4119KiB/s (4218kB/s), 412KiB/s-1807KiB/s (422kB/s-1850kB/s), io=20.0MiB (20.0MB), run=3967-4972msec WRITE: bw=5767KiB/s (5905kB/s), 1291KiB/s-2060KiB/s (1322kB/s-2109kB/s), io=28.0MiB (29.4MB), run=3967-4972msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179768: Fri Sep 4 10:19:36 2026 read: IOPS=1, BW=5176KiB/s (5300kB/s)(12.0MiB/2374msec) clat (msec): min=624, max=1040, avg=791.05, stdev=220.22 lat (msec): min=624, max=1040, avg=791.07, stdev=220.25 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.48%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179769: Fri Sep 4 10:19:36 2026 read: IOPS=0, BW=1466KiB/s (1501kB/s)(4096KiB/2794msec) clat (nsec): min=195705k, max=195705k, avg=195704697.00, stdev= 0.00 lat (nsec): min=195707k, max=195707k, avg=195707231.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 197], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 5736, max= 5736, per=97.83%, avg=5736.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2932KiB/s (3002kB/s)(8192KiB/2794msec); 0 zone resets clat (msec): min=312, max=2232, avg=1272.41, stdev=1357.16 lat (msec): min=312, max=2232, avg=1272.67, stdev=1357.21 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 313], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 5736, max= 5736, per=48.91%, avg=5736.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.51%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179771: Fri Sep 4 10:19:36 2026 write: IOPS=1, BW=6624KiB/s (6783kB/s)(12.0MiB/1855msec); 0 zone resets clat (msec): min=417, max=723, avg=617.40, stdev=173.20 lat (msec): min=418, max=723, avg=618.03, stdev=172.69 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 6681, max= 8143, per=63.20%, avg=7412.00, stdev=1033.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=6.31%, ctx=44, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179772: Fri Sep 4 10:19:36 2026 write: IOPS=1, BW=6450KiB/s (6605kB/s)(12.0MiB/1905msec); 0 zone resets clat (msec): min=217, max=1301, avg=608.21, stdev=602.14 lat (msec): min=218, max=1302, avg=609.92, stdev=601.12 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 305], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min=11787, max=11787, per=100.00%, avg=11787.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.72%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5864KiB/s (6005kB/s), 1466KiB/s-5176KiB/s (1501kB/s-5300kB/s), io=16.0MiB (16.8MB), run=2374-2794msec WRITE: bw=11.5MiB/s (12.0MB/s), 2932KiB/s-6624KiB/s (3002kB/s-6783kB/s), io=32.0MiB (33.6MB), run=1855-2794msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179774: Fri Sep 4 10:19:37 2026 read: IOPS=1, BW=6074KiB/s (6220kB/s)(12.0MiB/2023msec) clat (msec): min=660, max=697, avg=673.58, stdev=20.42 lat (msec): min=660, max=697, avg=673.58, stdev=20.42 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=22.06%, ctx=378, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179775: Fri Sep 4 10:19:37 2026 read: IOPS=0, BW=1670KiB/s (1711kB/s)(4096KiB/2452msec) clat (nsec): min=545684k, max=545684k, avg=545684237.00, stdev= 0.00 lat (nsec): min=545686k, max=545686k, avg=545686467.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 5712, max= 5712, per=85.50%, avg=5712.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3341KiB/s (3421kB/s)(8192KiB/2452msec); 0 zone resets clat (msec): min=488, max=1416, avg=952.17, stdev=656.32 lat (msec): min=488, max=1416, avg=952.56, stdev=656.29 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 489], 40.00th=[ 489], 50.00th=[ 489], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8159, max= 8159, per=74.68%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.94%, ctx=196, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179776: Fri Sep 4 10:19:37 2026 write: IOPS=1, BW=4097KiB/s (4196kB/s)(12.0MiB/2999msec); 0 zone resets clat (msec): min=227, max=2069, avg=998.80, stdev=956.41 lat (msec): min=228, max=2069, avg=999.21, stdev=956.39 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 228], | 30.00th=[ 228], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 2072], 80.00th=[ 2072], 90.00th=[ 2072], 95.00th=[ 2072], | 99.00th=[ 2072], 99.50th=[ 2072], 99.90th=[ 2072], 99.95th=[ 2072], | 99.99th=[ 2072] bw ( KiB/s): min= 8192, max= 8192, per=74.98%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.90%, ctx=55, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179777: Fri Sep 4 10:19:37 2026 write: IOPS=1, BW=5476KiB/s (5607kB/s)(12.0MiB/2244msec); 0 zone resets clat (msec): min=147, max=1554, avg=743.81, stdev=727.41 lat (msec): min=147, max=1554, avg=744.12, stdev=727.42 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7049, max= 7049, per=64.52%, avg=7049.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.15%, ctx=48, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6682KiB/s (6842kB/s), 1670KiB/s-6074KiB/s (1711kB/s-6220kB/s), io=16.0MiB (16.8MB), run=2023-2452msec WRITE: bw=10.7MiB/s (11.2MB/s), 3341KiB/s-5476KiB/s (3421kB/s-5607kB/s), io=32.0MiB (33.6MB), run=2244-2999msec