== sanity test 398b: DIO and buffer IO race ============== 19:57:02 (1789689422) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.96269 s, 10.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179241: Thu Sep 17 19:59:20 2026 read: IOPS=12, BW=50.9KiB/s (52.1kB/s)(5992KiB/117807msec) clat (usec): min=33, max=944871, avg=43514.48, stdev=35822.68 lat (usec): min=33, max=944872, avg=43515.86, stdev=35822.74 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10683], 10.00th=[ 15533], 20.00th=[ 21103], | 30.00th=[ 26084], 40.00th=[ 31065], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[132645], 99.50th=[147850], 99.90th=[202376], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 7, max= 135, per=25.25%, avg=50.49, stdev=20.20, samples=231 iops : min= 1, max= 33, avg=11.98, stdev= 5.08, samples=231 write: IOPS=13, BW=53.4KiB/s (54.7kB/s)(6296KiB/117807msec); 0 zone resets clat (usec): min=700, max=287459, avg=33138.01, stdev=36861.58 lat (usec): min=701, max=287461, avg=33141.39, stdev=36860.43 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1237], 20.00th=[ 2769], | 30.00th=[ 6259], 40.00th=[ 13829], 50.00th=[ 22414], 60.00th=[ 31065], | 70.00th=[ 42730], 80.00th=[ 56361], 90.00th=[ 81265], 95.00th=[105382], | 99.00th=[162530], 99.50th=[193987], 99.90th=[261096], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 127, per=25.38%, avg=53.29, stdev=22.72, samples=230 iops : min= 1, max= 31, avg=12.69, stdev= 5.73, samples=230 lat (usec) : 50=0.42%, 100=1.24%, 250=0.13%, 750=0.03%, 1000=0.42% lat (msec) : 2=8.17%, 4=3.97%, 10=6.48%, 20=11.75%, 50=39.32% lat (msec) : 100=23.31%, 250=4.62%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=4.93%, ctx=5936, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179243: Thu Sep 17 19:59:20 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5940KiB/119543msec) clat (usec): min=32, max=271953, avg=43835.28, stdev=30064.39 lat (usec): min=32, max=271953, avg=43842.02, stdev=30066.50 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10552], 10.00th=[ 16450], 20.00th=[ 22152], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 37487], 60.00th=[ 43254], | 70.00th=[ 50594], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[177210], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 108, per=24.67%, avg=49.33, stdev=19.33, samples=233 iops : min= 1, max= 27, avg=11.70, stdev= 4.89, samples=233 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6348KiB/119543msec); 0 zone resets clat (usec): min=676, max=876534, avg=34009.16, stdev=42150.80 lat (usec): min=676, max=876536, avg=34011.42, stdev=42150.89 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1156], 10.00th=[ 1270], 20.00th=[ 2769], | 30.00th=[ 6456], 40.00th=[ 13960], 50.00th=[ 23462], 60.00th=[ 31065], | 70.00th=[ 41681], 80.00th=[ 56886], 90.00th=[ 85459], 95.00th=[109577], | 99.00th=[154141], 99.50th=[181404], 99.90th=[283116], 99.95th=[876610], | 99.99th=[876610] bw ( KiB/s): min= 7, max= 136, per=24.91%, avg=52.30, stdev=25.27, samples=234 iops : min= 1, max= 34, avg=12.44, stdev= 6.36, samples=234 lat (usec) : 50=0.29%, 100=1.17%, 750=0.13%, 1000=0.26% lat (msec) : 2=8.17%, 4=4.10%, 10=6.61%, 20=10.19%, 50=41.34% lat (msec) : 100=22.07%, 250=5.50%, 500=0.13%, 1000=0.03% cpu : usr=0.09%, sys=5.01%, ctx=6028, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179245: Thu Sep 17 19:59:20 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6028KiB/118851msec) clat (usec): min=37, max=255436, avg=43136.70, stdev=30234.25 lat (usec): min=37, max=255436, avg=43137.92, stdev=30234.19 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 10028], 10.00th=[ 15664], 20.00th=[ 21103], | 30.00th=[ 25822], 40.00th=[ 30540], 50.00th=[ 35914], 60.00th=[ 42206], | 70.00th=[ 49546], 80.00th=[ 61604], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[156238], 99.50th=[185598], 99.90th=[225444], 99.95th=[254804], | 99.99th=[254804] bw ( KiB/s): min= 7, max= 112, per=25.25%, avg=50.49, stdev=20.04, samples=232 iops : min= 1, max= 28, avg=11.98, stdev= 5.06, samples=232 write: IOPS=13, BW=52.7KiB/s (53.9kB/s)(6260KiB/118851msec); 0 zone resets clat (usec): min=695, max=903626, avg=34117.94, stdev=41212.17 lat (usec): min=696, max=903627, avg=34121.74, stdev=41211.09 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1270], 20.00th=[ 2769], | 30.00th=[ 6587], 40.00th=[ 14353], 50.00th=[ 22938], 60.00th=[ 32637], | 70.00th=[ 44827], 80.00th=[ 60556], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[152044], 99.50th=[166724], 99.90th=[200279], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 111, per=24.83%, avg=52.13, stdev=22.18, samples=233 iops : min= 1, max= 27, avg=12.39, stdev= 5.58, samples=233 lat (usec) : 50=0.46%, 100=1.56%, 250=0.13%, 750=0.10%, 1000=0.26% lat (msec) : 2=8.17%, 4=3.71%, 10=5.99%, 20=11.52%, 50=40.62% lat (msec) : 100=22.30%, 250=5.11%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.15%, ctx=6077, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179247: Thu Sep 17 19:59:20 2026 read: IOPS=12, BW=51.4KiB/s (52.7kB/s)(6052KiB/117702msec) clat (usec): min=32, max=273357, avg=43210.13, stdev=29628.01 lat (usec): min=32, max=273359, avg=43211.63, stdev=29628.45 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 11469], 10.00th=[ 15533], 20.00th=[ 21365], | 30.00th=[ 25822], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 50594], 80.00th=[ 61080], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[177210], 99.90th=[242222], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 7, max= 103, per=25.88%, avg=51.75, stdev=19.59, samples=228 iops : min= 1, max= 25, avg=12.30, stdev= 4.95, samples=228 write: IOPS=13, BW=52.0KiB/s (54.3kB/s)(6236KiB/117702msec); 0 zone resets clat (usec): min=858, max=958900, avg=33273.71, stdev=42376.37 lat (usec): min=860, max=958903, avg=33277.89, stdev=42375.45 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1369], 20.00th=[ 3097], | 30.00th=[ 6325], 40.00th=[ 13566], 50.00th=[ 22152], 60.00th=[ 31589], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 79168], 95.00th=[105382], | 99.00th=[160433], 99.50th=[181404], 99.90th=[212861], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 7, max= 132, per=25.14%, avg=52.80, stdev=22.44, samples=230 iops : min= 1, max= 33, avg=12.57, stdev= 5.68, samples=230 lat (usec) : 50=0.26%, 100=1.37%, 250=0.07%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=7.29%, 4=4.39%, 10=6.67%, 20=12.17%, 50=40.72% lat (msec) : 100=21.71%, 250=4.98%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.11%, ctx=6158, majf=0, minf=20 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=201KiB/s (206kB/s), 49.7KiB/s-51.4KiB/s (50.9kB/s-52.7kB/s), io=23.4MiB (24.6MB), run=117702-119543msec WRITE: bw=210KiB/s (215kB/s), 52.7KiB/s-53.4KiB/s (53.9kB/s-54.7kB/s), io=24.6MiB (25.7MB), run=117702-119543msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179242: Thu Sep 17 19:59:57 2026 read: IOPS=9, BW=38.4KiB/s (39.4kB/s)(5992KiB/155857msec) clat (msec): min=5, max=972, avg=40.36, stdev=46.65 lat (msec): min=5, max=972, avg=40.36, stdev=46.65 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 96], 95.00th=[ 124], | 99.00th=[ 199], 99.50th=[ 226], 99.90th=[ 363], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 143, per=25.67%, avg=39.28, stdev=28.20, samples=297 iops : min= 1, max= 35, avg= 9.18, stdev= 7.08, samples=297 write: IOPS=10, BW=40.4KiB/s (41.4kB/s)(6296KiB/155857msec); 0 zone resets clat (msec): min=9, max=354, avg=60.35, stdev=45.85 lat (msec): min=9, max=354, avg=60.35, stdev=45.85 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 53], | 70.00th=[ 70], 80.00th=[ 91], 90.00th=[ 118], 95.00th=[ 155], | 99.00th=[ 230], 99.50th=[ 271], 99.90th=[ 296], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 127, per=25.47%, avg=40.76, stdev=27.39, samples=301 iops : min= 1, max= 31, avg= 9.54, stdev= 6.88, samples=301 lat (msec) : 10=4.04%, 20=18.29%, 50=44.24%, 100=20.74%, 250=12.24% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=1.75%, ctx=4823, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179244: Thu Sep 17 19:59:57 2026 read: IOPS=9, BW=37.9KiB/s (38.8kB/s)(5940KiB/156606msec) clat (msec): min=5, max=907, avg=41.43, stdev=47.37 lat (msec): min=5, max=907, avg=41.43, stdev=47.36 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 61], 90.00th=[ 97], 95.00th=[ 130], | 99.00th=[ 194], 99.50th=[ 241], 99.90th=[ 321], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 133, per=24.62%, avg=37.66, stdev=28.63, samples=305 iops : min= 1, max= 33, avg= 8.77, stdev= 7.20, samples=305 write: IOPS=10, BW=40.5KiB/s (41.5kB/s)(6348KiB/156606msec); 0 zone resets clat (msec): min=8, max=363, avg=59.67, stdev=44.90 lat (msec): min=8, max=363, avg=59.67, stdev=44.90 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 43], 60.00th=[ 54], | 70.00th=[ 68], 80.00th=[ 89], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 226], 99.50th=[ 255], 99.90th=[ 296], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 159, per=25.03%, avg=40.04, stdev=27.60, samples=306 iops : min= 1, max= 39, avg= 9.36, stdev= 6.93, samples=306 lat (msec) : 10=3.61%, 20=19.79%, 50=43.23%, 100=20.93%, 250=11.95% lat (msec) : 500=0.46%, 1000=0.03% cpu : usr=0.06%, sys=1.72%, ctx=4840, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179246: Thu Sep 17 19:59:57 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6028KiB/155795msec) clat (msec): min=4, max=343, avg=39.71, stdev=39.24 lat (msec): min=4, max=343, avg=39.71, stdev=39.24 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 57], 90.00th=[ 93], 95.00th=[ 123], | 99.00th=[ 176], 99.50th=[ 222], 99.90th=[ 300], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 151, per=25.78%, avg=39.45, stdev=27.09, samples=298 iops : min= 1, max= 37, avg= 9.22, stdev= 6.82, samples=298 write: IOPS=10, BW=40.2KiB/s (41.1kB/s)(6260KiB/155795msec); 0 zone resets clat (msec): min=10, max=913, avg=61.05, stdev=49.03 lat (msec): min=10, max=913, avg=61.06, stdev=49.03 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 44], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 92], 90.00th=[ 124], 95.00th=[ 150], | 99.00th=[ 215], 99.50th=[ 236], 99.90th=[ 296], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 143, per=25.08%, avg=40.13, stdev=27.29, samples=304 iops : min= 1, max= 35, avg= 9.39, stdev= 6.87, samples=304 lat (msec) : 10=3.52%, 20=18.46%, 50=44.08%, 100=21.29%, 250=12.30% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.79%, ctx=4830, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179248: Thu Sep 17 19:59:57 2026 read: IOPS=9, BW=38.8KiB/s (39.7kB/s)(6052KiB/156056msec) clat (msec): min=4, max=324, avg=39.08, stdev=40.14 lat (msec): min=4, max=324, avg=39.08, stdev=40.14 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 90], 95.00th=[ 121], | 99.00th=[ 209], 99.50th=[ 239], 99.90th=[ 313], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 151, per=26.02%, avg=39.81, stdev=28.84, samples=295 iops : min= 1, max= 37, avg= 9.31, stdev= 7.24, samples=295 write: IOPS=9, BW=39.0KiB/s (40.9kB/s)(6236KiB/156056msec); 0 zone resets clat (msec): min=9, max=951, avg=61.92, stdev=50.91 lat (msec): min=9, max=951, avg=61.92, stdev=50.91 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 226], 99.50th=[ 247], 99.90th=[ 355], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 135, per=24.86%, avg=39.78, stdev=26.65, samples=304 iops : min= 1, max= 33, avg= 9.30, stdev= 6.70, samples=304 lat (msec) : 10=4.17%, 20=18.98%, 50=43.36%, 100=20.96%, 250=12.17% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.05%, sys=1.69%, ctx=4784, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=153KiB/s (157kB/s), 37.9KiB/s-38.8KiB/s (38.8kB/s-39.7kB/s), io=23.4MiB (24.6MB), run=155795-156606msec WRITE: bw=161KiB/s (164kB/s), 39.0KiB/s-40.5KiB/s (40.9kB/s-41.5kB/s), io=24.6MiB (25.7MB), run=155795-156606msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179296: Thu Sep 17 20:00:38 2026 read: IOPS=13, BW=222KiB/s (227kB/s)(5920KiB/26666msec) clat (usec): min=38, max=334391, avg=38243.02, stdev=31549.12 lat (usec): min=38, max=334392, avg=38244.51, stdev=31548.68 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 73], 20.00th=[ 17957], | 30.00th=[ 23987], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 46400], 80.00th=[ 54264], 90.00th=[ 71828], 95.00th=[ 86508], | 99.00th=[156238], 99.50th=[200279], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 31, max= 411, per=27.82%, avg=221.46, stdev=79.47, samples=52 iops : min= 1, max= 25, avg=13.08, stdev= 5.08, samples=52 write: IOPS=14, BW=239KiB/s (245kB/s)(6368KiB/26666msec); 0 zone resets clat (usec): min=1165, max=140417, avg=31227.11, stdev=30848.23 lat (usec): min=1165, max=140419, avg=31229.20, stdev=30848.36 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1795], 10.00th=[ 2606], 20.00th=[ 4686], | 30.00th=[ 7504], 40.00th=[ 12518], 50.00th=[ 20055], 60.00th=[ 30278], | 70.00th=[ 42206], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[126354], 99.50th=[135267], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 31, max= 412, per=28.50%, avg=238.58, stdev=85.68, samples=52 iops : min= 1, max= 25, avg=14.15, stdev= 5.43, samples=52 lat (usec) : 50=0.26%, 100=5.86%, 250=0.65%, 500=0.13% lat (msec) : 2=3.52%, 4=5.73%, 10=8.85%, 20=11.85%, 50=38.80% lat (msec) : 100=21.35%, 250=2.86%, 500=0.13% cpu : usr=0.07%, sys=6.16%, ctx=1513, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179298: Thu Sep 17 20:00:38 2026 read: IOPS=12, BW=206KiB/s (211kB/s)(5744KiB/27857msec) clat (usec): min=33, max=156745, avg=40372.69, stdev=26891.73 lat (usec): min=33, max=156746, avg=40373.83, stdev=26891.76 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 62], 10.00th=[ 91], 20.00th=[ 20579], | 30.00th=[ 26870], 40.00th=[ 33817], 50.00th=[ 38011], 60.00th=[ 42730], | 70.00th=[ 50070], 80.00th=[ 60556], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[135267], 99.50th=[149947], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 21, max= 352, per=25.99%, avg=206.89, stdev=84.13, samples=54 iops : min= 1, max= 22, avg=12.15, stdev= 5.31, samples=54 write: IOPS=14, BW=235KiB/s (241kB/s)(6544KiB/27857msec); 0 zone resets clat (usec): min=1380, max=179451, avg=31599.04, stdev=30890.71 lat (usec): min=1382, max=179453, avg=31601.10, stdev=30890.70 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1778], 10.00th=[ 2606], 20.00th=[ 5669], | 30.00th=[ 9503], 40.00th=[ 14877], 50.00th=[ 22938], 60.00th=[ 29230], | 70.00th=[ 40109], 80.00th=[ 54789], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[132645], 99.50th=[149947], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 62, max= 446, per=28.09%, avg=235.07, stdev=89.62, samples=54 iops : min= 3, max= 27, avg=13.93, stdev= 5.62, samples=54 lat (usec) : 50=0.39%, 100=4.30%, 250=0.39%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.78%, 4=4.30%, 10=9.24%, 20=10.42%, 50=41.15% lat (msec) : 100=22.27%, 250=3.39% cpu : usr=0.06%, sys=6.23%, ctx=1580, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179300: Thu Sep 17 20:00:38 2026 read: IOPS=12, BW=208KiB/s (213kB/s)(6256KiB/30080msec) clat (usec): min=40, max=276749, avg=43040.63, stdev=30538.98 lat (usec): min=40, max=276750, avg=43041.75, stdev=30538.97 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 67], 10.00th=[ 11338], 20.00th=[ 22938], | 30.00th=[ 29492], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 43254], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 72877], 95.00th=[ 88605], | 99.00th=[158335], 99.50th=[202376], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 380, per=26.25%, avg=208.93, stdev=71.94, samples=58 iops : min= 3, max= 23, avg=12.26, stdev= 4.53, samples=58 write: IOPS=12, BW=201KiB/s (205kB/s)(6032KiB/30080msec); 0 zone resets clat (usec): min=1411, max=225952, avg=34225.49, stdev=31683.11 lat (usec): min=1413, max=225953, avg=34227.51, stdev=31683.10 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 1762], 10.00th=[ 2147], 20.00th=[ 5407], | 30.00th=[ 10683], 40.00th=[ 19006], 50.00th=[ 27132], 60.00th=[ 35390], | 70.00th=[ 43779], 80.00th=[ 58459], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[133694], 99.50th=[166724], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 63, max= 472, per=23.65%, avg=197.91, stdev=84.88, samples=58 iops : min= 3, max= 29, avg=11.59, stdev= 5.42, samples=58 lat (usec) : 50=0.52%, 100=3.52%, 250=0.52%, 750=0.13% lat (msec) : 2=4.69%, 4=3.52%, 10=6.25%, 20=8.85%, 50=43.49% lat (msec) : 100=24.87%, 250=3.52%, 500=0.13% cpu : usr=0.08%, sys=5.82%, ctx=1703, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179301: Thu Sep 17 20:00:38 2026 read: IOPS=13, BW=216KiB/s (221kB/s)(6032KiB/27980msec) clat (usec): min=38, max=351547, avg=41207.20, stdev=33404.27 lat (usec): min=39, max=351548, avg=41208.44, stdev=33404.27 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 18482], | 30.00th=[ 24773], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 51643], 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[ 94897], | 99.00th=[145753], 99.50th=[152044], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 31, max= 503, per=28.15%, avg=224.04, stdev=84.06, samples=52 iops : min= 1, max= 31, avg=13.23, stdev= 5.31, samples=52 write: IOPS=13, BW=224KiB/s (229kB/s)(6256KiB/27980msec); 0 zone resets clat (usec): min=1144, max=210092, avg=30721.62, stdev=31249.27 lat (usec): min=1144, max=210095, avg=30727.59, stdev=31251.89 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1827], 10.00th=[ 2638], 20.00th=[ 4359], | 30.00th=[ 8356], 40.00th=[ 12911], 50.00th=[ 20317], 60.00th=[ 30016], | 70.00th=[ 40109], 80.00th=[ 52691], 90.00th=[ 72877], 95.00th=[ 91751], | 99.00th=[141558], 99.50th=[152044], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 62, max= 538, per=26.61%, avg=222.69, stdev=99.91, samples=54 iops : min= 3, max= 33, avg=13.13, stdev= 6.33, samples=54 lat (usec) : 50=0.65%, 100=5.73%, 250=0.65%, 500=0.13% lat (msec) : 2=3.52%, 4=6.25%, 10=8.33%, 20=11.20%, 50=36.20% lat (msec) : 100=23.96%, 250=3.26%, 500=0.13% cpu : usr=0.07%, sys=5.92%, ctx=1539, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=796KiB/s (815kB/s), 206KiB/s-222KiB/s (211kB/s-227kB/s), io=23.4MiB (24.5MB), run=26666-30080msec WRITE: bw=838KiB/s (858kB/s), 201KiB/s-239KiB/s (205kB/s-245kB/s), io=24.6MiB (25.8MB), run=26666-30080msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179294: Thu Sep 17 20:00:51 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(5920KiB/42930msec) clat (msec): min=8, max=246, avg=42.39, stdev=32.33 lat (msec): min=8, max=246, avg=42.40, stdev=32.33 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 58], 90.00th=[ 82], 95.00th=[ 111], | 99.00th=[ 174], 99.50th=[ 192], 99.90th=[ 247], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 31, max= 534, per=25.35%, avg=141.21, stdev=78.76, samples=81 iops : min= 1, max= 33, avg= 8.04, stdev= 4.98, samples=81 write: IOPS=9, BW=148KiB/s (152kB/s)(6368KiB/42930msec); 0 zone resets clat (msec): min=15, max=366, avg=67.67, stdev=42.06 lat (msec): min=15, max=366, avg=67.68, stdev=42.06 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 57], 60.00th=[ 67], | 70.00th=[ 79], 80.00th=[ 94], 90.00th=[ 115], 95.00th=[ 148], | 99.00th=[ 241], 99.50th=[ 268], 99.90th=[ 368], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 31, max= 320, per=25.11%, avg=147.37, stdev=68.83, samples=84 iops : min= 1, max= 20, avg= 8.43, stdev= 4.40, samples=84 lat (msec) : 10=0.52%, 20=10.16%, 50=44.79%, 100=32.81%, 250=11.46% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.75%, ctx=1174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179295: Thu Sep 17 20:00:51 2026 read: IOPS=8, BW=134KiB/s (137kB/s)(5744KiB/42844msec) clat (msec): min=6, max=196, avg=42.16, stdev=31.15 lat (msec): min=6, max=196, avg=42.17, stdev=31.15 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 62], 90.00th=[ 86], 95.00th=[ 112], | 99.00th=[ 150], 99.50th=[ 180], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 21, max= 565, per=24.29%, avg=135.29, stdev=93.99, samples=83 iops : min= 1, max= 35, avg= 7.66, stdev= 5.97, samples=83 write: IOPS=9, BW=153KiB/s (156kB/s)(6544KiB/42844msec); 0 zone resets clat (msec): min=13, max=364, avg=66.97, stdev=43.88 lat (msec): min=13, max=364, avg=66.98, stdev=43.88 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 64], | 70.00th=[ 77], 80.00th=[ 95], 90.00th=[ 123], 95.00th=[ 157], | 99.00th=[ 220], 99.50th=[ 251], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 31, max= 345, per=25.99%, avg=152.56, stdev=76.11, samples=84 iops : min= 1, max= 21, avg= 8.75, stdev= 4.85, samples=84 lat (msec) : 10=1.56%, 20=10.55%, 50=45.18%, 100=30.08%, 250=12.24% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.90%, ctx=1235, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179297: Thu Sep 17 20:00:51 2026 read: IOPS=9, BW=148KiB/s (152kB/s)(6256KiB/42147msec) clat (msec): min=7, max=247, avg=44.17, stdev=31.38 lat (msec): min=7, max=247, avg=44.18, stdev=31.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 52], 80.00th=[ 65], 90.00th=[ 84], 95.00th=[ 105], | 99.00th=[ 157], 99.50th=[ 174], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 440, per=27.38%, avg=152.52, stdev=85.90, samples=80 iops : min= 1, max= 27, avg= 8.75, stdev= 5.45, samples=80 write: IOPS=8, BW=143KiB/s (147kB/s)(6032KiB/42147msec); 0 zone resets clat (msec): min=13, max=294, avg=65.81, stdev=38.60 lat (msec): min=13, max=294, avg=65.82, stdev=38.60 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 67], | 70.00th=[ 78], 80.00th=[ 97], 90.00th=[ 123], 95.00th=[ 138], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 408, per=23.96%, avg=140.65, stdev=74.53, samples=82 iops : min= 1, max= 25, avg= 8.00, stdev= 4.75, samples=82 lat (msec) : 10=1.30%, 20=9.64%, 50=45.05%, 100=31.51%, 250=12.37% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.86%, ctx=1141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179299: Thu Sep 17 20:00:51 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(6032KiB/41863msec) clat (msec): min=6, max=181, avg=42.84, stdev=29.73 lat (msec): min=6, max=181, avg=42.84, stdev=29.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 57], 90.00th=[ 85], 95.00th=[ 109], | 99.00th=[ 148], 99.50th=[ 174], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 31, max= 413, per=25.74%, avg=143.35, stdev=76.98, samples=82 iops : min= 1, max= 25, avg= 8.15, stdev= 4.87, samples=82 write: IOPS=9, BW=149KiB/s (153kB/s)(6256KiB/41863msec); 0 zone resets clat (msec): min=15, max=289, avg=64.86, stdev=37.31 lat (msec): min=15, max=289, avg=64.86, stdev=37.31 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 55], 60.00th=[ 64], | 70.00th=[ 75], 80.00th=[ 93], 90.00th=[ 121], 95.00th=[ 140], | 99.00th=[ 169], 99.50th=[ 203], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 534, per=25.50%, avg=149.66, stdev=80.23, samples=82 iops : min= 1, max= 33, avg= 8.57, stdev= 5.11, samples=82 lat (msec) : 10=1.04%, 20=8.85%, 50=47.79%, 100=30.47%, 250=11.72% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=1.84%, ctx=1189, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=558KiB/s (571kB/s), 134KiB/s-148KiB/s (137kB/s-152kB/s), io=23.4MiB (24.5MB), run=41863-42930msec WRITE: bw=587KiB/s (601kB/s), 143KiB/s-153KiB/s (147kB/s-156kB/s), io=24.6MiB (25.8MB), run=41863-42930msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179313: Thu Sep 17 20:01:09 2026 read: IOPS=0, BW=851KiB/s (871kB/s)(7168KiB/8426msec) clat (usec): min=1114, max=3870.9k, avg=988488.63, stdev=1505629.52 lat (usec): min=1116, max=3870.9k, avg=988490.03, stdev=1505629.82 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1123], 10.00th=[ 1123], | 20.00th=[ 1483], 30.00th=[ 189793], 40.00th=[ 189793], | 50.00th=[ 242222], 60.00th=[ 320865], 70.00th=[ 320865], | 80.00th=[2298479], 90.00th=[3875537], 95.00th=[3875537], | 99.00th=[3875537], 99.50th=[3875537], 99.90th=[3875537], | 99.95th=[3875537], 99.99th=[3875537] bw ( KiB/s): min= 1939, max= 4039, per=99.58%, avg=2419.80, stdev=906.22, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=608KiB/s (622kB/s)(5120KiB/8426msec); 0 zone resets clat (msec): min=109, max=398, avg=252.15, stdev=111.83 lat (msec): min=109, max=398, avg=252.23, stdev=111.84 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 397], 95.00th=[ 397], | 99.00th=[ 397], 99.50th=[ 397], 99.90th=[ 397], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 2039, max= 4087, per=98.02%, avg=3334.67, stdev=1126.94, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 2=16.67%, 250=33.33%, 500=33.33%, >=2000=16.67% cpu : usr=0.02%, sys=5.64%, ctx=740, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179315: Thu Sep 17 20:01:09 2026 read: IOPS=0, BW=243KiB/s (249kB/s)(2048KiB/8417msec) clat (msec): min=149, max=231, avg=190.78, stdev=57.82 lat (msec): min=149, max=231, avg=190.78, stdev=57.82 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 150], | 30.00th=[ 150], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 1892, max= 2039, per=80.88%, avg=1965.50, stdev=103.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1217KiB/s (1246kB/s)(10.0MiB/8417msec); 0 zone resets clat (msec): min=147, max=4471, avg=791.74, stdev=1302.93 lat (msec): min=147, max=4471, avg=791.83, stdev=1302.93 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 192], | 30.00th=[ 317], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 363], | 70.00th=[ 498], 80.00th=[ 625], 90.00th=[ 634], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 1976, max= 4007, per=75.71%, avg=2575.71, stdev=934.75, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=6.50%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179316: Thu Sep 17 20:01:09 2026 read: IOPS=0, BW=815KiB/s (835kB/s)(6144KiB/7538msec) clat (usec): min=486, max=275678, avg=99695.27, stdev=122948.89 lat (usec): min=488, max=275680, avg=99696.66, stdev=122949.13 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 1369], | 30.00th=[ 1369], 40.00th=[ 22676], 50.00th=[ 22676], 60.00th=[ 64226], | 70.00th=[233833], 80.00th=[233833], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 4007, max= 4096, per=100.00%, avg=4051.50, stdev=62.93, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=0, BW=815KiB/s (835kB/s)(6144KiB/7538msec); 0 zone resets clat (msec): min=273, max=4157, avg=1118.73, stdev=1515.07 lat (msec): min=273, max=4157, avg=1119.33, stdev=1515.00 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 617], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 4144], 95.00th=[ 4144], | 99.00th=[ 4144], 99.50th=[ 4144], 99.90th=[ 4144], 99.95th=[ 4144], | 99.99th=[ 4144] bw ( KiB/s): min= 2003, max= 2048, per=59.71%, avg=2031.20, stdev=16.98, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33% lat (msec) : 2=8.33%, 50=8.33%, 100=8.33%, 250=8.33%, 500=33.33% lat (msec) : 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.64%, ctx=141, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179317: Thu Sep 17 20:01:09 2026 read: IOPS=0, BW=705KiB/s (722kB/s)(5120KiB/7263msec) clat (usec): min=476, max=166473, avg=67573.63, stdev=89941.68 lat (usec): min=477, max=166474, avg=67574.74, stdev=89941.84 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 478], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 4752], 60.00th=[ 4752], | 70.00th=[166724], 80.00th=[166724], 90.00th=[166724], 95.00th=[166724], | 99.00th=[166724], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 2043, max= 6119, per=100.00%, avg=4081.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=0, BW=987KiB/s (1011kB/s)(7168KiB/7263msec); 0 zone resets clat (msec): min=228, max=3884, avg=963.70, stdev=1309.74 lat (msec): min=228, max=3885, avg=964.02, stdev=1309.67 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 264], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 460], 60.00th=[ 600], | 70.00th=[ 600], 80.00th=[ 927], 90.00th=[ 3876], 95.00th=[ 3876], | 99.00th=[ 3876], 99.50th=[ 3876], 99.90th=[ 3876], 99.95th=[ 3876], | 99.99th=[ 3876] bw ( KiB/s): min= 1973, max= 2048, per=59.32%, avg=2018.20, stdev=33.60, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=5.77%, ctx=179, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2431KiB/s (2489kB/s), 243KiB/s-851KiB/s (249kB/s-871kB/s), io=20.0MiB (20.0MB), run=7263-8426msec WRITE: bw=3403KiB/s (3484kB/s), 608KiB/s-1217KiB/s (622kB/s-1246kB/s), io=28.0MiB (29.4MB), run=7263-8426msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179329: Thu Sep 17 20:01:10 2026 read: IOPS=0, BW=830KiB/s (850kB/s)(7168KiB/8634msec) clat (msec): min=95, max=3609, avg=1017.74, stdev=1318.02 lat (msec): min=95, max=3609, avg=1017.75, stdev=1318.02 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 111], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 228], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1770], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 2019, max= 4047, per=100.00%, avg=2535.00, stdev=1008.05, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=593KiB/s (607kB/s)(5120KiB/8634msec); 0 zone resets clat (msec): min=180, max=540, avg=281.28, stdev=150.13 lat (msec): min=180, max=540, avg=282.09, stdev=150.10 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 180], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1957, max= 4087, per=80.99%, avg=2689.00, stdev=1211.15, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=8.33%, 2000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.97%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179330: Thu Sep 17 20:01:10 2026 read: IOPS=0, BW=243KiB/s (249kB/s)(2048KiB/8429msec) clat (msec): min=99, max=719, avg=409.55, stdev=438.73 lat (msec): min=99, max=719, avg=409.55, stdev=438.73 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 100], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 100], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 2023, max= 2043, per=85.71%, avg=2033.00, stdev=14.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1215KiB/s (1244kB/s)(10.0MiB/8429msec); 0 zone resets clat (msec): min=103, max=4528, avg=759.55, stdev=1337.00 lat (msec): min=103, max=4528, avg=759.64, stdev=1337.00 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 132], | 30.00th=[ 155], 40.00th=[ 279], 50.00th=[ 326], 60.00th=[ 388], | 70.00th=[ 472], 80.00th=[ 550], 90.00th=[ 667], 95.00th=[ 4530], | 99.00th=[ 4530], 99.50th=[ 4530], 99.90th=[ 4530], 99.95th=[ 4530], | 99.99th=[ 4530] bw ( KiB/s): min= 1988, max= 6131, per=100.00%, avg=3649.60, stdev=1725.25, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=1.99%, ctx=76, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179331: Thu Sep 17 20:01:10 2026 read: IOPS=0, BW=744KiB/s (762kB/s)(6144KiB/8258msec) clat (msec): min=126, max=457, avg=253.19, stdev=130.55 lat (msec): min=126, max=457, avg=253.19, stdev=130.55 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 309], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 460], 95.00th=[ 460], | 99.00th=[ 460], 99.50th=[ 460], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 1954, max= 2043, per=84.54%, avg=2005.40, stdev=35.06, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=744KiB/s (762kB/s)(6144KiB/8258msec); 0 zone resets clat (msec): min=88, max=4334, avg=1098.94, stdev=1609.49 lat (msec): min=88, max=4334, avg=1099.06, stdev=1609.50 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 535], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 2035, max= 3908, per=72.70%, avg=2413.80, stdev=835.30, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=1.85%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179332: Thu Sep 17 20:01:10 2026 read: IOPS=0, BW=635KiB/s (651kB/s)(5120KiB/8059msec) clat (msec): min=59, max=421, avg=149.87, stdev=152.74 lat (msec): min=59, max=421, avg=149.87, stdev=152.74 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 60], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 84], 60.00th=[ 84], | 70.00th=[ 104], 80.00th=[ 104], 90.00th=[ 422], 95.00th=[ 422], | 99.00th=[ 422], 99.50th=[ 422], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 1988, max= 4063, per=100.00%, avg=2691.33, stdev=1188.03, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=0, BW=889KiB/s (911kB/s)(7168KiB/8059msec); 0 zone resets clat (msec): min=166, max=4377, avg=1038.26, stdev=1490.71 lat (msec): min=166, max=4377, avg=1038.46, stdev=1490.66 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 330], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 460], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 877], 90.00th=[ 4396], 95.00th=[ 4396], | 99.00th=[ 4396], 99.50th=[ 4396], 99.90th=[ 4396], 99.95th=[ 4396], | 99.99th=[ 4396] bw ( KiB/s): min= 1957, max= 3976, per=72.40%, avg=2403.60, stdev=879.59, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=25.00%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.52%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2372KiB/s (2429kB/s), 243KiB/s-830KiB/s (249kB/s-850kB/s), io=20.0MiB (20.0MB), run=8059-8634msec WRITE: bw=3321KiB/s (3401kB/s), 593KiB/s-1215KiB/s (607kB/s-1244kB/s), io=28.0MiB (29.4MB), run=8059-8634msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179339: Thu Sep 17 20:01:28 2026 read: IOPS=1, BW=5956KiB/s (6099kB/s)(12.0MiB/2063msec) clat (msec): min=462, max=880, avg=650.75, stdev=211.93 lat (msec): min=462, max=880, avg=650.75, stdev=211.93 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7772, max= 8175, per=100.00%, avg=7973.50, stdev=284.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.24%, sys=5.00%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179340: Thu Sep 17 20:01:28 2026 read: IOPS=0, BW=1850KiB/s (1894kB/s)(4096KiB/2214msec) clat (nsec): min=301058k, max=301058k, avg=301057564.00, stdev= 0.00 lat (nsec): min=301060k, max=301060k, avg=301060404.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 300], 95.00th=[ 300], | 99.00th=[ 300], 99.50th=[ 300], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7713, max= 7713, per=100.00%, avg=7713.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3700KiB/s (3789kB/s)(8192KiB/2214msec); 0 zone resets clat (msec): min=526, max=1267, avg=896.76, stdev=523.91 lat (msec): min=526, max=1267, avg=897.13, stdev=523.79 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 1267], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7772, max= 7772, per=91.59%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.44%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179341: Thu Sep 17 20:01:28 2026 write: IOPS=0, BW=3183KiB/s (3259kB/s)(12.0MiB/3861msec); 0 zone resets clat (msec): min=366, max=2285, avg=1264.68, stdev=965.07 lat (msec): min=367, max=2285, avg=1265.25, stdev=964.93 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 7801, max= 7968, per=92.91%, avg=7884.50, stdev=118.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=2.38%, ctx=56, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179342: Thu Sep 17 20:01:28 2026 write: IOPS=1, BW=4298KiB/s (4401kB/s)(12.0MiB/2859msec); 0 zone resets clat (msec): min=400, max=1816, avg=924.06, stdev=776.68 lat (msec): min=416, max=1820, avg=930.85, stdev=773.47 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 5595, max= 7801, per=78.93%, avg=6698.00, stdev=1559.88, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.14%, sys=2.83%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7400KiB/s (7578kB/s), 1850KiB/s-5956KiB/s (1894kB/s-6099kB/s), io=16.0MiB (16.8MB), run=2063-2214msec WRITE: bw=8487KiB/s (8691kB/s), 3183KiB/s-4298KiB/s (3259kB/s-4401kB/s), io=32.0MiB (33.6MB), run=2214-3861msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179344: Thu Sep 17 20:01:28 2026 read: IOPS=1, BW=5200KiB/s (5325kB/s)(12.0MiB/2363msec) clat (msec): min=735, max=850, avg=787.13, stdev=58.29 lat (msec): min=735, max=850, avg=787.13, stdev=58.29 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 7953, max= 8015, per=100.00%, avg=7984.00, stdev=43.84, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=12.91%, ctx=559, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179345: Thu Sep 17 20:01:28 2026 read: IOPS=0, BW=1355KiB/s (1387kB/s)(4096KiB/3023msec) clat (nsec): min=952404k, max=952404k, avg=952404411.00, stdev= 0.00 lat (nsec): min=952406k, max=952406k, avg=952405882.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2710KiB/s (2775kB/s)(8192KiB/3023msec); 0 zone resets clat (msec): min=659, max=1409, avg=1034.25, stdev=530.02 lat (msec): min=659, max=1409, avg=1034.69, stdev=530.01 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8126, max= 8126, per=84.96%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=2.51%, ctx=183, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179346: Thu Sep 17 20:01:28 2026 write: IOPS=0, BW=3587KiB/s (3673kB/s)(12.0MiB/3426msec); 0 zone resets clat (msec): min=197, max=1918, avg=1139.82, stdev=872.27 lat (msec): min=197, max=1922, avg=1141.38, stdev=873.77 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 1301], 50.00th=[ 1301], 60.00th=[ 1301], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 7892, max= 8192, per=84.09%, avg=8042.00, stdev=212.13, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.87%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179347: Thu Sep 17 20:01:28 2026 write: IOPS=1, BW=5799KiB/s (5938kB/s)(12.0MiB/2119msec); 0 zone resets clat (msec): min=304, max=1149, avg=683.06, stdev=428.96 lat (msec): min=305, max=1149, avg=683.50, stdev=429.00 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 6068, max= 6068, per=63.45%, avg=6068.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.29%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5420KiB/s (5550kB/s), 1355KiB/s-5200KiB/s (1387kB/s-5325kB/s), io=16.0MiB (16.8MB), run=2363-3023msec WRITE: bw=9565KiB/s (9794kB/s), 2710KiB/s-5799KiB/s (2775kB/s-5938kB/s), io=32.0MiB (33.6MB), run=2119-3426msec