== sanity test 398b: DIO and buffer IO race ============== 11:29:23 (1789140563) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.29997 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144491: Fri Sep 11 11:32:18 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(5992KiB/152908msec) clat (usec): min=33, max=1089.8k, avg=50253.24, stdev=51280.16 lat (usec): min=34, max=1089.8k, avg=50256.43, stdev=51280.40 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 97], | 20.00th=[ 20579], 30.00th=[ 28705], 40.00th=[ 34866], | 50.00th=[ 41681], 60.00th=[ 49546], 70.00th=[ 61604], | 80.00th=[ 74974], 90.00th=[ 93848], 95.00th=[ 116917], | 99.00th=[ 191890], 99.50th=[ 267387], 99.90th=[ 683672], | 99.95th=[1082131], 99.99th=[1082131] bw ( KiB/s): min= 7, max= 118, per=25.12%, avg=39.19, stdev=18.71, samples=297 iops : min= 1, max= 29, avg= 9.15, stdev= 4.72, samples=297 write: IOPS=10, BW=41.2KiB/s (42.2kB/s)(6296KiB/152908msec); 0 zone resets clat (usec): min=774, max=423591, avg=49159.67, stdev=50217.41 lat (usec): min=775, max=423593, avg=49172.15, stdev=50211.71 clat percentiles (usec): | 1.00th=[ 1172], 5.00th=[ 1319], 10.00th=[ 1958], 20.00th=[ 5538], | 30.00th=[ 10683], 40.00th=[ 23462], 50.00th=[ 36439], 60.00th=[ 49021], | 70.00th=[ 64226], 80.00th=[ 85459], 90.00th=[115868], 95.00th=[147850], | 99.00th=[227541], 99.50th=[252707], 99.90th=[304088], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 7, max= 158, per=25.17%, avg=41.03, stdev=18.76, samples=298 iops : min= 1, max= 39, avg= 9.62, stdev= 4.74, samples=298 lat (usec) : 50=0.36%, 100=4.69%, 250=0.39%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=5.37%, 4=2.96%, 10=6.77%, 20=7.98%, 50=31.77% lat (msec) : 100=28.42%, 250=10.58%, 500=0.49%, 750=0.03%, 2000=0.03% cpu : usr=0.09%, sys=4.94%, ctx=6546, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144492: Fri Sep 11 11:32:18 2026 read: IOPS=9, BW=38.6KiB/s (39.6kB/s)(5940KiB/153715msec) clat (usec): min=36, max=999142, avg=50734.57, stdev=45874.59 lat (usec): min=36, max=999143, avg=50736.53, stdev=45875.16 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 523], | 20.00th=[ 22676], 30.00th=[ 29230], 40.00th=[ 34866], | 50.00th=[ 42206], 60.00th=[ 51643], 70.00th=[ 62129], | 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[ 116917], | 99.00th=[ 177210], 99.50th=[ 210764], 99.90th=[ 459277], | 99.95th=[1002439], 99.99th=[1002439] bw ( KiB/s): min= 7, max= 104, per=25.03%, avg=39.05, stdev=18.05, samples=296 iops : min= 1, max= 26, avg= 9.12, stdev= 4.56, samples=296 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6348KiB/153715msec); 0 zone resets clat (usec): min=860, max=549307, avg=49237.90, stdev=52659.78 lat (usec): min=861, max=549308, avg=49242.64, stdev=52659.03 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1762], 20.00th=[ 5211], | 30.00th=[ 10683], 40.00th=[ 22676], 50.00th=[ 36439], 60.00th=[ 47973], | 70.00th=[ 64226], 80.00th=[ 83362], 90.00th=[116917], 95.00th=[147850], | 99.00th=[214959], 99.50th=[270533], 99.90th=[421528], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 127, per=25.44%, avg=41.47, stdev=19.50, samples=298 iops : min= 1, max= 31, avg= 9.73, stdev= 4.92, samples=298 lat (usec) : 50=0.36%, 100=3.97%, 250=0.36%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=5.47%, 4=3.55%, 10=6.12%, 20=7.58%, 50=31.84% lat (msec) : 100=28.26%, 250=11.72%, 500=0.36%, 750=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.76%, ctx=6659, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144493: Fri Sep 11 11:32:18 2026 read: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6028KiB/152767msec) clat (usec): min=24, max=567566, avg=48696.40, stdev=39618.44 lat (usec): min=24, max=567568, avg=48697.91, stdev=39618.51 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 118], 20.00th=[ 22152], | 30.00th=[ 29492], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 50070], | 70.00th=[ 59507], 80.00th=[ 72877], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[168821], 99.50th=[246416], 99.90th=[383779], 99.95th=[566232], | 99.99th=[566232] bw ( KiB/s): min= 7, max= 103, per=25.38%, avg=39.60, stdev=17.38, samples=296 iops : min= 1, max= 25, avg= 9.26, stdev= 4.38, samples=296 write: IOPS=10, BW=40.0KiB/s (41.0kB/s)(6260KiB/152767msec); 0 zone resets clat (usec): min=1030, max=1048.6k, avg=50552.67, stdev=57630.12 lat (usec): min=1031, max=1048.6k, avg=50566.65, stdev=57623.37 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1745], | 20.00th=[ 5276], 30.00th=[ 12911], 40.00th=[ 25560], | 50.00th=[ 36963], 60.00th=[ 51119], 70.00th=[ 64750], | 80.00th=[ 83362], 90.00th=[ 114820], 95.00th=[ 154141], | 99.00th=[ 214959], 99.50th=[ 270533], 99.90th=[ 513803], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 87, per=25.12%, avg=40.94, stdev=17.45, samples=297 iops : min= 1, max= 21, avg= 9.59, stdev= 4.40, samples=297 lat (usec) : 50=0.26%, 100=4.56%, 250=0.46%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.10% lat (msec) : 2=5.60%, 4=3.03%, 10=5.44%, 20=7.23%, 50=32.94% lat (msec) : 100=29.75%, 250=10.03%, 500=0.42%, 750=0.07%, 2000=0.03% cpu : usr=0.09%, sys=4.78%, ctx=6469, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144494: Fri Sep 11 11:32:18 2026 read: IOPS=9, BW=39.9KiB/s (40.9kB/s)(6052KiB/151626msec) clat (usec): min=24, max=712074, avg=48797.87, stdev=43295.86 lat (usec): min=24, max=712075, avg=48799.25, stdev=43295.90 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 1221], 20.00th=[ 21890], | 30.00th=[ 28705], 40.00th=[ 34866], 50.00th=[ 41681], 60.00th=[ 48497], | 70.00th=[ 58459], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[193987], 99.50th=[258999], 99.90th=[574620], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 95, per=25.72%, avg=40.12, stdev=18.05, samples=292 iops : min= 1, max= 23, avg= 9.38, stdev= 4.54, samples=292 write: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6236KiB/151626msec); 0 zone resets clat (usec): min=972, max=1069.1k, avg=49772.06, stdev=57151.58 lat (usec): min=973, max=1069.1k, avg=49773.69, stdev=57151.56 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1663], | 20.00th=[ 5407], 30.00th=[ 11338], 40.00th=[ 25560], | 50.00th=[ 36963], 60.00th=[ 50594], 70.00th=[ 65274], | 80.00th=[ 81265], 90.00th=[ 111674], 95.00th=[ 145753], | 99.00th=[ 217056], 99.50th=[ 278922], 99.90th=[ 497026], | 99.95th=[1069548], 99.99th=[1069548] bw ( KiB/s): min= 7, max= 96, per=25.20%, avg=41.07, stdev=17.92, samples=294 iops : min= 1, max= 24, avg= 9.63, stdev= 4.52, samples=294 lat (usec) : 50=0.36%, 100=4.07%, 250=0.42%, 750=0.03%, 1000=0.07% lat (msec) : 2=5.83%, 4=2.80%, 10=6.12%, 20=7.32%, 50=33.69% lat (msec) : 100=29.07%, 250=9.67%, 500=0.46%, 750=0.07%, 2000=0.03% cpu : usr=0.07%, sys=4.77%, ctx=6432, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=156KiB/s (160kB/s), 38.6KiB/s-39.9KiB/s (39.6kB/s-40.9kB/s), io=23.4MiB (24.6MB), run=151626-153715msec WRITE: bw=164KiB/s (167kB/s), 40.0KiB/s-41.3KiB/s (41.0kB/s-42.3kB/s), io=24.6MiB (25.7MB), run=151626-153715msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144486: Fri Sep 11 11:34:45 2026 read: IOPS=5, BW=20.1KiB/s (20.5kB/s)(5992KiB/298730msec) clat (msec): min=5, max=1174, avg=40.44, stdev=51.21 lat (msec): min=5, max=1174, avg=40.44, stdev=51.21 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 39], 80.00th=[ 56], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 205], 99.50th=[ 241], 99.90th=[ 481], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 7, max= 103, per=29.82%, avg=23.56, stdev=16.31, samples=490 iops : min= 1, max= 25, avg= 5.25, stdev= 4.11, samples=490 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6296KiB/298730msec); 0 zone resets clat (msec): min=31, max=803, avg=150.97, stdev=84.75 lat (msec): min=31, max=803, avg=150.97, stdev=84.75 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 58], 10.00th=[ 70], 20.00th=[ 86], | 30.00th=[ 100], 40.00th=[ 113], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 171], 80.00th=[ 209], 90.00th=[ 268], 95.00th=[ 305], | 99.00th=[ 430], 99.50th=[ 498], 99.90th=[ 776], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 64, per=25.10%, avg=20.83, stdev=11.15, samples=579 iops : min= 1, max= 16, avg= 4.56, stdev= 2.85, samples=579 lat (msec) : 10=3.55%, 20=15.79%, 50=19.27%, 100=21.58%, 250=33.37% lat (msec) : 500=6.18%, 750=0.16%, 1000=0.07%, 2000=0.03% cpu : usr=0.04%, sys=1.06%, ctx=5088, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144487: Fri Sep 11 11:34:45 2026 read: IOPS=4, BW=19.7KiB/s (20.2kB/s)(5940KiB/301091msec) clat (msec): min=4, max=1095, avg=38.83, stdev=47.67 lat (msec): min=4, max=1095, avg=38.84, stdev=47.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 57], 90.00th=[ 86], 95.00th=[ 113], | 99.00th=[ 192], 99.50th=[ 220], 99.90th=[ 451], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 112, per=29.92%, avg=23.64, stdev=16.19, samples=484 iops : min= 1, max= 28, avg= 5.28, stdev= 4.09, samples=484 write: IOPS=5, BW=21.1KiB/s (21.6kB/s)(6348KiB/301091msec); 0 zone resets clat (msec): min=24, max=824, avg=153.06, stdev=89.02 lat (msec): min=24, max=824, avg=153.06, stdev=89.02 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 97], 40.00th=[ 113], 50.00th=[ 130], 60.00th=[ 150], | 70.00th=[ 176], 80.00th=[ 211], 90.00th=[ 266], 95.00th=[ 317], | 99.00th=[ 481], 99.50th=[ 558], 99.90th=[ 818], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 79, per=25.43%, avg=21.11, stdev=11.48, samples=577 iops : min= 1, max= 19, avg= 4.63, stdev= 2.93, samples=577 lat (msec) : 10=4.13%, 20=15.63%, 50=18.72%, 100=22.98%, 250=31.87% lat (msec) : 500=6.28%, 750=0.26%, 1000=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.10%, ctx=5240, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144488: Fri Sep 11 11:34:45 2026 read: IOPS=5, BW=20.1KiB/s (20.6kB/s)(6028KiB/299184msec) clat (msec): min=5, max=406, avg=39.26, stdev=39.58 lat (msec): min=5, max=406, avg=39.26, stdev=39.58 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 40], 80.00th=[ 57], 90.00th=[ 89], 95.00th=[ 117], | 99.00th=[ 194], 99.50th=[ 226], 99.90th=[ 334], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 7, max= 95, per=29.74%, avg=23.49, stdev=16.12, samples=494 iops : min= 1, max= 23, avg= 5.24, stdev= 4.06, samples=494 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6260KiB/299184msec); 0 zone resets clat (msec): min=34, max=1145, avg=153.04, stdev=89.30 lat (msec): min=34, max=1145, avg=153.04, stdev=89.30 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 58], 10.00th=[ 70], 20.00th=[ 86], | 30.00th=[ 101], 40.00th=[ 114], 50.00th=[ 131], 60.00th=[ 150], | 70.00th=[ 176], 80.00th=[ 207], 90.00th=[ 266], 95.00th=[ 317], | 99.00th=[ 460], 99.50th=[ 523], 99.90th=[ 810], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 64, per=25.17%, avg=20.89, stdev=11.05, samples=574 iops : min= 1, max= 16, avg= 4.57, stdev= 2.82, samples=574 lat (msec) : 10=3.32%, 20=15.59%, 50=19.82%, 100=21.68%, 250=33.43% lat (msec) : 500=5.86%, 750=0.20%, 1000=0.07%, 2000=0.03% cpu : usr=0.03%, sys=1.03%, ctx=5016, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144489: Fri Sep 11 11:34:45 2026 read: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6052KiB/298237msec) clat (msec): min=5, max=398, avg=39.72, stdev=43.21 lat (msec): min=5, max=398, avg=39.72, stdev=43.21 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 38], 80.00th=[ 54], 90.00th=[ 95], 95.00th=[ 128], | 99.00th=[ 197], 99.50th=[ 247], 99.90th=[ 388], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 6, max= 120, per=30.57%, avg=24.15, stdev=17.23, samples=483 iops : min= 1, max= 30, avg= 5.41, stdev= 4.37, samples=483 write: IOPS=5, BW=20.9KiB/s (21.4kB/s)(6236KiB/298237msec); 0 zone resets clat (msec): min=27, max=1145, avg=152.44, stdev=84.70 lat (msec): min=27, max=1145, avg=152.45, stdev=84.70 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 70], 20.00th=[ 87], | 30.00th=[ 103], 40.00th=[ 118], 50.00th=[ 134], 60.00th=[ 153], | 70.00th=[ 176], 80.00th=[ 205], 90.00th=[ 264], 95.00th=[ 305], | 99.00th=[ 430], 99.50th=[ 493], 99.90th=[ 709], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 56, per=24.82%, avg=20.60, stdev=10.72, samples=579 iops : min= 1, max= 14, avg= 4.50, stdev= 2.73, samples=579 lat (msec) : 10=3.61%, 20=16.08%, 50=19.99%, 100=19.56%, 250=34.83% lat (msec) : 500=5.70%, 750=0.20%, 2000=0.03% cpu : usr=0.04%, sys=1.09%, ctx=5075, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=79.7KiB/s (81.7kB/s), 19.7KiB/s-20.3KiB/s (20.2kB/s-20.8kB/s), io=23.4MiB (24.6MB), run=298237-301091msec WRITE: bw=83.5KiB/s (85.5kB/s), 20.9KiB/s-21.1KiB/s (21.4kB/s-21.6kB/s), io=24.6MiB (25.7MB), run=298237-301091msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144555: Fri Sep 11 11:35:32 2026 read: IOPS=11, BW=180KiB/s (184kB/s)(5920KiB/32876msec) clat (usec): min=37, max=513509, avg=47873.20, stdev=48383.75 lat (usec): min=37, max=513510, avg=47875.61, stdev=48383.12 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 95], | 30.00th=[ 20579], 40.00th=[ 33817], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 64226], 80.00th=[ 76022], 90.00th=[102237], 95.00th=[125305], | 99.00th=[187696], 99.50th=[258999], 99.90th=[513803], 99.95th=[513803], | 99.99th=[513803] bw ( KiB/s): min= 31, max= 352, per=27.07%, avg=177.84, stdev=67.92, samples=64 iops : min= 1, max= 22, avg=10.36, stdev= 4.32, samples=64 write: IOPS=12, BW=194KiB/s (198kB/s)(6368KiB/32876msec); 0 zone resets clat (usec): min=1537, max=216144, avg=37558.75, stdev=39657.19 lat (usec): min=1540, max=216148, avg=37567.21, stdev=39662.92 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1975], 10.00th=[ 2933], 20.00th=[ 7373], | 30.00th=[ 10945], 40.00th=[ 14746], 50.00th=[ 21103], 60.00th=[ 31327], | 70.00th=[ 45351], 80.00th=[ 66847], 90.00th=[ 99091], 95.00th=[121111], | 99.00th=[173016], 99.50th=[196084], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 30, max= 470, per=27.93%, avg=193.02, stdev=94.71, samples=64 iops : min= 1, max= 29, avg=11.33, stdev= 6.01, samples=64 lat (usec) : 50=0.65%, 100=9.64%, 250=1.04%, 500=0.52%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=2.86%, 4=3.65%, 10=8.33%, 20=11.46%, 50=28.26% lat (msec) : 100=23.31%, 250=9.51%, 500=0.13%, 750=0.13% cpu : usr=0.09%, sys=5.70%, ctx=1418, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144556: Fri Sep 11 11:35:32 2026 read: IOPS=9, BW=159KiB/s (162kB/s)(5744KiB/36201msec) clat (usec): min=42, max=391988, avg=51201.09, stdev=46496.38 lat (usec): min=42, max=391989, avg=51203.35, stdev=46495.66 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 67], 10.00th=[ 79], 20.00th=[ 172], | 30.00th=[ 26608], 40.00th=[ 36439], 50.00th=[ 46400], 60.00th=[ 55313], | 70.00th=[ 68682], 80.00th=[ 82314], 90.00th=[102237], 95.00th=[120062], | 99.00th=[206570], 99.50th=[283116], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 31, max= 381, per=23.92%, avg=157.14, stdev=76.00, samples=71 iops : min= 1, max= 23, avg= 9.06, stdev= 4.78, samples=71 write: IOPS=11, BW=181KiB/s (185kB/s)(6544KiB/36201msec); 0 zone resets clat (usec): min=1356, max=262706, avg=42768.70, stdev=44055.38 lat (usec): min=1358, max=262707, avg=42776.86, stdev=44051.70 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1958], 10.00th=[ 3097], 20.00th=[ 6325], | 30.00th=[ 10028], 40.00th=[ 16450], 50.00th=[ 29230], 60.00th=[ 41157], | 70.00th=[ 57410], 80.00th=[ 78119], 90.00th=[104334], 95.00th=[129500], | 99.00th=[191890], 99.50th=[219153], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 30, max= 384, per=26.30%, avg=181.70, stdev=85.80, samples=70 iops : min= 1, max= 24, avg=10.60, stdev= 5.44, samples=70 lat (usec) : 50=0.13%, 100=7.16%, 250=2.21%, 500=0.26%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=3.12%, 4=3.78%, 10=9.77%, 20=8.85%, 50=25.91% lat (msec) : 100=27.47%, 250=10.29%, 500=0.65% cpu : usr=0.10%, sys=6.18%, ctx=1476, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144557: Fri Sep 11 11:35:32 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36438msec) clat (usec): min=39, max=262901, avg=50073.85, stdev=44015.73 lat (usec): min=40, max=262903, avg=50075.76, stdev=44015.58 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 70], 20.00th=[ 106], | 30.00th=[ 27657], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 53740], | 70.00th=[ 67634], 80.00th=[ 78119], 90.00th=[105382], 95.00th=[129500], | 99.00th=[202376], 99.50th=[240124], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 350, per=26.01%, avg=170.86, stdev=73.07, samples=71 iops : min= 1, max= 21, avg= 9.93, stdev= 4.61, samples=71 write: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36438msec); 0 zone resets clat (usec): min=1560, max=388991, avg=44092.47, stdev=49660.00 lat (usec): min=1562, max=388993, avg=44142.26, stdev=49650.71 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1958], 10.00th=[ 3032], 20.00th=[ 5866], | 30.00th=[ 9765], 40.00th=[ 14877], 50.00th=[ 26084], 60.00th=[ 40109], | 70.00th=[ 58983], 80.00th=[ 78119], 90.00th=[112722], 95.00th=[139461], | 99.00th=[221250], 99.50th=[274727], 99.90th=[387974], 99.95th=[387974], | 99.99th=[387974] bw ( KiB/s): min= 31, max= 320, per=23.45%, avg=162.03, stdev=69.57, samples=71 iops : min= 1, max= 20, avg= 9.37, stdev= 4.36, samples=71 lat (usec) : 50=0.91%, 100=8.72%, 250=2.21% lat (msec) : 2=2.99%, 4=4.17%, 10=8.33%, 20=9.51%, 50=24.74% lat (msec) : 100=26.69%, 250=11.33%, 500=0.39% cpu : usr=0.07%, sys=5.57%, ctx=1480, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144558: Fri Sep 11 11:35:32 2026 read: IOPS=10, BW=171KiB/s (175kB/s)(6032KiB/35350msec) clat (usec): min=35, max=496407, avg=50176.29, stdev=49317.45 lat (usec): min=35, max=496408, avg=50182.07, stdev=49313.22 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 65], 10.00th=[ 76], 20.00th=[ 169], | 30.00th=[ 25035], 40.00th=[ 34341], 50.00th=[ 43779], 60.00th=[ 54264], | 70.00th=[ 67634], 80.00th=[ 80217], 90.00th=[100140], 95.00th=[122160], | 99.00th=[235930], 99.50th=[295699], 99.90th=[497026], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 31, max= 474, per=25.96%, avg=170.58, stdev=85.50, samples=69 iops : min= 1, max= 29, avg= 9.90, stdev= 5.37, samples=69 write: IOPS=11, BW=177KiB/s (181kB/s)(6256KiB/35350msec); 0 zone resets clat (usec): min=1450, max=318635, avg=41765.61, stdev=47396.58 lat (usec): min=1451, max=318637, avg=41785.69, stdev=47383.82 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 2008], 10.00th=[ 2442], 20.00th=[ 5342], | 30.00th=[ 9634], 40.00th=[ 13698], 50.00th=[ 22676], 60.00th=[ 36963], | 70.00th=[ 50070], 80.00th=[ 72877], 90.00th=[110625], 95.00th=[133694], | 99.00th=[191890], 99.50th=[295699], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 31, max= 411, per=26.09%, avg=180.31, stdev=82.18, samples=68 iops : min= 1, max= 25, avg=10.53, stdev= 5.14, samples=68 lat (usec) : 50=0.78%, 100=6.64%, 250=2.73%, 750=0.39%, 1000=0.39% lat (msec) : 2=2.86%, 4=5.73%, 10=8.20%, 20=10.03%, 50=25.78% lat (msec) : 100=24.48%, 250=11.46%, 500=0.52% cpu : usr=0.08%, sys=5.09%, ctx=1408, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=657KiB/s (673kB/s), 159KiB/s-180KiB/s (162kB/s-184kB/s), io=23.4MiB (24.5MB), run=32876-36438msec WRITE: bw=692KiB/s (708kB/s), 166KiB/s-194KiB/s (170kB/s-198kB/s), io=24.6MiB (25.8MB), run=32876-36438msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144560: Fri Sep 11 11:36:22 2026 read: IOPS=4, BW=69.0KiB/s (71.6kB/s)(5920KiB/84629msec) clat (msec): min=7, max=302, avg=49.21, stdev=48.41 lat (msec): min=7, max=302, avg=49.21, stdev=48.41 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 14], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 103], 95.00th=[ 148], | 99.00th=[ 255], 99.50th=[ 279], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 28, max= 347, per=29.50%, avg=82.60, stdev=57.79, samples=141 iops : min= 1, max= 21, avg= 4.38, stdev= 3.65, samples=141 write: IOPS=4, BW=75.2KiB/s (77.1kB/s)(6368KiB/84629msec); 0 zone resets clat (msec): min=26, max=611, avg=166.62, stdev=96.42 lat (msec): min=26, max=611, avg=166.62, stdev=96.42 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 59], 10.00th=[ 75], 20.00th=[ 97], | 30.00th=[ 109], 40.00th=[ 127], 50.00th=[ 142], 60.00th=[ 163], | 70.00th=[ 186], 80.00th=[ 220], 90.00th=[ 292], 95.00th=[ 351], | 99.00th=[ 550], 99.50th=[ 592], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 28, max= 222, per=26.42%, avg=77.69, stdev=39.17, samples=161 iops : min= 1, max= 13, avg= 4.05, stdev= 2.51, samples=161 lat (msec) : 10=0.78%, 20=9.90%, 50=24.87%, 100=18.62%, 250=37.24% lat (msec) : 500=7.94%, 750=0.65% cpu : usr=0.04%, sys=1.11%, ctx=1323, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144561: Fri Sep 11 11:36:22 2026 read: IOPS=4, BW=67.2KiB/s (68.8kB/s)(5744KiB/85492msec) clat (msec): min=6, max=262, avg=44.67, stdev=39.92 lat (msec): min=6, max=262, avg=44.67, stdev=39.92 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 64], 90.00th=[ 95], 95.00th=[ 133], | 99.00th=[ 188], 99.50th=[ 234], 99.90th=[ 264], 99.95th=[ 264], | 99.99th=[ 264] bw ( KiB/s): min= 28, max= 288, per=30.78%, avg=86.18, stdev=56.06, samples=129 iops : min= 1, max= 18, avg= 4.60, stdev= 3.54, samples=129 write: IOPS=4, BW=76.5KiB/s (78.4kB/s)(6544KiB/85492msec); 0 zone resets clat (msec): min=27, max=637, avg=169.63, stdev=101.03 lat (msec): min=27, max=637, avg=169.64, stdev=101.03 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 69], 20.00th=[ 92], | 30.00th=[ 111], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 163], | 70.00th=[ 197], 80.00th=[ 239], 90.00th=[ 313], 95.00th=[ 372], | 99.00th=[ 493], 99.50th=[ 575], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 28, max= 287, per=26.42%, avg=77.68, stdev=41.22, samples=163 iops : min= 1, max= 17, avg= 4.06, stdev= 2.60, samples=163 lat (msec) : 10=2.34%, 20=9.38%, 50=23.96%, 100=19.27%, 250=35.16% lat (msec) : 500=9.38%, 750=0.52% cpu : usr=0.04%, sys=1.18%, ctx=1340, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144562: Fri Sep 11 11:36:22 2026 read: IOPS=4, BW=75.2KiB/s (77.0kB/s)(6256KiB/83195msec) clat (msec): min=7, max=431, avg=46.45, stdev=48.20 lat (msec): min=7, max=431, avg=46.45, stdev=48.20 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 97], 95.00th=[ 134], | 99.00th=[ 220], 99.50th=[ 405], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 28, max= 350, per=31.69%, avg=88.72, stdev=60.69, samples=139 iops : min= 1, max= 21, avg= 4.76, stdev= 3.85, samples=139 write: IOPS=4, BW=72.5KiB/s (74.2kB/s)(6032KiB/83195msec); 0 zone resets clat (msec): min=33, max=571, avg=172.20, stdev=86.66 lat (msec): min=33, max=571, avg=172.22, stdev=86.76 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 66], 10.00th=[ 82], 20.00th=[ 105], | 30.00th=[ 118], 40.00th=[ 132], 50.00th=[ 150], 60.00th=[ 174], | 70.00th=[ 205], 80.00th=[ 239], 90.00th=[ 288], 95.00th=[ 334], | 99.00th=[ 489], 99.50th=[ 567], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 29, max= 191, per=25.05%, avg=73.65, stdev=36.32, samples=160 iops : min= 1, max= 11, avg= 3.81, stdev= 2.29, samples=160 lat (msec) : 10=1.30%, 20=11.33%, 50=24.87%, 100=16.67%, 250=37.24% lat (msec) : 500=8.33%, 750=0.26% cpu : usr=0.04%, sys=1.19%, ctx=1345, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144563: Fri Sep 11 11:36:22 2026 read: IOPS=4, BW=71.8KiB/s (73.5kB/s)(6032KiB/83983msec) clat (msec): min=6, max=375, avg=46.97, stdev=41.88 lat (msec): min=6, max=375, avg=46.98, stdev=41.88 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 99], 95.00th=[ 120], | 99.00th=[ 205], 99.50th=[ 351], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 287, per=32.40%, avg=90.71, stdev=61.71, samples=129 iops : min= 1, max= 17, avg= 4.88, stdev= 3.88, samples=129 write: IOPS=4, BW=74.5KiB/s (76.3kB/s)(6256KiB/83983msec); 0 zone resets clat (msec): min=36, max=1068, avg=169.39, stdev=100.24 lat (msec): min=36, max=1068, avg=169.40, stdev=100.23 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 110], 40.00th=[ 128], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 192], 80.00th=[ 228], 90.00th=[ 292], 95.00th=[ 347], | 99.00th=[ 472], 99.50th=[ 592], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 31, max= 256, per=26.20%, avg=77.03, stdev=39.29, samples=159 iops : min= 1, max= 16, avg= 4.02, stdev= 2.51, samples=159 lat (msec) : 10=0.65%, 20=11.46%, 50=22.53%, 100=21.48%, 250=35.16% lat (msec) : 500=8.46%, 750=0.13%, 2000=0.13% cpu : usr=0.04%, sys=1.13%, ctx=1331, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=280KiB/s (287kB/s), 67.2KiB/s-75.2KiB/s (68.8kB/s-77.0kB/s), io=23.4MiB (24.5MB), run=83195-85492msec WRITE: bw=295KiB/s (302kB/s), 72.5KiB/s-76.5KiB/s (74.2kB/s-78.4kB/s), io=24.6MiB (25.8MB), run=83195-85492msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144582: Fri Sep 11 11:36:40 2026 read: IOPS=1, BW=1503KiB/s (1539kB/s)(7168KiB/4770msec) clat (msec): min=88, max=900, avg=299.54, stdev=280.84 lat (msec): min=88, max=900, avg=299.54, stdev=280.84 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 140], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 167], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 351], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1914, max= 4830, per=79.36%, avg=2710.00, stdev=1414.74, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.26, samples=4 write: IOPS=1, BW=1073KiB/s (1099kB/s)(5120KiB/4770msec); 0 zone resets clat (msec): min=306, max=965, avg=494.85, stdev=271.23 lat (msec): min=306, max=965, avg=494.95, stdev=271.20 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 477], 80.00th=[ 477], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1910, max= 4039, per=52.39%, avg=2505.00, stdev=1024.43, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 1000=16.67% cpu : usr=0.04%, sys=3.50%, ctx=64, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144583: Fri Sep 11 11:36:40 2026 read: IOPS=0, BW=342KiB/s (350kB/s)(2048KiB/5996msec) clat (msec): min=176, max=587, avg=382.13, stdev=290.68 lat (msec): min=176, max=587, avg=382.13, stdev=290.68 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 178], 60.00th=[ 592], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1654, max= 1980, per=53.21%, avg=1817.00, stdev=230.52, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1708KiB/s (1749kB/s)(10.0MiB/5996msec); 0 zone resets clat (msec): min=205, max=1119, avg=503.01, stdev=309.08 lat (msec): min=205, max=1119, avg=503.14, stdev=309.07 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 334], | 70.00th=[ 609], 80.00th=[ 743], 90.00th=[ 844], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1943, max= 4096, per=62.68%, avg=2996.83, stdev=1108.20, samples=6 iops : min= 1, max= 4, avg= 2.33, stdev= 1.51, samples=6 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.17%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144584: Fri Sep 11 11:36:40 2026 read: IOPS=1, BW=1055KiB/s (1081kB/s)(6144KiB/5821msec) clat (msec): min=136, max=1089, avg=439.55, stdev=396.60 lat (msec): min=136, max=1089, avg=439.55, stdev=396.60 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 148], | 30.00th=[ 148], 40.00th=[ 171], 50.00th=[ 171], 60.00th=[ 334], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1910, max= 4096, per=73.27%, avg=2502.25, stdev=1063.52, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1055KiB/s (1081kB/s)(6144KiB/5821msec); 0 zone resets clat (msec): min=235, max=1255, avg=494.19, stdev=408.96 lat (msec): min=235, max=1256, avg=494.61, stdev=409.28 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 305], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1692, max= 4096, per=49.29%, avg=2356.40, stdev=982.16, samples=5 iops : min= 1, max= 4, avg= 1.80, stdev= 1.30, samples=5 lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=8.33%, 2000=16.67% cpu : usr=0.10%, sys=2.78%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144585: Fri Sep 11 11:36:40 2026 read: IOPS=1, BW=1148KiB/s (1175kB/s)(5120KiB/4461msec) clat (msec): min=129, max=382, avg=270.86, stdev=111.57 lat (msec): min=129, max=382, avg=270.86, stdev=111.57 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 130], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 3961, max= 4047, per=100.00%, avg=4004.00, stdev=60.81, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1607KiB/s (1645kB/s)(7168KiB/4461msec); 0 zone resets clat (msec): min=224, max=838, avg=436.00, stdev=204.90 lat (msec): min=230, max=838, avg=436.95, stdev=203.91 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 321], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 368], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 558], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1622, max= 4096, per=56.75%, avg=2713.20, stdev=1178.93, samples=5 iops : min= 1, max= 4, avg= 2.20, stdev= 1.30, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=2.83%, ctx=66, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3416KiB/s (3498kB/s), 342KiB/s-1503KiB/s (350kB/s-1539kB/s), io=20.0MiB (20.0MB), run=4461-5996msec WRITE: bw=4782KiB/s (4897kB/s), 1055KiB/s-1708KiB/s (1081kB/s-1749kB/s), io=28.0MiB (29.4MB), run=4461-5996msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144588: Fri Sep 11 11:36:40 2026 read: IOPS=1, BW=1642KiB/s (1681kB/s)(7168KiB/4366msec) clat (msec): min=5, max=834, avg=293.76, stdev=270.06 lat (msec): min=5, max=834, avg=293.76, stdev=270.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 115], | 30.00th=[ 130], 40.00th=[ 130], 50.00th=[ 317], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 338], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1976, max= 3835, per=65.50%, avg=2897.25, stdev=1046.27, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1173KiB/s (1201kB/s)(5120KiB/4366msec); 0 zone resets clat (msec): min=153, max=905, avg=460.61, stdev=284.83 lat (msec): min=153, max=906, avg=461.09, stdev=284.59 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 523], 80.00th=[ 523], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1910, max= 4015, per=40.15%, avg=2486.00, stdev=1020.47, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 10=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=16.67% cpu : usr=0.07%, sys=8.45%, ctx=144, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144589: Fri Sep 11 11:36:40 2026 read: IOPS=0, BW=442KiB/s (453kB/s)(2048KiB/4630msec) clat (usec): min=600, max=335698, avg=168149.87, stdev=236950.13 lat (usec): min=602, max=335700, avg=168151.47, stdev=236950.56 clat percentiles (usec): | 1.00th=[ 603], 5.00th=[ 603], 10.00th=[ 603], 20.00th=[ 603], | 30.00th=[ 603], 40.00th=[ 603], 50.00th=[ 603], 60.00th=[337642], | 70.00th=[337642], 80.00th=[337642], 90.00th=[337642], 95.00th=[337642], | 99.00th=[337642], 99.50th=[337642], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 1368, max= 2019, per=38.29%, avg=1693.50, stdev=460.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2212KiB/s (2265kB/s)(10.0MiB/4630msec); 0 zone resets clat (msec): min=165, max=905, avg=428.80, stdev=267.36 lat (msec): min=165, max=905, avg=429.11, stdev=267.45 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 167], | 30.00th=[ 220], 40.00th=[ 245], 50.00th=[ 300], 60.00th=[ 418], | 70.00th=[ 472], 80.00th=[ 567], 90.00th=[ 835], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1878, max= 6059, per=58.02%, avg=3592.60, stdev=2235.73, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 2.19, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=11.13%, ctx=131, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144590: Fri Sep 11 11:36:40 2026 read: IOPS=1, BW=1379KiB/s (1412kB/s)(6144KiB/4457msec) clat (usec): min=541, max=510370, avg=209391.36, stdev=201049.98 lat (usec): min=543, max=510439, avg=209403.81, stdev=201070.05 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[189793], 50.00th=[189793], 60.00th=[191890], | 70.00th=[362808], 80.00th=[362808], 90.00th=[509608], 95.00th=[509608], | 99.00th=[509608], 99.50th=[509608], 99.90th=[509608], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 1910, max= 4015, per=55.61%, avg=2459.50, stdev=1037.73, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1379KiB/s (1412kB/s)(6144KiB/4457msec); 0 zone resets clat (msec): min=207, max=891, avg=532.70, stdev=297.42 lat (msec): min=207, max=891, avg=532.79, stdev=297.42 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 693], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1984, max= 2043, per=32.47%, avg=2010.60, stdev=23.11, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=33.33%, 500=16.67%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=10.12%, ctx=167, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144591: Fri Sep 11 11:36:40 2026 read: IOPS=1, BW=1335KiB/s (1367kB/s)(5120KiB/3836msec) clat (msec): min=5, max=680, avg=268.03, stdev=284.40 lat (msec): min=5, max=680, avg=268.03, stdev=284.40 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2023, max= 3835, per=59.54%, avg=2633.67, stdev=1040.43, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1869KiB/s (1913kB/s)(7168KiB/3836msec); 0 zone resets clat (msec): min=224, max=601, avg=355.88, stdev=139.97 lat (msec): min=225, max=603, avg=356.20, stdev=140.45 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 230], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 296], 60.00th=[ 426], | 70.00th=[ 426], 80.00th=[ 447], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1910, max= 4087, per=56.35%, avg=3489.25, stdev=1054.09, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (msec) : 10=16.67%, 250=25.00%, 500=41.67%, 750=16.67% cpu : usr=0.10%, sys=13.27%, ctx=152, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4423KiB/s (4529kB/s), 442KiB/s-1642KiB/s (453kB/s-1681kB/s), io=20.0MiB (20.0MB), run=3836-4630msec WRITE: bw=6193KiB/s (6341kB/s), 1173KiB/s-2212KiB/s (1201kB/s-2265kB/s), io=28.0MiB (29.4MB), run=3836-4630msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144599: Fri Sep 11 11:36:59 2026 read: IOPS=1, BW=4842KiB/s (4958kB/s)(12.0MiB/2538msec) clat (msec): min=653, max=878, avg=749.02, stdev=116.50 lat (msec): min=653, max=878, avg=749.02, stdev=116.50 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7641, max= 7787, per=100.00%, avg=7714.00, stdev=103.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.47%, sys=3.67%, ctx=66, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144600: Fri Sep 11 11:36:59 2026 read: IOPS=0, BW=1714KiB/s (1755kB/s)(4096KiB/2390msec) clat (nsec): min=243595k, max=243595k, avg=243594578.00, stdev= 0.00 lat (nsec): min=243599k, max=243599k, avg=243598544.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 245], | 70.00th=[ 245], 80.00th=[ 245], 90.00th=[ 245], 95.00th=[ 245], | 99.00th=[ 245], 99.50th=[ 245], 99.90th=[ 245], 99.95th=[ 245], | 99.99th=[ 245] bw ( KiB/s): min= 6077, max= 6077, per=94.14%, avg=6077.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3428KiB/s (3510kB/s)(8192KiB/2390msec); 0 zone resets clat (msec): min=731, max=1138, avg=934.80, stdev=288.08 lat (msec): min=731, max=1140, avg=936.39, stdev=289.20 clat percentiles (msec): | 1.00th=[ 735], 5.00th=[ 735], 10.00th=[ 735], 20.00th=[ 735], | 30.00th=[ 735], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 7772, max= 7772, per=100.00%, avg=7772.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.17%, sys=4.35%, ctx=45, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144601: Fri Sep 11 11:36:59 2026 write: IOPS=0, BW=2396KiB/s (2453kB/s)(12.0MiB/5129msec); 0 zone resets clat (msec): min=649, max=2622, avg=1617.26, stdev=986.81 lat (msec): min=649, max=2625, avg=1618.78, stdev=988.23 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1586], 50.00th=[ 1586], 60.00th=[ 1586], | 70.00th=[ 2635], 80.00th=[ 2635], 90.00th=[ 2635], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 7787, max= 8094, per=100.00%, avg=7940.50, stdev=217.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.14%, sys=3.57%, ctx=86, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144602: Fri Sep 11 11:36:59 2026 write: IOPS=0, BW=3770KiB/s (3861kB/s)(12.0MiB/3259msec); 0 zone resets clat (msec): min=420, max=1990, avg=1022.69, stdev=846.33 lat (msec): min=420, max=1991, avg=1023.54, stdev=846.29 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 7641, max= 7772, per=100.00%, avg=7706.50, stdev=92.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.18%, sys=3.99%, ctx=67, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6455KiB/s (6610kB/s), 1714KiB/s-4842KiB/s (1755kB/s-4958kB/s), io=16.0MiB (16.8MB), run=2390-2538msec WRITE: bw=6389KiB/s (6542kB/s), 2396KiB/s-3770KiB/s (2453kB/s-3861kB/s), io=32.0MiB (33.6MB), run=2390-5129msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144604: Fri Sep 11 11:36:59 2026 read: IOPS=0, BW=3487KiB/s (3571kB/s)(12.0MiB/3524msec) clat (msec): min=1114, max=1275, avg=1173.97, stdev=88.02 lat (msec): min=1114, max=1275, avg=1173.97, stdev=88.02 clat percentiles (msec): | 1.00th=[ 1116], 5.00th=[ 1116], 10.00th=[ 1116], 20.00th=[ 1116], | 30.00th=[ 1116], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 7861, max= 8143, per=100.00%, avg=8002.00, stdev=199.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=11.75%, ctx=301, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144605: Fri Sep 11 11:36:59 2026 read: IOPS=0, BW=929KiB/s (952kB/s)(4096KiB/4408msec) clat (nsec): min=1064.3M, max=1064.3M, avg=1064317898.00, stdev= 0.00 lat (nsec): min=1064.3M, max=1064.3M, avg=1064321470.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1062], 5.00th=[ 1062], 10.00th=[ 1062], 20.00th=[ 1062], | 30.00th=[ 1062], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7861, max= 7861, per=100.00%, avg=7861.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1858KiB/s (1903kB/s)(8192KiB/4408msec); 0 zone resets clat (msec): min=953, max=2383, avg=1668.20, stdev=1011.04 lat (msec): min=953, max=2383, avg=1668.97, stdev=1011.14 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 2400], | 70.00th=[ 2400], 80.00th=[ 2400], 90.00th=[ 2400], 95.00th=[ 2400], | 99.00th=[ 2400], 99.50th=[ 2400], 99.90th=[ 2400], 99.95th=[ 2400], | 99.99th=[ 2400] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.14%, sys=2.56%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144606: Fri Sep 11 11:36:59 2026 write: IOPS=0, BW=2698KiB/s (2762kB/s)(12.0MiB/4555msec); 0 zone resets clat (msec): min=623, max=2257, avg=1517.45, stdev=827.70 lat (msec): min=624, max=2257, avg=1517.93, stdev=827.63 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 1670], 50.00th=[ 1670], 60.00th=[ 1670], | 70.00th=[ 2265], 80.00th=[ 2265], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.60%, ctx=57, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144607: Fri Sep 11 11:36:59 2026 write: IOPS=0, BW=4009KiB/s (4105kB/s)(12.0MiB/3065msec); 0 zone resets clat (msec): min=447, max=2002, avg=1020.06, stdev=855.05 lat (msec): min=447, max=2003, avg=1020.50, stdev=855.10 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 609], 50.00th=[ 609], 60.00th=[ 609], | 70.00th=[ 2005], 80.00th=[ 2005], 90.00th=[ 2005], 95.00th=[ 2005], | 99.00th=[ 2005], 99.50th=[ 2005], 99.90th=[ 2005], 99.95th=[ 2005], | 99.99th=[ 2005] bw ( KiB/s): min= 7861, max= 8143, per=100.00%, avg=8002.00, stdev=199.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.93%, ctx=64, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3717KiB/s (3806kB/s), 929KiB/s-3487KiB/s (952kB/s-3571kB/s), io=16.0MiB (16.8MB), run=3524-4408msec WRITE: bw=7194KiB/s (7367kB/s), 1858KiB/s-4009KiB/s (1903kB/s-4105kB/s), io=32.0MiB (33.6MB), run=3065-4555msec