== sanity test 398b: DIO and buffer IO race ============== 14:50:20 (1789066220) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.66926 s, 7.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179203: Thu Sep 10 14:52:46 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(5992KiB/123907msec) clat (usec): min=30, max=586150, avg=45814.19, stdev=32741.83 lat (usec): min=30, max=586152, avg=45819.14, stdev=32741.19 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12125], 10.00th=[ 17957], 20.00th=[ 23987], | 30.00th=[ 28967], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 63701], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[158335], 99.50th=[181404], 99.90th=[295699], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 7, max= 104, per=25.06%, avg=47.86, stdev=17.77, samples=245 iops : min= 1, max= 26, avg=11.32, stdev= 4.49, samples=245 write: IOPS=12, BW=50.8KiB/s (52.0kB/s)(6296KiB/123907msec); 0 zone resets clat (usec): min=1173, max=209756, avg=34790.46, stdev=33264.03 lat (usec): min=1174, max=209757, avg=34794.22, stdev=33266.64 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1500], 10.00th=[ 2245], 20.00th=[ 5014], | 30.00th=[ 10028], 40.00th=[ 18482], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[ 98042], | 99.00th=[143655], 99.50th=[164627], 99.90th=[196084], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 7, max= 142, per=25.23%, avg=50.45, stdev=22.79, samples=244 iops : min= 1, max= 35, avg=11.97, stdev= 5.74, samples=244 lat (usec) : 50=0.10%, 100=1.40%, 250=0.07%, 500=0.13%, 1000=0.03% lat (msec) : 2=4.36%, 4=4.00%, 10=7.39%, 20=10.58%, 50=41.37% lat (msec) : 100=25.91%, 250=4.59%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=4.91%, ctx=6770, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179205: Thu Sep 10 14:52:46 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(5940KiB/124508msec) clat (usec): min=48, max=253561, avg=46174.97, stdev=29068.08 lat (usec): min=49, max=253562, avg=46183.62, stdev=29066.01 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 14222], 10.00th=[ 18482], 20.00th=[ 23987], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 65799], 90.00th=[ 80217], 95.00th=[ 98042], | 99.00th=[154141], 99.50th=[175113], 99.90th=[238027], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 6, max= 127, per=24.76%, avg=47.29, stdev=19.39, samples=245 iops : min= 1, max= 31, avg=11.18, stdev= 4.87, samples=245 write: IOPS=12, BW=50.0KiB/s (52.2kB/s)(6348KiB/124508msec); 0 zone resets clat (usec): min=1189, max=589964, avg=34939.69, stdev=37732.63 lat (usec): min=1191, max=589967, avg=34943.07, stdev=37734.47 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 1516], 10.00th=[ 2442], 20.00th=[ 4883], | 30.00th=[ 8848], 40.00th=[ 16450], 50.00th=[ 24249], 60.00th=[ 32375], | 70.00th=[ 43254], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[154141], 99.50th=[189793], 99.90th=[233833], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 7, max= 190, per=25.23%, avg=50.47, stdev=22.99, samples=245 iops : min= 1, max= 47, avg=11.98, stdev= 5.78, samples=245 lat (usec) : 50=0.07%, 100=1.30%, 250=0.03%, 500=0.07% lat (msec) : 2=4.13%, 4=4.62%, 10=8.04%, 20=10.55%, 50=40.40% lat (msec) : 100=25.59%, 250=5.14%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.06%, ctx=6889, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179207: Thu Sep 10 14:52:46 2026 read: IOPS=12, BW=48.2KiB/s (49.3kB/s)(6028KiB/125116msec) clat (usec): min=48, max=580474, avg=46075.82, stdev=32280.85 lat (usec): min=49, max=580476, avg=46083.46, stdev=32279.29 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 12780], 10.00th=[ 17957], 20.00th=[ 24773], | 30.00th=[ 29492], 40.00th=[ 34341], 50.00th=[ 40109], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 64226], 90.00th=[ 79168], 95.00th=[ 96994], | 99.00th=[158335], 99.50th=[193987], 99.90th=[270533], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 6, max= 103, per=24.88%, avg=47.51, stdev=18.62, samples=247 iops : min= 1, max= 25, avg=11.23, stdev= 4.68, samples=247 write: IOPS=12, BW=50.0KiB/s (51.2kB/s)(6260KiB/125116msec); 0 zone resets clat (usec): min=1208, max=237018, avg=35250.22, stdev=34606.72 lat (usec): min=1210, max=237020, avg=35255.46, stdev=34608.67 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1516], 10.00th=[ 2573], 20.00th=[ 5211], | 30.00th=[ 9503], 40.00th=[ 17433], 50.00th=[ 26084], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[143655], 99.50th=[168821], 99.90th=[233833], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 7, max= 117, per=24.74%, avg=49.49, stdev=21.10, samples=246 iops : min= 1, max= 29, avg=11.73, stdev= 5.33, samples=246 lat (usec) : 50=0.10%, 100=1.53%, 250=0.16%, 500=0.07% lat (msec) : 2=3.87%, 4=4.04%, 10=8.07%, 20=10.61%, 50=41.05% lat (msec) : 100=25.26%, 250=5.18%, 500=0.03%, 750=0.03% cpu : usr=0.07%, sys=5.05%, ctx=6888, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179209: Thu Sep 10 14:52:46 2026 read: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6052KiB/123643msec) clat (usec): min=43, max=223325, avg=45094.18, stdev=28108.94 lat (usec): min=43, max=223327, avg=45095.89, stdev=28109.10 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 11731], 10.00th=[ 17433], 20.00th=[ 23462], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[160433], 99.90th=[219153], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 119, per=25.57%, avg=48.83, stdev=17.27, samples=242 iops : min= 1, max= 29, avg=11.56, stdev= 4.34, samples=242 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6236KiB/123643msec); 0 zone resets clat (usec): min=1025, max=821097, avg=35166.24, stdev=40856.29 lat (usec): min=1026, max=821099, avg=35168.40, stdev=40856.15 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1450], 10.00th=[ 2024], 20.00th=[ 4178], | 30.00th=[ 7832], 40.00th=[ 15664], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 44303], 80.00th=[ 61080], 90.00th=[ 84411], 95.00th=[105382], | 99.00th=[152044], 99.50th=[181404], 99.90th=[299893], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 152, per=25.12%, avg=50.24, stdev=23.31, samples=242 iops : min= 1, max= 38, avg=11.92, stdev= 5.87, samples=242 lat (usec) : 50=0.13%, 100=1.66%, 250=0.20%, 500=0.03% lat (msec) : 2=4.95%, 4=4.92%, 10=7.68%, 20=10.25%, 50=39.88% lat (msec) : 100=24.93%, 250=5.31%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=5.00%, ctx=6812, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (197kB/s), 47.7KiB/s-48.9KiB/s (48.9kB/s-50.1kB/s), io=23.4MiB (24.6MB), run=123643-125116msec WRITE: bw=201KiB/s (206kB/s), 50.0KiB/s-50.0KiB/s (51.2kB/s-52.2kB/s), io=24.6MiB (25.7MB), run=123643-125116msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179204: Thu Sep 10 14:53:32 2026 read: IOPS=8, BW=35.5KiB/s (36.3kB/s)(5992KiB/169006msec) clat (msec): min=6, max=621, avg=44.75, stdev=39.40 lat (msec): min=6, max=621, avg=44.75, stdev=39.40 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 64], 90.00th=[ 92], 95.00th=[ 123], | 99.00th=[ 190], 99.50th=[ 207], 99.90th=[ 271], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 7, max= 119, per=25.65%, avg=35.92, stdev=21.56, samples=325 iops : min= 1, max= 29, avg= 8.31, stdev= 5.42, samples=325 write: IOPS=9, BW=37.3KiB/s (38.1kB/s)(6296KiB/169006msec); 0 zone resets clat (msec): min=13, max=387, avg=64.47, stdev=42.91 lat (msec): min=13, max=387, avg=64.47, stdev=42.91 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 91], 90.00th=[ 118], 95.00th=[ 144], | 99.00th=[ 215], 99.50th=[ 259], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 103, per=25.25%, avg=37.12, stdev=19.86, samples=330 iops : min= 1, max= 25, avg= 8.62, stdev= 4.99, samples=330 lat (msec) : 10=0.88%, 20=11.13%, 50=48.11%, 100=27.51%, 250=12.01% lat (msec) : 500=0.33%, 750=0.03% cpu : usr=0.06%, sys=2.15%, ctx=5013, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179206: Thu Sep 10 14:53:32 2026 read: IOPS=8, BW=34.8KiB/s (35.6kB/s)(5940KiB/170709msec) clat (msec): min=6, max=839, avg=44.88, stdev=41.69 lat (msec): min=6, max=839, avg=44.88, stdev=41.69 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 65], 90.00th=[ 96], 95.00th=[ 124], | 99.00th=[ 184], 99.50th=[ 199], 99.90th=[ 257], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 7, max= 111, per=25.45%, avg=35.63, stdev=21.80, samples=324 iops : min= 1, max= 27, avg= 8.24, stdev= 5.48, samples=324 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6348KiB/170709msec); 0 zone resets clat (msec): min=12, max=383, avg=65.31, stdev=42.68 lat (msec): min=12, max=383, avg=65.32, stdev=42.68 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 122], 95.00th=[ 144], | 99.00th=[ 205], 99.50th=[ 271], 99.90th=[ 347], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 103, per=25.17%, avg=36.99, stdev=19.72, samples=333 iops : min= 1, max= 25, avg= 8.58, stdev= 4.96, samples=333 lat (msec) : 10=0.98%, 20=11.07%, 50=48.05%, 100=26.56%, 250=12.99% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=2.05%, ctx=4994, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179208: Thu Sep 10 14:53:32 2026 read: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6028KiB/169262msec) clat (msec): min=6, max=317, avg=44.94, stdev=36.64 lat (msec): min=6, max=317, avg=44.95, stdev=36.66 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 49], 80.00th=[ 63], 90.00th=[ 97], 95.00th=[ 126], | 99.00th=[ 171], 99.50th=[ 188], 99.90th=[ 275], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 7, max= 150, per=25.61%, avg=35.86, stdev=21.84, samples=326 iops : min= 1, max= 37, avg= 8.30, stdev= 5.50, samples=326 write: IOPS=9, BW=36.0KiB/s (37.9kB/s)(6260KiB/169262msec); 0 zone resets clat (msec): min=9, max=789, avg=64.54, stdev=46.27 lat (msec): min=9, max=789, avg=64.55, stdev=46.27 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 74], 80.00th=[ 93], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 220], 99.50th=[ 253], 99.90th=[ 388], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 117, per=25.06%, avg=36.84, stdev=20.77, samples=329 iops : min= 1, max= 29, avg= 8.54, stdev= 5.23, samples=329 lat (msec) : 10=1.07%, 20=11.82%, 50=47.27%, 100=26.46%, 250=13.05% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.06%, sys=2.08%, ctx=5069, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179210: Thu Sep 10 14:53:32 2026 read: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6052KiB/169793msec) clat (msec): min=6, max=267, avg=45.28, stdev=38.74 lat (msec): min=6, max=267, avg=45.29, stdev=38.74 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 47], 80.00th=[ 65], 90.00th=[ 101], 95.00th=[ 127], | 99.00th=[ 188], 99.50th=[ 213], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 7, max= 120, per=25.74%, avg=36.04, stdev=22.35, samples=326 iops : min= 1, max= 30, avg= 8.35, stdev= 5.61, samples=326 write: IOPS=9, BW=36.7KiB/s (37.6kB/s)(6236KiB/169793msec); 0 zone resets clat (msec): min=8, max=838, avg=64.70, stdev=46.75 lat (msec): min=8, max=838, avg=64.71, stdev=46.75 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 123], 95.00th=[ 146], | 99.00th=[ 224], 99.50th=[ 268], 99.90th=[ 342], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 102, per=24.91%, avg=36.62, stdev=20.19, samples=330 iops : min= 1, max= 25, avg= 8.48, stdev= 5.08, samples=330 lat (msec) : 10=1.11%, 20=11.43%, 50=48.05%, 100=26.11%, 250=12.92% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.05%, sys=2.06%, ctx=4923, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=141KiB/s (144kB/s), 34.8KiB/s-35.6KiB/s (35.6kB/s-36.5kB/s), io=23.4MiB (24.6MB), run=169006-170709msec WRITE: bw=147KiB/s (151kB/s), 36.7KiB/s-37.3KiB/s (37.6kB/s-38.1kB/s), io=24.6MiB (25.7MB), run=169006-170709msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179254: Thu Sep 10 14:54:29 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5920KiB/43191msec) clat (usec): min=34, max=297148, avg=60990.79, stdev=39974.07 lat (usec): min=34, max=297149, avg=60999.14, stdev=39972.34 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 76], 10.00th=[ 22152], 20.00th=[ 33424], | 30.00th=[ 40109], 40.00th=[ 47973], 50.00th=[ 55837], 60.00th=[ 64226], | 70.00th=[ 71828], 80.00th=[ 82314], 90.00th=[105382], 95.00th=[135267], | 99.00th=[227541], 99.50th=[283116], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 285, per=25.30%, avg=138.12, stdev=54.41, samples=82 iops : min= 1, max= 17, avg= 7.84, stdev= 3.47, samples=82 write: IOPS=9, BW=147KiB/s (151kB/s)(6368KiB/43191msec); 0 zone resets clat (usec): min=1779, max=272540, avg=51689.84, stdev=47994.75 lat (usec): min=1783, max=272545, avg=51693.52, stdev=47994.91 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 2474], 10.00th=[ 4293], 20.00th=[ 9503], | 30.00th=[ 15270], 40.00th=[ 27395], 50.00th=[ 39584], 60.00th=[ 52691], | 70.00th=[ 68682], 80.00th=[ 85459], 90.00th=[115868], 95.00th=[145753], | 99.00th=[204473], 99.50th=[270533], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 25, max= 344, per=25.81%, avg=148.40, stdev=65.40, samples=83 iops : min= 1, max= 21, avg= 8.48, stdev= 4.09, samples=83 lat (usec) : 50=0.13%, 100=2.86%, 250=0.26%, 500=0.13% lat (msec) : 2=1.43%, 4=3.78%, 10=5.99%, 20=7.16%, 50=27.60% lat (msec) : 100=37.63%, 250=12.50%, 500=0.52% cpu : usr=0.05%, sys=4.35%, ctx=1789, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179255: Thu Sep 10 14:54:29 2026 read: IOPS=8, BW=137KiB/s (140kB/s)(5744KiB/41910msec) clat (usec): min=50, max=235740, avg=61438.58, stdev=39738.07 lat (usec): min=51, max=235741, avg=61440.04, stdev=39738.24 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 78], 10.00th=[ 9241], 20.00th=[ 32113], | 30.00th=[ 40633], 40.00th=[ 49546], 50.00th=[ 57410], 60.00th=[ 65274], | 70.00th=[ 76022], 80.00th=[ 88605], 90.00th=[107480], 95.00th=[130548], | 99.00th=[198181], 99.50th=[233833], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 31, max= 283, per=25.33%, avg=138.32, stdev=57.15, samples=81 iops : min= 1, max= 17, avg= 7.85, stdev= 3.62, samples=81 write: IOPS=9, BW=156KiB/s (160kB/s)(6544KiB/41910msec); 0 zone resets clat (usec): min=1635, max=226929, avg=48421.75, stdev=46564.33 lat (usec): min=1638, max=226932, avg=48433.05, stdev=46577.33 clat percentiles (usec): | 1.00th=[ 1942], 5.00th=[ 2835], 10.00th=[ 4424], 20.00th=[ 8455], | 30.00th=[ 14222], 40.00th=[ 24773], 50.00th=[ 34866], 60.00th=[ 46924], | 70.00th=[ 59507], 80.00th=[ 83362], 90.00th=[114820], 95.00th=[145753], | 99.00th=[200279], 99.50th=[219153], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 30, max= 318, per=27.09%, avg=155.78, stdev=70.39, samples=82 iops : min= 1, max= 19, avg= 8.95, stdev= 4.41, samples=82 lat (usec) : 100=3.91%, 250=0.39% lat (msec) : 2=0.91%, 4=4.04%, 10=7.55%, 20=8.20%, 50=27.34% lat (msec) : 100=33.20%, 250=14.45% cpu : usr=0.06%, sys=4.20%, ctx=1729, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179256: Thu Sep 10 14:54:29 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43791msec) clat (usec): min=50, max=193387, avg=61787.02, stdev=36765.56 lat (usec): min=50, max=193388, avg=61788.66, stdev=36765.72 clat percentiles (usec): | 1.00th=[ 59], 5.00th=[ 85], 10.00th=[ 23200], 20.00th=[ 32900], | 30.00th=[ 39584], 40.00th=[ 47449], 50.00th=[ 57410], 60.00th=[ 64226], | 70.00th=[ 76022], 80.00th=[ 90702], 90.00th=[108528], 95.00th=[131597], | 99.00th=[164627], 99.50th=[187696], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 31, max= 345, per=26.19%, avg=142.99, stdev=61.97, samples=86 iops : min= 1, max= 21, avg= 8.14, stdev= 3.93, samples=86 write: IOPS=8, BW=138KiB/s (141kB/s)(6032KiB/43791msec); 0 zone resets clat (usec): min=1548, max=238626, avg=51828.69, stdev=47417.48 lat (usec): min=1550, max=238629, avg=51855.93, stdev=47426.58 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 3130], 10.00th=[ 4490], 20.00th=[ 8848], | 30.00th=[ 16057], 40.00th=[ 30802], 50.00th=[ 39584], 60.00th=[ 51119], | 70.00th=[ 63701], 80.00th=[ 86508], 90.00th=[121111], 95.00th=[141558], | 99.00th=[214959], 99.50th=[227541], 99.90th=[238027], 99.95th=[238027], | 99.99th=[238027] bw ( KiB/s): min= 30, max= 350, per=23.90%, avg=137.44, stdev=67.15, samples=86 iops : min= 1, max= 21, avg= 7.78, stdev= 4.21, samples=86 lat (usec) : 100=2.73%, 250=0.39%, 1000=0.13% lat (msec) : 2=0.91%, 4=2.86%, 10=6.77%, 20=7.03%, 50=29.95% lat (msec) : 100=34.24%, 250=14.97% cpu : usr=0.06%, sys=4.34%, ctx=1800, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179257: Thu Sep 10 14:54:29 2026 read: IOPS=9, BW=144KiB/s (148kB/s)(6032KiB/41835msec) clat (usec): min=54, max=300765, avg=61972.56, stdev=40454.42 lat (usec): min=55, max=300766, avg=61974.44, stdev=40454.52 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 80], 10.00th=[ 15664], 20.00th=[ 31851], | 30.00th=[ 41157], 40.00th=[ 47449], 50.00th=[ 55313], 60.00th=[ 64750], | 70.00th=[ 77071], 80.00th=[ 92799], 90.00th=[112722], 95.00th=[132645], | 99.00th=[196084], 99.50th=[219153], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 31, max= 284, per=26.23%, avg=143.21, stdev=62.71, samples=82 iops : min= 1, max= 17, avg= 8.16, stdev= 3.94, samples=82 write: IOPS=9, BW=150KiB/s (153kB/s)(6256KiB/41835msec); 0 zone resets clat (usec): min=1709, max=247699, avg=46997.30, stdev=45612.31 lat (usec): min=1713, max=247702, avg=47011.99, stdev=45624.18 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3687], 10.00th=[ 5669], 20.00th=[ 9372], | 30.00th=[ 14222], 40.00th=[ 23462], 50.00th=[ 31065], 60.00th=[ 44303], | 70.00th=[ 60031], 80.00th=[ 80217], 90.00th=[109577], 95.00th=[141558], | 99.00th=[189793], 99.50th=[198181], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 31, max= 382, per=26.34%, avg=151.44, stdev=73.84, samples=81 iops : min= 1, max= 23, avg= 8.68, stdev= 4.64, samples=81 lat (usec) : 100=3.78%, 250=0.26%, 500=0.26%, 750=0.13% lat (msec) : 2=1.04%, 4=1.95%, 10=8.59%, 20=7.94%, 50=28.91% lat (msec) : 100=33.20%, 250=13.80%, 500=0.13% cpu : usr=0.06%, sys=4.36%, ctx=1802, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=547KiB/s (560kB/s), 137KiB/s-144KiB/s (140kB/s-148kB/s), io=23.4MiB (24.5MB), run=41835-43791msec WRITE: bw=575KiB/s (589kB/s), 138KiB/s-156KiB/s (141kB/s-160kB/s), io=24.6MiB (25.8MB), run=41835-43791msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179248: Thu Sep 10 14:54:40 2026 read: IOPS=6, BW=106KiB/s (108kB/s)(5920KiB/56028msec) clat (msec): min=8, max=266, avg=56.44, stdev=50.73 lat (msec): min=8, max=266, avg=56.45, stdev=50.73 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 58], 80.00th=[ 82], 90.00th=[ 123], 95.00th=[ 176], | 99.00th=[ 255], 99.50th=[ 264], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 512, per=25.99%, avg=110.98, stdev=87.52, samples=104 iops : min= 1, max= 32, avg= 6.12, stdev= 5.57, samples=104 write: IOPS=7, BW=114KiB/s (116kB/s)(6368KiB/56028msec); 0 zone resets clat (msec): min=11, max=338, avg=87.80, stdev=67.45 lat (msec): min=11, max=338, avg=87.82, stdev=67.46 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 44], 40.00th=[ 51], 50.00th=[ 64], 60.00th=[ 79], | 70.00th=[ 104], 80.00th=[ 136], 90.00th=[ 186], 95.00th=[ 239], | 99.00th=[ 321], 99.50th=[ 330], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 412, per=25.32%, avg=113.67, stdev=77.13, samples=109 iops : min= 1, max= 25, avg= 6.29, stdev= 4.94, samples=109 lat (msec) : 10=0.39%, 20=10.42%, 50=39.45%, 100=26.30%, 250=20.57% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.61%, ctx=1185, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179249: Thu Sep 10 14:54:40 2026 read: IOPS=6, BW=104KiB/s (107kB/s)(5744KiB/55061msec) clat (msec): min=10, max=343, avg=57.95, stdev=50.99 lat (msec): min=10, max=343, avg=57.95, stdev=50.99 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 41], 60.00th=[ 50], | 70.00th=[ 62], 80.00th=[ 84], 90.00th=[ 125], 95.00th=[ 174], | 99.00th=[ 253], 99.50th=[ 284], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 30, max= 413, per=26.15%, avg=111.65, stdev=76.10, samples=101 iops : min= 1, max= 25, avg= 6.16, stdev= 4.87, samples=101 write: IOPS=7, BW=119KiB/s (122kB/s)(6544KiB/55061msec); 0 zone resets clat (msec): min=14, max=447, avg=83.27, stdev=57.95 lat (msec): min=14, max=447, avg=83.27, stdev=57.95 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 54], 50.00th=[ 63], 60.00th=[ 81], | 70.00th=[ 100], 80.00th=[ 126], 90.00th=[ 159], 95.00th=[ 192], | 99.00th=[ 292], 99.50th=[ 305], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 30, max= 412, per=27.05%, avg=121.44, stdev=76.47, samples=105 iops : min= 1, max= 25, avg= 6.77, stdev= 4.88, samples=105 lat (msec) : 20=6.90%, 50=41.28%, 100=29.56%, 250=20.70%, 500=1.56% cpu : usr=0.04%, sys=1.68%, ctx=1099, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179250: Thu Sep 10 14:54:40 2026 read: IOPS=7, BW=113KiB/s (115kB/s)(6256KiB/55541msec) clat (msec): min=8, max=288, avg=56.30, stdev=50.09 lat (msec): min=8, max=288, avg=56.30, stdev=50.09 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 39], 60.00th=[ 48], | 70.00th=[ 62], 80.00th=[ 80], 90.00th=[ 117], 95.00th=[ 169], | 99.00th=[ 257], 99.50th=[ 266], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 415, per=27.04%, avg=115.46, stdev=85.45, samples=106 iops : min= 1, max= 25, avg= 6.40, stdev= 5.43, samples=106 write: IOPS=6, BW=109KiB/s (111kB/s)(6032KiB/55541msec); 0 zone resets clat (msec): min=16, max=456, avg=88.44, stdev=64.99 lat (msec): min=16, max=456, avg=88.44, stdev=64.98 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 55], 50.00th=[ 67], 60.00th=[ 83], | 70.00th=[ 107], 80.00th=[ 134], 90.00th=[ 184], 95.00th=[ 224], | 99.00th=[ 296], 99.50th=[ 355], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 30, max= 351, per=24.58%, avg=110.38, stdev=73.12, samples=106 iops : min= 1, max= 21, avg= 6.07, stdev= 4.67, samples=106 lat (msec) : 10=0.65%, 20=9.38%, 50=39.06%, 100=28.26%, 250=20.70% lat (msec) : 500=1.95% cpu : usr=0.06%, sys=1.65%, ctx=1224, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179251: Thu Sep 10 14:54:40 2026 read: IOPS=6, BW=108KiB/s (111kB/s)(6032KiB/55777msec) clat (msec): min=7, max=281, avg=59.66, stdev=52.09 lat (msec): min=7, max=281, avg=59.66, stdev=52.09 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 51], | 70.00th=[ 63], 80.00th=[ 92], 90.00th=[ 138], 95.00th=[ 182], | 99.00th=[ 228], 99.50th=[ 266], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 30, max= 380, per=25.87%, avg=110.45, stdev=80.18, samples=105 iops : min= 1, max= 23, avg= 6.07, stdev= 5.10, samples=105 write: IOPS=7, BW=112KiB/s (115kB/s)(6256KiB/55777msec); 0 zone resets clat (msec): min=15, max=476, avg=84.91, stdev=60.99 lat (msec): min=15, max=476, avg=84.92, stdev=60.99 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 46], 40.00th=[ 55], 50.00th=[ 65], 60.00th=[ 79], | 70.00th=[ 105], 80.00th=[ 128], 90.00th=[ 167], 95.00th=[ 201], | 99.00th=[ 279], 99.50th=[ 347], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 30, max= 413, per=24.93%, avg=111.95, stdev=73.71, samples=107 iops : min= 1, max= 25, avg= 6.18, stdev= 4.70, samples=107 lat (msec) : 10=0.78%, 20=8.20%, 50=38.54%, 100=27.99%, 250=23.18% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.68%, ctx=1203, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=428KiB/s (438kB/s), 104KiB/s-113KiB/s (107kB/s-115kB/s), io=23.4MiB (24.5MB), run=55061-56028msec WRITE: bw=450KiB/s (461kB/s), 109KiB/s-119KiB/s (111kB/s-122kB/s), io=24.6MiB (25.8MB), run=55061-56028msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179270: Thu Sep 10 14:54:56 2026 read: IOPS=2, BW=2385KiB/s (2442kB/s)(7168KiB/3006msec) clat (msec): min=74, max=633, avg=189.34, stdev=206.44 lat (msec): min=74, max=633, avg=189.34, stdev=206.44 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 77], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 97], 60.00th=[ 102], | 70.00th=[ 102], 80.00th=[ 259], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1799, max= 8175, per=87.58%, avg=3928.67, stdev=3677.44, samples=3 iops : min= 1, max= 7, avg= 3.00, stdev= 3.46, samples=3 write: IOPS=1, BW=1703KiB/s (1744kB/s)(5120KiB/3006msec); 0 zone resets clat (msec): min=69, max=697, avg=327.52, stdev=292.27 lat (msec): min=69, max=697, avg=327.61, stdev=292.28 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1799, max= 4087, per=39.10%, avg=2455.25, stdev=1092.47, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=41.67%, 250=25.00%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=4.66%, ctx=73, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179271: Thu Sep 10 14:54:56 2026 read: IOPS=0, BW=449KiB/s (459kB/s)(2048KiB/4565msec) clat (msec): min=89, max=273, avg=181.72, stdev=129.76 lat (msec): min=89, max=273, avg=181.72, stdev=129.76 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 2039, max= 2043, per=45.50%, avg=2041.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2243KiB/s (2297kB/s)(10.0MiB/4565msec); 0 zone resets clat (msec): min=114, max=1095, avg=406.72, stdev=296.29 lat (msec): min=114, max=1095, avg=406.84, stdev=296.29 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 144], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 264], 60.00th=[ 313], | 70.00th=[ 518], 80.00th=[ 542], 90.00th=[ 609], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 1799, max= 4079, per=40.55%, avg=2546.67, stdev=1024.42, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=7.12%, ctx=94, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179272: Thu Sep 10 14:54:56 2026 read: IOPS=1, BW=1532KiB/s (1569kB/s)(6144KiB/4010msec) clat (msec): min=136, max=710, avg=322.18, stdev=217.87 lat (msec): min=136, max=710, avg=322.18, stdev=217.87 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 192], 50.00th=[ 192], 60.00th=[ 300], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 1882, max= 3785, per=69.04%, avg=3097.00, stdev=1055.30, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1532KiB/s (1569kB/s)(6144KiB/4010msec); 0 zone resets clat (msec): min=104, max=740, avg=325.84, stdev=257.70 lat (msec): min=104, max=740, avg=326.01, stdev=257.63 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 125], | 30.00th=[ 125], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 313], | 70.00th=[ 527], 80.00th=[ 527], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1799, max= 6083, per=46.23%, avg=2903.00, stdev=2120.34, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=25.00% cpu : usr=0.02%, sys=3.49%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179273: Thu Sep 10 14:54:56 2026 read: IOPS=1, BW=1415KiB/s (1449kB/s)(5120KiB/3619msec) clat (msec): min=124, max=559, avg=249.60, stdev=177.06 lat (msec): min=124, max=559, avg=249.60, stdev=177.06 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 126], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 224], 80.00th=[ 224], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1695, max= 6107, per=86.96%, avg=3901.00, stdev=3119.76, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1981KiB/s (2028kB/s)(7168KiB/3619msec); 0 zone resets clat (msec): min=82, max=821, avg=318.13, stdev=314.17 lat (msec): min=83, max=821, avg=319.02, stdev=315.18 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 102], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 174], 60.00th=[ 178], | 70.00th=[ 178], 80.00th=[ 726], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 3657, max= 5580, per=73.54%, avg=4618.50, stdev=1359.77, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 lat (msec) : 100=8.33%, 250=66.67%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=4.26%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4486KiB/s (4594kB/s), 449KiB/s-2385KiB/s (459kB/s-2442kB/s), io=20.0MiB (20.0MB), run=3006-4565msec WRITE: bw=6281KiB/s (6432kB/s), 1532KiB/s-2243KiB/s (1569kB/s-2297kB/s), io=28.0MiB (29.4MB), run=3006-4565msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179275: Thu Sep 10 14:54:56 2026 read: IOPS=2, BW=2138KiB/s (2190kB/s)(7168KiB/3352msec) clat (usec): min=618, max=259661, avg=160947.12, stdev=108080.19 lat (usec): min=619, max=259662, avg=160948.59, stdev=108080.19 clat percentiles (usec): | 1.00th=[ 619], 5.00th=[ 619], 10.00th=[ 619], 20.00th=[ 13173], | 30.00th=[189793], 40.00th=[189793], 50.00th=[198181], 60.00th=[219153], | 70.00th=[219153], 80.00th=[244319], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 2019, max= 4090, per=50.12%, avg=2543.75, stdev=1030.86, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1527KiB/s (1564kB/s)(5120KiB/3352msec); 0 zone resets clat (msec): min=270, max=672, avg=444.62, stdev=172.30 lat (msec): min=270, max=672, avg=444.87, stdev=172.24 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1787, max= 2035, per=27.71%, avg=1969.00, stdev=121.57, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 20=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.03%, sys=16.35%, ctx=196, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179276: Thu Sep 10 14:54:56 2026 read: IOPS=0, BW=508KiB/s (520kB/s)(2048KiB/4035msec) clat (msec): min=159, max=229, avg=194.49, stdev=49.38 lat (msec): min=159, max=229, avg=194.49, stdev=49.38 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 161], 50.00th=[ 161], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1436, max= 2035, per=34.20%, avg=1735.50, stdev=423.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2538KiB/s (2599kB/s)(10.0MiB/4035msec); 0 zone resets clat (msec): min=122, max=733, avg=363.78, stdev=230.72 lat (msec): min=125, max=733, avg=364.50, stdev=230.49 clat percentiles (msec): | 1.00th=[ 124], 5.00th=[ 124], 10.00th=[ 124], 20.00th=[ 161], | 30.00th=[ 163], 40.00th=[ 182], 50.00th=[ 211], 60.00th=[ 380], | 70.00th=[ 439], 80.00th=[ 567], 90.00th=[ 676], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1787, max= 4071, per=37.51%, avg=2665.00, stdev=1083.86, samples=6 iops : min= 1, max= 3, avg= 1.67, stdev= 1.03, samples=6 lat (msec) : 250=58.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=18.34%, ctx=220, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179277: Thu Sep 10 14:54:56 2026 read: IOPS=1, BW=1764KiB/s (1806kB/s)(6144KiB/3483msec) clat (usec): min=583, max=348768, avg=158688.52, stdev=135986.76 lat (usec): min=585, max=348770, avg=158689.85, stdev=135986.79 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 2278], | 30.00th=[ 2278], 40.00th=[181404], 50.00th=[181404], 60.00th=[185598], | 70.00th=[233833], 80.00th=[233833], 90.00th=[350225], 95.00th=[350225], | 99.00th=[350225], 99.50th=[350225], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 2035, max= 4063, per=63.53%, avg=3224.00, stdev=1058.33, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1764KiB/s (1806kB/s)(6144KiB/3483msec); 0 zone resets clat (msec): min=228, max=727, avg=419.68, stdev=169.09 lat (msec): min=228, max=727, avg=419.81, stdev=169.07 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 376], 50.00th=[ 376], 60.00th=[ 397], | 70.00th=[ 460], 80.00th=[ 460], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1622, max= 2035, per=27.04%, avg=1921.50, stdev=176.10, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=15.34%, ctx=214, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179278: Thu Sep 10 14:54:56 2026 read: IOPS=1, BW=1359KiB/s (1392kB/s)(5120KiB/3767msec) clat (usec): min=532, max=262407, avg=99591.77, stdev=134168.89 lat (usec): min=533, max=262407, avg=99593.02, stdev=134168.71 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 1860], 40.00th=[ 1860], 50.00th=[ 3556], 60.00th=[ 3556], | 70.00th=[229639], 80.00th=[229639], 90.00th=[263193], 95.00th=[263193], | 99.00th=[263193], 99.50th=[263193], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7148, max= 7148, per=100.00%, avg=7148.00, stdev= 0.00, samples=1 iops : min= 6, max= 6, avg= 6.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1903KiB/s (1949kB/s)(7168KiB/3767msec); 0 zone resets clat (msec): min=221, max=770, avg=466.61, stdev=194.39 lat (msec): min=221, max=770, avg=466.70, stdev=194.38 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 230], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 502], 60.00th=[ 518], | 70.00th=[ 518], 80.00th=[ 584], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 1477, max= 2035, per=26.32%, avg=1869.80, stdev=243.25, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 250=25.00%, 500=25.00%, 750=16.67% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=13.86%, ctx=179, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5076KiB/s (5197kB/s), 508KiB/s-2138KiB/s (520kB/s-2190kB/s), io=20.0MiB (20.0MB), run=3352-4035msec WRITE: bw=7106KiB/s (7276kB/s), 1527KiB/s-2538KiB/s (1564kB/s-2599kB/s), io=28.0MiB (29.4MB), run=3352-4035msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179285: Thu Sep 10 14:55:12 2026 read: IOPS=0, BW=2350KiB/s (2406kB/s)(12.0MiB/5230msec) clat (msec): min=336, max=3080, avg=1724.65, stdev=1372.40 lat (msec): min=336, max=3080, avg=1724.65, stdev=1372.40 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 1754], 50.00th=[ 1754], 60.00th=[ 1754], | 70.00th=[ 3071], 80.00th=[ 3071], 90.00th=[ 3071], 95.00th=[ 3071], | 99.00th=[ 3071], 99.50th=[ 3071], 99.90th=[ 3071], 99.95th=[ 3071], | 99.99th=[ 3071] bw ( KiB/s): min= 8126, max= 8192, per=100.00%, avg=8159.00, stdev=46.67, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.10%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179286: Thu Sep 10 14:55:12 2026 read: IOPS=0, BW=733KiB/s (750kB/s)(4096KiB/5589msec) clat (nsec): min=1549.0M, max=1549.0M, avg=1549013773.00, stdev= 0.00 lat (nsec): min=1549.0M, max=1549.0M, avg=1549015550.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1552], 5.00th=[ 1552], 10.00th=[ 1552], 20.00th=[ 1552], | 30.00th=[ 1552], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1466KiB/s (1501kB/s)(8192KiB/5589msec); 0 zone resets clat (msec): min=253, max=3470, avg=1861.88, stdev=2274.45 lat (msec): min=253, max=3470, avg=1862.42, stdev=2274.84 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 3473], | 70.00th=[ 3473], 80.00th=[ 3473], 90.00th=[ 3473], 95.00th=[ 3473], | 99.00th=[ 3473], 99.50th=[ 3473], 99.90th=[ 3473], 99.95th=[ 3473], | 99.99th=[ 3473] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.56%, ctx=74, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179288: Thu Sep 10 14:55:12 2026 write: IOPS=1, BW=4876KiB/s (4993kB/s)(12.0MiB/2520msec); 0 zone resets clat (msec): min=241, max=1095, avg=802.69, stdev=485.97 lat (msec): min=242, max=1096, avg=803.13, stdev=485.98 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.04%, sys=8.26%, ctx=102, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179290: Thu Sep 10 14:55:12 2026 write: IOPS=1, BW=4774KiB/s (4888kB/s)(12.0MiB/2574msec); 0 zone resets clat (msec): min=225, max=1663, avg=808.35, stdev=756.59 lat (msec): min=225, max=1663, avg=809.93, stdev=756.02 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min=16062, max=16062, per=100.00%, avg=16062.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.82%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2931KiB/s (3002kB/s), 733KiB/s-2350KiB/s (750kB/s-2406kB/s), io=16.0MiB (16.8MB), run=5230-5589msec WRITE: bw=5863KiB/s (6004kB/s), 1466KiB/s-4876KiB/s (1501kB/s-4993kB/s), io=32.0MiB (33.6MB), run=2520-5589msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179287: Thu Sep 10 14:55:13 2026 read: IOPS=0, BW=2373KiB/s (2430kB/s)(12.0MiB/5179msec) clat (msec): min=610, max=3443, avg=1632.12, stdev=1573.06 lat (msec): min=610, max=3443, avg=1632.13, stdev=1573.06 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 3440], 80.00th=[ 3440], 90.00th=[ 3440], 95.00th=[ 3440], | 99.00th=[ 3440], 99.50th=[ 3440], 99.90th=[ 3440], 99.95th=[ 3440], | 99.99th=[ 3440] bw ( KiB/s): min= 8078, max= 8175, per=100.00%, avg=8126.50, stdev=68.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=7.59%, ctx=629, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179289: Thu Sep 10 14:55:13 2026 read: IOPS=0, BW=690KiB/s (706kB/s)(4096KiB/5937msec) clat (nsec): min=789393k, max=789393k, avg=789393115.00, stdev= 0.00 lat (nsec): min=789396k, max=789396k, avg=789395698.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 793], 50.00th=[ 793], 60.00th=[ 793], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1380KiB/s (1413kB/s)(8192KiB/5937msec); 0 zone resets clat (msec): min=738, max=4337, avg=2538.13, stdev=2544.85 lat (msec): min=739, max=4341, avg=2540.28, stdev=2547.28 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 743], 50.00th=[ 743], 60.00th=[ 4329], | 70.00th=[ 4329], 80.00th=[ 4329], 90.00th=[ 4329], 95.00th=[ 4329], | 99.00th=[ 4329], 99.50th=[ 4329], 99.90th=[ 4329], 99.95th=[ 4329], | 99.99th=[ 4329] bw ( KiB/s): min= 7907, max= 7907, per=100.00%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.14%, ctx=95, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179291: Thu Sep 10 14:55:13 2026 write: IOPS=0, BW=2029KiB/s (2078kB/s)(12.0MiB/6055msec); 0 zone resets clat (msec): min=480, max=3578, avg=1999.54, stdev=1549.95 lat (msec): min=480, max=3580, avg=2000.36, stdev=1550.67 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 7984, max= 8126, per=100.00%, avg=8055.00, stdev=100.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=1.77%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179292: Thu Sep 10 14:55:13 2026 write: IOPS=1, BW=5435KiB/s (5565kB/s)(12.0MiB/2261msec); 0 zone resets clat (msec): min=256, max=1655, avg=729.08, stdev=801.97 lat (msec): min=256, max=1655, avg=729.48, stdev=802.00 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 7787, max= 8078, per=100.00%, avg=7932.50, stdev=205.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.09%, sys=5.13%, ctx=55, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2760KiB/s (2826kB/s), 690KiB/s-2373KiB/s (706kB/s-2430kB/s), io=16.0MiB (16.8MB), run=5179-5937msec WRITE: bw=5412KiB/s (5542kB/s), 1380KiB/s-5435KiB/s (1413kB/s-5565kB/s), io=32.0MiB (33.6MB), run=2261-6055msec