== sanity test 398b: DIO and buffer IO race ============== 20:29:38 (1763342978) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.46708 s, 9.2 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184700: Sun Nov 16 20:31:29 2025 read: IOPS=15, BW=62.9KiB/s (64.4kB/s)(5992KiB/95244msec) clat (usec): min=117, max=210081, avg=35423.19, stdev=21255.95 lat (usec): min=117, max=210082, avg=35424.99, stdev=21256.17 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 11863], 10.00th=[ 15533], 20.00th=[ 19268], | 30.00th=[ 23200], 40.00th=[ 26870], 50.00th=[ 31327], 60.00th=[ 35914], | 70.00th=[ 41681], 80.00th=[ 49021], 90.00th=[ 61080], 95.00th=[ 73925], | 99.00th=[108528], 99.50th=[116917], 99.90th=[191890], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 15, max= 134, per=24.85%, avg=62.61, stdev=20.45, samples=187 iops : min= 3, max= 33, avg=15.03, stdev= 5.14, samples=187 write: IOPS=16, BW=66.1KiB/s (67.7kB/s)(6296KiB/95244msec); 0 zone resets clat (usec): min=913, max=653477, avg=26522.51, stdev=31900.95 lat (usec): min=914, max=653479, avg=26524.23, stdev=31900.88 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1287], 20.00th=[ 2442], | 30.00th=[ 5669], 40.00th=[ 11469], 50.00th=[ 19530], 60.00th=[ 25297], | 70.00th=[ 33162], 80.00th=[ 46400], 90.00th=[ 64226], 95.00th=[ 80217], | 99.00th=[122160], 99.50th=[154141], 99.90th=[265290], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 173, per=25.01%, avg=65.78, stdev=24.66, samples=187 iops : min= 1, max= 43, avg=15.82, stdev= 6.20, samples=187 lat (usec) : 250=0.88%, 500=0.23%, 750=0.03%, 1000=0.36% lat (msec) : 2=8.89%, 4=3.81%, 10=7.45%, 20=14.81%, 50=45.77% lat (msec) : 100=15.92%, 250=1.79%, 500=0.03%, 750=0.03% cpu : usr=0.10%, sys=7.29%, ctx=6692, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184701: Sun Nov 16 20:31:29 2025 read: IOPS=15, BW=63.2KiB/s (64.7kB/s)(5940KiB/94000msec) clat (usec): min=119, max=986655, avg=36031.86, stdev=32667.89 lat (usec): min=119, max=986656, avg=36038.31, stdev=32667.74 clat percentiles (usec): | 1.00th=[ 161], 5.00th=[ 11600], 10.00th=[ 14877], 20.00th=[ 19530], | 30.00th=[ 23200], 40.00th=[ 27395], 50.00th=[ 31327], 60.00th=[ 35390], | 70.00th=[ 41681], 80.00th=[ 50070], 90.00th=[ 60556], 95.00th=[ 71828], | 99.00th=[112722], 99.50th=[141558], 99.90th=[206570], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 15, max= 119, per=24.98%, avg=62.95, stdev=19.70, samples=184 iops : min= 3, max= 29, avg=15.11, stdev= 4.96, samples=184 write: IOPS=16, BW=67.5KiB/s (69.2kB/s)(6348KiB/94000msec); 0 zone resets clat (usec): min=926, max=268081, avg=25246.80, stdev=26202.50 lat (usec): min=927, max=268083, avg=25249.48, stdev=26202.61 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 2540], | 30.00th=[ 5800], 40.00th=[ 11731], 50.00th=[ 19006], 60.00th=[ 24511], | 70.00th=[ 32375], 80.00th=[ 43254], 90.00th=[ 61080], 95.00th=[ 77071], | 99.00th=[107480], 99.50th=[121111], 99.90th=[242222], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 15, max= 143, per=25.66%, avg=67.48, stdev=24.63, samples=183 iops : min= 3, max= 35, avg=16.25, stdev= 6.21, samples=183 lat (usec) : 250=1.27%, 500=0.23%, 750=0.07%, 1000=0.33% lat (msec) : 2=8.82%, 4=4.04%, 10=6.71%, 20=15.53%, 50=45.25% lat (msec) : 100=16.18%, 250=1.53%, 500=0.03%, 1000=0.03% cpu : usr=0.11%, sys=7.27%, ctx=6630, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184702: Sun Nov 16 20:31:29 2025 read: IOPS=15, BW=63.4KiB/s (64.9kB/s)(6028KiB/95066msec) clat (usec): min=121, max=209884, avg=35685.55, stdev=23097.47 lat (usec): min=122, max=209885, avg=35687.08, stdev=23097.63 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 10159], 10.00th=[ 13960], 20.00th=[ 19006], | 30.00th=[ 22676], 40.00th=[ 26870], 50.00th=[ 31065], 60.00th=[ 36439], | 70.00th=[ 42206], 80.00th=[ 49546], 90.00th=[ 61080], 95.00th=[ 74974], | 99.00th=[126354], 99.50th=[147850], 99.90th=[202376], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 15, max= 126, per=25.19%, avg=63.47, stdev=19.60, samples=185 iops : min= 3, max= 31, avg=15.24, stdev= 4.97, samples=185 write: IOPS=16, BW=65.8KiB/s (67.4kB/s)(6260KiB/95066msec); 0 zone resets clat (usec): min=882, max=953800, avg=26128.72, stdev=35277.90 lat (usec): min=883, max=953802, avg=26130.61, stdev=35278.22 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 2573], | 30.00th=[ 5800], 40.00th=[ 11731], 50.00th=[ 19006], 60.00th=[ 24773], | 70.00th=[ 32113], 80.00th=[ 44303], 90.00th=[ 61604], 95.00th=[ 77071], | 99.00th=[114820], 99.50th=[122160], 99.90th=[227541], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 181, per=24.91%, avg=65.51, stdev=25.43, samples=186 iops : min= 1, max= 45, avg=15.76, stdev= 6.40, samples=186 lat (usec) : 250=1.33%, 500=0.29%, 750=0.03%, 1000=0.36% lat (msec) : 2=8.63%, 4=3.68%, 10=7.62%, 20=15.72%, 50=44.63% lat (msec) : 100=15.89%, 250=1.79%, 1000=0.03% cpu : usr=0.10%, sys=7.45%, ctx=6572, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184703: Sun Nov 16 20:31:29 2025 read: IOPS=16, BW=64.2KiB/s (65.7kB/s)(6052KiB/94329msec) clat (usec): min=116, max=227297, avg=34665.76, stdev=22301.85 lat (usec): min=116, max=227299, avg=34668.05, stdev=22300.85 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 8848], 10.00th=[ 13698], 20.00th=[ 18220], | 30.00th=[ 21890], 40.00th=[ 25822], 50.00th=[ 30802], 60.00th=[ 35914], | 70.00th=[ 41157], 80.00th=[ 47973], 90.00th=[ 61604], 95.00th=[ 71828], | 99.00th=[108528], 99.50th=[137364], 99.90th=[187696], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 8, max= 157, per=25.34%, avg=63.85, stdev=21.36, samples=185 iops : min= 2, max= 39, avg=15.35, stdev= 5.37, samples=185 write: IOPS=16, BW=66.1KiB/s (67.7kB/s)(6236KiB/94329msec); 0 zone resets clat (usec): min=968, max=936924, avg=26610.20, stdev=34232.95 lat (usec): min=969, max=936925, avg=26611.77, stdev=34232.97 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1319], 20.00th=[ 2769], | 30.00th=[ 6652], 40.00th=[ 14353], 50.00th=[ 20317], 60.00th=[ 26346], | 70.00th=[ 33817], 80.00th=[ 45876], 90.00th=[ 60031], 95.00th=[ 72877], | 99.00th=[106431], 99.50th=[124257], 99.90th=[204473], 99.95th=[935330], | 99.99th=[935330] bw ( KiB/s): min= 15, max= 173, per=25.01%, avg=65.77, stdev=26.28, samples=185 iops : min= 3, max= 43, avg=15.82, stdev= 6.63, samples=185 lat (usec) : 250=1.63%, 500=0.33%, 750=0.10%, 1000=0.07% lat (msec) : 2=8.43%, 4=3.68%, 10=6.18%, 20=17.32%, 50=44.50% lat (msec) : 100=16.28%, 250=1.46%, 1000=0.03% cpu : usr=0.10%, sys=7.29%, ctx=6640, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=252KiB/s (258kB/s), 62.9KiB/s-64.2KiB/s (64.4kB/s-65.7kB/s), io=23.4MiB (24.6MB), run=94000-95244msec WRITE: bw=264KiB/s (270kB/s), 65.8KiB/s-67.5KiB/s (67.4kB/s-69.2kB/s), io=24.6MiB (25.7MB), run=94000-95244msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184705: Sun Nov 16 20:31:58 2025 read: IOPS=12, BW=48.6KiB/s (49.7kB/s)(5992KiB/123413msec) clat (msec): min=4, max=718, avg=32.47, stdev=36.29 lat (msec): min=4, max=718, avg=32.48, stdev=36.29 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 32], 80.00th=[ 46], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 292], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 7, max= 159, per=25.07%, avg=48.64, stdev=33.82, samples=241 iops : min= 1, max= 39, avg=11.49, stdev= 8.50, samples=241 write: IOPS=12, BW=51.0KiB/s (52.2kB/s)(6296KiB/123413msec); 0 zone resets clat (msec): min=9, max=307, avg=47.41, stdev=33.65 lat (msec): min=9, max=307, avg=47.42, stdev=33.64 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 43], | 70.00th=[ 57], 80.00th=[ 73], 90.00th=[ 94], 95.00th=[ 112], | 99.00th=[ 159], 99.50th=[ 182], 99.90th=[ 275], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 151, per=24.96%, avg=50.67, stdev=33.98, samples=243 iops : min= 1, max= 37, avg=11.99, stdev= 8.53, samples=243 lat (msec) : 10=5.34%, 20=26.92%, 50=41.15%, 100=19.92%, 250=6.54% lat (msec) : 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=2.63%, ctx=4996, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184706: Sun Nov 16 20:31:58 2025 read: IOPS=12, BW=48.8KiB/s (49.0kB/s)(5940KiB/121692msec) clat (msec): min=5, max=999, avg=31.95, stdev=38.51 lat (msec): min=5, max=999, avg=31.95, stdev=38.51 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 93], | 99.00th=[ 157], 99.50th=[ 171], 99.90th=[ 224], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 7, max= 174, per=25.32%, avg=49.12, stdev=33.46, samples=236 iops : min= 1, max= 43, avg=11.60, stdev= 8.40, samples=236 write: IOPS=13, BW=52.2KiB/s (53.4kB/s)(6348KiB/121692msec); 0 zone resets clat (msec): min=8, max=252, avg=46.67, stdev=31.81 lat (msec): min=8, max=252, avg=46.68, stdev=31.81 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 23], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 90], 95.00th=[ 108], | 99.00th=[ 157], 99.50th=[ 176], 99.90th=[ 241], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 7, max= 151, per=25.60%, avg=51.96, stdev=31.79, samples=238 iops : min= 1, max= 37, avg=12.31, stdev= 7.98, samples=238 lat (msec) : 10=5.05%, 20=25.13%, 50=43.39%, 100=21.22%, 250=5.14% lat (msec) : 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=2.72%, ctx=4873, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184707: Sun Nov 16 20:31:58 2025 read: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6028KiB/122509msec) clat (msec): min=4, max=219, avg=31.58, stdev=29.35 lat (msec): min=4, max=219, avg=31.58, stdev=29.35 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 70], 95.00th=[ 92], | 99.00th=[ 150], 99.50th=[ 169], 99.90th=[ 201], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 7, max= 159, per=25.37%, avg=49.22, stdev=33.05, samples=239 iops : min= 1, max= 39, avg=11.63, stdev= 8.30, samples=239 write: IOPS=12, BW=51.1KiB/s (52.3kB/s)(6260KiB/122509msec); 0 zone resets clat (msec): min=9, max=1014, avg=47.79, stdev=41.54 lat (msec): min=9, max=1017, avg=47.80, stdev=41.58 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 56], 80.00th=[ 72], 90.00th=[ 93], 95.00th=[ 113], | 99.00th=[ 153], 99.50th=[ 182], 99.90th=[ 313], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 143, per=24.98%, avg=50.71, stdev=33.91, samples=241 iops : min= 1, max= 35, avg=12.00, stdev= 8.51, samples=241 lat (msec) : 10=4.85%, 20=26.17%, 50=43.16%, 100=19.89%, 250=5.76% lat (msec) : 500=0.13%, 2000=0.03% cpu : usr=0.10%, sys=2.61%, ctx=4856, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184708: Sun Nov 16 20:31:58 2025 read: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6052KiB/122694msec) clat (msec): min=4, max=298, avg=30.55, stdev=29.12 lat (msec): min=4, max=298, avg=30.55, stdev=29.12 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 45], 90.00th=[ 69], 95.00th=[ 89], | 99.00th=[ 146], 99.50th=[ 163], 99.90th=[ 222], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 7, max= 166, per=25.39%, avg=49.26, stdev=34.55, samples=239 iops : min= 1, max= 41, avg=11.64, stdev= 8.67, samples=239 write: IOPS=12, BW=50.8KiB/s (52.0kB/s)(6236KiB/122694msec); 0 zone resets clat (msec): min=8, max=991, avg=48.98, stdev=42.62 lat (msec): min=8, max=991, avg=48.98, stdev=42.62 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 44], | 70.00th=[ 59], 80.00th=[ 73], 90.00th=[ 95], 95.00th=[ 116], | 99.00th=[ 167], 99.50th=[ 215], 99.90th=[ 321], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 7, max= 151, per=24.78%, avg=50.30, stdev=31.94, samples=241 iops : min= 1, max= 37, avg=11.90, stdev= 8.02, samples=241 lat (msec) : 10=5.76%, 20=26.20%, 50=41.99%, 100=19.82%, 250=6.02% lat (msec) : 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=2.70%, ctx=4959, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=195KiB/s (199kB/s), 48.6KiB/s-49.3KiB/s (49.7kB/s-50.5kB/s), io=23.4MiB (24.6MB), run=121692-123413msec WRITE: bw=204KiB/s (209kB/s), 50.8KiB/s-52.2KiB/s (52.0kB/s-53.4kB/s), io=24.6MiB (25.7MB), run=121692-123413msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184752: Sun Nov 16 20:32:40 2025 read: IOPS=11, BW=183KiB/s (188kB/s)(5920KiB/32313msec) clat (usec): min=141, max=225637, avg=46149.17, stdev=29757.66 lat (usec): min=142, max=225639, avg=46150.91, stdev=29757.62 clat percentiles (usec): | 1.00th=[ 172], 5.00th=[ 269], 10.00th=[ 16909], 20.00th=[ 23200], | 30.00th=[ 28705], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 46924], | 70.00th=[ 55837], 80.00th=[ 66847], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[143655], 99.50th=[185598], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 62, max= 350, per=25.54%, avg=182.10, stdev=65.81, samples=63 iops : min= 3, max= 21, avg=10.60, stdev= 4.13, samples=63 write: IOPS=12, BW=197KiB/s (202kB/s)(6368KiB/32313msec); 0 zone resets clat (usec): min=1439, max=189508, avg=38097.38, stdev=35001.80 lat (usec): min=1442, max=189511, avg=38100.64, stdev=35004.42 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1909], 10.00th=[ 2704], 20.00th=[ 6915], | 30.00th=[ 14877], 40.00th=[ 21627], 50.00th=[ 28443], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 62129], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[156238], 99.50th=[170918], 99.90th=[189793], 99.95th=[189793], | 99.99th=[189793] bw ( KiB/s): min= 31, max= 375, per=26.23%, avg=197.02, stdev=77.98, samples=63 iops : min= 1, max= 23, avg=11.57, stdev= 4.94, samples=63 lat (usec) : 250=2.34%, 500=0.26%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.26%, 4=4.82%, 10=5.08%, 20=9.24%, 50=42.58% lat (msec) : 100=26.30%, 250=5.86% cpu : usr=0.10%, sys=6.99%, ctx=1812, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184753: Sun Nov 16 20:32:40 2025 read: IOPS=11, BW=178KiB/s (182kB/s)(5744KiB/32324msec) clat (usec): min=165, max=212433, avg=48098.11, stdev=30465.48 lat (usec): min=167, max=212434, avg=48100.49, stdev=30465.34 clat percentiles (usec): | 1.00th=[ 190], 5.00th=[ 15401], 10.00th=[ 20317], 20.00th=[ 25560], | 30.00th=[ 31851], 40.00th=[ 35914], 50.00th=[ 41681], 60.00th=[ 49021], | 70.00th=[ 55313], 80.00th=[ 65799], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[177210], 99.50th=[206570], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 344, per=24.89%, avg=177.46, stdev=71.09, samples=63 iops : min= 1, max= 21, avg=10.32, stdev= 4.51, samples=63 write: IOPS=12, BW=202KiB/s (207kB/s)(6544KiB/32324msec); 0 zone resets clat (usec): min=1458, max=181122, avg=36624.10, stdev=34068.69 lat (usec): min=1460, max=181124, avg=36632.34, stdev=34066.04 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1811], 10.00th=[ 2008], 20.00th=[ 6849], | 30.00th=[ 13173], 40.00th=[ 19792], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 46924], 80.00th=[ 65274], 90.00th=[ 87557], 95.00th=[104334], | 99.00th=[137364], 99.50th=[156238], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 444, per=26.82%, avg=201.44, stdev=86.46, samples=63 iops : min= 1, max= 27, avg=11.84, stdev= 5.42, samples=63 lat (usec) : 250=1.17%, 500=0.26% lat (msec) : 2=5.34%, 4=2.60%, 10=5.86%, 20=10.94%, 50=41.93% lat (msec) : 100=26.30%, 250=5.60% cpu : usr=0.09%, sys=6.75%, ctx=1817, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184754: Sun Nov 16 20:32:40 2025 read: IOPS=11, BW=186KiB/s (191kB/s)(6256KiB/33548msec) clat (usec): min=105, max=240922, avg=47396.48, stdev=32646.90 lat (usec): min=105, max=240924, avg=47398.43, stdev=32646.72 clat percentiles (usec): | 1.00th=[ 155], 5.00th=[ 202], 10.00th=[ 13829], 20.00th=[ 24511], | 30.00th=[ 30278], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[104334], | 99.00th=[160433], 99.50th=[240124], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 30, max= 476, per=26.14%, avg=186.41, stdev=84.25, samples=66 iops : min= 1, max= 29, avg=10.88, stdev= 5.34, samples=66 write: IOPS=11, BW=180KiB/s (184kB/s)(6032KiB/33548msec); 0 zone resets clat (usec): min=1631, max=173219, avg=39712.83, stdev=35373.27 lat (usec): min=1634, max=173222, avg=39715.38, stdev=35373.26 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1926], 10.00th=[ 2442], 20.00th=[ 7373], | 30.00th=[ 16909], 40.00th=[ 24511], 50.00th=[ 30016], 60.00th=[ 38011], | 70.00th=[ 48497], 80.00th=[ 66847], 90.00th=[ 94897], 95.00th=[111674], | 99.00th=[154141], 99.50th=[170918], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 31, max= 351, per=23.76%, avg=178.44, stdev=75.82, samples=66 iops : min= 1, max= 21, avg=10.38, stdev= 4.80, samples=66 lat (usec) : 250=3.26%, 500=0.39% lat (msec) : 2=3.52%, 4=3.52%, 10=5.86%, 20=7.68%, 50=42.32% lat (msec) : 100=26.56%, 250=6.90% cpu : usr=0.08%, sys=6.58%, ctx=1870, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184755: Sun Nov 16 20:32:40 2025 read: IOPS=11, BW=183KiB/s (187kB/s)(6032KiB/33049msec) clat (usec): min=135, max=183863, avg=47574.65, stdev=32163.15 lat (usec): min=135, max=183864, avg=47576.13, stdev=32163.10 clat percentiles (usec): | 1.00th=[ 147], 5.00th=[ 188], 10.00th=[ 9896], 20.00th=[ 22938], | 30.00th=[ 30278], 40.00th=[ 37487], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 56886], 80.00th=[ 70779], 90.00th=[ 94897], 95.00th=[108528], | 99.00th=[143655], 99.50th=[154141], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 381, per=25.52%, avg=181.98, stdev=69.35, samples=65 iops : min= 1, max= 23, avg=10.60, stdev= 4.39, samples=65 write: IOPS=11, BW=189KiB/s (194kB/s)(6256KiB/33049msec); 0 zone resets clat (usec): min=1614, max=233584, avg=38384.55, stdev=36133.32 lat (usec): min=1615, max=233586, avg=38387.18, stdev=36133.10 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1811], 10.00th=[ 2376], 20.00th=[ 7963], | 30.00th=[ 14353], 40.00th=[ 21627], 50.00th=[ 28181], 60.00th=[ 37487], | 70.00th=[ 48497], 80.00th=[ 60556], 90.00th=[ 86508], 95.00th=[117965], | 99.00th=[164627], 99.50th=[187696], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 62, max= 384, per=25.58%, avg=192.14, stdev=75.42, samples=64 iops : min= 3, max= 24, avg=11.25, stdev= 4.79, samples=64 lat (usec) : 250=3.91%, 500=0.39% lat (msec) : 2=4.82%, 4=2.34%, 10=5.60%, 20=10.03%, 50=39.71% lat (msec) : 100=25.78%, 250=7.42% cpu : usr=0.09%, sys=6.82%, ctx=1832, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=714KiB/s (731kB/s), 178KiB/s-186KiB/s (182kB/s-191kB/s), io=23.4MiB (24.5MB), run=32313-33548msec WRITE: bw=751KiB/s (769kB/s), 180KiB/s-202KiB/s (184kB/s-207kB/s), io=24.6MiB (25.8MB), run=32313-33548msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184747: Sun Nov 16 20:32:48 2025 read: IOPS=8, BW=142KiB/s (145kB/s)(5920KiB/41678msec) clat (msec): min=6, max=372, avg=43.42, stdev=43.02 lat (msec): min=6, max=372, avg=43.43, stdev=43.02 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 100], 95.00th=[ 130], | 99.00th=[ 207], 99.50th=[ 259], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 30, max= 415, per=24.10%, avg=137.60, stdev=91.06, samples=81 iops : min= 1, max= 25, avg= 7.75, stdev= 5.74, samples=81 write: IOPS=9, BW=153KiB/s (156kB/s)(6368KiB/41678msec); 0 zone resets clat (msec): min=16, max=242, avg=64.19, stdev=41.78 lat (msec): min=16, max=242, avg=64.20, stdev=41.77 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 94], 90.00th=[ 120], 95.00th=[ 153], | 99.00th=[ 194], 99.50th=[ 241], 99.90th=[ 243], 99.95th=[ 243], | 99.99th=[ 243] bw ( KiB/s): min= 31, max= 443, per=24.99%, avg=150.16, stdev=87.13, samples=81 iops : min= 1, max= 27, avg= 8.54, stdev= 5.49, samples=81 lat (msec) : 10=0.91%, 20=15.76%, 50=44.01%, 100=25.39%, 250=13.67% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.31%, ctx=1215, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184748: Sun Nov 16 20:32:48 2025 read: IOPS=8, BW=137KiB/s (140kB/s)(5744KiB/41917msec) clat (msec): min=6, max=216, avg=42.42, stdev=37.35 lat (msec): min=6, max=216, avg=42.42, stdev=37.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 99], 95.00th=[ 129], | 99.00th=[ 167], 99.50th=[ 215], 99.90th=[ 218], 99.95th=[ 218], | 99.99th=[ 218] bw ( KiB/s): min= 29, max= 411, per=24.16%, avg=137.94, stdev=95.84, samples=80 iops : min= 1, max= 25, avg= 7.78, stdev= 6.03, samples=80 write: IOPS=9, BW=156KiB/s (160kB/s)(6544KiB/41917msec); 0 zone resets clat (msec): min=9, max=322, avg=64.85, stdev=47.43 lat (msec): min=9, max=322, avg=64.86, stdev=47.43 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 78], 80.00th=[ 101], 90.00th=[ 134], 95.00th=[ 159], | 99.00th=[ 205], 99.50th=[ 209], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 477, per=25.62%, avg=153.98, stdev=98.60, samples=81 iops : min= 1, max= 29, avg= 8.78, stdev= 6.19, samples=81 lat (msec) : 10=1.56%, 20=16.41%, 50=43.23%, 100=23.57%, 250=14.97% lat (msec) : 500=0.26% cpu : usr=0.08%, sys=2.05%, ctx=1253, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184749: Sun Nov 16 20:32:48 2025 read: IOPS=9, BW=151KiB/s (154kB/s)(6256KiB/41538msec) clat (msec): min=7, max=281, avg=42.25, stdev=38.44 lat (msec): min=7, max=281, avg=42.25, stdev=38.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 88], 95.00th=[ 132], | 99.00th=[ 188], 99.50th=[ 224], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 510, per=26.23%, avg=149.75, stdev=96.79, samples=81 iops : min= 1, max= 31, avg= 8.52, stdev= 6.09, samples=81 write: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41538msec); 0 zone resets clat (msec): min=13, max=328, avg=65.94, stdev=45.46 lat (msec): min=13, max=328, avg=65.95, stdev=45.46 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 93], 90.00th=[ 129], 95.00th=[ 163], | 99.00th=[ 199], 99.50th=[ 300], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 30, max= 411, per=23.98%, avg=144.12, stdev=82.78, samples=80 iops : min= 1, max= 25, avg= 8.16, stdev= 5.22, samples=80 lat (msec) : 10=0.91%, 20=15.49%, 50=45.83%, 100=25.52%, 250=11.85% lat (msec) : 500=0.39% cpu : usr=0.07%, sys=2.18%, ctx=1202, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184750: Sun Nov 16 20:32:48 2025 read: IOPS=9, BW=145KiB/s (148kB/s)(6032KiB/41623msec) clat (msec): min=7, max=278, avg=43.73, stdev=42.01 lat (msec): min=7, max=278, avg=43.74, stdev=42.01 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 101], 95.00th=[ 138], | 99.00th=[ 203], 99.50th=[ 247], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 478, per=25.10%, avg=143.32, stdev=91.62, samples=80 iops : min= 1, max= 29, avg= 8.11, stdev= 5.76, samples=80 write: IOPS=9, BW=150KiB/s (154kB/s)(6256KiB/41623msec); 0 zone resets clat (msec): min=14, max=351, avg=63.92, stdev=43.38 lat (msec): min=14, max=351, avg=63.92, stdev=43.38 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 90], 90.00th=[ 126], 95.00th=[ 148], | 99.00th=[ 209], 99.50th=[ 234], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 30, max= 415, per=25.24%, avg=151.67, stdev=86.67, samples=79 iops : min= 1, max= 25, avg= 8.63, stdev= 5.44, samples=79 lat (msec) : 10=1.30%, 20=16.41%, 50=45.18%, 100=24.22%, 250=12.63% lat (msec) : 500=0.26% cpu : usr=0.08%, sys=2.17%, ctx=1279, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=571KiB/s (585kB/s), 137KiB/s-151KiB/s (140kB/s-154kB/s), io=23.4MiB (24.5MB), run=41538-41917msec WRITE: bw=601KiB/s (616kB/s), 145KiB/s-156KiB/s (149kB/s-160kB/s), io=24.6MiB (25.8MB), run=41538-41917msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184771: Sun Nov 16 20:33:01 2025 read: IOPS=2, BW=2730KiB/s (2795kB/s)(7168KiB/2626msec) clat (usec): min=749, max=333677, avg=179360.66, stdev=106773.80 lat (usec): min=751, max=333679, avg=179362.75, stdev=106773.71 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[120062], | 30.00th=[143655], 40.00th=[143655], 50.00th=[177210], 60.00th=[225444], | 70.00th=[225444], 80.00th=[254804], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 2035, max= 5667, per=75.75%, avg=3927.00, stdev=1820.76, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1950KiB/s (1997kB/s)(5120KiB/2626msec); 0 zone resets clat (msec): min=86, max=428, avg=273.47, stdev=132.93 lat (msec): min=87, max=428, avg=273.54, stdev=132.92 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 87], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 266], 60.00th=[ 266], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 430], 95.00th=[ 430], | 99.00th=[ 430], 99.50th=[ 430], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 2035, max= 4071, per=37.43%, avg=2716.33, stdev=1173.18, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=41.67% cpu : usr=0.00%, sys=23.47%, ctx=231, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184772: Sun Nov 16 20:33:01 2025 read: IOPS=0, BW=518KiB/s (531kB/s)(2048KiB/3950msec) clat (msec): min=245, max=663, avg=454.23, stdev=295.82 lat (msec): min=245, max=663, avg=454.23, stdev=295.82 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 245], | 30.00th=[ 245], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 2035, max= 2043, per=39.33%, avg=2039.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2592KiB/s (2655kB/s)(10.0MiB/3950msec); 0 zone resets clat (msec): min=148, max=966, avg=303.35, stdev=242.17 lat (msec): min=148, max=966, avg=303.85, stdev=241.94 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 165], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 197], 60.00th=[ 284], | 70.00th=[ 292], 80.00th=[ 317], 90.00th=[ 321], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2019, max= 4079, per=39.26%, avg=2849.40, stdev=1118.85, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=20.18%, ctx=220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184773: Sun Nov 16 20:33:01 2025 read: IOPS=1, BW=1748KiB/s (1790kB/s)(6144KiB/3514msec) clat (usec): min=878, max=260427, avg=105946.76, stdev=114041.12 lat (usec): min=879, max=260430, avg=105948.73, stdev=114041.45 clat percentiles (usec): | 1.00th=[ 881], 5.00th=[ 881], 10.00th=[ 881], 20.00th=[ 2024], | 30.00th=[ 2024], 40.00th=[ 23462], 50.00th=[ 23462], 60.00th=[135267], | 70.00th=[214959], 80.00th=[214959], 90.00th=[261096], 95.00th=[261096], | 99.00th=[261096], 99.50th=[261096], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 2035, max= 4079, per=65.49%, avg=3395.00, stdev=1177.80, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1748KiB/s (1790kB/s)(6144KiB/3514msec); 0 zone resets clat (msec): min=239, max=914, avg=478.85, stdev=238.41 lat (msec): min=239, max=915, avg=479.27, stdev=238.76 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 363], | 30.00th=[ 363], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 414], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1712, max= 2043, per=27.18%, avg=1972.80, stdev=145.83, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 4=8.33%, 50=8.33%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.06%, sys=15.66%, ctx=252, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184774: Sun Nov 16 20:33:01 2025 read: IOPS=1, BW=1561KiB/s (1599kB/s)(5120KiB/3279msec) clat (usec): min=420, max=714, avg=573.44, stdev=122.48 lat (usec): min=420, max=716, avg=574.47, stdev=123.21 clat percentiles (usec): | 1.00th=[ 420], 5.00th=[ 420], 10.00th=[ 420], 20.00th=[ 420], | 30.00th=[ 486], 40.00th=[ 486], 50.00th=[ 578], 60.00th=[ 578], | 70.00th=[ 668], 80.00th=[ 668], 90.00th=[ 717], 95.00th=[ 717], | 99.00th=[ 717], 99.50th=[ 717], 99.90th=[ 717], 99.95th=[ 717], | 99.99th=[ 717] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 8, max= 8, avg= 8.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2186KiB/s (2238kB/s)(7168KiB/3279msec); 0 zone resets clat (msec): min=106, max=1134, avg=467.79, stdev=348.04 lat (msec): min=106, max=1134, avg=467.87, stdev=348.04 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 161], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 409], 60.00th=[ 567], | 70.00th=[ 567], 80.00th=[ 600], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 2035, max= 4096, per=46.93%, avg=3406.00, stdev=1187.33, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (usec) : 500=16.67%, 750=25.00% lat (msec) : 250=16.67%, 500=16.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=17.48%, ctx=48, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5185KiB/s (5309kB/s), 518KiB/s-2730KiB/s (531kB/s-2795kB/s), io=20.0MiB (20.0MB), run=2626-3950msec WRITE: bw=7259KiB/s (7433kB/s), 1748KiB/s-2592KiB/s (1790kB/s-2655kB/s), io=28.0MiB (29.4MB), run=2626-3950msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184766: Sun Nov 16 20:33:01 2025 read: IOPS=1, BW=1768KiB/s (1810kB/s)(7168KiB/4055msec) clat (msec): min=59, max=854, avg=238.40, stdev=285.04 lat (msec): min=59, max=854, avg=238.40, stdev=285.04 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 60], 10.00th=[ 60], 20.00th=[ 61], | 30.00th=[ 84], 40.00th=[ 84], 50.00th=[ 99], 60.00th=[ 251], | 70.00th=[ 251], 80.00th=[ 264], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1950, max= 6131, per=84.06%, avg=4019.00, stdev=2090.83, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1263KiB/s (1293kB/s)(5120KiB/4055msec); 0 zone resets clat (msec): min=187, max=949, avg=449.00, stdev=302.00 lat (msec): min=187, max=949, avg=449.08, stdev=301.99 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 502], 80.00th=[ 502], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 2043, max= 3900, per=39.79%, avg=2663.67, stdev=1070.70, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 100=33.33%, 250=8.33%, 500=33.33%, 750=8.33%, 1000=16.67% cpu : usr=0.07%, sys=6.91%, ctx=155, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184767: Sun Nov 16 20:33:01 2025 read: IOPS=0, BW=478KiB/s (490kB/s)(2048KiB/4283msec) clat (msec): min=89, max=105, avg=97.51, stdev=11.60 lat (msec): min=89, max=105, avg=97.51, stdev=11.60 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 106], | 70.00th=[ 106], 80.00th=[ 106], 90.00th=[ 106], 95.00th=[ 106], | 99.00th=[ 106], 99.50th=[ 106], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 1398, max= 2011, per=35.65%, avg=1704.50, stdev=433.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2391KiB/s (2448kB/s)(10.0MiB/4283msec); 0 zone resets clat (msec): min=88, max=866, avg=403.93, stdev=305.23 lat (msec): min=88, max=866, avg=404.03, stdev=305.22 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 123], | 30.00th=[ 167], 40.00th=[ 176], 50.00th=[ 257], 60.00th=[ 279], | 70.00th=[ 558], 80.00th=[ 676], 90.00th=[ 852], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 2011, max= 4196, per=36.84%, avg=2466.00, stdev=967.22, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=16.67% cpu : usr=0.02%, sys=8.01%, ctx=111, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184768: Sun Nov 16 20:33:01 2025 read: IOPS=1, BW=1761KiB/s (1803kB/s)(6144KiB/3489msec) clat (msec): min=53, max=517, avg=184.35, stdev=168.32 lat (msec): min=53, max=517, avg=184.35, stdev=168.32 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 129], | 70.00th=[ 184], 80.00th=[ 184], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 2955, max= 6035, per=94.02%, avg=4495.00, stdev=2177.89, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1761KiB/s (1803kB/s)(6144KiB/3489msec); 0 zone resets clat (msec): min=83, max=1289, avg=378.00, stdev=483.67 lat (msec): min=83, max=1289, avg=378.10, stdev=483.66 clat percentiles (msec): | 1.00th=[ 84], 5.00th=[ 84], 10.00th=[ 84], 20.00th=[ 85], | 30.00th=[ 85], 40.00th=[ 96], 50.00th=[ 96], 60.00th=[ 150], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 1284], 95.00th=[ 1284], | 99.00th=[ 1284], 99.50th=[ 1284], 99.90th=[ 1284], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 1988, max= 4432, per=41.98%, avg=2810.33, stdev=1404.45, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=33.33%, 250=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.30%, ctx=79, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184769: Sun Nov 16 20:33:01 2025 read: IOPS=1, BW=1747KiB/s (1789kB/s)(5120KiB/2931msec) clat (msec): min=104, max=374, avg=219.24, stdev=113.14 lat (msec): min=104, max=374, avg=219.24, stdev=113.14 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 113], 40.00th=[ 113], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 376], 95.00th=[ 376], | 99.00th=[ 376], 99.50th=[ 376], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 3976, max= 4023, per=83.65%, avg=3999.50, stdev=33.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2446KiB/s (2504kB/s)(7168KiB/2931msec); 0 zone resets clat (msec): min=111, max=555, avg=243.98, stdev=158.77 lat (msec): min=111, max=555, avg=244.24, stdev=158.70 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 117], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 188], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 321], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 1988, max= 4096, per=38.93%, avg=2606.20, stdev=914.73, samples=5 iops : min= 1, max= 4, avg= 2.00, stdev= 1.22, samples=5 lat (msec) : 250=58.33%, 500=33.33%, 750=8.33% cpu : usr=0.07%, sys=8.60%, ctx=102, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4782KiB/s (4896kB/s), 478KiB/s-1768KiB/s (490kB/s-1810kB/s), io=20.0MiB (20.0MB), run=2931-4283msec WRITE: bw=6694KiB/s (6855kB/s), 1263KiB/s-2446KiB/s (1293kB/s-2504kB/s), io=28.0MiB (29.4MB), run=2931-4283msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=184780: Sun Nov 16 20:33:12 2025 read: IOPS=2, BW=11.7MiB/s (12.2MB/s)(12.0MiB/1028msec) clat (msec): min=230, max=326, avg=273.09, stdev=48.53 lat (msec): min=230, max=326, avg=273.09, stdev=48.53 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 264], 50.00th=[ 264], 60.00th=[ 264], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 6595, max= 6595, per=52.90%, avg=6595.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=18.50%, ctx=78, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184781: Sun Nov 16 20:33:12 2025 read: IOPS=0, BW=3117KiB/s (3192kB/s)(4096KiB/1314msec) clat (nsec): min=389575k, max=389575k, avg=389575193.00, stdev= 0.00 lat (nsec): min=389579k, max=389579k, avg=389578601.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 5461, max= 5461, per=43.80%, avg=5461.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6234KiB/s (6384kB/s)(8192KiB/1314msec); 0 zone resets clat (msec): min=221, max=614, avg=418.03, stdev=277.36 lat (msec): min=222, max=614, avg=418.36, stdev=277.32 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 222], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 5461, max= 5461, per=40.15%, avg=5461.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 750=33.33% cpu : usr=0.00%, sys=12.03%, ctx=61, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184782: Sun Nov 16 20:33:12 2025 write: IOPS=1, BW=5101KiB/s (5223kB/s)(12.0MiB/2409msec); 0 zone resets clat (msec): min=555, max=907, avg=763.05, stdev=184.40 lat (msec): min=555, max=907, avg=763.49, stdev=184.47 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 8159, max= 8175, per=60.04%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=8.31%, ctx=67, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184783: Sun Nov 16 20:33:12 2025 write: IOPS=1, BW=5568KiB/s (5701kB/s)(12.0MiB/2207msec); 0 zone resets clat (msec): min=248, max=1306, avg=696.54, stdev=547.59 lat (msec): min=248, max=1307, avg=696.90, stdev=547.56 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 535], 50.00th=[ 535], 60.00th=[ 535], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7772, max= 8159, per=58.56%, avg=7965.50, stdev=273.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.39%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=12.2MiB/s (12.8MB/s), 3117KiB/s-11.7MiB/s (3192kB/s-12.2MB/s), io=16.0MiB (16.8MB), run=1028-1314msec WRITE: bw=13.3MiB/s (13.9MB/s), 5101KiB/s-6234KiB/s (5223kB/s-6384kB/s), io=32.0MiB (33.6MB), run=1314-2409msec rand-rw: (groupid=0, jobs=1): err= 0: pid=184785: Sun Nov 16 20:33:12 2025 read: IOPS=1, BW=6364KiB/s (6516kB/s)(12.0MiB/1931msec) clat (msec): min=525, max=753, avg=643.28, stdev=113.81 lat (msec): min=525, max=753, avg=643.28, stdev=113.81 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7907, max= 8031, per=100.00%, avg=7969.00, stdev=87.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=22.59%, ctx=786, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184786: Sun Nov 16 20:33:12 2025 read: IOPS=0, BW=1747KiB/s (1789kB/s)(4096KiB/2345msec) clat (nsec): min=829445k, max=829445k, avg=829445341.00, stdev= 0.00 lat (nsec): min=829449k, max=829449k, avg=829448757.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3493KiB/s (3577kB/s)(8192KiB/2345msec); 0 zone resets clat (msec): min=477, max=1032, avg=755.17, stdev=392.54 lat (msec): min=477, max=1033, avg=755.53, stdev=392.59 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 1036], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7907, max= 7907, per=56.59%, avg=7907.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.09%, sys=6.10%, ctx=200, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184787: Sun Nov 16 20:33:12 2025 write: IOPS=1, BW=5478KiB/s (5610kB/s)(12.0MiB/2243msec); 0 zone resets clat (msec): min=163, max=1139, avg=745.74, stdev=514.35 lat (msec): min=164, max=1139, avg=747.30, stdev=515.07 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 165], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 936], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8031, max= 8078, per=57.64%, avg=8054.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=8.03%, ctx=74, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=184788: Sun Nov 16 20:33:12 2025 write: IOPS=1, BW=5942KiB/s (6085kB/s)(12.0MiB/2068msec); 0 zone resets clat (msec): min=369, max=1037, avg=688.49, stdev=335.10 lat (msec): min=369, max=1037, avg=688.82, stdev=335.09 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8031, max= 8078, per=57.64%, avg=8054.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=6.58%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6987KiB/s (7154kB/s), 1747KiB/s-6364KiB/s (1789kB/s-6516kB/s), io=16.0MiB (16.8MB), run=1931-2345msec WRITE: bw=13.6MiB/s (14.3MB/s), 3493KiB/s-5942KiB/s (3577kB/s-6085kB/s), io=32.0MiB (33.6MB), run=2068-2345msec