== sanity test 398b: DIO and buffer IO race ============== 02:41:46 (1761288106) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.94999 s, 12.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148013: Fri Oct 24 02:43:13 2025 read: IOPS=20, BW=80.6KiB/s (82.6kB/s)(5992KiB/74317msec) clat (usec): min=106, max=498413, avg=24986.30, stdev=22552.27 lat (usec): min=106, max=498414, avg=24988.66, stdev=22552.32 clat percentiles (usec): | 1.00th=[ 149], 5.00th=[ 215], 10.00th=[ 7504], 20.00th=[ 12911], | 30.00th=[ 15270], 40.00th=[ 17695], 50.00th=[ 21103], 60.00th=[ 25035], | 70.00th=[ 29492], 80.00th=[ 35390], 90.00th=[ 44827], 95.00th=[ 55313], | 99.00th=[ 95945], 99.50th=[122160], 99.90th=[274727], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 159, per=24.83%, avg=80.20, stdev=26.68, samples=147 iops : min= 1, max= 39, avg=19.42, stdev= 6.68, samples=147 write: IOPS=21, BW=84.7KiB/s (86.8kB/s)(6296KiB/74317msec); 0 zone resets clat (usec): min=916, max=174372, avg=23236.21, stdev=22844.85 lat (usec): min=918, max=174373, avg=23238.96, stdev=22844.75 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1237], 10.00th=[ 1532], 20.00th=[ 2966], | 30.00th=[ 5800], 40.00th=[ 12649], 50.00th=[ 18482], 60.00th=[ 23725], | 70.00th=[ 29492], 80.00th=[ 38536], 90.00th=[ 52167], 95.00th=[ 64750], | 99.00th=[107480], 99.50th=[128451], 99.90th=[160433], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 15, max= 183, per=24.89%, avg=84.14, stdev=29.14, samples=147 iops : min= 3, max= 45, avg=20.41, stdev= 7.32, samples=147 lat (usec) : 250=2.70%, 500=1.46%, 750=0.13%, 1000=0.36% lat (msec) : 2=7.00%, 4=5.31%, 10=7.68%, 20=25.20%, 50=41.28% lat (msec) : 100=7.81%, 250=1.01%, 500=0.07% cpu : usr=0.10%, sys=10.98%, ctx=6879, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148014: Fri Oct 24 02:43:13 2025 read: IOPS=20, BW=82.7KiB/s (84.7kB/s)(5940KiB/71811msec) clat (usec): min=119, max=535844, avg=24187.75, stdev=23894.08 lat (usec): min=119, max=535846, avg=24189.23, stdev=23893.91 clat percentiles (usec): | 1.00th=[ 139], 5.00th=[ 200], 10.00th=[ 848], 20.00th=[ 12518], | 30.00th=[ 15008], 40.00th=[ 17695], 50.00th=[ 20579], 60.00th=[ 23987], | 70.00th=[ 28705], 80.00th=[ 34866], 90.00th=[ 43254], 95.00th=[ 51119], | 99.00th=[ 83362], 99.50th=[119014], 99.90th=[392168], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 7, max= 150, per=25.39%, avg=82.01, stdev=27.55, samples=142 iops : min= 1, max= 37, avg=19.89, stdev= 6.91, samples=142 write: IOPS=22, BW=88.4KiB/s (90.5kB/s)(6348KiB/71811msec); 0 zone resets clat (usec): min=934, max=187289, avg=22415.91, stdev=21934.03 lat (usec): min=935, max=187290, avg=22417.95, stdev=21933.76 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1254], 10.00th=[ 1663], 20.00th=[ 3032], | 30.00th=[ 5342], 40.00th=[ 11863], 50.00th=[ 17171], 60.00th=[ 22676], | 70.00th=[ 29492], 80.00th=[ 38536], 90.00th=[ 51119], 95.00th=[ 63701], | 99.00th=[ 89654], 99.50th=[105382], 99.90th=[179307], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 176, per=25.84%, avg=87.34, stdev=29.57, samples=142 iops : min= 1, max= 44, avg=21.22, stdev= 7.43, samples=142 lat (usec) : 250=3.03%, 500=1.56%, 750=0.16%, 1000=0.29% lat (msec) : 2=6.67%, 4=6.67%, 10=7.88%, 20=25.52%, 50=39.81% lat (msec) : 100=7.75%, 250=0.59%, 500=0.03%, 750=0.03% cpu : usr=0.14%, sys=11.05%, ctx=6697, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148015: Fri Oct 24 02:43:13 2025 read: IOPS=20, BW=83.1KiB/s (85.0kB/s)(6028KiB/72582msec) clat (usec): min=84, max=187250, avg=23271.90, stdev=16156.19 lat (usec): min=84, max=187252, avg=23273.10, stdev=16156.21 clat percentiles (usec): | 1.00th=[ 141], 5.00th=[ 196], 10.00th=[ 5932], 20.00th=[ 12256], | 30.00th=[ 14746], 40.00th=[ 17433], 50.00th=[ 20317], 60.00th=[ 23725], | 70.00th=[ 28181], 80.00th=[ 33424], 90.00th=[ 42206], 95.00th=[ 51643], | 99.00th=[ 79168], 99.50th=[ 96994], 99.90th=[117965], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 7, max= 151, per=25.58%, avg=82.63, stdev=28.17, samples=144 iops : min= 1, max= 37, avg=20.03, stdev= 7.05, samples=144 write: IOPS=21, BW=86.2KiB/s (88.3kB/s)(6260KiB/72582msec); 0 zone resets clat (usec): min=899, max=536552, avg=23783.33, stdev=26448.74 lat (usec): min=900, max=536552, avg=23784.87, stdev=26448.72 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1582], 20.00th=[ 2704], | 30.00th=[ 5276], 40.00th=[ 12125], 50.00th=[ 18482], 60.00th=[ 25035], | 70.00th=[ 31851], 80.00th=[ 39584], 90.00th=[ 54264], 95.00th=[ 65274], | 99.00th=[ 96994], 99.50th=[117965], 99.90th=[196084], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 15, max= 174, per=25.37%, avg=85.75, stdev=27.11, samples=144 iops : min= 3, max= 43, avg=20.82, stdev= 6.80, samples=144 lat (usec) : 100=0.03%, 250=3.16%, 500=1.11%, 750=0.23%, 1000=0.33% lat (msec) : 2=7.29%, 4=5.96%, 10=7.55%, 20=25.36%, 50=39.94% lat (msec) : 100=8.50%, 250=0.52%, 750=0.03% cpu : usr=0.11%, sys=11.05%, ctx=6830, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148016: Fri Oct 24 02:43:13 2025 read: IOPS=20, BW=82.8KiB/s (84.8kB/s)(6052KiB/73052msec) clat (usec): min=105, max=277123, avg=23712.32, stdev=18082.67 lat (usec): min=105, max=277125, avg=23713.51, stdev=18082.70 clat percentiles (usec): | 1.00th=[ 145], 5.00th=[ 208], 10.00th=[ 1385], 20.00th=[ 12256], | 30.00th=[ 14877], 40.00th=[ 17433], 50.00th=[ 20055], 60.00th=[ 23987], | 70.00th=[ 28967], 80.00th=[ 35390], 90.00th=[ 43779], 95.00th=[ 51119], | 99.00th=[ 79168], 99.50th=[ 91751], 99.90th=[200279], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 7, max= 143, per=25.36%, avg=81.90, stdev=26.07, samples=144 iops : min= 1, max= 35, avg=19.86, stdev= 6.54, samples=144 write: IOPS=21, BW=85.4KiB/s (87.4kB/s)(6236KiB/73052msec); 0 zone resets clat (usec): min=880, max=525153, avg=23646.75, stdev=25726.21 lat (usec): min=881, max=525155, avg=23649.37, stdev=25725.88 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1549], 20.00th=[ 2835], | 30.00th=[ 5800], 40.00th=[ 11863], 50.00th=[ 17957], 60.00th=[ 24249], | 70.00th=[ 31327], 80.00th=[ 40109], 90.00th=[ 54264], 95.00th=[ 66847], | 99.00th=[ 93848], 99.50th=[108528], 99.90th=[183501], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 15, max= 167, per=25.04%, avg=84.64, stdev=27.05, samples=144 iops : min= 3, max= 41, avg=20.54, stdev= 6.74, samples=144 lat (usec) : 250=2.86%, 500=1.73%, 750=0.23%, 1000=0.20% lat (msec) : 2=6.90%, 4=5.83%, 10=8.14%, 20=25.42%, 50=39.45% lat (msec) : 100=8.76%, 250=0.42%, 500=0.03%, 750=0.03% cpu : usr=0.14%, sys=10.64%, ctx=6726, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=323KiB/s (331kB/s), 80.6KiB/s-83.1KiB/s (82.6kB/s-85.0kB/s), io=23.4MiB (24.6MB), run=71811-74317msec WRITE: bw=338KiB/s (346kB/s), 84.7KiB/s-88.4KiB/s (86.8kB/s-90.5kB/s), io=24.6MiB (25.7MB), run=71811-74317msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148018: Fri Oct 24 02:44:28 2025 read: IOPS=10, BW=40.2KiB/s (41.2kB/s)(5992KiB/149058msec) clat (msec): min=4, max=574, avg=18.64, stdev=25.09 lat (msec): min=4, max=574, avg=18.64, stdev=25.10 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 24], 90.00th=[ 41], 95.00th=[ 54], | 99.00th=[ 96], 99.50th=[ 161], 99.90th=[ 241], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 7, max= 151, per=25.39%, avg=40.88, stdev=28.27, samples=288 iops : min= 1, max= 37, avg= 9.69, stdev= 7.14, samples=288 write: IOPS=10, BW=42.2KiB/s (43.3kB/s)(6296KiB/149058msec); 0 zone resets clat (msec): min=23, max=310, avg=76.89, stdev=40.26 lat (msec): min=23, max=310, avg=76.89, stdev=40.26 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 51], 40.00th=[ 58], 50.00th=[ 65], 60.00th=[ 74], | 70.00th=[ 88], 80.00th=[ 108], 90.00th=[ 133], 95.00th=[ 155], | 99.00th=[ 218], 99.50th=[ 234], 99.90th=[ 284], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 7, max= 96, per=24.93%, avg=41.88, stdev=20.37, samples=295 iops : min= 1, max= 24, avg= 9.94, stdev= 5.19, samples=295 lat (msec) : 10=21.06%, 20=16.24%, 50=23.21%, 100=27.15%, 250=12.11% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=2.31%, ctx=5415, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148019: Fri Oct 24 02:44:28 2025 read: IOPS=9, BW=39.0KiB/s (40.9kB/s)(5940KiB/148655msec) clat (msec): min=4, max=544, avg=18.09, stdev=23.32 lat (msec): min=4, max=544, avg=18.09, stdev=23.32 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 11], 60.00th=[ 13], | 70.00th=[ 16], 80.00th=[ 23], 90.00th=[ 40], 95.00th=[ 54], | 99.00th=[ 89], 99.50th=[ 125], 99.90th=[ 268], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 6, max= 151, per=25.57%, avg=41.17, stdev=28.38, samples=283 iops : min= 1, max= 37, avg= 9.76, stdev= 7.13, samples=283 write: IOPS=10, BW=42.7KiB/s (43.7kB/s)(6348KiB/148655msec); 0 zone resets clat (msec): min=25, max=415, avg=76.68, stdev=42.09 lat (msec): min=25, max=415, avg=76.68, stdev=42.09 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 44], | 30.00th=[ 51], 40.00th=[ 57], 50.00th=[ 64], 60.00th=[ 72], | 70.00th=[ 86], 80.00th=[ 107], 90.00th=[ 136], 95.00th=[ 159], | 99.00th=[ 230], 99.50th=[ 247], 99.90th=[ 296], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 7, max= 88, per=25.18%, avg=42.30, stdev=20.76, samples=294 iops : min= 1, max= 22, avg=10.04, stdev= 5.28, samples=294 lat (msec) : 10=20.80%, 20=16.18%, 50=23.89%, 100=27.15%, 250=11.75% lat (msec) : 500=0.20%, 750=0.03% cpu : usr=0.06%, sys=2.39%, ctx=5509, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148020: Fri Oct 24 02:44:28 2025 read: IOPS=10, BW=40.6KiB/s (41.6kB/s)(6028KiB/148309msec) clat (msec): min=3, max=215, avg=18.70, stdev=20.08 lat (msec): min=3, max=215, avg=18.70, stdev=20.08 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 27], 90.00th=[ 42], 95.00th=[ 55], | 99.00th=[ 94], 99.50th=[ 140], 99.90th=[ 194], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 7, max= 136, per=25.35%, avg=40.82, stdev=25.97, samples=289 iops : min= 1, max= 34, avg= 9.66, stdev= 6.54, samples=289 write: IOPS=10, BW=42.2KiB/s (43.2kB/s)(6260KiB/148309msec); 0 zone resets clat (msec): min=23, max=661, avg=76.69, stdev=42.31 lat (msec): min=23, max=661, avg=76.70, stdev=42.31 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 36], 10.00th=[ 41], 20.00th=[ 47], | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 64], 60.00th=[ 73], | 70.00th=[ 86], 80.00th=[ 105], 90.00th=[ 136], 95.00th=[ 157], | 99.00th=[ 220], 99.50th=[ 236], 99.90th=[ 414], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 88, per=24.89%, avg=41.81, stdev=20.40, samples=293 iops : min= 1, max= 22, avg= 9.92, stdev= 5.20, samples=293 lat (msec) : 4=0.07%, 10=20.15%, 20=16.44%, 50=23.05%, 100=28.78% lat (msec) : 250=11.46%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=2.34%, ctx=5355, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148021: Fri Oct 24 02:44:28 2025 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(6052KiB/148164msec) clat (msec): min=4, max=265, avg=18.93, stdev=21.29 lat (msec): min=4, max=265, avg=18.93, stdev=21.29 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 7], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 10], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 26], 90.00th=[ 43], 95.00th=[ 56], | 99.00th=[ 99], 99.50th=[ 153], 99.90th=[ 224], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 7, max= 135, per=25.89%, avg=41.68, stdev=27.07, samples=285 iops : min= 1, max= 33, avg= 9.89, stdev= 6.83, samples=285 write: IOPS=10, BW=42.1KiB/s (43.1kB/s)(6236KiB/148164msec); 0 zone resets clat (msec): min=23, max=656, avg=76.59, stdev=40.68 lat (msec): min=23, max=656, avg=76.60, stdev=40.68 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 74], | 70.00th=[ 87], 80.00th=[ 106], 90.00th=[ 131], 95.00th=[ 153], | 99.00th=[ 205], 99.50th=[ 215], 99.90th=[ 317], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 88, per=24.93%, avg=41.88, stdev=20.07, samples=292 iops : min= 1, max= 22, avg= 9.93, stdev= 5.10, samples=292 lat (msec) : 10=20.83%, 20=15.98%, 50=23.14%, 100=27.99%, 250=11.88% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=2.31%, ctx=5429, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=161KiB/s (165kB/s), 39.0KiB/s-40.8KiB/s (40.9kB/s-41.8kB/s), io=23.4MiB (24.6MB), run=148164-149058msec WRITE: bw=169KiB/s (173kB/s), 42.1KiB/s-42.7KiB/s (43.1kB/s-43.7kB/s), io=24.6MiB (25.7MB), run=148164-149058msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148066: Fri Oct 24 02:44:49 2025 read: IOPS=25, BW=413KiB/s (423kB/s)(5920KiB/14346msec) clat (usec): min=113, max=121340, avg=18930.96, stdev=13877.69 lat (usec): min=114, max=121342, avg=18932.20, stdev=13877.80 clat percentiles (usec): | 1.00th=[ 143], 5.00th=[ 241], 10.00th=[ 334], 20.00th=[ 9110], | 30.00th=[ 12649], 40.00th=[ 15401], 50.00th=[ 18744], 60.00th=[ 21103], | 70.00th=[ 23987], 80.00th=[ 27919], 90.00th=[ 33817], 95.00th=[ 40109], | 99.00th=[ 56886], 99.50th=[102237], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 254, max= 640, per=25.80%, avg=411.75, stdev=117.34, samples=28 iops : min= 15, max= 40, avg=25.11, stdev= 7.44, samples=28 write: IOPS=27, BW=444KiB/s (455kB/s)(6368KiB/14346msec); 0 zone resets clat (usec): min=1000, max=166992, avg=18176.00, stdev=18417.86 lat (usec): min=1002, max=166993, avg=18178.05, stdev=18417.93 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1893], 10.00th=[ 2933], 20.00th=[ 4228], | 30.00th=[ 5932], 40.00th=[ 8455], 50.00th=[ 12911], 60.00th=[ 17957], | 70.00th=[ 21627], 80.00th=[ 30016], 90.00th=[ 39584], 95.00th=[ 50594], | 99.00th=[ 91751], 99.50th=[117965], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 223, max= 702, per=26.57%, avg=446.18, stdev=123.25, samples=28 iops : min= 13, max= 43, avg=27.25, stdev= 7.90, samples=28 lat (usec) : 250=2.47%, 500=4.17%, 750=1.17%, 1000=0.26% lat (msec) : 2=3.12%, 4=7.16%, 10=14.58%, 20=27.34%, 50=36.20% lat (msec) : 100=2.99%, 250=0.52% cpu : usr=0.17%, sys=20.68%, ctx=1893, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148067: Fri Oct 24 02:44:49 2025 read: IOPS=23, BW=383KiB/s (392kB/s)(5744KiB/15002msec) clat (usec): min=111, max=147113, avg=21939.81, stdev=16799.74 lat (usec): min=111, max=147115, avg=21941.19, stdev=16799.66 clat percentiles (usec): | 1.00th=[ 161], 5.00th=[ 251], 10.00th=[ 469], 20.00th=[ 11469], | 30.00th=[ 14091], 40.00th=[ 16909], 50.00th=[ 20055], 60.00th=[ 23725], | 70.00th=[ 27657], 80.00th=[ 31589], 90.00th=[ 39584], 95.00th=[ 45876], | 99.00th=[ 90702], 99.50th=[133694], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 127, max= 544, per=23.65%, avg=377.45, stdev=106.10, samples=29 iops : min= 7, max= 34, avg=22.97, stdev= 6.72, samples=29 write: IOPS=27, BW=436KiB/s (447kB/s)(6544KiB/15002msec); 0 zone resets clat (usec): min=1362, max=182963, avg=17180.92, stdev=18324.75 lat (usec): min=1363, max=182966, avg=17183.15, stdev=18324.69 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2057], 10.00th=[ 2671], 20.00th=[ 3752], | 30.00th=[ 5407], 40.00th=[ 7242], 50.00th=[ 12125], 60.00th=[ 15926], | 70.00th=[ 20841], 80.00th=[ 27657], 90.00th=[ 39584], 95.00th=[ 50070], | 99.00th=[ 72877], 99.50th=[ 79168], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 254, max= 692, per=25.26%, avg=424.17, stdev=111.52, samples=29 iops : min= 15, max= 43, avg=25.93, stdev= 7.19, samples=29 lat (usec) : 250=2.21%, 500=2.86%, 750=0.65%, 1000=0.52% lat (msec) : 2=2.73%, 4=9.24%, 10=13.93%, 20=27.86%, 50=35.81% lat (msec) : 100=3.52%, 250=0.65% cpu : usr=0.09%, sys=20.20%, ctx=1790, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148068: Fri Oct 24 02:44:49 2025 read: IOPS=26, BW=429KiB/s (440kB/s)(6256KiB/14572msec) clat (usec): min=114, max=111315, avg=19963.52, stdev=14585.16 lat (usec): min=114, max=111317, avg=19964.73, stdev=14585.19 clat percentiles (usec): | 1.00th=[ 128], 5.00th=[ 233], 10.00th=[ 338], 20.00th=[ 9110], | 30.00th=[ 13173], 40.00th=[ 16188], 50.00th=[ 19268], 60.00th=[ 22414], | 70.00th=[ 25560], 80.00th=[ 30540], 90.00th=[ 36439], 95.00th=[ 44303], | 99.00th=[ 70779], 99.50th=[ 77071], 99.90th=[111674], 99.95th=[111674], | 99.99th=[111674] bw ( KiB/s): min= 222, max= 736, per=27.34%, avg=436.39, stdev=110.30, samples=28 iops : min= 13, max= 46, avg=26.64, stdev= 6.98, samples=28 write: IOPS=25, BW=414KiB/s (424kB/s)(6032KiB/14572msec); 0 zone resets clat (usec): min=1496, max=185280, avg=17834.99, stdev=17848.55 lat (usec): min=1499, max=185284, avg=17837.23, stdev=17848.61 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2114], 10.00th=[ 2737], 20.00th=[ 4228], | 30.00th=[ 5800], 40.00th=[ 8291], 50.00th=[ 13042], 60.00th=[ 16712], | 70.00th=[ 21365], 80.00th=[ 29230], 90.00th=[ 42730], 95.00th=[ 50594], | 99.00th=[ 70779], 99.50th=[ 73925], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 127, max= 698, per=24.60%, avg=413.07, stdev=143.09, samples=28 iops : min= 7, max= 43, avg=25.21, stdev= 8.98, samples=28 lat (usec) : 250=2.86%, 500=4.95%, 750=0.78%, 1000=0.39% lat (msec) : 2=2.60%, 4=6.90%, 10=13.93%, 20=27.60%, 50=36.33% lat (msec) : 100=3.39%, 250=0.26% cpu : usr=0.10%, sys=20.63%, ctx=1938, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148069: Fri Oct 24 02:44:49 2025 read: IOPS=25, BW=414KiB/s (424kB/s)(6032KiB/14566msec) clat (usec): min=120, max=184644, avg=19581.99, stdev=15961.26 lat (usec): min=120, max=184645, avg=19584.14, stdev=15961.01 clat percentiles (usec): | 1.00th=[ 135], 5.00th=[ 235], 10.00th=[ 359], 20.00th=[ 5735], | 30.00th=[ 12780], 40.00th=[ 15533], 50.00th=[ 17957], 60.00th=[ 21365], | 70.00th=[ 25035], 80.00th=[ 30802], 90.00th=[ 37487], 95.00th=[ 44303], | 99.00th=[ 57410], 99.50th=[ 69731], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 192, max= 576, per=25.59%, avg=408.36, stdev=103.12, samples=28 iops : min= 12, max= 36, avg=24.89, stdev= 6.49, samples=28 write: IOPS=26, BW=429KiB/s (440kB/s)(6256KiB/14566msec); 0 zone resets clat (usec): min=1349, max=114520, avg=18143.07, stdev=17817.29 lat (usec): min=1351, max=114522, avg=18148.38, stdev=17815.16 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 2073], 10.00th=[ 2704], 20.00th=[ 4178], | 30.00th=[ 5669], 40.00th=[ 7242], 50.00th=[ 12256], 60.00th=[ 16057], | 70.00th=[ 21103], 80.00th=[ 30802], 90.00th=[ 43779], 95.00th=[ 52691], | 99.00th=[ 76022], 99.50th=[ 93848], 99.90th=[114820], 99.95th=[114820], | 99.99th=[114820] bw ( KiB/s): min= 222, max= 670, per=25.37%, avg=426.00, stdev=115.01, samples=28 iops : min= 13, max= 41, avg=26.00, stdev= 7.36, samples=28 lat (usec) : 250=2.73%, 500=4.04%, 750=1.69%, 1000=0.78% lat (msec) : 2=2.60%, 4=6.77%, 10=14.58%, 20=28.65%, 50=33.72% lat (msec) : 100=4.17%, 250=0.26% cpu : usr=0.16%, sys=20.17%, ctx=1862, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1597KiB/s (1635kB/s), 383KiB/s-429KiB/s (392kB/s-440kB/s), io=23.4MiB (24.5MB), run=14346-15002msec WRITE: bw=1680KiB/s (1720kB/s), 414KiB/s-444KiB/s (424kB/s-455kB/s), io=24.6MiB (25.8MB), run=14346-15002msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148061: Fri Oct 24 02:45:10 2025 read: IOPS=10, BW=165KiB/s (169kB/s)(5920KiB/35897msec) clat (msec): min=5, max=146, avg=20.18, stdev=20.24 lat (msec): min=5, max=146, avg=20.18, stdev=20.24 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 27], 90.00th=[ 46], 95.00th=[ 65], | 99.00th=[ 102], 99.50th=[ 133], 99.90th=[ 148], 99.95th=[ 148], | 99.99th=[ 148] bw ( KiB/s): min= 31, max= 416, per=24.91%, avg=164.42, stdev=88.02, samples=71 iops : min= 1, max= 26, avg= 9.61, stdev= 5.61, samples=71 write: IOPS=11, BW=177KiB/s (182kB/s)(6368KiB/35897msec); 0 zone resets clat (msec): min=29, max=256, avg=71.32, stdev=28.01 lat (msec): min=29, max=256, avg=71.33, stdev=28.01 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 52], | 30.00th=[ 57], 40.00th=[ 62], 50.00th=[ 66], 60.00th=[ 70], | 70.00th=[ 79], 80.00th=[ 87], 90.00th=[ 105], 95.00th=[ 120], | 99.00th=[ 205], 99.50th=[ 218], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 63, max= 287, per=25.50%, avg=177.20, stdev=63.05, samples=71 iops : min= 3, max= 17, avg=10.41, stdev= 4.03, samples=71 lat (msec) : 10=14.97%, 20=20.96%, 50=17.19%, 100=40.76%, 250=5.99% lat (msec) : 500=0.13% cpu : usr=0.07%, sys=3.59%, ctx=1507, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148062: Fri Oct 24 02:45:10 2025 read: IOPS=9, BW=158KiB/s (162kB/s)(5744KiB/36255msec) clat (msec): min=4, max=155, avg=19.07, stdev=18.21 lat (msec): min=4, max=155, avg=19.08, stdev=18.22 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 14], | 70.00th=[ 16], 80.00th=[ 26], 90.00th=[ 44], 95.00th=[ 57], | 99.00th=[ 88], 99.50th=[ 122], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 31, max= 411, per=25.07%, avg=165.46, stdev=87.06, samples=69 iops : min= 1, max= 25, avg= 9.70, stdev= 5.50, samples=69 write: IOPS=11, BW=180KiB/s (185kB/s)(6544KiB/36255msec); 0 zone resets clat (msec): min=26, max=202, avg=71.69, stdev=28.23 lat (msec): min=26, max=202, avg=71.69, stdev=28.23 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 40], 10.00th=[ 44], 20.00th=[ 51], | 30.00th=[ 56], 40.00th=[ 61], 50.00th=[ 65], 60.00th=[ 70], | 70.00th=[ 78], 80.00th=[ 88], 90.00th=[ 115], 95.00th=[ 131], | 99.00th=[ 157], 99.50th=[ 178], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 63, max= 288, per=25.90%, avg=179.97, stdev=60.37, samples=72 iops : min= 3, max= 18, avg=10.58, stdev= 3.86, samples=72 lat (msec) : 10=15.36%, 20=20.05%, 50=18.23%, 100=38.41%, 250=7.94% cpu : usr=0.07%, sys=3.50%, ctx=1506, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148063: Fri Oct 24 02:45:10 2025 read: IOPS=11, BW=182KiB/s (186kB/s)(6256KiB/34369msec) clat (msec): min=5, max=138, avg=18.43, stdev=17.81 lat (msec): min=5, max=138, avg=18.43, stdev=17.81 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 16], 80.00th=[ 24], 90.00th=[ 39], 95.00th=[ 59], | 99.00th=[ 103], 99.50th=[ 130], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 479, per=28.09%, avg=185.42, stdev=107.51, samples=67 iops : min= 1, max= 29, avg=10.93, stdev= 6.81, samples=67 write: IOPS=10, BW=176KiB/s (180kB/s)(6032KiB/34369msec); 0 zone resets clat (msec): min=33, max=214, avg=71.81, stdev=27.90 lat (msec): min=33, max=214, avg=71.81, stdev=27.90 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 41], 10.00th=[ 45], 20.00th=[ 52], | 30.00th=[ 57], 40.00th=[ 61], 50.00th=[ 66], 60.00th=[ 71], | 70.00th=[ 79], 80.00th=[ 88], 90.00th=[ 105], 95.00th=[ 127], | 99.00th=[ 182], 99.50th=[ 199], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 288, per=25.14%, avg=174.75, stdev=58.08, samples=68 iops : min= 1, max= 18, avg=10.25, stdev= 3.71, samples=68 lat (msec) : 10=18.62%, 20=20.44%, 50=17.71%, 100=36.59%, 250=6.64% cpu : usr=0.08%, sys=3.70%, ctx=1523, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148064: Fri Oct 24 02:45:10 2025 read: IOPS=10, BW=171KiB/s (175kB/s)(6032KiB/35280msec) clat (msec): min=5, max=117, avg=18.86, stdev=18.38 lat (msec): min=5, max=117, avg=18.86, stdev=18.38 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 12], 60.00th=[ 14], | 70.00th=[ 17], 80.00th=[ 25], 90.00th=[ 40], 95.00th=[ 61], | 99.00th=[ 111], 99.50th=[ 113], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 31, max= 415, per=25.65%, avg=169.31, stdev=92.42, samples=70 iops : min= 1, max= 25, avg= 9.90, stdev= 5.79, samples=70 write: IOPS=11, BW=177KiB/s (182kB/s)(6256KiB/35280msec); 0 zone resets clat (msec): min=32, max=202, avg=71.86, stdev=28.09 lat (msec): min=32, max=202, avg=71.86, stdev=28.09 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 42], 10.00th=[ 45], 20.00th=[ 50], | 30.00th=[ 55], 40.00th=[ 60], 50.00th=[ 67], 60.00th=[ 71], | 70.00th=[ 78], 80.00th=[ 88], 90.00th=[ 109], 95.00th=[ 133], | 99.00th=[ 167], 99.50th=[ 197], 99.90th=[ 203], 99.95th=[ 203], | 99.99th=[ 203] bw ( KiB/s): min= 63, max= 256, per=25.47%, avg=176.99, stdev=61.32, samples=70 iops : min= 3, max= 16, avg=10.39, stdev= 3.94, samples=70 lat (msec) : 10=16.41%, 20=21.22%, 50=19.40%, 100=36.07%, 250=6.90% cpu : usr=0.07%, sys=3.66%, ctx=1516, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=661KiB/s (677kB/s), 158KiB/s-182KiB/s (162kB/s-186kB/s), io=23.4MiB (24.5MB), run=34369-36255msec WRITE: bw=695KiB/s (712kB/s), 176KiB/s-180KiB/s (180kB/s-185kB/s), io=24.6MiB (25.8MB), run=34369-36255msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148080: Fri Oct 24 02:45:20 2025 read: IOPS=2, BW=2090KiB/s (2141kB/s)(7168KiB/3429msec) clat (msec): min=42, max=575, avg=187.33, stdev=185.61 lat (msec): min=42, max=575, avg=187.33, stdev=185.61 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 43], 10.00th=[ 43], 20.00th=[ 63], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 134], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 259], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1882, max= 4071, per=56.10%, avg=3325.33, stdev=1250.19, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1493KiB/s (1529kB/s)(5120KiB/3429msec); 0 zone resets clat (msec): min=230, max=656, avg=394.14, stdev=185.65 lat (msec): min=230, max=656, avg=394.23, stdev=185.67 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 309], 60.00th=[ 309], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2027, max= 4071, per=32.72%, avg=2715.33, stdev=1174.09, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=25.00%, 750=25.00% cpu : usr=0.00%, sys=10.53%, ctx=124, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148081: Fri Oct 24 02:45:20 2025 read: IOPS=0, BW=593KiB/s (607kB/s)(2048KiB/3455msec) clat (usec): min=47933, max=95146, avg=71539.71, stdev=33384.37 lat (usec): min=47936, max=95147, avg=71541.78, stdev=33383.07 clat percentiles (usec): | 1.00th=[47973], 5.00th=[47973], 10.00th=[47973], 20.00th=[47973], | 30.00th=[47973], 40.00th=[47973], 50.00th=[47973], 60.00th=[94897], | 70.00th=[94897], 80.00th=[94897], 90.00th=[94897], 95.00th=[94897], | 99.00th=[94897], 99.50th=[94897], 99.90th=[94897], 99.95th=[94897], | 99.99th=[94897] bw ( KiB/s): min= 1845, max= 2011, per=32.53%, avg=1928.00, stdev=117.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2964KiB/s (3035kB/s)(10.0MiB/3455msec); 0 zone resets clat (msec): min=108, max=687, avg=323.32, stdev=168.45 lat (msec): min=108, max=687, avg=323.57, stdev=168.36 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 222], | 30.00th=[ 239], 40.00th=[ 247], 50.00th=[ 262], 60.00th=[ 300], | 70.00th=[ 300], 80.00th=[ 330], 90.00th=[ 542], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1845, max= 4071, per=32.28%, avg=2678.83, stdev=1080.77, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.06%, sys=12.19%, ctx=254, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148082: Fri Oct 24 02:45:20 2025 read: IOPS=1, BW=1794KiB/s (1837kB/s)(6144KiB/3424msec) clat (msec): min=44, max=362, avg=202.89, stdev=129.31 lat (msec): min=44, max=362, avg=202.89, stdev=129.31 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 45], 10.00th=[ 45], 20.00th=[ 87], | 30.00th=[ 87], 40.00th=[ 146], 50.00th=[ 146], 60.00th=[ 262], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2027, max= 4023, per=45.47%, avg=2695.00, stdev=1150.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1794KiB/s (1837kB/s)(6144KiB/3424msec); 0 zone resets clat (msec): min=130, max=722, avg=365.12, stdev=223.06 lat (msec): min=131, max=723, avg=365.23, stdev=223.03 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 218], | 30.00th=[ 218], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 351], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 1861, max= 2048, per=24.12%, avg=2001.20, stdev=78.73, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 50=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=16.67% cpu : usr=0.06%, sys=9.79%, ctx=78, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148083: Fri Oct 24 02:45:20 2025 read: IOPS=2, BW=2076KiB/s (2126kB/s)(5120KiB/2466msec) clat (msec): min=55, max=193, avg=127.23, stdev=65.58 lat (msec): min=55, max=193, avg=127.23, stdev=65.58 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 56], | 30.00th=[ 61], 40.00th=[ 61], 50.00th=[ 148], 60.00th=[ 148], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 194], 95.00th=[ 194], | 99.00th=[ 194], 99.50th=[ 194], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 2011, max= 6144, per=68.80%, avg=4077.50, stdev=2922.47, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2907KiB/s (2976kB/s)(7168KiB/2466msec); 0 zone resets clat (msec): min=110, max=473, avg=249.92, stdev=120.55 lat (msec): min=110, max=473, avg=250.02, stdev=120.56 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 155], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 209], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 309], 90.00th=[ 472], 95.00th=[ 472], | 99.00th=[ 472], 99.50th=[ 472], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 1875, max= 4071, per=30.14%, avg=2501.25, stdev=1049.14, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=16.67%, 250=58.33%, 500=25.00% cpu : usr=0.08%, sys=11.24%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5928KiB/s (6070kB/s), 593KiB/s-2090KiB/s (607kB/s-2141kB/s), io=20.0MiB (20.0MB), run=2466-3455msec WRITE: bw=8299KiB/s (8498kB/s), 1493KiB/s-2964KiB/s (1529kB/s-3035kB/s), io=28.0MiB (29.4MB), run=2466-3455msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148085: Fri Oct 24 02:45:20 2025 read: IOPS=2, BW=2819KiB/s (2886kB/s)(7168KiB/2543msec) clat (usec): min=930, max=281118, avg=150494.80, stdev=97022.18 lat (usec): min=931, max=281123, avg=150496.69, stdev=97023.23 clat percentiles (usec): | 1.00th=[ 930], 5.00th=[ 930], 10.00th=[ 930], 20.00th=[ 66323], | 30.00th=[145753], 40.00th=[145753], 50.00th=[149947], 60.00th=[160433], | 70.00th=[160433], 80.00th=[250610], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 1809, max= 4096, per=55.93%, avg=3328.00, stdev=1315.52, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=2013KiB/s (2062kB/s)(5120KiB/2543msec); 0 zone resets clat (msec): min=183, max=333, avg=261.88, stdev=66.32 lat (msec): min=184, max=333, avg=261.97, stdev=66.32 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 305], 80.00th=[ 305], 90.00th=[ 334], 95.00th=[ 334], | 99.00th=[ 334], 99.50th=[ 334], 99.90th=[ 334], 99.95th=[ 334], | 99.99th=[ 334] bw ( KiB/s): min= 2048, max= 4096, per=36.88%, avg=3072.00, stdev=1448.15, samples=2 iops : min= 2, max= 4, avg= 3.00, stdev= 1.41, samples=2 lat (usec) : 1000=8.33% lat (msec) : 100=8.33%, 250=50.00%, 500=33.33% cpu : usr=0.20%, sys=38.24%, ctx=532, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148086: Fri Oct 24 02:45:20 2025 read: IOPS=0, BW=595KiB/s (609kB/s)(2048KiB/3442msec) clat (msec): min=186, max=269, avg=228.21, stdev=58.80 lat (msec): min=186, max=269, avg=228.21, stdev=58.80 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 186], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 271], 95.00th=[ 271], | 99.00th=[ 271], 99.50th=[ 271], 99.90th=[ 271], 99.95th=[ 271], | 99.99th=[ 271] bw ( KiB/s): min= 1793, max= 1996, per=31.84%, avg=1894.50, stdev=143.54, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2975KiB/s (3046kB/s)(10.0MiB/3442msec); 0 zone resets clat (msec): min=128, max=777, avg=293.99, stdev=190.24 lat (msec): min=128, max=777, avg=294.12, stdev=190.22 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 153], | 30.00th=[ 161], 40.00th=[ 174], 50.00th=[ 243], 60.00th=[ 292], | 70.00th=[ 305], 80.00th=[ 330], 90.00th=[ 384], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1996, max= 6119, per=39.09%, avg=3256.40, stdev=1828.05, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.52, samples=5 lat (msec) : 250=50.00%, 500=41.67%, 1000=8.33% cpu : usr=0.06%, sys=33.01%, ctx=179, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148087: Fri Oct 24 02:45:20 2025 read: IOPS=2, BW=2091KiB/s (2141kB/s)(6144KiB/2939msec) clat (usec): min=1066, max=248283, avg=110686.63, stdev=110758.51 lat (usec): min=1067, max=248283, avg=110687.69, stdev=110758.36 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1074], 10.00th=[ 1074], 20.00th=[ 15139], | 30.00th=[ 15139], 40.00th=[ 19006], 50.00th=[ 19006], 60.00th=[179307], | 70.00th=[200279], 80.00th=[200279], 90.00th=[248513], 95.00th=[248513], | 99.00th=[248513], 99.50th=[248513], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 1996, max= 4096, per=57.08%, avg=3396.00, stdev=1212.44, samples=3 iops : min= 1, max= 4, avg= 3.00, stdev= 1.73, samples=3 write: IOPS=2, BW=2091KiB/s (2141kB/s)(6144KiB/2939msec); 0 zone resets clat (msec): min=164, max=617, avg=350.68, stdev=163.09 lat (msec): min=164, max=618, avg=350.81, stdev=163.09 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 243], | 30.00th=[ 243], 40.00th=[ 259], 50.00th=[ 259], 60.00th=[ 405], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1802, max= 2048, per=23.85%, avg=1986.60, stdev=105.42, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 lat (msec) : 2=8.33%, 20=16.67%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.10%, sys=33.87%, ctx=348, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148088: Fri Oct 24 02:45:20 2025 read: IOPS=1, BW=1861KiB/s (1906kB/s)(5120KiB/2751msec) clat (usec): min=687, max=199942, avg=64647.45, stdev=91748.04 lat (usec): min=688, max=199944, avg=64648.64, stdev=91747.97 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 685], | 30.00th=[ 775], 40.00th=[ 775], 50.00th=[ 1057], 60.00th=[ 1057], | 70.00th=[121111], 80.00th=[121111], 90.00th=[200279], 95.00th=[200279], | 99.00th=[200279], 99.50th=[200279], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2606KiB/s (2668kB/s)(7168KiB/2751msec); 0 zone resets clat (msec): min=97, max=693, avg=328.43, stdev=235.71 lat (msec): min=97, max=693, avg=328.51, stdev=235.71 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 112], | 30.00th=[ 167], 40.00th=[ 167], 50.00th=[ 268], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 592], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1809, max= 4096, per=35.85%, avg=2986.25, stdev=1226.01, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=16.67% cpu : usr=0.07%, sys=27.89%, ctx=254, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5950KiB/s (6093kB/s), 595KiB/s-2819KiB/s (609kB/s-2886kB/s), io=20.0MiB (20.0MB), run=2543-3442msec WRITE: bw=8330KiB/s (8530kB/s), 2013KiB/s-2975KiB/s (2062kB/s-3046kB/s), io=28.0MiB (29.4MB), run=2543-3442msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148095: Fri Oct 24 02:45:30 2025 read: IOPS=1, BW=5114KiB/s (5236kB/s)(12.0MiB/2403msec) clat (msec): min=465, max=1186, avg=764.31, stdev=375.92 lat (msec): min=465, max=1186, avg=764.31, stdev=375.92 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8143, max= 8192, per=100.00%, avg=8167.50, stdev=34.65, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=10.66%, ctx=52, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148096: Fri Oct 24 02:45:30 2025 read: IOPS=0, BW=1654KiB/s (1694kB/s)(4096KiB/2476msec) clat (nsec): min=926616k, max=926616k, avg=926616105.00, stdev= 0.00 lat (nsec): min=926618k, max=926618k, avg=926617836.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3309KiB/s (3388kB/s)(8192KiB/2476msec); 0 zone resets clat (msec): min=550, max=901, avg=726.16, stdev=248.54 lat (msec): min=550, max=902, avg=726.46, stdev=248.33 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 902], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 902], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 8192, max= 8192, per=61.90%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.08%, sys=8.48%, ctx=206, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148097: Fri Oct 24 02:45:30 2025 write: IOPS=2, BW=11.7MiB/s (12.3MB/s)(12.0MiB/1026msec); 0 zone resets clat (msec): min=260, max=441, avg=323.25, stdev=102.81 lat (msec): min=261, max=442, avg=323.51, stdev=102.83 clat percentiles (msec): | 1.00th=[ 262], 5.00th=[ 262], 10.00th=[ 262], 20.00th=[ 262], | 30.00th=[ 262], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min=13931, max=13931, per=100.00%, avg=13931.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=21.07%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148099: Fri Oct 24 02:45:30 2025 write: IOPS=1, BW=6974KiB/s (7141kB/s)(12.0MiB/1762msec); 0 zone resets clat (msec): min=284, max=910, avg=567.05, stdev=317.64 lat (msec): min=284, max=910, avg=567.31, stdev=317.54 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 506], | 70.00th=[ 911], 80.00th=[ 911], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 6907, max= 8047, per=56.50%, avg=7477.00, stdev=806.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.06%, sys=9.37%, ctx=45, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6617KiB/s (6776kB/s), 1654KiB/s-5114KiB/s (1694kB/s-5236kB/s), io=16.0MiB (16.8MB), run=2403-2476msec WRITE: bw=12.9MiB/s (13.6MB/s), 3309KiB/s-11.7MiB/s (3388kB/s-12.3MB/s), io=32.0MiB (33.6MB), run=1026-2476msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148100: Fri Oct 24 02:45:31 2025 read: IOPS=1, BW=6104KiB/s (6251kB/s)(12.0MiB/2013msec) clat (msec): min=620, max=726, avg=670.73, stdev=53.12 lat (msec): min=620, max=726, avg=670.74, stdev=53.12 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7984, max= 8175, per=100.00%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=28.58%, ctx=617, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148101: Fri Oct 24 02:45:31 2025 read: IOPS=0, BW=1808KiB/s (1851kB/s)(4096KiB/2266msec) clat (nsec): min=673465k, max=673465k, avg=673464820.00, stdev= 0.00 lat (nsec): min=673467k, max=673467k, avg=673467223.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 676], 80.00th=[ 676], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3615KiB/s (3702kB/s)(8192KiB/2266msec); 0 zone resets clat (msec): min=373, max=1215, avg=794.04, stdev=595.40 lat (msec): min=373, max=1218, avg=795.89, stdev=597.62 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 1217], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 8175, max= 8175, per=64.79%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=20.57%, ctx=225, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148102: Fri Oct 24 02:45:31 2025 write: IOPS=1, BW=4732KiB/s (4845kB/s)(12.0MiB/2597msec); 0 zone resets clat (msec): min=203, max=2119, avg=863.27, stdev=1088.74 lat (msec): min=203, max=2120, avg=863.66, stdev=1088.65 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 268], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8094, max= 8094, per=64.15%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.15%, sys=9.13%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148103: Fri Oct 24 02:45:31 2025 write: IOPS=1, BW=6126KiB/s (6273kB/s)(12.0MiB/2006msec); 0 zone resets clat (msec): min=388, max=1204, avg=668.00, stdev=464.76 lat (msec): min=388, max=1204, avg=668.36, stdev=464.73 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7787, max= 7984, per=62.50%, avg=7885.50, stdev=139.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=10.87%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=7230KiB/s (7404kB/s), 1808KiB/s-6104KiB/s (1851kB/s-6251kB/s), io=16.0MiB (16.8MB), run=2013-2266msec WRITE: bw=12.3MiB/s (12.9MB/s), 3615KiB/s-6126KiB/s (3702kB/s-6273kB/s), io=32.0MiB (33.6MB), run=2006-2597msec