== sanity test 398b: DIO and buffer IO race ============== 02:15:52 (1769757352) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.85152 s, 10.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148050: Fri Jan 30 02:18:03 2026 read: IOPS=13, BW=52.2KiB/s (53.4kB/s)(5992KiB/114812msec) clat (usec): min=78, max=674763, avg=37790.63, stdev=33330.37 lat (usec): min=78, max=674765, avg=37794.83, stdev=33330.01 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 165], 10.00th=[ 1319], 20.00th=[ 17433], | 30.00th=[ 21627], 40.00th=[ 26084], 50.00th=[ 31589], 60.00th=[ 37487], | 70.00th=[ 45351], 80.00th=[ 55313], 90.00th=[ 73925], 95.00th=[ 87557], | 99.00th=[137364], 99.50th=[166724], 99.90th=[325059], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 126, per=25.41%, avg=51.83, stdev=23.33, samples=225 iops : min= 1, max= 31, avg=12.32, stdev= 5.87, samples=225 write: IOPS=13, BW=54.8KiB/s (56.2kB/s)(6296KiB/114812msec); 0 zone resets clat (usec): min=792, max=370763, avg=36718.99, stdev=39867.53 lat (usec): min=793, max=370764, avg=36721.01, stdev=39867.56 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1139], 10.00th=[ 1336], 20.00th=[ 3359], | 30.00th=[ 6456], 40.00th=[ 16450], 50.00th=[ 25560], 60.00th=[ 35914], | 70.00th=[ 47973], 80.00th=[ 64226], 90.00th=[ 87557], 95.00th=[113771], | 99.00th=[168821], 99.50th=[200279], 99.90th=[308282], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 127, per=25.60%, avg=54.79, stdev=22.64, samples=224 iops : min= 1, max= 31, avg=13.07, stdev= 5.70, samples=224 lat (usec) : 100=0.07%, 250=4.10%, 500=0.46%, 750=0.10%, 1000=0.29% lat (msec) : 2=7.26%, 4=4.56%, 10=7.00%, 20=11.26%, 50=37.34% lat (msec) : 100=22.49%, 250=4.92%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=5.18%, ctx=6578, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148051: Fri Jan 30 02:18:03 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(5940KiB/117177msec) clat (usec): min=102, max=900402, avg=38386.88, stdev=37540.24 lat (usec): min=103, max=900405, avg=38390.85, stdev=37541.02 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 172], 10.00th=[ 6128], 20.00th=[ 16909], | 30.00th=[ 21365], 40.00th=[ 25822], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 45876], 80.00th=[ 55837], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[137364], 99.50th=[156238], 99.90th=[387974], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 119, per=24.83%, avg=50.66, stdev=23.17, samples=228 iops : min= 1, max= 29, avg=12.03, stdev= 5.83, samples=228 write: IOPS=13, BW=54.2KiB/s (55.5kB/s)(6348KiB/117177msec); 0 zone resets clat (usec): min=737, max=379306, avg=37665.65, stdev=40450.32 lat (usec): min=738, max=379308, avg=37669.31, stdev=40449.45 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1123], 10.00th=[ 1303], 20.00th=[ 3032], | 30.00th=[ 7308], 40.00th=[ 16712], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 49021], 80.00th=[ 62129], 90.00th=[ 90702], 95.00th=[117965], | 99.00th=[181404], 99.50th=[193987], 99.90th=[265290], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 199, per=25.16%, avg=53.84, stdev=26.27, samples=229 iops : min= 1, max= 49, avg=12.83, stdev= 6.60, samples=229 lat (usec) : 250=3.32%, 500=0.78%, 750=0.16%, 1000=0.49% lat (msec) : 2=7.75%, 4=4.33%, 10=6.09%, 20=12.24%, 50=37.37% lat (msec) : 100=21.39%, 250=5.92%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=5.04%, ctx=6490, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148053: Fri Jan 30 02:18:03 2026 read: IOPS=12, BW=51.0KiB/s (53.2kB/s)(6028KiB/115936msec) clat (usec): min=89, max=706652, avg=37767.21, stdev=35592.93 lat (usec): min=90, max=706654, avg=37768.42, stdev=35592.92 clat percentiles (usec): | 1.00th=[ 137], 5.00th=[ 169], 10.00th=[ 5342], 20.00th=[ 16581], | 30.00th=[ 21103], 40.00th=[ 25035], 50.00th=[ 30278], 60.00th=[ 36963], | 70.00th=[ 44827], 80.00th=[ 56361], 90.00th=[ 70779], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[164627], 99.90th=[467665], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 7, max= 144, per=25.26%, avg=51.53, stdev=24.08, samples=227 iops : min= 1, max= 36, avg=12.25, stdev= 6.06, samples=227 write: IOPS=13, BW=53.0KiB/s (55.3kB/s)(6260KiB/115936msec); 0 zone resets clat (usec): min=808, max=263864, avg=37482.15, stdev=37510.79 lat (usec): min=810, max=263866, avg=37485.00, stdev=37512.50 clat percentiles (usec): | 1.00th=[ 1029], 5.00th=[ 1156], 10.00th=[ 1483], 20.00th=[ 3523], | 30.00th=[ 8717], 40.00th=[ 18744], 50.00th=[ 27657], 60.00th=[ 37487], | 70.00th=[ 49546], 80.00th=[ 65274], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[160433], 99.50th=[187696], 99.90th=[242222], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 126, per=24.87%, avg=53.22, stdev=21.96, samples=228 iops : min= 1, max= 31, avg=12.68, stdev= 5.53, samples=228 lat (usec) : 100=0.03%, 250=3.68%, 500=0.42%, 750=0.23%, 1000=0.42% lat (msec) : 2=6.90%, 4=3.78%, 10=6.05%, 20=12.96%, 50=37.83% lat (msec) : 100=22.43%, 250=5.11%, 500=0.13%, 750=0.03% cpu : usr=0.08%, sys=5.14%, ctx=6598, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148054: Fri Jan 30 02:18:03 2026 read: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6052KiB/115723msec) clat (usec): min=91, max=910599, avg=37587.78, stdev=37867.94 lat (usec): min=91, max=910600, avg=37592.83, stdev=37869.88 clat percentiles (usec): | 1.00th=[ 129], 5.00th=[ 165], 10.00th=[ 1188], 20.00th=[ 16188], | 30.00th=[ 20579], 40.00th=[ 25035], 50.00th=[ 29492], 60.00th=[ 35914], | 70.00th=[ 44303], 80.00th=[ 55837], 90.00th=[ 71828], 95.00th=[ 90702], | 99.00th=[143655], 99.50th=[179307], 99.90th=[274727], 99.95th=[910164], | 99.99th=[910164] bw ( KiB/s): min= 7, max= 119, per=25.87%, avg=52.78, stdev=22.12, samples=224 iops : min= 1, max= 29, avg=12.55, stdev= 5.57, samples=224 write: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6236KiB/115723msec); 0 zone resets clat (usec): min=724, max=369802, avg=37518.08, stdev=39849.38 lat (usec): min=725, max=369804, avg=37520.23, stdev=39848.80 clat percentiles (usec): | 1.00th=[ 1020], 5.00th=[ 1139], 10.00th=[ 1352], 20.00th=[ 3359], | 30.00th=[ 7242], 40.00th=[ 16909], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 49546], 80.00th=[ 66847], 90.00th=[ 90702], 95.00th=[108528], | 99.00th=[166724], 99.50th=[202376], 99.90th=[308282], 99.95th=[371196], | 99.99th=[371196] bw ( KiB/s): min= 7, max= 120, per=25.03%, avg=53.56, stdev=22.06, samples=227 iops : min= 1, max= 30, avg=12.76, stdev= 5.56, samples=227 lat (usec) : 100=0.07%, 250=3.94%, 500=0.59%, 750=0.26%, 1000=0.42% lat (msec) : 2=7.16%, 4=4.23%, 10=6.22%, 20=12.89%, 50=36.88% lat (msec) : 100=22.01%, 250=5.08%, 500=0.23%, 1000=0.03% cpu : usr=0.07%, sys=5.25%, ctx=6465, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=205KiB/s (210kB/s), 50.7KiB/s-52.3KiB/s (51.9kB/s-53.6kB/s), io=23.4MiB (24.6MB), run=114812-117177msec WRITE: bw=215KiB/s (220kB/s), 53.9KiB/s-54.8KiB/s (55.2kB/s-56.2kB/s), io=24.6MiB (25.7MB), run=114812-117177msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148055: Fri Jan 30 02:19:52 2026 read: IOPS=6, BW=26.6KiB/s (27.2kB/s)(5992KiB/225634msec) clat (msec): min=4, max=702, avg=30.25, stdev=38.18 lat (msec): min=4, max=702, avg=30.25, stdev=38.18 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 67], 95.00th=[ 91], | 99.00th=[ 148], 99.50th=[ 209], 99.90th=[ 550], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 7, max= 103, per=27.42%, avg=29.06, stdev=19.94, samples=401 iops : min= 1, max= 25, avg= 6.68, stdev= 5.08, samples=401 write: IOPS=6, BW=27.9KiB/s (28.6kB/s)(6296KiB/225634msec); 0 zone resets clat (msec): min=29, max=635, avg=114.39, stdev=62.62 lat (msec): min=29, max=635, avg=114.39, stdev=62.62 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 87], 50.00th=[ 97], 60.00th=[ 110], | 70.00th=[ 129], 80.00th=[ 153], 90.00th=[ 190], 95.00th=[ 241], | 99.00th=[ 334], 99.50th=[ 376], 99.90th=[ 600], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 7, max= 79, per=24.85%, avg=27.59, stdev=13.58, samples=443 iops : min= 1, max= 19, avg= 6.29, stdev= 3.48, samples=443 lat (msec) : 10=7.32%, 20=19.14%, 50=17.25%, 100=29.92%, 250=24.12% lat (msec) : 500=2.12%, 750=0.13% cpu : usr=0.05%, sys=1.20%, ctx=5202, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148056: Fri Jan 30 02:19:52 2026 read: IOPS=6, BW=26.3KiB/s (26.9kB/s)(5940KiB/225962msec) clat (msec): min=4, max=886, avg=31.23, stdev=43.60 lat (msec): min=4, max=886, avg=31.23, stdev=43.60 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 23], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 71], 95.00th=[ 97], | 99.00th=[ 165], 99.50th=[ 215], 99.90th=[ 667], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 103, per=26.84%, avg=28.45, stdev=18.97, samples=405 iops : min= 1, max= 25, avg= 6.52, stdev= 4.79, samples=405 write: IOPS=7, BW=28.1KiB/s (28.8kB/s)(6348KiB/225962msec); 0 zone resets clat (msec): min=29, max=477, avg=112.97, stdev=58.86 lat (msec): min=29, max=477, avg=112.98, stdev=58.86 clat percentiles (msec): | 1.00th=[ 41], 5.00th=[ 50], 10.00th=[ 57], 20.00th=[ 69], | 30.00th=[ 78], 40.00th=[ 86], 50.00th=[ 96], 60.00th=[ 109], | 70.00th=[ 127], 80.00th=[ 153], 90.00th=[ 194], 95.00th=[ 232], | 99.00th=[ 317], 99.50th=[ 342], 99.90th=[ 418], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 7, max= 63, per=25.21%, avg=27.98, stdev=13.45, samples=439 iops : min= 1, max= 15, avg= 6.39, stdev= 3.46, samples=439 lat (msec) : 10=6.87%, 20=19.76%, 50=16.70%, 100=30.47%, 250=24.02% lat (msec) : 500=2.12%, 750=0.03%, 1000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5156, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148057: Fri Jan 30 02:19:52 2026 read: IOPS=6, BW=26.7KiB/s (27.4kB/s)(6028KiB/225592msec) clat (msec): min=5, max=326, avg=30.76, stdev=32.81 lat (msec): min=5, max=326, avg=30.76, stdev=32.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 97], | 99.00th=[ 161], 99.50th=[ 197], 99.90th=[ 305], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 134, per=27.13%, avg=28.76, stdev=20.33, samples=406 iops : min= 1, max= 33, avg= 6.59, stdev= 5.14, samples=406 write: IOPS=6, BW=27.7KiB/s (28.4kB/s)(6260KiB/225592msec); 0 zone resets clat (msec): min=31, max=1007, avg=114.32, stdev=65.81 lat (msec): min=31, max=1007, avg=114.32, stdev=65.81 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 57], 20.00th=[ 67], | 30.00th=[ 77], 40.00th=[ 85], 50.00th=[ 95], 60.00th=[ 108], | 70.00th=[ 127], 80.00th=[ 153], 90.00th=[ 199], 95.00th=[ 241], | 99.00th=[ 342], 99.50th=[ 384], 99.90th=[ 477], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 71, per=24.79%, avg=27.51, stdev=13.88, samples=440 iops : min= 1, max= 17, avg= 6.28, stdev= 3.56, samples=440 lat (msec) : 10=7.16%, 20=18.88%, 50=17.42%, 100=30.86%, 250=23.40% lat (msec) : 500=2.25%, 2000=0.03% cpu : usr=0.04%, sys=1.18%, ctx=5179, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148058: Fri Jan 30 02:19:52 2026 read: IOPS=6, BW=26.8KiB/s (27.5kB/s)(6052KiB/225613msec) clat (msec): min=4, max=675, avg=28.85, stdev=35.08 lat (msec): min=4, max=675, avg=28.85, stdev=35.08 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 14], 40.00th=[ 16], 50.00th=[ 18], 60.00th=[ 22], | 70.00th=[ 27], 80.00th=[ 38], 90.00th=[ 64], 95.00th=[ 87], | 99.00th=[ 132], 99.50th=[ 167], 99.90th=[ 550], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 7, max= 119, per=27.62%, avg=29.28, stdev=20.44, samples=402 iops : min= 1, max= 29, avg= 6.72, stdev= 5.18, samples=402 write: IOPS=6, BW=27.6KiB/s (28.3kB/s)(6236KiB/225613msec); 0 zone resets clat (msec): min=32, max=1071, avg=116.53, stdev=66.54 lat (msec): min=32, max=1071, avg=116.53, stdev=66.54 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 53], 10.00th=[ 60], 20.00th=[ 70], | 30.00th=[ 79], 40.00th=[ 88], 50.00th=[ 99], 60.00th=[ 111], | 70.00th=[ 127], 80.00th=[ 157], 90.00th=[ 201], 95.00th=[ 239], | 99.00th=[ 355], 99.50th=[ 393], 99.90th=[ 531], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 63, per=24.67%, avg=27.38, stdev=13.27, samples=442 iops : min= 1, max= 15, avg= 6.24, stdev= 3.41, samples=442 lat (msec) : 10=6.54%, 20=21.00%, 50=15.98%, 100=30.37%, 250=24.06% lat (msec) : 500=1.92%, 750=0.10%, 2000=0.03% cpu : usr=0.04%, sys=1.21%, ctx=5171, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=106KiB/s (109kB/s), 26.3KiB/s-26.8KiB/s (26.9kB/s-27.5kB/s), io=23.4MiB (24.6MB), run=225592-225962msec WRITE: bw=111KiB/s (114kB/s), 27.6KiB/s-28.1KiB/s (28.3kB/s-28.8kB/s), io=24.6MiB (25.7MB), run=225592-225962msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148109: Fri Jan 30 02:20:25 2026 read: IOPS=17, BW=277KiB/s (284kB/s)(5920KiB/21369msec) clat (usec): min=86, max=196599, avg=31398.51, stdev=24918.84 lat (usec): min=87, max=196600, avg=31399.71, stdev=24918.86 clat percentiles (usec): | 1.00th=[ 115], 5.00th=[ 141], 10.00th=[ 159], 20.00th=[ 578], | 30.00th=[ 19792], 40.00th=[ 24249], 50.00th=[ 28967], 60.00th=[ 34341], | 70.00th=[ 41157], 80.00th=[ 48497], 90.00th=[ 62653], 95.00th=[ 71828], | 99.00th=[ 96994], 99.50th=[120062], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 121, max= 445, per=27.15%, avg=281.00, stdev=85.42, samples=40 iops : min= 7, max= 27, avg=16.80, stdev= 5.37, samples=40 write: IOPS=18, BW=298KiB/s (305kB/s)(6368KiB/21369msec); 0 zone resets clat (usec): min=1237, max=148220, avg=24411.16, stdev=25605.85 lat (usec): min=1238, max=148222, avg=24412.90, stdev=25605.92 clat percentiles (usec): | 1.00th=[ 1418], 5.00th=[ 1647], 10.00th=[ 1844], 20.00th=[ 3163], | 30.00th=[ 5407], 40.00th=[ 8848], 50.00th=[ 14091], 60.00th=[ 25035], | 70.00th=[ 32375], 80.00th=[ 42730], 90.00th=[ 61080], 95.00th=[ 70779], | 99.00th=[111674], 99.50th=[145753], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 126, max= 445, per=27.46%, avg=299.00, stdev=83.67, samples=41 iops : min= 7, max= 27, avg=17.95, stdev= 5.24, samples=41 lat (usec) : 100=0.13%, 250=8.33%, 500=0.91%, 750=0.52% lat (msec) : 2=7.16%, 4=5.73%, 10=10.68%, 20=9.51%, 50=39.58% lat (msec) : 100=16.15%, 250=1.30% cpu : usr=0.09%, sys=6.87%, ctx=1389, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148110: Fri Jan 30 02:20:25 2026 read: IOPS=15, BW=252KiB/s (258kB/s)(5744KiB/22809msec) clat (usec): min=98, max=161714, avg=32448.11, stdev=24539.88 lat (usec): min=99, max=161715, avg=32449.20, stdev=24539.92 clat percentiles (usec): | 1.00th=[ 118], 5.00th=[ 151], 10.00th=[ 167], 20.00th=[ 3425], | 30.00th=[ 20317], 40.00th=[ 25035], 50.00th=[ 30540], 60.00th=[ 35390], | 70.00th=[ 42206], 80.00th=[ 51643], 90.00th=[ 64226], 95.00th=[ 74974], | 99.00th=[ 99091], 99.50th=[104334], 99.90th=[162530], 99.95th=[162530], | 99.99th=[162530] bw ( KiB/s): min= 48, max= 477, per=25.59%, avg=264.83, stdev=95.07, samples=42 iops : min= 3, max= 29, avg=15.79, stdev= 5.97, samples=42 write: IOPS=17, BW=287KiB/s (294kB/s)(6544KiB/22809msec); 0 zone resets clat (usec): min=1248, max=241197, avg=27183.72, stdev=34018.53 lat (usec): min=1251, max=241198, avg=27188.72, stdev=34017.23 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 1647], 10.00th=[ 2114], 20.00th=[ 3326], | 30.00th=[ 5932], 40.00th=[ 8717], 50.00th=[ 14877], 60.00th=[ 22152], | 70.00th=[ 31589], 80.00th=[ 46400], 90.00th=[ 67634], 95.00th=[ 87557], | 99.00th=[160433], 99.50th=[221250], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 60, max= 443, per=26.20%, avg=285.34, stdev=107.78, samples=44 iops : min= 3, max= 27, avg=17.07, stdev= 6.81, samples=44 lat (usec) : 100=0.13%, 250=7.03%, 500=0.78%, 750=0.13%, 1000=0.26% lat (msec) : 2=5.47%, 4=8.46%, 10=10.03%, 20=11.59%, 50=36.98% lat (msec) : 100=16.80%, 250=2.34% cpu : usr=0.05%, sys=6.57%, ctx=1449, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148111: Fri Jan 30 02:20:25 2026 read: IOPS=16, BW=271KiB/s (278kB/s)(6256KiB/23082msec) clat (usec): min=97, max=191829, avg=32545.62, stdev=26578.73 lat (usec): min=98, max=191830, avg=32546.65, stdev=26578.73 clat percentiles (usec): | 1.00th=[ 133], 5.00th=[ 153], 10.00th=[ 172], 20.00th=[ 1270], | 30.00th=[ 19006], 40.00th=[ 25297], 50.00th=[ 30278], 60.00th=[ 34866], | 70.00th=[ 43779], 80.00th=[ 52691], 90.00th=[ 65274], 95.00th=[ 77071], | 99.00th=[113771], 99.50th=[166724], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 60, max= 476, per=26.43%, avg=273.53, stdev=98.92, samples=45 iops : min= 3, max= 29, avg=16.33, stdev= 6.19, samples=45 write: IOPS=16, BW=261KiB/s (268kB/s)(6032KiB/23082msec); 0 zone resets clat (usec): min=1373, max=147024, avg=27310.34, stdev=27571.25 lat (usec): min=1375, max=147027, avg=27315.93, stdev=27571.25 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1811], 10.00th=[ 2278], 20.00th=[ 3916], | 30.00th=[ 6128], 40.00th=[ 10421], 50.00th=[ 17957], 60.00th=[ 27132], | 70.00th=[ 35390], 80.00th=[ 51119], 90.00th=[ 64750], 95.00th=[ 80217], | 99.00th=[131597], 99.50th=[143655], 99.90th=[147850], 99.95th=[147850], | 99.99th=[147850] bw ( KiB/s): min= 95, max= 539, per=24.00%, avg=261.38, stdev=97.48, samples=45 iops : min= 5, max= 33, avg=15.58, stdev= 6.10, samples=45 lat (usec) : 100=0.13%, 250=7.81%, 500=1.69%, 1000=0.52% lat (msec) : 2=4.17%, 4=6.90%, 10=9.51%, 20=11.07%, 50=36.33% lat (msec) : 100=20.18%, 250=1.69% cpu : usr=0.06%, sys=6.60%, ctx=1463, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148112: Fri Jan 30 02:20:25 2026 read: IOPS=16, BW=261KiB/s (267kB/s)(6032KiB/23140msec) clat (usec): min=67, max=150530, avg=32117.84, stdev=25652.21 lat (usec): min=68, max=150531, avg=32125.28, stdev=25647.40 clat percentiles (usec): | 1.00th=[ 117], 5.00th=[ 141], 10.00th=[ 161], 20.00th=[ 725], | 30.00th=[ 17171], 40.00th=[ 23462], 50.00th=[ 30540], 60.00th=[ 38011], | 70.00th=[ 44303], 80.00th=[ 51643], 90.00th=[ 65274], 95.00th=[ 78119], | 99.00th=[103285], 99.50th=[112722], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 90, max= 445, per=24.90%, avg=257.76, stdev=91.19, samples=45 iops : min= 5, max= 27, avg=15.33, stdev= 5.70, samples=45 write: IOPS=16, BW=270KiB/s (277kB/s)(6256KiB/23140msec); 0 zone resets clat (usec): min=949, max=136779, avg=28116.95, stdev=28820.50 lat (usec): min=949, max=136781, avg=28120.00, stdev=28822.11 clat percentiles (usec): | 1.00th=[ 1369], 5.00th=[ 1598], 10.00th=[ 1860], 20.00th=[ 3425], | 30.00th=[ 6521], 40.00th=[ 11731], 50.00th=[ 18744], 60.00th=[ 27919], | 70.00th=[ 35390], 80.00th=[ 47973], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[126354], 99.50th=[128451], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 95, max= 479, per=24.54%, avg=267.20, stdev=91.40, samples=45 iops : min= 5, max= 29, avg=15.93, stdev= 5.77, samples=45 lat (usec) : 100=0.26%, 250=8.20%, 500=1.04%, 750=0.39%, 1000=0.52% lat (msec) : 2=5.99%, 4=6.12%, 10=8.72%, 20=11.85%, 50=35.68% lat (msec) : 100=18.49%, 250=2.73% cpu : usr=0.08%, sys=6.30%, ctx=1440, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1035KiB/s (1060kB/s), 252KiB/s-277KiB/s (258kB/s-284kB/s), io=23.4MiB (24.5MB), run=21369-23140msec WRITE: bw=1089KiB/s (1115kB/s), 261KiB/s-298KiB/s (268kB/s-305kB/s), io=24.6MiB (25.8MB), run=21369-23140msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148104: Fri Jan 30 02:20:56 2026 read: IOPS=6, BW=111KiB/s (114kB/s)(5920KiB/53298msec) clat (msec): min=5, max=410, avg=33.03, stdev=37.44 lat (msec): min=5, max=410, avg=33.03, stdev=37.44 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 43], 90.00th=[ 66], 95.00th=[ 104], | 99.00th=[ 197], 99.50th=[ 234], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 31, max= 319, per=25.46%, avg=113.81, stdev=70.52, samples=101 iops : min= 1, max= 19, avg= 6.36, stdev= 4.53, samples=101 write: IOPS=7, BW=119KiB/s (122kB/s)(6368KiB/53298msec); 0 zone resets clat (msec): min=29, max=391, avg=103.08, stdev=44.24 lat (msec): min=29, max=391, avg=103.09, stdev=44.24 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 75], 40.00th=[ 84], 50.00th=[ 93], 60.00th=[ 104], | 70.00th=[ 122], 80.00th=[ 136], 90.00th=[ 159], 95.00th=[ 190], | 99.00th=[ 234], 99.50th=[ 275], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 31, max= 224, per=25.11%, avg=118.28, stdev=49.12, samples=105 iops : min= 1, max= 14, avg= 6.64, stdev= 3.19, samples=105 lat (msec) : 10=4.69%, 20=16.80%, 50=20.83%, 100=33.07%, 250=24.22% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.45%, ctx=1250, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148105: Fri Jan 30 02:20:56 2026 read: IOPS=6, BW=107KiB/s (110kB/s)(5744KiB/53478msec) clat (msec): min=5, max=403, avg=30.29, stdev=33.67 lat (msec): min=5, max=403, avg=30.29, stdev=33.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 41], 90.00th=[ 64], 95.00th=[ 83], | 99.00th=[ 169], 99.50th=[ 209], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 30, max= 380, per=26.51%, avg=118.51, stdev=77.21, samples=96 iops : min= 1, max= 23, avg= 6.67, stdev= 4.90, samples=96 write: IOPS=7, BW=122KiB/s (125kB/s)(6544KiB/53478msec); 0 zone resets clat (msec): min=32, max=304, avg=103.80, stdev=46.09 lat (msec): min=32, max=304, avg=103.80, stdev=46.09 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 50], 10.00th=[ 58], 20.00th=[ 67], | 30.00th=[ 77], 40.00th=[ 83], 50.00th=[ 92], 60.00th=[ 104], | 70.00th=[ 121], 80.00th=[ 138], 90.00th=[ 161], 95.00th=[ 199], | 99.00th=[ 249], 99.50th=[ 262], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 286, per=26.15%, avg=123.16, stdev=52.11, samples=105 iops : min= 1, max= 17, avg= 6.94, stdev= 3.37, samples=105 lat (msec) : 10=4.43%, 20=19.66%, 50=19.14%, 100=32.55%, 250=23.57% lat (msec) : 500=0.65% cpu : usr=0.04%, sys=1.49%, ctx=1270, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148106: Fri Jan 30 02:20:56 2026 read: IOPS=7, BW=120KiB/s (123kB/s)(6256KiB/51986msec) clat (msec): min=5, max=193, avg=29.53, stdev=27.04 lat (msec): min=5, max=193, avg=29.53, stdev=27.04 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 38], 90.00th=[ 60], 95.00th=[ 87], | 99.00th=[ 161], 99.50th=[ 180], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 31, max= 512, per=27.74%, avg=124.01, stdev=87.94, samples=100 iops : min= 1, max= 32, avg= 7.00, stdev= 5.59, samples=100 write: IOPS=7, BW=116KiB/s (119kB/s)(6032KiB/51986msec); 0 zone resets clat (msec): min=36, max=401, avg=106.97, stdev=49.25 lat (msec): min=36, max=401, avg=106.97, stdev=49.25 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 69], | 30.00th=[ 74], 40.00th=[ 83], 50.00th=[ 94], 60.00th=[ 109], | 70.00th=[ 122], 80.00th=[ 144], 90.00th=[ 174], 95.00th=[ 203], | 99.00th=[ 264], 99.50th=[ 284], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 31, max= 224, per=24.48%, avg=115.30, stdev=51.54, samples=103 iops : min= 1, max= 14, avg= 6.46, stdev= 3.38, samples=103 lat (msec) : 10=5.21%, 20=20.18%, 50=20.57%, 100=29.95%, 250=23.18% lat (msec) : 500=0.91% cpu : usr=0.03%, sys=1.52%, ctx=1270, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148107: Fri Jan 30 02:20:56 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(6032KiB/52928msec) clat (msec): min=5, max=320, avg=31.40, stdev=34.17 lat (msec): min=5, max=320, avg=31.41, stdev=34.17 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 19], 60.00th=[ 24], | 70.00th=[ 30], 80.00th=[ 43], 90.00th=[ 64], 95.00th=[ 113], | 99.00th=[ 174], 99.50th=[ 194], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 351, per=27.76%, avg=124.10, stdev=74.21, samples=96 iops : min= 1, max= 21, avg= 7.01, stdev= 4.66, samples=96 write: IOPS=7, BW=118KiB/s (121kB/s)(6256KiB/52928msec); 0 zone resets clat (msec): min=33, max=343, avg=104.74, stdev=46.11 lat (msec): min=33, max=343, avg=104.75, stdev=46.11 clat percentiles (msec): | 1.00th=[ 40], 5.00th=[ 51], 10.00th=[ 58], 20.00th=[ 68], | 30.00th=[ 78], 40.00th=[ 86], 50.00th=[ 95], 60.00th=[ 105], | 70.00th=[ 118], 80.00th=[ 136], 90.00th=[ 163], 95.00th=[ 199], | 99.00th=[ 243], 99.50th=[ 326], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 255, per=25.31%, avg=119.19, stdev=50.28, samples=104 iops : min= 1, max= 15, avg= 6.69, stdev= 3.27, samples=104 lat (msec) : 10=4.17%, 20=21.74%, 50=17.71%, 100=30.86%, 250=25.00% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.44%, ctx=1312, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=448KiB/s (459kB/s), 107KiB/s-120KiB/s (110kB/s-123kB/s), io=23.4MiB (24.5MB), run=51986-53478msec WRITE: bw=471KiB/s (483kB/s), 116KiB/s-122KiB/s (119kB/s-125kB/s), io=24.6MiB (25.8MB), run=51986-53478msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148126: Fri Jan 30 02:21:10 2026 read: IOPS=1, BW=1431KiB/s (1466kB/s)(7168KiB/5008msec) clat (msec): min=28, max=2351, avg=475.29, stdev=831.49 lat (msec): min=28, max=2351, avg=475.29, stdev=831.49 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 29], 10.00th=[ 29], 20.00th=[ 112], | 30.00th=[ 124], 40.00th=[ 124], 50.00th=[ 192], 60.00th=[ 249], | 70.00th=[ 249], 80.00th=[ 275], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 1444, max= 4096, per=77.98%, avg=2904.00, stdev=1393.69, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.73, samples=4 write: IOPS=0, BW=1022KiB/s (1047kB/s)(5120KiB/5008msec); 0 zone resets clat (msec): min=242, max=447, avg=313.48, stdev=79.05 lat (msec): min=242, max=447, avg=313.56, stdev=79.03 clat percentiles (msec): | 1.00th=[ 243], 5.00th=[ 243], 10.00th=[ 243], 20.00th=[ 243], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 296], 60.00th=[ 296], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1946, max= 4079, per=51.18%, avg=2668.33, stdev=1221.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 50=8.33%, 250=41.67%, 500=41.67%, >=2000=8.33% cpu : usr=0.02%, sys=12.86%, ctx=694, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148127: Fri Jan 30 02:21:10 2026 read: IOPS=0, BW=372KiB/s (381kB/s)(2048KiB/5498msec) clat (usec): min=806, max=146395, avg=73601.21, stdev=102946.99 lat (usec): min=807, max=146398, avg=73602.99, stdev=102948.02 clat percentiles (usec): | 1.00th=[ 807], 5.00th=[ 807], 10.00th=[ 807], 20.00th=[ 807], | 30.00th=[ 807], 40.00th=[ 807], 50.00th=[ 807], 60.00th=[145753], | 70.00th=[145753], 80.00th=[145753], 90.00th=[145753], 95.00th=[145753], | 99.00th=[145753], 99.50th=[145753], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 1471, max= 1980, per=46.33%, avg=1725.50, stdev=359.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1862KiB/s (1907kB/s)(10.0MiB/5498msec); 0 zone resets clat (msec): min=107, max=2631, avg=532.93, stdev=769.71 lat (msec): min=107, max=2631, avg=533.00, stdev=769.71 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 131], | 30.00th=[ 186], 40.00th=[ 188], 50.00th=[ 226], 60.00th=[ 268], | 70.00th=[ 288], 80.00th=[ 435], 90.00th=[ 869], 95.00th=[ 2635], | 99.00th=[ 2635], 99.50th=[ 2635], 99.90th=[ 2635], 99.95th=[ 2635], | 99.99th=[ 2635] bw ( KiB/s): min= 1980, max= 8078, per=86.53%, avg=4511.75, stdev=2561.48, samples=4 iops : min= 1, max= 7, avg= 3.75, stdev= 2.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=50.00%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=11.92%, ctx=154, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148128: Fri Jan 30 02:21:10 2026 read: IOPS=1, BW=1201KiB/s (1230kB/s)(6144KiB/5115msec) clat (usec): min=1684, max=324559, avg=135538.27, stdev=149294.19 lat (usec): min=1685, max=324560, avg=135539.37, stdev=149294.28 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1680], 10.00th=[ 1680], 20.00th=[ 2245], | 30.00th=[ 2245], 40.00th=[ 3032], 50.00th=[ 3032], 60.00th=[229639], | 70.00th=[252707], 80.00th=[252707], 90.00th=[325059], 95.00th=[325059], | 99.00th=[325059], 99.50th=[325059], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 4079, max= 4096, per=100.00%, avg=4087.50, stdev=12.02, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1201KiB/s (1230kB/s)(6144KiB/5115msec); 0 zone resets clat (msec): min=145, max=2539, avg=710.47, stdev=916.15 lat (msec): min=145, max=2539, avg=710.54, stdev=916.17 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 368], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1946, max= 3165, per=45.77%, avg=2386.33, stdev=676.27, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 lat (msec) : 2=8.33%, 4=16.67%, 250=25.00%, 500=33.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=7.08%, ctx=101, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148129: Fri Jan 30 02:21:10 2026 read: IOPS=1, BW=1030KiB/s (1054kB/s)(5120KiB/4973msec) clat (usec): min=512, max=359113, avg=106362.06, stdev=158458.85 lat (usec): min=512, max=359115, avg=106363.11, stdev=158458.96 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 775], 40.00th=[ 775], 50.00th=[ 4015], 60.00th=[ 4015], | 70.00th=[166724], 80.00th=[166724], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1441KiB/s (1476kB/s)(7168KiB/4973msec); 0 zone resets clat (msec): min=157, max=2525, avg=624.11, stdev=842.40 lat (msec): min=157, max=2525, avg=624.18, stdev=842.40 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 249], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 376], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 384], 90.00th=[ 2534], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1477, max= 4096, per=55.04%, avg=2870.00, stdev=1352.48, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=41.67%, >=2000=8.33% cpu : usr=0.00%, sys=11.97%, ctx=182, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3725KiB/s (3814kB/s), 372KiB/s-1431KiB/s (381kB/s-1466kB/s), io=20.0MiB (20.0MB), run=4973-5498msec WRITE: bw=5215KiB/s (5340kB/s), 1022KiB/s-1862KiB/s (1047kB/s-1907kB/s), io=28.0MiB (29.4MB), run=4973-5498msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148131: Fri Jan 30 02:21:11 2026 read: IOPS=1, BW=1139KiB/s (1166kB/s)(7168KiB/6293msec) clat (msec): min=55, max=2266, avg=726.20, stdev=847.28 lat (msec): min=55, max=2266, avg=726.20, stdev=847.28 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 56], 10.00th=[ 56], 20.00th=[ 65], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 271], 60.00th=[ 894], | 70.00th=[ 894], 80.00th=[ 1401], 90.00th=[ 2265], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 2000, max= 4079, per=74.89%, avg=2436.80, stdev=918.15, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=0, BW=814KiB/s (833kB/s)(5120KiB/6293msec); 0 zone resets clat (msec): min=94, max=415, avg=229.37, stdev=148.37 lat (msec): min=94, max=415, avg=229.47, stdev=148.41 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 142], 60.00th=[ 142], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2023, max= 6000, per=88.05%, avg=4011.50, stdev=2812.16, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=25.00%, 250=25.00%, 500=25.00%, 1000=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=2.35%, ctx=63, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148132: Fri Jan 30 02:21:11 2026 read: IOPS=0, BW=329KiB/s (337kB/s)(2048KiB/6226msec) clat (msec): min=172, max=229, avg=201.02, stdev=39.96 lat (msec): min=172, max=229, avg=201.02, stdev=39.97 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 230], | 70.00th=[ 230], 80.00th=[ 230], 90.00th=[ 230], 95.00th=[ 230], | 99.00th=[ 230], 99.50th=[ 230], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 1570, max= 2023, per=55.21%, avg=1796.50, stdev=320.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1645KiB/s (1684kB/s)(10.0MiB/6226msec); 0 zone resets clat (msec): min=112, max=2514, avg=573.25, stdev=717.18 lat (msec): min=112, max=2514, avg=573.33, stdev=717.19 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 122], | 30.00th=[ 199], 40.00th=[ 275], 50.00th=[ 309], 60.00th=[ 321], | 70.00th=[ 409], 80.00th=[ 709], 90.00th=[ 760], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 2023, max= 6000, per=66.67%, avg=3037.33, stdev=1665.62, samples=6 iops : min= 1, max= 5, avg= 2.17, stdev= 1.60, samples=6 lat (msec) : 250=41.67%, 500=33.33%, 750=8.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.12%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148133: Fri Jan 30 02:21:11 2026 read: IOPS=1, BW=1085KiB/s (1111kB/s)(6144KiB/5664msec) clat (msec): min=90, max=509, avg=212.38, stdev=160.90 lat (msec): min=90, max=509, avg=212.38, stdev=160.90 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 142], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2023, max= 4079, per=83.31%, avg=2711.00, stdev=1184.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1085KiB/s (1111kB/s)(6144KiB/5664msec); 0 zone resets clat (msec): min=146, max=2993, avg=720.44, stdev=1117.16 lat (msec): min=146, max=2993, avg=720.54, stdev=1117.16 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 176], | 30.00th=[ 176], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 338], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 2023, max= 3250, per=53.50%, avg=2437.33, stdev=703.84, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.41%, ctx=68, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148134: Fri Jan 30 02:21:11 2026 read: IOPS=0, BW=857KiB/s (878kB/s)(5120KiB/5974msec) clat (msec): min=67, max=893, avg=288.27, stdev=352.48 lat (msec): min=67, max=893, avg=288.27, stdev=352.48 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 69], 40.00th=[ 69], 50.00th=[ 106], 60.00th=[ 106], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 4047, max= 4071, per=100.00%, avg=4059.00, stdev=16.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1200KiB/s (1229kB/s)(7168KiB/5974msec); 0 zone resets clat (msec): min=134, max=2908, avg=645.26, stdev=1005.70 lat (msec): min=134, max=2909, avg=645.48, stdev=1005.65 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 136], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 317], 60.00th=[ 388], | 70.00th=[ 388], 80.00th=[ 447], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1774, max= 4079, per=57.74%, avg=2630.67, stdev=1261.27, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=16.67%, 250=33.33%, 500=33.33%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.47%, ctx=117, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3254KiB/s (3333kB/s), 329KiB/s-1139KiB/s (337kB/s-1166kB/s), io=20.0MiB (20.0MB), run=5664-6293msec WRITE: bw=4556KiB/s (4666kB/s), 814KiB/s-1645KiB/s (833kB/s-1684kB/s), io=28.0MiB (29.4MB), run=5664-6293msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=148141: Fri Jan 30 02:21:25 2026 read: IOPS=2, BW=9260KiB/s (9482kB/s)(12.0MiB/1327msec) clat (msec): min=301, max=566, avg=434.05, stdev=132.32 lat (msec): min=301, max=566, avg=434.06, stdev=132.32 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 567], 95.00th=[ 567], | 99.00th=[ 567], 99.50th=[ 567], 99.90th=[ 567], 99.95th=[ 567], | 99.99th=[ 567] bw ( KiB/s): min= 5497, max= 8159, per=56.56%, avg=6828.00, stdev=1882.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=6.64%, ctx=65, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148142: Fri Jan 30 02:21:25 2026 read: IOPS=0, BW=3018KiB/s (3091kB/s)(4096KiB/1357msec) clat (nsec): min=232182k, max=232182k, avg=232181935.00, stdev= 0.00 lat (nsec): min=232185k, max=232185k, avg=232184520.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 232], 5.00th=[ 232], 10.00th=[ 232], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 232], | 70.00th=[ 232], 80.00th=[ 232], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 7420, max= 7420, per=61.46%, avg=7420.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6037KiB/s (6182kB/s)(8192KiB/1357msec); 0 zone resets clat (msec): min=511, max=530, avg=521.15, stdev=13.46 lat (msec): min=511, max=531, avg=521.62, stdev=13.70 clat percentiles (msec): | 1.00th=[ 510], 5.00th=[ 510], 10.00th=[ 510], 20.00th=[ 510], | 30.00th=[ 510], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 531], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=66.67% cpu : usr=0.00%, sys=8.26%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148143: Fri Jan 30 02:21:25 2026 write: IOPS=0, BW=2605KiB/s (2668kB/s)(12.0MiB/4717msec); 0 zone resets clat (msec): min=337, max=3545, avg=1531.28, stdev=1754.14 lat (msec): min=337, max=3545, avg=1531.72, stdev=1754.36 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 3540], 80.00th=[ 3540], 90.00th=[ 3540], 95.00th=[ 3540], | 99.00th=[ 3540], 99.50th=[ 3540], 99.90th=[ 3540], 99.95th=[ 3540], | 99.99th=[ 3540] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.22%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148144: Fri Jan 30 02:21:25 2026 write: IOPS=0, BW=2832KiB/s (2900kB/s)(12.0MiB/4339msec); 0 zone resets clat (msec): min=321, max=3580, avg=1432.84, stdev=1860.20 lat (msec): min=321, max=3580, avg=1433.96, stdev=1859.58 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.95%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.8MiB/s (12.4MB/s), 3018KiB/s-9260KiB/s (3091kB/s-9482kB/s), io=16.0MiB (16.8MB), run=1327-1357msec WRITE: bw=6947KiB/s (7114kB/s), 2605KiB/s-6037KiB/s (2668kB/s-6182kB/s), io=32.0MiB (33.6MB), run=1357-4717msec rand-rw: (groupid=0, jobs=1): err= 0: pid=148146: Fri Jan 30 02:21:27 2026 read: IOPS=0, BW=2462KiB/s (2521kB/s)(12.0MiB/4991msec) clat (msec): min=678, max=3227, avg=1663.25, stdev=1369.92 lat (msec): min=678, max=3227, avg=1663.26, stdev=1369.92 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8143, max= 8159, per=100.00%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=6.91%, ctx=189, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148147: Fri Jan 30 02:21:27 2026 read: IOPS=0, BW=893KiB/s (915kB/s)(4096KiB/4586msec) clat (nsec): min=3327.9M, max=3327.9M, avg=3327907138.00, stdev= 0.00 lat (nsec): min=3327.9M, max=3327.9M, avg=3327910281.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 3339], 5.00th=[ 3339], 10.00th=[ 3339], 20.00th=[ 3339], | 30.00th=[ 3339], 40.00th=[ 3339], 50.00th=[ 3339], 60.00th=[ 3339], | 70.00th=[ 3339], 80.00th=[ 3339], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1786KiB/s (1829kB/s)(8192KiB/4586msec); 0 zone resets clat (msec): min=475, max=778, avg=627.15, stdev=213.97 lat (msec): min=476, max=779, avg=628.04, stdev=214.82 clat percentiles (msec): | 1.00th=[ 477], 5.00th=[ 477], 10.00th=[ 477], 20.00th=[ 477], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 477], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=7.18%, ctx=567, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148148: Fri Jan 30 02:21:27 2026 write: IOPS=0, BW=2255KiB/s (2309kB/s)(12.0MiB/5450msec); 0 zone resets clat (msec): min=383, max=4624, avg=1815.04, stdev=2432.97 lat (msec): min=383, max=4624, avg=1815.49, stdev=2432.75 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 439], 50.00th=[ 439], 60.00th=[ 439], | 70.00th=[ 4597], 80.00th=[ 4597], 90.00th=[ 4597], 95.00th=[ 4597], | 99.00th=[ 4597], 99.50th=[ 4597], 99.90th=[ 4597], 99.95th=[ 4597], | 99.99th=[ 4597] bw ( KiB/s): min=15875, max=15875, per=100.00%, avg=15875.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.26%, ctx=70, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=148149: Fri Jan 30 02:21:27 2026 write: IOPS=0, BW=2933KiB/s (3003kB/s)(12.0MiB/4190msec); 0 zone resets clat (msec): min=422, max=3197, avg=1392.92, stdev=1564.47 lat (msec): min=423, max=3198, avg=1395.45, stdev=1563.15 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 6311, max= 8110, per=100.00%, avg=7210.50, stdev=1272.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.05%, sys=2.91%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3283KiB/s (3361kB/s), 893KiB/s-2462KiB/s (915kB/s-2521kB/s), io=16.0MiB (16.8MB), run=4586-4991msec WRITE: bw=6012KiB/s (6157kB/s), 1786KiB/s-2933KiB/s (1829kB/s-3003kB/s), io=32.0MiB (33.6MB), run=4190-5450msec