== sanity test 398b: DIO and buffer IO race ============== 22:44:05 (1788489845) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.50889 s, 9.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179672: Thu Sep 3 22:46:35 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(5992KiB/131728msec) clat (usec): min=48, max=798638, avg=48388.42, stdev=38033.40 lat (usec): min=48, max=798640, avg=48390.01, stdev=38033.14 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12387], 10.00th=[ 17695], 20.00th=[ 23725], | 30.00th=[ 28443], 40.00th=[ 34866], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 86508], 95.00th=[105382], | 99.00th=[175113], 99.50th=[191890], 99.90th=[375391], 99.95th=[801113], | 99.99th=[801113] bw ( KiB/s): min= 7, max= 103, per=25.17%, avg=45.30, stdev=17.29, samples=258 iops : min= 1, max= 25, avg=10.69, stdev= 4.38, samples=258 write: IOPS=11, BW=47.8KiB/s (48.9kB/s)(6296KiB/131728msec); 0 zone resets clat (usec): min=923, max=326264, avg=37556.21, stdev=39689.84 lat (usec): min=923, max=326265, avg=37560.73, stdev=39691.07 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1188], 10.00th=[ 1598], 20.00th=[ 3425], | 30.00th=[ 7111], 40.00th=[ 16319], 50.00th=[ 27657], 60.00th=[ 37487], | 70.00th=[ 49021], 80.00th=[ 64750], 90.00th=[ 90702], 95.00th=[116917], | 99.00th=[179307], 99.50th=[206570], 99.90th=[231736], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 7, max= 112, per=25.24%, avg=47.44, stdev=21.34, samples=259 iops : min= 1, max= 28, avg=11.23, stdev= 5.35, samples=259 lat (usec) : 50=0.33%, 100=1.11%, 250=0.26%, 1000=0.10% lat (msec) : 2=6.58%, 4=4.92%, 10=6.45%, 20=9.24%, 50=37.70% lat (msec) : 100=26.11%, 250=7.10%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=4.43%, ctx=6431, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179673: Thu Sep 3 22:46:35 2026 read: IOPS=11, BW=45.8KiB/s (46.9kB/s)(5940KiB/129820msec) clat (usec): min=43, max=740726, avg=47516.35, stdev=35852.17 lat (usec): min=43, max=740727, avg=47517.91, stdev=35852.11 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 10683], 10.00th=[ 17171], 20.00th=[ 22938], | 30.00th=[ 28443], 40.00th=[ 34341], 50.00th=[ 40633], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 67634], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[164627], 99.50th=[170918], 99.90th=[267387], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 103, per=25.25%, avg=45.45, stdev=18.51, samples=255 iops : min= 1, max= 25, avg=10.73, stdev= 4.68, samples=255 write: IOPS=12, BW=48.9KiB/s (50.1kB/s)(6348KiB/129820msec); 0 zone resets clat (usec): min=980, max=282074, avg=37207.16, stdev=39799.34 lat (usec): min=980, max=282076, avg=37216.48, stdev=39804.21 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1729], 20.00th=[ 3851], | 30.00th=[ 7832], 40.00th=[ 16909], 50.00th=[ 26084], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 89654], 95.00th=[113771], | 99.00th=[181404], 99.50th=[210764], 99.90th=[270533], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 7, max= 126, per=25.88%, avg=48.66, stdev=20.62, samples=254 iops : min= 1, max= 31, avg=11.53, stdev= 5.18, samples=254 lat (usec) : 50=0.42%, 100=1.33%, 250=0.10%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.89%, 4=4.62%, 10=6.61%, 20=10.06%, 50=38.54% lat (msec) : 100=25.46%, 250=6.58%, 500=0.13%, 750=0.03% cpu : usr=0.07%, sys=4.74%, ctx=6344, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179674: Thu Sep 3 22:46:35 2026 read: IOPS=11, BW=45.3KiB/s (46.4kB/s)(6028KiB/133109msec) clat (usec): min=34, max=407756, avg=49195.89, stdev=35371.04 lat (usec): min=35, max=407757, avg=49197.73, stdev=35370.58 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 9110], 10.00th=[ 17171], 20.00th=[ 23200], | 30.00th=[ 30016], 40.00th=[ 35390], 50.00th=[ 41157], 60.00th=[ 48497], | 70.00th=[ 57410], 80.00th=[ 70779], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[175113], 99.50th=[200279], 99.90th=[316670], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 95, per=25.00%, avg=44.99, stdev=16.99, samples=259 iops : min= 1, max= 23, avg=10.61, stdev= 4.28, samples=259 write: IOPS=11, BW=47.0KiB/s (48.2kB/s)(6260KiB/133109msec); 0 zone resets clat (usec): min=968, max=751905, avg=37568.37, stdev=43551.24 lat (usec): min=969, max=751907, avg=37569.91, stdev=43551.30 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1827], 20.00th=[ 4015], | 30.00th=[ 7898], 40.00th=[ 16581], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 63177], 90.00th=[ 91751], 95.00th=[114820], | 99.00th=[173016], 99.50th=[204473], 99.90th=[383779], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 127, per=24.78%, avg=46.59, stdev=22.86, samples=259 iops : min= 1, max= 31, avg=11.01, stdev= 5.75, samples=259 lat (usec) : 50=0.39%, 100=1.46%, 250=0.23%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=5.53%, 4=4.39%, 10=7.29%, 20=9.54%, 50=37.76% lat (msec) : 100=25.72%, 250=7.19%, 500=0.16%, 1000=0.03% cpu : usr=0.07%, sys=4.57%, ctx=6479, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179675: Thu Sep 3 22:46:35 2026 read: IOPS=11, BW=45.9KiB/s (47.0kB/s)(6052KiB/131782msec) clat (usec): min=45, max=366680, avg=48115.45, stdev=33621.44 lat (usec): min=45, max=366680, avg=48117.46, stdev=33621.32 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10028], 10.00th=[ 17171], 20.00th=[ 23725], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 41681], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 68682], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[156238], 99.50th=[206570], 99.90th=[295699], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 110, per=25.31%, avg=45.56, stdev=18.26, samples=259 iops : min= 1, max= 27, avg=10.76, stdev= 4.63, samples=259 write: IOPS=11, BW=47.3KiB/s (48.5kB/s)(6236KiB/131782msec); 0 zone resets clat (usec): min=954, max=745806, avg=37728.17, stdev=43344.50 lat (usec): min=954, max=745809, avg=37730.13, stdev=43344.54 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1762], 20.00th=[ 4015], | 30.00th=[ 7898], 40.00th=[ 16581], 50.00th=[ 26608], 60.00th=[ 36963], | 70.00th=[ 46924], 80.00th=[ 64226], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[173016], 99.50th=[198181], 99.90th=[387974], 99.95th=[742392], | 99.99th=[742392] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=47.10, stdev=21.26, samples=258 iops : min= 1, max= 25, avg=11.15, stdev= 5.36, samples=258 lat (usec) : 50=0.26%, 100=1.69%, 250=0.20%, 500=0.07%, 1000=0.20% lat (msec) : 2=5.70%, 4=4.30%, 10=7.00%, 20=9.47%, 50=38.48% lat (msec) : 100=25.88%, 250=6.58%, 500=0.16%, 750=0.03% cpu : usr=0.06%, sys=4.57%, ctx=6479, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=180KiB/s (185kB/s), 45.3KiB/s-45.9KiB/s (46.4kB/s-47.0kB/s), io=23.4MiB (24.6MB), run=129820-133109msec WRITE: bw=189KiB/s (193kB/s), 47.0KiB/s-48.9KiB/s (48.2kB/s-50.1kB/s), io=24.6MiB (25.7MB), run=129820-133109msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179667: Thu Sep 3 22:47:11 2026 read: IOPS=8, BW=35.4KiB/s (36.3kB/s)(5992KiB/169246msec) clat (msec): min=5, max=912, avg=44.21, stdev=49.89 lat (msec): min=5, max=912, avg=44.22, stdev=49.89 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 65], 90.00th=[ 104], 95.00th=[ 138], | 99.00th=[ 215], 99.50th=[ 245], 99.90th=[ 493], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 135, per=25.68%, avg=36.21, stdev=27.75, samples=320 iops : min= 1, max= 33, avg= 8.37, stdev= 6.97, samples=320 write: IOPS=9, BW=37.2KiB/s (38.1kB/s)(6296KiB/169246msec); 0 zone resets clat (msec): min=9, max=450, avg=65.21, stdev=51.67 lat (msec): min=9, max=450, avg=65.21, stdev=51.67 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 59], | 70.00th=[ 75], 80.00th=[ 99], 90.00th=[ 128], 95.00th=[ 165], | 99.00th=[ 264], 99.50th=[ 321], 99.90th=[ 435], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 7, max= 136, per=25.17%, avg=37.25, stdev=26.81, samples=327 iops : min= 1, max= 34, avg= 8.63, stdev= 6.75, samples=327 lat (msec) : 10=2.99%, 20=17.64%, 50=42.29%, 100=22.17%, 250=14.13% lat (msec) : 500=0.75%, 1000=0.03% cpu : usr=0.06%, sys=1.71%, ctx=4873, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179668: Thu Sep 3 22:47:11 2026 read: IOPS=8, BW=35.1KiB/s (35.0kB/s)(5940KiB/169043msec) clat (msec): min=6, max=836, avg=42.68, stdev=45.31 lat (msec): min=6, max=836, avg=42.68, stdev=45.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 99], 95.00th=[ 126], | 99.00th=[ 197], 99.50th=[ 226], 99.90th=[ 363], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 159, per=25.67%, avg=36.19, stdev=27.81, samples=319 iops : min= 1, max= 39, avg= 8.37, stdev= 7.01, samples=319 write: IOPS=9, BW=37.6KiB/s (38.5kB/s)(6348KiB/169043msec); 0 zone resets clat (msec): min=9, max=455, avg=66.34, stdev=52.20 lat (msec): min=9, max=455, avg=66.34, stdev=52.20 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 58], | 70.00th=[ 75], 80.00th=[ 102], 90.00th=[ 134], 95.00th=[ 171], | 99.00th=[ 247], 99.50th=[ 313], 99.90th=[ 439], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 7, max= 127, per=25.26%, avg=37.38, stdev=25.62, samples=330 iops : min= 1, max= 31, avg= 8.66, stdev= 6.42, samples=330 lat (msec) : 10=2.93%, 20=16.73%, 50=43.55%, 100=21.74%, 250=14.42% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.06%, sys=1.61%, ctx=4779, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179669: Thu Sep 3 22:47:11 2026 read: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6028KiB/169259msec) clat (msec): min=5, max=362, avg=44.15, stdev=41.47 lat (msec): min=5, max=362, avg=44.15, stdev=41.47 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 68], 90.00th=[ 103], 95.00th=[ 132], | 99.00th=[ 194], 99.50th=[ 218], 99.90th=[ 279], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 7, max= 143, per=25.48%, avg=35.92, stdev=26.19, samples=325 iops : min= 1, max= 35, avg= 8.30, stdev= 6.58, samples=325 write: IOPS=9, BW=36.0KiB/s (37.9kB/s)(6260KiB/169259msec); 0 zone resets clat (msec): min=10, max=861, avg=65.38, stdev=54.52 lat (msec): min=10, max=861, avg=65.38, stdev=54.51 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 100], 90.00th=[ 134], 95.00th=[ 165], | 99.00th=[ 255], 99.50th=[ 288], 99.90th=[ 422], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 128, per=24.87%, avg=36.81, stdev=26.42, samples=329 iops : min= 1, max= 32, avg= 8.52, stdev= 6.64, samples=329 lat (msec) : 10=2.41%, 20=17.38%, 50=43.72%, 100=21.61%, 250=14.23% lat (msec) : 500=0.62%, 1000=0.03% cpu : usr=0.05%, sys=1.71%, ctx=4895, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179670: Thu Sep 3 22:47:11 2026 read: IOPS=8, BW=35.8KiB/s (36.6kB/s)(6052KiB/169266msec) clat (msec): min=5, max=506, avg=43.96, stdev=44.82 lat (msec): min=5, max=506, avg=43.96, stdev=44.82 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 46], 80.00th=[ 66], 90.00th=[ 101], 95.00th=[ 133], | 99.00th=[ 211], 99.50th=[ 239], 99.90th=[ 368], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 143, per=25.76%, avg=36.33, stdev=27.68, samples=322 iops : min= 1, max= 35, avg= 8.40, stdev= 6.95, samples=322 write: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6236KiB/169266msec); 0 zone resets clat (msec): min=11, max=859, avg=65.67, stdev=53.73 lat (msec): min=11, max=859, avg=65.67, stdev=53.73 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 132], 95.00th=[ 165], | 99.00th=[ 249], 99.50th=[ 288], 99.90th=[ 393], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 7, max= 143, per=24.78%, avg=36.67, stdev=26.16, samples=329 iops : min= 1, max= 35, avg= 8.48, stdev= 6.58, samples=329 lat (msec) : 10=2.83%, 20=17.35%, 50=42.45%, 100=22.82%, 250=13.83% lat (msec) : 500=0.65%, 750=0.03%, 1000=0.03% cpu : usr=0.06%, sys=1.65%, ctx=4901, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=142KiB/s (145kB/s), 35.1KiB/s-35.8KiB/s (35.0kB/s-36.6kB/s), io=23.4MiB (24.6MB), run=169043-169266msec WRITE: bw=149KiB/s (152kB/s), 36.8KiB/s-37.6KiB/s (37.7kB/s-38.5kB/s), io=24.6MiB (25.7MB), run=169043-169266msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179718: Thu Sep 3 22:47:51 2026 read: IOPS=12, BW=194KiB/s (199kB/s)(5920KiB/30492msec) clat (usec): min=36, max=182036, avg=41537.30, stdev=30038.76 lat (usec): min=37, max=182038, avg=41538.48, stdev=30038.79 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 139], 20.00th=[ 19268], | 30.00th=[ 23725], 40.00th=[ 29492], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[181404], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 61, max= 448, per=26.36%, avg=193.73, stdev=83.46, samples=60 iops : min= 3, max= 28, avg=11.33, stdev= 5.27, samples=60 write: IOPS=13, BW=209KiB/s (214kB/s)(6368KiB/30492msec); 0 zone resets clat (usec): min=1525, max=273853, avg=37752.83, stdev=41669.70 lat (usec): min=1527, max=273853, avg=37755.02, stdev=41669.73 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2474], 10.00th=[ 3458], 20.00th=[ 6259], | 30.00th=[ 9503], 40.00th=[ 15008], 50.00th=[ 22676], 60.00th=[ 34341], | 70.00th=[ 45876], 80.00th=[ 62129], 90.00th=[ 91751], 95.00th=[124257], | 99.00th=[193987], 99.50th=[254804], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 63, max= 442, per=27.48%, avg=212.46, stdev=81.56, samples=59 iops : min= 3, max= 27, avg=12.53, stdev= 5.15, samples=59 lat (usec) : 50=0.65%, 100=3.91%, 250=0.78%, 500=0.39%, 750=0.13% lat (msec) : 2=1.69%, 4=5.08%, 10=9.51%, 20=12.24%, 50=35.81% lat (msec) : 100=23.83%, 250=5.73%, 500=0.26% cpu : usr=0.08%, sys=5.60%, ctx=1708, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179720: Thu Sep 3 22:47:51 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(5744KiB/31047msec) clat (usec): min=42, max=263977, avg=43748.09, stdev=32449.34 lat (usec): min=42, max=263979, avg=43757.52, stdev=32443.68 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 90], 20.00th=[ 19792], | 30.00th=[ 26870], 40.00th=[ 31589], 50.00th=[ 39060], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 65799], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[219153], 99.90th=[263193], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 42, max= 477, per=25.58%, avg=188.02, stdev=91.69, samples=59 iops : min= 2, max= 29, avg=11.02, stdev= 5.84, samples=59 write: IOPS=13, BW=211KiB/s (216kB/s)(6544KiB/31047msec); 0 zone resets clat (usec): min=1447, max=245625, avg=36771.79, stdev=38350.33 lat (usec): min=1449, max=245627, avg=36793.02, stdev=38339.06 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2311], 10.00th=[ 3359], 20.00th=[ 5997], | 30.00th=[ 9372], 40.00th=[ 16712], 50.00th=[ 25560], 60.00th=[ 33817], | 70.00th=[ 45351], 80.00th=[ 61080], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[168821], 99.50th=[193987], 99.90th=[246416], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 30, max= 512, per=27.00%, avg=208.70, stdev=91.67, samples=60 iops : min= 1, max= 32, avg=12.30, stdev= 5.81, samples=60 lat (usec) : 50=0.39%, 100=4.43%, 250=0.26%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=2.34%, 4=3.78%, 10=10.55%, 20=10.94%, 50=35.42% lat (msec) : 100=25.91%, 250=5.34%, 500=0.13% cpu : usr=0.07%, sys=5.73%, ctx=1735, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179723: Thu Sep 3 22:47:51 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(6256KiB/32568msec) clat (usec): min=38, max=200240, avg=45175.65, stdev=33186.33 lat (usec): min=38, max=200241, avg=45177.06, stdev=33186.25 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 58], 10.00th=[ 75], 20.00th=[ 21890], | 30.00th=[ 27919], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 44827], | 70.00th=[ 53216], 80.00th=[ 65274], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[160433], 99.50th=[170918], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 63, max= 415, per=26.21%, avg=192.62, stdev=80.93, samples=63 iops : min= 3, max= 25, avg=11.29, stdev= 5.10, samples=63 write: IOPS=11, BW=185KiB/s (190kB/s)(6032KiB/32568msec); 0 zone resets clat (usec): min=1379, max=326181, avg=38899.54, stdev=39977.05 lat (usec): min=1380, max=326183, avg=38901.72, stdev=39977.40 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2212], 10.00th=[ 3326], 20.00th=[ 5604], | 30.00th=[ 10814], 40.00th=[ 21103], 50.00th=[ 27919], 60.00th=[ 35914], | 70.00th=[ 49021], 80.00th=[ 63177], 90.00th=[ 91751], 95.00th=[120062], | 99.00th=[177210], 99.50th=[183501], 99.90th=[325059], 99.95th=[325059], | 99.99th=[325059] bw ( KiB/s): min= 30, max= 448, per=23.67%, avg=183.00, stdev=82.07, samples=63 iops : min= 1, max= 28, avg=10.70, stdev= 5.22, samples=63 lat (usec) : 50=1.30%, 100=4.30%, 250=0.39% lat (msec) : 2=1.95%, 4=4.43%, 10=7.29%, 20=8.46%, 50=40.36% lat (msec) : 100=23.83%, 250=7.55%, 500=0.13% cpu : usr=0.06%, sys=5.50%, ctx=1769, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179725: Thu Sep 3 22:47:51 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(6032KiB/30269msec) clat (usec): min=47, max=152976, avg=42807.12, stdev=29971.27 lat (usec): min=48, max=152978, avg=42819.91, stdev=29974.83 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 80], 20.00th=[ 20055], | 30.00th=[ 26084], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 44827], | 70.00th=[ 53740], 80.00th=[ 63177], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[135267], 99.50th=[152044], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 63, max= 351, per=26.94%, avg=198.02, stdev=73.34, samples=59 iops : min= 3, max= 21, avg=11.63, stdev= 4.60, samples=59 write: IOPS=12, BW=207KiB/s (212kB/s)(6256KiB/30269msec); 0 zone resets clat (usec): min=1498, max=203475, avg=35238.07, stdev=36161.95 lat (usec): min=1500, max=203477, avg=35241.65, stdev=36161.55 clat percentiles (usec): | 1.00th=[ 1549], 5.00th=[ 2057], 10.00th=[ 3294], 20.00th=[ 6325], | 30.00th=[ 9372], 40.00th=[ 14353], 50.00th=[ 24511], 60.00th=[ 33817], | 70.00th=[ 44827], 80.00th=[ 59507], 90.00th=[ 78119], 95.00th=[112722], | 99.00th=[183501], 99.50th=[202376], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 32, max= 509, per=26.77%, avg=206.92, stdev=87.07, samples=59 iops : min= 2, max= 31, avg=12.19, stdev= 5.48, samples=59 lat (usec) : 50=0.13%, 100=5.21%, 250=0.52%, 500=0.13% lat (msec) : 2=2.21%, 4=4.30%, 10=9.90%, 20=11.07%, 50=35.81% lat (msec) : 100=24.87%, 250=5.86% cpu : usr=0.07%, sys=5.61%, ctx=1644, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=735KiB/s (753kB/s), 185KiB/s-199KiB/s (189kB/s-204kB/s), io=23.4MiB (24.5MB), run=30269-32568msec WRITE: bw=774KiB/s (792kB/s), 185KiB/s-211KiB/s (190kB/s-216kB/s), io=24.6MiB (25.8MB), run=30269-32568msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179719: Thu Sep 3 22:48:03 2026 read: IOPS=8, BW=135KiB/s (138kB/s)(5920KiB/43842msec) clat (msec): min=7, max=296, avg=47.93, stdev=48.50 lat (msec): min=7, max=296, avg=47.93, stdev=48.50 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 64], 90.00th=[ 117], 95.00th=[ 161], | 99.00th=[ 239], 99.50th=[ 268], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 415, per=24.35%, avg=132.45, stdev=87.61, samples=86 iops : min= 1, max= 25, avg= 7.44, stdev= 5.51, samples=86 write: IOPS=9, BW=145KiB/s (149kB/s)(6368KiB/43842msec); 0 zone resets clat (msec): min=12, max=260, avg=64.62, stdev=44.06 lat (msec): min=12, max=260, avg=64.63, stdev=44.06 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 71], 80.00th=[ 94], 90.00th=[ 132], 95.00th=[ 153], | 99.00th=[ 234], 99.50th=[ 257], 99.90th=[ 262], 99.95th=[ 262], | 99.99th=[ 262] bw ( KiB/s): min= 31, max= 475, per=26.38%, avg=150.87, stdev=91.13, samples=82 iops : min= 1, max= 29, avg= 8.61, stdev= 5.73, samples=82 lat (msec) : 10=0.78%, 20=13.28%, 50=47.40%, 100=23.05%, 250=14.97% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.62%, ctx=1155, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179721: Thu Sep 3 22:48:03 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(5744KiB/43987msec) clat (msec): min=7, max=277, avg=44.70, stdev=42.61 lat (msec): min=7, max=277, avg=44.70, stdev=42.61 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 37], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 97], 95.00th=[ 138], | 99.00th=[ 222], 99.50th=[ 236], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 447, per=24.86%, avg=135.23, stdev=93.50, samples=84 iops : min= 1, max= 27, avg= 7.62, stdev= 5.88, samples=84 write: IOPS=9, BW=149KiB/s (152kB/s)(6544KiB/43987msec); 0 zone resets clat (msec): min=18, max=239, avg=68.01, stdev=42.82 lat (msec): min=18, max=239, avg=68.02, stdev=42.82 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 26], 10.00th=[ 29], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 67], | 70.00th=[ 81], 80.00th=[ 100], 90.00th=[ 134], 95.00th=[ 167], | 99.00th=[ 197], 99.50th=[ 203], 99.90th=[ 241], 99.95th=[ 241], | 99.99th=[ 241] bw ( KiB/s): min= 31, max= 383, per=25.89%, avg=148.10, stdev=87.26, samples=87 iops : min= 1, max= 23, avg= 8.43, stdev= 5.50, samples=87 lat (msec) : 10=1.04%, 20=12.63%, 50=45.31%, 100=26.43%, 250=14.45% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.78%, ctx=1220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179722: Thu Sep 3 22:48:03 2026 read: IOPS=8, BW=143KiB/s (147kB/s)(6256KiB/43664msec) clat (msec): min=7, max=356, avg=46.79, stdev=48.17 lat (msec): min=7, max=356, avg=46.79, stdev=48.17 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 69], 90.00th=[ 110], 95.00th=[ 146], | 99.00th=[ 257], 99.50th=[ 317], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 505, per=26.37%, avg=143.48, stdev=102.16, samples=86 iops : min= 1, max= 31, avg= 8.17, stdev= 6.39, samples=86 write: IOPS=8, BW=138KiB/s (141kB/s)(6032KiB/43664msec); 0 zone resets clat (msec): min=15, max=256, avg=66.48, stdev=44.28 lat (msec): min=15, max=256, avg=66.48, stdev=44.28 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 72], 80.00th=[ 96], 90.00th=[ 127], 95.00th=[ 169], | 99.00th=[ 234], 99.50th=[ 241], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 349, per=24.39%, avg=139.52, stdev=81.23, samples=85 iops : min= 1, max= 21, avg= 7.92, stdev= 5.08, samples=85 lat (msec) : 10=0.91%, 20=13.80%, 50=47.66%, 100=21.48%, 250=15.49% lat (msec) : 500=0.65% cpu : usr=0.05%, sys=1.72%, ctx=1167, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179724: Thu Sep 3 22:48:03 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43102msec) clat (msec): min=6, max=370, avg=46.42, stdev=46.87 lat (msec): min=6, max=370, avg=46.43, stdev=46.87 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 106], 95.00th=[ 142], | 99.00th=[ 266], 99.50th=[ 321], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 31, max= 474, per=27.30%, avg=148.53, stdev=86.52, samples=79 iops : min= 1, max= 29, avg= 8.47, stdev= 5.44, samples=79 write: IOPS=9, BW=145KiB/s (149kB/s)(6256KiB/43102msec); 0 zone resets clat (msec): min=13, max=310, avg=64.72, stdev=45.50 lat (msec): min=13, max=310, avg=64.74, stdev=45.50 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 74], 80.00th=[ 90], 90.00th=[ 122], 95.00th=[ 161], | 99.00th=[ 239], 99.50th=[ 288], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 380, per=25.57%, avg=146.24, stdev=85.08, samples=84 iops : min= 1, max= 23, avg= 8.31, stdev= 5.36, samples=84 lat (msec) : 10=0.91%, 20=13.80%, 50=47.01%, 100=25.26%, 250=12.11% lat (msec) : 500=0.91% cpu : usr=0.03%, sys=1.69%, ctx=1144, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=545KiB/s (558kB/s), 131KiB/s-143KiB/s (134kB/s-147kB/s), io=23.4MiB (24.5MB), run=43102-43987msec WRITE: bw=573KiB/s (587kB/s), 138KiB/s-149KiB/s (141kB/s-152kB/s), io=24.6MiB (25.8MB), run=43102-43987msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179736: Thu Sep 3 22:48:17 2026 read: IOPS=2, BW=2263KiB/s (2318kB/s)(7168KiB/3167msec) clat (usec): min=543, max=301296, avg=207851.46, stdev=97157.45 lat (usec): min=545, max=301297, avg=207852.90, stdev=97157.50 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[189793], | 30.00th=[227541], 40.00th=[227541], 50.00th=[238027], 60.00th=[246416], | 70.00th=[246416], 80.00th=[250610], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 1965, max= 4079, per=54.48%, avg=2417.20, stdev=929.36, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1617KiB/s (1655kB/s)(5120KiB/3167msec); 0 zone resets clat (msec): min=112, max=511, avg=290.11, stdev=174.81 lat (msec): min=112, max=511, avg=290.20, stdev=174.82 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 113], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 194], 60.00th=[ 194], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 2031, max= 5896, per=63.80%, avg=3963.50, stdev=2732.97, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=8.33% lat (msec) : 250=58.33%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=22.08%, ctx=255, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179738: Thu Sep 3 22:48:17 2026 read: IOPS=0, BW=444KiB/s (454kB/s)(2048KiB/4615msec) clat (usec): min=888, max=141940, avg=71414.44, stdev=99738.55 lat (usec): min=890, max=141942, avg=71416.17, stdev=99739.06 clat percentiles (usec): | 1.00th=[ 889], 5.00th=[ 889], 10.00th=[ 889], 20.00th=[ 889], | 30.00th=[ 889], 40.00th=[ 889], 50.00th=[ 889], 60.00th=[141558], | 70.00th=[141558], 80.00th=[141558], 90.00th=[141558], 95.00th=[141558], | 99.00th=[141558], 99.50th=[141558], 99.90th=[141558], 99.95th=[141558], | 99.99th=[141558] bw ( KiB/s): min= 1910, max= 1965, per=43.67%, avg=1937.50, stdev=38.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2219KiB/s (2272kB/s)(10.0MiB/4615msec); 0 zone resets clat (msec): min=204, max=892, avg=438.85, stdev=235.77 lat (msec): min=204, max=892, avg=438.92, stdev=235.77 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 257], | 30.00th=[ 292], 40.00th=[ 309], 50.00th=[ 313], 60.00th=[ 368], | 70.00th=[ 376], 80.00th=[ 600], 90.00th=[ 776], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 1965, max= 4079, per=41.80%, avg=2596.86, stdev=1007.52, samples=7 iops : min= 1, max= 3, avg= 1.71, stdev= 0.95, samples=7 lat (usec) : 1000=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=8.33%, 1000=16.67% cpu : usr=0.02%, sys=14.80%, ctx=161, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179739: Thu Sep 3 22:48:17 2026 read: IOPS=1, BW=2034KiB/s (2083kB/s)(6144KiB/3020msec) clat (usec): min=482, max=295345, avg=106057.30, stdev=139979.91 lat (usec): min=484, max=295346, avg=106058.43, stdev=139979.82 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 3589], 50.00th=[ 3589], 60.00th=[ 64226], | 70.00th=[270533], 80.00th=[270533], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 4047, max= 4047, per=91.21%, avg=4047.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 write: IOPS=1, BW=2034KiB/s (2083kB/s)(6144KiB/3020msec); 0 zone resets clat (msec): min=54, max=819, avg=349.82, stdev=271.47 lat (msec): min=54, max=819, avg=349.88, stdev=271.50 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 55], 10.00th=[ 55], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 342], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1965, max= 4079, per=43.29%, avg=2689.00, stdev=1204.12, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 4=8.33%, 100=16.67%, 250=8.33%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=18.25%, ctx=181, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179740: Thu Sep 3 22:48:17 2026 read: IOPS=1, BW=1228KiB/s (1257kB/s)(5120KiB/4170msec) clat (usec): min=459, max=282650, avg=162486.90, stdev=148116.82 lat (usec): min=460, max=282652, avg=162488.09, stdev=148116.85 clat percentiles (usec): | 1.00th=[ 461], 5.00th=[ 461], 10.00th=[ 461], 20.00th=[ 461], | 30.00th=[ 906], 40.00th=[ 906], 50.00th=[252707], 60.00th=[252707], | 70.00th=[274727], 80.00th=[274727], 90.00th=[283116], 95.00th=[283116], | 99.00th=[283116], 99.50th=[283116], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 1965, max= 3938, per=59.28%, avg=2630.33, stdev=1132.53, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1719KiB/s (1760kB/s)(7168KiB/4170msec); 0 zone resets clat (msec): min=267, max=830, avg=434.72, stdev=185.47 lat (msec): min=267, max=830, avg=434.85, stdev=185.44 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 334], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 359], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 451], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1965, max= 2039, per=32.35%, avg=2009.67, stdev=33.46, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 500=8.33%, 1000=8.33% lat (msec) : 500=75.00%, 1000=8.33% cpu : usr=0.00%, sys=14.49%, ctx=198, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4438KiB/s (4544kB/s), 444KiB/s-2263KiB/s (454kB/s-2318kB/s), io=20.0MiB (20.0MB), run=3020-4615msec WRITE: bw=6213KiB/s (6362kB/s), 1617KiB/s-2219KiB/s (1655kB/s-2272kB/s), io=28.0MiB (29.4MB), run=3020-4615msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179741: Thu Sep 3 22:48:17 2026 read: IOPS=1, BW=1492KiB/s (1528kB/s)(7168KiB/4804msec) clat (msec): min=63, max=1197, avg=436.29, stdev=433.90 lat (msec): min=63, max=1197, avg=436.29, stdev=433.90 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 64], 10.00th=[ 64], 20.00th=[ 70], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 234], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 802], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 1973, max= 4047, per=57.00%, avg=2416.20, stdev=911.95, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1066KiB/s (1091kB/s)(5120KiB/4804msec); 0 zone resets clat (msec): min=82, max=465, avg=249.02, stdev=146.54 lat (msec): min=82, max=466, avg=249.38, stdev=146.73 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2007, max= 6047, per=56.62%, avg=3360.33, stdev=2326.74, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=4.02%, ctx=93, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179742: Thu Sep 3 22:48:17 2026 read: IOPS=0, BW=424KiB/s (434kB/s)(2048KiB/4831msec) clat (msec): min=172, max=453, avg=312.69, stdev=198.46 lat (msec): min=172, max=453, avg=312.69, stdev=198.46 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 174], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 456], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 2015, max= 2039, per=47.82%, avg=2027.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2120KiB/s (2171kB/s)(10.0MiB/4831msec); 0 zone resets clat (msec): min=148, max=827, avg=392.75, stdev=205.62 lat (msec): min=148, max=828, avg=392.99, stdev=205.77 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 169], | 30.00th=[ 264], 40.00th=[ 275], 50.00th=[ 313], 60.00th=[ 439], | 70.00th=[ 447], 80.00th=[ 464], 90.00th=[ 584], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2015, max= 4047, per=51.02%, avg=3028.33, stdev=1098.44, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.04%, sys=6.71%, ctx=128, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179743: Thu Sep 3 22:48:17 2026 read: IOPS=1, BW=1326KiB/s (1358kB/s)(6144KiB/4633msec) clat (msec): min=97, max=416, avg=198.57, stdev=133.90 lat (msec): min=97, max=416, avg=198.57, stdev=133.90 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 153], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 1973, max= 2027, per=47.39%, avg=2009.00, stdev=21.54, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1326KiB/s (1358kB/s)(6144KiB/4633msec); 0 zone resets clat (msec): min=199, max=776, avg=541.66, stdev=224.02 lat (msec): min=200, max=776, avg=541.83, stdev=223.86 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 600], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2007, max= 2039, per=34.06%, avg=2021.40, stdev=11.87, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 1000=16.67% cpu : usr=0.00%, sys=6.54%, ctx=106, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179744: Thu Sep 3 22:48:18 2026 read: IOPS=1, BW=1278KiB/s (1309kB/s)(5120KiB/4005msec) clat (msec): min=92, max=788, avg=263.34, stdev=295.81 lat (msec): min=92, max=788, avg=263.34, stdev=295.81 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 100], 40.00th=[ 100], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 171], 80.00th=[ 171], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 4031, max= 4047, per=95.28%, avg=4039.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1790KiB/s (1833kB/s)(7168KiB/4005msec); 0 zone resets clat (msec): min=237, max=780, avg=375.78, stdev=195.21 lat (msec): min=237, max=781, avg=377.17, stdev=195.91 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 296], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 1416, max= 4047, per=38.72%, avg=2298.00, stdev=1011.15, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=25.00%, 1000=16.67% cpu : usr=0.00%, sys=7.49%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4239KiB/s (4341kB/s), 424KiB/s-1492KiB/s (434kB/s-1528kB/s), io=20.0MiB (20.0MB), run=4005-4831msec WRITE: bw=5935KiB/s (6077kB/s), 1066KiB/s-2120KiB/s (1091kB/s-2171kB/s), io=28.0MiB (29.4MB), run=4005-4831msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179752: Thu Sep 3 22:48:31 2026 read: IOPS=1, BW=5137KiB/s (5260kB/s)(12.0MiB/2392msec) clat (msec): min=722, max=840, avg=778.06, stdev=59.32 lat (msec): min=722, max=840, avg=778.06, stdev=59.32 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 844], 80.00th=[ 844], 90.00th=[ 844], 95.00th=[ 844], | 99.00th=[ 844], 99.50th=[ 844], 99.90th=[ 844], 99.95th=[ 844], | 99.99th=[ 844] bw ( KiB/s): min= 8078, max= 8126, per=100.00%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.86%, ctx=374, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179754: Thu Sep 3 22:48:31 2026 read: IOPS=0, BW=1234KiB/s (1264kB/s)(4096KiB/3319msec) clat (nsec): min=689790k, max=689790k, avg=689790184.00, stdev= 0.00 lat (nsec): min=689792k, max=689792k, avg=689792180.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2468KiB/s (2527kB/s)(8192KiB/3319msec); 0 zone resets clat (msec): min=561, max=1980, avg=1271.16, stdev=1003.73 lat (msec): min=561, max=1983, avg=1272.58, stdev=1004.98 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1989], | 70.00th=[ 1989], 80.00th=[ 1989], 90.00th=[ 1989], 95.00th=[ 1989], | 99.00th=[ 1989], 99.50th=[ 1989], 99.90th=[ 1989], 99.95th=[ 1989], | 99.99th=[ 1989] bw ( KiB/s): min= 7816, max= 7816, per=79.17%, avg=7816.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.24%, ctx=140, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179756: Thu Sep 3 22:48:31 2026 write: IOPS=0, BW=3754KiB/s (3844kB/s)(12.0MiB/3273msec); 0 zone resets clat (msec): min=450, max=1638, avg=1055.07, stdev=594.17 lat (msec): min=451, max=1639, avg=1055.77, stdev=594.29 clat percentiles (msec): | 1.00th=[ 451], 5.00th=[ 451], 10.00th=[ 451], 20.00th=[ 451], | 30.00th=[ 451], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min=16286, max=16286, per=100.00%, avg=16286.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.43%, ctx=69, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179759: Thu Sep 3 22:48:31 2026 write: IOPS=1, BW=4433KiB/s (4539kB/s)(12.0MiB/2772msec); 0 zone resets clat (msec): min=249, max=1792, avg=892.93, stdev=802.55 lat (msec): min=249, max=1793, avg=893.95, stdev=803.33 clat percentiles (msec): | 1.00th=[ 249], 5.00th=[ 249], 10.00th=[ 249], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min=16253, max=16253, per=100.00%, avg=16253.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=5.92%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4936KiB/s (5055kB/s), 1234KiB/s-5137KiB/s (1264kB/s-5260kB/s), io=16.0MiB (16.8MB), run=2392-3319msec WRITE: bw=9873KiB/s (10.1MB/s), 2468KiB/s-4433KiB/s (2527kB/s-4539kB/s), io=32.0MiB (33.6MB), run=2772-3319msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179753: Thu Sep 3 22:48:31 2026 read: IOPS=1, BW=5769KiB/s (5907kB/s)(12.0MiB/2130msec) clat (msec): min=221, max=1472, avg=699.23, stdev=675.74 lat (msec): min=222, max=1472, avg=699.23, stdev=675.74 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 222], | 30.00th=[ 222], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 7148, max= 8192, per=100.00%, avg=7670.00, stdev=738.22, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.12%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179755: Thu Sep 3 22:48:31 2026 read: IOPS=0, BW=1189KiB/s (1218kB/s)(4096KiB/3444msec) clat (nsec): min=831629k, max=831629k, avg=831628999.00, stdev= 0.00 lat (nsec): min=831631k, max=831631k, avg=831631039.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 835], 5.00th=[ 835], 10.00th=[ 835], 20.00th=[ 835], | 30.00th=[ 835], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7937, max= 7937, per=100.00%, avg=7937.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2379KiB/s (2436kB/s)(8192KiB/3444msec); 0 zone resets clat (msec): min=380, max=2163, avg=1272.19, stdev=1260.96 lat (msec): min=381, max=2164, avg=1272.67, stdev=1260.83 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 2165], | 70.00th=[ 2165], 80.00th=[ 2165], 90.00th=[ 2165], 95.00th=[ 2165], | 99.00th=[ 2165], 99.50th=[ 2165], 99.90th=[ 2165], 99.95th=[ 2165], | 99.99th=[ 2165] bw ( KiB/s): min= 8143, max= 8143, per=85.59%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.72%, ctx=38, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179757: Thu Sep 3 22:48:31 2026 write: IOPS=0, BW=3597KiB/s (3684kB/s)(12.0MiB/3416msec); 0 zone resets clat (msec): min=525, max=2022, avg=1109.53, stdev=800.98 lat (msec): min=526, max=2022, avg=1110.29, stdev=800.53 clat percentiles (msec): | 1.00th=[ 527], 5.00th=[ 527], 10.00th=[ 527], 20.00th=[ 527], | 30.00th=[ 527], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8143, max= 8159, per=85.67%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.39%, ctx=57, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179758: Thu Sep 3 22:48:31 2026 write: IOPS=1, BW=4172KiB/s (4273kB/s)(12.0MiB/2945msec); 0 zone resets clat (msec): min=455, max=1213, avg=958.30, stdev=435.38 lat (msec): min=456, max=1214, avg=958.87, stdev=435.00 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7816, max= 8192, per=84.13%, avg=8004.00, stdev=265.87, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.31%, ctx=62, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4757KiB/s (4871kB/s), 1189KiB/s-5769KiB/s (1218kB/s-5907kB/s), io=16.0MiB (16.8MB), run=2130-3444msec WRITE: bw=9515KiB/s (9743kB/s), 2379KiB/s-4172KiB/s (2436kB/s-4273kB/s), io=32.0MiB (33.6MB), run=2945-3444msec