== sanity test 398b: DIO and buffer IO race ============== 11:44:52 (1788277492) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.68257 s, 8.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180420: Tue Sep 1 11:47:16 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(5992KiB/123831msec) clat (usec): min=33, max=240490, avg=45859.58, stdev=31441.22 lat (usec): min=33, max=240490, avg=45860.56, stdev=31441.23 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 3163], 10.00th=[ 15926], 20.00th=[ 22152], | 30.00th=[ 26608], 40.00th=[ 32637], 50.00th=[ 39060], 60.00th=[ 46924], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[156238], 99.50th=[179307], 99.90th=[235930], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 103, per=25.05%, avg=47.84, stdev=18.56, samples=244 iops : min= 1, max= 25, avg=11.32, stdev= 4.68, samples=244 write: IOPS=12, BW=50.8KiB/s (52.1kB/s)(6296KiB/123831msec); 0 zone resets clat (usec): min=895, max=470510, avg=34687.55, stdev=38077.36 lat (usec): min=897, max=470511, avg=34690.79, stdev=38078.44 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1156], 10.00th=[ 1319], 20.00th=[ 3130], | 30.00th=[ 6652], 40.00th=[ 16319], 50.00th=[ 23987], 60.00th=[ 33424], | 70.00th=[ 43779], 80.00th=[ 60556], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[160433], 99.50th=[166724], 99.90th=[261096], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 5, max= 118, per=25.27%, avg=50.53, stdev=22.32, samples=243 iops : min= 1, max= 29, avg=11.99, stdev= 5.62, samples=243 lat (usec) : 50=0.29%, 100=1.86%, 250=0.16%, 500=0.03%, 1000=0.23% lat (msec) : 2=7.58%, 4=4.46%, 10=5.89%, 20=10.22%, 50=38.18% lat (msec) : 100=25.23%, 250=5.76%, 500=0.10% cpu : usr=0.07%, sys=5.18%, ctx=6341, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180421: Tue Sep 1 11:47:16 2026 read: IOPS=12, BW=49.1KiB/s (50.3kB/s)(5940KiB/120941msec) clat (usec): min=32, max=235262, avg=44680.41, stdev=29679.96 lat (usec): min=33, max=235263, avg=44685.01, stdev=29677.82 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 1418], 10.00th=[ 15664], 20.00th=[ 21890], | 30.00th=[ 27132], 40.00th=[ 33162], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 54264], 80.00th=[ 63177], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[149947], 99.50th=[160433], 99.90th=[229639], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 15, max= 96, per=25.40%, avg=48.51, stdev=18.90, samples=238 iops : min= 3, max= 24, avg=11.49, stdev= 4.79, samples=238 write: IOPS=13, BW=52.5KiB/s (53.7kB/s)(6348KiB/120941msec); 0 zone resets clat (usec): min=935, max=456254, avg=34092.02, stdev=38841.88 lat (usec): min=935, max=456255, avg=34094.20, stdev=38842.33 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1336], 20.00th=[ 2868], | 30.00th=[ 6390], 40.00th=[ 13435], 50.00th=[ 22676], 60.00th=[ 32113], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 84411], 95.00th=[107480], | 99.00th=[160433], 99.50th=[210764], 99.90th=[283116], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 119, per=25.88%, avg=51.76, stdev=21.01, samples=238 iops : min= 1, max= 29, avg=12.29, stdev= 5.29, samples=238 lat (usec) : 50=0.23%, 100=1.89%, 250=0.20%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.23% lat (msec) : 2=7.49%, 4=4.75%, 10=6.45%, 20=10.94%, 50=38.02% lat (msec) : 100=24.19%, 250=5.50%, 500=0.07% cpu : usr=0.07%, sys=5.27%, ctx=6319, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180422: Tue Sep 1 11:47:16 2026 read: IOPS=12, BW=48.7KiB/s (49.9kB/s)(6028KiB/123766msec) clat (usec): min=33, max=269134, avg=44712.40, stdev=30113.70 lat (usec): min=33, max=269135, avg=44716.10, stdev=30111.80 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 5932], 10.00th=[ 15664], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[ 98042], | 99.00th=[145753], 99.50th=[164627], 99.90th=[242222], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 103, per=25.35%, avg=48.42, stdev=17.97, samples=243 iops : min= 1, max= 25, avg=11.46, stdev= 4.52, samples=243 write: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6260KiB/123766msec); 0 zone resets clat (usec): min=972, max=677769, avg=35707.83, stdev=40543.35 lat (usec): min=972, max=677771, avg=35710.19, stdev=40542.56 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1172], 10.00th=[ 1336], 20.00th=[ 3097], | 30.00th=[ 6849], 40.00th=[ 15270], 50.00th=[ 25035], 60.00th=[ 33817], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[158335], 99.50th=[189793], 99.90th=[244319], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 7, max= 135, per=25.15%, avg=50.29, stdev=21.46, samples=243 iops : min= 1, max= 33, avg=11.93, stdev= 5.41, samples=243 lat (usec) : 50=0.42%, 100=1.66%, 250=0.16%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.23% lat (msec) : 2=7.36%, 4=4.13%, 10=6.45%, 20=10.32%, 50=38.54% lat (msec) : 100=24.77%, 250=5.79%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.21%, ctx=6241, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180423: Tue Sep 1 11:47:16 2026 read: IOPS=12, BW=48.3KiB/s (49.4kB/s)(6052KiB/125360msec) clat (usec): min=32, max=487558, avg=45339.23, stdev=32795.59 lat (usec): min=33, max=487559, avg=45340.75, stdev=32795.43 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 87], 10.00th=[ 15795], 20.00th=[ 21890], | 30.00th=[ 27395], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 53740], 80.00th=[ 64750], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[162530], 99.50th=[196084], 99.90th=[242222], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 7, max= 103, per=25.01%, avg=47.77, stdev=18.97, samples=247 iops : min= 1, max= 25, avg=11.30, stdev= 4.76, samples=247 write: IOPS=12, BW=49.7KiB/s (50.9kB/s)(6236KiB/125360msec); 0 zone resets clat (usec): min=943, max=265731, avg=36103.21, stdev=37691.84 lat (usec): min=944, max=265733, avg=36109.65, stdev=37697.33 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3458], | 30.00th=[ 7308], 40.00th=[ 17957], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 46924], 80.00th=[ 62129], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[168821], 99.50th=[202376], 99.90th=[250610], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 7, max= 136, per=24.70%, avg=49.40, stdev=21.89, samples=246 iops : min= 1, max= 34, avg=11.70, stdev= 5.53, samples=246 lat (usec) : 50=0.49%, 100=2.02%, 250=0.10%, 1000=0.07% lat (msec) : 2=7.39%, 4=3.84%, 10=6.15%, 20=9.77%, 50=38.77% lat (msec) : 100=25.65%, 250=5.66%, 500=0.10% cpu : usr=0.07%, sys=5.11%, ctx=6362, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=192KiB/s (196kB/s), 48.3KiB/s-49.1KiB/s (49.4kB/s-50.3kB/s), io=23.4MiB (24.6MB), run=120941-125360msec WRITE: bw=201KiB/s (205kB/s), 49.7KiB/s-52.5KiB/s (50.9kB/s-53.7kB/s), io=24.6MiB (25.7MB), run=120941-125360msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180425: Tue Sep 1 11:47:55 2026 read: IOPS=9, BW=36.5KiB/s (37.4kB/s)(5992KiB/164091msec) clat (msec): min=4, max=507, avg=43.72, stdev=44.44 lat (msec): min=4, max=507, avg=43.72, stdev=44.44 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 65], 90.00th=[ 100], 95.00th=[ 134], | 99.00th=[ 213], 99.50th=[ 247], 99.90th=[ 376], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 151, per=25.15%, avg=36.72, stdev=25.86, samples=316 iops : min= 1, max= 37, avg= 8.53, stdev= 6.52, samples=316 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6296KiB/164091msec); 0 zone resets clat (msec): min=10, max=389, avg=62.57, stdev=47.60 lat (msec): min=10, max=389, avg=62.57, stdev=47.60 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 92], 90.00th=[ 124], 95.00th=[ 159], | 99.00th=[ 241], 99.50th=[ 279], 99.90th=[ 351], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 7, max= 128, per=25.18%, avg=38.53, stdev=25.61, samples=317 iops : min= 1, max= 32, avg= 8.99, stdev= 6.48, samples=317 lat (msec) : 10=2.57%, 20=16.50%, 50=44.66%, 100=23.34%, 250=12.24% lat (msec) : 500=0.65%, 750=0.03% cpu : usr=0.05%, sys=1.69%, ctx=4804, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180426: Tue Sep 1 11:47:55 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(5940KiB/163548msec) clat (msec): min=5, max=725, avg=42.74, stdev=43.81 lat (msec): min=5, max=725, avg=42.74, stdev=43.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 64], 90.00th=[ 95], 95.00th=[ 128], | 99.00th=[ 199], 99.50th=[ 247], 99.90th=[ 305], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 143, per=25.80%, avg=37.66, stdev=26.82, samples=307 iops : min= 1, max= 35, avg= 8.77, stdev= 6.75, samples=307 write: IOPS=9, BW=38.8KiB/s (39.7kB/s)(6348KiB/163548msec); 0 zone resets clat (msec): min=9, max=349, avg=62.95, stdev=47.91 lat (msec): min=9, max=349, avg=62.96, stdev=47.90 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 93], 90.00th=[ 125], 95.00th=[ 159], | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 330], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 125, per=25.15%, avg=38.48, stdev=25.75, samples=320 iops : min= 1, max= 31, avg= 8.98, stdev= 6.50, samples=320 lat (msec) : 10=3.03%, 20=17.09%, 50=43.23%, 100=23.37%, 250=12.53% lat (msec) : 500=0.72%, 750=0.03% cpu : usr=0.06%, sys=1.73%, ctx=4843, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180427: Tue Sep 1 11:47:55 2026 read: IOPS=9, BW=36.0KiB/s (37.8kB/s)(6028KiB/163105msec) clat (msec): min=5, max=374, avg=42.46, stdev=40.67 lat (msec): min=5, max=374, avg=42.47, stdev=40.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 63], 90.00th=[ 93], 95.00th=[ 125], | 99.00th=[ 199], 99.50th=[ 259], 99.90th=[ 288], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 135, per=25.53%, avg=37.27, stdev=25.90, samples=314 iops : min= 1, max= 33, avg= 8.68, stdev= 6.53, samples=314 write: IOPS=9, BW=38.4KiB/s (39.3kB/s)(6260KiB/163105msec); 0 zone resets clat (msec): min=11, max=775, avg=63.25, stdev=50.09 lat (msec): min=11, max=775, avg=63.26, stdev=50.09 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 90], 90.00th=[ 124], 95.00th=[ 159], | 99.00th=[ 234], 99.50th=[ 284], 99.90th=[ 351], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 112, per=25.04%, avg=38.32, stdev=25.16, samples=317 iops : min= 1, max= 28, avg= 8.94, stdev= 6.36, samples=317 lat (msec) : 10=2.44%, 20=15.76%, 50=45.35%, 100=23.96%, 250=11.82% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.06%, sys=1.64%, ctx=4738, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180428: Tue Sep 1 11:47:55 2026 read: IOPS=9, BW=37.1KiB/s (37.0kB/s)(6052KiB/163218msec) clat (msec): min=4, max=309, avg=42.39, stdev=41.22 lat (msec): min=4, max=309, avg=42.39, stdev=41.22 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 61], 90.00th=[ 94], 95.00th=[ 130], | 99.00th=[ 209], 99.50th=[ 236], 99.90th=[ 300], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 7, max= 151, per=25.74%, avg=37.59, stdev=25.94, samples=312 iops : min= 1, max= 37, avg= 8.76, stdev= 6.53, samples=312 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6236KiB/163218msec); 0 zone resets clat (msec): min=6, max=760, avg=63.48, stdev=50.54 lat (msec): min=6, max=760, avg=63.48, stdev=50.54 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 72], 80.00th=[ 91], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 253], 99.50th=[ 292], 99.90th=[ 397], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 7, max= 127, per=24.82%, avg=37.98, stdev=24.90, samples=318 iops : min= 1, max= 31, avg= 8.85, stdev= 6.29, samples=318 lat (msec) : 10=2.73%, 20=15.69%, 50=46.09%, 100=22.59%, 250=12.17% lat (msec) : 500=0.68%, 1000=0.03% cpu : usr=0.05%, sys=1.70%, ctx=4805, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=146KiB/s (150kB/s), 36.3KiB/s-37.1KiB/s (37.2kB/s-37.0kB/s), io=23.4MiB (24.6MB), run=163105-164091msec WRITE: bw=153KiB/s (157kB/s), 38.2KiB/s-38.8KiB/s (39.1kB/s-39.7kB/s), io=24.6MiB (25.7MB), run=163105-164091msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180471: Tue Sep 1 11:48:39 2026 read: IOPS=12, BW=198KiB/s (202kB/s)(5920KiB/29969msec) clat (usec): min=42, max=216530, avg=41130.57, stdev=31077.39 lat (usec): min=42, max=216531, avg=41131.58, stdev=31077.39 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 63], 10.00th=[ 103], 20.00th=[ 19268], | 30.00th=[ 25822], 40.00th=[ 31065], 50.00th=[ 36963], 60.00th=[ 43254], | 70.00th=[ 49546], 80.00th=[ 59507], 90.00th=[ 72877], 95.00th=[ 93848], | 99.00th=[147850], 99.50th=[212861], 99.90th=[217056], 99.95th=[217056], | 99.99th=[217056] bw ( KiB/s): min= 31, max= 374, per=26.52%, avg=197.03, stdev=69.91, samples=59 iops : min= 1, max= 23, avg=11.56, stdev= 4.50, samples=59 write: IOPS=13, BW=212KiB/s (218kB/s)(6368KiB/29969msec); 0 zone resets clat (usec): min=1313, max=252630, avg=36382.44, stdev=35543.34 lat (usec): min=1315, max=252631, avg=36447.14, stdev=35513.79 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2278], 10.00th=[ 4228], 20.00th=[ 6521], | 30.00th=[ 10290], 40.00th=[ 19268], 50.00th=[ 27657], 60.00th=[ 34866], | 70.00th=[ 44303], 80.00th=[ 60031], 90.00th=[ 89654], 95.00th=[107480], | 99.00th=[154141], 99.50th=[160433], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 31, max= 480, per=27.08%, avg=211.49, stdev=91.44, samples=59 iops : min= 1, max= 30, avg=12.47, stdev= 5.80, samples=59 lat (usec) : 50=0.78%, 100=3.91%, 250=0.39%, 500=0.13%, 750=0.39% lat (usec) : 1000=0.13% lat (msec) : 2=1.82%, 4=3.39%, 10=10.42%, 20=9.77%, 50=41.15% lat (msec) : 100=22.53%, 250=5.08%, 500=0.13% cpu : usr=0.07%, sys=6.19%, ctx=1680, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180472: Tue Sep 1 11:48:39 2026 read: IOPS=11, BW=178KiB/s (183kB/s)(5744KiB/32226msec) clat (usec): min=47, max=198419, avg=45315.28, stdev=29693.28 lat (usec): min=47, max=198419, avg=45316.30, stdev=29693.27 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 130], 20.00th=[ 23200], | 30.00th=[ 29230], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 48497], | 70.00th=[ 55313], 80.00th=[ 67634], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[132645], 99.50th=[164627], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 31, max= 320, per=24.28%, avg=180.37, stdev=73.21, samples=62 iops : min= 1, max= 20, avg=10.53, stdev= 4.65, samples=62 write: IOPS=12, BW=203KiB/s (208kB/s)(6544KiB/32226msec); 0 zone resets clat (usec): min=1500, max=296064, avg=38096.35, stdev=39829.51 lat (usec): min=1501, max=296066, avg=38099.25, stdev=39830.39 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2278], 10.00th=[ 3261], 20.00th=[ 6718], | 30.00th=[ 12649], 40.00th=[ 19530], 50.00th=[ 27657], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 60556], 90.00th=[ 88605], 95.00th=[112722], | 99.00th=[181404], 99.50th=[196084], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 31, max= 408, per=25.86%, avg=201.97, stdev=98.33, samples=63 iops : min= 1, max= 25, avg=11.90, stdev= 6.25, samples=63 lat (usec) : 50=0.26%, 100=3.78%, 250=0.65%, 500=0.13%, 750=0.13% lat (msec) : 2=1.95%, 4=4.82%, 10=7.81%, 20=9.77%, 50=39.06% lat (msec) : 100=25.52%, 250=5.86%, 500=0.26% cpu : usr=0.06%, sys=6.03%, ctx=1761, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180473: Tue Sep 1 11:48:39 2026 read: IOPS=12, BW=203KiB/s (208kB/s)(6256KiB/30763msec) clat (usec): min=45, max=153852, avg=43479.12, stdev=27419.96 lat (usec): min=46, max=153854, avg=43481.21, stdev=27419.65 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 11338], 20.00th=[ 22938], | 30.00th=[ 28967], 40.00th=[ 34341], 50.00th=[ 41157], 60.00th=[ 46400], | 70.00th=[ 53740], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[131597], 99.50th=[139461], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 64, max= 383, per=27.58%, avg=204.93, stdev=66.61, samples=60 iops : min= 4, max= 23, avg=12.07, stdev= 4.15, samples=60 write: IOPS=12, BW=196KiB/s (201kB/s)(6032KiB/30763msec); 0 zone resets clat (usec): min=1426, max=221582, avg=36342.62, stdev=34385.43 lat (usec): min=1428, max=221583, avg=36344.46, stdev=34385.40 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1795], 10.00th=[ 3163], 20.00th=[ 5997], | 30.00th=[ 11469], 40.00th=[ 17957], 50.00th=[ 26870], 60.00th=[ 36963], | 70.00th=[ 45876], 80.00th=[ 62129], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[139461], 99.50th=[168821], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 63, max= 349, per=24.86%, avg=194.18, stdev=72.61, samples=60 iops : min= 3, max= 21, avg=11.40, stdev= 4.60, samples=60 lat (usec) : 50=0.13%, 100=4.17%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=3.65%, 4=2.86%, 10=7.42%, 20=10.55%, 50=39.19% lat (msec) : 100=26.56%, 250=4.95% cpu : usr=0.07%, sys=5.72%, ctx=1715, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180474: Tue Sep 1 11:48:39 2026 read: IOPS=12, BW=204KiB/s (209kB/s)(6032KiB/29520msec) clat (usec): min=46, max=198436, avg=44109.05, stdev=30493.27 lat (usec): min=47, max=198437, avg=44110.05, stdev=30493.31 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 63], 10.00th=[ 98], 20.00th=[ 23987], | 30.00th=[ 28443], 40.00th=[ 33162], 50.00th=[ 40109], 60.00th=[ 49021], | 70.00th=[ 55313], 80.00th=[ 63701], 90.00th=[ 77071], 95.00th=[100140], | 99.00th=[156238], 99.50th=[170918], 99.90th=[198181], 99.95th=[198181], | 99.99th=[198181] bw ( KiB/s): min= 63, max= 343, per=27.35%, avg=203.23, stdev=58.52, samples=57 iops : min= 3, max= 21, avg=11.96, stdev= 3.74, samples=57 write: IOPS=13, BW=212KiB/s (217kB/s)(6256KiB/29520msec); 0 zone resets clat (usec): min=1514, max=149408, avg=32513.36, stdev=29028.79 lat (usec): min=1515, max=149410, avg=32515.24, stdev=29028.77 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1909], 10.00th=[ 2802], 20.00th=[ 6194], | 30.00th=[ 9372], 40.00th=[ 18220], 50.00th=[ 24773], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 55837], 90.00th=[ 73925], 95.00th=[ 88605], | 99.00th=[116917], 99.50th=[132645], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 63, max= 415, per=27.02%, avg=211.05, stdev=92.67, samples=57 iops : min= 3, max= 25, avg=12.44, stdev= 5.81, samples=57 lat (usec) : 50=0.13%, 100=4.82%, 250=0.78%, 500=0.26% lat (msec) : 2=2.73%, 4=4.17%, 10=8.98%, 20=7.42%, 50=40.49% lat (msec) : 100=26.17%, 250=4.04% cpu : usr=0.08%, sys=6.30%, ctx=1650, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=743KiB/s (761kB/s), 178KiB/s-204KiB/s (183kB/s-209kB/s), io=23.4MiB (24.5MB), run=29520-32226msec WRITE: bw=782KiB/s (801kB/s), 196KiB/s-212KiB/s (201kB/s-218kB/s), io=24.6MiB (25.8MB), run=29520-32226msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180475: Tue Sep 1 11:48:49 2026 read: IOPS=8, BW=141KiB/s (145kB/s)(5920KiB/41916msec) clat (msec): min=6, max=256, avg=43.04, stdev=35.90 lat (msec): min=6, max=256, avg=43.05, stdev=35.90 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 35], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 89], 95.00th=[ 121], | 99.00th=[ 178], 99.50th=[ 184], 99.90th=[ 257], 99.95th=[ 257], | 99.99th=[ 257] bw ( KiB/s): min= 31, max= 448, per=25.44%, avg=144.52, stdev=87.64, samples=81 iops : min= 1, max= 28, avg= 8.21, stdev= 5.60, samples=81 write: IOPS=9, BW=152KiB/s (156kB/s)(6368KiB/41916msec); 0 zone resets clat (msec): min=13, max=312, avg=64.75, stdev=43.53 lat (msec): min=13, max=312, avg=64.75, stdev=43.53 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 71], 80.00th=[ 93], 90.00th=[ 130], 95.00th=[ 148], | 99.00th=[ 226], 99.50th=[ 284], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 31, max= 383, per=25.64%, avg=153.30, stdev=83.98, samples=82 iops : min= 1, max= 23, avg= 8.77, stdev= 5.29, samples=82 lat (msec) : 10=1.30%, 20=12.24%, 50=46.35%, 100=26.69%, 250=13.02% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=1.93%, ctx=1232, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180476: Tue Sep 1 11:48:49 2026 read: IOPS=8, BW=136KiB/s (140kB/s)(5744KiB/42101msec) clat (msec): min=6, max=193, avg=42.11, stdev=32.98 lat (msec): min=6, max=193, avg=42.11, stdev=32.98 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 86], 95.00th=[ 121], | 99.00th=[ 150], 99.50th=[ 178], 99.90th=[ 194], 99.95th=[ 194], | 99.99th=[ 194] bw ( KiB/s): min= 30, max= 477, per=25.37%, avg=144.08, stdev=88.99, samples=78 iops : min= 1, max= 29, avg= 8.18, stdev= 5.61, samples=78 write: IOPS=9, BW=155KiB/s (159kB/s)(6544KiB/42101msec); 0 zone resets clat (msec): min=14, max=295, avg=65.73, stdev=43.79 lat (msec): min=14, max=295, avg=65.74, stdev=43.79 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 100], 90.00th=[ 130], 95.00th=[ 150], | 99.00th=[ 215], 99.50th=[ 239], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 448, per=25.83%, avg=154.45, stdev=89.38, samples=83 iops : min= 1, max= 28, avg= 8.84, stdev= 5.67, samples=83 lat (msec) : 10=1.30%, 20=12.76%, 50=47.27%, 100=24.09%, 250=14.32% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.92%, ctx=1208, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180477: Tue Sep 1 11:48:49 2026 read: IOPS=9, BW=151KiB/s (155kB/s)(6256KiB/41358msec) clat (msec): min=8, max=259, avg=43.75, stdev=36.30 lat (msec): min=8, max=259, avg=43.75, stdev=36.30 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 59], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 169], 99.50th=[ 190], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 31, max= 479, per=26.88%, avg=152.69, stdev=99.62, samples=80 iops : min= 1, max= 29, avg= 8.72, stdev= 6.26, samples=80 write: IOPS=9, BW=146KiB/s (149kB/s)(6032KiB/41358msec); 0 zone resets clat (msec): min=14, max=348, avg=63.30, stdev=43.27 lat (msec): min=14, max=348, avg=63.32, stdev=43.26 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 51], 60.00th=[ 59], | 70.00th=[ 70], 80.00th=[ 91], 90.00th=[ 118], 95.00th=[ 148], | 99.00th=[ 224], 99.50th=[ 243], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 31, max= 405, per=24.27%, avg=145.14, stdev=79.16, samples=80 iops : min= 1, max= 25, avg= 8.25, stdev= 5.01, samples=80 lat (msec) : 10=0.52%, 20=13.93%, 50=47.79%, 100=25.91%, 250=11.59% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.87%, ctx=1174, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180478: Tue Sep 1 11:48:49 2026 read: IOPS=8, BW=143KiB/s (147kB/s)(6032KiB/42045msec) clat (msec): min=6, max=195, avg=42.96, stdev=35.15 lat (msec): min=6, max=195, avg=42.96, stdev=35.15 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 66], 90.00th=[ 96], 95.00th=[ 123], | 99.00th=[ 157], 99.50th=[ 184], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 30, max= 448, per=25.30%, avg=143.73, stdev=96.63, samples=82 iops : min= 1, max= 28, avg= 8.16, stdev= 6.10, samples=82 write: IOPS=9, BW=149KiB/s (152kB/s)(6256KiB/42045msec); 0 zone resets clat (msec): min=16, max=345, avg=65.20, stdev=46.33 lat (msec): min=16, max=345, avg=65.21, stdev=46.34 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 61], | 70.00th=[ 74], 80.00th=[ 92], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 243], 99.50th=[ 275], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 31, max= 413, per=25.10%, avg=150.12, stdev=86.44, samples=82 iops : min= 1, max= 25, avg= 8.57, stdev= 5.47, samples=82 lat (msec) : 10=1.56%, 20=12.63%, 50=47.66%, 100=25.00%, 250=12.89% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=1.84%, ctx=1141, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=569KiB/s (583kB/s), 136KiB/s-151KiB/s (140kB/s-155kB/s), io=23.4MiB (24.5MB), run=41358-42101msec WRITE: bw=599KiB/s (613kB/s), 146KiB/s-155KiB/s (149kB/s-159kB/s), io=24.6MiB (25.8MB), run=41358-42101msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180489: Tue Sep 1 11:49:06 2026 read: IOPS=1, BW=1701KiB/s (1742kB/s)(7168KiB/4214msec) clat (msec): min=118, max=600, avg=226.36, stdev=168.03 lat (msec): min=118, max=600, avg=226.36, stdev=168.03 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 127], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 180], 60.00th=[ 194], | 70.00th=[ 194], 80.00th=[ 205], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2011, max= 5763, per=82.58%, avg=2962.00, stdev=1867.38, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1215KiB/s (1244kB/s)(5120KiB/4214msec); 0 zone resets clat (msec): min=316, max=934, avg=519.26, stdev=256.74 lat (msec): min=316, max=934, avg=519.34, stdev=256.74 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 1783, max= 4096, per=49.49%, avg=2485.25, stdev=1080.18, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=2.94%, ctx=71, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180490: Tue Sep 1 11:49:06 2026 read: IOPS=0, BW=365KiB/s (374kB/s)(2048KiB/5614msec) clat (msec): min=98, max=152, avg=125.57, stdev=38.52 lat (msec): min=98, max=152, avg=125.57, stdev=38.53 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 99], 50.00th=[ 99], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 1410, max= 2039, per=48.08%, avg=1724.50, stdev=444.77, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1824KiB/s (1868kB/s)(10.0MiB/5614msec); 0 zone resets clat (msec): min=149, max=1262, avg=531.93, stdev=321.03 lat (msec): min=149, max=1262, avg=532.22, stdev=320.88 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 157], | 30.00th=[ 309], 40.00th=[ 451], 50.00th=[ 506], 60.00th=[ 527], | 70.00th=[ 592], 80.00th=[ 676], 90.00th=[ 684], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 2031, max= 4023, per=48.46%, avg=2433.57, stdev=759.01, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.79, samples=7 lat (msec) : 100=8.33%, 250=25.00%, 500=16.67%, 750=41.67%, 2000=8.33% cpu : usr=0.05%, sys=2.87%, ctx=81, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180491: Tue Sep 1 11:49:06 2026 read: IOPS=1, BW=1076KiB/s (1102kB/s)(6144KiB/5709msec) clat (msec): min=125, max=507, avg=269.50, stdev=174.02 lat (msec): min=125, max=507, avg=269.50, stdev=174.02 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 167], 50.00th=[ 167], 60.00th=[ 218], | 70.00th=[ 472], 80.00th=[ 472], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1790, max= 2039, per=55.28%, avg=1982.80, stdev=108.41, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1076KiB/s (1102kB/s)(6144KiB/5709msec); 0 zone resets clat (msec): min=253, max=1003, avg=669.19, stdev=310.20 lat (msec): min=253, max=1003, avg=669.28, stdev=310.17 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 802], | 70.00th=[ 944], 80.00th=[ 944], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 1523, max= 2039, per=38.29%, avg=1923.00, stdev=223.95, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=16.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.04%, sys=3.50%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180492: Tue Sep 1 11:49:06 2026 read: IOPS=1, BW=1029KiB/s (1054kB/s)(5120KiB/4976msec) clat (msec): min=119, max=807, avg=373.89, stdev=296.88 lat (msec): min=119, max=807, avg=373.89, stdev=296.88 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 120], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2031, max= 3567, per=71.05%, avg=2548.67, stdev=881.94, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1441KiB/s (1475kB/s)(7168KiB/4976msec); 0 zone resets clat (msec): min=153, max=1060, avg=426.12, stdev=318.35 lat (msec): min=153, max=1060, avg=426.21, stdev=318.35 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 182], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 326], 60.00th=[ 456], | 70.00th=[ 456], 80.00th=[ 575], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 2011, max= 4039, per=50.44%, avg=2533.00, stdev=1004.10, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=4.24%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3587KiB/s (3673kB/s), 365KiB/s-1701KiB/s (374kB/s-1742kB/s), io=20.0MiB (20.0MB), run=4214-5709msec WRITE: bw=5022KiB/s (5143kB/s), 1076KiB/s-1824KiB/s (1102kB/s-1868kB/s), io=28.0MiB (29.4MB), run=4214-5709msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180494: Tue Sep 1 11:49:06 2026 read: IOPS=1, BW=1739KiB/s (1781kB/s)(7168KiB/4122msec) clat (usec): min=593, max=373931, avg=218464.55, stdev=116393.29 lat (usec): min=595, max=373933, avg=218465.82, stdev=116393.14 clat percentiles (usec): | 1.00th=[ 594], 5.00th=[ 594], 10.00th=[ 594], 20.00th=[166724], | 30.00th=[208667], 40.00th=[208667], 50.00th=[227541], 60.00th=[267387], | 70.00th=[267387], 80.00th=[283116], 90.00th=[375391], 95.00th=[375391], | 99.00th=[375391], 99.50th=[375391], 99.90th=[375391], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 2031, max= 3908, per=83.73%, avg=3253.00, stdev=1059.20, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1242KiB/s (1272kB/s)(5120KiB/4122msec); 0 zone resets clat (msec): min=253, max=736, avg=517.97, stdev=210.47 lat (msec): min=254, max=736, avg=518.07, stdev=210.43 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 347], 40.00th=[ 347], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1932, max= 3946, per=48.37%, avg=2631.00, stdev=1139.58, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=25.00% cpu : usr=0.00%, sys=11.65%, ctx=182, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180495: Tue Sep 1 11:49:06 2026 read: IOPS=0, BW=389KiB/s (398kB/s)(2048KiB/5271msec) clat (msec): min=35, max=656, avg=346.14, stdev=438.93 lat (msec): min=35, max=656, avg=346.14, stdev=438.93 clat percentiles (msec): | 1.00th=[ 36], 5.00th=[ 36], 10.00th=[ 36], 20.00th=[ 36], | 30.00th=[ 36], 40.00th=[ 36], 50.00th=[ 36], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2015, max= 2031, per=52.07%, avg=2023.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1943KiB/s (1989kB/s)(10.0MiB/5271msec); 0 zone resets clat (msec): min=163, max=1175, avg=457.24, stdev=292.04 lat (msec): min=164, max=1175, avg=457.59, stdev=291.92 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 288], | 30.00th=[ 292], 40.00th=[ 300], 50.00th=[ 321], 60.00th=[ 363], | 70.00th=[ 439], 80.00th=[ 558], 90.00th=[ 676], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 2015, max= 4096, per=55.04%, avg=2993.50, stdev=1057.28, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 50=8.33%, 250=8.33%, 500=50.00%, 750=25.00%, 2000=8.33% cpu : usr=0.00%, sys=9.20%, ctx=141, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180496: Tue Sep 1 11:49:06 2026 read: IOPS=1, BW=1439KiB/s (1473kB/s)(6144KiB/4271msec) clat (usec): min=477, max=424531, avg=134260.09, stdev=170140.09 lat (usec): min=478, max=424532, avg=134261.33, stdev=170140.20 clat percentiles (usec): | 1.00th=[ 478], 5.00th=[ 478], 10.00th=[ 478], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 8455], 50.00th=[ 8455], 60.00th=[143655], | 70.00th=[227541], 80.00th=[227541], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 1973, max= 4031, per=85.05%, avg=3304.00, stdev=1154.32, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1439KiB/s (1473kB/s)(6144KiB/4271msec); 0 zone resets clat (msec): min=229, max=1056, avg=576.35, stdev=327.63 lat (msec): min=229, max=1056, avg=576.41, stdev=327.62 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 288], | 30.00th=[ 288], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 701], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 1706, max= 2031, per=34.97%, avg=1901.80, stdev=128.50, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 10=8.33%, 250=25.00%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=11.22%, ctx=145, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180497: Tue Sep 1 11:49:06 2026 read: IOPS=1, BW=1075KiB/s (1100kB/s)(5120KiB/4765msec) clat (usec): min=935, max=291668, avg=164220.56, stdev=149314.96 lat (usec): min=936, max=291669, avg=164221.79, stdev=149314.70 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 938], | 30.00th=[ 1893], 40.00th=[ 1893], 50.00th=[250610], 60.00th=[250610], | 70.00th=[274727], 80.00th=[274727], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 3946, max= 4031, per=100.00%, avg=3988.50, stdev=60.10, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1504KiB/s (1540kB/s)(7168KiB/4765msec); 0 zone resets clat (msec): min=230, max=860, avg=559.70, stdev=217.83 lat (msec): min=230, max=860, avg=559.77, stdev=217.83 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 330], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 592], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 726], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 1845, max= 2048, per=36.31%, avg=1974.83, stdev=79.69, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=8.33%, 500=33.33%, 750=33.33%, 1000=8.33% cpu : usr=0.00%, sys=9.30%, ctx=197, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3885KiB/s (3979kB/s), 389KiB/s-1739KiB/s (398kB/s-1781kB/s), io=20.0MiB (20.0MB), run=4122-5271msec WRITE: bw=5440KiB/s (5570kB/s), 1242KiB/s-1943KiB/s (1272kB/s-1989kB/s), io=28.0MiB (29.4MB), run=4122-5271msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180504: Tue Sep 1 11:49:20 2026 read: IOPS=1, BW=4526KiB/s (4635kB/s)(12.0MiB/2715msec) clat (msec): min=543, max=1114, avg=846.77, stdev=287.51 lat (msec): min=543, max=1114, avg=846.77, stdev=287.51 clat percentiles (msec): | 1.00th=[ 542], 5.00th=[ 542], 10.00th=[ 542], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 1116], 80.00th=[ 1116], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 8126, max= 8175, per=100.00%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.16%, ctx=64, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180505: Tue Sep 1 11:49:20 2026 read: IOPS=0, BW=3454KiB/s (3537kB/s)(4096KiB/1186msec) clat (nsec): min=273465k, max=273465k, avg=273464798.00, stdev= 0.00 lat (nsec): min=273468k, max=273468k, avg=273467599.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 275], 50.00th=[ 275], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 275], 95.00th=[ 275], | 99.00th=[ 275], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 6113, max= 6113, per=100.00%, avg=6113.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6907KiB/s (7073kB/s)(8192KiB/1186msec); 0 zone resets clat (msec): min=380, max=451, avg=416.02, stdev=49.58 lat (msec): min=381, max=451, avg=416.44, stdev=49.41 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 451], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 8126, max= 8126, per=68.70%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=8.52%, ctx=65, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180506: Tue Sep 1 11:49:20 2026 write: IOPS=1, BW=6015KiB/s (6159kB/s)(12.0MiB/2043msec); 0 zone resets clat (msec): min=536, max=754, avg=624.02, stdev=114.81 lat (msec): min=537, max=754, avg=624.39, stdev=114.69 clat percentiles (msec): | 1.00th=[ 535], 5.00th=[ 535], 10.00th=[ 535], 20.00th=[ 535], | 30.00th=[ 535], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8126, max= 8175, per=68.90%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.78%, ctx=62, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180507: Tue Sep 1 11:49:20 2026 write: IOPS=1, BW=4436KiB/s (4543kB/s)(12.0MiB/2770msec); 0 zone resets clat (msec): min=296, max=2030, avg=897.95, stdev=981.44 lat (msec): min=297, max=2030, avg=898.26, stdev=981.43 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 368], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 6243, max= 8126, per=60.74%, avg=7184.50, stdev=1331.48, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.04%, sys=6.25%, ctx=42, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6035KiB/s (6179kB/s), 3454KiB/s-4526KiB/s (3537kB/s-4635kB/s), io=16.0MiB (16.8MB), run=1186-2715msec WRITE: bw=11.6MiB/s (12.1MB/s), 4436KiB/s-6907KiB/s (4543kB/s-7073kB/s), io=32.0MiB (33.6MB), run=1186-2770msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180509: Tue Sep 1 11:49:21 2026 read: IOPS=1, BW=4425KiB/s (4531kB/s)(12.0MiB/2777msec) clat (msec): min=829, max=975, avg=920.93, stdev=79.33 lat (msec): min=829, max=975, avg=920.93, stdev=79.33 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8031, max= 8159, per=100.00%, avg=8095.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=100.00% cpu : usr=0.00%, sys=11.92%, ctx=262, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180510: Tue Sep 1 11:49:21 2026 read: IOPS=0, BW=1248KiB/s (1278kB/s)(4096KiB/3282msec) clat (nsec): min=1003.2M, max=1003.2M, avg=1003239005.00, stdev= 0.00 lat (nsec): min=1003.2M, max=1003.2M, avg=1003240326.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1003], 5.00th=[ 1003], 10.00th=[ 1003], 20.00th=[ 1003], | 30.00th=[ 1003], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1003], 80.00th=[ 1003], 90.00th=[ 1003], 95.00th=[ 1003], | 99.00th=[ 1003], 99.50th=[ 1003], 99.90th=[ 1003], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2496KiB/s (2556kB/s)(8192KiB/3282msec); 0 zone resets clat (msec): min=1097, max=1179, avg=1138.56, stdev=57.62 lat (msec): min=1098, max=1179, avg=1139.04, stdev=57.61 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8159, max= 8159, per=84.69%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=6.03%, ctx=112, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180511: Tue Sep 1 11:49:21 2026 write: IOPS=0, BW=3613KiB/s (3700kB/s)(12.0MiB/3401msec); 0 zone resets clat (msec): min=304, max=2118, avg=1130.72, stdev=917.42 lat (msec): min=305, max=2118, avg=1133.32, stdev=916.79 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8175, max= 8175, per=84.86%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.68%, ctx=50, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180512: Tue Sep 1 11:49:21 2026 write: IOPS=1, BW=4575KiB/s (4685kB/s)(12.0MiB/2686msec); 0 zone resets clat (msec): min=350, max=1500, avg=891.09, stdev=578.13 lat (msec): min=350, max=1510, avg=894.95, stdev=583.33 clat percentiles (msec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 351], | 30.00th=[ 351], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 5565, max= 8159, per=71.23%, avg=6862.00, stdev=1834.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.54%, ctx=47, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4992KiB/s (5112kB/s), 1248KiB/s-4425KiB/s (1278kB/s-4531kB/s), io=16.0MiB (16.8MB), run=2777-3282msec WRITE: bw=9635KiB/s (9866kB/s), 2496KiB/s-4575KiB/s (2556kB/s-4685kB/s), io=32.0MiB (33.6MB), run=2686-3401msec