== sanity test 398b: DIO and buffer IO race ============== 06:25:23 (1783074323) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.79788 s, 18.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147311: Fri Jul 3 06:26:27 2026 read: IOPS=27, BW=108KiB/s (111kB/s)(5992KiB/55353msec) clat (usec): min=45, max=972018, avg=19585.23, stdev=27150.48 lat (usec): min=46, max=972019, avg=19586.43, stdev=27150.76 clat percentiles (usec): | 1.00th=[ 91], 5.00th=[ 227], 10.00th=[ 8029], 20.00th=[ 10421], | 30.00th=[ 12649], 40.00th=[ 14746], 50.00th=[ 17171], 60.00th=[ 19530], | 70.00th=[ 22414], 80.00th=[ 26346], 90.00th=[ 32900], 95.00th=[ 38536], | 99.00th=[ 56886], 99.50th=[ 73925], 99.90th=[101188], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 6, max= 190, per=25.26%, avg=109.11, stdev=29.37, samples=109 iops : min= 1, max= 47, avg=26.83, stdev= 7.39, samples=109 write: IOPS=28, BW=114KiB/s (116kB/s)(6296KiB/55353msec); 0 zone resets clat (usec): min=816, max=113367, avg=16392.76, stdev=13669.53 lat (usec): min=817, max=113369, avg=16394.08, stdev=13669.53 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2474], 10.00th=[ 3064], 20.00th=[ 4228], | 30.00th=[ 6718], 40.00th=[ 10290], 50.00th=[ 13042], 60.00th=[ 16581], | 70.00th=[ 21103], 80.00th=[ 26084], 90.00th=[ 34341], 95.00th=[ 41681], | 99.00th=[ 62653], 99.50th=[ 74974], 99.90th=[109577], 99.95th=[113771], | 99.99th=[113771] bw ( KiB/s): min= 39, max= 200, per=25.52%, avg=115.59, stdev=32.73, samples=108 iops : min= 9, max= 50, avg=28.46, stdev= 8.19, samples=108 lat (usec) : 50=0.07%, 100=0.59%, 250=1.86%, 500=0.03%, 1000=0.13% lat (msec) : 2=1.33%, 4=8.30%, 10=16.63%, 20=35.84%, 50=33.01% lat (msec) : 100=2.08%, 250=0.10%, 1000=0.03% cpu : usr=0.13%, sys=26.23%, ctx=8858, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147312: Fri Jul 3 06:26:27 2026 read: IOPS=26, BW=108KiB/s (110kB/s)(5940KiB/55204msec) clat (usec): min=50, max=176334, avg=19105.00, stdev=11538.04 lat (usec): min=51, max=176334, avg=19106.25, stdev=11538.19 clat percentiles (usec): | 1.00th=[ 97], 5.00th=[ 5538], 10.00th=[ 8455], 20.00th=[ 10683], | 30.00th=[ 12649], 40.00th=[ 15139], 50.00th=[ 17433], 60.00th=[ 20055], | 70.00th=[ 22676], 80.00th=[ 25822], 90.00th=[ 32637], 95.00th=[ 38536], | 99.00th=[ 55313], 99.50th=[ 63701], 99.90th=[107480], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 6, max= 192, per=25.03%, avg=108.12, stdev=30.00, samples=108 iops : min= 1, max= 48, avg=26.58, stdev= 7.58, samples=108 write: IOPS=28, BW=115KiB/s (118kB/s)(6348KiB/55204msec); 0 zone resets clat (usec): min=846, max=961456, avg=16767.68, stdev=27133.75 lat (usec): min=847, max=961457, avg=16772.10, stdev=27134.33 clat percentiles (usec): | 1.00th=[ 1270], 5.00th=[ 2343], 10.00th=[ 3064], 20.00th=[ 4555], | 30.00th=[ 6849], 40.00th=[ 10290], 50.00th=[ 13042], 60.00th=[ 16319], | 70.00th=[ 20317], 80.00th=[ 25560], 90.00th=[ 34866], 95.00th=[ 42206], | 99.00th=[ 57934], 99.50th=[ 62129], 99.90th=[111674], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 47, max= 208, per=25.62%, avg=116.07, stdev=33.35, samples=107 iops : min= 11, max= 52, avg=28.58, stdev= 8.37, samples=107 lat (usec) : 100=0.52%, 250=1.63%, 500=0.03%, 1000=0.20% lat (msec) : 2=1.56%, 4=6.97%, 10=17.64%, 20=35.90%, 50=33.40% lat (msec) : 100=2.02%, 250=0.10%, 1000=0.03% cpu : usr=0.16%, sys=26.58%, ctx=8977, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147313: Fri Jul 3 06:26:27 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6028KiB/55194msec) clat (usec): min=45, max=118137, avg=18869.44, stdev=11585.99 lat (usec): min=46, max=118138, avg=18871.11, stdev=11586.23 clat percentiles (usec): | 1.00th=[ 98], 5.00th=[ 5538], 10.00th=[ 8356], 20.00th=[ 10552], | 30.00th=[ 12387], 40.00th=[ 14746], 50.00th=[ 16909], 60.00th=[ 19006], | 70.00th=[ 22152], 80.00th=[ 26084], 90.00th=[ 32375], 95.00th=[ 38011], | 99.00th=[ 54789], 99.50th=[ 71828], 99.90th=[106431], 99.95th=[117965], | 99.99th=[117965] bw ( KiB/s): min= 63, max= 207, per=25.70%, avg=111.03, stdev=26.26, samples=107 iops : min= 15, max= 51, avg=27.31, stdev= 6.54, samples=107 write: IOPS=28, BW=113KiB/s (116kB/s)(6260KiB/55194msec); 0 zone resets clat (usec): min=869, max=969524, avg=16960.50, stdev=27709.16 lat (usec): min=870, max=969525, avg=16962.17, stdev=27709.07 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 2409], 10.00th=[ 3097], 20.00th=[ 4228], | 30.00th=[ 6521], 40.00th=[ 10028], 50.00th=[ 12911], 60.00th=[ 16581], | 70.00th=[ 20579], 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 59507], 99.50th=[ 70779], 99.90th=[158335], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 13, max= 192, per=25.13%, avg=113.86, stdev=33.18, samples=108 iops : min= 3, max= 48, avg=28.03, stdev= 8.35, samples=108 lat (usec) : 50=0.03%, 100=0.49%, 250=1.66%, 500=0.07%, 1000=0.16% lat (msec) : 2=1.33%, 4=7.88%, 10=17.02%, 20=37.63%, 50=31.74% lat (msec) : 100=1.76%, 250=0.20%, 1000=0.03% cpu : usr=0.16%, sys=26.31%, ctx=8730, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147314: Fri Jul 3 06:26:27 2026 read: IOPS=27, BW=109KiB/s (112kB/s)(6052KiB/55475msec) clat (usec): min=39, max=166008, avg=18469.99, stdev=11305.27 lat (usec): min=39, max=166009, avg=18471.11, stdev=11305.34 clat percentiles (usec): | 1.00th=[ 77], 5.00th=[ 1156], 10.00th=[ 8356], 20.00th=[ 10290], | 30.00th=[ 12125], 40.00th=[ 14091], 50.00th=[ 16581], 60.00th=[ 19006], | 70.00th=[ 21890], 80.00th=[ 25822], 90.00th=[ 31851], 95.00th=[ 38536], | 99.00th=[ 52691], 99.50th=[ 59507], 99.90th=[ 96994], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 24, max= 183, per=25.60%, avg=110.58, stdev=27.40, samples=108 iops : min= 6, max= 45, avg=27.20, stdev= 6.87, samples=108 write: IOPS=28, BW=112KiB/s (115kB/s)(6236KiB/55475msec); 0 zone resets clat (usec): min=735, max=1012.4k, avg=17507.45, stdev=28716.12 lat (usec): min=736, max=1012.4k, avg=17509.47, stdev=28716.15 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 2409], 10.00th=[ 3064], | 20.00th=[ 4293], 30.00th=[ 6915], 40.00th=[ 10945], | 50.00th=[ 14222], 60.00th=[ 17171], 70.00th=[ 21627], | 80.00th=[ 26870], 90.00th=[ 34866], 95.00th=[ 41681], | 99.00th=[ 58459], 99.50th=[ 72877], 99.90th=[ 119014], | 99.95th=[1010828], 99.99th=[1010828] bw ( KiB/s): min= 48, max= 215, per=25.16%, avg=113.97, stdev=33.68, samples=108 iops : min= 12, max= 53, avg=28.06, stdev= 8.42, samples=108 lat (usec) : 50=0.07%, 100=0.94%, 250=1.24%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=1.43%, 4=7.88%, 10=15.98%, 20=37.40%, 50=32.85% lat (msec) : 100=1.79%, 250=0.10%, 2000=0.03% cpu : usr=0.14%, sys=25.92%, ctx=8888, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=433KiB/s (443kB/s), 108KiB/s-109KiB/s (110kB/s-112kB/s), io=23.4MiB (24.6MB), run=55194-55475msec WRITE: bw=453KiB/s (464kB/s), 112KiB/s-115KiB/s (115kB/s-118kB/s), io=24.6MiB (25.7MB), run=55194-55475msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147315: Fri Jul 3 06:26:58 2026 read: IOPS=17, BW=69.7KiB/s (71.4kB/s)(5992KiB/85925msec) clat (msec): min=2, max=976, avg=17.45, stdev=28.31 lat (msec): min=2, max=976, avg=17.45, stdev=28.31 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 43], | 99.00th=[ 69], 99.50th=[ 82], 99.90th=[ 136], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 216, per=25.24%, avg=70.41, stdev=38.16, samples=169 iops : min= 1, max= 54, avg=17.26, stdev= 9.70, samples=169 write: IOPS=18, BW=73.3KiB/s (75.0kB/s)(6296KiB/85925msec); 0 zone resets clat (msec): min=13, max=175, avg=37.87, stdev=18.30 lat (msec): min=13, max=175, avg=37.87, stdev=18.30 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 63], 95.00th=[ 73], | 99.00th=[ 101], 99.50th=[ 113], 99.90th=[ 155], 99.95th=[ 176], | 99.99th=[ 176] bw ( KiB/s): min= 23, max= 168, per=25.30%, avg=73.87, stdev=31.25, samples=169 iops : min= 5, max= 42, avg=18.13, stdev= 8.02, samples=169 lat (msec) : 4=0.62%, 10=16.57%, 20=22.43%, 50=47.95%, 100=11.78% lat (msec) : 250=0.62%, 1000=0.03% cpu : usr=0.11%, sys=9.46%, ctx=6322, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147316: Fri Jul 3 06:26:58 2026 read: IOPS=17, BW=69.3KiB/s (70.9kB/s)(5940KiB/85753msec) clat (msec): min=3, max=951, avg=16.89, stdev=27.63 lat (msec): min=3, max=951, avg=16.90, stdev=27.63 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 23], 90.00th=[ 33], 95.00th=[ 43], | 99.00th=[ 71], 99.50th=[ 78], 99.90th=[ 142], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 184, per=24.86%, avg=69.37, stdev=37.77, samples=169 iops : min= 1, max= 46, avg=17.00, stdev= 9.59, samples=169 write: IOPS=18, BW=74.0KiB/s (75.8kB/s)(6348KiB/85753msec); 0 zone resets clat (msec): min=13, max=157, avg=38.11, stdev=18.56 lat (msec): min=13, max=157, avg=38.12, stdev=18.56 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 44], 80.00th=[ 52], 90.00th=[ 65], 95.00th=[ 75], | 99.00th=[ 105], 99.50th=[ 115], 99.90th=[ 134], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 24, max= 144, per=25.45%, avg=74.31, stdev=31.72, samples=168 iops : min= 6, max= 36, avg=18.24, stdev= 8.12, samples=168 lat (msec) : 4=0.68%, 10=16.80%, 20=22.95%, 50=47.27%, 100=11.56% lat (msec) : 250=0.72%, 1000=0.03% cpu : usr=0.10%, sys=9.54%, ctx=6420, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147317: Fri Jul 3 06:26:58 2026 read: IOPS=17, BW=70.7KiB/s (72.4kB/s)(6028KiB/85269msec) clat (msec): min=3, max=152, avg=16.93, stdev=14.34 lat (msec): min=3, max=152, avg=16.93, stdev=14.34 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 35], 95.00th=[ 46], | 99.00th=[ 74], 99.50th=[ 81], 99.90th=[ 113], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 15, max= 184, per=25.52%, avg=71.21, stdev=36.02, samples=167 iops : min= 3, max= 46, avg=17.46, stdev= 9.18, samples=167 write: IOPS=18, BW=73.4KiB/s (75.2kB/s)(6260KiB/85269msec); 0 zone resets clat (msec): min=14, max=972, avg=38.06, stdev=29.68 lat (msec): min=14, max=972, avg=38.06, stdev=29.68 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 50], 90.00th=[ 62], 95.00th=[ 75], | 99.00th=[ 103], 99.50th=[ 113], 99.90th=[ 176], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 144, per=25.15%, avg=73.45, stdev=32.80, samples=168 iops : min= 1, max= 36, avg=18.02, stdev= 8.38, samples=168 lat (msec) : 4=0.59%, 10=16.60%, 20=23.96%, 50=47.04%, 100=11.17% lat (msec) : 250=0.62%, 1000=0.03% cpu : usr=0.12%, sys=9.54%, ctx=6292, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147318: Fri Jul 3 06:26:58 2026 read: IOPS=17, BW=70.7KiB/s (72.4kB/s)(6052KiB/85641msec) clat (msec): min=3, max=122, avg=17.10, stdev=14.75 lat (msec): min=3, max=122, avg=17.10, stdev=14.75 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 10], 40.00th=[ 11], 50.00th=[ 13], 60.00th=[ 15], | 70.00th=[ 18], 80.00th=[ 24], 90.00th=[ 36], 95.00th=[ 49], | 99.00th=[ 75], 99.50th=[ 86], 99.90th=[ 121], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 7, max= 192, per=25.51%, avg=71.17, stdev=37.95, samples=168 iops : min= 1, max= 48, avg=17.45, stdev= 9.65, samples=168 write: IOPS=18, BW=72.8KiB/s (74.6kB/s)(6236KiB/85641msec); 0 zone resets clat (msec): min=14, max=999, avg=38.22, stdev=30.11 lat (msec): min=14, max=999, avg=38.23, stdev=30.11 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 37], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 63], 95.00th=[ 73], | 99.00th=[ 91], 99.50th=[ 112], 99.90th=[ 176], 99.95th=[ 1003], | 99.99th=[ 1003] bw ( KiB/s): min= 24, max= 144, per=25.09%, avg=73.26, stdev=31.43, samples=168 iops : min= 6, max= 36, avg=17.98, stdev= 8.05, samples=168 lat (msec) : 4=0.85%, 10=17.15%, 20=22.33%, 50=47.27%, 100=11.88% lat (msec) : 250=0.49%, 1000=0.03% cpu : usr=0.11%, sys=9.46%, ctx=6321, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=279KiB/s (286kB/s), 69.3KiB/s-70.7KiB/s (70.9kB/s-72.4kB/s), io=23.4MiB (24.6MB), run=85269-85925msec WRITE: bw=293KiB/s (300kB/s), 72.8KiB/s-74.0KiB/s (74.6kB/s-75.8kB/s), io=24.6MiB (25.7MB), run=85269-85925msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147348: Fri Jul 3 06:27:20 2026 read: IOPS=24, BW=391KiB/s (400kB/s)(5920KiB/15140msec) clat (usec): min=39, max=81993, avg=20510.79, stdev=12223.33 lat (usec): min=40, max=81995, avg=20511.94, stdev=12223.45 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 141], 10.00th=[ 7767], 20.00th=[11863], | 30.00th=[14615], 40.00th=[16909], 50.00th=[18744], 60.00th=[21365], | 70.00th=[23987], 80.00th=[28967], 90.00th=[34866], 95.00th=[42730], | 99.00th=[61080], 99.50th=[66323], 99.90th=[82314], 99.95th=[82314], | 99.99th=[82314] bw ( KiB/s): min= 223, max= 542, per=25.59%, avg=388.45, stdev=89.99, samples=29 iops : min= 13, max= 33, avg=23.69, stdev= 5.63, samples=29 write: IOPS=26, BW=421KiB/s (431kB/s)(6368KiB/15140msec); 0 zone resets clat (usec): min=1228, max=78552, avg=18665.89, stdev=13828.45 lat (usec): min=1229, max=78555, avg=18667.90, stdev=13828.47 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 3392], 10.00th=[ 4490], 20.00th=[ 6521], | 30.00th=[ 9372], 40.00th=[12518], 50.00th=[15533], 60.00th=[18482], | 70.00th=[22676], 80.00th=[29230], 90.00th=[38011], 95.00th=[45876], | 99.00th=[66323], 99.50th=[78119], 99.90th=[78119], 99.95th=[78119], | 99.99th=[78119] bw ( KiB/s): min= 160, max= 640, per=26.41%, avg=422.03, stdev=131.50, samples=29 iops : min= 10, max= 40, avg=25.79, stdev= 8.26, samples=29 lat (usec) : 50=0.13%, 100=0.91%, 250=2.73%, 500=0.13% lat (msec) : 2=0.78%, 4=3.65%, 10=15.36%, 20=35.42%, 50=37.89% lat (msec) : 100=2.99% cpu : usr=0.15%, sys=27.80%, ctx=2511, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147349: Fri Jul 3 06:27:20 2026 read: IOPS=23, BW=371KiB/s (380kB/s)(5744KiB/15496msec) clat (usec): min=59, max=116086, avg=21076.27, stdev=12967.71 lat (usec): min=61, max=116087, avg=21077.40, stdev=12967.74 clat percentiles (usec): | 1.00th=[ 73], 5.00th=[ 155], 10.00th=[ 9765], 20.00th=[ 12649], | 30.00th=[ 14353], 40.00th=[ 16909], 50.00th=[ 19006], 60.00th=[ 22414], | 70.00th=[ 24773], 80.00th=[ 28181], 90.00th=[ 35390], 95.00th=[ 40109], | 99.00th=[ 65274], 99.50th=[100140], 99.90th=[115868], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 208, max= 571, per=24.40%, avg=370.33, stdev=88.75, samples=30 iops : min= 13, max= 35, avg=22.57, stdev= 5.54, samples=30 write: IOPS=26, BW=422KiB/s (432kB/s)(6544KiB/15496msec); 0 zone resets clat (usec): min=1338, max=75646, avg=19309.21, stdev=14751.75 lat (usec): min=1339, max=75648, avg=19311.88, stdev=14751.06 clat percentiles (usec): | 1.00th=[ 1893], 5.00th=[ 2999], 10.00th=[ 3916], 20.00th=[ 6128], | 30.00th=[ 9503], 40.00th=[12518], 50.00th=[15926], 60.00th=[19006], | 70.00th=[23200], 80.00th=[30802], 90.00th=[40633], 95.00th=[48497], | 99.00th=[66847], 99.50th=[70779], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 191, max= 574, per=25.90%, avg=413.87, stdev=125.58, samples=30 iops : min= 11, max= 35, avg=25.27, stdev= 7.83, samples=30 lat (usec) : 100=1.04%, 250=1.69%, 500=0.13%, 750=0.13%, 1000=0.13% lat (msec) : 2=0.78%, 4=4.82%, 10=13.15%, 20=36.46%, 50=38.41% lat (msec) : 100=2.99%, 250=0.26% cpu : usr=0.21%, sys=26.96%, ctx=2450, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147350: Fri Jul 3 06:27:20 2026 read: IOPS=24, BW=397KiB/s (406kB/s)(6256KiB/15769msec) clat (usec): min=55, max=109447, avg=21464.06, stdev=14447.32 lat (usec): min=56, max=109449, avg=21465.26, stdev=14447.47 clat percentiles (usec): | 1.00th=[ 72], 5.00th=[ 135], 10.00th=[ 529], 20.00th=[ 11338], | 30.00th=[ 13960], 40.00th=[ 16712], 50.00th=[ 20055], 60.00th=[ 22676], | 70.00th=[ 25822], 80.00th=[ 30802], 90.00th=[ 39584], 95.00th=[ 44827], | 99.00th=[ 68682], 99.50th=[ 93848], 99.90th=[109577], 99.95th=[109577], | 99.99th=[109577] bw ( KiB/s): min= 158, max= 640, per=25.99%, avg=394.48, stdev=119.09, samples=31 iops : min= 9, max= 40, avg=24.06, stdev= 7.52, samples=31 write: IOPS=23, BW=383KiB/s (392kB/s)(6032KiB/15769msec); 0 zone resets clat (usec): min=1452, max=98239, avg=19310.67, stdev=15885.83 lat (usec): min=1452, max=98240, avg=19312.82, stdev=15885.86 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 3195], 10.00th=[ 4424], 20.00th=[ 6194], | 30.00th=[ 9372], 40.00th=[11731], 50.00th=[15008], 60.00th=[18220], | 70.00th=[23725], 80.00th=[29230], 90.00th=[41681], 95.00th=[51643], | 99.00th=[76022], 99.50th=[89654], 99.90th=[98042], 99.95th=[98042], | 99.99th=[98042] bw ( KiB/s): min= 159, max= 640, per=23.43%, avg=374.39, stdev=127.56, samples=31 iops : min= 9, max= 40, avg=22.84, stdev= 8.03, samples=31 lat (usec) : 100=1.17%, 250=3.39%, 500=0.52%, 750=0.13%, 1000=0.13% lat (msec) : 2=1.04%, 4=2.86%, 10=15.23%, 20=32.03%, 50=39.06% lat (msec) : 100=4.30%, 250=0.13% cpu : usr=0.11%, sys=25.74%, ctx=2447, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147351: Fri Jul 3 06:27:20 2026 read: IOPS=25, BW=403KiB/s (412kB/s)(6032KiB/14977msec) clat (usec): min=36, max=120734, avg=19950.20, stdev=13198.68 lat (usec): min=37, max=120735, avg=19951.25, stdev=13198.74 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 118], 10.00th=[ 196], 20.00th=[ 10945], | 30.00th=[ 13960], 40.00th=[ 16057], 50.00th=[ 18744], 60.00th=[ 20841], | 70.00th=[ 24249], 80.00th=[ 27919], 90.00th=[ 35390], 95.00th=[ 43779], | 99.00th=[ 62129], 99.50th=[ 67634], 99.90th=[121111], 99.95th=[121111], | 99.99th=[121111] bw ( KiB/s): min= 95, max= 670, per=26.64%, avg=404.34, stdev=141.02, samples=29 iops : min= 5, max= 41, avg=24.69, stdev= 8.79, samples=29 write: IOPS=26, BW=418KiB/s (428kB/s)(6256KiB/14977msec); 0 zone resets clat (usec): min=1342, max=122973, avg=18842.42, stdev=16219.16 lat (usec): min=1344, max=122975, avg=18844.64, stdev=16218.91 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 3523], 10.00th=[ 4359], 20.00th=[ 5997], | 30.00th=[ 8586], 40.00th=[ 10945], 50.00th=[ 14091], 60.00th=[ 18220], | 70.00th=[ 22676], 80.00th=[ 28443], 90.00th=[ 37487], 95.00th=[ 52691], | 99.00th=[ 83362], 99.50th=[ 88605], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 224, max= 670, per=26.28%, avg=419.90, stdev=109.61, samples=29 iops : min= 14, max= 41, avg=25.66, stdev= 6.91, samples=29 lat (usec) : 50=0.26%, 100=1.56%, 250=3.52%, 500=0.26% lat (msec) : 2=0.65%, 4=2.99%, 10=16.54%, 20=33.07%, 50=36.98% lat (msec) : 100=3.91%, 250=0.26% cpu : usr=0.20%, sys=27.46%, ctx=2376, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1519KiB/s (1555kB/s), 371KiB/s-403KiB/s (380kB/s-412kB/s), io=23.4MiB (24.5MB), run=14977-15769msec WRITE: bw=1598KiB/s (1636kB/s), 383KiB/s-422KiB/s (392kB/s-432kB/s), io=24.6MiB (25.8MB), run=14977-15769msec fio: pid=147346, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=147343: Fri Jul 3 06:27:26 2026 read: IOPS=16, BW=269KiB/s (276kB/s)(5920KiB/21994msec) clat (msec): min=3, max=118, avg=16.49, stdev=16.65 lat (msec): min=3, max=118, avg=16.50, stdev=16.65 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 19], 80.00th=[ 25], 90.00th=[ 36], 95.00th=[ 52], | 99.00th=[ 77], 99.50th=[ 101], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 63, max= 672, per=25.65%, avg=260.05, stdev=156.20, samples=43 iops : min= 3, max= 42, avg=15.91, stdev= 9.87, samples=43 write: IOPS=18, BW=290KiB/s (296kB/s)(6368KiB/21994msec); 0 zone resets clat (msec): min=15, max=162, avg=39.83, stdev=22.73 lat (msec): min=15, max=162, avg=39.83, stdev=22.73 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 56], 90.00th=[ 72], 95.00th=[ 85], | 99.00th=[ 118], 99.50th=[ 142], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 96, max= 640, per=26.47%, avg=285.05, stdev=159.69, samples=43 iops : min= 6, max= 40, avg=17.47, stdev=10.17, samples=43 lat (msec) : 4=1.30%, 10=24.09%, 20=15.89%, 50=42.06%, 100=15.23% lat (msec) : 250=1.43% cpu : usr=0.10%, sys=9.49%, ctx=1604, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147344: Fri Jul 3 06:27:26 2026 read: IOPS=16, BW=260KiB/s (266kB/s)(5744KiB/22087msec) clat (msec): min=3, max=156, avg=16.95, stdev=18.79 lat (msec): min=3, max=156, avg=16.95, stdev=18.79 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 13], | 70.00th=[ 17], 80.00th=[ 23], 90.00th=[ 44], 95.00th=[ 56], | 99.00th=[ 88], 99.50th=[ 108], 99.90th=[ 157], 99.95th=[ 157], | 99.99th=[ 157] bw ( KiB/s): min= 32, max= 640, per=25.19%, avg=255.40, stdev=163.32, samples=43 iops : min= 2, max= 40, avg=15.60, stdev=10.41, samples=43 write: IOPS=18, BW=296KiB/s (303kB/s)(6544KiB/22087msec); 0 zone resets clat (msec): min=14, max=162, avg=39.01, stdev=22.36 lat (msec): min=14, max=162, avg=39.02, stdev=22.36 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 46], 80.00th=[ 54], 90.00th=[ 69], 95.00th=[ 87], | 99.00th=[ 122], 99.50th=[ 127], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 127, max= 672, per=26.75%, avg=288.07, stdev=153.22, samples=43 iops : min= 7, max= 42, avg=17.65, stdev= 9.72, samples=43 lat (msec) : 4=0.52%, 10=23.70%, 20=19.14%, 50=41.02%, 100=14.06% lat (msec) : 250=1.56% cpu : usr=0.11%, sys=9.52%, ctx=1631, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147345: Fri Jul 3 06:27:26 2026 read: IOPS=17, BW=287KiB/s (294kB/s)(6256KiB/21814msec) clat (msec): min=3, max=105, avg=17.05, stdev=17.51 lat (msec): min=3, max=105, avg=17.05, stdev=17.51 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 9], 60.00th=[ 14], | 70.00th=[ 18], 80.00th=[ 26], 90.00th=[ 40], 95.00th=[ 58], | 99.00th=[ 87], 99.50th=[ 93], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 64, max= 864, per=28.47%, avg=288.65, stdev=202.46, samples=43 iops : min= 4, max= 54, avg=17.70, stdev=12.81, samples=43 write: IOPS=17, BW=277KiB/s (283kB/s)(6032KiB/21814msec); 0 zone resets clat (msec): min=15, max=150, avg=40.11, stdev=22.87 lat (msec): min=15, max=150, avg=40.11, stdev=22.87 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 23], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 46], 80.00th=[ 57], 90.00th=[ 73], 95.00th=[ 89], | 99.00th=[ 122], 99.50th=[ 136], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 63, max= 608, per=25.46%, avg=274.23, stdev=150.92, samples=43 iops : min= 3, max= 38, avg=16.79, stdev= 9.61, samples=43 lat (msec) : 4=0.52%, 10=26.43%, 20=15.36%, 50=41.54%, 100=14.84% lat (msec) : 250=1.30% cpu : usr=0.09%, sys=9.68%, ctx=1606, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=147346: Fri Jul 3 06:27:26 2026 read: IOPS=14, BW=230KiB/s (236kB/s)(4480KiB/19464msec) clat (msec): min=4, max=119, avg=21.67, stdev=20.25 lat (msec): min=4, max=119, avg=21.67, stdev=20.25 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 8], | 30.00th=[ 9], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 51], 95.00th=[ 64], | 99.00th=[ 99], 99.50th=[ 110], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 32, max= 640, per=22.17%, avg=224.84, stdev=111.74, samples=38 iops : min= 2, max= 40, avg=13.66, stdev= 7.10, samples=38 write: IOPS=15, BW=249KiB/s (255kB/s)(4848KiB/19464msec); 0 zone resets clat (msec): min=17, max=127, avg=44.02, stdev=21.59 lat (msec): min=17, max=127, avg=44.03, stdev=21.59 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 21], 10.00th=[ 22], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 34], 50.00th=[ 39], 60.00th=[ 46], | 70.00th=[ 53], 80.00th=[ 59], 90.00th=[ 75], 95.00th=[ 89], | 99.00th=[ 106], 99.50th=[ 123], 99.90th=[ 128], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 63, max= 606, per=22.81%, avg=245.63, stdev=137.59, samples=38 iops : min= 3, max= 37, avg=14.95, stdev= 8.70, samples=38 lat (msec) : 10=16.10%, 20=18.49%, 50=42.98%, 100=20.55%, 250=1.71% cpu : usr=0.09%, sys=9.66%, ctx=1277, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=281,303,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1014KiB/s (1039kB/s), 230KiB/s-287KiB/s (236kB/s-294kB/s), io=21.9MiB (22.9MB), run=19464-22087msec WRITE: bw=1077KiB/s (1103kB/s), 249KiB/s-296KiB/s (255kB/s-303kB/s), io=23.2MiB (24.4MB), run=19464-22087msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147364: Fri Jul 3 06:27:36 2026 read: IOPS=2, BW=2163KiB/s (2215kB/s)(7168KiB/3314msec) clat (usec): min=965, max=316716, avg=184265.79, stdev=108166.37 lat (usec): min=966, max=316718, avg=184267.53, stdev=108166.35 clat percentiles (usec): | 1.00th=[ 963], 5.00th=[ 963], 10.00th=[ 963], 20.00th=[135267], | 30.00th=[147850], 40.00th=[147850], 50.00th=[160433], 60.00th=[233833], | 70.00th=[233833], 80.00th=[295699], 90.00th=[316670], 95.00th=[316670], | 99.00th=[316670], 99.50th=[316670], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 1868, max= 4087, per=55.09%, avg=2929.50, stdev=1184.14, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1545KiB/s (1582kB/s)(5120KiB/3314msec); 0 zone resets clat (msec): min=254, max=456, avg=373.89, stdev=82.11 lat (msec): min=254, max=456, avg=373.98, stdev=82.11 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 338], 40.00th=[ 338], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 456], 95.00th=[ 456], | 99.00th=[ 456], 99.50th=[ 456], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 1950, max= 2048, per=27.15%, avg=2021.00, stdev=47.39, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 1000=8.33% lat (msec) : 250=33.33%, 500=58.33% cpu : usr=0.00%, sys=44.85%, ctx=918, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147365: Fri Jul 3 06:27:36 2026 read: IOPS=0, BW=532KiB/s (545kB/s)(2048KiB/3851msec) clat (msec): min=131, max=393, avg=262.58, stdev=185.31 lat (msec): min=131, max=393, avg=262.58, stdev=185.31 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 132], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 132], 60.00th=[ 393], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 393], 95.00th=[ 393], | 99.00th=[ 393], 99.50th=[ 393], 99.90th=[ 393], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 1845, max= 1950, per=35.68%, avg=1897.50, stdev=74.25, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2659KiB/s (2723kB/s)(10.0MiB/3851msec); 0 zone resets clat (msec): min=74, max=1303, avg=330.98, stdev=361.65 lat (msec): min=74, max=1303, avg=331.08, stdev=361.63 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 146], | 30.00th=[ 148], 40.00th=[ 155], 50.00th=[ 192], 60.00th=[ 205], | 70.00th=[ 271], 80.00th=[ 321], 90.00th=[ 498], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 1845, max= 6131, per=42.66%, avg=3176.00, stdev=1834.76, samples=5 iops : min= 1, max= 5, avg= 2.40, stdev= 1.67, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=33.33%, 2000=8.33% cpu : usr=0.03%, sys=38.94%, ctx=398, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147366: Fri Jul 3 06:27:36 2026 read: IOPS=1, BW=1801KiB/s (1844kB/s)(6144KiB/3412msec) clat (usec): min=635, max=618718, avg=236524.24, stdev=216943.47 lat (usec): min=636, max=618719, avg=236525.41, stdev=216943.67 clat percentiles (usec): | 1.00th=[ 635], 5.00th=[ 635], 10.00th=[ 635], 20.00th=[109577], | 30.00th=[109577], 40.00th=[139461], 50.00th=[139461], 60.00th=[223347], | 70.00th=[325059], 80.00th=[325059], 90.00th=[616563], 95.00th=[616563], | 99.00th=[616563], 99.50th=[616563], 99.90th=[616563], 99.95th=[616563], | 99.99th=[616563] bw ( KiB/s): min= 1906, max= 2048, per=37.36%, avg=1986.75, stdev=70.21, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1801KiB/s (1844kB/s)(6144KiB/3412msec); 0 zone resets clat (msec): min=112, max=865, avg=322.96, stdev=272.99 lat (msec): min=112, max=866, avg=323.03, stdev=273.01 clat percentiles (msec): | 1.00th=[ 113], 5.00th=[ 113], 10.00th=[ 113], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 224], 50.00th=[ 224], 60.00th=[ 255], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1906, max= 3670, per=34.11%, avg=2539.67, stdev=981.29, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=37.88%, ctx=253, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147367: Fri Jul 3 06:27:36 2026 read: IOPS=1, BW=1576KiB/s (1614kB/s)(5120KiB/3249msec) clat (usec): min=506, max=234053, avg=79296.21, stdev=110880.52 lat (usec): min=507, max=234054, avg=79297.28, stdev=110880.67 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 586], 40.00th=[ 586], 50.00th=[ 603], 60.00th=[ 603], | 70.00th=[160433], 80.00th=[160433], 90.00th=[233833], 95.00th=[233833], | 99.00th=[233833], 99.50th=[233833], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 2043, max= 6144, per=76.97%, avg=4093.50, stdev=2899.84, samples=2 iops : min= 1, max= 6, avg= 3.50, stdev= 3.54, samples=2 write: IOPS=2, BW=2206KiB/s (2259kB/s)(7168KiB/3249msec); 0 zone resets clat (msec): min=185, max=906, avg=392.28, stdev=252.15 lat (msec): min=185, max=906, avg=392.51, stdev=252.09 clat percentiles (msec): | 1.00th=[ 186], 5.00th=[ 186], 10.00th=[ 186], 20.00th=[ 188], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 313], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 489], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 1825, max= 3813, per=31.37%, avg=2335.80, stdev=830.73, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 750=25.00% lat (msec) : 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.03%, sys=38.49%, ctx=331, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5318KiB/s (5446kB/s), 532KiB/s-2163KiB/s (545kB/s-2215kB/s), io=20.0MiB (20.0MB), run=3249-3851msec WRITE: bw=7445KiB/s (7624kB/s), 1545KiB/s-2659KiB/s (1582kB/s-2723kB/s), io=28.0MiB (29.4MB), run=3249-3851msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147368: Fri Jul 3 06:27:36 2026 read: IOPS=2, BW=2365KiB/s (2422kB/s)(7168KiB/3031msec) clat (msec): min=65, max=640, avg=217.58, stdev=226.53 lat (msec): min=65, max=640, avg=217.58, stdev=226.53 clat percentiles (msec): | 1.00th=[ 66], 5.00th=[ 66], 10.00th=[ 66], 20.00th=[ 74], | 30.00th=[ 81], 40.00th=[ 81], 50.00th=[ 90], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 430], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2043, max= 6131, per=77.00%, avg=3950.00, stdev=2057.73, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1689KiB/s (1730kB/s)(5120KiB/3031msec); 0 zone resets clat (msec): min=69, max=625, avg=296.19, stdev=278.54 lat (msec): min=69, max=625, avg=296.29, stdev=278.54 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 88], 40.00th=[ 88], 50.00th=[ 125], 60.00th=[ 125], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1961, max= 4087, per=35.29%, avg=2534.75, stdev=1035.60, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 100=50.00%, 250=16.67%, 500=8.33%, 750=25.00% cpu : usr=0.00%, sys=13.20%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147369: Fri Jul 3 06:27:36 2026 read: IOPS=0, BW=517KiB/s (529kB/s)(2048KiB/3965msec) clat (msec): min=136, max=380, avg=258.62, stdev=172.84 lat (msec): min=136, max=380, avg=258.63, stdev=172.84 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1868, max= 2043, per=38.12%, avg=1955.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2583KiB/s (2645kB/s)(10.0MiB/3965msec); 0 zone resets clat (msec): min=68, max=1272, avg=331.08, stdev=358.44 lat (msec): min=69, max=1272, avg=331.17, stdev=358.44 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 97], | 30.00th=[ 122], 40.00th=[ 146], 50.00th=[ 174], 60.00th=[ 190], | 70.00th=[ 388], 80.00th=[ 401], 90.00th=[ 456], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 1950, max= 3923, per=33.42%, avg=2400.40, stdev=852.11, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=33.33%, 2000=8.33% cpu : usr=0.08%, sys=15.11%, ctx=147, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147370: Fri Jul 3 06:27:36 2026 read: IOPS=1, BW=1608KiB/s (1646kB/s)(6144KiB/3822msec) clat (msec): min=41, max=336, avg=160.39, stdev=133.59 lat (msec): min=41, max=336, avg=160.39, stdev=133.59 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 52], | 30.00th=[ 52], 40.00th=[ 79], 50.00th=[ 79], 60.00th=[ 138], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 3900, max= 6131, per=97.77%, avg=5015.50, stdev=1577.56, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1608KiB/s (1646kB/s)(6144KiB/3822msec); 0 zone resets clat (msec): min=91, max=1212, avg=460.69, stdev=405.50 lat (msec): min=91, max=1212, avg=460.78, stdev=405.50 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 178], | 30.00th=[ 178], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 384], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 1950, max= 2048, per=27.97%, avg=2009.00, stdev=49.04, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 50=8.33%, 100=25.00%, 250=16.67%, 500=33.33%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=11.88%, ctx=140, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147371: Fri Jul 3 06:27:36 2026 read: IOPS=1, BW=1283KiB/s (1313kB/s)(5120KiB/3992msec) clat (msec): min=23, max=493, avg=247.18, stdev=205.22 lat (msec): min=23, max=493, avg=247.18, stdev=205.22 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 24], 10.00th=[ 24], 20.00th=[ 24], | 30.00th=[ 54], 40.00th=[ 54], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 3900, max= 4087, per=77.85%, avg=3993.50, stdev=132.23, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1796KiB/s (1839kB/s)(7168KiB/3992msec); 0 zone resets clat (msec): min=85, max=930, avg=374.18, stdev=300.43 lat (msec): min=85, max=930, avg=374.26, stdev=300.43 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 94], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 288], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 514], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 2043, max= 4096, per=37.97%, avg=2727.33, stdev=1185.30, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 50=8.33%, 100=25.00%, 250=8.33%, 500=41.67%, 750=8.33% lat (msec) : 1000=8.33% cpu : usr=0.08%, sys=11.30%, ctx=243, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5130KiB/s (5253kB/s), 517KiB/s-2365KiB/s (529kB/s-2422kB/s), io=20.0MiB (20.0MB), run=3031-3992msec WRITE: bw=7182KiB/s (7355kB/s), 1608KiB/s-2583KiB/s (1646kB/s-2645kB/s), io=28.0MiB (29.4MB), run=3031-3992msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147377: Fri Jul 3 06:27:44 2026 read: IOPS=2, BW=10.7MiB/s (11.2MB/s)(12.0MiB/1121msec) clat (msec): min=152, max=493, avg=352.90, stdev=178.37 lat (msec): min=152, max=493, avg=352.90, stdev=178.37 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 414], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7353, max= 8192, per=90.38%, avg=7772.50, stdev=593.26, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=66.67% cpu : usr=0.00%, sys=18.84%, ctx=284, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147378: Fri Jul 3 06:27:44 2026 read: IOPS=0, BW=2150KiB/s (2202kB/s)(4096KiB/1905msec) clat (nsec): min=570855k, max=570855k, avg=570854941.00, stdev= 0.00 lat (nsec): min=570857k, max=570857k, avg=570857134.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 8192, max= 8192, per=95.26%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=1, BW=4300KiB/s (4403kB/s)(8192KiB/1905msec); 0 zone resets clat (msec): min=247, max=1013, avg=630.54, stdev=542.22 lat (msec): min=247, max=1014, avg=630.83, stdev=542.20 clat percentiles (msec): | 1.00th=[ 247], 5.00th=[ 247], 10.00th=[ 247], 20.00th=[ 247], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 1011], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=19.75%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147379: Fri Jul 3 06:27:44 2026 write: IOPS=1, BW=6715KiB/s (6876kB/s)(12.0MiB/1830msec); 0 zone resets clat (msec): min=158, max=895, avg=576.76, stdev=378.14 lat (msec): min=159, max=895, avg=577.04, stdev=378.18 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8192, max= 8192, per=47.63%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=16.57%, ctx=63, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147380: Fri Jul 3 06:27:44 2026 write: IOPS=2, BW=8563KiB/s (8769kB/s)(12.0MiB/1435msec); 0 zone resets clat (msec): min=120, max=919, avg=464.80, stdev=411.18 lat (msec): min=120, max=920, avg=465.14, stdev=411.13 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 121], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min=14787, max=14787, per=85.97%, avg=14787.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 500=33.33%, 1000=33.33% cpu : usr=0.07%, sys=18.13%, ctx=85, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=8601KiB/s (8807kB/s), 2150KiB/s-10.7MiB/s (2202kB/s-11.2MB/s), io=16.0MiB (16.8MB), run=1121-1905msec WRITE: bw=16.8MiB/s (17.6MB/s), 4300KiB/s-8563KiB/s (4403kB/s-8769kB/s), io=32.0MiB (33.6MB), run=1435-1905msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147382: Fri Jul 3 06:27:44 2026 read: IOPS=2, BW=8457KiB/s (8660kB/s)(12.0MiB/1453msec) clat (msec): min=399, max=540, avg=468.53, stdev=70.48 lat (msec): min=399, max=540, avg=468.53, stdev=70.48 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 468], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7641, max= 8192, per=70.21%, avg=7916.50, stdev=389.62, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=52.62%, ctx=2160, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147383: Fri Jul 3 06:27:44 2026 read: IOPS=0, BW=3269KiB/s (3347kB/s)(4096KiB/1253msec) clat (nsec): min=441070k, max=441070k, avg=441069794.00, stdev= 0.00 lat (nsec): min=441072k, max=441072k, avg=441071991.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 443], 5.00th=[ 443], 10.00th=[ 443], 20.00th=[ 443], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7474, max= 7474, per=66.29%, avg=7474.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=1, BW=6538KiB/s (6695kB/s)(8192KiB/1253msec); 0 zone resets clat (msec): min=380, max=413, avg=396.93, stdev=22.99 lat (msec): min=380, max=413, avg=397.13, stdev=23.06 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 8192, max= 8192, per=46.43%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=100.00% cpu : usr=0.00%, sys=25.88%, ctx=602, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147384: Fri Jul 3 06:27:44 2026 write: IOPS=1, BW=6617KiB/s (6776kB/s)(12.0MiB/1857msec); 0 zone resets clat (msec): min=168, max=1084, avg=612.28, stdev=458.76 lat (msec): min=168, max=1084, avg=612.63, stdev=458.86 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 584], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8192, max= 8192, per=46.43%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.05%, sys=12.72%, ctx=46, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147385: Fri Jul 3 06:27:44 2026 write: IOPS=2, BW=8393KiB/s (8595kB/s)(12.0MiB/1464msec); 0 zone resets clat (msec): min=387, max=617, avg=476.59, stdev=123.02 lat (msec): min=388, max=617, avg=476.88, stdev=122.99 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 7557, max= 8192, per=44.63%, avg=7874.50, stdev=449.01, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=22.28%, ctx=76, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=11.0MiB/s (11.5MB/s), 3269KiB/s-8457KiB/s (3347kB/s-8660kB/s), io=16.0MiB (16.8MB), run=1253-1453msec WRITE: bw=17.2MiB/s (18.1MB/s), 6538KiB/s-8393KiB/s (6695kB/s-8595kB/s), io=32.0MiB (33.6MB), run=1253-1857msec