== sanity test 398b: DIO and buffer IO race ============== 15:26:24 (1788290784) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.8124 s, 7.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178952: Tue Sep 1 15:28:44 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(5992KiB/120376msec) clat (usec): min=42, max=245984, avg=42833.84, stdev=27957.26 lat (usec): min=43, max=245985, avg=42837.20, stdev=27956.37 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9372], 10.00th=[ 16188], 20.00th=[ 21627], | 30.00th=[ 26346], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[160433], 99.90th=[200279], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 7, max= 111, per=24.86%, avg=49.47, stdev=20.38, samples=236 iops : min= 1, max= 27, avg=11.74, stdev= 5.12, samples=236 write: IOPS=13, BW=52.3KiB/s (53.6kB/s)(6296KiB/120376msec); 0 zone resets clat (usec): min=877, max=965951, avg=35391.24, stdev=43411.74 lat (usec): min=878, max=965953, avg=35394.12, stdev=43410.67 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1827], 20.00th=[ 3818], | 30.00th=[ 7177], 40.00th=[ 16712], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[160433], 99.50th=[191890], 99.90th=[333448], 99.95th=[968885], | 99.99th=[968885] bw ( KiB/s): min= 7, max= 158, per=25.04%, avg=52.08, stdev=22.41, samples=236 iops : min= 1, max= 39, avg=12.39, stdev= 5.67, samples=236 lat (usec) : 50=0.13%, 100=1.53%, 250=0.23%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=5.37%, 4=5.37%, 10=7.00%, 20=10.45%, 50=41.15% lat (msec) : 100=23.80%, 250=4.65%, 500=0.07%, 1000=0.03% cpu : usr=0.07%, sys=4.79%, ctx=6613, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178953: Tue Sep 1 15:28:44 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5940KiB/119468msec) clat (usec): min=36, max=206173, avg=43902.72, stdev=28065.05 lat (usec): min=36, max=206174, avg=43906.64, stdev=28065.11 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 11863], 10.00th=[ 16909], 20.00th=[ 22414], | 30.00th=[ 27395], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 51643], 80.00th=[ 61080], 90.00th=[ 81265], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[158335], 99.90th=[191890], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 7, max= 104, per=25.02%, avg=49.79, stdev=19.81, samples=233 iops : min= 1, max= 26, avg=11.82, stdev= 5.02, samples=233 write: IOPS=13, BW=53.1KiB/s (54.4kB/s)(6348KiB/119468msec); 0 zone resets clat (usec): min=905, max=1016.7k, avg=33927.24, stdev=42334.76 lat (usec): min=906, max=1016.7k, avg=33931.51, stdev=42333.21 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1582], | 20.00th=[ 3490], 30.00th=[ 6718], 40.00th=[ 14877], | 50.00th=[ 22676], 60.00th=[ 31851], 70.00th=[ 43779], | 80.00th=[ 60556], 90.00th=[ 82314], 95.00th=[ 102237], | 99.00th=[ 141558], 99.50th=[ 173016], 99.90th=[ 263193], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 7, max= 143, per=25.33%, avg=52.69, stdev=22.88, samples=235 iops : min= 1, max= 35, avg=12.54, stdev= 5.76, samples=235 lat (usec) : 50=0.39%, 100=1.27%, 250=0.16%, 500=0.07%, 1000=0.16% lat (msec) : 2=6.18%, 4=5.08%, 10=7.06%, 20=10.61%, 50=40.14% lat (msec) : 100=23.89%, 250=4.92%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=4.92%, ctx=6546, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178954: Tue Sep 1 15:28:44 2026 read: IOPS=12, BW=50.0KiB/s (52.2kB/s)(6028KiB/118222msec) clat (usec): min=38, max=1049.9k, avg=43521.46, stdev=38538.40 lat (usec): min=39, max=1049.0k, avg=43523.38, stdev=38538.19 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 9372], 10.00th=[ 15664], | 20.00th=[ 21627], 30.00th=[ 26608], 40.00th=[ 31851], | 50.00th=[ 36963], 60.00th=[ 42730], 70.00th=[ 50594], | 80.00th=[ 61080], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[ 135267], 99.50th=[ 168821], 99.90th=[ 308282], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 120, per=25.50%, avg=50.74, stdev=20.69, samples=233 iops : min= 1, max= 30, avg=12.05, stdev= 5.22, samples=233 write: IOPS=13, BW=52.0KiB/s (54.2kB/s)(6260KiB/118222msec); 0 zone resets clat (usec): min=938, max=271214, avg=33336.14, stdev=35803.50 lat (usec): min=939, max=271216, avg=33341.81, stdev=35803.06 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1205], 10.00th=[ 1582], 20.00th=[ 3163], | 30.00th=[ 6194], 40.00th=[ 13829], 50.00th=[ 22938], 60.00th=[ 31589], | 70.00th=[ 42730], 80.00th=[ 58459], 90.00th=[ 82314], 95.00th=[100140], | 99.00th=[154141], 99.50th=[189793], 99.90th=[244319], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 7, max= 144, per=25.42%, avg=52.87, stdev=22.48, samples=232 iops : min= 1, max= 36, avg=12.59, stdev= 5.69, samples=232 lat (usec) : 50=0.23%, 100=1.46%, 250=0.16%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.61%, 4=5.27%, 10=7.03%, 20=10.81%, 50=40.30% lat (msec) : 100=23.05%, 250=4.69%, 500=0.07%, 2000=0.03% cpu : usr=0.08%, sys=4.89%, ctx=6535, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178955: Tue Sep 1 15:28:44 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6052KiB/119859msec) clat (usec): min=35, max=1053.1k, avg=43816.46, stdev=38705.91 lat (usec): min=36, max=1053.1k, avg=43819.63, stdev=38705.32 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 5735], 10.00th=[ 15926], | 20.00th=[ 21365], 30.00th=[ 26084], 40.00th=[ 31851], | 50.00th=[ 37487], 60.00th=[ 43779], 70.00th=[ 51119], | 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 94897], | 99.00th=[ 143655], 99.50th=[ 160433], 99.90th=[ 312476], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 103, per=25.15%, avg=50.05, stdev=17.73, samples=235 iops : min= 1, max= 25, avg=11.88, stdev= 4.45, samples=235 write: IOPS=13, BW=52.0KiB/s (53.3kB/s)(6236KiB/119859msec); 0 zone resets clat (usec): min=938, max=365240, avg=34095.13, stdev=36876.28 lat (usec): min=939, max=365241, avg=34105.97, stdev=36869.87 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1254], 10.00th=[ 1860], 20.00th=[ 3752], | 30.00th=[ 6718], 40.00th=[ 13960], 50.00th=[ 23200], 60.00th=[ 32113], | 70.00th=[ 44303], 80.00th=[ 58983], 90.00th=[ 81265], 95.00th=[106431], | 99.00th=[164627], 99.50th=[187696], 99.90th=[229639], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 151, per=24.81%, avg=51.61, stdev=21.95, samples=235 iops : min= 1, max= 37, avg=12.28, stdev= 5.51, samples=235 lat (usec) : 50=0.39%, 100=1.40%, 250=0.42%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=5.66%, 4=4.92%, 10=7.71%, 20=10.77%, 50=40.10% lat (msec) : 100=23.24%, 250=4.98%, 500=0.07%, 2000=0.03% cpu : usr=0.06%, sys=4.88%, ctx=6591, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=199KiB/s (204kB/s), 49.7KiB/s-50.0KiB/s (50.9kB/s-52.2kB/s), io=23.4MiB (24.6MB), run=118222-120376msec WRITE: bw=209KiB/s (214kB/s), 52.0KiB/s-53.1KiB/s (53.3kB/s-54.4kB/s), io=24.6MiB (25.7MB), run=118222-120376msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178956: Tue Sep 1 15:29:20 2026 read: IOPS=9, BW=38.2KiB/s (39.1kB/s)(5992KiB/156838msec) clat (msec): min=5, max=1234, avg=41.35, stdev=49.76 lat (msec): min=5, max=1234, avg=41.35, stdev=49.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 61], 90.00th=[ 93], 95.00th=[ 123], | 99.00th=[ 203], 99.50th=[ 220], 99.90th=[ 305], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 150, per=25.23%, avg=38.59, stdev=27.90, samples=301 iops : min= 1, max= 37, avg= 9.00, stdev= 7.02, samples=301 write: IOPS=10, BW=40.1KiB/s (41.1kB/s)(6296KiB/156838msec); 0 zone resets clat (msec): min=11, max=435, avg=60.01, stdev=44.80 lat (msec): min=11, max=435, avg=60.02, stdev=44.80 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 55], | 70.00th=[ 71], 80.00th=[ 88], 90.00th=[ 115], 95.00th=[ 150], | 99.00th=[ 226], 99.50th=[ 268], 99.90th=[ 342], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 7, max= 119, per=25.16%, avg=40.26, stdev=25.40, samples=304 iops : min= 1, max= 29, avg= 9.41, stdev= 6.39, samples=304 lat (msec) : 10=3.42%, 20=17.09%, 50=44.76%, 100=23.63%, 250=10.64% lat (msec) : 500=0.42%, 2000=0.03% cpu : usr=0.05%, sys=1.62%, ctx=4776, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178957: Tue Sep 1 15:29:20 2026 read: IOPS=9, BW=38.1KiB/s (39.1kB/s)(5940KiB/155736msec) clat (msec): min=5, max=1096, avg=40.81, stdev=47.25 lat (msec): min=5, max=1096, avg=40.81, stdev=47.25 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 56], 90.00th=[ 90], 95.00th=[ 123], | 99.00th=[ 192], 99.50th=[ 234], 99.90th=[ 313], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 183, per=25.21%, avg=38.57, stdev=26.34, samples=300 iops : min= 1, max= 45, avg= 8.99, stdev= 6.62, samples=300 write: IOPS=10, BW=40.8KiB/s (41.7kB/s)(6348KiB/155736msec); 0 zone resets clat (msec): min=9, max=374, avg=59.71, stdev=42.39 lat (msec): min=9, max=374, avg=59.72, stdev=42.39 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 55], | 70.00th=[ 68], 80.00th=[ 87], 90.00th=[ 114], 95.00th=[ 140], | 99.00th=[ 218], 99.50th=[ 247], 99.90th=[ 355], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 135, per=25.44%, avg=40.70, stdev=24.96, samples=304 iops : min= 1, max= 33, avg= 9.52, stdev= 6.27, samples=304 lat (msec) : 10=3.19%, 20=16.57%, 50=45.67%, 100=23.08%, 250=11.10% lat (msec) : 500=0.36%, 2000=0.03% cpu : usr=0.05%, sys=1.71%, ctx=4724, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178958: Tue Sep 1 15:29:20 2026 read: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6028KiB/156455msec) clat (msec): min=4, max=319, avg=40.81, stdev=39.23 lat (msec): min=4, max=319, avg=40.81, stdev=39.23 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 89], 95.00th=[ 116], | 99.00th=[ 194], 99.50th=[ 247], 99.90th=[ 275], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 159, per=25.25%, avg=38.63, stdev=26.46, samples=303 iops : min= 1, max= 39, avg= 9.00, stdev= 6.65, samples=303 write: IOPS=10, BW=40.0KiB/s (40.0kB/s)(6260KiB/156455msec); 0 zone resets clat (msec): min=8, max=1087, avg=60.42, stdev=50.32 lat (msec): min=8, max=1087, avg=60.42, stdev=50.32 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 56], | 70.00th=[ 69], 80.00th=[ 87], 90.00th=[ 116], 95.00th=[ 146], | 99.00th=[ 215], 99.50th=[ 255], 99.90th=[ 372], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 7, max= 111, per=24.86%, avg=39.78, stdev=25.04, samples=305 iops : min= 1, max= 27, avg= 9.29, stdev= 6.30, samples=305 lat (msec) : 10=2.80%, 20=16.80%, 50=45.77%, 100=23.31%, 250=10.84% lat (msec) : 500=0.46%, 2000=0.03% cpu : usr=0.05%, sys=1.72%, ctx=4735, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178959: Tue Sep 1 15:29:20 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6052KiB/156473msec) clat (msec): min=4, max=348, avg=40.06, stdev=37.08 lat (msec): min=4, max=348, avg=40.06, stdev=37.08 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 58], 90.00th=[ 86], 95.00th=[ 116], | 99.00th=[ 180], 99.50th=[ 215], 99.90th=[ 321], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 159, per=25.64%, avg=39.23, stdev=26.47, samples=299 iops : min= 1, max= 39, avg= 9.15, stdev= 6.66, samples=299 write: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6236KiB/156473msec); 0 zone resets clat (msec): min=11, max=1056, avg=61.23, stdev=51.46 lat (msec): min=11, max=1056, avg=61.24, stdev=51.46 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 54], | 70.00th=[ 69], 80.00th=[ 89], 90.00th=[ 125], 95.00th=[ 146], | 99.00th=[ 230], 99.50th=[ 262], 99.90th=[ 430], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 7, max= 134, per=24.77%, avg=39.63, stdev=25.12, samples=305 iops : min= 1, max= 33, avg= 9.26, stdev= 6.32, samples=305 lat (msec) : 10=2.77%, 20=17.25%, 50=45.64%, 100=22.56%, 250=11.39% lat (msec) : 500=0.36%, 2000=0.03% cpu : usr=0.04%, sys=1.69%, ctx=4699, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=153KiB/s (157kB/s), 38.1KiB/s-38.7KiB/s (39.1kB/s-39.6kB/s), io=23.4MiB (24.6MB), run=155736-156838msec WRITE: bw=160KiB/s (164kB/s), 39.9KiB/s-40.8KiB/s (40.8kB/s-41.7kB/s), io=24.6MiB (25.7MB), run=155736-156838msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179004: Tue Sep 1 15:30:07 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35546msec) clat (usec): min=49, max=202893, avg=48894.21, stdev=31766.26 lat (usec): min=50, max=202895, avg=48896.55, stdev=31765.21 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 14091], 20.00th=[ 25035], | 30.00th=[ 31851], 40.00th=[ 38011], 50.00th=[ 43254], 60.00th=[ 50070], | 70.00th=[ 58459], 80.00th=[ 73925], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[152044], 99.50th=[154141], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 32, max= 473, per=24.60%, avg=165.54, stdev=69.65, samples=70 iops : min= 2, max= 29, avg= 9.56, stdev= 4.37, samples=70 write: IOPS=11, BW=179KiB/s (183kB/s)(6368KiB/35546msec); 0 zone resets clat (usec): min=1364, max=212062, avg=43314.98, stdev=40299.75 lat (usec): min=1366, max=212064, avg=43317.25, stdev=40299.63 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1827], 10.00th=[ 3261], 20.00th=[ 7767], | 30.00th=[ 14615], 40.00th=[ 23987], 50.00th=[ 32900], 60.00th=[ 41681], | 70.00th=[ 52691], 80.00th=[ 73925], 90.00th=[102237], 95.00th=[131597], | 99.00th=[179307], 99.50th=[193987], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 29, max= 416, per=25.20%, avg=178.44, stdev=71.08, samples=70 iops : min= 1, max= 26, avg=10.36, stdev= 4.47, samples=70 lat (usec) : 50=0.13%, 100=3.65%, 250=0.26%, 500=0.13%, 750=0.13% lat (msec) : 2=2.86%, 4=3.12%, 10=6.25%, 20=8.07%, 50=39.19% lat (msec) : 100=27.08%, 250=9.11% cpu : usr=0.06%, sys=4.66%, ctx=1742, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179005: Tue Sep 1 15:30:07 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(5744KiB/33850msec) clat (usec): min=49, max=264761, avg=52038.81, stdev=35336.88 lat (usec): min=49, max=264762, avg=52050.34, stdev=35339.67 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 16712], 20.00th=[ 26346], | 30.00th=[ 34341], 40.00th=[ 39060], 50.00th=[ 45876], 60.00th=[ 52691], | 70.00th=[ 61604], 80.00th=[ 76022], 90.00th=[ 93848], 95.00th=[111674], | 99.00th=[179307], 99.50th=[200279], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 29, max= 349, per=25.23%, avg=169.79, stdev=69.13, samples=66 iops : min= 1, max= 21, avg= 9.80, stdev= 4.37, samples=66 write: IOPS=12, BW=193KiB/s (198kB/s)(6544KiB/33850msec); 0 zone resets clat (usec): min=1339, max=192210, avg=36157.71, stdev=35064.80 lat (usec): min=1340, max=192213, avg=36172.35, stdev=35054.91 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 1795], 10.00th=[ 2868], 20.00th=[ 5538], | 30.00th=[ 8717], 40.00th=[ 14877], 50.00th=[ 26346], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[152044], 99.50th=[154141], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 31, max= 403, per=27.49%, avg=194.62, stdev=84.56, samples=66 iops : min= 1, max= 25, avg=11.38, stdev= 5.31, samples=66 lat (usec) : 50=0.13%, 100=3.52%, 250=0.13%, 750=0.13% lat (msec) : 2=3.26%, 4=4.17%, 10=9.51%, 20=8.20%, 50=35.16% lat (msec) : 100=28.39%, 250=7.29%, 500=0.13% cpu : usr=0.06%, sys=4.95%, ctx=1664, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179006: Tue Sep 1 15:30:07 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6256KiB/33836msec) clat (usec): min=52, max=232581, avg=50592.37, stdev=33000.38 lat (usec): min=52, max=232583, avg=50594.00, stdev=33000.27 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 15926], 20.00th=[ 24773], | 30.00th=[ 30802], 40.00th=[ 38536], 50.00th=[ 45876], 60.00th=[ 54789], | 70.00th=[ 62129], 80.00th=[ 73925], 90.00th=[ 93848], 95.00th=[108528], | 99.00th=[145753], 99.50th=[198181], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 59, max= 349, per=27.73%, avg=186.65, stdev=59.97, samples=66 iops : min= 3, max= 21, avg=10.86, stdev= 3.79, samples=66 write: IOPS=11, BW=178KiB/s (183kB/s)(6032KiB/33836msec); 0 zone resets clat (usec): min=1348, max=213443, avg=36980.87, stdev=37187.94 lat (usec): min=1350, max=213443, avg=36992.51, stdev=37188.27 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 1811], 10.00th=[ 3064], 20.00th=[ 6128], | 30.00th=[ 9896], 40.00th=[ 16057], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 46400], 80.00th=[ 66847], 90.00th=[ 89654], 95.00th=[112722], | 99.00th=[158335], 99.50th=[198181], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 412, per=24.98%, avg=176.88, stdev=86.02, samples=66 iops : min= 1, max= 25, avg=10.26, stdev= 5.38, samples=66 lat (usec) : 100=3.91%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.39%, 4=3.91%, 10=7.81%, 20=8.98%, 50=34.90% lat (msec) : 100=29.43%, 250=7.42% cpu : usr=0.04%, sys=4.65%, ctx=1684, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179007: Tue Sep 1 15:30:07 2026 read: IOPS=10, BW=174KiB/s (178kB/s)(6032KiB/34640msec) clat (usec): min=41, max=331468, avg=50893.24, stdev=35686.12 lat (usec): min=41, max=331469, avg=50895.05, stdev=35686.27 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 64], 10.00th=[ 11207], 20.00th=[ 24773], | 30.00th=[ 33162], 40.00th=[ 40109], 50.00th=[ 47449], 60.00th=[ 55313], | 70.00th=[ 61604], 80.00th=[ 71828], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[160433], 99.50th=[270533], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 31, max= 288, per=26.16%, avg=176.09, stdev=65.20, samples=67 iops : min= 1, max= 18, avg=10.19, stdev= 4.11, samples=67 write: IOPS=11, BW=181KiB/s (185kB/s)(6256KiB/34640msec); 0 zone resets clat (usec): min=1313, max=252130, avg=38663.79, stdev=39932.31 lat (usec): min=1315, max=252132, avg=38665.82, stdev=39932.37 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1909], 10.00th=[ 2868], 20.00th=[ 6587], | 30.00th=[ 10945], 40.00th=[ 16909], 50.00th=[ 23987], 60.00th=[ 35914], | 70.00th=[ 46400], 80.00th=[ 71828], 90.00th=[ 93848], 95.00th=[114820], | 99.00th=[185598], 99.50th=[248513], 99.90th=[252707], 99.95th=[252707], | 99.99th=[252707] bw ( KiB/s): min= 29, max= 348, per=25.59%, avg=181.19, stdev=67.88, samples=68 iops : min= 1, max= 21, avg=10.53, stdev= 4.26, samples=68 lat (usec) : 50=0.13%, 100=3.78%, 250=0.39%, 750=0.13% lat (msec) : 2=2.60%, 4=3.78%, 10=7.68%, 20=10.55%, 50=33.85% lat (msec) : 100=30.08%, 250=6.64%, 500=0.39% cpu : usr=0.03%, sys=4.97%, ctx=1633, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=674KiB/s (690kB/s), 167KiB/s-185KiB/s (171kB/s-189kB/s), io=23.4MiB (24.5MB), run=33836-35546msec WRITE: bw=709KiB/s (726kB/s), 178KiB/s-193KiB/s (183kB/s-198kB/s), io=24.6MiB (25.8MB), run=33836-35546msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179000: Tue Sep 1 15:30:20 2026 read: IOPS=7, BW=123KiB/s (125kB/s)(5920KiB/48308msec) clat (msec): min=5, max=320, avg=48.16, stdev=40.66 lat (msec): min=5, max=320, avg=48.16, stdev=40.66 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 67], 90.00th=[ 102], 95.00th=[ 130], | 99.00th=[ 197], 99.50th=[ 253], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 31, max= 416, per=25.60%, avg=126.45, stdev=78.07, samples=91 iops : min= 1, max= 26, avg= 7.09, stdev= 4.97, samples=91 write: IOPS=8, BW=132KiB/s (135kB/s)(6368KiB/48308msec); 0 zone resets clat (msec): min=15, max=352, avg=76.18, stdev=53.42 lat (msec): min=15, max=352, avg=76.18, stdev=53.42 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 37], | 30.00th=[ 43], 40.00th=[ 51], 50.00th=[ 59], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 109], 90.00th=[ 146], 95.00th=[ 186], | 99.00th=[ 279], 99.50th=[ 342], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 31, max= 351, per=25.46%, avg=132.37, stdev=75.40, samples=94 iops : min= 1, max= 21, avg= 7.46, stdev= 4.78, samples=94 lat (msec) : 10=1.30%, 20=9.90%, 50=41.80%, 100=29.30%, 250=16.80% lat (msec) : 500=0.91% cpu : usr=0.04%, sys=1.46%, ctx=1236, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179001: Tue Sep 1 15:30:20 2026 read: IOPS=7, BW=119KiB/s (121kB/s)(5744KiB/48433msec) clat (msec): min=5, max=306, avg=52.46, stdev=47.28 lat (msec): min=5, max=306, avg=52.47, stdev=47.27 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 42], | 70.00th=[ 56], 80.00th=[ 85], 90.00th=[ 127], 95.00th=[ 157], | 99.00th=[ 224], 99.50th=[ 236], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 28, max= 443, per=24.72%, avg=122.10, stdev=81.22, samples=91 iops : min= 1, max= 27, avg= 6.81, stdev= 5.15, samples=91 write: IOPS=8, BW=135KiB/s (138kB/s)(6544KiB/48433msec); 0 zone resets clat (msec): min=10, max=315, avg=72.01, stdev=47.02 lat (msec): min=10, max=315, avg=72.01, stdev=47.02 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 57], 60.00th=[ 69], | 70.00th=[ 86], 80.00th=[ 111], 90.00th=[ 140], 95.00th=[ 167], | 99.00th=[ 215], 99.50th=[ 232], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 352, per=26.40%, avg=137.27, stdev=72.04, samples=92 iops : min= 1, max= 22, avg= 7.77, stdev= 4.58, samples=92 lat (msec) : 10=1.17%, 20=9.51%, 50=45.05%, 100=25.26%, 250=18.62% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.54%, ctx=1183, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179002: Tue Sep 1 15:30:20 2026 read: IOPS=8, BW=131KiB/s (134kB/s)(6256KiB/47888msec) clat (msec): min=6, max=285, avg=50.33, stdev=42.89 lat (msec): min=6, max=285, avg=50.33, stdev=42.89 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 44], | 70.00th=[ 53], 80.00th=[ 71], 90.00th=[ 105], 95.00th=[ 148], | 99.00th=[ 205], 99.50th=[ 264], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 31, max= 538, per=26.70%, avg=131.88, stdev=88.64, samples=93 iops : min= 1, max= 33, avg= 7.43, stdev= 5.62, samples=93 write: IOPS=7, BW=126KiB/s (129kB/s)(6032KiB/47888msec); 0 zone resets clat (msec): min=16, max=343, avg=74.67, stdev=50.53 lat (msec): min=16, max=344, avg=74.68, stdev=50.54 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 30], 20.00th=[ 36], | 30.00th=[ 43], 40.00th=[ 50], 50.00th=[ 59], 60.00th=[ 70], | 70.00th=[ 87], 80.00th=[ 108], 90.00th=[ 144], 95.00th=[ 182], | 99.00th=[ 241], 99.50th=[ 279], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 31, max= 383, per=24.08%, avg=125.22, stdev=72.37, samples=93 iops : min= 1, max= 23, avg= 7.00, stdev= 4.58, samples=93 lat (msec) : 10=0.91%, 20=9.38%, 50=43.62%, 100=27.86%, 250=17.45% lat (msec) : 500=0.78% cpu : usr=0.03%, sys=1.53%, ctx=1209, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179003: Tue Sep 1 15:30:20 2026 read: IOPS=7, BW=125KiB/s (128kB/s)(6032KiB/48285msec) clat (msec): min=8, max=264, avg=51.83, stdev=46.54 lat (msec): min=8, max=264, avg=51.84, stdev=46.54 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 52], 80.00th=[ 72], 90.00th=[ 126], 95.00th=[ 157], | 99.00th=[ 230], 99.50th=[ 262], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 415, per=26.08%, avg=128.81, stdev=81.70, samples=91 iops : min= 1, max= 25, avg= 7.23, stdev= 5.18, samples=91 write: IOPS=8, BW=130KiB/s (133kB/s)(6256KiB/48285msec); 0 zone resets clat (msec): min=15, max=338, avg=72.86, stdev=49.46 lat (msec): min=15, max=338, avg=72.86, stdev=49.46 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 34], | 30.00th=[ 41], 40.00th=[ 49], 50.00th=[ 58], 60.00th=[ 71], | 70.00th=[ 85], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 176], | 99.00th=[ 230], 99.50th=[ 305], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 383, per=25.01%, avg=130.04, stdev=82.16, samples=94 iops : min= 1, max= 23, avg= 7.31, stdev= 5.22, samples=94 lat (msec) : 10=0.52%, 20=10.81%, 50=43.49%, 100=26.82%, 250=17.84% lat (msec) : 500=0.52% cpu : usr=0.02%, sys=1.51%, ctx=1149, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=495KiB/s (506kB/s), 119KiB/s-131KiB/s (121kB/s-134kB/s), io=23.4MiB (24.5MB), run=47888-48433msec WRITE: bw=520KiB/s (533kB/s), 126KiB/s-135KiB/s (129kB/s-138kB/s), io=24.6MiB (25.8MB), run=47888-48433msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179020: Tue Sep 1 15:30:36 2026 read: IOPS=1, BW=1286KiB/s (1317kB/s)(7168KiB/5574msec) clat (msec): min=68, max=1880, avg=505.94, stdev=695.43 lat (msec): min=68, max=1880, avg=505.94, stdev=695.43 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 69], 10.00th=[ 69], 20.00th=[ 106], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 161], | 70.00th=[ 161], 80.00th=[ 1036], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 1957, max= 4243, per=85.93%, avg=2746.33, stdev=1296.80, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=0, BW=919KiB/s (941kB/s)(5120KiB/5574msec); 0 zone resets clat (msec): min=104, max=1096, avg=393.51, stdev=409.90 lat (msec): min=104, max=1096, avg=393.78, stdev=409.74 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 108], 40.00th=[ 108], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 376], 80.00th=[ 376], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 2039, max= 4096, per=60.97%, avg=2727.67, stdev=1185.02, samples=3 iops : min= 1, max= 4, avg= 2.33, stdev= 1.53, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 2000=25.00% cpu : usr=0.00%, sys=2.82%, ctx=71, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179021: Tue Sep 1 15:30:36 2026 read: IOPS=0, BW=320KiB/s (327kB/s)(2048KiB/6408msec) clat (msec): min=114, max=619, avg=366.80, stdev=356.98 lat (msec): min=114, max=619, avg=366.80, stdev=356.98 clat percentiles (msec): | 1.00th=[ 115], 5.00th=[ 115], 10.00th=[ 115], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 115], 50.00th=[ 115], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1428, max= 2048, per=54.38%, avg=1738.00, stdev=438.41, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1598KiB/s (1636kB/s)(10.0MiB/6408msec); 0 zone resets clat (msec): min=124, max=2514, avg=563.27, stdev=752.55 lat (msec): min=124, max=2514, avg=563.35, stdev=752.55 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 134], | 30.00th=[ 184], 40.00th=[ 209], 50.00th=[ 209], 60.00th=[ 296], | 70.00th=[ 363], 80.00th=[ 418], 90.00th=[ 1183], 95.00th=[ 2500], | 99.00th=[ 2500], 99.50th=[ 2500], 99.90th=[ 2500], 99.95th=[ 2500], | 99.99th=[ 2500] bw ( KiB/s): min= 1984, max= 4096, per=76.34%, avg=3415.60, stdev=959.79, samples=5 iops : min= 1, max= 4, avg= 2.60, stdev= 1.14, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=8.33%, 2000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=3.36%, ctx=100, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179022: Tue Sep 1 15:30:36 2026 read: IOPS=1, BW=1041KiB/s (1066kB/s)(6144KiB/5902msec) clat (msec): min=85, max=744, avg=358.31, stdev=269.03 lat (msec): min=85, max=744, avg=358.31, stdev=269.03 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 86], | 30.00th=[ 86], 40.00th=[ 228], 50.00th=[ 228], 60.00th=[ 456], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1903, max= 2048, per=62.50%, avg=1997.40, stdev=64.79, samples=5 iops : min= 1, max= 2, avg= 1.40, stdev= 0.55, samples=5 write: IOPS=1, BW=1041KiB/s (1066kB/s)(6144KiB/5902msec); 0 zone resets clat (msec): min=120, max=1854, avg=615.37, stdev=652.72 lat (msec): min=120, max=1854, avg=618.35, stdev=650.74 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 550], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 2039, max= 4063, per=60.56%, avg=2709.25, stdev=952.12, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 0.82, samples=4 lat (msec) : 100=16.67%, 250=33.33%, 500=8.33%, 750=33.33%, 2000=8.33% cpu : usr=0.02%, sys=3.20%, ctx=72, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179023: Tue Sep 1 15:30:36 2026 read: IOPS=1, BW=1769KiB/s (1812kB/s)(5120KiB/2894msec) clat (msec): min=77, max=666, avg=270.03, stdev=230.00 lat (msec): min=77, max=666, avg=270.04, stdev=230.00 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 201], 60.00th=[ 201], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 3806, max= 3915, per=100.00%, avg=3860.50, stdev=77.07, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2477KiB/s (2536kB/s)(7168KiB/2894msec); 0 zone resets clat (msec): min=120, max=404, avg=213.13, stdev=95.29 lat (msec): min=121, max=405, avg=213.49, stdev=95.43 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 130], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 197], 60.00th=[ 213], | 70.00th=[ 213], 80.00th=[ 247], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2039, max= 5953, per=93.10%, avg=4165.33, stdev=1978.86, samples=3 iops : min= 1, max= 5, avg= 3.33, stdev= 2.08, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=4.87%, ctx=49, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3196KiB/s (3273kB/s), 320KiB/s-1769KiB/s (327kB/s-1812kB/s), io=20.0MiB (20.0MB), run=2894-6408msec WRITE: bw=4474KiB/s (4582kB/s), 919KiB/s-2477KiB/s (941kB/s-2536kB/s), io=28.0MiB (29.4MB), run=2894-6408msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179025: Tue Sep 1 15:30:36 2026 read: IOPS=2, BW=2360KiB/s (2417kB/s)(7168KiB/3037msec) clat (usec): min=481, max=427649, avg=219311.13, stdev=134247.37 lat (usec): min=482, max=427651, avg=219312.64, stdev=134247.47 clat percentiles (usec): | 1.00th=[ 482], 5.00th=[ 482], 10.00th=[ 482], 20.00th=[149947], | 30.00th=[164627], 40.00th=[164627], 50.00th=[223347], 60.00th=[270533], | 70.00th=[270533], 80.00th=[299893], 90.00th=[425722], 95.00th=[425722], | 99.00th=[425722], 99.50th=[425722], 99.90th=[425722], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 1630, max= 4079, per=95.02%, avg=3167.00, stdev=1338.79, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1686KiB/s (1726kB/s)(5120KiB/3037msec); 0 zone resets clat (msec): min=171, max=371, avg=299.84, stdev=75.22 lat (msec): min=171, max=371, avg=299.92, stdev=75.23 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 171], | 30.00th=[ 317], 40.00th=[ 317], 50.00th=[ 317], 60.00th=[ 317], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 372], 95.00th=[ 372], | 99.00th=[ 372], 99.50th=[ 372], 99.90th=[ 372], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 2023, max= 3842, per=56.47%, avg=2634.67, stdev=1045.61, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33% lat (msec) : 250=33.33%, 500=58.33% cpu : usr=0.00%, sys=15.38%, ctx=176, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179026: Tue Sep 1 15:30:36 2026 read: IOPS=0, BW=333KiB/s (341kB/s)(2048KiB/6144msec) clat (msec): min=342, max=379, avg=360.79, stdev=26.27 lat (msec): min=342, max=379, avg=360.79, stdev=26.27 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 1759, max= 2023, per=56.74%, avg=1891.00, stdev=186.68, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1667KiB/s (1707kB/s)(10.0MiB/6144msec); 0 zone resets clat (msec): min=136, max=2711, avg=541.90, stdev=792.56 lat (msec): min=136, max=2711, avg=541.99, stdev=792.55 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 184], | 30.00th=[ 194], 40.00th=[ 197], 50.00th=[ 255], 60.00th=[ 271], | 70.00th=[ 279], 80.00th=[ 296], 90.00th=[ 894], 95.00th=[ 2702], | 99.00th=[ 2702], 99.50th=[ 2702], 99.90th=[ 2702], 99.95th=[ 2702], | 99.99th=[ 2702] bw ( KiB/s): min= 2023, max= 4079, per=74.87%, avg=3493.25, stdev=989.46, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=50.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=9.67%, ctx=133, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179027: Tue Sep 1 15:30:36 2026 read: IOPS=2, BW=2080KiB/s (2130kB/s)(6144KiB/2954msec) clat (usec): min=341, max=160481, avg=27453.36, stdev=65172.88 lat (usec): min=341, max=160483, avg=27454.38, stdev=65173.15 clat percentiles (usec): | 1.00th=[ 343], 5.00th=[ 343], 10.00th=[ 343], 20.00th=[ 486], | 30.00th=[ 486], 40.00th=[ 490], 50.00th=[ 490], 60.00th=[ 1057], | 70.00th=[ 1860], 80.00th=[ 1860], 90.00th=[160433], 95.00th=[160433], | 99.00th=[160433], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 2023, max= 3842, per=96.58%, avg=3219.00, stdev=1036.07, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2080KiB/s (2130kB/s)(6144KiB/2954msec); 0 zone resets clat (msec): min=167, max=928, avg=464.58, stdev=258.94 lat (msec): min=167, max=929, avg=464.66, stdev=258.93 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 481], | 70.00th=[ 514], 80.00th=[ 514], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1896, max= 3778, per=51.53%, avg=2404.50, stdev=917.31, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=25.00% lat (msec) : 2=16.67%, 250=16.67%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=13.95%, ctx=132, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179028: Tue Sep 1 15:30:36 2026 read: IOPS=0, BW=836KiB/s (856kB/s)(5120KiB/6126msec) clat (usec): min=560, max=2223.4k, avg=549337.91, stdev=945123.05 lat (usec): min=562, max=2223.4k, avg=549339.08, stdev=945122.71 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], | 20.00th=[ 562], 30.00th=[ 2606], 40.00th=[ 2606], | 50.00th=[ 221250], 60.00th=[ 221250], 70.00th=[ 299893], | 80.00th=[ 299893], 90.00th=[2231370], 95.00th=[2231370], | 99.00th=[2231370], 99.50th=[2231370], 99.90th=[2231370], | 99.95th=[2231370], 99.99th=[2231370] bw ( KiB/s): min= 4047, max= 4055, per=100.00%, avg=4051.00, stdev= 5.66, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1170KiB/s (1198kB/s)(7168KiB/6126msec); 0 zone resets clat (msec): min=220, max=866, avg=481.64, stdev=273.51 lat (msec): min=220, max=866, avg=481.77, stdev=273.48 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 257], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 342], 60.00th=[ 542], | 70.00th=[ 542], 80.00th=[ 844], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 1780, max= 4079, per=62.55%, avg=2918.50, stdev=1184.32, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=16.67%, 500=33.33%, 750=8.33%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=9.21%, ctx=527, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3333KiB/s (3413kB/s), 333KiB/s-2360KiB/s (341kB/s-2417kB/s), io=20.0MiB (20.0MB), run=2954-6144msec WRITE: bw=4667KiB/s (4779kB/s), 1170KiB/s-2080KiB/s (1198kB/s-2130kB/s), io=28.0MiB (29.4MB), run=2954-6144msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179040: Tue Sep 1 15:30:51 2026 read: IOPS=1, BW=5159KiB/s (5282kB/s)(12.0MiB/2382msec) clat (msec): min=677, max=837, avg=767.08, stdev=81.73 lat (msec): min=677, max=837, avg=767.09, stdev=81.73 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 835], 80.00th=[ 835], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 8047, max= 8094, per=100.00%, avg=8070.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=16.55%, ctx=372, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179041: Tue Sep 1 15:30:51 2026 read: IOPS=0, BW=1258KiB/s (1288kB/s)(4096KiB/3256msec) clat (nsec): min=612557k, max=612557k, avg=612556796.00, stdev= 0.00 lat (nsec): min=612559k, max=612559k, avg=612559176.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2516KiB/s (2576kB/s)(8192KiB/3256msec); 0 zone resets clat (msec): min=845, max=1603, avg=1224.78, stdev=536.19 lat (msec): min=845, max=1604, avg=1225.12, stdev=536.24 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 1603], | 70.00th=[ 1603], 80.00th=[ 1603], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 8192, max= 8192, per=84.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=5.68%, ctx=105, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179042: Tue Sep 1 15:30:51 2026 write: IOPS=0, BW=3657KiB/s (3745kB/s)(12.0MiB/3360msec); 0 zone resets clat (msec): min=208, max=1624, avg=1053.72, stdev=747.06 lat (msec): min=209, max=1624, avg=1054.47, stdev=746.30 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7937, max= 8078, per=82.11%, avg=8007.50, stdev=99.70, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.48%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179043: Tue Sep 1 15:30:51 2026 write: IOPS=0, BW=3918KiB/s (4012kB/s)(12.0MiB/3136msec); 0 zone resets clat (msec): min=791, max=1141, avg=963.46, stdev=175.10 lat (msec): min=791, max=1141, avg=964.82, stdev=175.06 clat percentiles (msec): | 1.00th=[ 793], 5.00th=[ 793], 10.00th=[ 793], 20.00th=[ 793], | 30.00th=[ 793], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8047, max= 8192, per=83.26%, avg=8119.50, stdev=102.53, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.47%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5032KiB/s (5153kB/s), 1258KiB/s-5159KiB/s (1288kB/s-5282kB/s), io=16.0MiB (16.8MB), run=2382-3256msec WRITE: bw=9752KiB/s (9986kB/s), 2516KiB/s-3918KiB/s (2576kB/s-4012kB/s), io=32.0MiB (33.6MB), run=3136-3360msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179036: Tue Sep 1 15:30:52 2026 read: IOPS=0, BW=4063KiB/s (4161kB/s)(12.0MiB/3024msec) clat (msec): min=672, max=1304, avg=914.31, stdev=341.54 lat (msec): min=672, max=1304, avg=914.31, stdev=341.54 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7984, max= 8192, per=100.00%, avg=8088.00, stdev=147.08, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.23%, ctx=67, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179037: Tue Sep 1 15:30:52 2026 read: IOPS=0, BW=1396KiB/s (1429kB/s)(4096KiB/2935msec) clat (nsec): min=704734k, max=704734k, avg=704734188.00, stdev= 0.00 lat (nsec): min=704736k, max=704736k, avg=704736481.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2791KiB/s (2858kB/s)(8192KiB/2935msec); 0 zone resets clat (msec): min=994, max=1042, avg=1018.70, stdev=33.97 lat (msec): min=995, max=1043, avg=1019.02, stdev=33.95 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 1045], | 70.00th=[ 1045], 80.00th=[ 1045], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 8143, max= 8143, per=99.28%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.91%, ctx=74, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179038: Tue Sep 1 15:30:52 2026 write: IOPS=0, BW=3076KiB/s (3150kB/s)(12.0MiB/3995msec); 0 zone resets clat (msec): min=167, max=2902, avg=1236.15, stdev=1462.53 lat (msec): min=167, max=2903, avg=1236.48, stdev=1462.43 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 642], 50.00th=[ 642], 60.00th=[ 642], | 70.00th=[ 2903], 80.00th=[ 2903], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 8078, max= 8078, per=98.49%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.30%, ctx=63, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179039: Tue Sep 1 15:30:52 2026 write: IOPS=1, BW=5185KiB/s (5309kB/s)(12.0MiB/2370msec); 0 zone resets clat (msec): min=306, max=1637, avg=765.47, stdev=755.76 lat (msec): min=306, max=1638, avg=766.35, stdev=756.01 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 6272, max= 8143, per=87.87%, avg=7207.50, stdev=1323.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.94%, ctx=78, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5418KiB/s (5548kB/s), 1396KiB/s-4063KiB/s (1429kB/s-4161kB/s), io=16.0MiB (16.8MB), run=2935-3024msec WRITE: bw=8202KiB/s (8399kB/s), 2791KiB/s-5185KiB/s (2858kB/s-5309kB/s), io=32.0MiB (33.6MB), run=2370-3995msec