== sanity test 398b: DIO and buffer IO race ============== 12:29:23 (1787588963) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.16197 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179474: Mon Aug 24 12:31:49 2026 read: IOPS=12, BW=48.7KiB/s (49.9kB/s)(5992KiB/122942msec) clat (usec): min=37, max=227316, avg=45810.42, stdev=30197.07 lat (usec): min=37, max=227316, avg=45813.31, stdev=30194.46 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10945], 10.00th=[ 17171], 20.00th=[ 23200], | 30.00th=[ 27919], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 46400], | 70.00th=[ 55313], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[160433], 99.50th=[181404], 99.90th=[200279], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 7, max= 103, per=24.74%, avg=48.25, stdev=18.01, samples=241 iops : min= 1, max= 25, avg=11.40, stdev= 4.51, samples=241 write: IOPS=12, BW=51.2KiB/s (52.4kB/s)(6296KiB/122942msec); 0 zone resets clat (usec): min=989, max=1028.4k, avg=34166.53, stdev=43014.17 lat (usec): min=990, max=1028.4k, avg=34170.44, stdev=43013.62 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1287], 10.00th=[ 1893], | 20.00th=[ 4359], 30.00th=[ 8455], 40.00th=[ 16909], | 50.00th=[ 24249], 60.00th=[ 31589], 70.00th=[ 40633], | 80.00th=[ 55313], 90.00th=[ 82314], 95.00th=[ 104334], | 99.00th=[ 164627], 99.50th=[ 189793], 99.90th=[ 263193], | 99.95th=[1027605], 99.99th=[1027605] bw ( KiB/s): min= 7, max= 119, per=25.09%, avg=51.18, stdev=20.52, samples=239 iops : min= 1, max= 29, avg=12.14, stdev= 5.17, samples=239 lat (usec) : 50=0.16%, 100=1.69%, 250=0.13%, 500=0.07%, 1000=0.03% lat (msec) : 2=5.50%, 4=3.87%, 10=7.52%, 20=9.96%, 50=41.37% lat (msec) : 100=24.41%, 250=5.21%, 500=0.03%, 2000=0.03% cpu : usr=0.08%, sys=5.22%, ctx=6516, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179476: Mon Aug 24 12:31:49 2026 read: IOPS=12, BW=48.9KiB/s (50.1kB/s)(5940KiB/121480msec) clat (usec): min=47, max=221699, avg=44061.36, stdev=28513.89 lat (usec): min=48, max=221700, avg=44062.61, stdev=28514.53 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 10421], 10.00th=[ 16450], 20.00th=[ 22676], | 30.00th=[ 27395], 40.00th=[ 32375], 50.00th=[ 38536], 60.00th=[ 44303], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 79168], 95.00th=[ 95945], | 99.00th=[147850], 99.50th=[158335], 99.90th=[191890], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 5, max= 87, per=25.02%, avg=48.79, stdev=17.21, samples=238 iops : min= 1, max= 21, avg=11.54, stdev= 4.30, samples=238 write: IOPS=13, BW=52.3KiB/s (53.5kB/s)(6348KiB/121480msec); 0 zone resets clat (usec): min=1001, max=1212.5k, avg=34958.69, stdev=44761.97 lat (usec): min=1003, max=1212.5k, avg=34960.13, stdev=44762.02 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1336], 10.00th=[ 1975], | 20.00th=[ 4015], 30.00th=[ 8455], 40.00th=[ 17433], | 50.00th=[ 26084], 60.00th=[ 34341], 70.00th=[ 43779], | 80.00th=[ 57934], 90.00th=[ 81265], 95.00th=[ 100140], | 99.00th=[ 145753], 99.50th=[ 154141], 99.90th=[ 242222], | 99.95th=[1216349], 99.99th=[1216349] bw ( KiB/s): min= 7, max= 148, per=25.69%, avg=52.42, stdev=22.61, samples=237 iops : min= 1, max= 37, avg=12.45, stdev= 5.72, samples=237 lat (usec) : 50=0.03%, 100=1.66%, 250=0.26%, 500=0.03%, 1000=0.07% lat (msec) : 2=5.18%, 4=5.21%, 10=6.51%, 20=10.42%, 50=41.24% lat (msec) : 100=24.64%, 250=4.72%, 2000=0.03% cpu : usr=0.07%, sys=5.29%, ctx=6572, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179477: Mon Aug 24 12:31:49 2026 read: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6028KiB/117079msec) clat (usec): min=35, max=240360, avg=43074.36, stdev=28351.98 lat (usec): min=35, max=240361, avg=43076.11, stdev=28351.77 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 12780], 10.00th=[ 16712], 20.00th=[ 22414], | 30.00th=[ 26346], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 50070], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 91751], | 99.00th=[152044], 99.50th=[173016], 99.90th=[223347], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 7, max= 95, per=26.49%, avg=51.65, stdev=17.72, samples=228 iops : min= 1, max= 23, avg=12.25, stdev= 4.45, samples=228 write: IOPS=13, BW=53.5KiB/s (54.8kB/s)(6260KiB/117079msec); 0 zone resets clat (usec): min=1031, max=1124.8k, avg=32982.79, stdev=43125.00 lat (usec): min=1031, max=1124.8k, avg=32987.06, stdev=43124.32 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1778], | 20.00th=[ 3851], 30.00th=[ 6915], 40.00th=[ 14877], | 50.00th=[ 23725], 60.00th=[ 31851], 70.00th=[ 41157], | 80.00th=[ 56361], 90.00th=[ 76022], 95.00th=[ 100140], | 99.00th=[ 143655], 99.50th=[ 160433], 99.90th=[ 283116], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 15, max= 119, per=26.29%, avg=53.63, stdev=21.09, samples=228 iops : min= 3, max= 29, avg=12.75, stdev= 5.29, samples=228 lat (usec) : 50=0.16%, 100=1.43%, 250=0.10%, 500=0.10%, 750=0.03% lat (msec) : 2=5.99%, 4=4.52%, 10=6.93%, 20=11.10%, 50=42.97% lat (msec) : 100=22.33%, 250=4.26%, 500=0.03%, 2000=0.03% cpu : usr=0.07%, sys=5.09%, ctx=6383, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179479: Mon Aug 24 12:31:49 2026 read: IOPS=12, BW=49.5KiB/s (50.7kB/s)(6052KiB/122206msec) clat (usec): min=35, max=212548, avg=43003.53, stdev=27939.83 lat (usec): min=36, max=212549, avg=43010.07, stdev=27937.68 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 7504], 10.00th=[ 15401], 20.00th=[ 22152], | 30.00th=[ 27132], 40.00th=[ 32113], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 93848], | 99.00th=[143655], 99.50th=[162530], 99.90th=[196084], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 7, max= 127, per=25.49%, avg=49.70, stdev=19.16, samples=238 iops : min= 1, max= 31, avg=11.76, stdev= 4.80, samples=238 write: IOPS=12, BW=51.0KiB/s (52.3kB/s)(6236KiB/122206msec); 0 zone resets clat (usec): min=985, max=1139.1k, avg=36255.49, stdev=45811.62 lat (usec): min=986, max=1139.1k, avg=36277.08, stdev=45810.87 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 2057], | 20.00th=[ 4752], 30.00th=[ 9503], 40.00th=[ 18220], | 50.00th=[ 25297], 60.00th=[ 33817], 70.00th=[ 45876], | 80.00th=[ 61604], 90.00th=[ 85459], 95.00th=[ 103285], | 99.00th=[ 154141], 99.50th=[ 208667], 99.90th=[ 312476], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 119, per=25.00%, avg=51.00, stdev=22.39, samples=239 iops : min= 1, max= 29, avg=12.08, stdev= 5.64, samples=239 lat (usec) : 50=0.33%, 100=1.73%, 250=0.20%, 750=0.03%, 1000=0.03% lat (msec) : 2=4.88%, 4=4.00%, 10=7.32%, 20=11.00%, 50=41.50% lat (msec) : 100=23.83%, 250=5.01%, 500=0.10%, 2000=0.03% cpu : usr=0.08%, sys=5.19%, ctx=6607, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=195KiB/s (200kB/s), 48.7KiB/s-51.5KiB/s (49.9kB/s-52.7kB/s), io=23.4MiB (24.6MB), run=117079-122942msec WRITE: bw=204KiB/s (209kB/s), 51.0KiB/s-53.5KiB/s (52.3kB/s-54.8kB/s), io=24.6MiB (25.7MB), run=117079-122942msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179473: Mon Aug 24 12:32:26 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(5992KiB/159583msec) clat (msec): min=5, max=1236, avg=41.05, stdev=47.70 lat (msec): min=5, max=1236, avg=41.05, stdev=47.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 92], 95.00th=[ 121], | 99.00th=[ 171], 99.50th=[ 199], 99.90th=[ 317], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7, max= 142, per=25.47%, avg=37.95, stdev=26.21, samples=307 iops : min= 1, max= 35, avg= 8.83, stdev= 6.58, samples=307 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6296KiB/159583msec); 0 zone resets clat (msec): min=11, max=348, avg=62.01, stdev=44.48 lat (msec): min=11, max=348, avg=62.02, stdev=44.48 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 41], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 92], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 334], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 120, per=25.22%, avg=39.35, stdev=24.28, samples=311 iops : min= 1, max= 30, avg= 9.18, stdev= 6.10, samples=311 lat (msec) : 10=2.28%, 20=16.47%, 50=46.13%, 100=22.62%, 250=12.08% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.05%, sys=1.79%, ctx=4726, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179475: Mon Aug 24 12:32:26 2026 read: IOPS=9, BW=37.2KiB/s (38.1kB/s)(5940KiB/159534msec) clat (msec): min=5, max=1066, avg=41.97, stdev=46.57 lat (msec): min=5, max=1066, avg=41.97, stdev=46.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 61], 90.00th=[ 94], 95.00th=[ 126], | 99.00th=[ 182], 99.50th=[ 220], 99.90th=[ 305], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7, max= 143, per=25.62%, avg=38.17, stdev=25.89, samples=303 iops : min= 1, max= 35, avg= 8.89, stdev= 6.50, samples=303 write: IOPS=9, BW=39.8KiB/s (40.7kB/s)(6348KiB/159534msec); 0 zone resets clat (msec): min=12, max=343, avg=60.96, stdev=43.44 lat (msec): min=12, max=343, avg=60.96, stdev=43.44 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 47], 60.00th=[ 56], | 70.00th=[ 68], 80.00th=[ 90], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 207], 99.50th=[ 251], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 112, per=25.34%, avg=39.54, stdev=24.69, samples=312 iops : min= 1, max= 28, avg= 9.23, stdev= 6.21, samples=312 lat (msec) : 10=2.08%, 20=16.37%, 50=45.57%, 100=23.57%, 250=11.98% lat (msec) : 500=0.39%, 2000=0.03% cpu : usr=0.07%, sys=1.75%, ctx=4720, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179478: Mon Aug 24 12:32:26 2026 read: IOPS=9, BW=37.8KiB/s (38.8kB/s)(6028KiB/159265msec) clat (msec): min=5, max=318, avg=41.78, stdev=38.33 lat (msec): min=5, max=318, avg=41.78, stdev=38.33 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 64], 90.00th=[ 94], 95.00th=[ 125], | 99.00th=[ 190], 99.50th=[ 226], 99.90th=[ 279], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 7, max= 160, per=25.70%, avg=38.29, stdev=25.86, samples=306 iops : min= 1, max= 40, avg= 8.92, stdev= 6.49, samples=306 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6260KiB/159265msec); 0 zone resets clat (msec): min=11, max=1109, avg=61.22, stdev=50.14 lat (msec): min=11, max=1109, avg=61.23, stdev=50.14 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 116], 95.00th=[ 140], | 99.00th=[ 218], 99.50th=[ 259], 99.90th=[ 351], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 111, per=25.12%, avg=39.19, stdev=24.39, samples=310 iops : min= 1, max= 27, avg= 9.15, stdev= 6.13, samples=310 lat (msec) : 10=2.05%, 20=16.28%, 50=45.12%, 100=24.54%, 250=11.46% lat (msec) : 500=0.52%, 2000=0.03% cpu : usr=0.06%, sys=1.72%, ctx=4616, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179480: Mon Aug 24 12:32:26 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6052KiB/160278msec) clat (msec): min=4, max=281, avg=41.34, stdev=38.31 lat (msec): min=4, max=281, avg=41.35, stdev=38.31 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 44], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 125], | 99.00th=[ 182], 99.50th=[ 207], 99.90th=[ 247], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 7, max= 143, per=26.09%, avg=38.87, stdev=27.16, samples=302 iops : min= 1, max= 35, avg= 9.07, stdev= 6.80, samples=302 write: IOPS=9, BW=38.9KiB/s (39.8kB/s)(6236KiB/160278msec); 0 zone resets clat (msec): min=8, max=1119, avg=62.37, stdev=51.62 lat (msec): min=8, max=1119, avg=62.38, stdev=51.62 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 93], 90.00th=[ 125], 95.00th=[ 150], | 99.00th=[ 211], 99.50th=[ 264], 99.90th=[ 330], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 112, per=24.77%, avg=38.64, stdev=24.80, samples=313 iops : min= 1, max= 28, avg= 9.00, stdev= 6.24, samples=313 lat (msec) : 10=2.47%, 20=17.55%, 50=44.17%, 100=22.79%, 250=12.70% lat (msec) : 500=0.29%, 2000=0.03% cpu : usr=0.06%, sys=1.80%, ctx=4842, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=150KiB/s (153kB/s), 37.2KiB/s-37.8KiB/s (38.1kB/s-38.8kB/s), io=23.4MiB (24.6MB), run=159265-160278msec WRITE: bw=157KiB/s (161kB/s), 38.9KiB/s-39.8KiB/s (39.8kB/s-40.7kB/s), io=24.6MiB (25.7MB), run=159265-160278msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179524: Mon Aug 24 12:33:10 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(5920KiB/31285msec) clat (usec): min=39, max=139112, avg=41711.22, stdev=25882.38 lat (usec): min=39, max=139113, avg=41712.65, stdev=25882.65 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 122], 20.00th=[ 21627], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 40109], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 74974], 95.00th=[ 85459], | 99.00th=[119014], 99.50th=[137364], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 62, max= 416, per=26.07%, avg=188.46, stdev=74.54, samples=61 iops : min= 3, max= 26, avg=11.03, stdev= 4.76, samples=61 write: IOPS=12, BW=204KiB/s (208kB/s)(6368KiB/31285msec); 0 zone resets clat (usec): min=1333, max=265939, avg=39163.77, stdev=40238.53 lat (usec): min=1334, max=265940, avg=39166.19, stdev=40238.34 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 2180], 10.00th=[ 3425], 20.00th=[ 5604], | 30.00th=[ 8586], 40.00th=[ 18220], 50.00th=[ 25822], 60.00th=[ 36439], | 70.00th=[ 49546], 80.00th=[ 68682], 90.00th=[ 94897], 95.00th=[122160], | 99.00th=[181404], 99.50th=[193987], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 31, max= 544, per=26.83%, avg=204.20, stdev=86.63, samples=61 iops : min= 1, max= 34, avg=12.02, stdev= 5.55, samples=61 lat (usec) : 50=0.39%, 100=3.91%, 250=0.78%, 500=0.26% lat (msec) : 2=2.47%, 4=5.21%, 10=9.11%, 20=8.46%, 50=37.63% lat (msec) : 100=26.17%, 250=5.47%, 500=0.13% cpu : usr=0.07%, sys=5.86%, ctx=1718, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179525: Mon Aug 24 12:33:10 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5744KiB/32679msec) clat (usec): min=38, max=220225, avg=47348.40, stdev=31552.56 lat (usec): min=38, max=220226, avg=47357.22, stdev=31555.39 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 62], 10.00th=[ 13698], 20.00th=[ 24511], | 30.00th=[ 31589], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 50594], | 70.00th=[ 56886], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[103285], | 99.00th=[149947], 99.50th=[177210], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 58, max= 318, per=24.24%, avg=175.25, stdev=70.88, samples=64 iops : min= 3, max= 19, avg=10.20, stdev= 4.50, samples=64 write: IOPS=12, BW=200KiB/s (205kB/s)(6544KiB/32679msec); 0 zone resets clat (usec): min=1618, max=244715, avg=37707.03, stdev=35493.77 lat (usec): min=1620, max=244717, avg=37710.43, stdev=35492.52 clat percentiles (usec): | 1.00th=[ 1827], 5.00th=[ 3326], 10.00th=[ 4883], 20.00th=[ 7111], | 30.00th=[ 11469], 40.00th=[ 18220], 50.00th=[ 28181], 60.00th=[ 39060], | 70.00th=[ 49021], 80.00th=[ 63177], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[154141], 99.50th=[160433], 99.90th=[244319], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 62, max= 351, per=26.21%, avg=199.45, stdev=71.89, samples=64 iops : min= 3, max= 21, avg=11.73, stdev= 4.54, samples=64 lat (usec) : 50=0.39%, 100=3.39%, 250=0.52% lat (msec) : 2=0.91%, 4=3.39%, 10=11.07%, 20=10.29%, 50=35.94% lat (msec) : 100=28.52%, 250=5.60% cpu : usr=0.09%, sys=5.70%, ctx=1707, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179526: Mon Aug 24 12:33:10 2026 read: IOPS=11, BW=189KiB/s (194kB/s)(6256KiB/33084msec) clat (usec): min=41, max=247617, avg=47281.85, stdev=34156.66 lat (usec): min=41, max=247618, avg=47290.77, stdev=34151.22 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 9896], 20.00th=[ 24511], | 30.00th=[ 30540], 40.00th=[ 35914], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 56361], 80.00th=[ 66847], 90.00th=[ 83362], 95.00th=[101188], | 99.00th=[191890], 99.50th=[223347], 99.90th=[248513], 99.95th=[248513], | 99.99th=[248513] bw ( KiB/s): min= 63, max= 384, per=26.21%, avg=189.49, stdev=62.72, samples=65 iops : min= 3, max= 24, avg=11.12, stdev= 4.08, samples=65 write: IOPS=11, BW=182KiB/s (187kB/s)(6032KiB/33084msec); 0 zone resets clat (usec): min=1451, max=184228, avg=38355.95, stdev=36039.10 lat (usec): min=1453, max=184230, avg=38360.48, stdev=36040.01 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2900], 10.00th=[ 4490], 20.00th=[ 6652], | 30.00th=[ 10552], 40.00th=[ 18744], 50.00th=[ 27919], 60.00th=[ 36963], | 70.00th=[ 51119], 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[113771], | 99.00th=[152044], 99.50th=[164627], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 31, max= 410, per=23.75%, avg=180.77, stdev=89.43, samples=65 iops : min= 1, max= 25, avg=10.55, stdev= 5.62, samples=65 lat (usec) : 50=0.13%, 100=4.17%, 250=0.52%, 750=0.13% lat (msec) : 2=1.30%, 4=2.99%, 10=10.29%, 20=8.59%, 50=36.98% lat (msec) : 100=29.17%, 250=5.73% cpu : usr=0.06%, sys=5.37%, ctx=1753, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179527: Mon Aug 24 12:33:10 2026 read: IOPS=11, BW=186KiB/s (190kB/s)(6032KiB/32443msec) clat (usec): min=47, max=204290, avg=46724.26, stdev=34413.99 lat (usec): min=47, max=204291, avg=46732.42, stdev=34417.43 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 63], 10.00th=[ 79], 20.00th=[ 23200], | 30.00th=[ 28705], 40.00th=[ 35390], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 57934], 80.00th=[ 69731], 90.00th=[ 86508], 95.00th=[112722], | 99.00th=[160433], 99.50th=[202376], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 63, max= 383, per=26.12%, avg=188.83, stdev=79.87, samples=63 iops : min= 3, max= 23, avg=11.05, stdev= 5.08, samples=63 write: IOPS=12, BW=193KiB/s (197kB/s)(6256KiB/32443msec); 0 zone resets clat (usec): min=1407, max=242450, avg=37087.98, stdev=37928.70 lat (usec): min=1407, max=242452, avg=37090.86, stdev=37927.98 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 2040], 10.00th=[ 3163], 20.00th=[ 5276], | 30.00th=[ 9241], 40.00th=[ 17433], 50.00th=[ 27657], 60.00th=[ 35914], | 70.00th=[ 46400], 80.00th=[ 63701], 90.00th=[ 83362], 95.00th=[109577], | 99.00th=[173016], 99.50th=[202376], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 384, per=25.40%, avg=193.27, stdev=85.08, samples=64 iops : min= 1, max= 24, avg=11.33, stdev= 5.43, samples=64 lat (usec) : 50=0.26%, 100=5.99%, 250=0.52% lat (msec) : 2=2.47%, 4=5.21%, 10=8.46%, 20=7.42%, 50=36.07% lat (msec) : 100=27.34%, 250=6.25% cpu : usr=0.08%, sys=5.72%, ctx=1731, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=724KiB/s (741kB/s), 176KiB/s-189KiB/s (180kB/s-194kB/s), io=23.4MiB (24.5MB), run=31285-33084msec WRITE: bw=762KiB/s (780kB/s), 182KiB/s-204KiB/s (187kB/s-208kB/s), io=24.6MiB (25.8MB), run=31285-33084msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179520: Mon Aug 24 12:33:21 2026 read: IOPS=8, BW=134KiB/s (138kB/s)(5920KiB/44037msec) clat (msec): min=7, max=228, avg=44.58, stdev=41.43 lat (msec): min=7, max=228, avg=44.58, stdev=41.43 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 57], 90.00th=[ 101], 95.00th=[ 142], | 99.00th=[ 203], 99.50th=[ 222], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 30, max= 447, per=25.51%, avg=138.54, stdev=95.07, samples=84 iops : min= 1, max= 27, avg= 7.89, stdev= 5.97, samples=84 write: IOPS=9, BW=145KiB/s (148kB/s)(6368KiB/44037msec); 0 zone resets clat (msec): min=14, max=415, avg=69.02, stdev=48.91 lat (msec): min=14, max=415, avg=69.03, stdev=48.91 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 63], | 70.00th=[ 80], 80.00th=[ 103], 90.00th=[ 138], 95.00th=[ 165], | 99.00th=[ 251], 99.50th=[ 288], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 31, max= 415, per=25.20%, avg=143.92, stdev=88.40, samples=87 iops : min= 1, max= 25, avg= 8.23, stdev= 5.54, samples=87 lat (msec) : 10=1.43%, 20=12.76%, 50=45.96%, 100=24.35%, 250=14.97% lat (msec) : 500=0.52% cpu : usr=0.04%, sys=1.89%, ctx=1264, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179521: Mon Aug 24 12:33:21 2026 read: IOPS=8, BW=130KiB/s (133kB/s)(5744KiB/44083msec) clat (msec): min=8, max=230, avg=47.11, stdev=40.84 lat (msec): min=8, max=230, avg=47.11, stdev=40.83 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 103], 95.00th=[ 136], | 99.00th=[ 197], 99.50th=[ 228], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 29, max= 412, per=24.61%, avg=133.64, stdev=90.42, samples=84 iops : min= 1, max= 25, avg= 7.57, stdev= 5.71, samples=84 write: IOPS=9, BW=148KiB/s (152kB/s)(6544KiB/44083msec); 0 zone resets clat (msec): min=14, max=325, avg=65.62, stdev=45.20 lat (msec): min=14, max=325, avg=65.62, stdev=45.20 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 97], 90.00th=[ 131], 95.00th=[ 150], | 99.00th=[ 220], 99.50th=[ 279], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 29, max= 411, per=25.86%, avg=147.67, stdev=89.05, samples=87 iops : min= 1, max= 25, avg= 8.46, stdev= 5.59, samples=87 lat (msec) : 10=0.78%, 20=11.33%, 50=47.66%, 100=25.65%, 250=14.06% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.82%, ctx=1190, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179522: Mon Aug 24 12:33:21 2026 read: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43771msec) clat (msec): min=7, max=233, avg=47.63, stdev=43.95 lat (msec): min=7, max=233, avg=47.64, stdev=43.94 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 51], 80.00th=[ 70], 90.00th=[ 109], 95.00th=[ 148], | 99.00th=[ 215], 99.50th=[ 234], 99.90th=[ 234], 99.95th=[ 234], | 99.99th=[ 234] bw ( KiB/s): min= 31, max= 574, per=26.66%, avg=144.78, stdev=104.60, samples=85 iops : min= 1, max= 35, avg= 8.28, stdev= 6.57, samples=85 write: IOPS=8, BW=138KiB/s (141kB/s)(6032KiB/43771msec); 0 zone resets clat (msec): min=16, max=275, avg=65.85, stdev=42.30 lat (msec): min=16, max=275, avg=65.85, stdev=42.29 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 54], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 94], 90.00th=[ 124], 95.00th=[ 153], | 99.00th=[ 232], 99.50th=[ 271], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 383, per=23.82%, avg=136.00, stdev=78.51, samples=86 iops : min= 1, max= 23, avg= 7.73, stdev= 4.93, samples=86 lat (msec) : 10=1.30%, 20=12.37%, 50=44.79%, 100=26.95%, 250=14.32% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=1.72%, ctx=1218, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179523: Mon Aug 24 12:33:21 2026 read: IOPS=8, BW=137KiB/s (141kB/s)(6032KiB/43922msec) clat (msec): min=6, max=179, avg=44.78, stdev=34.71 lat (msec): min=6, max=179, avg=44.80, stdev=34.73 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 51], 80.00th=[ 67], 90.00th=[ 97], 95.00th=[ 125], | 99.00th=[ 165], 99.50th=[ 169], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 31, max= 414, per=25.52%, avg=138.60, stdev=91.69, samples=84 iops : min= 1, max= 25, avg= 7.89, stdev= 5.76, samples=84 write: IOPS=8, BW=142KiB/s (146kB/s)(6256KiB/43922msec); 0 zone resets clat (msec): min=15, max=410, avg=68.46, stdev=48.68 lat (msec): min=15, max=410, avg=68.47, stdev=48.68 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 24], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 62], | 70.00th=[ 78], 80.00th=[ 104], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 232], 99.50th=[ 249], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 31, max= 352, per=24.90%, avg=142.16, stdev=82.27, samples=85 iops : min= 1, max= 22, avg= 8.12, stdev= 5.19, samples=85 lat (msec) : 10=1.56%, 20=10.68%, 50=47.14%, 100=25.26%, 250=15.23% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.83%, ctx=1205, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=543KiB/s (556kB/s), 130KiB/s-143KiB/s (133kB/s-146kB/s), io=23.4MiB (24.5MB), run=43771-44083msec WRITE: bw=572KiB/s (585kB/s), 138KiB/s-148KiB/s (141kB/s-152kB/s), io=24.6MiB (25.8MB), run=43771-44083msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179544: Mon Aug 24 12:33:35 2026 read: IOPS=1, BW=1990KiB/s (2038kB/s)(7168KiB/3602msec) clat (usec): min=714, max=321037, avg=208143.36, stdev=106706.25 lat (usec): min=716, max=321038, avg=208144.68, stdev=106706.09 clat percentiles (usec): | 1.00th=[ 717], 5.00th=[ 717], 10.00th=[ 717], 20.00th=[152044], | 30.00th=[200279], 40.00th=[200279], 50.00th=[238027], 60.00th=[265290], | 70.00th=[265290], 80.00th=[278922], 90.00th=[320865], 95.00th=[320865], | 99.00th=[320865], 99.50th=[320865], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 1475, max= 4079, per=47.92%, avg=2304.80, stdev=1017.20, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1421KiB/s (1456kB/s)(5120KiB/3602msec); 0 zone resets clat (msec): min=165, max=669, avg=361.81, stdev=233.10 lat (msec): min=165, max=670, avg=361.93, stdev=233.13 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1935, max= 4007, per=39.48%, avg=2659.00, stdev=1168.47, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.08%, sys=19.83%, ctx=312, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179545: Mon Aug 24 12:33:35 2026 read: IOPS=0, BW=481KiB/s (493kB/s)(2048KiB/4257msec) clat (msec): min=266, max=291, avg=279.33, stdev=17.73 lat (msec): min=266, max=291, avg=279.33, stdev=17.73 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 292], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 292], 95.00th=[ 292], | 99.00th=[ 292], 99.50th=[ 292], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 1450, max= 2000, per=35.86%, avg=1725.00, stdev=388.91, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2405KiB/s (2463kB/s)(10.0MiB/4257msec); 0 zone resets clat (msec): min=102, max=517, avg=355.08, stdev=171.48 lat (msec): min=102, max=517, avg=355.38, stdev=171.42 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 142], | 30.00th=[ 146], 40.00th=[ 266], 50.00th=[ 443], 60.00th=[ 447], | 70.00th=[ 481], 80.00th=[ 502], 90.00th=[ 510], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1935, max= 6119, per=44.99%, avg=3029.83, stdev=1729.96, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=25.00%, 500=58.33%, 750=16.67% cpu : usr=0.00%, sys=18.77%, ctx=220, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179546: Mon Aug 24 12:33:35 2026 read: IOPS=1, BW=1590KiB/s (1629kB/s)(6144KiB/3863msec) clat (usec): min=558, max=641325, avg=264108.72, stdev=278985.30 lat (usec): min=559, max=641326, avg=264110.13, stdev=278985.40 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 1614], | 30.00th=[ 1614], 40.00th=[181404], 50.00th=[181404], 60.00th=[187696], | 70.00th=[574620], 80.00th=[574620], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 2003, max= 4000, per=52.40%, avg=2520.25, stdev=986.65, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1590KiB/s (1629kB/s)(6144KiB/3863msec); 0 zone resets clat (msec): min=171, max=697, avg=295.70, stdev=199.32 lat (msec): min=171, max=698, avg=295.94, stdev=199.23 clat percentiles (msec): | 1.00th=[ 171], 5.00th=[ 171], 10.00th=[ 171], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 232], 50.00th=[ 232], 60.00th=[ 239], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1460, max= 4087, per=34.21%, avg=2304.20, stdev=1023.50, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=58.33%, 750=25.00% cpu : usr=0.00%, sys=16.96%, ctx=220, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179547: Mon Aug 24 12:33:35 2026 read: IOPS=1, BW=1231KiB/s (1261kB/s)(5120KiB/4159msec) clat (usec): min=525, max=297286, avg=104213.99, stdev=143248.52 lat (usec): min=526, max=297286, avg=104215.05, stdev=143248.36 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], 20.00th=[ 529], | 30.00th=[ 1598], 40.00th=[ 1598], 50.00th=[ 2573], 60.00th=[ 2573], | 70.00th=[219153], 80.00th=[219153], 90.00th=[295699], 95.00th=[295699], | 99.00th=[295699], 99.50th=[295699], 99.90th=[295699], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 4071, max= 4087, per=84.80%, avg=4079.00, stdev=11.31, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1723KiB/s (1765kB/s)(7168KiB/4159msec); 0 zone resets clat (msec): min=98, max=873, avg=450.18, stdev=320.95 lat (msec): min=98, max=873, avg=450.33, stdev=320.93 clat percentiles (msec): | 1.00th=[ 99], 5.00th=[ 99], 10.00th=[ 99], 20.00th=[ 157], | 30.00th=[ 186], 40.00th=[ 186], 50.00th=[ 401], 60.00th=[ 642], | 70.00th=[ 642], 80.00th=[ 802], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 1490, max= 2043, per=28.22%, avg=1900.60, stdev=233.45, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 4=8.33%, 100=8.33%, 250=25.00%, 500=16.67% lat (msec) : 750=8.33%, 1000=16.67% cpu : usr=0.00%, sys=12.55%, ctx=93, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4811KiB/s (4926kB/s), 481KiB/s-1990KiB/s (493kB/s-2038kB/s), io=20.0MiB (20.0MB), run=3602-4257msec WRITE: bw=6735KiB/s (6897kB/s), 1421KiB/s-2405KiB/s (1456kB/s-2463kB/s), io=28.0MiB (29.4MB), run=3602-4257msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179540: Mon Aug 24 12:33:35 2026 read: IOPS=2, BW=2055KiB/s (2104kB/s)(7168KiB/3488msec) clat (msec): min=72, max=231, avg=154.96, stdev=60.89 lat (msec): min=72, max=231, avg=154.96, stdev=60.89 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 96], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 161], 60.00th=[ 165], | 70.00th=[ 165], 80.00th=[ 230], 90.00th=[ 232], 95.00th=[ 232], | 99.00th=[ 232], 99.50th=[ 232], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 2043, max= 4202, per=77.48%, avg=3444.00, stdev=1214.66, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1468KiB/s (1503kB/s)(5120KiB/3488msec); 0 zone resets clat (msec): min=138, max=756, avg=449.66, stdev=244.49 lat (msec): min=139, max=756, avg=449.78, stdev=244.45 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 279], 40.00th=[ 279], 50.00th=[ 489], 60.00th=[ 489], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1984, max= 2043, per=32.59%, avg=2028.25, stdev=29.50, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% cpu : usr=0.09%, sys=6.40%, ctx=119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179541: Mon Aug 24 12:33:35 2026 read: IOPS=0, BW=445KiB/s (455kB/s)(2048KiB/4607msec) clat (msec): min=89, max=287, avg=188.64, stdev=140.49 lat (msec): min=89, max=287, avg=188.64, stdev=140.49 clat percentiles (msec): | 1.00th=[ 90], 5.00th=[ 90], 10.00th=[ 90], 20.00th=[ 90], | 30.00th=[ 90], 40.00th=[ 90], 50.00th=[ 90], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 288], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1497, max= 2043, per=39.82%, avg=1770.00, stdev=386.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2223KiB/s (2276kB/s)(10.0MiB/4607msec); 0 zone resets clat (msec): min=109, max=825, avg=402.34, stdev=261.01 lat (msec): min=109, max=825, avg=402.55, stdev=260.93 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 111], | 30.00th=[ 188], 40.00th=[ 251], 50.00th=[ 338], 60.00th=[ 372], | 70.00th=[ 418], 80.00th=[ 676], 90.00th=[ 743], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 1980, max= 4087, per=37.92%, avg=2360.00, stdev=846.50, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.00%, sys=8.86%, ctx=138, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179542: Mon Aug 24 12:33:35 2026 read: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec) clat (msec): min=64, max=680, avg=285.48, stdev=217.66 lat (msec): min=64, max=680, avg=285.48, stdev=217.66 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 268], 50.00th=[ 268], 60.00th=[ 275], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2023, max= 4096, per=76.54%, avg=3402.00, stdev=1194.26, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1645KiB/s (1685kB/s)(6144KiB/3734msec); 0 zone resets clat (msec): min=131, max=523, avg=313.57, stdev=144.32 lat (msec): min=131, max=523, avg=313.69, stdev=144.32 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 249], | 30.00th=[ 249], 40.00th=[ 262], 50.00th=[ 262], 60.00th=[ 271], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 523], 95.00th=[ 523], | 99.00th=[ 523], 99.50th=[ 523], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 2023, max= 3757, per=38.24%, avg=2379.60, stdev=770.06, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.03%, sys=5.33%, ctx=73, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179543: Mon Aug 24 12:33:35 2026 read: IOPS=1, BW=1272KiB/s (1303kB/s)(5120KiB/4025msec) clat (msec): min=88, max=833, avg=383.25, stdev=333.21 lat (msec): min=88, max=833, avg=383.25, stdev=333.21 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 89], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 207], 60.00th=[ 207], | 70.00th=[ 642], 80.00th=[ 642], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 4047, max= 4087, per=91.50%, avg=4067.00, stdev=28.28, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1781KiB/s (1824kB/s)(7168KiB/4025msec); 0 zone resets clat (msec): min=102, max=617, avg=287.91, stdev=227.51 lat (msec): min=103, max=617, avg=288.05, stdev=227.48 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 107], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 188], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 609], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1984, max= 4413, per=45.10%, avg=2806.67, stdev=1391.26, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=8.33%, 750=25.00%, 1000=8.33% cpu : usr=0.05%, sys=6.34%, ctx=127, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4445KiB/s (4552kB/s), 445KiB/s-2055KiB/s (455kB/s-2104kB/s), io=20.0MiB (20.0MB), run=3488-4607msec WRITE: bw=6224KiB/s (6373kB/s), 1468KiB/s-2223KiB/s (1503kB/s-2276kB/s), io=28.0MiB (29.4MB), run=3488-4607msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=179553: Mon Aug 24 12:33:51 2026 read: IOPS=0, BW=3933KiB/s (4028kB/s)(12.0MiB/3124msec) clat (msec): min=891, max=1242, avg=1011.47, stdev=200.02 lat (msec): min=891, max=1242, avg=1011.47, stdev=200.02 clat percentiles (msec): | 1.00th=[ 894], 5.00th=[ 894], 10.00th=[ 894], 20.00th=[ 894], | 30.00th=[ 894], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.06%, sys=3.97%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179554: Mon Aug 24 12:33:51 2026 read: IOPS=0, BW=1340KiB/s (1372kB/s)(4096KiB/3057msec) clat (nsec): min=381062k, max=381062k, avg=381062415.00, stdev= 0.00 lat (nsec): min=381066k, max=381066k, avg=381065718.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 380], 95.00th=[ 380], | 99.00th=[ 380], 99.50th=[ 380], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 7160, max= 7160, per=100.00%, avg=7160.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2680KiB/s (2744kB/s)(8192KiB/3057msec); 0 zone resets clat (msec): min=1241, max=1424, avg=1333.08, stdev=129.42 lat (msec): min=1241, max=1425, avg=1333.75, stdev=130.02 clat percentiles (msec): | 1.00th=[ 1250], 5.00th=[ 1250], 10.00th=[ 1250], 20.00th=[ 1250], | 30.00th=[ 1250], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1418], | 70.00th=[ 1418], 80.00th=[ 1418], 90.00th=[ 1418], 95.00th=[ 1418], | 99.00th=[ 1418], 99.50th=[ 1418], 99.90th=[ 1418], 99.95th=[ 1418], | 99.99th=[ 1418] bw ( KiB/s): min= 8031, max= 8031, per=87.40%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.60%, ctx=43, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179556: Mon Aug 24 12:33:51 2026 write: IOPS=0, BW=3446KiB/s (3529kB/s)(12.0MiB/3566msec); 0 zone resets clat (msec): min=257, max=1824, avg=1160.32, stdev=810.02 lat (msec): min=258, max=1825, avg=1161.02, stdev=810.32 clat percentiles (msec): | 1.00th=[ 257], 5.00th=[ 257], 10.00th=[ 257], 20.00th=[ 257], | 30.00th=[ 257], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8031, max= 8031, per=87.40%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.17%, sys=3.45%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179557: Mon Aug 24 12:33:51 2026 write: IOPS=1, BW=5101KiB/s (5223kB/s)(12.0MiB/2409msec); 0 zone resets clat (msec): min=333, max=1247, avg=769.06, stdev=458.61 lat (msec): min=334, max=1248, avg=769.64, stdev=458.59 clat percentiles (msec): | 1.00th=[ 334], 5.00th=[ 334], 10.00th=[ 334], 20.00th=[ 334], | 30.00th=[ 334], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 726], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 6104, max= 8159, per=77.61%, avg=7131.50, stdev=1453.10, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.12%, sys=5.40%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5245KiB/s (5370kB/s), 1340KiB/s-3933KiB/s (1372kB/s-4028kB/s), io=16.0MiB (16.8MB), run=3057-3124msec WRITE: bw=9189KiB/s (9410kB/s), 2680KiB/s-5101KiB/s (2744kB/s-5223kB/s), io=32.0MiB (33.6MB), run=2409-3566msec rand-rw: (groupid=0, jobs=1): err= 0: pid=179558: Mon Aug 24 12:33:51 2026 read: IOPS=1, BW=4821KiB/s (4936kB/s)(12.0MiB/2549msec) clat (msec): min=743, max=916, avg=849.10, stdev=92.35 lat (msec): min=743, max=916, avg=849.10, stdev=92.35 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 7937, max= 7953, per=100.00%, avg=7945.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.20%, sys=13.89%, ctx=229, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179559: Mon Aug 24 12:33:51 2026 read: IOPS=0, BW=1282KiB/s (1313kB/s)(4096KiB/3195msec) clat (nsec): min=822675k, max=822675k, avg=822675183.00, stdev= 0.00 lat (nsec): min=822679k, max=822679k, avg=822678708.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 827], 5.00th=[ 827], 10.00th=[ 827], 20.00th=[ 827], | 30.00th=[ 827], 40.00th=[ 827], 50.00th=[ 827], 60.00th=[ 827], | 70.00th=[ 827], 80.00th=[ 827], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7968, max= 7968, per=100.00%, avg=7968.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2564KiB/s (2626kB/s)(8192KiB/3195msec); 0 zone resets clat (msec): min=1019, max=1346, avg=1183.36, stdev=231.29 lat (msec): min=1021, max=1347, avg=1184.47, stdev=230.51 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8062, max= 8062, per=86.22%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.82%, ctx=104, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179560: Mon Aug 24 12:33:51 2026 write: IOPS=0, BW=3507KiB/s (3591kB/s)(12.0MiB/3504msec); 0 zone resets clat (msec): min=166, max=1790, avg=1166.93, stdev=875.15 lat (msec): min=166, max=1790, avg=1167.40, stdev=875.33 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8031, max= 8031, per=85.88%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.46%, ctx=32, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=179561: Mon Aug 24 12:33:51 2026 write: IOPS=1, BW=4609KiB/s (4720kB/s)(12.0MiB/2666msec); 0 zone resets clat (msec): min=678, max=1265, avg=887.89, stdev=327.29 lat (msec): min=678, max=1265, avg=888.27, stdev=327.23 clat percentiles (msec): | 1.00th=[ 676], 5.00th=[ 676], 10.00th=[ 676], 20.00th=[ 676], | 30.00th=[ 676], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 6023, max= 7937, per=74.64%, avg=6980.00, stdev=1353.40, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.15%, sys=3.86%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5128KiB/s (5251kB/s), 1282KiB/s-4821KiB/s (1313kB/s-4936kB/s), io=16.0MiB (16.8MB), run=2549-3195msec WRITE: bw=9352KiB/s (9576kB/s), 2564KiB/s-4609KiB/s (2626kB/s-4720kB/s), io=32.0MiB (33.6MB), run=2666-3504msec