== sanity test 398b: DIO and buffer IO race ============== 06:54:14 (1789988054) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.75071 s, 8.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188408: Mon Sep 21 06:56:36 2026 read: IOPS=12, BW=49.3KiB/s (50.5kB/s)(5992KiB/121576msec) clat (usec): min=33, max=337221, avg=43735.73, stdev=28539.28 lat (usec): min=33, max=337222, avg=43739.18, stdev=28539.75 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 4817], 10.00th=[ 16319], 20.00th=[ 22414], | 30.00th=[ 27395], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[ 89654], | 99.00th=[127402], 99.50th=[158335], 99.90th=[295699], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 103, per=25.39%, avg=49.01, stdev=18.41, samples=239 iops : min= 1, max= 25, avg=11.60, stdev= 4.65, samples=239 write: IOPS=12, BW=51.8KiB/s (53.0kB/s)(6296KiB/121576msec); 0 zone resets clat (usec): min=979, max=262363, avg=35492.14, stdev=36627.52 lat (usec): min=980, max=262365, avg=35497.03, stdev=36625.81 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1385], 10.00th=[ 1958], 20.00th=[ 4113], | 30.00th=[ 7504], 40.00th=[ 16450], 50.00th=[ 25560], 60.00th=[ 33424], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[164627], 99.50th=[183501], 99.90th=[225444], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 7, max= 143, per=25.39%, avg=51.30, stdev=22.18, samples=240 iops : min= 1, max= 35, avg=12.17, stdev= 5.55, samples=240 lat (usec) : 50=0.23%, 100=1.73%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=5.27%, 4=4.72%, 10=7.65%, 20=9.54%, 50=40.40% lat (msec) : 100=25.03%, 250=4.88%, 500=0.10% cpu : usr=0.08%, sys=5.76%, ctx=6811, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188409: Mon Sep 21 06:56:36 2026 read: IOPS=12, BW=49.0KiB/s (50.2kB/s)(5940KiB/121203msec) clat (usec): min=43, max=516153, avg=44878.43, stdev=31864.04 lat (usec): min=44, max=516154, avg=44880.21, stdev=31863.74 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12649], 10.00th=[ 17171], 20.00th=[ 22938], | 30.00th=[ 27919], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 62129], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[160433], 99.90th=[358613], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 111, per=25.08%, avg=48.40, stdev=18.87, samples=240 iops : min= 1, max= 27, avg=11.45, stdev= 4.76, samples=240 write: IOPS=13, BW=52.4KiB/s (53.6kB/s)(6348KiB/121203msec); 0 zone resets clat (usec): min=939, max=260068, avg=34249.63, stdev=35662.86 lat (usec): min=941, max=260070, avg=34251.70, stdev=35662.69 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1319], 10.00th=[ 1909], 20.00th=[ 3851], | 30.00th=[ 6652], 40.00th=[ 15401], 50.00th=[ 24773], 60.00th=[ 33424], | 70.00th=[ 43254], 80.00th=[ 59507], 90.00th=[ 83362], 95.00th=[103285], | 99.00th=[156238], 99.50th=[185598], 99.90th=[254804], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 7, max= 119, per=25.76%, avg=52.04, stdev=21.79, samples=239 iops : min= 1, max= 29, avg=12.36, stdev= 5.45, samples=239 lat (usec) : 50=0.13%, 100=1.11%, 250=0.20%, 500=0.10%, 1000=0.03% lat (msec) : 2=5.57%, 4=4.92%, 10=7.85%, 20=9.90%, 50=40.98% lat (msec) : 100=24.32%, 250=4.79%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.61%, ctx=6830, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188410: Mon Sep 21 06:56:36 2026 read: IOPS=12, BW=50.6KiB/s (51.8kB/s)(6028KiB/119238msec) clat (usec): min=39, max=392448, avg=43487.78, stdev=29689.90 lat (usec): min=39, max=392449, avg=43490.34, stdev=29689.43 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 9765], 10.00th=[ 15664], 20.00th=[ 22152], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[168821], 99.90th=[231736], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 7, max= 119, per=26.14%, avg=50.46, stdev=19.51, samples=234 iops : min= 1, max= 29, avg=11.97, stdev= 4.89, samples=234 write: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6260KiB/119238msec); 0 zone resets clat (usec): min=954, max=547869, avg=34202.41, stdev=36702.54 lat (usec): min=956, max=547871, avg=34208.83, stdev=36699.41 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1352], 10.00th=[ 1958], 20.00th=[ 3982], | 30.00th=[ 7308], 40.00th=[ 14615], 50.00th=[ 24511], 60.00th=[ 33162], | 70.00th=[ 44827], 80.00th=[ 60031], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[145753], 99.50th=[166724], 99.90th=[208667], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 7, max= 111, per=25.80%, avg=52.11, stdev=22.77, samples=235 iops : min= 1, max= 27, avg=12.39, stdev= 5.73, samples=235 lat (usec) : 50=0.07%, 100=1.56%, 250=0.33%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=5.37%, 4=4.85%, 10=7.98%, 20=10.97%, 50=40.17% lat (msec) : 100=23.89%, 250=4.65%, 500=0.03%, 750=0.03% cpu : usr=0.08%, sys=5.77%, ctx=6723, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188411: Mon Sep 21 06:56:36 2026 read: IOPS=12, BW=48.7KiB/s (49.9kB/s)(6052KiB/124151msec) clat (usec): min=30, max=339673, avg=44816.50, stdev=32410.40 lat (usec): min=30, max=339675, avg=44820.32, stdev=32413.52 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 281], 10.00th=[ 15533], 20.00th=[ 21890], | 30.00th=[ 26346], 40.00th=[ 31327], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 84411], 95.00th=[106431], | 99.00th=[164627], 99.50th=[185598], 99.90th=[261096], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 7, max= 87, per=24.96%, avg=48.18, stdev=18.37, samples=244 iops : min= 1, max= 21, avg=11.39, stdev= 4.62, samples=244 write: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6236KiB/124151msec); 0 zone resets clat (usec): min=1026, max=554524, avg=36010.52, stdev=38014.27 lat (usec): min=1027, max=554528, avg=36017.52, stdev=38010.31 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1467], 10.00th=[ 2180], 20.00th=[ 4359], | 30.00th=[ 8225], 40.00th=[ 18220], 50.00th=[ 26346], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[106431], | 99.00th=[158335], 99.50th=[183501], 99.90th=[278922], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 7, max= 183, per=24.63%, avg=49.75, stdev=22.23, samples=244 iops : min= 1, max= 45, avg=11.78, stdev= 5.59, samples=244 lat (usec) : 50=0.13%, 100=2.02%, 250=0.26%, 500=0.20%, 1000=0.07% lat (msec) : 2=4.75%, 4=4.95%, 10=7.10%, 20=9.70%, 50=41.08% lat (msec) : 100=23.57%, 250=6.05%, 500=0.10%, 750=0.03% cpu : usr=0.08%, sys=5.57%, ctx=6770, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=193KiB/s (198kB/s), 48.7KiB/s-50.6KiB/s (49.9kB/s-51.8kB/s), io=23.4MiB (24.6MB), run=119238-124151msec WRITE: bw=202KiB/s (207kB/s), 50.2KiB/s-52.5KiB/s (51.4kB/s-53.8kB/s), io=24.6MiB (25.7MB), run=119238-124151msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188403: Mon Sep 21 06:57:16 2026 read: IOPS=9, BW=36.4KiB/s (37.2kB/s)(5992KiB/164771msec) clat (msec): min=5, max=776, avg=42.87, stdev=42.81 lat (msec): min=5, max=776, avg=42.88, stdev=42.81 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 63], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 192], 99.50th=[ 224], 99.90th=[ 288], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 7, max= 119, per=25.49%, avg=36.96, stdev=24.54, samples=316 iops : min= 1, max= 29, avg= 8.58, stdev= 6.16, samples=316 write: IOPS=9, BW=38.2KiB/s (39.1kB/s)(6296KiB/164771msec); 0 zone resets clat (msec): min=10, max=381, avg=63.65, stdev=44.20 lat (msec): min=10, max=381, avg=63.65, stdev=44.20 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 123], 95.00th=[ 150], | 99.00th=[ 224], 99.50th=[ 245], 99.90th=[ 355], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 104, per=25.05%, avg=38.07, stdev=23.28, samples=322 iops : min= 1, max= 26, avg= 8.86, stdev= 5.87, samples=322 lat (msec) : 10=2.28%, 20=14.78%, 50=45.61%, 100=24.41%, 250=12.60% lat (msec) : 500=0.29%, 1000=0.03% cpu : usr=0.05%, sys=1.85%, ctx=4665, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188404: Mon Sep 21 06:57:16 2026 read: IOPS=9, BW=36.1KiB/s (36.0kB/s)(5940KiB/164539msec) clat (msec): min=5, max=951, avg=41.44, stdev=43.48 lat (msec): min=5, max=951, avg=41.44, stdev=43.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 93], 95.00th=[ 124], | 99.00th=[ 176], 99.50th=[ 192], 99.90th=[ 321], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 126, per=25.33%, avg=36.73, stdev=24.00, samples=314 iops : min= 1, max= 31, avg= 8.54, stdev= 6.05, samples=314 write: IOPS=9, BW=38.6KiB/s (39.5kB/s)(6348KiB/164539msec); 0 zone resets clat (msec): min=7, max=420, avg=64.67, stdev=45.48 lat (msec): min=7, max=420, avg=64.67, stdev=45.48 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 95], 90.00th=[ 127], 95.00th=[ 155], | 99.00th=[ 234], 99.50th=[ 275], 99.90th=[ 342], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 103, per=25.21%, avg=38.32, stdev=21.89, samples=321 iops : min= 1, max= 25, avg= 8.92, stdev= 5.51, samples=321 lat (msec) : 10=1.86%, 20=14.62%, 50=46.65%, 100=23.40%, 250=13.09% lat (msec) : 500=0.36%, 1000=0.03% cpu : usr=0.06%, sys=1.84%, ctx=4555, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188405: Mon Sep 21 06:57:16 2026 read: IOPS=9, BW=36.7KiB/s (37.6kB/s)(6028KiB/164164msec) clat (msec): min=5, max=305, avg=42.27, stdev=37.66 lat (msec): min=5, max=305, avg=42.27, stdev=37.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 95], 95.00th=[ 122], | 99.00th=[ 176], 99.50th=[ 218], 99.90th=[ 279], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 7, max= 142, per=25.55%, avg=37.04, stdev=23.82, samples=316 iops : min= 1, max= 35, avg= 8.60, stdev= 6.01, samples=316 write: IOPS=9, BW=38.1KiB/s (39.0kB/s)(6260KiB/164164msec); 0 zone resets clat (msec): min=13, max=961, avg=63.94, stdev=50.28 lat (msec): min=13, max=961, avg=63.94, stdev=50.28 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 49], 60.00th=[ 59], | 70.00th=[ 71], 80.00th=[ 90], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 239], 99.50th=[ 271], 99.90th=[ 422], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 111, per=24.98%, avg=37.97, stdev=22.53, samples=320 iops : min= 1, max= 27, avg= 8.83, stdev= 5.67, samples=320 lat (msec) : 10=1.66%, 20=14.78%, 50=46.00%, 100=25.33%, 250=11.72% lat (msec) : 500=0.49%, 1000=0.03% cpu : usr=0.06%, sys=1.87%, ctx=4503, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188406: Mon Sep 21 06:57:16 2026 read: IOPS=9, BW=36.8KiB/s (37.7kB/s)(6052KiB/164552msec) clat (msec): min=6, max=254, avg=42.76, stdev=37.32 lat (msec): min=6, max=254, avg=42.76, stdev=37.32 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 44], 80.00th=[ 63], 90.00th=[ 96], 95.00th=[ 122], | 99.00th=[ 174], 99.50th=[ 192], 99.90th=[ 247], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 7, max= 134, per=25.75%, avg=37.33, stdev=24.86, samples=315 iops : min= 1, max= 33, avg= 8.68, stdev= 6.27, samples=315 write: IOPS=9, BW=37.9KiB/s (38.8kB/s)(6236KiB/164552msec); 0 zone resets clat (msec): min=13, max=961, avg=63.81, stdev=50.05 lat (msec): min=13, max=961, avg=63.81, stdev=50.05 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 22], 10.00th=[ 26], 20.00th=[ 31], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 48], 60.00th=[ 58], | 70.00th=[ 73], 80.00th=[ 91], 90.00th=[ 120], 95.00th=[ 150], | 99.00th=[ 243], 99.50th=[ 271], 99.90th=[ 372], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 7, max= 104, per=24.69%, avg=37.53, stdev=21.91, samples=322 iops : min= 1, max= 26, avg= 8.72, stdev= 5.52, samples=322 lat (msec) : 10=1.60%, 20=14.55%, 50=46.94%, 100=23.96%, 250=12.53% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.05%, sys=1.85%, ctx=4609, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=146KiB/s (149kB/s), 36.1KiB/s-36.8KiB/s (36.0kB/s-37.7kB/s), io=23.4MiB (24.6MB), run=164164-164771msec WRITE: bw=153KiB/s (156kB/s), 37.9KiB/s-38.6KiB/s (38.8kB/s-39.5kB/s), io=24.6MiB (25.7MB), run=164164-164771msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188459: Mon Sep 21 06:57:57 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(5920KiB/29828msec) clat (usec): min=48, max=239972, avg=43691.70, stdev=28379.53 lat (usec): min=49, max=239972, avg=43693.14, stdev=28379.65 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 73], 10.00th=[ 930], 20.00th=[ 24511], | 30.00th=[ 29754], 40.00th=[ 34866], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 62129], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[122160], 99.50th=[156238], 99.90th=[240124], 99.95th=[240124], | 99.99th=[240124] bw ( KiB/s): min= 95, max= 443, per=25.97%, avg=196.84, stdev=63.54, samples=58 iops : min= 5, max= 27, avg=11.59, stdev= 4.02, samples=58 write: IOPS=13, BW=213KiB/s (219kB/s)(6368KiB/29828msec); 0 zone resets clat (usec): min=1586, max=173316, avg=34082.34, stdev=31619.43 lat (usec): min=1588, max=173318, avg=34096.44, stdev=31618.59 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2442], 10.00th=[ 3687], 20.00th=[ 6587], | 30.00th=[ 9634], 40.00th=[ 17171], 50.00th=[ 26084], 60.00th=[ 32900], | 70.00th=[ 43779], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[143655], 99.50th=[162530], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 63, max= 415, per=26.76%, avg=213.52, stdev=85.29, samples=58 iops : min= 3, max= 25, avg=12.62, stdev= 5.41, samples=58 lat (usec) : 50=0.13%, 100=3.26%, 250=0.91%, 500=0.26%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.95%, 4=4.04%, 10=10.55%, 20=8.20%, 50=40.62% lat (msec) : 100=25.78%, 250=4.04% cpu : usr=0.10%, sys=6.75%, ctx=1741, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188460: Mon Sep 21 06:57:57 2026 read: IOPS=11, BW=186KiB/s (191kB/s)(5744KiB/30801msec) clat (usec): min=54, max=149242, avg=44495.50, stdev=26310.07 lat (usec): min=55, max=149243, avg=44529.30, stdev=26292.48 clat percentiles (usec): | 1.00th=[ 63], 5.00th=[ 81], 10.00th=[ 17695], 20.00th=[ 24773], | 30.00th=[ 30540], 40.00th=[ 34866], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 55313], 80.00th=[ 63701], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[126354], 99.50th=[137364], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 26, max= 384, per=24.47%, avg=185.45, stdev=72.25, samples=60 iops : min= 1, max= 24, avg=10.85, stdev= 4.60, samples=60 write: IOPS=13, BW=212KiB/s (218kB/s)(6544KiB/30801msec); 0 zone resets clat (usec): min=1472, max=184186, avg=35522.98, stdev=32993.84 lat (usec): min=1473, max=184189, avg=35525.64, stdev=32993.90 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2278], 10.00th=[ 3326], 20.00th=[ 6194], | 30.00th=[ 10683], 40.00th=[ 18220], 50.00th=[ 26346], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 61604], 90.00th=[ 85459], 95.00th=[ 99091], | 99.00th=[135267], 99.50th=[143655], 99.90th=[183501], 99.95th=[183501], | 99.99th=[183501] bw ( KiB/s): min= 32, max= 380, per=26.46%, avg=211.18, stdev=84.22, samples=60 iops : min= 2, max= 23, avg=12.47, stdev= 5.30, samples=60 lat (usec) : 100=2.47%, 250=0.52%, 750=0.26% lat (msec) : 2=1.43%, 4=5.47%, 10=8.72%, 20=9.51%, 50=41.28% lat (msec) : 100=26.30%, 250=4.04% cpu : usr=0.08%, sys=6.81%, ctx=1822, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188461: Mon Sep 21 06:57:57 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6256KiB/31572msec) clat (usec): min=49, max=205904, avg=47164.89, stdev=31761.54 lat (usec): min=51, max=205905, avg=47173.70, stdev=31767.12 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 73], 10.00th=[ 186], 20.00th=[ 24249], | 30.00th=[ 30016], 40.00th=[ 34866], 50.00th=[ 42730], 60.00th=[ 49021], | 70.00th=[ 60556], 80.00th=[ 70779], 90.00th=[ 86508], 95.00th=[109577], | 99.00th=[145753], 99.50th=[154141], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 63, max= 380, per=26.21%, avg=198.65, stdev=71.75, samples=62 iops : min= 3, max= 23, avg=11.68, stdev= 4.47, samples=62 write: IOPS=11, BW=191KiB/s (196kB/s)(6032KiB/31572msec); 0 zone resets clat (usec): min=1446, max=187074, avg=34046.55, stdev=31848.67 lat (usec): min=1448, max=187076, avg=34055.00, stdev=31843.79 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2245], 10.00th=[ 3490], 20.00th=[ 6063], | 30.00th=[ 10028], 40.00th=[ 17433], 50.00th=[ 25035], 60.00th=[ 35914], | 70.00th=[ 45876], 80.00th=[ 56886], 90.00th=[ 77071], 95.00th=[ 95945], | 99.00th=[141558], 99.50th=[158335], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 31, max= 448, per=24.08%, avg=192.16, stdev=86.14, samples=61 iops : min= 1, max= 28, avg=11.26, stdev= 5.47, samples=61 lat (usec) : 50=0.13%, 100=3.52%, 250=1.56%, 750=0.26% lat (msec) : 2=1.17%, 4=5.08%, 10=8.72%, 20=8.07%, 50=38.93% lat (msec) : 100=26.95%, 250=5.60% cpu : usr=0.09%, sys=6.49%, ctx=1816, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188462: Mon Sep 21 06:57:57 2026 read: IOPS=12, BW=198KiB/s (203kB/s)(6032KiB/30425msec) clat (usec): min=36, max=157415, avg=41868.70, stdev=29615.81 lat (usec): min=36, max=157417, avg=41870.12, stdev=29615.85 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 67], 10.00th=[ 113], 20.00th=[ 21103], | 30.00th=[ 27395], 40.00th=[ 33162], 50.00th=[ 38011], 60.00th=[ 43254], | 70.00th=[ 50070], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[145753], 99.50th=[156238], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 31, max= 384, per=26.49%, avg=200.83, stdev=73.69, samples=59 iops : min= 1, max= 24, avg=11.81, stdev= 4.73, samples=59 write: IOPS=12, BW=206KiB/s (211kB/s)(6256KiB/30425msec); 0 zone resets clat (usec): min=1561, max=166731, avg=36863.15, stdev=35680.06 lat (usec): min=1563, max=166734, avg=36865.64, stdev=35680.28 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2311], 10.00th=[ 3458], 20.00th=[ 6259], | 30.00th=[ 10290], 40.00th=[ 16319], 50.00th=[ 24511], 60.00th=[ 36439], | 70.00th=[ 45351], 80.00th=[ 63177], 90.00th=[ 89654], 95.00th=[108528], | 99.00th=[145753], 99.50th=[166724], 99.90th=[166724], 99.95th=[166724], | 99.99th=[166724] bw ( KiB/s): min= 63, max= 443, per=25.80%, avg=205.87, stdev=78.20, samples=60 iops : min= 3, max= 27, avg=12.13, stdev= 4.97, samples=60 lat (usec) : 50=0.13%, 100=4.69%, 250=0.65%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.56%, 4=5.08%, 10=9.38%, 20=9.77%, 50=39.32% lat (msec) : 100=23.44%, 250=5.60% cpu : usr=0.08%, sys=6.34%, ctx=1701, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=759KiB/s (777kB/s), 186KiB/s-198KiB/s (191kB/s-203kB/s), io=23.4MiB (24.5MB), run=29828-31572msec WRITE: bw=798KiB/s (817kB/s), 191KiB/s-213KiB/s (196kB/s-219kB/s), io=24.6MiB (25.8MB), run=29828-31572msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188454: Mon Sep 21 06:58:08 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(5920KiB/42386msec) clat (msec): min=7, max=275, avg=43.46, stdev=40.90 lat (msec): min=7, max=275, avg=43.46, stdev=40.90 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 23], 40.00th=[ 26], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 61], 90.00th=[ 97], 95.00th=[ 131], | 99.00th=[ 201], 99.50th=[ 236], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 383, per=24.34%, avg=137.53, stdev=85.71, samples=81 iops : min= 1, max= 23, avg= 7.75, stdev= 5.40, samples=81 write: IOPS=9, BW=150KiB/s (154kB/s)(6368KiB/42386msec); 0 zone resets clat (msec): min=11, max=292, avg=65.82, stdev=44.52 lat (msec): min=11, max=292, avg=65.83, stdev=44.52 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 22], 10.00th=[ 27], 20.00th=[ 32], | 30.00th=[ 37], 40.00th=[ 43], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 93], 90.00th=[ 130], 95.00th=[ 153], | 99.00th=[ 215], 99.50th=[ 264], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 31, max= 415, per=24.77%, avg=147.16, stdev=87.67, samples=83 iops : min= 1, max= 25, avg= 8.36, stdev= 5.54, samples=83 lat (msec) : 10=1.82%, 20=12.11%, 50=48.31%, 100=23.96%, 250=13.41% lat (msec) : 500=0.39% cpu : usr=0.06%, sys=2.08%, ctx=1243, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188455: Mon Sep 21 06:58:08 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5744KiB/42330msec) clat (msec): min=6, max=273, avg=44.83, stdev=39.13 lat (msec): min=6, max=273, avg=44.83, stdev=39.13 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 45], 80.00th=[ 66], 90.00th=[ 104], 95.00th=[ 133], | 99.00th=[ 171], 99.50th=[ 245], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 29, max= 416, per=24.36%, avg=137.64, stdev=91.76, samples=81 iops : min= 1, max= 26, avg= 7.75, stdev= 5.80, samples=81 write: IOPS=9, BW=155KiB/s (158kB/s)(6544KiB/42330msec); 0 zone resets clat (msec): min=15, max=235, avg=63.56, stdev=41.29 lat (msec): min=15, max=235, avg=63.56, stdev=41.29 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 58], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 123], 95.00th=[ 159], | 99.00th=[ 203], 99.50th=[ 224], 99.90th=[ 236], 99.95th=[ 236], | 99.99th=[ 236] bw ( KiB/s): min= 31, max= 351, per=25.54%, avg=151.70, stdev=85.86, samples=83 iops : min= 1, max= 21, avg= 8.65, stdev= 5.41, samples=83 lat (msec) : 10=1.30%, 20=11.33%, 50=48.18%, 100=25.52%, 250=13.54% lat (msec) : 500=0.13% cpu : usr=0.08%, sys=1.94%, ctx=1195, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188456: Mon Sep 21 06:58:08 2026 read: IOPS=9, BW=149KiB/s (153kB/s)(6256KiB/41913msec) clat (msec): min=6, max=225, avg=44.80, stdev=37.42 lat (msec): min=6, max=225, avg=44.80, stdev=37.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 65], 90.00th=[ 104], 95.00th=[ 131], | 99.00th=[ 174], 99.50th=[ 215], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 510, per=26.40%, avg=149.17, stdev=104.21, samples=83 iops : min= 1, max= 31, avg= 8.48, stdev= 6.57, samples=83 write: IOPS=8, BW=144KiB/s (147kB/s)(6032KiB/41913msec); 0 zone resets clat (msec): min=10, max=285, avg=64.35, stdev=40.05 lat (msec): min=10, max=285, avg=64.35, stdev=40.05 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 75], 80.00th=[ 95], 90.00th=[ 116], 95.00th=[ 140], | 99.00th=[ 209], 99.50th=[ 228], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 31, max= 382, per=24.14%, avg=143.37, stdev=78.43, samples=83 iops : min= 1, max= 23, avg= 8.12, stdev= 4.96, samples=83 lat (msec) : 10=1.17%, 20=11.20%, 50=48.18%, 100=25.39%, 250=13.93% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=2.02%, ctx=1194, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188457: Mon Sep 21 06:58:08 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6032KiB/41583msec) clat (msec): min=7, max=205, avg=44.15, stdev=35.07 lat (msec): min=7, max=205, avg=44.16, stdev=35.06 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 62], 90.00th=[ 94], 95.00th=[ 117], | 99.00th=[ 174], 99.50th=[ 190], 99.90th=[ 207], 99.95th=[ 207], | 99.99th=[ 207] bw ( KiB/s): min= 31, max= 415, per=25.47%, avg=143.93, stdev=85.71, samples=82 iops : min= 1, max= 25, avg= 8.16, stdev= 5.44, samples=82 write: IOPS=9, BW=150KiB/s (154kB/s)(6256KiB/41583msec); 0 zone resets clat (msec): min=15, max=238, avg=63.59, stdev=38.22 lat (msec): min=15, max=238, avg=63.61, stdev=38.24 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 61], | 70.00th=[ 77], 80.00th=[ 91], 90.00th=[ 116], 95.00th=[ 140], | 99.00th=[ 190], 99.50th=[ 232], 99.90th=[ 239], 99.95th=[ 239], | 99.99th=[ 239] bw ( KiB/s): min= 31, max= 414, per=25.27%, avg=150.12, stdev=81.49, samples=82 iops : min= 1, max= 25, avg= 8.55, stdev= 5.14, samples=82 lat (msec) : 10=1.04%, 20=10.29%, 50=48.57%, 100=28.39%, 250=11.72% cpu : usr=0.10%, sys=2.11%, ctx=1192, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=565KiB/s (579kB/s), 136KiB/s-149KiB/s (139kB/s-153kB/s), io=23.4MiB (24.5MB), run=41583-42386msec WRITE: bw=595KiB/s (609kB/s), 144KiB/s-155KiB/s (147kB/s-158kB/s), io=24.6MiB (25.8MB), run=41583-42386msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188478: Mon Sep 21 06:58:24 2026 read: IOPS=1, BW=1556KiB/s (1594kB/s)(7168KiB/4606msec) clat (usec): min=558, max=449119, avg=148001.18, stdev=166816.03 lat (usec): min=559, max=449121, avg=148002.65, stdev=166816.25 clat percentiles (usec): | 1.00th=[ 562], 5.00th=[ 562], 10.00th=[ 562], 20.00th=[ 2638], | 30.00th=[ 4817], 40.00th=[ 4817], 50.00th=[125305], 60.00th=[225444], | 70.00th=[225444], 80.00th=[227541], 90.00th=[450888], 95.00th=[450888], | 99.00th=[450888], 99.50th=[450888], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 1615, max= 4087, per=66.12%, avg=2441.00, stdev=1114.72, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1112KiB/s (1138kB/s)(5120KiB/4606msec); 0 zone resets clat (msec): min=177, max=1870, avg=646.07, stdev=696.21 lat (msec): min=177, max=1870, avg=646.15, stdev=696.22 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 178], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 2035, max= 3992, per=58.31%, avg=3013.50, stdev=1383.81, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 10=8.33%, 250=33.33%, 500=25.00%, 750=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=10.58%, ctx=165, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188480: Mon Sep 21 06:58:24 2026 read: IOPS=0, BW=369KiB/s (378kB/s)(2048KiB/5547msec) clat (usec): min=650, max=1919.6k, avg=960119.98, stdev=1356894.73 lat (usec): min=651, max=1919.6k, avg=960121.78, stdev=1356895.68 clat percentiles (usec): | 1.00th=[ 652], 5.00th=[ 652], 10.00th=[ 652], | 20.00th=[ 652], 30.00th=[ 652], 40.00th=[ 652], | 50.00th=[ 652], 60.00th=[1920992], 70.00th=[1920992], | 80.00th=[1920992], 90.00th=[1920992], 95.00th=[1920992], | 99.00th=[1920992], 99.50th=[1920992], 99.90th=[1920992], | 99.95th=[1920992], 99.99th=[1920992] bw ( KiB/s): min= 1996, max= 2039, per=54.65%, avg=2017.50, stdev=30.41, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1846KiB/s (1890kB/s)(10.0MiB/5547msec); 0 zone resets clat (msec): min=177, max=615, avg=345.49, stdev=126.93 lat (msec): min=179, max=616, avg=345.74, stdev=126.69 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 218], | 30.00th=[ 234], 40.00th=[ 292], 50.00th=[ 326], 60.00th=[ 376], | 70.00th=[ 393], 80.00th=[ 405], 90.00th=[ 418], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1996, max= 3764, per=50.41%, avg=2605.00, stdev=890.22, samples=6 iops : min= 1, max= 3, avg= 1.83, stdev= 0.98, samples=6 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=13.94%, ctx=389, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188481: Mon Sep 21 06:58:24 2026 read: IOPS=2, BW=2364KiB/s (2421kB/s)(6144KiB/2599msec) clat (usec): min=490, max=406506, avg=183633.43, stdev=181766.83 lat (usec): min=491, max=406508, avg=183634.76, stdev=181767.07 clat percentiles (usec): | 1.00th=[ 490], 5.00th=[ 490], 10.00th=[ 490], 20.00th=[ 502], | 30.00th=[ 502], 40.00th=[143655], 50.00th=[143655], 60.00th=[152044], | 70.00th=[396362], 80.00th=[396362], 90.00th=[404751], 95.00th=[404751], | 99.00th=[404751], 99.50th=[404751], 99.90th=[404751], 99.95th=[404751], | 99.99th=[404751] bw ( KiB/s): min= 2027, max= 4079, per=73.50%, avg=2713.67, stdev=1182.42, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=2, BW=2364KiB/s (2421kB/s)(6144KiB/2599msec); 0 zone resets clat (msec): min=166, max=338, avg=232.79, stdev=57.09 lat (msec): min=166, max=338, avg=232.87, stdev=57.12 clat percentiles (msec): | 1.00th=[ 167], 5.00th=[ 167], 10.00th=[ 167], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 218], 50.00th=[ 218], 60.00th=[ 220], | 70.00th=[ 239], 80.00th=[ 239], 90.00th=[ 338], 95.00th=[ 338], | 99.00th=[ 338], 99.50th=[ 338], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 2027, max= 3170, per=46.65%, avg=2410.67, stdev=657.61, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 250=58.33%, 500=25.00% cpu : usr=0.00%, sys=20.67%, ctx=150, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188482: Mon Sep 21 06:58:24 2026 read: IOPS=1, BW=1065KiB/s (1091kB/s)(5120KiB/4807msec) clat (usec): min=656, max=232361, avg=118107.01, stdev=109395.67 lat (usec): min=657, max=232362, avg=118108.24, stdev=109395.62 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 660], | 30.00th=[ 3982], 40.00th=[ 3982], 50.00th=[154141], 60.00th=[154141], | 70.00th=[200279], 80.00th=[200279], 90.00th=[231736], 95.00th=[231736], | 99.00th=[231736], 99.50th=[231736], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 2043, max= 5988, per=100.00%, avg=4015.50, stdev=2789.54, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1491KiB/s (1527kB/s)(7168KiB/4807msec); 0 zone resets clat (msec): min=148, max=1849, avg=553.41, stdev=590.30 lat (msec): min=148, max=1849, avg=553.50, stdev=590.29 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 232], | 30.00th=[ 262], 40.00th=[ 262], 50.00th=[ 363], 60.00th=[ 414], | 70.00th=[ 414], 80.00th=[ 609], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 2027, max= 3744, per=45.99%, avg=2376.80, stdev=764.31, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=8.33% lat (msec) : 4=8.33%, 250=41.67%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.15%, ctx=157, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3692KiB/s (3781kB/s), 369KiB/s-2364KiB/s (378kB/s-2421kB/s), io=20.0MiB (20.0MB), run=2599-5547msec WRITE: bw=5169KiB/s (5293kB/s), 1112KiB/s-2364KiB/s (1138kB/s-2421kB/s), io=28.0MiB (29.4MB), run=2599-5547msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188475: Mon Sep 21 06:58:25 2026 read: IOPS=1, BW=1215KiB/s (1244kB/s)(7168KiB/5898msec) clat (msec): min=72, max=729, avg=205.81, stdev=236.30 lat (msec): min=72, max=729, avg=205.82, stdev=236.29 clat percentiles (msec): | 1.00th=[ 72], 5.00th=[ 72], 10.00th=[ 72], 20.00th=[ 77], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 125], 60.00th=[ 144], | 70.00th=[ 144], 80.00th=[ 211], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 2027, max= 4899, per=83.05%, avg=2752.25, stdev=1431.19, samples=4 iops : min= 1, max= 4, avg= 2.00, stdev= 1.41, samples=4 write: IOPS=0, BW=868KiB/s (889kB/s)(5120KiB/5898msec); 0 zone resets clat (msec): min=101, max=2038, avg=881.85, stdev=717.03 lat (msec): min=102, max=2038, avg=882.01, stdev=717.00 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 575], 40.00th=[ 575], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 927], 80.00th=[ 927], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 1872, max= 2027, per=41.94%, avg=1946.00, stdev=77.00, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 750=16.67%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=5.19%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188476: Mon Sep 21 06:58:25 2026 read: IOPS=0, BW=384KiB/s (393kB/s)(2048KiB/5330msec) clat (msec): min=105, max=192, avg=148.67, stdev=61.47 lat (msec): min=105, max=192, avg=148.68, stdev=61.47 clat percentiles (msec): | 1.00th=[ 106], 5.00th=[ 106], 10.00th=[ 106], 20.00th=[ 106], | 30.00th=[ 106], 40.00th=[ 106], 50.00th=[ 106], 60.00th=[ 192], | 70.00th=[ 192], 80.00th=[ 192], 90.00th=[ 192], 95.00th=[ 192], | 99.00th=[ 192], 99.50th=[ 192], 99.90th=[ 192], 99.95th=[ 192], | 99.99th=[ 192] bw ( KiB/s): min= 1471, max= 2048, per=53.09%, avg=1759.50, stdev=408.00, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1921KiB/s (1967kB/s)(10.0MiB/5330msec); 0 zone resets clat (msec): min=88, max=1815, avg=498.63, stdev=500.66 lat (msec): min=88, max=1815, avg=498.79, stdev=500.66 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 171], | 30.00th=[ 182], 40.00th=[ 305], 50.00th=[ 313], 60.00th=[ 422], | 70.00th=[ 439], 80.00th=[ 502], 90.00th=[ 751], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 1872, max= 4096, per=61.12%, avg=2836.00, stdev=1038.67, samples=6 iops : min= 1, max= 4, avg= 2.00, stdev= 1.26, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.04%, sys=4.03%, ctx=95, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188477: Mon Sep 21 06:58:25 2026 read: IOPS=0, BW=994KiB/s (1018kB/s)(6144KiB/6179msec) clat (msec): min=91, max=305, avg=177.24, stdev=88.06 lat (msec): min=91, max=305, avg=177.24, stdev=88.05 clat percentiles (msec): | 1.00th=[ 92], 5.00th=[ 92], 10.00th=[ 92], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 144], 50.00th=[ 144], 60.00th=[ 163], | 70.00th=[ 264], 80.00th=[ 264], 90.00th=[ 305], 95.00th=[ 305], | 99.00th=[ 305], 99.50th=[ 305], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 2027, max= 3992, per=81.14%, avg=2689.00, stdev=1128.48, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=0, BW=994KiB/s (1018kB/s)(6144KiB/6179msec); 0 zone resets clat (msec): min=175, max=2238, avg=829.07, stdev=722.44 lat (msec): min=175, max=2239, avg=829.29, stdev=722.60 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 726], | 70.00th=[ 768], 80.00th=[ 768], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1889, max= 2048, per=43.21%, avg=2005.00, stdev=77.58, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=25.00%, 750=16.67%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=4.92%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188479: Mon Sep 21 06:58:25 2026 read: IOPS=0, BW=850KiB/s (870kB/s)(5120KiB/6025msec) clat (msec): min=110, max=352, avg=217.38, stdev=90.75 lat (msec): min=110, max=352, avg=217.38, stdev=90.75 clat percentiles (msec): | 1.00th=[ 110], 5.00th=[ 110], 10.00th=[ 110], 20.00th=[ 110], | 30.00th=[ 174], 40.00th=[ 174], 50.00th=[ 203], 60.00th=[ 203], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 3992, max= 4096, per=100.00%, avg=4044.00, stdev=73.54, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1190KiB/s (1218kB/s)(7168KiB/6025msec); 0 zone resets clat (msec): min=119, max=2135, avg=697.58, stdev=696.17 lat (msec): min=119, max=2136, avg=698.09, stdev=696.00 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 174], | 30.00th=[ 309], 40.00th=[ 309], 50.00th=[ 498], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 869], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 1889, max= 3136, per=48.00%, avg=2227.00, stdev=512.21, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=3.59%, ctx=110, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3314KiB/s (3394kB/s), 384KiB/s-1215KiB/s (393kB/s-1244kB/s), io=20.0MiB (20.0MB), run=5330-6179msec WRITE: bw=4640KiB/s (4752kB/s), 868KiB/s-1921KiB/s (889kB/s-1967kB/s), io=28.0MiB (29.4MB), run=5330-6179msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=188490: Mon Sep 21 06:58:42 2026 read: IOPS=0, BW=2467KiB/s (2526kB/s)(12.0MiB/4981msec) clat (msec): min=653, max=3221, avg=1641.00, stdev=1382.76 lat (msec): min=653, max=3221, avg=1641.00, stdev=1382.76 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.29%, ctx=31, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188491: Mon Sep 21 06:58:42 2026 read: IOPS=0, BW=726KiB/s (744kB/s)(4096KiB/5639msec) clat (nsec): min=859218k, max=859218k, avg=859217782.00, stdev= 0.00 lat (nsec): min=859220k, max=859220k, avg=859220097.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1453KiB/s (1488kB/s)(8192KiB/5639msec); 0 zone resets clat (msec): min=938, max=3777, avg=2357.79, stdev=2007.57 lat (msec): min=940, max=3780, avg=2360.89, stdev=2008.07 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 936], 50.00th=[ 936], 60.00th=[ 3775], | 70.00th=[ 3775], 80.00th=[ 3775], 90.00th=[ 3775], 95.00th=[ 3775], | 99.00th=[ 3775], 99.50th=[ 3775], 99.90th=[ 3775], 99.95th=[ 3775], | 99.99th=[ 3775] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=2.29%, ctx=52, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188492: Mon Sep 21 06:58:42 2026 write: IOPS=2, BW=9600KiB/s (9830kB/s)(12.0MiB/1280msec); 0 zone resets clat (msec): min=269, max=516, avg=393.26, stdev=123.61 lat (msec): min=269, max=516, avg=393.83, stdev=123.53 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 271], | 30.00th=[ 271], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 518], 80.00th=[ 518], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 8159, max= 8192, per=100.00%, avg=8175.50, stdev=23.33, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 750=33.33% cpu : usr=0.00%, sys=9.30%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188494: Mon Sep 21 06:58:42 2026 write: IOPS=0, BW=2422KiB/s (2480kB/s)(12.0MiB/5074msec); 0 zone resets clat (msec): min=329, max=4179, avg=1654.55, stdev=2187.85 lat (msec): min=329, max=4180, avg=1654.97, stdev=2187.98 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 456], | 70.00th=[ 4178], 80.00th=[ 4178], 90.00th=[ 4178], 95.00th=[ 4178], | 99.00th=[ 4178], 99.50th=[ 4178], 99.90th=[ 4178], 99.95th=[ 4178], | 99.99th=[ 4178] bw ( KiB/s): min= 7135, max= 7135, per=100.00%, avg=7135.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.06%, sys=2.88%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2905KiB/s (2975kB/s), 726KiB/s-2467KiB/s (744kB/s-2526kB/s), io=16.0MiB (16.8MB), run=4981-5639msec WRITE: bw=5811KiB/s (5950kB/s), 1453KiB/s-9600KiB/s (1488kB/s-9830kB/s), io=32.0MiB (33.6MB), run=1280-5639msec rand-rw: (groupid=0, jobs=1): err= 0: pid=188493: Mon Sep 21 06:58:42 2026 read: IOPS=0, BW=2598KiB/s (2660kB/s)(12.0MiB/4730msec) clat (msec): min=617, max=3201, avg=1557.37, stdev=1428.64 lat (msec): min=617, max=3201, avg=1557.38, stdev=1428.64 clat percentiles (msec): | 1.00th=[ 617], 5.00th=[ 617], 10.00th=[ 617], 20.00th=[ 617], | 30.00th=[ 617], 40.00th=[ 852], 50.00th=[ 852], 60.00th=[ 852], | 70.00th=[ 3205], 80.00th=[ 3205], 90.00th=[ 3205], 95.00th=[ 3205], | 99.00th=[ 3205], 99.50th=[ 3205], 99.90th=[ 3205], 99.95th=[ 3205], | 99.99th=[ 3205] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=9.81%, ctx=873, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188495: Mon Sep 21 06:58:42 2026 read: IOPS=0, BW=807KiB/s (826kB/s)(4096KiB/5075msec) clat (nsec): min=545337k, max=545337k, avg=545336950.00, stdev= 0.00 lat (nsec): min=545340k, max=545340k, avg=545339827.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 550], 50.00th=[ 550], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1614KiB/s (1653kB/s)(8192KiB/5075msec); 0 zone resets clat (msec): min=844, max=3568, avg=2206.64, stdev=1926.25 lat (msec): min=844, max=3569, avg=2207.26, stdev=1926.66 clat percentiles (msec): | 1.00th=[ 844], 5.00th=[ 844], 10.00th=[ 844], 20.00th=[ 844], | 30.00th=[ 844], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 3574], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.94%, ctx=131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188496: Mon Sep 21 06:58:42 2026 write: IOPS=0, BW=2218KiB/s (2272kB/s)(12.0MiB/5539msec); 0 zone resets clat (msec): min=204, max=3560, avg=1828.00, stdev=1680.52 lat (msec): min=204, max=3563, avg=1829.33, stdev=1681.70 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 3574], 80.00th=[ 3574], 90.00th=[ 3574], 95.00th=[ 3574], | 99.00th=[ 3574], 99.50th=[ 3574], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.86%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=188497: Mon Sep 21 06:58:42 2026 write: IOPS=0, BW=2684KiB/s (2748kB/s)(12.0MiB/4579msec); 0 zone resets clat (msec): min=253, max=3400, avg=1514.37, stdev=1664.10 lat (msec): min=253, max=3400, avg=1514.65, stdev=1664.02 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 894], 50.00th=[ 894], 60.00th=[ 894], | 70.00th=[ 3406], 80.00th=[ 3406], 90.00th=[ 3406], 95.00th=[ 3406], | 99.00th=[ 3406], 99.50th=[ 3406], 99.90th=[ 3406], 99.95th=[ 3406], | 99.99th=[ 3406] bw ( KiB/s): min= 5962, max= 8159, per=100.00%, avg=7060.50, stdev=1553.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.73%, ctx=55, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3228KiB/s (3306kB/s), 807KiB/s-2598KiB/s (826kB/s-2660kB/s), io=16.0MiB (16.8MB), run=4730-5075msec WRITE: bw=5916KiB/s (6058kB/s), 1614KiB/s-2684KiB/s (1653kB/s-2748kB/s), io=32.0MiB (33.6MB), run=4579-5539msec