== sanity test 398b: DIO and buffer IO race ============== 08:22:49 (1787833369) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.28729 s, 6.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178487: Thu Aug 27 08:25:19 2026 read: IOPS=11, BW=46.0KiB/s (48.1kB/s)(5992KiB/127570msec) clat (usec): min=42, max=834711, avg=47744.19, stdev=35462.76 lat (usec): min=44, max=834712, avg=47752.85, stdev=35464.72 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 12387], 10.00th=[ 17957], 20.00th=[ 24249], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 42206], 60.00th=[ 49021], | 70.00th=[ 56886], 80.00th=[ 68682], 90.00th=[ 82314], 95.00th=[101188], | 99.00th=[147850], 99.50th=[179307], 99.90th=[248513], 99.95th=[834667], | 99.99th=[834667] bw ( KiB/s): min= 7, max= 111, per=24.69%, avg=46.41, stdev=18.15, samples=252 iops : min= 1, max= 27, avg=10.95, stdev= 4.58, samples=252 write: IOPS=12, BW=49.4KiB/s (50.5kB/s)(6296KiB/127570msec); 0 zone resets clat (usec): min=799, max=289698, avg=35211.07, stdev=35405.04 lat (usec): min=800, max=289700, avg=35214.36, stdev=35404.94 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1532], 20.00th=[ 4113], | 30.00th=[ 8455], 40.00th=[ 17171], 50.00th=[ 25822], 60.00th=[ 34866], | 70.00th=[ 44827], 80.00th=[ 60556], 90.00th=[ 84411], 95.00th=[104334], | 99.00th=[147850], 99.50th=[168821], 99.90th=[227541], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 111, per=24.74%, avg=48.74, stdev=22.39, samples=252 iops : min= 1, max= 27, avg=11.54, stdev= 5.63, samples=252 lat (usec) : 50=0.10%, 100=1.56%, 250=0.16%, 500=0.03%, 1000=0.23% lat (msec) : 2=6.15%, 4=3.74%, 10=6.90%, 20=9.24%, 50=39.88% lat (msec) : 100=26.24%, 250=5.70%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.31%, ctx=6528, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178488: Thu Aug 27 08:25:19 2026 read: IOPS=11, BW=47.4KiB/s (48.6kB/s)(5940KiB/125258msec) clat (usec): min=40, max=897348, avg=47535.63, stdev=37666.30 lat (usec): min=40, max=897349, avg=47537.85, stdev=37666.44 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 13435], 10.00th=[ 17695], 20.00th=[ 23987], | 30.00th=[ 29230], 40.00th=[ 34866], 50.00th=[ 40109], 60.00th=[ 47449], | 70.00th=[ 55837], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[152044], 99.50th=[185598], 99.90th=[274727], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 110, per=24.96%, avg=46.93, stdev=17.86, samples=247 iops : min= 1, max= 27, avg=11.07, stdev= 4.51, samples=247 write: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6348KiB/125258msec); 0 zone resets clat (usec): min=842, max=383397, avg=34071.55, stdev=36469.69 lat (usec): min=844, max=383398, avg=34073.49, stdev=36469.68 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1303], 10.00th=[ 1631], 20.00th=[ 3982], | 30.00th=[ 7111], 40.00th=[ 14877], 50.00th=[ 24511], 60.00th=[ 32900], | 70.00th=[ 43254], 80.00th=[ 58459], 90.00th=[ 82314], 95.00th=[103285], | 99.00th=[162530], 99.50th=[181404], 99.90th=[287310], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 126, per=25.56%, avg=50.35, stdev=21.72, samples=246 iops : min= 1, max= 31, avg=11.94, stdev= 5.48, samples=246 lat (usec) : 50=0.26%, 100=1.07%, 250=0.26%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=5.86%, 4=4.36%, 10=7.88%, 20=9.96%, 50=38.67% lat (msec) : 100=25.88%, 250=5.44%, 500=0.10%, 1000=0.03% cpu : usr=0.11%, sys=5.29%, ctx=6502, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178489: Thu Aug 27 08:25:19 2026 read: IOPS=11, BW=47.5KiB/s (48.7kB/s)(6028KiB/126848msec) clat (usec): min=39, max=893832, avg=46359.52, stdev=37229.35 lat (usec): min=39, max=893833, avg=46365.05, stdev=37229.53 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 9110], 10.00th=[ 16450], 20.00th=[ 23200], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 54789], 80.00th=[ 66847], 90.00th=[ 82314], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[181404], 99.90th=[267387], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 103, per=24.96%, avg=46.92, stdev=19.18, samples=250 iops : min= 1, max= 25, avg=11.08, stdev= 4.84, samples=250 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6260KiB/126848msec); 0 zone resets clat (usec): min=830, max=330502, avg=35987.90, stdev=37544.88 lat (usec): min=831, max=330503, avg=35992.32, stdev=37542.83 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1319], 10.00th=[ 1598], 20.00th=[ 3621], | 30.00th=[ 7701], 40.00th=[ 16188], 50.00th=[ 25822], 60.00th=[ 35390], | 70.00th=[ 45876], 80.00th=[ 62653], 90.00th=[ 89654], 95.00th=[109577], | 99.00th=[158335], 99.50th=[181404], 99.90th=[244319], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 7, max= 134, per=24.80%, avg=48.86, stdev=21.87, samples=249 iops : min= 1, max= 33, avg=11.57, stdev= 5.50, samples=249 lat (usec) : 50=0.26%, 100=1.53%, 250=0.29%, 500=0.10%, 1000=0.16% lat (msec) : 2=6.54%, 4=4.20%, 10=6.28%, 20=10.09%, 50=39.52% lat (msec) : 100=25.10%, 250=5.83%, 500=0.07%, 1000=0.03% cpu : usr=0.10%, sys=5.20%, ctx=6454, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178490: Thu Aug 27 08:25:19 2026 read: IOPS=12, BW=48.5KiB/s (49.7kB/s)(6052KiB/124759msec) clat (usec): min=43, max=368646, avg=45849.71, stdev=29930.70 lat (usec): min=43, max=368647, avg=45851.37, stdev=29930.72 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 11731], 10.00th=[ 17433], 20.00th=[ 23725], | 30.00th=[ 28443], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 46924], | 70.00th=[ 55313], 80.00th=[ 64750], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[149947], 99.50th=[164627], 99.90th=[238027], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 7, max= 134, per=25.61%, avg=48.15, stdev=19.50, samples=245 iops : min= 1, max= 33, avg=11.38, stdev= 4.92, samples=245 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6236KiB/124759msec); 0 zone resets clat (usec): min=964, max=863991, avg=35144.05, stdev=41100.62 lat (usec): min=965, max=863993, avg=35149.07, stdev=41103.76 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1565], 20.00th=[ 3916], | 30.00th=[ 7570], 40.00th=[ 15401], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 45351], 80.00th=[ 61080], 90.00th=[ 82314], 95.00th=[105382], | 99.00th=[154141], 99.50th=[170918], 99.90th=[287310], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 7, max= 158, per=25.39%, avg=50.02, stdev=22.44, samples=243 iops : min= 1, max= 39, avg=11.86, stdev= 5.64, samples=243 lat (usec) : 50=0.10%, 100=1.50%, 250=0.26%, 1000=0.03% lat (msec) : 2=6.38%, 4=3.97%, 10=7.23%, 20=9.77%, 50=39.55% lat (msec) : 100=25.88%, 250=5.21%, 500=0.10%, 1000=0.03% cpu : usr=0.09%, sys=5.24%, ctx=6520, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (193kB/s), 46.0KiB/s-48.5KiB/s (48.1kB/s-49.7kB/s), io=23.4MiB (24.6MB), run=124759-127570msec WRITE: bw=197KiB/s (202kB/s), 49.3KiB/s-50.7KiB/s (50.5kB/s-51.9kB/s), io=24.6MiB (25.7MB), run=124759-127570msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178492: Thu Aug 27 08:26:11 2026 read: IOPS=8, BW=33.9KiB/s (34.7kB/s)(5992KiB/176668msec) clat (msec): min=4, max=932, avg=46.03, stdev=43.24 lat (msec): min=4, max=932, avg=46.03, stdev=43.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 93], 95.00th=[ 124], | 99.00th=[ 186], 99.50th=[ 207], 99.90th=[ 338], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 7, max= 102, per=25.75%, avg=34.51, stdev=20.03, samples=337 iops : min= 1, max= 25, avg= 7.95, stdev= 5.04, samples=337 write: IOPS=8, BW=35.6KiB/s (36.5kB/s)(6296KiB/176668msec); 0 zone resets clat (msec): min=10, max=385, avg=68.30, stdev=44.27 lat (msec): min=10, max=385, avg=68.30, stdev=44.27 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 36], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 56], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 125], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 266], 99.90th=[ 376], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 103, per=25.27%, avg=35.38, stdev=18.08, samples=345 iops : min= 1, max= 25, avg= 8.18, stdev= 4.55, samples=345 lat (msec) : 10=1.04%, 20=10.16%, 50=45.08%, 100=30.63%, 250=12.63% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.07%, sys=1.74%, ctx=4636, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178493: Thu Aug 27 08:26:11 2026 read: IOPS=8, BW=33.4KiB/s (34.2kB/s)(5940KiB/177913msec) clat (msec): min=5, max=904, avg=46.72, stdev=46.64 lat (msec): min=5, max=904, avg=46.72, stdev=46.64 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 67], 90.00th=[ 101], 95.00th=[ 130], | 99.00th=[ 197], 99.50th=[ 241], 99.90th=[ 380], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 110, per=25.53%, avg=34.21, stdev=20.63, samples=337 iops : min= 1, max= 27, avg= 7.90, stdev= 5.20, samples=337 write: IOPS=8, BW=35.7KiB/s (36.5kB/s)(6348KiB/177913msec); 0 zone resets clat (msec): min=12, max=420, avg=68.27, stdev=44.31 lat (msec): min=12, max=420, avg=68.27, stdev=44.32 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 25], 10.00th=[ 29], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 56], 60.00th=[ 66], | 70.00th=[ 79], 80.00th=[ 96], 90.00th=[ 126], 95.00th=[ 148], | 99.00th=[ 222], 99.50th=[ 268], 99.90th=[ 384], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 7, max= 104, per=25.24%, avg=35.33, stdev=18.36, samples=349 iops : min= 1, max= 26, avg= 8.18, stdev= 4.63, samples=349 lat (msec) : 10=1.20%, 20=11.39%, 50=43.49%, 100=29.65%, 250=13.74% lat (msec) : 500=0.49%, 1000=0.03% cpu : usr=0.06%, sys=1.73%, ctx=4847, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178494: Thu Aug 27 08:26:11 2026 read: IOPS=8, BW=33.8KiB/s (34.6kB/s)(6028KiB/178523msec) clat (msec): min=5, max=375, avg=47.23, stdev=39.03 lat (msec): min=5, max=375, avg=47.23, stdev=39.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 65], 90.00th=[ 99], 95.00th=[ 132], | 99.00th=[ 182], 99.50th=[ 222], 99.90th=[ 271], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 128, per=25.16%, avg=33.71, stdev=20.16, samples=345 iops : min= 1, max= 32, avg= 7.76, stdev= 5.07, samples=345 write: IOPS=8, BW=35.1KiB/s (35.9kB/s)(6260KiB/178523msec); 0 zone resets clat (msec): min=12, max=901, avg=68.44, stdev=48.89 lat (msec): min=12, max=901, avg=68.45, stdev=48.89 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 41], 40.00th=[ 47], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 79], 80.00th=[ 95], 90.00th=[ 126], 95.00th=[ 157], | 99.00th=[ 222], 99.50th=[ 262], 99.90th=[ 418], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 102, per=24.75%, avg=34.65, stdev=18.72, samples=348 iops : min= 1, max= 25, avg= 8.00, stdev= 4.72, samples=348 lat (msec) : 10=1.14%, 20=9.96%, 50=45.67%, 100=29.10%, 250=13.77% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=1.78%, ctx=4716, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178495: Thu Aug 27 08:26:11 2026 read: IOPS=8, BW=34.0KiB/s (34.8kB/s)(6052KiB/177901msec) clat (msec): min=5, max=344, avg=46.55, stdev=38.97 lat (msec): min=5, max=344, avg=46.55, stdev=38.97 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 66], 90.00th=[ 97], 95.00th=[ 126], | 99.00th=[ 188], 99.50th=[ 222], 99.90th=[ 296], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 104, per=25.57%, avg=34.27, stdev=20.63, samples=343 iops : min= 1, max= 26, avg= 7.91, stdev= 5.20, samples=343 write: IOPS=8, BW=35.1KiB/s (35.9kB/s)(6236KiB/177901msec); 0 zone resets clat (msec): min=11, max=830, avg=68.78, stdev=47.49 lat (msec): min=11, max=830, avg=68.78, stdev=47.49 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 24], 10.00th=[ 28], 20.00th=[ 35], | 30.00th=[ 42], 40.00th=[ 48], 50.00th=[ 57], 60.00th=[ 66], | 70.00th=[ 80], 80.00th=[ 96], 90.00th=[ 125], 95.00th=[ 148], | 99.00th=[ 228], 99.50th=[ 259], 99.90th=[ 443], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 112, per=24.92%, avg=34.89, stdev=17.51, samples=347 iops : min= 1, max= 28, avg= 8.07, stdev= 4.41, samples=347 lat (msec) : 10=1.20%, 20=9.60%, 50=45.31%, 100=29.92%, 250=13.41% lat (msec) : 500=0.52%, 1000=0.03% cpu : usr=0.06%, sys=1.72%, ctx=4670, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=135KiB/s (138kB/s), 33.4KiB/s-34.0KiB/s (34.2kB/s-34.8kB/s), io=23.4MiB (24.6MB), run=176668-178523msec WRITE: bw=141KiB/s (144kB/s), 35.1KiB/s-35.7KiB/s (35.9kB/s-36.5kB/s), io=24.6MiB (25.7MB), run=176668-178523msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178538: Thu Aug 27 08:26:57 2026 read: IOPS=11, BW=184KiB/s (188kB/s)(5920KiB/32209msec) clat (usec): min=43, max=214528, avg=49456.87, stdev=34988.05 lat (usec): min=43, max=214530, avg=49458.54, stdev=34987.84 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 5669], 20.00th=[ 25560], | 30.00th=[ 31065], 40.00th=[ 36963], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 61080], 80.00th=[ 69731], 90.00th=[ 88605], 95.00th=[117965], | 99.00th=[183501], 99.50th=[193987], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 446, per=25.95%, avg=182.94, stdev=70.74, samples=63 iops : min= 1, max= 27, avg=10.68, stdev= 4.44, samples=63 write: IOPS=12, BW=198KiB/s (202kB/s)(6368KiB/32209msec); 0 zone resets clat (usec): min=1323, max=182200, avg=34715.52, stdev=34561.10 lat (usec): min=1324, max=182201, avg=34724.21, stdev=34557.02 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1827], 10.00th=[ 2900], 20.00th=[ 4948], | 30.00th=[ 8717], 40.00th=[ 17171], 50.00th=[ 24249], 60.00th=[ 33817], | 70.00th=[ 42730], 80.00th=[ 61604], 90.00th=[ 84411], 95.00th=[103285], | 99.00th=[158335], 99.50th=[175113], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 31, max= 414, per=26.55%, avg=197.03, stdev=75.24, samples=63 iops : min= 1, max= 25, avg=11.57, stdev= 4.75, samples=63 lat (usec) : 50=0.26%, 100=3.52%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.65%, 4=4.82%, 10=8.85%, 20=8.20%, 50=36.85% lat (msec) : 100=26.56%, 250=6.51% cpu : usr=0.08%, sys=5.59%, ctx=1660, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178539: Thu Aug 27 08:26:57 2026 read: IOPS=10, BW=173KiB/s (177kB/s)(5744KiB/33264msec) clat (usec): min=41, max=171986, avg=48732.00, stdev=31197.31 lat (usec): min=41, max=171988, avg=48733.32, stdev=31197.35 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 62], 10.00th=[ 13566], 20.00th=[ 25560], | 30.00th=[ 32375], 40.00th=[ 40109], 50.00th=[ 45876], 60.00th=[ 52167], | 70.00th=[ 57410], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[149947], 99.50th=[154141], 99.90th=[173016], 99.95th=[173016], | 99.99th=[173016] bw ( KiB/s): min= 42, max= 285, per=24.53%, avg=172.94, stdev=60.75, samples=65 iops : min= 2, max= 17, avg=10.06, stdev= 3.85, samples=65 write: IOPS=12, BW=197KiB/s (201kB/s)(6544KiB/33264msec); 0 zone resets clat (usec): min=1462, max=178588, avg=37996.22, stdev=36707.80 lat (usec): min=1464, max=178591, avg=37998.63, stdev=36707.81 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1876], 10.00th=[ 2966], 20.00th=[ 5473], | 30.00th=[ 9241], 40.00th=[ 19268], 50.00th=[ 27132], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 88605], 95.00th=[110625], | 99.00th=[149947], 99.50th=[158335], 99.90th=[179307], 99.95th=[179307], | 99.99th=[179307] bw ( KiB/s): min= 63, max= 509, per=26.52%, avg=196.77, stdev=90.16, samples=65 iops : min= 3, max= 31, avg=11.57, stdev= 5.66, samples=65 lat (usec) : 50=0.26%, 100=3.65%, 250=0.39%, 750=0.13%, 1000=0.13% lat (msec) : 2=3.12%, 4=4.95%, 10=8.46%, 20=7.03%, 50=35.94% lat (msec) : 100=29.04%, 250=6.90% cpu : usr=0.08%, sys=5.37%, ctx=1680, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178540: Thu Aug 27 08:26:57 2026 read: IOPS=11, BW=184KiB/s (189kB/s)(6256KiB/33962msec) clat (usec): min=48, max=214813, avg=46874.82, stdev=32536.05 lat (usec): min=49, max=214814, avg=46876.21, stdev=32536.05 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 13566], 20.00th=[ 23462], | 30.00th=[ 29754], 40.00th=[ 36439], 50.00th=[ 41157], 60.00th=[ 46924], | 70.00th=[ 56361], 80.00th=[ 67634], 90.00th=[ 83362], 95.00th=[113771], | 99.00th=[156238], 99.50th=[202376], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 342, per=26.37%, avg=185.89, stdev=67.39, samples=66 iops : min= 1, max= 21, avg=10.86, stdev= 4.28, samples=66 write: IOPS=11, BW=178KiB/s (182kB/s)(6032KiB/33962msec); 0 zone resets clat (usec): min=1337, max=203095, avg=40835.81, stdev=37905.32 lat (usec): min=1340, max=203098, avg=40838.25, stdev=37905.25 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 2311], 10.00th=[ 4752], 20.00th=[ 8455], | 30.00th=[ 11863], 40.00th=[ 20055], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 50070], 80.00th=[ 69731], 90.00th=[ 99091], 95.00th=[114820], | 99.00th=[158335], 99.50th=[189793], 99.90th=[202376], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 63, max= 349, per=23.65%, avg=175.45, stdev=71.12, samples=66 iops : min= 3, max= 21, avg=10.21, stdev= 4.44, samples=66 lat (usec) : 50=0.13%, 100=3.12%, 250=1.17%, 750=0.13% lat (msec) : 2=1.82%, 4=2.60%, 10=7.94%, 20=10.55%, 50=39.06% lat (msec) : 100=25.65%, 250=7.81% cpu : usr=0.08%, sys=5.46%, ctx=1755, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178541: Thu Aug 27 08:26:57 2026 read: IOPS=11, BW=190KiB/s (195kB/s)(6032KiB/31722msec) clat (usec): min=42, max=256982, avg=46910.59, stdev=32765.10 lat (usec): min=43, max=256983, avg=46912.45, stdev=32765.65 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 84], 20.00th=[ 24511], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 49546], | 70.00th=[ 59507], 80.00th=[ 70779], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[143655], 99.50th=[179307], 99.90th=[256902], 99.95th=[256902], | 99.99th=[256902] bw ( KiB/s): min= 31, max= 384, per=26.95%, avg=190.03, stdev=83.79, samples=62 iops : min= 1, max= 24, avg=11.15, stdev= 5.35, samples=62 write: IOPS=12, BW=197KiB/s (202kB/s)(6256KiB/31722msec); 0 zone resets clat (usec): min=1433, max=177203, avg=35339.04, stdev=35419.75 lat (usec): min=1435, max=177204, avg=35341.53, stdev=35419.53 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1958], 10.00th=[ 3294], 20.00th=[ 5669], | 30.00th=[ 8979], 40.00th=[ 14484], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 46924], 80.00th=[ 61080], 90.00th=[ 87557], 95.00th=[109577], | 99.00th=[162530], 99.50th=[173016], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 446, per=26.74%, avg=198.39, stdev=82.90, samples=62 iops : min= 1, max= 27, avg=11.66, stdev= 5.21, samples=62 lat (usec) : 50=0.78%, 100=4.56%, 250=0.65% lat (msec) : 2=2.73%, 4=3.39%, 10=10.42%, 20=8.98%, 50=35.16% lat (msec) : 100=27.21%, 250=5.99%, 500=0.13% cpu : usr=0.07%, sys=5.60%, ctx=1588, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=705KiB/s (722kB/s), 173KiB/s-190KiB/s (177kB/s-195kB/s), io=23.4MiB (24.5MB), run=31722-33962msec WRITE: bw=742KiB/s (760kB/s), 178KiB/s-198KiB/s (182kB/s-202kB/s), io=24.6MiB (25.8MB), run=31722-33962msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178543: Thu Aug 27 08:27:07 2026 read: IOPS=8, BW=134KiB/s (138kB/s)(5920KiB/44077msec) clat (msec): min=7, max=247, avg=47.07, stdev=43.69 lat (msec): min=7, max=247, avg=47.08, stdev=43.70 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 37], | 70.00th=[ 51], 80.00th=[ 69], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 209], 99.50th=[ 241], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 31, max= 544, per=25.74%, avg=139.78, stdev=97.78, samples=83 iops : min= 1, max= 34, avg= 8.00, stdev= 6.19, samples=83 write: IOPS=9, BW=144KiB/s (148kB/s)(6368KiB/44077msec); 0 zone resets clat (msec): min=10, max=315, avg=66.86, stdev=48.61 lat (msec): min=10, max=315, avg=66.86, stdev=48.61 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 51], 60.00th=[ 63], | 70.00th=[ 77], 80.00th=[ 99], 90.00th=[ 131], 95.00th=[ 153], | 99.00th=[ 288], 99.50th=[ 309], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 412, per=25.41%, avg=145.12, stdev=92.29, samples=86 iops : min= 1, max= 25, avg= 8.33, stdev= 5.85, samples=86 lat (msec) : 10=1.69%, 20=13.67%, 50=43.75%, 100=25.65%, 250=14.45% lat (msec) : 500=0.78% cpu : usr=0.06%, sys=1.73%, ctx=1167, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178544: Thu Aug 27 08:27:07 2026 read: IOPS=8, BW=130KiB/s (134kB/s)(5744KiB/44021msec) clat (msec): min=6, max=255, avg=45.23, stdev=42.35 lat (msec): min=6, max=255, avg=45.23, stdev=42.35 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 18], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 66], 90.00th=[ 104], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 236], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 30, max= 478, per=25.48%, avg=138.38, stdev=93.30, samples=82 iops : min= 1, max= 29, avg= 7.91, stdev= 5.88, samples=82 write: IOPS=9, BW=149KiB/s (152kB/s)(6544KiB/44021msec); 0 zone resets clat (msec): min=13, max=294, avg=67.80, stdev=46.23 lat (msec): min=13, max=294, avg=67.80, stdev=46.23 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 54], 60.00th=[ 65], | 70.00th=[ 83], 80.00th=[ 102], 90.00th=[ 130], 95.00th=[ 159], | 99.00th=[ 224], 99.50th=[ 241], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 512, per=25.89%, avg=147.80, stdev=97.50, samples=87 iops : min= 1, max= 32, avg= 8.51, stdev= 6.20, samples=87 lat (msec) : 10=2.08%, 20=12.50%, 50=44.66%, 100=25.13%, 250=15.23% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.66%, ctx=1128, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178545: Thu Aug 27 08:27:07 2026 read: IOPS=8, BW=142KiB/s (145kB/s)(6256KiB/44034msec) clat (msec): min=6, max=255, avg=46.00, stdev=41.62 lat (msec): min=6, max=255, avg=46.00, stdev=41.62 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 50], 80.00th=[ 68], 90.00th=[ 108], 95.00th=[ 136], | 99.00th=[ 205], 99.50th=[ 236], 99.90th=[ 255], 99.95th=[ 255], | 99.99th=[ 255] bw ( KiB/s): min= 30, max= 509, per=26.46%, avg=143.69, stdev=107.77, samples=86 iops : min= 1, max= 31, avg= 8.24, stdev= 6.83, samples=86 write: IOPS=8, BW=137KiB/s (140kB/s)(6032KiB/44034msec); 0 zone resets clat (msec): min=12, max=231, avg=68.98, stdev=47.14 lat (msec): min=12, max=231, avg=68.99, stdev=47.14 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 43], 50.00th=[ 54], 60.00th=[ 68], | 70.00th=[ 86], 80.00th=[ 105], 90.00th=[ 140], 95.00th=[ 169], | 99.00th=[ 218], 99.50th=[ 224], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 30, max= 446, per=24.01%, avg=137.08, stdev=88.12, samples=86 iops : min= 1, max= 27, avg= 7.83, stdev= 5.58, samples=86 lat (msec) : 10=2.73%, 20=15.10%, 50=41.02%, 100=24.48%, 250=16.54% lat (msec) : 500=0.13% cpu : usr=0.05%, sys=1.66%, ctx=1125, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178546: Thu Aug 27 08:27:07 2026 read: IOPS=8, BW=138KiB/s (141kB/s)(6032KiB/43856msec) clat (msec): min=6, max=219, avg=47.26, stdev=41.14 lat (msec): min=6, max=219, avg=47.26, stdev=41.14 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 52], 80.00th=[ 72], 90.00th=[ 114], 95.00th=[ 142], | 99.00th=[ 190], 99.50th=[ 213], 99.90th=[ 220], 99.95th=[ 220], | 99.99th=[ 220] bw ( KiB/s): min= 30, max= 446, per=25.88%, avg=140.52, stdev=93.97, samples=83 iops : min= 1, max= 27, avg= 8.04, stdev= 5.92, samples=83 write: IOPS=8, BW=143KiB/s (146kB/s)(6256KiB/43856msec); 0 zone resets clat (msec): min=10, max=318, avg=66.49, stdev=46.45 lat (msec): min=10, max=318, avg=66.50, stdev=46.45 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 37], 40.00th=[ 44], 50.00th=[ 52], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 94], 90.00th=[ 136], 95.00th=[ 161], | 99.00th=[ 224], 99.50th=[ 271], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 448, per=24.86%, avg=141.94, stdev=88.60, samples=85 iops : min= 1, max= 28, avg= 8.13, stdev= 5.59, samples=85 lat (msec) : 10=2.34%, 20=12.89%, 50=42.97%, 100=26.17%, 250=15.23% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=1.77%, ctx=1116, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=543KiB/s (556kB/s), 130KiB/s-142KiB/s (134kB/s-145kB/s), io=23.4MiB (24.5MB), run=43856-44077msec WRITE: bw=572KiB/s (585kB/s), 137KiB/s-149KiB/s (140kB/s-152kB/s), io=24.6MiB (25.8MB), run=43856-44077msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178558: Thu Aug 27 08:27:19 2026 read: IOPS=1, BW=1712KiB/s (1753kB/s)(7168KiB/4188msec) clat (msec): min=103, max=770, avg=312.04, stdev=264.13 lat (msec): min=103, max=770, avg=312.04, stdev=264.13 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 192], 60.00th=[ 247], | 70.00th=[ 247], 80.00th=[ 600], 90.00th=[ 768], 95.00th=[ 768], | 99.00th=[ 768], 99.50th=[ 768], 99.90th=[ 768], 99.95th=[ 768], | 99.99th=[ 768] bw ( KiB/s): min= 2007, max= 5036, per=62.53%, avg=2774.25, stdev=1507.89, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 write: IOPS=1, BW=1223KiB/s (1252kB/s)(5120KiB/4188msec); 0 zone resets clat (msec): min=154, max=1014, avg=391.62, stdev=360.53 lat (msec): min=154, max=1014, avg=391.79, stdev=360.48 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1899, max= 2039, per=32.15%, avg=1997.40, stdev=56.33, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=66.67%, 500=8.33%, 750=8.33%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.20%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178559: Thu Aug 27 08:27:19 2026 read: IOPS=0, BW=589KiB/s (603kB/s)(2048KiB/3477msec) clat (msec): min=127, max=283, avg=205.24, stdev=110.51 lat (msec): min=127, max=283, avg=205.24, stdev=110.51 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 128], | 30.00th=[ 128], 40.00th=[ 128], 50.00th=[ 128], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 284], 90.00th=[ 284], 95.00th=[ 284], | 99.00th=[ 284], 99.50th=[ 284], 99.90th=[ 284], 99.95th=[ 284], | 99.99th=[ 284] bw ( KiB/s): min= 1665, max= 1996, per=41.26%, avg=1830.50, stdev=234.05, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2945KiB/s (3016kB/s)(10.0MiB/3477msec); 0 zone resets clat (msec): min=119, max=481, avg=285.25, stdev=125.18 lat (msec): min=120, max=481, avg=285.37, stdev=125.20 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 169], | 30.00th=[ 203], 40.00th=[ 211], 50.00th=[ 255], 60.00th=[ 257], | 70.00th=[ 279], 80.00th=[ 430], 90.00th=[ 451], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 1665, max= 4079, per=56.71%, avg=3522.60, stdev=1044.34, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 250=41.67%, 500=58.33% cpu : usr=0.00%, sys=2.96%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178560: Thu Aug 27 08:27:19 2026 read: IOPS=1, BW=1331KiB/s (1363kB/s)(6144KiB/4615msec) clat (msec): min=139, max=941, avg=479.91, stdev=346.56 lat (msec): min=139, max=941, avg=479.91, stdev=346.56 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 309], 50.00th=[ 309], 60.00th=[ 338], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 944], 95.00th=[ 944], | 99.00th=[ 944], 99.50th=[ 944], 99.90th=[ 944], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 2007, max= 4055, per=57.11%, avg=2534.00, stdev=1014.10, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1331KiB/s (1363kB/s)(6144KiB/4615msec); 0 zone resets clat (msec): min=126, max=492, avg=263.56, stdev=130.91 lat (msec): min=126, max=492, avg=263.66, stdev=130.92 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 161], | 30.00th=[ 161], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 245], | 70.00th=[ 321], 80.00th=[ 321], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1899, max= 3413, per=37.66%, avg=2339.50, stdev=718.17, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 1000=16.67% cpu : usr=0.07%, sys=2.77%, ctx=69, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178561: Thu Aug 27 08:27:19 2026 read: IOPS=1, BW=1267KiB/s (1297kB/s)(5120KiB/4042msec) clat (msec): min=153, max=793, avg=308.60, stdev=272.03 lat (msec): min=153, max=793, avg=308.60, stdev=272.03 clat percentiles (msec): | 1.00th=[ 155], 5.00th=[ 155], 10.00th=[ 155], 20.00th=[ 155], | 30.00th=[ 192], 40.00th=[ 192], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 207], 80.00th=[ 207], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 2027, max= 4015, per=60.71%, avg=2693.67, stdev=1144.32, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1773KiB/s (1816kB/s)(7168KiB/4042msec); 0 zone resets clat (msec): min=159, max=893, avg=345.47, stdev=255.99 lat (msec): min=159, max=893, avg=346.66, stdev=255.68 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 192], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 257], 60.00th=[ 284], | 70.00th=[ 284], 80.00th=[ 418], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 3683, max= 4079, per=62.04%, avg=3853.67, stdev=203.58, samples=3 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=3 lat (msec) : 250=58.33%, 500=25.00%, 1000=16.67% cpu : usr=0.00%, sys=2.23%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4438KiB/s (4544kB/s), 589KiB/s-1712KiB/s (603kB/s-1753kB/s), io=20.0MiB (20.0MB), run=3477-4615msec WRITE: bw=6213KiB/s (6362kB/s), 1223KiB/s-2945KiB/s (1252kB/s-3016kB/s), io=28.0MiB (29.4MB), run=3477-4615msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178563: Thu Aug 27 08:27:20 2026 read: IOPS=1, BW=1921KiB/s (1967kB/s)(7168KiB/3731msec) clat (msec): min=160, max=478, avg=234.24, stdev=113.28 lat (msec): min=160, max=478, avg=234.24, stdev=113.28 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 167], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 188], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 268], 90.00th=[ 481], 95.00th=[ 481], | 99.00th=[ 481], 99.50th=[ 481], 99.90th=[ 481], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 2035, max= 4551, per=67.57%, avg=3478.33, stdev=1298.31, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1372KiB/s (1405kB/s)(5120KiB/3731msec); 0 zone resets clat (msec): min=193, max=674, avg=414.44, stdev=223.90 lat (msec): min=193, max=674, avg=414.54, stdev=223.86 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 359], 60.00th=[ 359], | 70.00th=[ 625], 80.00th=[ 625], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 2000, max= 4071, per=37.42%, avg=2696.67, stdev=1190.25, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=12.31%, ctx=220, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178564: Thu Aug 27 08:27:20 2026 read: IOPS=0, BW=515KiB/s (527kB/s)(2048KiB/3978msec) clat (usec): min=582, max=396523, avg=198552.96, stdev=279972.47 lat (usec): min=584, max=396525, avg=198554.66, stdev=279972.72 clat percentiles (usec): | 1.00th=[ 586], 5.00th=[ 586], 10.00th=[ 586], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[ 586], 50.00th=[ 586], 60.00th=[396362], | 70.00th=[396362], 80.00th=[396362], 90.00th=[396362], 95.00th=[396362], | 99.00th=[396362], 99.50th=[396362], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 1510, max= 1924, per=33.35%, avg=1717.00, stdev=292.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2574KiB/s (2636kB/s)(10.0MiB/3978msec); 0 zone resets clat (msec): min=126, max=754, avg=357.22, stdev=194.06 lat (msec): min=126, max=755, avg=357.95, stdev=194.08 clat percentiles (msec): | 1.00th=[ 127], 5.00th=[ 127], 10.00th=[ 127], 20.00th=[ 169], | 30.00th=[ 236], 40.00th=[ 284], 50.00th=[ 288], 60.00th=[ 296], | 70.00th=[ 393], 80.00th=[ 435], 90.00th=[ 592], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1965, max= 5774, per=49.16%, avg=3543.00, stdev=1595.81, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=12.62%, ctx=193, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178565: Thu Aug 27 08:27:20 2026 read: IOPS=1, BW=1729KiB/s (1771kB/s)(6144KiB/3553msec) clat (usec): min=767, max=483263, avg=173750.59, stdev=184687.01 lat (usec): min=769, max=483265, avg=173751.87, stdev=184687.16 clat percentiles (usec): | 1.00th=[ 766], 5.00th=[ 766], 10.00th=[ 766], 20.00th=[ 1123], | 30.00th=[ 1123], 40.00th=[ 87557], 50.00th=[ 87557], 60.00th=[231736], | 70.00th=[238027], 80.00th=[238027], 90.00th=[484443], 95.00th=[484443], | 99.00th=[484443], 99.50th=[484443], 99.90th=[484443], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 1924, max= 6107, per=64.95%, avg=3343.67, stdev=2393.42, samples=3 iops : min= 1, max= 5, avg= 2.33, stdev= 2.31, samples=3 write: IOPS=1, BW=1729KiB/s (1771kB/s)(6144KiB/3553msec); 0 zone resets clat (msec): min=163, max=577, avg=417.71, stdev=187.21 lat (msec): min=163, max=577, avg=417.85, stdev=187.28 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 199], | 30.00th=[ 199], 40.00th=[ 481], 50.00th=[ 481], 60.00th=[ 514], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1656, max= 4071, per=33.36%, avg=2404.00, stdev=1119.75, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=16.67%, 750=25.00% cpu : usr=0.00%, sys=11.35%, ctx=102, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178566: Thu Aug 27 08:27:20 2026 read: IOPS=1, BW=1347KiB/s (1379kB/s)(5120KiB/3802msec) clat (usec): min=777, max=265321, avg=127804.93, stdev=123788.39 lat (usec): min=778, max=265322, avg=127806.46, stdev=123788.42 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], 20.00th=[ 775], | 30.00th=[ 1893], 40.00th=[ 1893], 50.00th=[141558], 60.00th=[141558], | 70.00th=[229639], 80.00th=[229639], 90.00th=[265290], 95.00th=[265290], | 99.00th=[265290], 99.50th=[265290], 99.90th=[265290], 99.95th=[265290], | 99.99th=[265290] bw ( KiB/s): min= 4000, max= 4071, per=78.39%, avg=4035.50, stdev=50.20, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1885KiB/s (1931kB/s)(7168KiB/3802msec); 0 zone resets clat (msec): min=197, max=809, avg=448.21, stdev=227.03 lat (msec): min=197, max=810, avg=448.43, stdev=226.99 clat percentiles (msec): | 1.00th=[ 199], 5.00th=[ 199], 10.00th=[ 199], 20.00th=[ 218], | 30.00th=[ 363], 40.00th=[ 363], 50.00th=[ 388], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 667], 90.00th=[ 810], 95.00th=[ 810], | 99.00th=[ 810], 99.50th=[ 810], 99.90th=[ 810], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 2000, max= 3930, per=41.05%, avg=2958.75, stdev=1096.27, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 250=33.33%, 500=33.33%, 750=8.33%, 1000=8.33% cpu : usr=0.05%, sys=10.60%, ctx=178, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5148KiB/s (5272kB/s), 515KiB/s-1921KiB/s (527kB/s-1967kB/s), io=20.0MiB (20.0MB), run=3553-3978msec WRITE: bw=7208KiB/s (7381kB/s), 1372KiB/s-2574KiB/s (1405kB/s-2636kB/s), io=28.0MiB (29.4MB), run=3553-3978msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178573: Thu Aug 27 08:27:36 2026 read: IOPS=1, BW=5652KiB/s (5788kB/s)(12.0MiB/2174msec) clat (msec): min=318, max=887, avg=695.45, stdev=326.70 lat (msec): min=318, max=887, avg=695.45, stdev=326.70 clat percentiles (msec): | 1.00th=[ 317], 5.00th=[ 317], 10.00th=[ 317], 20.00th=[ 317], | 30.00th=[ 317], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 885], 80.00th=[ 885], 90.00th=[ 885], 95.00th=[ 885], | 99.00th=[ 885], 99.50th=[ 885], 99.90th=[ 885], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 8094, max= 8110, per=100.00%, avg=8102.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.57%, ctx=58, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178574: Thu Aug 27 08:27:36 2026 read: IOPS=0, BW=1411KiB/s (1445kB/s)(4096KiB/2903msec) clat (nsec): min=382853k, max=382853k, avg=382853305.00, stdev= 0.00 lat (nsec): min=382856k, max=382856k, avg=382855961.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 384], 5.00th=[ 384], 10.00th=[ 384], 20.00th=[ 384], | 30.00th=[ 384], 40.00th=[ 384], 50.00th=[ 384], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 5885, max= 5885, per=100.00%, avg=5885.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2822KiB/s (2890kB/s)(8192KiB/2903msec); 0 zone resets clat (msec): min=729, max=1678, avg=1203.91, stdev=671.37 lat (msec): min=729, max=1679, avg=1204.32, stdev=671.34 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 726], 50.00th=[ 726], 60.00th=[ 1687], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8110, max= 8110, per=72.57%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.10%, sys=4.48%, ctx=75, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178575: Thu Aug 27 08:27:36 2026 write: IOPS=1, BW=4191KiB/s (4292kB/s)(12.0MiB/2932msec); 0 zone resets clat (msec): min=601, max=1324, avg=921.35, stdev=368.67 lat (msec): min=601, max=1324, avg=921.78, stdev=368.66 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 835], 50.00th=[ 835], 60.00th=[ 835], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8110, max= 8192, per=72.94%, avg=8151.00, stdev=57.98, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.99%, ctx=66, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178577: Thu Aug 27 08:27:36 2026 write: IOPS=1, BW=5297KiB/s (5424kB/s)(12.0MiB/2320msec); 0 zone resets clat (msec): min=272, max=1496, avg=724.82, stdev=671.53 lat (msec): min=273, max=1499, avg=726.19, stdev=672.86 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 405], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 5595, max= 8094, per=61.25%, avg=6844.50, stdev=1767.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.09%, sys=6.08%, ctx=44, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5644KiB/s (5779kB/s), 1411KiB/s-5652KiB/s (1445kB/s-5788kB/s), io=16.0MiB (16.8MB), run=2174-2903msec WRITE: bw=10.9MiB/s (11.4MB/s), 2822KiB/s-5297KiB/s (2890kB/s-5424kB/s), io=32.0MiB (33.6MB), run=2320-2932msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178578: Thu Aug 27 08:27:38 2026 read: IOPS=1, BW=5608KiB/s (5743kB/s)(12.0MiB/2191msec) clat (msec): min=685, max=787, avg=729.49, stdev=52.13 lat (msec): min=685, max=787, avg=729.49, stdev=52.13 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8000, max= 8159, per=100.00%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=13.97%, ctx=452, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178579: Thu Aug 27 08:27:38 2026 read: IOPS=0, BW=1510KiB/s (1546kB/s)(4096KiB/2713msec) clat (nsec): min=779483k, max=779483k, avg=779482879.00, stdev= 0.00 lat (nsec): min=779486k, max=779486k, avg=779485652.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 776], 80.00th=[ 776], 90.00th=[ 776], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 8000, max= 8000, per=100.00%, avg=8000.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3020KiB/s (3092kB/s)(8192KiB/2713msec); 0 zone resets clat (msec): min=504, max=1396, avg=950.30, stdev=630.40 lat (msec): min=504, max=1396, avg=950.93, stdev=630.75 clat percentiles (msec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 506], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 506], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8159, max= 8159, per=84.99%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.68%, ctx=179, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178580: Thu Aug 27 08:27:38 2026 write: IOPS=0, BW=3600KiB/s (3687kB/s)(12.0MiB/3413msec); 0 zone resets clat (msec): min=236, max=1855, avg=1134.01, stdev=824.09 lat (msec): min=236, max=1863, avg=1137.04, stdev=827.48 clat percentiles (msec): | 1.00th=[ 236], 5.00th=[ 236], 10.00th=[ 236], 20.00th=[ 236], | 30.00th=[ 236], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1854], 80.00th=[ 1854], 90.00th=[ 1854], 95.00th=[ 1854], | 99.00th=[ 1854], 99.50th=[ 1854], 99.90th=[ 1854], 99.95th=[ 1854], | 99.99th=[ 1854] bw ( KiB/s): min= 8159, max= 8159, per=84.99%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.37%, ctx=42, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178581: Thu Aug 27 08:27:38 2026 write: IOPS=0, BW=3737KiB/s (3827kB/s)(12.0MiB/3288msec); 0 zone resets clat (msec): min=358, max=2042, avg=1091.57, stdev=862.88 lat (msec): min=369, max=2042, avg=1095.52, stdev=858.40 clat percentiles (msec): | 1.00th=[ 359], 5.00th=[ 359], 10.00th=[ 359], 20.00th=[ 359], | 30.00th=[ 359], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8000, max= 8159, per=84.16%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.68%, ctx=46, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6039KiB/s (6184kB/s), 1510KiB/s-5608KiB/s (1546kB/s-5743kB/s), io=16.0MiB (16.8MB), run=2191-2713msec WRITE: bw=9601KiB/s (9831kB/s), 3020KiB/s-3737KiB/s (3092kB/s-3827kB/s), io=32.0MiB (33.6MB), run=2713-3413msec