== sanity test 398b: DIO and buffer IO race ============== 09:39:21 (1787751561) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.7315 s, 5.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180468: Wed Aug 26 09:41:45 2026 read: IOPS=12, BW=49.1KiB/s (50.3kB/s)(5992KiB/121942msec) clat (usec): min=31, max=295225, avg=44449.82, stdev=29969.69 lat (usec): min=32, max=295226, avg=44451.20, stdev=29969.74 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 10683], 10.00th=[ 15795], 20.00th=[ 21365], | 30.00th=[ 26608], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[100140], | 99.00th=[149947], 99.50th=[173016], 99.90th=[261096], 99.95th=[295699], | 99.99th=[295699] bw ( KiB/s): min= 15, max= 104, per=24.72%, avg=48.45, stdev=19.04, samples=240 iops : min= 3, max= 26, avg=11.47, stdev= 4.79, samples=240 write: IOPS=12, BW=51.6KiB/s (52.9kB/s)(6296KiB/121942msec); 0 zone resets clat (usec): min=890, max=507770, avg=34872.81, stdev=39562.01 lat (usec): min=891, max=507771, avg=34875.92, stdev=39561.71 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1221], 10.00th=[ 1500], 20.00th=[ 3359], | 30.00th=[ 6194], 40.00th=[ 13960], 50.00th=[ 24249], 60.00th=[ 32637], | 70.00th=[ 44303], 80.00th=[ 59507], 90.00th=[ 86508], 95.00th=[110625], | 99.00th=[170918], 99.50th=[202376], 99.90th=[248513], 99.95th=[509608], | 99.99th=[509608] bw ( KiB/s): min= 7, max= 149, per=24.74%, avg=50.97, stdev=23.48, samples=240 iops : min= 1, max= 37, avg=12.11, stdev= 5.91, samples=240 lat (usec) : 50=0.26%, 100=1.60%, 250=0.13%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.74%, 4=4.69%, 10=7.19%, 20=11.10%, 50=38.28% lat (msec) : 100=23.80%, 250=5.92%, 500=0.07%, 750=0.03% cpu : usr=0.07%, sys=5.15%, ctx=6450, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180469: Wed Aug 26 09:41:45 2026 read: IOPS=12, BW=49.3KiB/s (50.4kB/s)(5940KiB/120600msec) clat (usec): min=41, max=306018, avg=44074.18, stdev=29958.77 lat (usec): min=42, max=306019, avg=44078.17, stdev=29961.72 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 8979], 10.00th=[ 15008], 20.00th=[ 21103], | 30.00th=[ 26870], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[147850], 99.50th=[158335], 99.90th=[238027], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 111, per=24.87%, avg=48.75, stdev=20.17, samples=238 iops : min= 1, max= 27, avg=11.55, stdev= 5.07, samples=238 write: IOPS=13, BW=52.6KiB/s (53.9kB/s)(6348KiB/120600msec); 0 zone resets clat (usec): min=970, max=491873, avg=34501.29, stdev=37271.17 lat (usec): min=971, max=491874, avg=34505.01, stdev=37271.96 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1188], 10.00th=[ 1483], 20.00th=[ 3294], | 30.00th=[ 6259], 40.00th=[ 14091], 50.00th=[ 23725], 60.00th=[ 33817], | 70.00th=[ 46924], 80.00th=[ 60556], 90.00th=[ 81265], 95.00th=[103285], | 99.00th=[154141], 99.50th=[179307], 99.90th=[235930], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 7, max= 119, per=25.27%, avg=52.05, stdev=22.49, samples=238 iops : min= 1, max= 29, avg=12.38, stdev= 5.64, samples=238 lat (usec) : 50=0.29%, 100=1.82%, 250=0.10%, 750=0.07%, 1000=0.10% lat (msec) : 2=6.28%, 4=5.40%, 10=7.16%, 20=11.13%, 50=37.47% lat (msec) : 100=24.74%, 250=5.37%, 500=0.07% cpu : usr=0.08%, sys=5.23%, ctx=6343, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180470: Wed Aug 26 09:41:45 2026 read: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6028KiB/121495msec) clat (usec): min=34, max=469308, avg=43080.27, stdev=28934.31 lat (usec): min=34, max=469309, avg=43081.81, stdev=28934.11 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 194], 10.00th=[ 15139], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 92799], | 99.00th=[129500], 99.50th=[154141], 99.90th=[204473], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 103, per=25.06%, avg=49.12, stdev=20.76, samples=240 iops : min= 1, max= 25, avg=11.65, stdev= 5.23, samples=240 write: IOPS=12, BW=51.5KiB/s (52.8kB/s)(6260KiB/121495msec); 0 zone resets clat (usec): min=913, max=236378, avg=35877.11, stdev=36804.03 lat (usec): min=914, max=236380, avg=35880.42, stdev=36804.41 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1221], 10.00th=[ 1647], 20.00th=[ 4015], | 30.00th=[ 7504], 40.00th=[ 16909], 50.00th=[ 26608], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 62653], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[162530], 99.50th=[177210], 99.90th=[210764], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 15, max= 119, per=24.86%, avg=51.22, stdev=21.19, samples=239 iops : min= 3, max= 29, avg=12.18, stdev= 5.34, samples=239 lat (usec) : 50=0.68%, 100=1.60%, 250=0.23%, 1000=0.13% lat (msec) : 2=6.22%, 4=3.78%, 10=7.49%, 20=9.86%, 50=40.30% lat (msec) : 100=24.80%, 250=4.88%, 500=0.03% cpu : usr=0.07%, sys=5.17%, ctx=6539, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180471: Wed Aug 26 09:41:45 2026 read: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6052KiB/121078msec) clat (usec): min=34, max=518875, avg=44320.70, stdev=32049.97 lat (usec): min=34, max=518876, avg=44338.78, stdev=32068.41 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 6849], 10.00th=[ 15664], 20.00th=[ 21365], | 30.00th=[ 26346], 40.00th=[ 32375], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[143655], 99.50th=[173016], 99.90th=[274727], 99.95th=[517997], | 99.99th=[517997] bw ( KiB/s): min= 7, max= 128, per=25.25%, avg=49.49, stdev=21.16, samples=239 iops : min= 1, max= 32, avg=11.74, stdev= 5.33, samples=239 write: IOPS=12, BW=51.5KiB/s (52.7kB/s)(6236KiB/121078msec); 0 zone resets clat (usec): min=927, max=291526, avg=34376.86, stdev=37749.12 lat (usec): min=928, max=291527, avg=34379.40, stdev=37749.09 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1614], 20.00th=[ 3261], | 30.00th=[ 6128], 40.00th=[ 12911], 50.00th=[ 21890], 60.00th=[ 32375], | 70.00th=[ 44303], 80.00th=[ 60031], 90.00th=[ 87557], 95.00th=[110625], | 99.00th=[158335], 99.50th=[183501], 99.90th=[248513], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 7, max= 140, per=24.74%, avg=50.96, stdev=22.69, samples=239 iops : min= 1, max= 35, avg=12.10, stdev= 5.71, samples=239 lat (usec) : 50=0.33%, 100=1.73%, 250=0.20%, 500=0.07%, 750=0.10% lat (usec) : 1000=0.13% lat (msec) : 2=6.28%, 4=5.27%, 10=7.68%, 20=11.07%, 50=37.60% lat (msec) : 100=24.09%, 250=5.37%, 500=0.07%, 750=0.03% cpu : usr=0.08%, sys=5.24%, ctx=6459, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=197KiB/s (202kB/s), 49.1KiB/s-49.0KiB/s (50.3kB/s-51.2kB/s), io=23.4MiB (24.6MB), run=120600-121942msec WRITE: bw=206KiB/s (211kB/s), 51.5KiB/s-52.6KiB/s (52.7kB/s-53.9kB/s), io=24.6MiB (25.7MB), run=120600-121942msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180473: Wed Aug 26 09:42:23 2026 read: IOPS=9, BW=37.8KiB/s (38.8kB/s)(5992KiB/158333msec) clat (msec): min=4, max=533, avg=41.47, stdev=41.81 lat (msec): min=4, max=533, avg=41.47, stdev=41.81 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 33], | 70.00th=[ 42], 80.00th=[ 61], 90.00th=[ 95], 95.00th=[ 127], | 99.00th=[ 201], 99.50th=[ 253], 99.90th=[ 338], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 7, max= 134, per=25.66%, avg=38.50, stdev=27.30, samples=303 iops : min= 1, max= 33, avg= 8.99, stdev= 6.86, samples=303 write: IOPS=9, BW=39.8KiB/s (40.7kB/s)(6296KiB/158333msec); 0 zone resets clat (msec): min=11, max=365, avg=61.07, stdev=45.20 lat (msec): min=11, max=365, avg=61.07, stdev=45.20 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 19], 10.00th=[ 23], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 71], 80.00th=[ 92], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 220], 99.50th=[ 259], 99.90th=[ 300], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 143, per=25.19%, avg=39.55, stdev=26.21, samples=310 iops : min= 1, max= 35, avg= 9.25, stdev= 6.56, samples=310 lat (msec) : 10=3.32%, 20=17.12%, 50=44.60%, 100=21.78%, 250=12.63% lat (msec) : 500=0.52%, 750=0.03% cpu : usr=0.05%, sys=1.71%, ctx=4676, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180474: Wed Aug 26 09:42:23 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(5940KiB/159239msec) clat (msec): min=4, max=480, avg=41.93, stdev=44.46 lat (msec): min=4, max=480, avg=41.93, stdev=44.46 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 42], 80.00th=[ 59], 90.00th=[ 100], 95.00th=[ 136], | 99.00th=[ 211], 99.50th=[ 251], 99.90th=[ 351], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 6, max= 151, per=25.30%, avg=37.95, stdev=27.89, samples=305 iops : min= 1, max= 37, avg= 8.85, stdev= 7.00, samples=305 write: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6348KiB/159239msec); 0 zone resets clat (msec): min=7, max=302, avg=61.03, stdev=43.91 lat (msec): min=7, max=302, avg=61.03, stdev=43.92 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 38], 50.00th=[ 46], 60.00th=[ 57], | 70.00th=[ 70], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 213], 99.50th=[ 239], 99.90th=[ 300], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 6, max= 126, per=25.35%, avg=39.80, stdev=26.09, samples=311 iops : min= 1, max= 31, avg= 9.31, stdev= 6.55, samples=311 lat (msec) : 10=4.23%, 20=16.86%, 50=44.01%, 100=21.29%, 250=13.18% lat (msec) : 500=0.42% cpu : usr=0.06%, sys=1.71%, ctx=4824, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180475: Wed Aug 26 09:42:23 2026 read: IOPS=9, BW=37.8KiB/s (38.7kB/s)(6028KiB/159386msec) clat (msec): min=5, max=346, avg=42.12, stdev=41.05 lat (msec): min=5, max=346, avg=42.12, stdev=41.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 62], 90.00th=[ 96], 95.00th=[ 131], | 99.00th=[ 194], 99.50th=[ 247], 99.90th=[ 326], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 143, per=25.20%, avg=37.81, stdev=27.03, samples=310 iops : min= 1, max= 35, avg= 8.81, stdev= 6.77, samples=310 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6260KiB/159386msec); 0 zone resets clat (msec): min=7, max=525, avg=61.20, stdev=45.85 lat (msec): min=7, max=525, avg=61.21, stdev=45.86 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 23], 20.00th=[ 28], | 30.00th=[ 32], 40.00th=[ 38], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 91], 90.00th=[ 124], 95.00th=[ 148], | 99.00th=[ 220], 99.50th=[ 275], 99.90th=[ 288], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 6, max= 119, per=24.70%, avg=38.77, stdev=26.20, samples=314 iops : min= 1, max= 29, avg= 9.05, stdev= 6.58, samples=314 lat (msec) : 10=3.16%, 20=16.54%, 50=45.31%, 100=21.61%, 250=12.86% lat (msec) : 500=0.49%, 750=0.03% cpu : usr=0.05%, sys=1.74%, ctx=4740, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180476: Wed Aug 26 09:42:23 2026 read: IOPS=9, BW=38.1KiB/s (39.0kB/s)(6052KiB/158782msec) clat (msec): min=4, max=346, avg=41.45, stdev=39.05 lat (msec): min=4, max=346, avg=41.46, stdev=39.05 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 45], 80.00th=[ 61], 90.00th=[ 93], 95.00th=[ 124], | 99.00th=[ 180], 99.50th=[ 213], 99.90th=[ 326], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 7, max= 127, per=25.98%, avg=38.97, stdev=26.96, samples=303 iops : min= 1, max= 31, avg= 9.11, stdev= 6.79, samples=303 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6236KiB/158782msec); 0 zone resets clat (msec): min=10, max=479, avg=61.53, stdev=47.45 lat (msec): min=10, max=479, avg=61.54, stdev=47.45 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 56], | 70.00th=[ 70], 80.00th=[ 93], 90.00th=[ 124], 95.00th=[ 155], | 99.00th=[ 230], 99.50th=[ 284], 99.90th=[ 376], 99.95th=[ 481], | 99.99th=[ 481] bw ( KiB/s): min= 7, max= 151, per=24.80%, avg=38.94, stdev=26.37, samples=312 iops : min= 1, max= 37, avg= 9.10, stdev= 6.61, samples=312 lat (msec) : 10=3.09%, 20=17.45%, 50=43.52%, 100=22.82%, 250=12.60% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.72%, ctx=4701, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=151KiB/s (154kB/s), 37.3KiB/s-38.1KiB/s (38.2kB/s-39.0kB/s), io=23.4MiB (24.6MB), run=158333-159386msec WRITE: bw=158KiB/s (162kB/s), 39.3KiB/s-39.9KiB/s (40.2kB/s-40.8kB/s), io=24.6MiB (25.7MB), run=158333-159386msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180520: Wed Aug 26 09:43:02 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5920KiB/27880msec) clat (usec): min=36, max=165229, avg=39146.33, stdev=23693.74 lat (usec): min=37, max=165230, avg=39147.38, stdev=23693.76 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 70], 10.00th=[ 13829], 20.00th=[ 22152], | 30.00th=[ 27395], 40.00th=[ 32113], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 47449], 80.00th=[ 56361], 90.00th=[ 65274], 95.00th=[ 78119], | 99.00th=[113771], 99.50th=[152044], 99.90th=[164627], 99.95th=[164627], | 99.99th=[164627] bw ( KiB/s): min= 96, max= 414, per=25.62%, avg=210.57, stdev=69.31, samples=54 iops : min= 6, max= 25, avg=12.43, stdev= 4.32, samples=54 write: IOPS=14, BW=228KiB/s (234kB/s)(6368KiB/27880msec); 0 zone resets clat (usec): min=1412, max=204193, avg=33557.68, stdev=30509.22 lat (usec): min=1414, max=204195, avg=33560.41, stdev=30509.11 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2245], 10.00th=[ 3523], 20.00th=[ 6587], | 30.00th=[ 11469], 40.00th=[ 17695], 50.00th=[ 24773], 60.00th=[ 32113], | 70.00th=[ 43254], 80.00th=[ 57934], 90.00th=[ 79168], 95.00th=[ 93848], | 99.00th=[124257], 99.50th=[131597], 99.90th=[204473], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 63, max= 411, per=26.45%, avg=228.50, stdev=76.24, samples=54 iops : min= 3, max= 25, avg=13.56, stdev= 4.81, samples=54 lat (usec) : 50=0.78%, 100=2.21%, 250=0.78%, 750=0.13%, 1000=0.26% lat (msec) : 2=1.95%, 4=3.78%, 10=8.46%, 20=12.37%, 50=41.80% lat (msec) : 100=24.74%, 250=2.73% cpu : usr=0.08%, sys=6.67%, ctx=1736, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180521: Wed Aug 26 09:43:02 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5744KiB/28059msec) clat (usec): min=47, max=146060, avg=41924.99, stdev=23550.48 lat (usec): min=48, max=146061, avg=41928.66, stdev=23552.83 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 84], 10.00th=[ 16450], 20.00th=[ 23987], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 51643], 80.00th=[ 59507], 90.00th=[ 66323], 95.00th=[ 81265], | 99.00th=[117965], 99.50th=[143655], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 95, max= 350, per=24.86%, avg=204.31, stdev=60.16, samples=55 iops : min= 5, max= 21, avg=12.04, stdev= 3.85, samples=55 write: IOPS=14, BW=233KiB/s (239kB/s)(6544KiB/28059msec); 0 zone resets clat (usec): min=1494, max=143338, avg=31698.27, stdev=30051.03 lat (usec): min=1495, max=143340, avg=31701.19, stdev=30051.17 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 2180], 10.00th=[ 3032], 20.00th=[ 5407], | 30.00th=[ 8291], 40.00th=[ 13829], 50.00th=[ 23725], 60.00th=[ 32375], | 70.00th=[ 41681], 80.00th=[ 56361], 90.00th=[ 77071], 95.00th=[ 93848], | 99.00th=[127402], 99.50th=[128451], 99.90th=[143655], 99.95th=[143655], | 99.99th=[143655] bw ( KiB/s): min= 31, max= 478, per=26.74%, avg=231.05, stdev=95.13, samples=55 iops : min= 1, max= 29, avg=13.69, stdev= 5.92, samples=55 lat (usec) : 50=0.26%, 100=2.21%, 250=0.13%, 1000=0.13% lat (msec) : 2=2.47%, 4=5.08%, 10=10.68%, 20=10.03%, 50=41.28% lat (msec) : 100=24.48%, 250=3.26% cpu : usr=0.07%, sys=6.77%, ctx=1761, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180522: Wed Aug 26 09:43:02 2026 read: IOPS=13, BW=215KiB/s (220kB/s)(6256KiB/29133msec) clat (usec): min=40, max=184809, avg=40633.73, stdev=27525.11 lat (usec): min=41, max=184810, avg=40634.82, stdev=27525.06 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 72], 10.00th=[ 15139], 20.00th=[ 21627], | 30.00th=[ 26870], 40.00th=[ 31065], 50.00th=[ 36439], 60.00th=[ 41681], | 70.00th=[ 46924], 80.00th=[ 55837], 90.00th=[ 69731], 95.00th=[ 91751], | 99.00th=[149947], 99.50th=[183501], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 94, max= 382, per=26.06%, avg=214.25, stdev=76.60, samples=57 iops : min= 5, max= 23, avg=12.67, stdev= 4.79, samples=57 write: IOPS=12, BW=207KiB/s (212kB/s)(6032KiB/29133msec); 0 zone resets clat (usec): min=1554, max=214370, avg=35057.93, stdev=34046.53 lat (usec): min=1555, max=214372, avg=35069.02, stdev=34054.94 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2040], 10.00th=[ 2999], 20.00th=[ 5604], | 30.00th=[ 9372], 40.00th=[ 17433], 50.00th=[ 24249], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 58459], 90.00th=[ 81265], 95.00th=[101188], | 99.00th=[160433], 99.50th=[177210], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 63, max= 413, per=23.65%, avg=204.30, stdev=75.14, samples=57 iops : min= 3, max= 25, avg=12.04, stdev= 4.79, samples=57 lat (usec) : 50=0.26%, 100=2.86%, 250=0.65%, 500=0.13% lat (msec) : 2=2.47%, 4=4.56%, 10=8.46%, 20=10.68%, 50=43.36% lat (msec) : 100=21.88%, 250=4.69% cpu : usr=0.05%, sys=6.26%, ctx=1828, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180523: Wed Aug 26 09:43:02 2026 read: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26952msec) clat (usec): min=38, max=215035, avg=37788.77, stdev=27807.38 lat (usec): min=38, max=215036, avg=37789.74, stdev=27807.36 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 75], 20.00th=[ 18482], | 30.00th=[ 23725], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 39584], | 70.00th=[ 46924], 80.00th=[ 57934], 90.00th=[ 69731], 95.00th=[ 80217], | 99.00th=[143655], 99.50th=[179307], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 63, max= 472, per=27.19%, avg=223.52, stdev=76.55, samples=52 iops : min= 3, max= 29, avg=13.25, stdev= 4.83, samples=52 write: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26952msec); 0 zone resets clat (usec): min=1535, max=182405, avg=32368.97, stdev=32042.64 lat (usec): min=1538, max=182407, avg=32370.89, stdev=32042.62 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2040], 10.00th=[ 3261], 20.00th=[ 5997], | 30.00th=[ 9503], 40.00th=[ 15664], 50.00th=[ 21890], 60.00th=[ 29492], | 70.00th=[ 39584], 80.00th=[ 54789], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[141558], 99.50th=[152044], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 63, max= 416, per=27.05%, avg=233.75, stdev=81.44, samples=52 iops : min= 3, max= 26, avg=13.90, stdev= 5.12, samples=52 lat (usec) : 50=0.39%, 100=4.95%, 250=0.65%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.73%, 4=3.91%, 10=9.24%, 20=12.50%, 50=41.28% lat (msec) : 100=21.09%, 250=2.99% cpu : usr=0.07%, sys=6.71%, ctx=1723, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=822KiB/s (842kB/s), 205KiB/s-224KiB/s (210kB/s-229kB/s), io=23.4MiB (24.5MB), run=26952-29133msec WRITE: bw=865KiB/s (886kB/s), 207KiB/s-233KiB/s (212kB/s-239kB/s), io=24.6MiB (25.8MB), run=26952-29133msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180515: Wed Aug 26 09:43:14 2026 read: IOPS=9, BW=145KiB/s (148kB/s)(5920KiB/40925msec) clat (msec): min=8, max=230, avg=43.55, stdev=30.25 lat (msec): min=8, max=230, avg=43.55, stdev=30.25 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 32], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 48], 80.00th=[ 58], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 155], 99.50th=[ 163], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 31, max= 318, per=25.16%, avg=145.20, stdev=80.48, samples=80 iops : min= 1, max= 19, avg= 8.25, stdev= 5.07, samples=80 write: IOPS=9, BW=156KiB/s (159kB/s)(6368KiB/40925msec); 0 zone resets clat (msec): min=15, max=318, avg=61.85, stdev=38.52 lat (msec): min=15, max=318, avg=61.86, stdev=38.51 clat percentiles (msec): | 1.00th=[ 19], 5.00th=[ 23], 10.00th=[ 26], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 71], 80.00th=[ 84], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 207], 99.50th=[ 247], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 351, per=25.54%, avg=155.02, stdev=70.58, samples=81 iops : min= 1, max= 21, avg= 8.88, stdev= 4.41, samples=81 lat (msec) : 10=0.26%, 20=9.90%, 50=48.57%, 100=31.90%, 250=9.24% lat (msec) : 500=0.13% cpu : usr=0.04%, sys=2.09%, ctx=1189, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180516: Wed Aug 26 09:43:14 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(5744KiB/41466msec) clat (msec): min=6, max=190, avg=45.18, stdev=33.40 lat (msec): min=6, max=190, avg=45.18, stdev=33.40 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 22], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 50], 80.00th=[ 64], 90.00th=[ 93], 95.00th=[ 123], | 99.00th=[ 165], 99.50th=[ 186], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 31, max= 320, per=24.64%, avg=142.16, stdev=72.06, samples=79 iops : min= 1, max= 20, avg= 8.06, stdev= 4.55, samples=79 write: IOPS=9, BW=158KiB/s (162kB/s)(6544KiB/41466msec); 0 zone resets clat (msec): min=11, max=209, avg=61.33, stdev=37.67 lat (msec): min=11, max=209, avg=61.34, stdev=37.68 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 31], | 30.00th=[ 38], 40.00th=[ 44], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 74], 80.00th=[ 89], 90.00th=[ 118], 95.00th=[ 136], | 99.00th=[ 180], 99.50th=[ 194], 99.90th=[ 209], 99.95th=[ 209], | 99.99th=[ 209] bw ( KiB/s): min= 31, max= 576, per=25.85%, avg=156.89, stdev=85.38, samples=82 iops : min= 1, max= 36, avg= 9.00, stdev= 5.42, samples=82 lat (msec) : 10=1.30%, 20=10.03%, 50=48.70%, 100=29.17%, 250=10.81% cpu : usr=0.05%, sys=1.93%, ctx=1167, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180517: Wed Aug 26 09:43:14 2026 read: IOPS=9, BW=153KiB/s (157kB/s)(6256KiB/40830msec) clat (msec): min=7, max=211, avg=43.33, stdev=32.58 lat (msec): min=7, max=211, avg=43.33, stdev=32.58 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 47], 80.00th=[ 62], 90.00th=[ 84], 95.00th=[ 113], | 99.00th=[ 169], 99.50th=[ 180], 99.90th=[ 211], 99.95th=[ 211], | 99.99th=[ 211] bw ( KiB/s): min= 30, max= 350, per=26.52%, avg=153.00, stdev=82.85, samples=80 iops : min= 1, max= 21, avg= 8.75, stdev= 5.19, samples=80 write: IOPS=9, BW=148KiB/s (151kB/s)(6032KiB/40830msec); 0 zone resets clat (msec): min=10, max=222, avg=63.19, stdev=37.48 lat (msec): min=10, max=222, avg=63.19, stdev=37.48 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 26], 10.00th=[ 30], 20.00th=[ 35], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 51], 60.00th=[ 61], | 70.00th=[ 72], 80.00th=[ 86], 90.00th=[ 116], 95.00th=[ 138], | 99.00th=[ 194], 99.50th=[ 211], 99.90th=[ 224], 99.95th=[ 224], | 99.99th=[ 224] bw ( KiB/s): min= 31, max= 287, per=23.89%, avg=145.01, stdev=61.85, samples=80 iops : min= 1, max= 17, avg= 8.25, stdev= 3.90, samples=80 lat (msec) : 10=0.78%, 20=9.77%, 50=50.26%, 100=27.60%, 250=11.59% cpu : usr=0.05%, sys=1.94%, ctx=1209, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180518: Wed Aug 26 09:43:14 2026 read: IOPS=9, BW=150KiB/s (153kB/s)(6032KiB/40279msec) clat (msec): min=6, max=180, avg=41.71, stdev=29.42 lat (msec): min=6, max=180, avg=41.71, stdev=29.42 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 58], 90.00th=[ 87], 95.00th=[ 106], | 99.00th=[ 146], 99.50th=[ 150], 99.90th=[ 182], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 30, max= 477, per=25.60%, avg=147.70, stdev=78.23, samples=79 iops : min= 1, max= 29, avg= 8.42, stdev= 4.92, samples=79 write: IOPS=9, BW=155KiB/s (159kB/s)(6256KiB/40279msec); 0 zone resets clat (msec): min=14, max=307, avg=62.38, stdev=38.52 lat (msec): min=14, max=307, avg=62.38, stdev=38.51 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 24], 10.00th=[ 26], 20.00th=[ 32], | 30.00th=[ 38], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 62], | 70.00th=[ 73], 80.00th=[ 84], 90.00th=[ 113], 95.00th=[ 136], | 99.00th=[ 207], 99.50th=[ 232], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 319, per=25.39%, avg=154.11, stdev=65.34, samples=79 iops : min= 1, max= 19, avg= 8.82, stdev= 4.09, samples=79 lat (msec) : 10=1.43%, 20=10.29%, 50=47.01%, 100=30.73%, 250=10.42% lat (msec) : 500=0.13% cpu : usr=0.06%, sys=1.92%, ctx=1153, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=578KiB/s (591kB/s), 139KiB/s-153KiB/s (142kB/s-157kB/s), io=23.4MiB (24.5MB), run=40279-41466msec WRITE: bw=608KiB/s (622kB/s), 148KiB/s-158KiB/s (151kB/s-162kB/s), io=24.6MiB (25.8MB), run=40279-41466msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180540: Wed Aug 26 09:43:27 2026 read: IOPS=2, BW=2381KiB/s (2438kB/s)(7168KiB/3011msec) clat (usec): min=525, max=1057.1k, avg=220280.50, stdev=376821.26 lat (usec): min=527, max=1057.1k, avg=220281.97, stdev=376821.38 clat percentiles (usec): | 1.00th=[ 529], 5.00th=[ 529], 10.00th=[ 529], | 20.00th=[ 586], 30.00th=[ 23462], 40.00th=[ 23462], | 50.00th=[ 112722], 60.00th=[ 156238], 70.00th=[ 156238], | 80.00th=[ 191890], 90.00th=[1061159], 95.00th=[1061159], | 99.00th=[1061159], 99.50th=[1061159], 99.90th=[1061159], | 99.95th=[1061159], 99.99th=[1061159] bw ( KiB/s): min= 1969, max= 4055, per=60.28%, avg=3195.00, stdev=1090.10, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1700KiB/s (1741kB/s)(5120KiB/3011msec); 0 zone resets clat (msec): min=164, max=354, avg=284.14, stdev=93.17 lat (msec): min=165, max=354, avg=284.25, stdev=93.13 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 165], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 355], 95.00th=[ 355], | 99.00th=[ 355], 99.50th=[ 355], 99.90th=[ 355], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 2027, max= 6011, per=54.16%, avg=4019.00, stdev=2817.11, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=41.67%, 500=25.00%, 2000=8.33% cpu : usr=0.07%, sys=19.24%, ctx=339, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180541: Wed Aug 26 09:43:27 2026 read: IOPS=0, BW=530KiB/s (543kB/s)(2048KiB/3864msec) clat (usec): min=1158, max=192503, avg=96830.91, stdev=135301.25 lat (usec): min=1159, max=192505, avg=96832.70, stdev=135301.81 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1156], 10.00th=[ 1156], 20.00th=[ 1156], | 30.00th=[ 1156], 40.00th=[ 1156], 50.00th=[ 1156], 60.00th=[191890], | 70.00th=[191890], 80.00th=[191890], 90.00th=[191890], 95.00th=[191890], | 99.00th=[191890], 99.50th=[191890], 99.90th=[191890], 99.95th=[191890], | 99.99th=[191890] bw ( KiB/s): min= 1861, max= 2027, per=36.68%, avg=1944.00, stdev=117.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2650KiB/s (2714kB/s)(10.0MiB/3864msec); 0 zone resets clat (msec): min=84, max=971, avg=356.06, stdev=246.75 lat (msec): min=85, max=971, avg=356.26, stdev=246.76 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 180], | 30.00th=[ 197], 40.00th=[ 205], 50.00th=[ 309], 60.00th=[ 380], | 70.00th=[ 388], 80.00th=[ 397], 90.00th=[ 456], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 2007, max= 4087, per=43.46%, avg=3224.40, stdev=1099.99, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 2=8.33%, 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33% cpu : usr=0.03%, sys=21.23%, ctx=175, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180542: Wed Aug 26 09:43:27 2026 read: IOPS=1, BW=1902KiB/s (1947kB/s)(6144KiB/3231msec) clat (usec): min=503, max=490140, avg=160700.72, stdev=198457.26 lat (usec): min=505, max=490142, avg=160701.89, stdev=198457.29 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 898], | 30.00th=[ 898], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[219153], | 70.00th=[252707], 80.00th=[252707], 90.00th=[488637], 95.00th=[488637], | 99.00th=[488637], 99.50th=[488637], 99.90th=[488637], 99.95th=[488637], | 99.99th=[488637] bw ( KiB/s): min= 2035, max= 4055, per=63.07%, avg=3342.67, stdev=1133.98, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1902KiB/s (1947kB/s)(6144KiB/3231msec); 0 zone resets clat (msec): min=86, max=643, avg=338.57, stdev=223.11 lat (msec): min=86, max=644, avg=338.74, stdev=223.26 clat percentiles (msec): | 1.00th=[ 87], 5.00th=[ 87], 10.00th=[ 87], 20.00th=[ 115], | 30.00th=[ 115], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 368], | 70.00th=[ 535], 80.00th=[ 535], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2003, max= 3828, per=33.24%, avg=2466.25, stdev=907.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=16.67%, 500=33.33%, 750=16.67% cpu : usr=0.00%, sys=20.28%, ctx=158, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180543: Wed Aug 26 09:43:27 2026 read: IOPS=1, BW=1735KiB/s (1777kB/s)(5120KiB/2951msec) clat (usec): min=546, max=300180, avg=112927.30, stdev=129926.15 lat (usec): min=547, max=300181, avg=112928.45, stdev=129926.10 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 545], | 30.00th=[ 1057], 40.00th=[ 1057], 50.00th=[ 73925], 60.00th=[ 73925], | 70.00th=[189793], 80.00th=[189793], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 4007, max= 4055, per=76.06%, avg=4031.00, stdev=33.94, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2429KiB/s (2487kB/s)(7168KiB/2951msec); 0 zone resets clat (msec): min=150, max=680, avg=305.62, stdev=172.46 lat (msec): min=150, max=680, avg=305.75, stdev=172.46 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 215], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 262], 60.00th=[ 275], | 70.00th=[ 275], 80.00th=[ 300], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1875, max= 3938, per=33.16%, avg=2460.75, stdev=987.09, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=23.22%, ctx=213, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5300KiB/s (5427kB/s), 530KiB/s-2381KiB/s (543kB/s-2438kB/s), io=20.0MiB (20.0MB), run=2951-3864msec WRITE: bw=7420KiB/s (7598kB/s), 1700KiB/s-2650KiB/s (1741kB/s-2714kB/s), io=28.0MiB (29.4MB), run=2951-3864msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180535: Wed Aug 26 09:43:27 2026 read: IOPS=1, BW=1693KiB/s (1734kB/s)(7168KiB/4234msec) clat (msec): min=37, max=1252, avg=400.12, stdev=450.60 lat (msec): min=37, max=1252, avg=400.14, stdev=450.60 clat percentiles (msec): | 1.00th=[ 37], 5.00th=[ 37], 10.00th=[ 37], 20.00th=[ 51], | 30.00th=[ 65], 40.00th=[ 65], 50.00th=[ 209], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 676], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1865, max= 2043, per=41.29%, avg=1997.00, stdev=74.40, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1209KiB/s (1238kB/s)(5120KiB/4234msec); 0 zone resets clat (msec): min=43, max=643, avg=241.34, stdev=239.24 lat (msec): min=43, max=643, avg=241.42, stdev=239.24 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 44], 10.00th=[ 44], 20.00th=[ 44], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 140], 60.00th=[ 140], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 642], 95.00th=[ 642], | 99.00th=[ 642], 99.50th=[ 642], 99.90th=[ 642], 99.95th=[ 642], | 99.99th=[ 642] bw ( KiB/s): min= 2003, max= 4087, per=44.97%, avg=3045.00, stdev=1473.61, samples=2 iops : min= 1, max= 3, avg= 2.00, stdev= 1.41, samples=2 lat (msec) : 50=16.67%, 100=16.67%, 250=25.00%, 500=8.33%, 750=25.00% lat (msec) : 2000=8.33% cpu : usr=0.05%, sys=6.38%, ctx=69, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180536: Wed Aug 26 09:43:27 2026 read: IOPS=0, BW=528KiB/s (541kB/s)(2048KiB/3879msec) clat (msec): min=92, max=179, avg=136.41, stdev=61.58 lat (msec): min=92, max=179, avg=136.41, stdev=61.58 clat percentiles (msec): | 1.00th=[ 93], 5.00th=[ 93], 10.00th=[ 93], 20.00th=[ 93], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 93], 60.00th=[ 180], | 70.00th=[ 180], 80.00th=[ 180], 90.00th=[ 180], 95.00th=[ 180], | 99.00th=[ 180], 99.50th=[ 180], 99.90th=[ 180], 99.95th=[ 180], | 99.99th=[ 180] bw ( KiB/s): min= 1835, max= 2035, per=40.00%, avg=1935.00, stdev=141.42, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2640KiB/s (2703kB/s)(10.0MiB/3879msec); 0 zone resets clat (msec): min=110, max=778, avg=357.93, stdev=242.31 lat (msec): min=110, max=778, avg=358.17, stdev=242.16 clat percentiles (msec): | 1.00th=[ 111], 5.00th=[ 111], 10.00th=[ 111], 20.00th=[ 132], | 30.00th=[ 192], 40.00th=[ 194], 50.00th=[ 215], 60.00th=[ 342], | 70.00th=[ 359], 80.00th=[ 542], 90.00th=[ 718], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2003, max= 4047, per=46.65%, avg=3158.80, stdev=1051.64, samples=5 iops : min= 1, max= 3, avg= 2.20, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=16.67%, 1000=8.33% cpu : usr=0.03%, sys=7.92%, ctx=121, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180537: Wed Aug 26 09:43:27 2026 read: IOPS=1, BW=1532KiB/s (1569kB/s)(6144KiB/4010msec) clat (msec): min=48, max=609, avg=312.19, stdev=251.44 lat (msec): min=48, max=609, avg=312.20, stdev=251.44 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 49], 10.00th=[ 49], 20.00th=[ 112], | 30.00th=[ 112], 40.00th=[ 120], 50.00th=[ 120], 60.00th=[ 405], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 2019, max= 2043, per=42.05%, avg=2034.00, stdev=10.52, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=1, BW=1532KiB/s (1569kB/s)(6144KiB/4010msec); 0 zone resets clat (msec): min=89, max=862, avg=335.37, stdev=316.36 lat (msec): min=89, max=862, avg=335.84, stdev=316.28 clat percentiles (msec): | 1.00th=[ 89], 5.00th=[ 89], 10.00th=[ 89], 20.00th=[ 97], | 30.00th=[ 97], 40.00th=[ 108], 50.00th=[ 108], 60.00th=[ 292], | 70.00th=[ 567], 80.00th=[ 567], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 2019, max= 3696, per=36.10%, avg=2444.25, stdev=834.54, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 50=8.33%, 100=16.67%, 250=25.00%, 500=16.67%, 750=25.00% lat (msec) : 1000=8.33% cpu : usr=0.00%, sys=5.04%, ctx=80, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180538: Wed Aug 26 09:43:27 2026 read: IOPS=1, BW=1368KiB/s (1401kB/s)(5120KiB/3742msec) clat (msec): min=113, max=679, avg=273.09, stdev=230.90 lat (msec): min=113, max=679, avg=273.10, stdev=230.90 clat percentiles (msec): | 1.00th=[ 114], 5.00th=[ 114], 10.00th=[ 114], 20.00th=[ 114], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 220], 80.00th=[ 220], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 2035, max= 4007, per=55.72%, avg=2695.00, stdev=1136.23, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1916KiB/s (1962kB/s)(7168KiB/3742msec); 0 zone resets clat (msec): min=144, max=545, avg=321.12, stdev=154.49 lat (msec): min=144, max=545, avg=321.28, stdev=154.49 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 201], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 275], 60.00th=[ 368], | 70.00th=[ 368], 80.00th=[ 498], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1896, max= 4047, per=41.54%, avg=2812.80, stdev=1124.58, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=16.67% cpu : usr=0.03%, sys=6.82%, ctx=125, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4837KiB/s (4953kB/s), 528KiB/s-1693KiB/s (541kB/s-1734kB/s), io=20.0MiB (20.0MB), run=3742-4234msec WRITE: bw=6772KiB/s (6934kB/s), 1209KiB/s-2640KiB/s (1238kB/s-2703kB/s), io=28.0MiB (29.4MB), run=3742-4234msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180552: Wed Aug 26 09:43:39 2026 read: IOPS=1, BW=5919KiB/s (6061kB/s)(12.0MiB/2076msec) clat (msec): min=607, max=655, avg=636.96, stdev=25.60 lat (msec): min=607, max=655, avg=636.96, stdev=25.60 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.05%, sys=21.20%, ctx=451, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180554: Wed Aug 26 09:43:39 2026 read: IOPS=0, BW=1639KiB/s (1678kB/s)(4096KiB/2499msec) clat (nsec): min=559640k, max=559640k, avg=559639674.00, stdev= 0.00 lat (nsec): min=559642k, max=559642k, avg=559641703.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 558], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 558], 95.00th=[ 558], | 99.00th=[ 558], 99.50th=[ 558], 99.90th=[ 558], 99.95th=[ 558], | 99.99th=[ 558] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3278KiB/s (3357kB/s)(8192KiB/2499msec); 0 zone resets clat (msec): min=325, max=1578, avg=951.76, stdev=885.83 lat (msec): min=325, max=1578, avg=952.07, stdev=885.84 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 326], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8143, max= 8143, per=75.82%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.04%, sys=3.68%, ctx=139, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180555: Wed Aug 26 09:43:39 2026 write: IOPS=0, BW=4028KiB/s (4124kB/s)(12.0MiB/3051msec); 0 zone resets clat (msec): min=321, max=1657, avg=995.56, stdev=668.14 lat (msec): min=322, max=1660, avg=996.73, stdev=669.50 clat percentiles (msec): | 1.00th=[ 321], 5.00th=[ 321], 10.00th=[ 321], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1653], 80.00th=[ 1653], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 8143, max= 8143, per=75.82%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.16%, sys=5.38%, ctx=58, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180557: Wed Aug 26 09:43:39 2026 write: IOPS=1, BW=4933KiB/s (5051kB/s)(12.0MiB/2491msec); 0 zone resets clat (msec): min=455, max=1305, avg=787.80, stdev=454.28 lat (msec): min=455, max=1305, avg=788.14, stdev=454.27 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 8143, max= 8159, per=75.89%, avg=8151.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.12%, sys=5.58%, ctx=58, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6556KiB/s (6714kB/s), 1639KiB/s-5919KiB/s (1678kB/s-6061kB/s), io=16.0MiB (16.8MB), run=2076-2499msec WRITE: bw=10.5MiB/s (10.0MB/s), 3278KiB/s-4933KiB/s (3357kB/s-5051kB/s), io=32.0MiB (33.6MB), run=2491-3051msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180551: Wed Aug 26 09:43:39 2026 read: IOPS=1, BW=5971KiB/s (6114kB/s)(12.0MiB/2058msec) clat (msec): min=635, max=727, avg=675.33, stdev=46.95 lat (msec): min=635, max=727, avg=675.33, stdev=46.95 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 726], 95.00th=[ 726], | 99.00th=[ 726], 99.50th=[ 726], 99.90th=[ 726], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 8031, max= 8143, per=100.00%, avg=8087.00, stdev=79.20, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=5.40%, ctx=43, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180553: Wed Aug 26 09:43:39 2026 read: IOPS=0, BW=1257KiB/s (1287kB/s)(4096KiB/3259msec) clat (nsec): min=1309.7M, max=1309.7M, avg=1309678990.00, stdev= 0.00 lat (nsec): min=1309.7M, max=1309.7M, avg=1309681258.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1318], 5.00th=[ 1318], 10.00th=[ 1318], 20.00th=[ 1318], | 30.00th=[ 1318], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2514KiB/s (2574kB/s)(8192KiB/3259msec); 0 zone resets clat (msec): min=903, max=992, avg=948.30, stdev=63.18 lat (msec): min=903, max=993, avg=948.64, stdev=63.13 clat percentiles (msec): | 1.00th=[ 902], 5.00th=[ 902], 10.00th=[ 902], 20.00th=[ 902], | 30.00th=[ 902], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8078, max= 8078, per=84.78%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.15%, sys=4.73%, ctx=68, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180556: Wed Aug 26 09:43:39 2026 write: IOPS=0, BW=3573KiB/s (3659kB/s)(12.0MiB/3439msec); 0 zone resets clat (msec): min=346, max=1725, avg=1095.12, stdev=696.97 lat (msec): min=346, max=1725, avg=1095.47, stdev=697.00 clat percentiles (msec): | 1.00th=[ 347], 5.00th=[ 347], 10.00th=[ 347], 20.00th=[ 347], | 30.00th=[ 347], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7968, max= 8143, per=84.55%, avg=8055.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.13%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180558: Wed Aug 26 09:43:39 2026 write: IOPS=1, BW=5968KiB/s (6111kB/s)(12.0MiB/2059msec); 0 zone resets clat (msec): min=276, max=1365, avg=678.08, stdev=598.15 lat (msec): min=276, max=1365, avg=678.74, stdev=597.91 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 393], | 70.00th=[ 1368], 80.00th=[ 1368], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 6860, max= 8031, per=78.14%, avg=7445.50, stdev=828.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=5.54%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5027KiB/s (5148kB/s), 1257KiB/s-5971KiB/s (1287kB/s-6114kB/s), io=16.0MiB (16.8MB), run=2058-3259msec WRITE: bw=9528KiB/s (9757kB/s), 2514KiB/s-5968KiB/s (2574kB/s-6111kB/s), io=32.0MiB (33.6MB), run=2059-3439msec