== sanity test 398b: DIO and buffer IO race ============== 21:17:36 (1790731056) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.50571 s, 7.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145952: Tue Sep 29 21:20:02 2026 read: IOPS=11, BW=47.6KiB/s (48.7kB/s)(5992KiB/125999msec) clat (usec): min=31, max=666929, avg=40993.17, stdev=37669.25 lat (usec): min=32, max=666930, avg=40995.67, stdev=37668.55 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 2442], 20.00th=[ 19268], | 30.00th=[ 23987], 40.00th=[ 28705], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 48497], 80.00th=[ 61080], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[139461], 99.50th=[189793], 99.90th=[566232], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 103, per=25.60%, avg=47.88, stdev=19.43, samples=245 iops : min= 1, max= 25, avg=11.34, stdev= 4.92, samples=245 write: IOPS=12, BW=49.0KiB/s (51.2kB/s)(6296KiB/125999msec); 0 zone resets clat (usec): min=986, max=450658, avg=40902.41, stdev=41991.78 lat (usec): min=987, max=450659, avg=40907.38, stdev=41989.59 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1369], 10.00th=[ 2114], 20.00th=[ 4883], | 30.00th=[ 9634], 40.00th=[ 20579], 50.00th=[ 30016], 60.00th=[ 41157], | 70.00th=[ 54789], 80.00th=[ 67634], 90.00th=[ 94897], 95.00th=[117965], | 99.00th=[177210], 99.50th=[208667], 99.90th=[325059], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 7, max= 120, per=25.42%, avg=49.81, stdev=21.05, samples=247 iops : min= 1, max= 30, avg=11.83, stdev= 5.27, samples=247 lat (usec) : 50=0.42%, 100=3.55%, 250=0.46%, 500=0.16%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=4.85%, 4=4.20%, 10=6.90%, 20=10.16%, 50=37.83% lat (msec) : 100=24.84%, 250=6.15%, 500=0.23%, 750=0.07% cpu : usr=0.09%, sys=5.61%, ctx=6659, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145953: Tue Sep 29 21:20:02 2026 read: IOPS=11, BW=46.4KiB/s (47.6kB/s)(5940KiB/127896msec) clat (usec): min=32, max=726256, avg=42351.88, stdev=40911.01 lat (usec): min=33, max=726259, avg=42354.80, stdev=40910.52 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 1045], 20.00th=[ 19006], | 30.00th=[ 24773], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 42206], | 70.00th=[ 50594], 80.00th=[ 62653], 90.00th=[ 78119], 95.00th=[ 98042], | 99.00th=[149947], 99.50th=[235930], 99.90th=[692061], 99.95th=[725615], | 99.99th=[725615] bw ( KiB/s): min= 7, max= 95, per=24.81%, avg=46.39, stdev=20.09, samples=249 iops : min= 1, max= 23, avg=10.98, stdev= 5.04, samples=249 write: IOPS=12, BW=49.6KiB/s (50.8kB/s)(6348KiB/127896msec); 0 zone resets clat (usec): min=918, max=359379, avg=40802.12, stdev=42826.76 lat (usec): min=919, max=359381, avg=40810.31, stdev=42827.03 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1401], 10.00th=[ 2376], 20.00th=[ 4555], | 30.00th=[ 8094], 40.00th=[ 19268], 50.00th=[ 28967], 60.00th=[ 40109], | 70.00th=[ 53740], 80.00th=[ 70779], 90.00th=[ 95945], 95.00th=[121111], | 99.00th=[193987], 99.50th=[212861], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 7, max= 111, per=25.28%, avg=49.56, stdev=20.93, samples=249 iops : min= 1, max= 27, avg=11.78, stdev= 5.29, samples=249 lat (usec) : 50=0.23%, 100=3.74%, 250=0.55%, 500=0.10%, 750=0.13% lat (usec) : 1000=0.16% lat (msec) : 2=4.13%, 4=5.50%, 10=7.49%, 20=9.47%, 50=36.78% lat (msec) : 100=25.00%, 250=6.41%, 500=0.23%, 750=0.07% cpu : usr=0.11%, sys=5.60%, ctx=6753, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145954: Tue Sep 29 21:20:02 2026 read: IOPS=11, BW=47.3KiB/s (48.5kB/s)(6028KiB/127370msec) clat (usec): min=20, max=664854, avg=39665.66, stdev=34587.30 lat (usec): min=20, max=664855, avg=39668.96, stdev=34588.17 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 68], 10.00th=[ 117], 20.00th=[ 18220], | 30.00th=[ 23462], 40.00th=[ 27919], 50.00th=[ 32375], 60.00th=[ 39060], | 70.00th=[ 47449], 80.00th=[ 57934], 90.00th=[ 76022], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[185598], 99.90th=[295699], 99.95th=[666895], | 99.99th=[666895] bw ( KiB/s): min= 7, max= 112, per=25.26%, avg=47.23, stdev=21.29, samples=248 iops : min= 1, max= 28, avg=11.20, stdev= 5.37, samples=248 write: IOPS=12, BW=49.1KiB/s (50.3kB/s)(6260KiB/127370msec); 0 zone resets clat (usec): min=1034, max=897972, avg=43066.21, stdev=50360.35 lat (usec): min=1035, max=897974, avg=43072.33, stdev=50358.76 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 1876], 20.00th=[ 4621], | 30.00th=[ 9110], 40.00th=[ 19792], 50.00th=[ 30540], 60.00th=[ 42206], | 70.00th=[ 55313], 80.00th=[ 72877], 90.00th=[102237], 95.00th=[124257], | 99.00th=[189793], 99.50th=[229639], 99.90th=[471860], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 111, per=24.80%, avg=48.61, stdev=20.15, samples=250 iops : min= 1, max= 27, avg=11.53, stdev= 5.12, samples=250 lat (usec) : 50=0.39%, 100=4.17%, 250=0.72%, 500=0.13%, 750=0.07% lat (msec) : 2=5.31%, 4=3.81%, 10=7.32%, 20=10.29%, 50=37.21% lat (msec) : 100=23.14%, 250=7.19%, 500=0.20%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.43%, ctx=6686, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145955: Tue Sep 29 21:20:02 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6052KiB/126762msec) clat (usec): min=32, max=736535, avg=40785.92, stdev=36339.14 lat (usec): min=32, max=736537, avg=40788.45, stdev=36339.17 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 65], 10.00th=[ 111], 20.00th=[ 17695], | 30.00th=[ 23462], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 41157], | 70.00th=[ 49546], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 94897], | 99.00th=[141558], 99.50th=[170918], 99.90th=[438305], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 135, per=25.72%, avg=48.09, stdev=20.15, samples=245 iops : min= 1, max= 33, avg=11.40, stdev= 5.08, samples=245 write: IOPS=12, BW=49.2KiB/s (50.4kB/s)(6236KiB/126762msec); 0 zone resets clat (usec): min=968, max=813724, avg=41535.21, stdev=47171.77 lat (usec): min=969, max=813726, avg=41540.65, stdev=47173.43 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1352], 10.00th=[ 2073], 20.00th=[ 4752], | 30.00th=[ 8848], 40.00th=[ 18482], 50.00th=[ 28967], 60.00th=[ 41157], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[ 99091], 95.00th=[127402], | 99.00th=[193987], 99.50th=[233833], 99.90th=[299893], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 7, max= 135, per=24.95%, avg=48.90, stdev=21.49, samples=248 iops : min= 1, max= 33, avg=11.60, stdev= 5.42, samples=248 lat (usec) : 50=0.65%, 100=4.07%, 250=0.75%, 500=0.26%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=4.88%, 4=4.10%, 10=7.52%, 20=10.25%, 50=36.65% lat (msec) : 100=23.89%, 250=6.64%, 500=0.16%, 750=0.03%, 1000=0.03% cpu : usr=0.09%, sys=5.61%, ctx=6574, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=188KiB/s (192kB/s), 46.4KiB/s-47.7KiB/s (47.6kB/s-48.9kB/s), io=23.4MiB (24.6MB), run=125999-127896msec WRITE: bw=197KiB/s (201kB/s), 49.1KiB/s-49.0KiB/s (50.3kB/s-51.2kB/s), io=24.6MiB (25.7MB), run=125999-127896msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145947: Tue Sep 29 21:22:01 2026 read: IOPS=6, BW=24.3KiB/s (24.9kB/s)(5992KiB/246885msec) clat (msec): min=5, max=870, avg=32.99, stdev=39.07 lat (msec): min=5, max=870, avg=33.00, stdev=39.07 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 75], 95.00th=[ 103], | 99.00th=[ 165], 99.50th=[ 188], 99.90th=[ 271], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 103, per=28.05%, avg=26.93, stdev=18.07, samples=430 iops : min= 1, max= 25, avg= 6.10, stdev= 4.56, samples=430 write: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6296KiB/246885msec); 0 zone resets clat (msec): min=36, max=724, avg=125.14, stdev=65.55 lat (msec): min=36, max=724, avg=125.15, stdev=65.55 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 88], 40.00th=[ 97], 50.00th=[ 108], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 163], 90.00th=[ 209], 95.00th=[ 255], | 99.00th=[ 351], 99.50th=[ 393], 99.90th=[ 676], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 56, per=24.82%, avg=25.07, stdev=11.97, samples=484 iops : min= 1, max= 14, avg= 5.62, stdev= 3.04, samples=484 lat (msec) : 10=4.46%, 20=19.60%, 50=16.99%, 100=27.02%, 250=29.04% lat (msec) : 500=2.77%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.31%, ctx=5239, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145948: Tue Sep 29 21:22:01 2026 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(5940KiB/248131msec) clat (msec): min=4, max=950, avg=32.94, stdev=40.57 lat (msec): min=4, max=950, avg=32.94, stdev=40.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 73], 95.00th=[ 102], | 99.00th=[ 174], 99.50th=[ 197], 99.90th=[ 296], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 96, per=28.00%, avg=26.88, stdev=18.12, samples=428 iops : min= 1, max= 24, avg= 6.09, stdev= 4.57, samples=428 write: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6348KiB/248131msec); 0 zone resets clat (msec): min=39, max=728, avg=125.24, stdev=67.02 lat (msec): min=39, max=728, avg=125.24, stdev=67.02 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 66], 20.00th=[ 78], | 30.00th=[ 86], 40.00th=[ 95], 50.00th=[ 106], 60.00th=[ 118], | 70.00th=[ 136], 80.00th=[ 165], 90.00th=[ 215], 95.00th=[ 251], | 99.00th=[ 363], 99.50th=[ 422], 99.90th=[ 676], 99.95th=[ 726], | 99.99th=[ 726] bw ( KiB/s): min= 7, max= 55, per=24.93%, avg=25.18, stdev=11.90, samples=487 iops : min= 1, max= 13, avg= 5.65, stdev= 3.03, samples=487 lat (msec) : 10=3.97%, 20=19.89%, 50=16.83%, 100=28.45%, 250=28.06% lat (msec) : 500=2.64%, 750=0.13%, 1000=0.03% cpu : usr=0.05%, sys=1.33%, ctx=5308, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145949: Tue Sep 29 21:22:01 2026 read: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6028KiB/246134msec) clat (msec): min=5, max=539, avg=33.71, stdev=37.77 lat (msec): min=5, max=539, avg=33.72, stdev=37.78 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 75], 95.00th=[ 101], | 99.00th=[ 174], 99.50th=[ 199], 99.90th=[ 523], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 7, max= 103, per=27.76%, avg=26.65, stdev=18.04, samples=438 iops : min= 1, max= 25, avg= 6.03, stdev= 4.54, samples=438 write: IOPS=6, BW=25.4KiB/s (26.0kB/s)(6260KiB/246134msec); 0 zone resets clat (msec): min=33, max=1092, avg=124.50, stdev=67.27 lat (msec): min=33, max=1092, avg=124.51, stdev=67.27 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 77], | 30.00th=[ 86], 40.00th=[ 95], 50.00th=[ 108], 60.00th=[ 120], | 70.00th=[ 138], 80.00th=[ 165], 90.00th=[ 211], 95.00th=[ 251], | 99.00th=[ 351], 99.50th=[ 397], 99.90th=[ 523], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 7, max= 63, per=24.99%, avg=25.24, stdev=12.06, samples=479 iops : min= 1, max= 15, avg= 5.67, stdev= 3.06, samples=479 lat (msec) : 10=3.48%, 20=19.79%, 50=17.58%, 100=28.19%, 250=28.16% lat (msec) : 500=2.67%, 750=0.10%, 2000=0.03% cpu : usr=0.06%, sys=1.28%, ctx=5240, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145950: Tue Sep 29 21:22:01 2026 read: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6052KiB/244730msec) clat (msec): min=5, max=648, avg=32.96, stdev=38.31 lat (msec): min=5, max=648, avg=32.96, stdev=38.31 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 17], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 80], 95.00th=[ 104], | 99.00th=[ 169], 99.50th=[ 197], 99.90th=[ 351], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 119, per=28.72%, avg=27.57, stdev=19.16, samples=425 iops : min= 1, max= 29, avg= 6.26, stdev= 4.85, samples=425 write: IOPS=6, BW=25.5KiB/s (26.1kB/s)(6236KiB/244730msec); 0 zone resets clat (msec): min=40, max=1011, avg=124.69, stdev=69.43 lat (msec): min=40, max=1011, avg=124.69, stdev=69.43 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 65], 20.00th=[ 75], | 30.00th=[ 85], 40.00th=[ 94], 50.00th=[ 105], 60.00th=[ 117], | 70.00th=[ 136], 80.00th=[ 165], 90.00th=[ 213], 95.00th=[ 255], | 99.00th=[ 347], 99.50th=[ 397], 99.90th=[ 793], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 48, per=24.96%, avg=25.21, stdev=12.07, samples=477 iops : min= 1, max= 12, avg= 5.66, stdev= 3.07, samples=477 lat (msec) : 10=4.07%, 20=20.70%, 50=16.60%, 100=28.26%, 250=27.38% lat (msec) : 500=2.90%, 750=0.03%, 1000=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.30%, ctx=5385, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=96.8KiB/s (99.1kB/s), 23.9KiB/s-24.7KiB/s (24.5kB/s-25.3kB/s), io=23.4MiB (24.6MB), run=244730-248131msec WRITE: bw=101KiB/s (104kB/s), 25.4KiB/s-25.6KiB/s (26.0kB/s-26.2kB/s), io=24.6MiB (25.7MB), run=244730-248131msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146017: Tue Sep 29 21:22:36 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(5920KiB/25497msec) clat (usec): min=35, max=187854, avg=35018.90, stdev=28373.81 lat (usec): min=36, max=187856, avg=35024.82, stdev=28371.21 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 73], 20.00th=[ 110], | 30.00th=[ 19792], 40.00th=[ 27132], 50.00th=[ 32637], 60.00th=[ 41157], | 70.00th=[ 47973], 80.00th=[ 56361], 90.00th=[ 69731], 95.00th=[ 80217], | 99.00th=[114820], 99.50th=[137364], 99.90th=[187696], 99.95th=[187696], | 99.99th=[187696] bw ( KiB/s): min= 93, max= 465, per=24.57%, avg=229.98, stdev=77.37, samples=50 iops : min= 5, max= 29, avg=13.64, stdev= 4.93, samples=50 write: IOPS=15, BW=250KiB/s (256kB/s)(6368KiB/25497msec); 0 zone resets clat (usec): min=1545, max=282467, avg=31108.63, stdev=32875.88 lat (usec): min=1548, max=282469, avg=31111.36, stdev=32875.84 clat percentiles (usec): | 1.00th=[ 1631], 5.00th=[ 2008], 10.00th=[ 2966], 20.00th=[ 5735], | 30.00th=[ 9110], 40.00th=[ 13698], 50.00th=[ 20579], 60.00th=[ 28181], | 70.00th=[ 39060], 80.00th=[ 52167], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[154141], 99.50th=[164627], 99.90th=[283116], 99.95th=[283116], | 99.99th=[283116] bw ( KiB/s): min= 95, max= 527, per=25.29%, avg=248.86, stdev=91.82, samples=50 iops : min= 5, max= 32, avg=14.82, stdev= 5.81, samples=50 lat (usec) : 50=1.17%, 100=8.20%, 250=1.04%, 500=0.39%, 750=0.26% lat (usec) : 1000=0.26% lat (msec) : 2=2.73%, 4=4.17%, 10=10.55%, 20=11.33%, 50=35.68% lat (msec) : 100=20.96%, 250=3.12%, 500=0.13% cpu : usr=0.06%, sys=7.58%, ctx=1558, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146018: Tue Sep 29 21:22:36 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(5744KiB/25584msec) clat (usec): min=43, max=195444, avg=34633.31, stdev=27756.47 lat (usec): min=43, max=195446, avg=34634.98, stdev=27756.36 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 72], 10.00th=[ 79], 20.00th=[ 330], | 30.00th=[ 20841], 40.00th=[ 26346], 50.00th=[ 32637], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 54264], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[124257], 99.50th=[166724], 99.90th=[196084], 99.95th=[196084], | 99.99th=[196084] bw ( KiB/s): min= 94, max= 478, per=24.33%, avg=227.69, stdev=80.60, samples=49 iops : min= 5, max= 29, avg=13.49, stdev= 5.07, samples=49 write: IOPS=15, BW=256KiB/s (262kB/s)(6544KiB/25584msec); 0 zone resets clat (usec): min=1718, max=200663, avg=31930.86, stdev=31668.75 lat (usec): min=1719, max=200665, avg=31934.04, stdev=31668.39 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2573], 10.00th=[ 3654], 20.00th=[ 5800], | 30.00th=[ 9241], 40.00th=[ 13566], 50.00th=[ 21365], 60.00th=[ 30016], | 70.00th=[ 42206], 80.00th=[ 54789], 90.00th=[ 74974], 95.00th=[ 90702], | 99.00th=[149947], 99.50th=[166724], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 95, max= 468, per=25.79%, avg=253.82, stdev=90.95, samples=50 iops : min= 5, max= 29, avg=15.16, stdev= 5.80, samples=50 lat (usec) : 50=0.52%, 100=7.03%, 250=1.56%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.30%, 4=5.73%, 10=11.07%, 20=10.94%, 50=36.85% lat (msec) : 100=22.27%, 250=2.34% cpu : usr=0.09%, sys=7.47%, ctx=1563, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146019: Tue Sep 29 21:22:36 2026 read: IOPS=16, BW=257KiB/s (263kB/s)(6256KiB/24382msec) clat (usec): min=38, max=194930, avg=33413.71, stdev=29134.79 lat (usec): min=39, max=194932, avg=33421.42, stdev=29135.63 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 64], 10.00th=[ 77], 20.00th=[ 123], | 30.00th=[ 16909], 40.00th=[ 24249], 50.00th=[ 31589], 60.00th=[ 36439], | 70.00th=[ 44827], 80.00th=[ 53740], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[131597], 99.50th=[137364], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 63, max= 536, per=27.45%, avg=256.94, stdev=94.27, samples=48 iops : min= 3, max= 33, avg=15.33, stdev= 5.97, samples=48 write: IOPS=15, BW=247KiB/s (253kB/s)(6032KiB/24382msec); 0 zone resets clat (usec): min=1493, max=194708, avg=29596.49, stdev=31072.19 lat (usec): min=1493, max=194711, avg=29599.15, stdev=31072.23 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2147], 10.00th=[ 2999], 20.00th=[ 4817], | 30.00th=[ 7635], 40.00th=[ 11600], 50.00th=[ 18220], 60.00th=[ 27395], | 70.00th=[ 36963], 80.00th=[ 52691], 90.00th=[ 70779], 95.00th=[ 91751], | 99.00th=[139461], 99.50th=[160433], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 93, max= 504, per=24.90%, avg=245.04, stdev=91.01, samples=48 iops : min= 5, max= 31, avg=14.58, stdev= 5.72, samples=48 lat (usec) : 50=0.65%, 100=8.07%, 250=2.86%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=1.82%, 4=6.25%, 10=10.81%, 20=11.85%, 50=33.85% lat (msec) : 100=19.92%, 250=3.12% cpu : usr=0.11%, sys=7.59%, ctx=1524, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146020: Tue Sep 29 21:22:36 2026 read: IOPS=15, BW=245KiB/s (251kB/s)(6032KiB/24646msec) clat (usec): min=39, max=136760, avg=32198.32, stdev=25418.77 lat (usec): min=40, max=136763, avg=32199.81, stdev=25418.88 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 127], | 30.00th=[ 19530], 40.00th=[ 24773], 50.00th=[ 31851], 60.00th=[ 38011], | 70.00th=[ 43254], 80.00th=[ 53216], 90.00th=[ 66847], 95.00th=[ 78119], | 99.00th=[104334], 99.50th=[106431], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 94, max= 448, per=26.13%, avg=244.56, stdev=78.67, samples=48 iops : min= 5, max= 28, avg=14.54, stdev= 5.00, samples=48 write: IOPS=15, BW=254KiB/s (260kB/s)(6256KiB/24646msec); 0 zone resets clat (usec): min=1517, max=185748, avg=31588.69, stdev=31701.58 lat (usec): min=1520, max=185752, avg=31594.41, stdev=31701.83 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2040], 10.00th=[ 3163], 20.00th=[ 5932], | 30.00th=[ 9241], 40.00th=[ 12518], 50.00th=[ 20579], 60.00th=[ 30278], | 70.00th=[ 40633], 80.00th=[ 54264], 90.00th=[ 74974], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[149947], 99.90th=[185598], 99.95th=[185598], | 99.99th=[185598] bw ( KiB/s): min= 126, max= 441, per=25.96%, avg=255.44, stdev=72.52, samples=48 iops : min= 7, max= 27, avg=15.25, stdev= 4.59, samples=48 lat (usec) : 50=0.52%, 100=8.59%, 250=1.82%, 500=0.52%, 750=0.13% lat (msec) : 2=2.47%, 4=4.30%, 10=11.20%, 20=10.68%, 50=36.98% lat (msec) : 100=20.18%, 250=2.60% cpu : usr=0.11%, sys=7.71%, ctx=1578, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=936KiB/s (959kB/s), 225KiB/s-257KiB/s (230kB/s-263kB/s), io=23.4MiB (24.5MB), run=24382-25584msec WRITE: bw=985KiB/s (1009kB/s), 247KiB/s-256KiB/s (253kB/s-262kB/s), io=24.6MiB (25.8MB), run=24382-25584msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146022: Tue Sep 29 21:23:14 2026 read: IOPS=5, BW=94.5KiB/s (96.8kB/s)(5920KiB/62655msec) clat (msec): min=6, max=295, avg=37.16, stdev=33.47 lat (msec): min=6, max=295, avg=37.16, stdev=33.47 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 38], 80.00th=[ 51], 90.00th=[ 69], 95.00th=[ 101], | 99.00th=[ 186], 99.50th=[ 201], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 287, per=26.98%, avg=102.78, stdev=60.55, samples=112 iops : min= 1, max= 17, avg= 5.66, stdev= 3.83, samples=112 write: IOPS=6, BW=102KiB/s (104kB/s)(6368KiB/62655msec); 0 zone resets clat (msec): min=41, max=308, avg=122.72, stdev=47.98 lat (msec): min=41, max=308, avg=122.72, stdev=47.98 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 63], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 104], 50.00th=[ 114], 60.00th=[ 125], | 70.00th=[ 140], 80.00th=[ 159], 90.00th=[ 186], 95.00th=[ 222], | 99.00th=[ 288], 99.50th=[ 305], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 22, max= 192, per=25.34%, avg=101.37, stdev=40.04, samples=123 iops : min= 1, max= 12, avg= 5.58, stdev= 2.57, samples=123 lat (msec) : 10=1.30%, 20=13.93%, 50=23.70%, 100=26.17%, 250=33.59% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.56%, ctx=1416, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146023: Tue Sep 29 21:23:14 2026 read: IOPS=5, BW=91.4KiB/s (93.6kB/s)(5744KiB/62843msec) clat (msec): min=8, max=230, avg=34.89, stdev=30.42 lat (msec): min=8, max=230, avg=34.89, stdev=30.42 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 45], 90.00th=[ 75], 95.00th=[ 107], | 99.00th=[ 138], 99.50th=[ 171], 99.90th=[ 230], 99.95th=[ 230], | 99.99th=[ 230] bw ( KiB/s): min= 22, max= 288, per=27.08%, avg=103.19, stdev=59.76, samples=110 iops : min= 1, max= 18, avg= 5.71, stdev= 3.77, samples=110 write: IOPS=6, BW=104KiB/s (107kB/s)(6544KiB/62843msec); 0 zone resets clat (msec): min=41, max=380, avg=122.87, stdev=49.76 lat (msec): min=41, max=380, avg=122.87, stdev=49.76 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 67], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 113], 60.00th=[ 123], | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 186], 95.00th=[ 213], | 99.00th=[ 284], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 224, per=25.91%, avg=103.65, stdev=38.96, samples=124 iops : min= 1, max= 14, avg= 5.72, stdev= 2.47, samples=124 lat (msec) : 10=1.04%, 20=17.19%, 50=21.22%, 100=25.39%, 250=33.46% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.40%, ctx=1339, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146024: Tue Sep 29 21:23:14 2026 read: IOPS=6, BW=103KiB/s (106kB/s)(6256KiB/60548msec) clat (msec): min=7, max=280, avg=33.50, stdev=30.78 lat (msec): min=7, max=280, avg=33.50, stdev=30.78 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 44], 90.00th=[ 62], 95.00th=[ 89], | 99.00th=[ 184], 99.50th=[ 249], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 31, max= 286, per=28.76%, avg=109.58, stdev=69.43, samples=113 iops : min= 1, max= 17, avg= 6.09, stdev= 4.39, samples=113 write: IOPS=6, BW=99.6KiB/s (102kB/s)(6032KiB/60548msec); 0 zone resets clat (msec): min=46, max=315, avg=125.70, stdev=50.28 lat (msec): min=46, max=315, avg=125.70, stdev=50.28 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 74], 20.00th=[ 85], | 30.00th=[ 93], 40.00th=[ 105], 50.00th=[ 115], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 199], 95.00th=[ 226], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 31, max= 192, per=24.74%, avg=98.97, stdev=40.46, samples=119 iops : min= 1, max= 12, avg= 5.43, stdev= 2.58, samples=119 lat (msec) : 10=1.82%, 20=16.02%, 50=26.04%, 100=22.79%, 250=31.51% lat (msec) : 500=1.82% cpu : usr=0.06%, sys=1.58%, ctx=1406, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146025: Tue Sep 29 21:23:14 2026 read: IOPS=6, BW=98.8KiB/s (101kB/s)(6032KiB/61034msec) clat (msec): min=7, max=226, avg=35.52, stdev=31.62 lat (msec): min=7, max=226, avg=35.53, stdev=31.62 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 47], 90.00th=[ 73], 95.00th=[ 101], | 99.00th=[ 169], 99.50th=[ 199], 99.90th=[ 226], 99.95th=[ 226], | 99.99th=[ 226] bw ( KiB/s): min= 31, max= 320, per=28.04%, avg=106.83, stdev=60.65, samples=110 iops : min= 1, max= 20, avg= 5.91, stdev= 3.89, samples=110 write: IOPS=6, BW=103KiB/s (105kB/s)(6256KiB/61034msec); 0 zone resets clat (msec): min=49, max=378, avg=121.68, stdev=47.99 lat (msec): min=49, max=378, avg=121.69, stdev=47.98 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 66], 10.00th=[ 73], 20.00th=[ 84], | 30.00th=[ 93], 40.00th=[ 103], 50.00th=[ 111], 60.00th=[ 124], | 70.00th=[ 136], 80.00th=[ 155], 90.00th=[ 186], 95.00th=[ 213], | 99.00th=[ 275], 99.50th=[ 284], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 31, max= 192, per=25.46%, avg=101.85, stdev=38.19, samples=120 iops : min= 1, max= 12, avg= 5.61, stdev= 2.43, samples=120 lat (msec) : 10=1.30%, 20=15.76%, 50=23.57%, 100=25.78%, 250=32.29% lat (msec) : 500=1.30% cpu : usr=0.05%, sys=1.41%, ctx=1333, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=381KiB/s (390kB/s), 91.4KiB/s-103KiB/s (93.6kB/s-106kB/s), io=23.4MiB (24.5MB), run=60548-62843msec WRITE: bw=401KiB/s (411kB/s), 99.6KiB/s-104KiB/s (102kB/s-107kB/s), io=24.6MiB (25.8MB), run=60548-62843msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146042: Tue Sep 29 21:23:27 2026 read: IOPS=2, BW=2171KiB/s (2224kB/s)(7168KiB/3301msec) clat (msec): min=163, max=517, avg=260.64, stdev=118.74 lat (msec): min=163, max=517, avg=260.64, stdev=118.74 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 184], | 30.00th=[ 215], 40.00th=[ 215], 50.00th=[ 236], 60.00th=[ 239], | 70.00th=[ 239], 80.00th=[ 271], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 1996, max= 4087, per=63.69%, avg=2742.50, stdev=977.16, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1551KiB/s (1588kB/s)(5120KiB/3301msec); 0 zone resets clat (msec): min=163, max=676, avg=288.25, stdev=219.01 lat (msec): min=163, max=676, avg=289.16, stdev=218.79 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 182], 40.00th=[ 182], 50.00th=[ 182], 60.00th=[ 182], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 676], 95.00th=[ 676], | 99.00th=[ 676], 99.50th=[ 676], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 1996, max= 4087, per=42.09%, avg=2537.25, stdev=1033.35, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=75.00%, 500=8.33%, 750=16.67% cpu : usr=0.03%, sys=19.39%, ctx=315, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146043: Tue Sep 29 21:23:27 2026 read: IOPS=0, BW=431KiB/s (441kB/s)(2048KiB/4756msec) clat (usec): min=1996, max=1521.4k, avg=761681.10, stdev=1074355.98 lat (usec): min=1998, max=1521.4k, avg=761702.15, stdev=1074383.79 clat percentiles (usec): | 1.00th=[ 1991], 5.00th=[ 1991], 10.00th=[ 1991], | 20.00th=[ 1991], 30.00th=[ 1991], 40.00th=[ 1991], | 50.00th=[ 1991], 60.00th=[1518339], 70.00th=[1518339], | 80.00th=[1518339], 90.00th=[1518339], 95.00th=[1518339], | 99.00th=[1518339], 99.50th=[1518339], 99.90th=[1518339], | 99.95th=[1518339], 99.99th=[1518339] bw ( KiB/s): min= 2019, max= 2043, per=47.17%, avg=2031.00, stdev=16.97, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2153KiB/s (2205kB/s)(10.0MiB/4756msec); 0 zone resets clat (msec): min=156, max=594, avg=313.23, stdev=140.74 lat (msec): min=156, max=594, avg=313.32, stdev=140.76 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 178], | 30.00th=[ 213], 40.00th=[ 232], 50.00th=[ 236], 60.00th=[ 292], | 70.00th=[ 355], 80.00th=[ 422], 90.00th=[ 451], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 1996, max= 4079, per=50.04%, avg=3016.67, stdev=1090.70, samples=6 iops : min= 1, max= 3, avg= 2.17, stdev= 0.98, samples=6 lat (msec) : 2=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, 2000=8.33% cpu : usr=0.08%, sys=14.55%, ctx=236, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146044: Tue Sep 29 21:23:27 2026 read: IOPS=1, BW=1818KiB/s (1862kB/s)(6144KiB/3379msec) clat (msec): min=80, max=286, avg=196.55, stdev=70.19 lat (msec): min=80, max=286, avg=196.55, stdev=70.19 clat percentiles (msec): | 1.00th=[ 81], 5.00th=[ 81], 10.00th=[ 81], 20.00th=[ 167], | 30.00th=[ 167], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 215], | 70.00th=[ 241], 80.00th=[ 241], 90.00th=[ 288], 95.00th=[ 288], | 99.00th=[ 288], 99.50th=[ 288], 99.90th=[ 288], 99.95th=[ 288], | 99.99th=[ 288] bw ( KiB/s): min= 1996, max= 4087, per=78.42%, avg=3376.67, stdev=1195.86, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1818KiB/s (1862kB/s)(6144KiB/3379msec); 0 zone resets clat (msec): min=126, max=637, avg=360.57, stdev=213.27 lat (msec): min=127, max=637, avg=360.65, stdev=213.25 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 213], | 30.00th=[ 213], 40.00th=[ 257], 50.00th=[ 257], 60.00th=[ 321], | 70.00th=[ 609], 80.00th=[ 609], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1957, max= 3084, per=36.84%, avg=2220.60, stdev=483.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=18.35%, ctx=229, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146045: Tue Sep 29 21:23:27 2026 read: IOPS=1, BW=1772KiB/s (1814kB/s)(5120KiB/2890msec) clat (usec): min=566, max=330335, avg=143042.99, stdev=138564.02 lat (usec): min=567, max=330336, avg=143044.57, stdev=138564.02 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[ 570], | 30.00th=[ 21627], 40.00th=[ 21627], 50.00th=[137364], 60.00th=[137364], | 70.00th=[225444], 80.00th=[225444], 90.00th=[329253], 95.00th=[329253], | 99.00th=[329253], 99.50th=[329253], 99.90th=[329253], 99.95th=[329253], | 99.99th=[329253] bw ( KiB/s): min= 3915, max= 4087, per=92.92%, avg=4001.00, stdev=121.62, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2480KiB/s (2540kB/s)(7168KiB/2890msec); 0 zone resets clat (msec): min=127, max=530, avg=295.63, stdev=151.47 lat (msec): min=127, max=530, avg=295.87, stdev=151.43 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 130], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 271], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 451], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 1448, max= 4087, per=48.21%, avg=2906.25, stdev=1362.25, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=8.33% lat (msec) : 50=8.33%, 250=33.33%, 500=41.67%, 750=8.33% cpu : usr=0.00%, sys=18.66%, ctx=183, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4306KiB/s (4409kB/s), 431KiB/s-2171KiB/s (441kB/s-2224kB/s), io=20.0MiB (20.0MB), run=2890-4756msec WRITE: bw=6029KiB/s (6173kB/s), 1551KiB/s-2480KiB/s (1588kB/s-2540kB/s), io=28.0MiB (29.4MB), run=2890-4756msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146046: Tue Sep 29 21:23:28 2026 read: IOPS=1, BW=1467KiB/s (1502kB/s)(7168KiB/4886msec) clat (msec): min=68, max=1169, avg=333.88, stdev=380.13 lat (msec): min=68, max=1169, avg=333.88, stdev=380.13 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 99], | 30.00th=[ 169], 40.00th=[ 169], 50.00th=[ 230], 60.00th=[ 271], | 70.00th=[ 271], 80.00th=[ 334], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 1469, max= 4096, per=74.69%, avg=2907.00, stdev=1347.48, samples=4 iops : min= 1, max= 4, avg= 2.50, stdev= 1.29, samples=4 write: IOPS=1, BW=1048KiB/s (1073kB/s)(5120KiB/4886msec); 0 zone resets clat (msec): min=168, max=797, avg=435.71, stdev=274.30 lat (msec): min=169, max=797, avg=435.80, stdev=274.29 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 169], | 30.00th=[ 251], 40.00th=[ 251], 50.00th=[ 305], 60.00th=[ 305], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1969, max= 4096, per=46.48%, avg=2532.75, stdev=1042.60, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=33.33%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=4.59%, ctx=111, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146047: Tue Sep 29 21:23:28 2026 read: IOPS=0, BW=389KiB/s (399kB/s)(2048KiB/5261msec) clat (msec): min=93, max=1312, avg=702.97, stdev=861.34 lat (msec): min=93, max=1312, avg=702.97, stdev=861.34 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 94], 40.00th=[ 94], 50.00th=[ 94], 60.00th=[ 1318], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 2035, max= 2048, per=52.45%, avg=2041.50, stdev= 9.19, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1946KiB/s (1993kB/s)(10.0MiB/5261msec); 0 zone resets clat (msec): min=108, max=759, avg=340.48, stdev=185.11 lat (msec): min=108, max=759, avg=340.56, stdev=185.11 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 205], | 30.00th=[ 234], 40.00th=[ 251], 50.00th=[ 262], 60.00th=[ 279], | 70.00th=[ 380], 80.00th=[ 451], 90.00th=[ 477], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1969, max= 4096, per=55.84%, avg=3042.83, stdev=1138.59, samples=6 iops : min= 1, max= 4, avg= 2.17, stdev= 1.33, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=5.82%, ctx=86, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146048: Tue Sep 29 21:23:28 2026 read: IOPS=1, BW=1208KiB/s (1237kB/s)(6144KiB/5088msec) clat (msec): min=90, max=399, avg=236.04, stdev=129.70 lat (msec): min=90, max=399, avg=236.04, stdev=129.70 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 142], | 30.00th=[ 142], 40.00th=[ 169], 50.00th=[ 169], 60.00th=[ 230], | 70.00th=[ 388], 80.00th=[ 388], 90.00th=[ 401], 95.00th=[ 401], | 99.00th=[ 401], 99.50th=[ 401], 99.90th=[ 401], 99.95th=[ 401], | 99.99th=[ 401] bw ( KiB/s): min= 2007, max= 2048, per=52.16%, avg=2030.25, stdev=17.11, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 write: IOPS=1, BW=1208KiB/s (1237kB/s)(6144KiB/5088msec); 0 zone resets clat (msec): min=98, max=1786, avg=602.22, stdev=613.99 lat (msec): min=99, max=1786, avg=602.52, stdev=613.95 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 372], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1969, max= 2048, per=36.97%, avg=2014.75, stdev=34.97, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (msec) : 100=16.67%, 250=25.00%, 500=41.67%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=3.85%, ctx=78, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146049: Tue Sep 29 21:23:28 2026 read: IOPS=1, BW=1082KiB/s (1108kB/s)(5120KiB/4732msec) clat (msec): min=67, max=188, avg=102.47, stdev=49.62 lat (msec): min=67, max=188, avg=102.47, stdev=49.62 clat percentiles (msec): | 1.00th=[ 68], 5.00th=[ 68], 10.00th=[ 68], 20.00th=[ 68], | 30.00th=[ 79], 40.00th=[ 79], 50.00th=[ 79], 60.00th=[ 79], | 70.00th=[ 100], 80.00th=[ 100], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 2031, max= 6107, per=100.00%, avg=4069.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1515KiB/s (1551kB/s)(7168KiB/4732msec); 0 zone resets clat (msec): min=149, max=1364, avg=519.30, stdev=443.80 lat (msec): min=149, max=1364, avg=519.50, stdev=443.95 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 167], | 30.00th=[ 209], 40.00th=[ 209], 50.00th=[ 326], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 735], 90.00th=[ 1368], 95.00th=[ 1368], | 99.00th=[ 1368], 99.50th=[ 1368], 99.90th=[ 1368], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 2007, max= 6144, per=52.39%, avg=2854.60, stdev=1838.90, samples=5 iops : min= 1, max= 6, avg= 2.20, stdev= 2.17, samples=5 lat (msec) : 100=33.33%, 250=33.33%, 500=8.33%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=5.16%, ctx=102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3893KiB/s (3986kB/s), 389KiB/s-1467KiB/s (399kB/s-1502kB/s), io=20.0MiB (20.0MB), run=4732-5261msec WRITE: bw=5450KiB/s (5581kB/s), 1048KiB/s-1946KiB/s (1073kB/s-1993kB/s), io=28.0MiB (29.4MB), run=4732-5261msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=146056: Tue Sep 29 21:23:41 2026 read: IOPS=1, BW=4800KiB/s (4915kB/s)(12.0MiB/2560msec) clat (msec): min=593, max=979, avg=842.65, stdev=216.12 lat (msec): min=593, max=979, avg=842.65, stdev=216.12 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 978], 80.00th=[ 978], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 8175, max= 8192, per=100.00%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=14.45%, ctx=251, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146057: Tue Sep 29 21:23:41 2026 read: IOPS=0, BW=1288KiB/s (1319kB/s)(4096KiB/3180msec) clat (nsec): min=665105k, max=665105k, avg=665104733.00, stdev= 0.00 lat (nsec): min=665107k, max=665107k, avg=665107445.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 667], | 70.00th=[ 667], 80.00th=[ 667], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2576KiB/s (2638kB/s)(8192KiB/3180msec); 0 zone resets clat (msec): min=1106, max=1344, avg=1225.66, stdev=168.61 lat (msec): min=1107, max=1349, avg=1228.29, stdev=170.83 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1351], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8192, max= 8192, per=79.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.41%, ctx=91, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146058: Tue Sep 29 21:23:41 2026 write: IOPS=1, BW=4286KiB/s (4389kB/s)(12.0MiB/2867msec); 0 zone resets clat (msec): min=878, max=1063, avg=954.85, stdev=96.87 lat (msec): min=878, max=1064, avg=955.39, stdev=97.04 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 927], | 70.00th=[ 1062], 80.00th=[ 1062], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 8159, max= 8175, per=79.26%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=8.65%, ctx=83, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146059: Tue Sep 29 21:23:41 2026 write: IOPS=1, BW=4259KiB/s (4361kB/s)(12.0MiB/2885msec); 0 zone resets clat (msec): min=594, max=1401, avg=939.03, stdev=416.39 lat (msec): min=594, max=1402, avg=939.45, stdev=416.51 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8159, max= 8175, per=79.26%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.03%, sys=4.58%, ctx=60, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5152KiB/s (5276kB/s), 1288KiB/s-4800KiB/s (1319kB/s-4915kB/s), io=16.0MiB (16.8MB), run=2560-3180msec WRITE: bw=10.1MiB/s (10.6MB/s), 2576KiB/s-4286KiB/s (2638kB/s-4389kB/s), io=32.0MiB (33.6MB), run=2867-3180msec rand-rw: (groupid=0, jobs=1): err= 0: pid=146061: Tue Sep 29 21:23:42 2026 read: IOPS=0, BW=3643KiB/s (3730kB/s)(12.0MiB/3373msec) clat (msec): min=479, max=1566, avg=1123.75, stdev=570.71 lat (msec): min=479, max=1566, avg=1123.75, stdev=570.71 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.32%, ctx=42, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146062: Tue Sep 29 21:23:42 2026 read: IOPS=0, BW=1282KiB/s (1312kB/s)(4096KiB/3196msec) clat (nsec): min=1943.1M, max=1943.1M, avg=1943126417.00, stdev= 0.00 lat (nsec): min=1943.1M, max=1943.1M, avg=1943128002.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1938], 5.00th=[ 1938], 10.00th=[ 1938], 20.00th=[ 1938], | 30.00th=[ 1938], 40.00th=[ 1938], 50.00th=[ 1938], 60.00th=[ 1938], | 70.00th=[ 1938], 80.00th=[ 1938], 90.00th=[ 1938], 95.00th=[ 1938], | 99.00th=[ 1938], 99.50th=[ 1938], 99.90th=[ 1938], 99.95th=[ 1938], | 99.99th=[ 1938] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2563KiB/s (2625kB/s)(8192KiB/3196msec); 0 zone resets clat (msec): min=381, max=869, avg=625.14, stdev=344.98 lat (msec): min=381, max=869, avg=625.48, stdev=344.80 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 380], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.23%, ctx=27, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146063: Tue Sep 29 21:23:42 2026 write: IOPS=0, BW=3836KiB/s (3928kB/s)(12.0MiB/3203msec); 0 zone resets clat (msec): min=781, max=1335, avg=1066.38, stdev=277.42 lat (msec): min=783, max=1335, avg=1067.26, stdev=276.71 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 7953, max= 8159, per=78.75%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.47%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=146064: Tue Sep 29 21:23:42 2026 write: IOPS=1, BW=4401KiB/s (4507kB/s)(12.0MiB/2792msec); 0 zone resets clat (msec): min=708, max=1067, avg=929.01, stdev=193.32 lat (msec): min=708, max=1067, avg=929.38, stdev=193.28 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 1011], 50.00th=[ 1011], 60.00th=[ 1011], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 7953, max= 8159, per=78.75%, avg=8056.00, stdev=145.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=5.20%, ctx=82, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4857KiB/s (4974kB/s), 1282KiB/s-3643KiB/s (1312kB/s-3730kB/s), io=16.0MiB (16.8MB), run=3196-3373msec WRITE: bw=9.99MiB/s (10.5MB/s), 2563KiB/s-4401KiB/s (2625kB/s-4507kB/s), io=32.0MiB (33.6MB), run=2792-3203msec