== sanity test 398b: DIO and buffer IO race ============== 11:33:38 (1790004818) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.17301 s, 7.0 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144280: Mon Sep 21 11:36:33 2026 read: IOPS=10, BW=41.1KiB/s (42.0kB/s)(5992KiB/145949msec) clat (usec): min=25, max=491297, avg=49078.92, stdev=36703.15 lat (usec): min=25, max=491298, avg=49081.77, stdev=36703.21 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 13304], 20.00th=[ 23462], | 30.00th=[ 29492], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 50594], | 70.00th=[ 60031], 80.00th=[ 71828], 90.00th=[ 91751], 95.00th=[108528], | 99.00th=[181404], 99.50th=[202376], 99.90th=[291505], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 7, max= 94, per=25.68%, avg=40.57, stdev=17.69, samples=287 iops : min= 1, max= 23, avg= 9.48, stdev= 4.46, samples=287 write: IOPS=10, BW=43.1KiB/s (44.2kB/s)(6296KiB/145949msec); 0 zone resets clat (usec): min=841, max=480715, avg=45824.55, stdev=50695.66 lat (usec): min=841, max=480717, avg=45827.36, stdev=50696.66 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1270], 10.00th=[ 1401], 20.00th=[ 3785], | 30.00th=[ 9110], 40.00th=[ 18482], 50.00th=[ 32637], 60.00th=[ 45351], | 70.00th=[ 58459], 80.00th=[ 79168], 90.00th=[111674], 95.00th=[139461], | 99.00th=[219153], 99.50th=[274727], 99.90th=[400557], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 7, max= 109, per=26.02%, avg=42.93, stdev=20.39, samples=285 iops : min= 1, max= 27, avg=10.07, stdev= 5.17, samples=285 lat (usec) : 50=0.33%, 100=3.26%, 250=0.33%, 500=0.13%, 1000=0.16% lat (msec) : 2=6.77%, 4=3.81%, 10=5.79%, 20=7.78%, 50=33.01% lat (msec) : 100=28.97%, 250=9.24%, 500=0.42% cpu : usr=0.08%, sys=4.25%, ctx=6215, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144281: Mon Sep 21 11:36:33 2026 read: IOPS=9, BW=39.2KiB/s (40.1kB/s)(5940KiB/151546msec) clat (usec): min=35, max=321028, avg=50266.96, stdev=35742.27 lat (usec): min=36, max=321030, avg=50268.49, stdev=35742.33 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 65], 10.00th=[ 12649], 20.00th=[ 23725], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 43254], 60.00th=[ 51643], | 70.00th=[ 62653], 80.00th=[ 74974], 90.00th=[ 96994], 95.00th=[113771], | 99.00th=[162530], 99.50th=[191890], 99.90th=[246416], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 5, max= 103, per=24.90%, avg=39.34, stdev=17.59, samples=293 iops : min= 1, max= 25, avg= 9.16, stdev= 4.44, samples=293 write: IOPS=10, BW=41.9KiB/s (42.9kB/s)(6348KiB/151546msec); 0 zone resets clat (usec): min=951, max=467040, avg=48283.55, stdev=50721.53 lat (usec): min=953, max=467042, avg=48290.66, stdev=50724.96 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1500], 20.00th=[ 4883], | 30.00th=[ 11207], 40.00th=[ 22938], 50.00th=[ 35914], 60.00th=[ 48497], | 70.00th=[ 63701], 80.00th=[ 82314], 90.00th=[114820], 95.00th=[141558], | 99.00th=[231736], 99.50th=[267387], 99.90th=[450888], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 7, max= 119, per=25.06%, avg=41.35, stdev=19.84, samples=297 iops : min= 1, max= 29, avg= 9.68, stdev= 5.02, samples=297 lat (usec) : 50=0.13%, 100=3.71%, 250=0.36%, 500=0.10%, 1000=0.10% lat (msec) : 2=6.12%, 4=2.96%, 10=5.66%, 20=7.62%, 50=32.85% lat (msec) : 100=29.04%, 250=11.00%, 500=0.36% cpu : usr=0.07%, sys=4.56%, ctx=6509, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144282: Mon Sep 21 11:36:33 2026 read: IOPS=10, BW=40.7KiB/s (41.7kB/s)(6028KiB/148157msec) clat (usec): min=24, max=462669, avg=49396.00, stdev=36207.61 lat (usec): min=24, max=462670, avg=49402.31, stdev=36204.33 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 68], 10.00th=[ 13042], 20.00th=[ 23725], | 30.00th=[ 30278], 40.00th=[ 35914], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 58983], 80.00th=[ 73925], 90.00th=[ 92799], 95.00th=[112722], | 99.00th=[160433], 99.50th=[187696], 99.90th=[287310], 99.95th=[463471], | 99.99th=[463471] bw ( KiB/s): min= 7, max= 94, per=25.73%, avg=40.65, stdev=18.35, samples=288 iops : min= 1, max= 23, avg= 9.50, stdev= 4.63, samples=288 write: IOPS=10, BW=42.3KiB/s (43.3kB/s)(6260KiB/148157msec); 0 zone resets clat (usec): min=991, max=492471, avg=46965.95, stdev=48258.58 lat (usec): min=992, max=492473, avg=46970.28, stdev=48256.62 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1237], 10.00th=[ 1467], 20.00th=[ 4293], | 30.00th=[ 9372], 40.00th=[ 22152], 50.00th=[ 33817], 60.00th=[ 46924], | 70.00th=[ 65274], 80.00th=[ 83362], 90.00th=[108528], 95.00th=[137364], | 99.00th=[212861], 99.50th=[248513], 99.90th=[270533], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 7, max= 104, per=25.49%, avg=42.05, stdev=18.60, samples=289 iops : min= 1, max= 26, avg= 9.85, stdev= 4.70, samples=289 lat (usec) : 50=0.36%, 100=3.42%, 250=0.07%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=6.54%, 4=3.48%, 10=6.22%, 20=7.58%, 50=32.62% lat (msec) : 100=29.10%, 250=10.16%, 500=0.23% cpu : usr=0.08%, sys=4.29%, ctx=6395, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144283: Mon Sep 21 11:36:33 2026 read: IOPS=10, BW=40.1KiB/s (41.1kB/s)(6052KiB/150897msec) clat (usec): min=36, max=244884, avg=49958.78, stdev=34480.15 lat (usec): min=37, max=244885, avg=49962.20, stdev=34477.87 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 69], 10.00th=[ 14353], 20.00th=[ 23987], | 30.00th=[ 30016], 40.00th=[ 36439], 50.00th=[ 43779], 60.00th=[ 51643], | 70.00th=[ 60556], 80.00th=[ 74974], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[162530], 99.50th=[181404], 99.90th=[208667], 99.95th=[244319], | 99.99th=[244319] bw ( KiB/s): min= 7, max= 111, per=25.41%, avg=40.15, stdev=17.93, samples=293 iops : min= 1, max= 27, avg= 9.37, stdev= 4.53, samples=293 write: IOPS=10, BW=41.3KiB/s (42.3kB/s)(6236KiB/150897msec); 0 zone resets clat (usec): min=956, max=630917, avg=48102.18, stdev=52686.18 lat (usec): min=958, max=630918, avg=48105.49, stdev=52685.84 clat percentiles (usec): | 1.00th=[ 1123], 5.00th=[ 1237], 10.00th=[ 1369], 20.00th=[ 3916], | 30.00th=[ 8848], 40.00th=[ 20317], 50.00th=[ 34866], 60.00th=[ 47973], | 70.00th=[ 63701], 80.00th=[ 84411], 90.00th=[113771], 95.00th=[141558], | 99.00th=[221250], 99.50th=[246416], 99.90th=[480248], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 7, max= 102, per=24.80%, avg=40.92, stdev=19.34, samples=296 iops : min= 1, max= 25, avg= 9.57, stdev= 4.90, samples=296 lat (usec) : 50=0.29%, 100=3.09%, 250=0.46%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.13% lat (msec) : 2=7.45%, 4=2.90%, 10=6.22%, 20=6.77%, 50=32.55% lat (msec) : 100=29.00%, 250=10.81%, 500=0.16%, 750=0.03% cpu : usr=0.08%, sys=4.18%, ctx=6325, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=158KiB/s (162kB/s), 39.2KiB/s-41.1KiB/s (40.1kB/s-42.0kB/s), io=23.4MiB (24.6MB), run=145949-151546msec WRITE: bw=166KiB/s (170kB/s), 41.3KiB/s-43.1KiB/s (42.3kB/s-44.2kB/s), io=24.6MiB (25.7MB), run=145949-151546msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144275: Mon Sep 21 11:39:11 2026 read: IOPS=4, BW=19.2KiB/s (19.7kB/s)(5992KiB/311276msec) clat (msec): min=5, max=881, avg=48.01, stdev=47.03 lat (msec): min=5, max=881, avg=48.01, stdev=47.03 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 64], 90.00th=[ 93], 95.00th=[ 132], | 99.00th=[ 232], 99.50th=[ 257], 99.90th=[ 388], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 80, per=28.96%, avg=22.30, stdev=15.13, samples=517 iops : min= 1, max= 20, avg= 4.94, stdev= 3.84, samples=517 write: IOPS=5, BW=20.2KiB/s (20.7kB/s)(6296KiB/311276msec); 0 zone resets clat (msec): min=32, max=707, avg=151.76, stdev=85.41 lat (msec): min=32, max=707, avg=151.76, stdev=85.41 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 60], 10.00th=[ 69], 20.00th=[ 84], | 30.00th=[ 97], 40.00th=[ 112], 50.00th=[ 130], 60.00th=[ 148], | 70.00th=[ 174], 80.00th=[ 211], 90.00th=[ 268], 95.00th=[ 321], | 99.00th=[ 447], 99.50th=[ 498], 99.90th=[ 617], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 56, per=25.17%, avg=20.13, stdev=10.72, samples=599 iops : min= 1, max= 14, avg= 4.39, stdev= 2.75, samples=599 lat (msec) : 10=1.46%, 20=8.56%, 50=24.71%, 100=26.07%, 250=32.78% lat (msec) : 500=6.15%, 750=0.23%, 1000=0.03% cpu : usr=0.04%, sys=1.16%, ctx=5533, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144276: Mon Sep 21 11:39:11 2026 read: IOPS=4, BW=19.1KiB/s (19.6kB/s)(5940KiB/311007msec) clat (msec): min=5, max=782, avg=46.82, stdev=45.22 lat (msec): min=5, max=782, avg=46.82, stdev=45.22 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 50], 80.00th=[ 62], 90.00th=[ 91], 95.00th=[ 123], | 99.00th=[ 220], 99.50th=[ 268], 99.90th=[ 409], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 7, max= 88, per=29.33%, avg=22.59, stdev=15.09, samples=506 iops : min= 1, max= 22, avg= 5.01, stdev= 3.83, samples=506 write: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6348KiB/311007msec); 0 zone resets clat (msec): min=30, max=741, avg=151.82, stdev=84.39 lat (msec): min=30, max=741, avg=151.83, stdev=84.39 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 86], | 30.00th=[ 100], 40.00th=[ 114], 50.00th=[ 131], 60.00th=[ 150], | 70.00th=[ 176], 80.00th=[ 209], 90.00th=[ 259], 95.00th=[ 317], | 99.00th=[ 443], 99.50th=[ 518], 99.90th=[ 625], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 63, per=25.47%, avg=20.37, stdev=10.42, samples=597 iops : min= 1, max= 15, avg= 4.45, stdev= 2.68, samples=597 lat (msec) : 10=1.82%, 20=8.53%, 50=24.97%, 100=24.87%, 250=33.66% lat (msec) : 500=5.79%, 750=0.33%, 1000=0.03% cpu : usr=0.04%, sys=1.15%, ctx=5560, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144277: Mon Sep 21 11:39:11 2026 read: IOPS=4, BW=19.5KiB/s (20.0kB/s)(6028KiB/308398msec) clat (msec): min=4, max=397, avg=46.12, stdev=38.75 lat (msec): min=4, max=397, avg=46.12, stdev=38.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 91], 95.00th=[ 122], | 99.00th=[ 192], 99.50th=[ 226], 99.90th=[ 372], 99.95th=[ 397], | 99.99th=[ 397] bw ( KiB/s): min= 7, max= 95, per=29.38%, avg=22.63, stdev=15.26, samples=513 iops : min= 1, max= 23, avg= 5.03, stdev= 3.86, samples=513 write: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6260KiB/308398msec); 0 zone resets clat (msec): min=35, max=875, avg=152.35, stdev=86.80 lat (msec): min=35, max=875, avg=152.35, stdev=86.80 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 70], 20.00th=[ 85], | 30.00th=[ 100], 40.00th=[ 114], 50.00th=[ 129], 60.00th=[ 148], | 70.00th=[ 176], 80.00th=[ 211], 90.00th=[ 264], 95.00th=[ 321], | 99.00th=[ 430], 99.50th=[ 523], 99.90th=[ 735], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 7, max= 56, per=25.32%, avg=20.26, stdev=10.56, samples=592 iops : min= 1, max= 14, avg= 4.42, stdev= 2.71, samples=592 lat (msec) : 10=2.28%, 20=7.91%, 50=24.90%, 100=25.75%, 250=33.01% lat (msec) : 500=5.89%, 750=0.23%, 1000=0.03% cpu : usr=0.05%, sys=1.17%, ctx=5488, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144278: Mon Sep 21 11:39:11 2026 read: IOPS=4, BW=19.7KiB/s (20.2kB/s)(6052KiB/306498msec) clat (msec): min=6, max=439, avg=45.95, stdev=43.00 lat (msec): min=6, max=439, avg=45.95, stdev=43.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 61], 90.00th=[ 89], 95.00th=[ 126], | 99.00th=[ 213], 99.50th=[ 305], 99.90th=[ 418], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 87, per=30.02%, avg=23.12, stdev=15.69, samples=504 iops : min= 1, max= 21, avg= 5.15, stdev= 3.98, samples=504 write: IOPS=5, BW=20.3KiB/s (20.8kB/s)(6236KiB/306498msec); 0 zone resets clat (msec): min=38, max=869, avg=151.68, stdev=82.44 lat (msec): min=38, max=869, avg=151.68, stdev=82.44 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 62], 10.00th=[ 72], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 112], 50.00th=[ 129], 60.00th=[ 150], | 70.00th=[ 178], 80.00th=[ 209], 90.00th=[ 266], 95.00th=[ 309], | 99.00th=[ 401], 99.50th=[ 468], 99.90th=[ 651], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 7, max= 63, per=25.35%, avg=20.28, stdev=10.25, samples=589 iops : min= 1, max= 15, avg= 4.43, stdev= 2.62, samples=589 lat (msec) : 10=1.76%, 20=8.95%, 50=25.88%, 100=24.41%, 250=32.23% lat (msec) : 500=6.61%, 750=0.13%, 1000=0.03% cpu : usr=0.04%, sys=1.17%, ctx=5455, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=77.1KiB/s (78.0kB/s), 19.1KiB/s-19.7KiB/s (19.6kB/s-20.2kB/s), io=23.4MiB (24.6MB), run=306498-311276msec WRITE: bw=80.8KiB/s (82.7kB/s), 20.2KiB/s-20.4KiB/s (20.7kB/s-20.9kB/s), io=24.6MiB (25.7MB), run=306498-311276msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144349: Mon Sep 21 11:40:03 2026 read: IOPS=9, BW=149KiB/s (152kB/s)(5920KiB/39837msec) clat (usec): min=35, max=493421, avg=51029.66, stdev=51067.76 lat (usec): min=35, max=493423, avg=51031.44, stdev=51067.74 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 65], 10.00th=[ 72], 20.00th=[ 200], | 30.00th=[ 27919], 40.00th=[ 35390], 50.00th=[ 42730], 60.00th=[ 50070], | 70.00th=[ 61604], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[132645], | 99.00th=[210764], 99.50th=[375391], 99.90th=[492831], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 31, max= 408, per=26.67%, avg=160.26, stdev=84.87, samples=72 iops : min= 1, max= 25, avg= 9.26, stdev= 5.39, samples=72 write: IOPS=9, BW=160KiB/s (164kB/s)(6368KiB/39837msec); 0 zone resets clat (usec): min=1426, max=3180.0k, avg=51617.13, stdev=166416.18 lat (usec): min=1428, max=3180.0k, avg=51621.18, stdev=166417.18 clat percentiles (usec): | 1.00th=[ 1582], 5.00th=[ 1893], 10.00th=[ 2442], | 20.00th=[ 6063], 30.00th=[ 9241], 40.00th=[ 15401], | 50.00th=[ 23200], 60.00th=[ 36963], 70.00th=[ 54789], | 80.00th=[ 74974], 90.00th=[ 107480], 95.00th=[ 145753], | 99.00th=[ 312476], 99.50th=[ 484443], 99.90th=[3170894], | 99.95th=[3170894], 99.99th=[3170894] bw ( KiB/s): min= 31, max= 411, per=27.32%, avg=172.64, stdev=99.07, samples=72 iops : min= 1, max= 25, avg=10.04, stdev= 6.30, samples=72 lat (usec) : 50=0.91%, 100=7.68%, 250=1.04%, 750=0.26%, 1000=0.13% lat (msec) : 2=3.26%, 4=4.95%, 10=8.72%, 20=8.85%, 50=27.60% lat (msec) : 100=25.65%, 250=9.90%, 500=0.91%, >=2000=0.13% cpu : usr=0.05%, sys=4.09%, ctx=1424, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144350: Mon Sep 21 11:40:03 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(5744KiB/39480msec) clat (usec): min=37, max=359589, avg=51959.80, stdev=49666.87 lat (usec): min=37, max=359589, avg=51962.06, stdev=49666.81 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 65], 10.00th=[ 70], 20.00th=[ 486], | 30.00th=[ 25035], 40.00th=[ 36963], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 64226], 80.00th=[ 79168], 90.00th=[109577], 95.00th=[141558], | 99.00th=[295699], 99.50th=[320865], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 375, per=26.58%, avg=159.74, stdev=70.42, samples=70 iops : min= 1, max= 23, avg= 9.21, stdev= 4.45, samples=70 write: IOPS=10, BW=166KiB/s (170kB/s)(6544KiB/39480msec); 0 zone resets clat (usec): min=1492, max=3147.9k, avg=50506.58, stdev=162128.29 lat (usec): min=1495, max=3147.9k, avg=50528.02, stdev=162143.08 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1811], 10.00th=[ 2474], | 20.00th=[ 5342], 30.00th=[ 9634], 40.00th=[ 14484], | 50.00th=[ 27395], 60.00th=[ 37487], 70.00th=[ 52691], | 80.00th=[ 73925], 90.00th=[ 107480], 95.00th=[ 143655], | 99.00th=[ 210764], 99.50th=[ 265290], 99.90th=[3137340], | 99.95th=[3137340], 99.99th=[3137340] bw ( KiB/s): min= 30, max= 475, per=28.06%, avg=177.36, stdev=97.19, samples=72 iops : min= 1, max= 29, avg=10.32, stdev= 6.16, samples=72 lat (usec) : 50=0.91%, 100=7.42%, 250=0.91%, 500=0.13%, 1000=0.13% lat (msec) : 2=3.65%, 4=5.08%, 10=8.20%, 20=9.24%, 50=26.04% lat (msec) : 100=26.69%, 250=10.68%, 500=0.65%, 750=0.13%, >=2000=0.13% cpu : usr=0.09%, sys=4.07%, ctx=1452, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144351: Mon Sep 21 11:40:03 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6256KiB/38937msec) clat (usec): min=38, max=3161.7k, avg=55881.01, stdev=164578.10 lat (usec): min=38, max=3161.7k, avg=55886.51, stdev=164577.82 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 63], 10.00th=[ 70], | 20.00th=[ 103], 30.00th=[ 26346], 40.00th=[ 36963], | 50.00th=[ 42730], 60.00th=[ 51119], 70.00th=[ 60031], | 80.00th=[ 69731], 90.00th=[ 96994], 95.00th=[ 120062], | 99.00th=[ 235930], 99.50th=[ 480248], 99.90th=[3170894], | 99.95th=[3170894], 99.99th=[3170894] bw ( KiB/s): min= 31, max= 410, per=29.02%, avg=174.43, stdev=82.12, samples=70 iops : min= 1, max= 25, avg=10.13, stdev= 5.23, samples=70 write: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38937msec); 0 zone resets clat (usec): min=1221, max=527148, avg=44501.46, stdev=55246.65 lat (usec): min=1225, max=527152, avg=44512.82, stdev=55240.46 clat percentiles (usec): | 1.00th=[ 1762], 5.00th=[ 1991], 10.00th=[ 2671], 20.00th=[ 6390], | 30.00th=[ 11076], 40.00th=[ 15664], 50.00th=[ 26346], 60.00th=[ 38011], | 70.00th=[ 55313], 80.00th=[ 76022], 90.00th=[104334], 95.00th=[137364], | 99.00th=[187696], 99.50th=[497026], 99.90th=[526386], 99.95th=[526386], | 99.99th=[526386] bw ( KiB/s): min= 30, max= 475, per=26.52%, avg=167.61, stdev=87.86, samples=69 iops : min= 1, max= 29, avg= 9.70, stdev= 5.56, samples=69 lat (usec) : 50=1.04%, 100=8.72%, 250=1.56%, 500=0.26%, 750=0.13% lat (msec) : 2=2.47%, 4=5.47%, 10=6.51%, 20=9.77%, 50=26.69% lat (msec) : 100=26.30%, 250=10.42%, 500=0.39%, 750=0.13%, >=2000=0.13% cpu : usr=0.08%, sys=3.93%, ctx=1393, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144352: Mon Sep 21 11:40:03 2026 read: IOPS=9, BW=155KiB/s (159kB/s)(6032KiB/38951msec) clat (usec): min=37, max=3178.8k, avg=57349.63, stdev=169504.56 lat (usec): min=38, max=3178.8k, avg=57351.52, stdev=169504.54 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 62], 10.00th=[ 73], | 20.00th=[ 98], 30.00th=[ 25560], 40.00th=[ 34341], | 50.00th=[ 42206], 60.00th=[ 49546], 70.00th=[ 62129], | 80.00th=[ 79168], 90.00th=[ 103285], 95.00th=[ 132645], | 99.00th=[ 267387], 99.50th=[ 492831], 99.90th=[3170894], | 99.95th=[3170894], 99.99th=[3170894] bw ( KiB/s): min= 31, max= 446, per=28.32%, avg=170.22, stdev=76.05, samples=69 iops : min= 1, max= 27, avg= 9.88, stdev= 4.74, samples=69 write: IOPS=10, BW=161KiB/s (164kB/s)(6256KiB/38951msec); 0 zone resets clat (usec): min=1442, max=532282, avg=43448.67, stdev=56637.72 lat (usec): min=1445, max=532285, avg=43457.31, stdev=56636.77 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1991], 10.00th=[ 2376], 20.00th=[ 5932], | 30.00th=[ 10028], 40.00th=[ 15795], 50.00th=[ 24249], 60.00th=[ 36963], | 70.00th=[ 52167], 80.00th=[ 70779], 90.00th=[104334], 95.00th=[137364], | 99.00th=[291505], 99.50th=[467665], 99.90th=[530580], 99.95th=[530580], | 99.99th=[530580] bw ( KiB/s): min= 31, max= 520, per=27.25%, avg=172.23, stdev=90.66, samples=71 iops : min= 1, max= 32, avg=10.03, stdev= 5.72, samples=71 lat (usec) : 50=1.30%, 100=8.85%, 250=1.69%, 500=0.13%, 750=0.26% lat (usec) : 1000=0.13% lat (msec) : 2=2.99%, 4=5.21%, 10=7.68%, 20=7.81%, 50=28.39% lat (msec) : 100=24.74%, 250=9.64%, 500=0.91%, 750=0.13%, >=2000=0.13% cpu : usr=0.08%, sys=4.29%, ctx=1361, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=601KiB/s (616kB/s), 145KiB/s-161KiB/s (149kB/s-165kB/s), io=23.4MiB (24.5MB), run=38937-39837msec WRITE: bw=633KiB/s (648kB/s), 155KiB/s-166KiB/s (159kB/s-170kB/s), io=24.6MiB (25.8MB), run=38937-39837msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144345: Mon Sep 21 11:40:43 2026 read: IOPS=4, BW=73.8KiB/s (75.6kB/s)(5920KiB/80209msec) clat (msec): min=7, max=329, avg=45.60, stdev=49.02 lat (msec): min=7, max=329, avg=45.60, stdev=49.02 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 44], 80.00th=[ 56], 90.00th=[ 103], 95.00th=[ 153], | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 24, max= 288, per=30.37%, avg=90.19, stdev=55.10, samples=128 iops : min= 1, max= 18, avg= 4.85, stdev= 3.49, samples=128 write: IOPS=4, BW=79.4KiB/s (81.3kB/s)(6368KiB/80209msec); 0 zone resets clat (msec): min=40, max=3299, avg=158.27, stdev=183.97 lat (msec): min=40, max=3299, avg=158.27, stdev=183.97 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 68], 20.00th=[ 82], | 30.00th=[ 96], 40.00th=[ 108], 50.00th=[ 123], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 201], 90.00th=[ 271], 95.00th=[ 351], | 99.00th=[ 567], 99.50th=[ 617], 99.90th=[ 3306], 99.95th=[ 3306], | 99.99th=[ 3306] bw ( KiB/s): min= 19, max= 220, per=27.58%, avg=86.06, stdev=46.04, samples=145 iops : min= 1, max= 13, avg= 4.59, stdev= 2.93, samples=145 lat (msec) : 10=0.78%, 20=13.67%, 50=22.40%, 100=23.70%, 250=31.51% lat (msec) : 500=6.90%, 750=0.91%, >=2000=0.13% cpu : usr=0.03%, sys=1.08%, ctx=1279, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144346: Mon Sep 21 11:40:43 2026 read: IOPS=4, BW=71.3KiB/s (73.0kB/s)(5744KiB/80530msec) clat (msec): min=6, max=781, avg=43.48, stdev=57.73 lat (msec): min=6, max=781, avg=43.49, stdev=57.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 27], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 55], 90.00th=[ 91], 95.00th=[ 138], | 99.00th=[ 245], 99.50th=[ 309], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 19, max= 319, per=31.16%, avg=92.55, stdev=59.95, samples=120 iops : min= 1, max= 19, avg= 5.01, stdev= 3.81, samples=120 write: IOPS=5, BW=81.3KiB/s (83.2kB/s)(6544KiB/80530msec); 0 zone resets clat (msec): min=38, max=3372, avg=158.05, stdev=186.50 lat (msec): min=38, max=3372, avg=158.06, stdev=186.50 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 71], 20.00th=[ 81], | 30.00th=[ 94], 40.00th=[ 108], 50.00th=[ 121], 60.00th=[ 142], | 70.00th=[ 163], 80.00th=[ 203], 90.00th=[ 268], 95.00th=[ 342], | 99.00th=[ 584], 99.50th=[ 651], 99.90th=[ 3373], 99.95th=[ 3373], | 99.99th=[ 3373] bw ( KiB/s): min= 28, max= 192, per=28.01%, avg=87.39, stdev=44.80, samples=145 iops : min= 1, max= 12, avg= 4.67, stdev= 2.87, samples=145 lat (msec) : 10=2.21%, 20=14.45%, 50=20.31%, 100=24.09%, 250=32.42% lat (msec) : 500=5.34%, 750=0.91%, 1000=0.13%, >=2000=0.13% cpu : usr=0.03%, sys=1.01%, ctx=1237, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144347: Mon Sep 21 11:40:43 2026 read: IOPS=4, BW=79.0KiB/s (81.9kB/s)(6256KiB/78202msec) clat (msec): min=9, max=316, avg=43.46, stdev=43.79 lat (msec): min=9, max=316, avg=43.46, stdev=43.79 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 14], 20.00th=[ 18], | 30.00th=[ 21], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 56], 90.00th=[ 89], 95.00th=[ 142], | 99.00th=[ 245], 99.50th=[ 249], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 24, max= 318, per=32.64%, avg=96.94, stdev=66.65, samples=127 iops : min= 1, max= 19, avg= 5.27, stdev= 4.22, samples=127 write: IOPS=4, BW=77.1KiB/s (78.0kB/s)(6032KiB/78202msec); 0 zone resets clat (msec): min=42, max=3568, avg=161.56, stdev=199.82 lat (msec): min=42, max=3568, avg=161.57, stdev=199.83 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 140], | 70.00th=[ 159], 80.00th=[ 205], 90.00th=[ 271], 95.00th=[ 359], | 99.00th=[ 575], 99.50th=[ 642], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 19, max= 192, per=26.25%, avg=81.90, stdev=45.05, samples=144 iops : min= 1, max= 12, avg= 4.32, stdev= 2.85, samples=144 lat (msec) : 10=0.39%, 20=14.32%, 50=24.74%, 100=22.92%, 250=30.99% lat (msec) : 500=5.86%, 750=0.65%, >=2000=0.13% cpu : usr=0.04%, sys=1.04%, ctx=1220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144348: Mon Sep 21 11:40:43 2026 read: IOPS=4, BW=75.7KiB/s (77.5kB/s)(6032KiB/79704msec) clat (msec): min=7, max=446, avg=45.05, stdev=49.24 lat (msec): min=7, max=446, avg=45.05, stdev=49.24 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 62], 90.00th=[ 97], 95.00th=[ 150], | 99.00th=[ 243], 99.50th=[ 334], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 19, max= 313, per=31.89%, avg=94.73, stdev=63.82, samples=124 iops : min= 1, max= 19, avg= 5.15, stdev= 4.03, samples=124 write: IOPS=4, BW=78.5KiB/s (80.4kB/s)(6256KiB/79704msec); 0 zone resets clat (msec): min=44, max=3565, avg=160.09, stdev=196.72 lat (msec): min=44, max=3565, avg=160.10, stdev=196.73 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 62], 10.00th=[ 69], 20.00th=[ 83], | 30.00th=[ 97], 40.00th=[ 113], 50.00th=[ 128], 60.00th=[ 142], | 70.00th=[ 167], 80.00th=[ 203], 90.00th=[ 268], 95.00th=[ 363], | 99.00th=[ 617], 99.50th=[ 726], 99.90th=[ 3574], 99.95th=[ 3574], | 99.99th=[ 3574] bw ( KiB/s): min= 19, max= 223, per=26.94%, avg=84.05, stdev=45.71, samples=146 iops : min= 1, max= 13, avg= 4.46, stdev= 2.91, samples=146 lat (msec) : 10=1.82%, 20=13.93%, 50=21.74%, 100=23.57%, 250=32.42% lat (msec) : 500=5.86%, 750=0.52%, >=2000=0.13% cpu : usr=0.04%, sys=1.13%, ctx=1273, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=297KiB/s (305kB/s), 71.3KiB/s-79.0KiB/s (73.0kB/s-81.9kB/s), io=23.4MiB (24.5MB), run=78202-80530msec WRITE: bw=313KiB/s (320kB/s), 77.1KiB/s-81.3KiB/s (78.0kB/s-83.2kB/s), io=24.6MiB (25.8MB), run=78202-80530msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144373: Mon Sep 21 11:41:04 2026 read: IOPS=1, BW=1489KiB/s (1525kB/s)(7168KiB/4814msec) clat (msec): min=143, max=492, avg=294.52, stdev=132.37 lat (msec): min=143, max=492, avg=294.52, stdev=132.37 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 150], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 321], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 393], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1973, max= 4071, per=94.43%, avg=3363.67, stdev=1204.41, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1064KiB/s (1089kB/s)(5120KiB/4814msec); 0 zone resets clat (msec): min=204, max=636, avg=471.79, stdev=176.05 lat (msec): min=204, max=636, avg=471.90, stdev=176.05 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 409], 40.00th=[ 409], 50.00th=[ 493], 60.00th=[ 493], | 70.00th=[ 617], 80.00th=[ 617], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 1984, max= 4000, per=53.62%, avg=2674.33, stdev=1148.39, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=33.33%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=4.49%, ctx=81, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144374: Mon Sep 21 11:41:04 2026 read: IOPS=0, BW=356KiB/s (365kB/s)(2048KiB/5748msec) clat (msec): min=186, max=195, avg=191.03, stdev= 6.05 lat (msec): min=186, max=195, avg=191.03, stdev= 6.05 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 188], | 30.00th=[ 188], 40.00th=[ 188], 50.00th=[ 188], 60.00th=[ 197], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 1700, max= 2027, per=52.32%, avg=1863.50, stdev=231.22, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1781KiB/s (1824kB/s)(10.0MiB/5748msec); 0 zone resets clat (msec): min=221, max=1023, avg=525.03, stdev=258.01 lat (msec): min=221, max=1023, avg=525.14, stdev=258.01 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 300], | 30.00th=[ 338], 40.00th=[ 363], 50.00th=[ 401], 60.00th=[ 435], | 70.00th=[ 684], 80.00th=[ 709], 90.00th=[ 776], 95.00th=[ 1028], | 99.00th=[ 1028], 99.50th=[ 1028], 99.90th=[ 1028], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 1700, max= 4071, per=44.75%, avg=2232.25, stdev=751.78, samples=8 iops : min= 1, max= 3, avg= 1.50, stdev= 0.76, samples=8 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=4.05%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144375: Mon Sep 21 11:41:04 2026 read: IOPS=1, BW=1112KiB/s (1139kB/s)(6144KiB/5524msec) clat (msec): min=87, max=536, avg=244.74, stdev=167.48 lat (msec): min=87, max=536, avg=244.74, stdev=167.48 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 88], 10.00th=[ 88], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 155], 50.00th=[ 155], 60.00th=[ 241], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 2035, max= 4063, per=93.70%, avg=3337.67, stdev=1130.57, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1112KiB/s (1139kB/s)(6144KiB/5524msec); 0 zone resets clat (msec): min=513, max=745, avg=625.54, stdev=98.91 lat (msec): min=513, max=745, avg=625.65, stdev=98.91 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 542], | 30.00th=[ 542], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 667], | 70.00th=[ 726], 80.00th=[ 726], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1957, max= 2027, per=39.95%, avg=1992.60, stdev=29.57, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=8.33%, 750=58.33% cpu : usr=0.00%, sys=3.42%, ctx=71, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144376: Mon Sep 21 11:41:04 2026 read: IOPS=0, BW=909KiB/s (930kB/s)(5120KiB/5635msec) clat (msec): min=109, max=802, avg=400.43, stdev=313.36 lat (msec): min=109, max=802, avg=400.43, stdev=313.36 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 126], 40.00th=[ 126], 50.00th=[ 313], 60.00th=[ 313], | 70.00th=[ 651], 80.00th=[ 651], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 1957, max= 4039, per=75.12%, avg=2675.67, stdev=1181.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1272KiB/s (1303kB/s)(7168KiB/5635msec); 0 zone resets clat (msec): min=191, max=834, avg=459.66, stdev=259.20 lat (msec): min=191, max=835, avg=459.98, stdev=259.38 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 249], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 422], 60.00th=[ 460], | 70.00th=[ 460], 80.00th=[ 793], 90.00th=[ 835], 95.00th=[ 835], | 99.00th=[ 835], 99.50th=[ 835], 99.90th=[ 835], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 1976, max= 2048, per=40.57%, avg=2023.40, stdev=27.65, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 250=33.33%, 500=33.33%, 750=8.33%, 1000=25.00% cpu : usr=0.02%, sys=2.59%, ctx=86, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3563KiB/s (3648kB/s), 356KiB/s-1489KiB/s (365kB/s-1525kB/s), io=20.0MiB (20.0MB), run=4814-5748msec WRITE: bw=4988KiB/s (5108kB/s), 1064KiB/s-1781KiB/s (1089kB/s-1824kB/s), io=28.0MiB (29.4MB), run=4814-5748msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144377: Mon Sep 21 11:41:04 2026 read: IOPS=1, BW=2011KiB/s (2059kB/s)(7168KiB/3564msec) clat (msec): min=2, max=466, avg=265.40, stdev=142.21 lat (msec): min=2, max=466, avg=265.40, stdev=142.21 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 241], | 30.00th=[ 243], 40.00th=[ 243], 50.00th=[ 253], 60.00th=[ 288], | 70.00th=[ 288], 80.00th=[ 368], 90.00th=[ 468], 95.00th=[ 468], | 99.00th=[ 468], 99.50th=[ 468], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 2019, max= 5688, per=84.66%, avg=2941.25, stdev=1831.17, samples=4 iops : min= 1, max= 5, avg= 2.00, stdev= 2.00, samples=4 write: IOPS=1, BW=1437KiB/s (1471kB/s)(5120KiB/3564msec); 0 zone resets clat (msec): min=172, max=349, avg=264.63, stdev=67.81 lat (msec): min=172, max=349, avg=264.74, stdev=67.82 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 174], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 247], 60.00th=[ 247], | 70.00th=[ 309], 80.00th=[ 309], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2019, max= 4031, per=51.96%, avg=2527.00, stdev=1002.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 4=8.33%, 250=41.67%, 500=50.00% cpu : usr=0.00%, sys=14.20%, ctx=190, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144378: Mon Sep 21 11:41:04 2026 read: IOPS=0, BW=347KiB/s (356kB/s)(2048KiB/5895msec) clat (msec): min=41, max=140, avg=91.12, stdev=70.20 lat (msec): min=41, max=140, avg=91.12, stdev=70.20 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 42], 10.00th=[ 42], 20.00th=[ 42], | 30.00th=[ 42], 40.00th=[ 42], 50.00th=[ 42], 60.00th=[ 142], | 70.00th=[ 142], 80.00th=[ 142], 90.00th=[ 142], 95.00th=[ 142], | 99.00th=[ 142], 99.50th=[ 142], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 1899, max= 2019, per=56.39%, avg=1959.00, stdev=84.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1737KiB/s (1779kB/s)(10.0MiB/5895msec); 0 zone resets clat (msec): min=182, max=955, avg=552.03, stdev=224.82 lat (msec): min=182, max=957, avg=552.26, stdev=225.09 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 288], | 30.00th=[ 372], 40.00th=[ 542], 50.00th=[ 567], 60.00th=[ 592], | 70.00th=[ 609], 80.00th=[ 693], 90.00th=[ 718], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1896, max= 4079, per=46.65%, avg=2268.62, stdev=733.04, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (msec) : 50=8.33%, 250=16.67%, 500=16.67%, 750=50.00%, 1000=8.33% cpu : usr=0.02%, sys=11.49%, ctx=182, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144379: Mon Sep 21 11:41:04 2026 read: IOPS=1, BW=1475KiB/s (1511kB/s)(6144KiB/4165msec) clat (usec): min=813, max=356883, avg=95636.13, stdev=152700.86 lat (usec): min=813, max=356885, avg=95637.53, stdev=152701.15 clat percentiles (usec): | 1.00th=[ 816], 5.00th=[ 816], 10.00th=[ 816], 20.00th=[ 1037], | 30.00th=[ 1037], 40.00th=[ 1745], 50.00th=[ 1745], 60.00th=[ 3392], | 70.00th=[210764], 80.00th=[210764], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 1980, max= 4071, per=96.74%, avg=3360.67, stdev=1195.86, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1475KiB/s (1511kB/s)(6144KiB/4165msec); 0 zone resets clat (msec): min=227, max=1074, avg=526.44, stdev=329.27 lat (msec): min=227, max=1074, avg=526.55, stdev=329.31 clat percentiles (msec): | 1.00th=[ 228], 5.00th=[ 228], 10.00th=[ 228], 20.00th=[ 259], | 30.00th=[ 259], 40.00th=[ 300], 50.00th=[ 300], 60.00th=[ 642], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1878, max= 2035, per=40.81%, avg=1984.60, stdev=62.80, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 1000=8.33% lat (msec) : 2=16.67%, 4=8.33%, 250=16.67%, 500=25.00%, 750=16.67% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=10.18%, ctx=148, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144380: Mon Sep 21 11:41:04 2026 read: IOPS=1, BW=1394KiB/s (1428kB/s)(5120KiB/3672msec) clat (msec): min=2, max=494, avg=305.40, stdev=197.61 lat (msec): min=2, max=494, avg=305.40, stdev=197.61 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 218], 40.00th=[ 218], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 422], 80.00th=[ 422], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 2035, max= 4031, per=77.81%, avg=2703.00, stdev=1150.09, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1952KiB/s (1999kB/s)(7168KiB/3672msec); 0 zone resets clat (msec): min=131, max=386, avg=266.90, stdev=104.70 lat (msec): min=131, max=386, avg=267.01, stdev=104.69 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 167], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 313], 60.00th=[ 347], | 70.00th=[ 347], 80.00th=[ 347], 90.00th=[ 388], 95.00th=[ 388], | 99.00th=[ 388], 99.50th=[ 388], 99.90th=[ 388], 99.95th=[ 388], | 99.99th=[ 388] bw ( KiB/s): min= 2015, max= 3757, per=54.92%, avg=2670.75, stdev=827.90, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 4=8.33%, 250=33.33%, 500=58.33% cpu : usr=0.00%, sys=15.47%, ctx=140, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3474KiB/s (3558kB/s), 347KiB/s-2011KiB/s (356kB/s-2059kB/s), io=20.0MiB (20.0MB), run=3564-5895msec WRITE: bw=4864KiB/s (4981kB/s), 1437KiB/s-1952KiB/s (1471kB/s-1999kB/s), io=28.0MiB (29.4MB), run=3564-5895msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144391: Mon Sep 21 11:41:21 2026 read: IOPS=0, BW=3535KiB/s (3620kB/s)(12.0MiB/3476msec) clat (msec): min=875, max=1237, avg=1050.42, stdev=181.17 lat (msec): min=875, max=1237, avg=1050.42, stdev=181.17 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1036], 50.00th=[ 1036], 60.00th=[ 1036], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 7846, max= 8143, per=100.00%, avg=7994.50, stdev=210.01, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=10.73%, ctx=269, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144393: Mon Sep 21 11:41:21 2026 read: IOPS=0, BW=949KiB/s (971kB/s)(4096KiB/4318msec) clat (nsec): min=994570k, max=994570k, avg=994570198.00, stdev= 0.00 lat (nsec): min=994573k, max=994573k, avg=994573143.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 995], 5.00th=[ 995], 10.00th=[ 995], 20.00th=[ 995], | 30.00th=[ 995], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 995], 80.00th=[ 995], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1897KiB/s (1943kB/s)(8192KiB/4318msec); 0 zone resets clat (msec): min=906, max=2302, avg=1604.03, stdev=987.16 lat (msec): min=906, max=2303, avg=1605.31, stdev=988.05 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 2299], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.45%, ctx=271, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144395: Mon Sep 21 11:41:21 2026 write: IOPS=0, BW=2377KiB/s (2434kB/s)(12.0MiB/5169msec); 0 zone resets clat (msec): min=419, max=2581, avg=1631.14, stdev=1104.12 lat (msec): min=420, max=2581, avg=1632.41, stdev=1104.39 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 1888], 50.00th=[ 1888], 60.00th=[ 1888], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 7846, max= 7846, per=100.00%, avg=7846.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.30%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144396: Mon Sep 21 11:41:21 2026 write: IOPS=0, BW=3780KiB/s (3870kB/s)(12.0MiB/3251msec); 0 zone resets clat (msec): min=425, max=2295, avg=1055.08, stdev=1074.47 lat (msec): min=426, max=2296, avg=1055.65, stdev=1074.74 clat percentiles (msec): | 1.00th=[ 426], 5.00th=[ 426], 10.00th=[ 426], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 443], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 2299], 80.00th=[ 2299], 90.00th=[ 2299], 95.00th=[ 2299], | 99.00th=[ 2299], 99.50th=[ 2299], 99.90th=[ 2299], 99.95th=[ 2299], | 99.99th=[ 2299] bw ( KiB/s): min= 6860, max= 7846, per=100.00%, avg=7353.00, stdev=697.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.38%, ctx=53, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3794KiB/s (3885kB/s), 949KiB/s-3535KiB/s (971kB/s-3620kB/s), io=16.0MiB (16.8MB), run=3476-4318msec WRITE: bw=6339KiB/s (6491kB/s), 1897KiB/s-3780KiB/s (1943kB/s-3870kB/s), io=32.0MiB (33.6MB), run=3251-5169msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144389: Mon Sep 21 11:41:22 2026 read: IOPS=0, BW=2259KiB/s (2313kB/s)(12.0MiB/5440msec) clat (msec): min=470, max=2565, avg=1716.22, stdev=1102.22 lat (msec): min=470, max=2565, avg=1716.23, stdev=1102.22 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 2106], 50.00th=[ 2106], 60.00th=[ 2106], | 70.00th=[ 2567], 80.00th=[ 2567], 90.00th=[ 2567], 95.00th=[ 2567], | 99.00th=[ 2567], 99.50th=[ 2567], 99.90th=[ 2567], 99.95th=[ 2567], | 99.99th=[ 2567] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, >=2000=66.67% cpu : usr=0.00%, sys=1.73%, ctx=53, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144390: Mon Sep 21 11:41:22 2026 read: IOPS=0, BW=1537KiB/s (1574kB/s)(4096KiB/2665msec) clat (nsec): min=252099k, max=252099k, avg=252098725.00, stdev= 0.00 lat (nsec): min=252101k, max=252101k, avg=252101425.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 253], 50.00th=[ 253], 60.00th=[ 253], | 70.00th=[ 253], 80.00th=[ 253], 90.00th=[ 253], 95.00th=[ 253], | 99.00th=[ 253], 99.50th=[ 253], 99.90th=[ 253], 99.95th=[ 253], | 99.99th=[ 253] bw ( KiB/s): min= 5728, max= 5728, per=100.00%, avg=5728.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3074KiB/s (3148kB/s)(8192KiB/2665msec); 0 zone resets clat (msec): min=1065, max=1199, avg=1132.39, stdev=94.27 lat (msec): min=1066, max=1199, avg=1132.73, stdev=94.21 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.06%, ctx=63, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144392: Mon Sep 21 11:41:22 2026 write: IOPS=0, BW=3029KiB/s (3102kB/s)(12.0MiB/4057msec); 0 zone resets clat (msec): min=697, max=1706, avg=1316.48, stdev=542.25 lat (msec): min=704, max=1706, avg=1319.47, stdev=538.40 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 1552], 50.00th=[ 1552], 60.00th=[ 1552], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 7816, max= 8110, per=100.00%, avg=7963.00, stdev=207.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.91%, ctx=76, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144394: Mon Sep 21 11:41:22 2026 write: IOPS=0, BW=2723KiB/s (2788kB/s)(12.0MiB/4513msec); 0 zone resets clat (msec): min=766, max=2143, avg=1412.50, stdev=692.40 lat (msec): min=766, max=2147, avg=1414.55, stdev=694.24 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 1334], 50.00th=[ 1334], 60.00th=[ 1334], | 70.00th=[ 2140], 80.00th=[ 2140], 90.00th=[ 2140], 95.00th=[ 2140], | 99.00th=[ 2140], 99.50th=[ 2140], 99.90th=[ 2140], 99.95th=[ 2140], | 99.99th=[ 2140] bw ( KiB/s): min= 7816, max= 8078, per=100.00%, avg=7947.00, stdev=185.26, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.19%, ctx=42, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3012KiB/s (3084kB/s), 1537KiB/s-2259KiB/s (1574kB/s-2313kB/s), io=16.0MiB (16.8MB), run=2665-5440msec WRITE: bw=7261KiB/s (7435kB/s), 2723KiB/s-3074KiB/s (2788kB/s-3148kB/s), io=32.0MiB (33.6MB), run=2665-4513msec