== sanity test 398b: DIO and buffer IO race ============== 22:55:04 (1781232904) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 4.65681 s, 10.8 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145499: Thu Jun 11 22:57:21 2026 read: IOPS=12, BW=49.7KiB/s (50.9kB/s)(5992KiB/120484msec) clat (usec): min=32, max=455286, avg=39832.49, stdev=31455.26 lat (usec): min=33, max=455287, avg=39834.83, stdev=31454.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 1139], 20.00th=[ 18744], | 30.00th=[ 23725], 40.00th=[ 27919], 50.00th=[ 33817], 60.00th=[ 40109], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 73925], 95.00th=[ 91751], | 99.00th=[149947], 99.50th=[187696], 99.90th=[252707], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 119, per=24.98%, avg=49.45, stdev=22.12, samples=236 iops : min= 1, max= 29, avg=11.74, stdev= 5.61, samples=236 write: IOPS=13, BW=52.3KiB/s (53.5kB/s)(6296KiB/120484msec); 0 zone resets clat (usec): min=1118, max=736904, avg=38315.75, stdev=45274.58 lat (usec): min=1120, max=736905, avg=38318.02, stdev=45274.94 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1385], 10.00th=[ 2073], 20.00th=[ 4228], | 30.00th=[ 7767], 40.00th=[ 16450], 50.00th=[ 27132], 60.00th=[ 38011], | 70.00th=[ 48497], 80.00th=[ 63177], 90.00th=[ 88605], 95.00th=[115868], | 99.00th=[189793], 99.50th=[248513], 99.90th=[442500], 99.95th=[734004], | 99.99th=[734004] bw ( KiB/s): min= 7, max= 123, per=24.97%, avg=51.68, stdev=23.08, samples=237 iops : min= 1, max= 30, avg=12.29, stdev= 5.84, samples=237 lat (usec) : 50=0.55%, 100=3.65%, 250=0.52%, 500=0.07%, 750=0.07% lat (msec) : 2=4.98%, 4=4.92%, 10=8.17%, 20=9.93%, 50=38.48% lat (msec) : 100=23.50%, 250=4.88%, 500=0.26%, 750=0.03% cpu : usr=0.08%, sys=5.83%, ctx=6561, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145500: Thu Jun 11 22:57:21 2026 read: IOPS=12, BW=49.3KiB/s (50.5kB/s)(5940KiB/120550msec) clat (usec): min=24, max=384076, avg=37996.71, stdev=30862.64 lat (usec): min=24, max=384077, avg=37998.37, stdev=30862.78 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 824], 20.00th=[ 17695], | 30.00th=[ 21627], 40.00th=[ 26346], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 45876], 80.00th=[ 55837], 90.00th=[ 72877], 95.00th=[ 90702], | 99.00th=[139461], 99.50th=[189793], 99.90th=[250610], 99.95th=[383779], | 99.99th=[383779] bw ( KiB/s): min= 7, max= 120, per=24.84%, avg=49.19, stdev=22.87, samples=236 iops : min= 1, max= 30, avg=11.67, stdev= 5.77, samples=236 write: IOPS=13, BW=52.7KiB/s (53.9kB/s)(6348KiB/120550msec); 0 zone resets clat (usec): min=792, max=704142, avg=40082.43, stdev=45061.78 lat (usec): min=793, max=704144, avg=40089.35, stdev=45067.95 clat percentiles (usec): | 1.00th=[ 1254], 5.00th=[ 1401], 10.00th=[ 2180], 20.00th=[ 4948], | 30.00th=[ 9372], 40.00th=[ 17695], 50.00th=[ 28967], 60.00th=[ 39060], | 70.00th=[ 51119], 80.00th=[ 67634], 90.00th=[ 93848], 95.00th=[117965], | 99.00th=[189793], 99.50th=[242222], 99.90th=[446694], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 7, max= 120, per=25.29%, avg=52.35, stdev=23.23, samples=237 iops : min= 1, max= 30, avg=12.46, stdev= 5.88, samples=237 lat (usec) : 50=0.72%, 100=3.78%, 250=0.13%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=4.79%, 4=4.62%, 10=7.49%, 20=12.76%, 50=37.37% lat (msec) : 100=22.07%, 250=5.79%, 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=5.83%, ctx=6728, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145501: Thu Jun 11 22:57:21 2026 read: IOPS=12, BW=49.8KiB/s (51.0kB/s)(6028KiB/120996msec) clat (usec): min=33, max=767508, avg=38297.03, stdev=34291.48 lat (usec): min=34, max=767510, avg=38298.98, stdev=34291.06 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 57], 10.00th=[ 388], 20.00th=[ 17433], | 30.00th=[ 22414], 40.00th=[ 26608], 50.00th=[ 31589], 60.00th=[ 38011], | 70.00th=[ 46924], 80.00th=[ 56886], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[131597], 99.50th=[156238], 99.90th=[304088], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 120, per=24.80%, avg=49.10, stdev=21.99, samples=238 iops : min= 1, max= 30, avg=11.63, stdev= 5.52, samples=238 write: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6260KiB/120996msec); 0 zone resets clat (usec): min=1104, max=440863, avg=40122.28, stdev=41752.13 lat (usec): min=1107, max=440864, avg=40126.91, stdev=41749.90 clat percentiles (usec): | 1.00th=[ 1221], 5.00th=[ 1336], 10.00th=[ 1860], 20.00th=[ 4555], | 30.00th=[ 9896], 40.00th=[ 19268], 50.00th=[ 30016], 60.00th=[ 40109], | 70.00th=[ 54789], 80.00th=[ 69731], 90.00th=[ 89654], 95.00th=[110625], | 99.00th=[183501], 99.50th=[246416], 99.90th=[367002], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 7, max= 116, per=24.75%, avg=51.22, stdev=20.26, samples=236 iops : min= 1, max= 29, avg=12.18, stdev= 5.14, samples=236 lat (usec) : 50=0.88%, 100=3.19%, 250=0.78%, 500=0.13%, 1000=0.07% lat (msec) : 2=5.44%, 4=4.04%, 10=6.25%, 20=12.14%, 50=37.60% lat (msec) : 100=24.38%, 250=4.82%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=5.90%, ctx=6673, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145502: Thu Jun 11 22:57:21 2026 read: IOPS=12, BW=50.2KiB/s (51.4kB/s)(6052KiB/120541msec) clat (usec): min=33, max=748894, avg=39169.85, stdev=35822.14 lat (usec): min=33, max=748895, avg=39172.03, stdev=35821.63 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 58], 10.00th=[ 2737], 20.00th=[ 18482], | 30.00th=[ 23462], 40.00th=[ 27919], 50.00th=[ 33162], 60.00th=[ 38536], | 70.00th=[ 46400], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 87557], | 99.00th=[147850], 99.50th=[198181], 99.90th=[341836], 99.95th=[750781], | 99.99th=[750781] bw ( KiB/s): min= 7, max= 121, per=25.20%, avg=49.89, stdev=19.83, samples=237 iops : min= 1, max= 30, avg=11.84, stdev= 5.02, samples=237 write: IOPS=12, BW=51.7KiB/s (52.0kB/s)(6236KiB/120541msec); 0 zone resets clat (usec): min=997, max=434904, avg=38995.14, stdev=40379.41 lat (usec): min=998, max=434905, avg=38997.57, stdev=40379.74 clat percentiles (usec): | 1.00th=[ 1237], 5.00th=[ 1401], 10.00th=[ 2180], 20.00th=[ 5276], | 30.00th=[ 10159], 40.00th=[ 20579], 50.00th=[ 29230], 60.00th=[ 38011], | 70.00th=[ 49021], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[109577], | 99.00th=[175113], 99.50th=[206570], 99.90th=[371196], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 7, max= 119, per=24.85%, avg=51.45, stdev=22.29, samples=237 iops : min= 1, max= 29, avg=12.23, stdev= 5.62, samples=237 lat (usec) : 50=0.78%, 100=3.55%, 250=0.36%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=4.62%, 4=3.71%, 10=7.36%, 20=11.04%, 50=40.49% lat (msec) : 100=22.88%, 250=4.79%, 500=0.20%, 750=0.03% cpu : usr=0.07%, sys=5.67%, ctx=6644, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=198KiB/s (203kB/s), 49.3KiB/s-50.2KiB/s (50.5kB/s-51.4kB/s), io=23.4MiB (24.6MB), run=120484-120996msec WRITE: bw=208KiB/s (213kB/s), 51.7KiB/s-52.7KiB/s (52.0kB/s-53.9kB/s), io=24.6MiB (25.7MB), run=120484-120996msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145504: Thu Jun 11 22:59:39 2026 read: IOPS=5, BW=23.3KiB/s (23.8kB/s)(5992KiB/257675msec) clat (msec): min=5, max=1032, avg=33.17, stdev=41.67 lat (msec): min=5, max=1032, avg=33.17, stdev=41.67 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 32], 80.00th=[ 45], 90.00th=[ 73], 95.00th=[ 96], | 99.00th=[ 157], 99.50th=[ 197], 99.90th=[ 426], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 7, max= 95, per=27.91%, avg=25.96, stdev=17.60, samples=446 iops : min= 1, max= 23, avg= 5.88, stdev= 4.45, samples=446 write: IOPS=6, BW=24.4KiB/s (25.0kB/s)(6296KiB/257675msec); 0 zone resets clat (msec): min=37, max=688, avg=132.05, stdev=61.02 lat (msec): min=37, max=688, avg=132.06, stdev=61.02 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 96], 40.00th=[ 106], 50.00th=[ 117], 60.00th=[ 131], | 70.00th=[ 148], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 247], | 99.00th=[ 338], 99.50th=[ 368], 99.90th=[ 481], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 56, per=24.75%, avg=24.01, stdev=10.27, samples=505 iops : min= 1, max= 14, avg= 5.39, stdev= 2.63, samples=505 lat (msec) : 10=3.91%, 20=18.26%, 50=18.68%, 100=23.73%, 250=32.94% lat (msec) : 500=2.41%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5302, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145505: Thu Jun 11 22:59:39 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(5940KiB/257067msec) clat (msec): min=5, max=790, avg=33.29, stdev=40.48 lat (msec): min=5, max=790, avg=33.29, stdev=40.48 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 70], 95.00th=[ 96], | 99.00th=[ 180], 99.50th=[ 268], 99.90th=[ 418], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7, max= 103, per=27.33%, avg=25.41, stdev=17.12, samples=452 iops : min= 1, max= 25, avg= 5.74, stdev= 4.32, samples=452 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6348KiB/257067msec); 0 zone resets clat (msec): min=37, max=690, avg=130.74, stdev=61.70 lat (msec): min=37, max=690, avg=130.74, stdev=61.70 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 84], | 30.00th=[ 95], 40.00th=[ 106], 50.00th=[ 116], 60.00th=[ 131], | 70.00th=[ 146], 80.00th=[ 165], 90.00th=[ 209], 95.00th=[ 253], | 99.00th=[ 334], 99.50th=[ 384], 99.90th=[ 617], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 7, max= 48, per=25.19%, avg=24.43, stdev=10.33, samples=502 iops : min= 1, max= 12, avg= 5.50, stdev= 2.65, samples=502 lat (msec) : 10=3.61%, 20=19.27%, 50=17.81%, 100=23.70%, 250=32.52% lat (msec) : 500=2.99%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.36%, ctx=5304, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145506: Thu Jun 11 22:59:39 2026 read: IOPS=5, BW=23.4KiB/s (23.9kB/s)(6028KiB/257833msec) clat (msec): min=5, max=426, avg=33.36, stdev=35.38 lat (msec): min=5, max=426, avg=33.36, stdev=35.38 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 46], 90.00th=[ 74], 95.00th=[ 101], | 99.00th=[ 169], 99.50th=[ 249], 99.90th=[ 393], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 95, per=27.53%, avg=25.60, stdev=16.48, samples=456 iops : min= 1, max= 23, avg= 5.79, stdev= 4.16, samples=456 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6260KiB/257833msec); 0 zone resets clat (msec): min=35, max=835, avg=132.52, stdev=62.40 lat (msec): min=35, max=835, avg=132.52, stdev=62.40 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 74], 20.00th=[ 86], | 30.00th=[ 97], 40.00th=[ 109], 50.00th=[ 120], 60.00th=[ 133], | 70.00th=[ 146], 80.00th=[ 169], 90.00th=[ 211], 95.00th=[ 247], | 99.00th=[ 326], 99.50th=[ 397], 99.90th=[ 617], 99.95th=[ 835], | 99.99th=[ 835] bw ( KiB/s): min= 7, max= 48, per=24.75%, avg=24.01, stdev=10.52, samples=504 iops : min= 1, max= 12, avg= 5.39, stdev= 2.69, samples=504 lat (msec) : 10=3.91%, 20=18.82%, 50=17.90%, 100=22.53%, 250=34.34% lat (msec) : 500=2.41%, 750=0.07%, 1000=0.03% cpu : usr=0.04%, sys=1.41%, ctx=5340, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145507: Thu Jun 11 22:59:39 2026 read: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6052KiB/256236msec) clat (msec): min=5, max=324, avg=31.96, stdev=31.93 lat (msec): min=5, max=324, avg=31.96, stdev=31.93 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 31], 80.00th=[ 44], 90.00th=[ 71], 95.00th=[ 94], | 99.00th=[ 157], 99.50th=[ 176], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 7, max= 103, per=28.12%, avg=26.15, stdev=17.61, samples=448 iops : min= 1, max= 25, avg= 5.93, stdev= 4.43, samples=448 write: IOPS=6, BW=24.3KiB/s (24.9kB/s)(6236KiB/256236msec); 0 zone resets clat (msec): min=30, max=824, avg=133.24, stdev=66.13 lat (msec): min=30, max=824, avg=133.25, stdev=66.13 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 73], 20.00th=[ 86], | 30.00th=[ 95], 40.00th=[ 105], 50.00th=[ 118], 60.00th=[ 132], | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 213], 95.00th=[ 257], | 99.00th=[ 363], 99.50th=[ 405], 99.90th=[ 709], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 7, max= 48, per=24.63%, avg=23.89, stdev=10.21, samples=503 iops : min= 1, max= 12, avg= 5.36, stdev= 2.60, samples=503 lat (msec) : 10=4.23%, 20=19.34%, 50=17.81%, 100=23.47%, 250=32.29% lat (msec) : 500=2.73%, 750=0.10%, 1000=0.03% cpu : usr=0.04%, sys=1.40%, ctx=5299, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=93.1KiB/s (95.4kB/s), 23.1KiB/s-23.6KiB/s (23.7kB/s-24.2kB/s), io=23.4MiB (24.6MB), run=256236-257833msec WRITE: bw=97.5KiB/s (99.8kB/s), 24.3KiB/s-24.7KiB/s (24.9kB/s-25.3kB/s), io=24.6MiB (25.7MB), run=256236-257833msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145565: Thu Jun 11 23:00:15 2026 read: IOPS=14, BW=238KiB/s (244kB/s)(5920KiB/24885msec) clat (usec): min=31, max=132745, avg=34258.12, stdev=25340.10 lat (usec): min=32, max=132747, avg=34261.10, stdev=25342.58 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 4359], | 30.00th=[ 22414], 40.00th=[ 27657], 50.00th=[ 32637], 60.00th=[ 38011], | 70.00th=[ 43779], 80.00th=[ 53216], 90.00th=[ 67634], 95.00th=[ 79168], | 99.00th=[104334], 99.50th=[132645], 99.90th=[132645], 99.95th=[132645], | 99.99th=[132645] bw ( KiB/s): min= 62, max= 413, per=25.12%, avg=238.63, stdev=72.67, samples=49 iops : min= 3, max= 25, avg=14.18, stdev= 4.61, samples=49 write: IOPS=15, BW=256KiB/s (262kB/s)(6368KiB/24885msec); 0 zone resets clat (usec): min=1681, max=428131, avg=30591.35, stdev=35894.13 lat (usec): min=1683, max=428132, avg=30602.98, stdev=35889.31 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2409], 10.00th=[ 3392], 20.00th=[ 5473], | 30.00th=[ 8225], 40.00th=[ 11994], 50.00th=[ 19006], 60.00th=[ 28443], | 70.00th=[ 39584], 80.00th=[ 50594], 90.00th=[ 68682], 95.00th=[ 90702], | 99.00th=[145753], 99.50th=[200279], 99.90th=[429917], 99.95th=[429917], | 99.99th=[429917] bw ( KiB/s): min= 62, max= 448, per=25.64%, avg=256.37, stdev=99.70, samples=49 iops : min= 3, max= 28, avg=15.31, stdev= 6.24, samples=49 lat (usec) : 50=0.78%, 100=7.42%, 250=0.65%, 500=0.13%, 1000=0.39% lat (msec) : 2=1.43%, 4=5.21%, 10=11.98%, 20=10.55%, 50=39.97% lat (msec) : 100=18.88%, 250=2.47%, 500=0.13% cpu : usr=0.09%, sys=7.38%, ctx=1566, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145566: Thu Jun 11 23:00:15 2026 read: IOPS=15, BW=244KiB/s (250kB/s)(5744KiB/23527msec) clat (usec): min=33, max=144735, avg=34708.57, stdev=26064.26 lat (usec): min=33, max=144736, avg=34709.82, stdev=26064.27 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 58], 10.00th=[ 67], 20.00th=[ 15008], | 30.00th=[ 23462], 40.00th=[ 27132], 50.00th=[ 31327], 60.00th=[ 37487], | 70.00th=[ 43254], 80.00th=[ 54264], 90.00th=[ 68682], 95.00th=[ 83362], | 99.00th=[115868], 99.50th=[139461], 99.90th=[145753], 99.95th=[145753], | 99.99th=[145753] bw ( KiB/s): min= 32, max= 510, per=26.29%, avg=249.73, stdev=88.63, samples=45 iops : min= 2, max= 31, avg=14.91, stdev= 5.46, samples=45 write: IOPS=17, BW=278KiB/s (285kB/s)(6544KiB/23527msec); 0 zone resets clat (usec): min=1490, max=194675, avg=26925.51, stdev=30635.26 lat (usec): min=1492, max=194678, avg=26944.13, stdev=30640.22 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 1926], 10.00th=[ 2769], 20.00th=[ 4113], | 30.00th=[ 6521], 40.00th=[ 10290], 50.00th=[ 13829], 60.00th=[ 22152], | 70.00th=[ 32637], 80.00th=[ 46924], 90.00th=[ 69731], 95.00th=[ 84411], | 99.00th=[141558], 99.50th=[164627], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 95, max= 447, per=27.81%, avg=278.11, stdev=80.66, samples=46 iops : min= 5, max= 27, avg=16.70, stdev= 5.11, samples=46 lat (usec) : 50=0.91%, 100=6.51%, 250=0.91%, 1000=0.39% lat (msec) : 2=3.12%, 4=7.03%, 10=10.81%, 20=13.15%, 50=36.07% lat (msec) : 100=18.49%, 250=2.60% cpu : usr=0.11%, sys=7.82%, ctx=1621, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145567: Thu Jun 11 23:00:15 2026 read: IOPS=15, BW=250KiB/s (256kB/s)(6256KiB/25052msec) clat (usec): min=35, max=422269, avg=36663.95, stdev=33362.60 lat (usec): min=35, max=422270, avg=36665.36, stdev=33362.50 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 57], 10.00th=[ 72], 20.00th=[ 16057], | 30.00th=[ 22152], 40.00th=[ 27919], 50.00th=[ 31327], 60.00th=[ 39584], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 67634], 95.00th=[ 77071], | 99.00th=[143655], 99.50th=[191890], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 62, max= 443, per=26.49%, avg=251.67, stdev=95.27, samples=49 iops : min= 3, max= 27, avg=15.02, stdev= 6.01, samples=49 write: IOPS=15, BW=241KiB/s (247kB/s)(6032KiB/25052msec); 0 zone resets clat (usec): min=1608, max=153348, avg=28325.43, stdev=28574.27 lat (usec): min=1611, max=153351, avg=28332.14, stdev=28585.61 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2024], 10.00th=[ 2933], 20.00th=[ 4490], | 30.00th=[ 7177], 40.00th=[ 10945], 50.00th=[ 17433], 60.00th=[ 28705], | 70.00th=[ 37487], 80.00th=[ 46924], 90.00th=[ 72877], 95.00th=[ 89654], | 99.00th=[130548], 99.50th=[147850], 99.90th=[154141], 99.95th=[154141], | 99.99th=[154141] bw ( KiB/s): min= 31, max= 442, per=23.86%, avg=238.63, stdev=90.18, samples=49 iops : min= 1, max= 27, avg=14.20, stdev= 5.63, samples=49 lat (usec) : 50=0.91%, 100=6.38%, 250=0.65%, 750=0.26%, 1000=0.13% lat (msec) : 2=2.21%, 4=6.77%, 10=9.51%, 20=11.98%, 50=38.67% lat (msec) : 100=20.18%, 250=2.21%, 500=0.13% cpu : usr=0.07%, sys=7.31%, ctx=1591, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145568: Thu Jun 11 23:00:15 2026 read: IOPS=14, BW=239KiB/s (245kB/s)(6032KiB/25190msec) clat (usec): min=33, max=266455, avg=34721.75, stdev=29713.01 lat (usec): min=33, max=266456, avg=34726.01, stdev=29711.21 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 123], | 30.00th=[ 20055], 40.00th=[ 26870], 50.00th=[ 32637], 60.00th=[ 40109], | 70.00th=[ 46400], 80.00th=[ 54789], 90.00th=[ 67634], 95.00th=[ 82314], | 99.00th=[125305], 99.50th=[149947], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 31, max= 537, per=24.83%, avg=235.88, stdev=92.85, samples=49 iops : min= 1, max= 33, avg=14.04, stdev= 5.91, samples=49 write: IOPS=15, BW=248KiB/s (254kB/s)(6256KiB/25190msec); 0 zone resets clat (usec): min=1548, max=259778, avg=30860.90, stdev=34859.97 lat (usec): min=1550, max=259779, avg=30869.52, stdev=34860.73 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1975], 10.00th=[ 3064], 20.00th=[ 5014], | 30.00th=[ 7504], 40.00th=[ 11469], 50.00th=[ 17433], 60.00th=[ 26870], | 70.00th=[ 39584], 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 94897], | 99.00th=[173016], 99.50th=[246416], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 61, max= 383, per=24.58%, avg=245.76, stdev=86.78, samples=49 iops : min= 3, max= 23, avg=14.65, stdev= 5.48, samples=49 lat (usec) : 50=1.30%, 100=7.55%, 250=1.56%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.26% lat (msec) : 2=2.73%, 4=5.99%, 10=10.68%, 20=11.07%, 50=33.72% lat (msec) : 100=21.35%, 250=2.86%, 500=0.26% cpu : usr=0.06%, sys=7.14%, ctx=1578, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=951KiB/s (974kB/s), 238KiB/s-250KiB/s (244kB/s-256kB/s), io=23.4MiB (24.5MB), run=23527-25190msec WRITE: bw=1000KiB/s (1024kB/s), 241KiB/s-278KiB/s (247kB/s-285kB/s), io=24.6MiB (25.8MB), run=23527-25190msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145560: Thu Jun 11 23:00:51 2026 read: IOPS=6, BW=96.6KiB/s (98.9kB/s)(5920KiB/61302msec) clat (msec): min=6, max=139, avg=31.18, stdev=25.81 lat (msec): min=6, max=139, avg=31.18, stdev=25.81 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 31], 80.00th=[ 40], 90.00th=[ 64], 95.00th=[ 102], | 99.00th=[ 132], 99.50th=[ 136], 99.90th=[ 140], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 31, max= 383, per=26.91%, avg=103.87, stdev=69.93, samples=112 iops : min= 1, max= 23, avg= 5.75, stdev= 4.41, samples=112 write: IOPS=6, BW=104KiB/s (106kB/s)(6368KiB/61302msec); 0 zone resets clat (msec): min=43, max=526, avg=124.73, stdev=56.62 lat (msec): min=43, max=526, avg=124.74, stdev=56.62 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 64], 10.00th=[ 72], 20.00th=[ 83], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 112], 60.00th=[ 122], | 70.00th=[ 136], 80.00th=[ 165], 90.00th=[ 201], 95.00th=[ 236], | 99.00th=[ 309], 99.50th=[ 363], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 31, max= 190, per=25.45%, avg=103.35, stdev=39.20, samples=121 iops : min= 1, max= 11, avg= 5.72, stdev= 2.52, samples=121 lat (msec) : 10=1.82%, 20=17.97%, 50=22.53%, 100=24.61%, 250=30.99% lat (msec) : 500=1.95%, 750=0.13% cpu : usr=0.05%, sys=1.61%, ctx=1397, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145561: Thu Jun 11 23:00:51 2026 read: IOPS=5, BW=92.8KiB/s (94.0kB/s)(5744KiB/61927msec) clat (msec): min=6, max=231, avg=33.34, stdev=31.57 lat (msec): min=6, max=231, avg=33.35, stdev=31.57 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 33], 80.00th=[ 47], 90.00th=[ 69], 95.00th=[ 100], | 99.00th=[ 169], 99.50th=[ 211], 99.90th=[ 232], 99.95th=[ 232], | 99.99th=[ 232] bw ( KiB/s): min= 29, max= 287, per=26.22%, avg=101.22, stdev=64.63, samples=111 iops : min= 1, max= 17, avg= 5.59, stdev= 4.10, samples=111 write: IOPS=6, BW=106KiB/s (108kB/s)(6544KiB/61927msec); 0 zone resets clat (msec): min=37, max=484, avg=121.78, stdev=55.08 lat (msec): min=37, max=484, avg=121.78, stdev=55.08 clat percentiles (msec): | 1.00th=[ 49], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 82], | 30.00th=[ 90], 40.00th=[ 99], 50.00th=[ 106], 60.00th=[ 118], | 70.00th=[ 138], 80.00th=[ 159], 90.00th=[ 192], 95.00th=[ 220], | 99.00th=[ 305], 99.50th=[ 334], 99.90th=[ 485], 99.95th=[ 485], | 99.99th=[ 485] bw ( KiB/s): min= 31, max= 254, per=26.04%, avg=105.71, stdev=44.19, samples=121 iops : min= 1, max= 15, avg= 5.87, stdev= 2.79, samples=121 lat (msec) : 10=2.86%, 20=17.58%, 50=18.23%, 100=28.52%, 250=30.99% lat (msec) : 500=1.82% cpu : usr=0.03%, sys=1.61%, ctx=1363, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145562: Thu Jun 11 23:00:51 2026 read: IOPS=6, BW=105KiB/s (108kB/s)(6256KiB/59592msec) clat (msec): min=6, max=215, avg=31.74, stdev=30.32 lat (msec): min=6, max=215, avg=31.74, stdev=30.32 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 29], 80.00th=[ 42], 90.00th=[ 69], 95.00th=[ 103], | 99.00th=[ 144], 99.50th=[ 188], 99.90th=[ 215], 99.95th=[ 215], | 99.99th=[ 215] bw ( KiB/s): min= 31, max= 351, per=29.70%, avg=114.63, stdev=77.20, samples=108 iops : min= 1, max= 21, avg= 6.43, stdev= 4.90, samples=108 write: IOPS=6, BW=101KiB/s (104kB/s)(6032KiB/59592msec); 0 zone resets clat (msec): min=46, max=522, avg=124.73, stdev=60.66 lat (msec): min=46, max=522, avg=124.73, stdev=60.66 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 70], 20.00th=[ 79], | 30.00th=[ 87], 40.00th=[ 97], 50.00th=[ 108], 60.00th=[ 121], | 70.00th=[ 136], 80.00th=[ 161], 90.00th=[ 211], 95.00th=[ 251], | 99.00th=[ 317], 99.50th=[ 334], 99.90th=[ 523], 99.95th=[ 523], | 99.99th=[ 523] bw ( KiB/s): min= 31, max= 191, per=25.20%, avg=102.31, stdev=42.45, samples=116 iops : min= 1, max= 11, avg= 5.66, stdev= 2.68, samples=116 lat (msec) : 10=2.60%, 20=22.14%, 50=18.62%, 100=25.13%, 250=28.91% lat (msec) : 500=2.47%, 750=0.13% cpu : usr=0.05%, sys=1.63%, ctx=1372, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145563: Thu Jun 11 23:00:51 2026 read: IOPS=6, BW=98.4KiB/s (101kB/s)(6032KiB/61300msec) clat (msec): min=7, max=323, avg=34.20, stdev=33.80 lat (msec): min=7, max=323, avg=34.21, stdev=33.80 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 32], 80.00th=[ 43], 90.00th=[ 71], 95.00th=[ 107], | 99.00th=[ 167], 99.50th=[ 205], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 31, max= 320, per=27.17%, avg=104.87, stdev=67.22, samples=112 iops : min= 1, max= 20, avg= 5.81, stdev= 4.33, samples=112 write: IOPS=6, BW=102KiB/s (105kB/s)(6256KiB/61300msec); 0 zone resets clat (msec): min=49, max=435, avg=123.63, stdev=54.54 lat (msec): min=49, max=435, avg=123.63, stdev=54.54 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 64], 10.00th=[ 70], 20.00th=[ 82], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 109], 60.00th=[ 121], | 70.00th=[ 140], 80.00th=[ 161], 90.00th=[ 199], 95.00th=[ 228], | 99.00th=[ 321], 99.50th=[ 338], 99.90th=[ 435], 99.95th=[ 435], | 99.99th=[ 435] bw ( KiB/s): min= 31, max= 192, per=25.41%, avg=103.16, stdev=40.45, samples=119 iops : min= 1, max= 12, avg= 5.71, stdev= 2.59, samples=119 lat (msec) : 10=1.56%, 20=18.75%, 50=21.09%, 100=25.52%, 250=31.25% lat (msec) : 500=1.82% cpu : usr=0.03%, sys=1.57%, ctx=1370, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=387KiB/s (396kB/s), 92.8KiB/s-105KiB/s (94.0kB/s-108kB/s), io=23.4MiB (24.5MB), run=59592-61927msec WRITE: bw=407KiB/s (417kB/s), 101KiB/s-106KiB/s (104kB/s-108kB/s), io=24.6MiB (25.8MB), run=59592-61927msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145584: Thu Jun 11 23:01:07 2026 read: IOPS=1, BW=1463KiB/s (1498kB/s)(7168KiB/4901msec) clat (msec): min=62, max=2843, avg=543.90, stdev=1016.98 lat (msec): min=62, max=2843, avg=543.90, stdev=1016.98 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 63], 10.00th=[ 63], 20.00th=[ 110], | 30.00th=[ 132], 40.00th=[ 132], 50.00th=[ 178], 60.00th=[ 182], | 70.00th=[ 182], 80.00th=[ 305], 90.00th=[ 2836], 95.00th=[ 2836], | 99.00th=[ 2836], 99.50th=[ 2836], 99.90th=[ 2836], 99.95th=[ 2836], | 99.99th=[ 2836] bw ( KiB/s): min= 1943, max= 6035, per=100.00%, avg=3949.67, stdev=2047.13, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1045KiB/s (1070kB/s)(5120KiB/4901msec); 0 zone resets clat (msec): min=122, max=248, avg=204.15, stdev=54.62 lat (msec): min=122, max=248, avg=204.25, stdev=54.63 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 228], 60.00th=[ 228], | 70.00th=[ 247], 80.00th=[ 247], 90.00th=[ 249], 95.00th=[ 249], | 99.00th=[ 249], 99.50th=[ 249], 99.90th=[ 249], 99.95th=[ 249], | 99.99th=[ 249] bw ( KiB/s): min= 1935, max= 4055, per=70.66%, avg=3292.00, stdev=1178.23, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=75.00%, 500=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.02%, ctx=636, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145585: Thu Jun 11 23:01:07 2026 read: IOPS=0, BW=333KiB/s (341kB/s)(2048KiB/6154msec) clat (msec): min=70, max=189, avg=129.79, stdev=84.31 lat (msec): min=70, max=189, avg=129.79, stdev=84.31 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 70], 10.00th=[ 70], 20.00th=[ 70], | 30.00th=[ 70], 40.00th=[ 70], 50.00th=[ 70], 60.00th=[ 190], | 70.00th=[ 190], 80.00th=[ 190], 90.00th=[ 190], 95.00th=[ 190], | 99.00th=[ 190], 99.50th=[ 190], 99.90th=[ 190], 99.95th=[ 190], | 99.99th=[ 190] bw ( KiB/s): min= 1996, max= 2027, per=60.46%, avg=2011.50, stdev=21.92, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1664KiB/s (1704kB/s)(10.0MiB/6154msec); 0 zone resets clat (msec): min=96, max=2952, avg=558.06, stdev=874.21 lat (msec): min=96, max=2953, avg=558.14, stdev=874.20 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 117], | 30.00th=[ 129], 40.00th=[ 169], 50.00th=[ 194], 60.00th=[ 271], | 70.00th=[ 275], 80.00th=[ 506], 90.00th=[ 877], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1976, max= 5862, per=77.02%, avg=3588.20, stdev=1622.50, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 100=16.67%, 250=41.67%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.43%, ctx=162, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145586: Thu Jun 11 23:01:07 2026 read: IOPS=1, BW=1086KiB/s (1112kB/s)(6144KiB/5660msec) clat (msec): min=5, max=347, avg=166.08, stdev=124.28 lat (msec): min=5, max=347, avg=166.08, stdev=124.28 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 77], | 30.00th=[ 77], 40.00th=[ 118], 50.00th=[ 118], 60.00th=[ 203], | 70.00th=[ 249], 80.00th=[ 249], 90.00th=[ 347], 95.00th=[ 347], | 99.00th=[ 347], 99.50th=[ 347], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 2031, max= 3992, per=99.50%, avg=3310.33, stdev=1108.73, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1086KiB/s (1112kB/s)(6144KiB/5660msec); 0 zone resets clat (msec): min=243, max=2896, avg=772.44, stdev=1047.01 lat (msec): min=243, max=2896, avg=772.52, stdev=1047.01 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 296], 50.00th=[ 296], 60.00th=[ 347], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 2903], 95.00th=[ 2903], | 99.00th=[ 2903], 99.50th=[ 2903], 99.90th=[ 2903], 99.95th=[ 2903], | 99.99th=[ 2903] bw ( KiB/s): min= 1969, max= 4063, per=51.61%, avg=2404.60, stdev=927.26, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 10=8.33%, 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.02%, sys=7.37%, ctx=175, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145587: Thu Jun 11 23:01:07 2026 read: IOPS=0, BW=834KiB/s (854kB/s)(5120KiB/6138msec) clat (usec): min=453, max=28919, avg=7779.79, stdev=12301.64 lat (usec): min=453, max=28919, avg=7780.61, stdev=12301.37 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 453], | 30.00th=[ 537], 40.00th=[ 537], 50.00th=[ 578], 60.00th=[ 578], | 70.00th=[ 8455], 80.00th=[ 8455], 90.00th=[28967], 95.00th=[28967], | 99.00th=[28967], 99.50th=[28967], 99.90th=[28967], 99.95th=[28967], | 99.99th=[28967] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1168KiB/s (1196kB/s)(7168KiB/6138msec); 0 zone resets clat (msec): min=122, max=3169, avg=834.69, stdev=1062.45 lat (msec): min=122, max=3169, avg=834.90, stdev=1062.47 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 259], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 498], 60.00th=[ 584], | 70.00th=[ 584], 80.00th=[ 919], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1969, max= 3992, per=51.87%, avg=2416.60, stdev=881.24, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 10=8.33%, 50=8.33%, 250=8.33%, 500=25.00%, 750=8.33% lat (msec) : 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=6.31%, ctx=84, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3328KiB/s (3408kB/s), 333KiB/s-1463KiB/s (341kB/s-1498kB/s), io=20.0MiB (20.0MB), run=4901-6154msec WRITE: bw=4659KiB/s (4771kB/s), 1045KiB/s-1664KiB/s (1070kB/s-1704kB/s), io=28.0MiB (29.4MB), run=4901-6154msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145588: Thu Jun 11 23:01:09 2026 read: IOPS=0, BW=967KiB/s (991kB/s)(7168KiB/7410msec) clat (msec): min=64, max=2591, avg=805.14, stdev=956.40 lat (msec): min=64, max=2591, avg=805.14, stdev=956.40 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 65], 10.00th=[ 65], 20.00th=[ 74], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 380], 60.00th=[ 726], | 70.00th=[ 726], 80.00th=[ 1603], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 2007, max= 2048, per=73.46%, avg=2029.60, stdev=15.42, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=0, BW=691KiB/s (708kB/s)(5120KiB/7410msec); 0 zone resets clat (msec): min=123, max=597, avg=295.04, stdev=182.90 lat (msec): min=123, max=597, avg=295.12, stdev=182.91 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 125], | 30.00th=[ 194], 40.00th=[ 194], 50.00th=[ 249], 60.00th=[ 249], | 70.00th=[ 313], 80.00th=[ 313], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 2048, max= 6131, per=100.00%, avg=4089.50, stdev=2887.12, samples=2 iops : min= 2, max= 5, avg= 3.50, stdev= 2.12, samples=2 lat (msec) : 100=16.67%, 250=33.33%, 500=16.67%, 750=16.67%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=1.63%, ctx=67, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145589: Thu Jun 11 23:01:09 2026 read: IOPS=0, BW=280KiB/s (287kB/s)(2048KiB/7315msec) clat (msec): min=109, max=418, avg=263.56, stdev=218.57 lat (msec): min=109, max=418, avg=263.56, stdev=218.57 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 109], 60.00th=[ 418], | 70.00th=[ 418], 80.00th=[ 418], 90.00th=[ 418], 95.00th=[ 418], | 99.00th=[ 418], 99.50th=[ 418], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 2007, max= 2043, per=73.29%, avg=2025.00, stdev=25.46, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1400KiB/s (1433kB/s)(10.0MiB/7315msec); 0 zone resets clat (msec): min=116, max=3626, avg=644.67, stdev=1061.36 lat (msec): min=116, max=3626, avg=644.75, stdev=1061.35 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 180], | 30.00th=[ 184], 40.00th=[ 215], 50.00th=[ 243], 60.00th=[ 296], | 70.00th=[ 426], 80.00th=[ 502], 90.00th=[ 659], 95.00th=[ 3641], | 99.00th=[ 3641], 99.50th=[ 3641], 99.90th=[ 3641], 99.95th=[ 3641], | 99.99th=[ 3641] bw ( KiB/s): min= 2027, max= 4087, per=94.41%, avg=3652.60, stdev=909.17, samples=5 iops : min= 1, max= 3, avg= 2.60, stdev= 0.89, samples=5 lat (msec) : 250=50.00%, 500=25.00%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.34%, ctx=86, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145590: Thu Jun 11 23:01:09 2026 read: IOPS=0, BW=943KiB/s (966kB/s)(6144KiB/6515msec) clat (msec): min=123, max=651, avg=249.75, stdev=203.95 lat (msec): min=123, max=651, avg=249.75, stdev=203.95 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 129], | 30.00th=[ 129], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 176], | 70.00th=[ 271], 80.00th=[ 271], 90.00th=[ 651], 95.00th=[ 651], | 99.00th=[ 651], 99.50th=[ 651], 99.90th=[ 651], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 2027, max= 4015, per=91.61%, avg=2531.25, stdev=989.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=943KiB/s (966kB/s)(6144KiB/6515msec); 0 zone resets clat (msec): min=221, max=2978, avg=790.98, stdev=1077.91 lat (msec): min=221, max=2978, avg=791.07, stdev=1077.91 clat percentiles (msec): | 1.00th=[ 222], 5.00th=[ 222], 10.00th=[ 222], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 284], 50.00th=[ 284], 60.00th=[ 493], | 70.00th=[ 498], 80.00th=[ 498], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 2007, max= 4087, per=65.70%, avg=2542.00, stdev=1030.10, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=41.67%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.78%, ctx=82, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145591: Thu Jun 11 23:01:09 2026 read: IOPS=0, BW=720KiB/s (738kB/s)(5120KiB/7107msec) clat (msec): min=107, max=803, avg=353.03, stdev=265.63 lat (msec): min=107, max=803, avg=353.03, stdev=265.63 clat percentiles (msec): | 1.00th=[ 108], 5.00th=[ 108], 10.00th=[ 108], 20.00th=[ 108], | 30.00th=[ 236], 40.00th=[ 236], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 338], 80.00th=[ 338], 90.00th=[ 802], 95.00th=[ 802], | 99.00th=[ 802], 99.50th=[ 802], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 2027, max= 4096, per=98.47%, avg=2720.67, stdev=1191.09, samples=3 iops : min= 1, max= 4, avg= 2.00, stdev= 1.73, samples=3 write: IOPS=0, BW=1009KiB/s (1033kB/s)(7168KiB/7107msec); 0 zone resets clat (msec): min=188, max=2950, avg=753.20, stdev=997.76 lat (msec): min=188, max=2950, avg=753.29, stdev=997.75 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 213], | 30.00th=[ 232], 40.00th=[ 232], 50.00th=[ 284], 60.00th=[ 575], | 70.00th=[ 575], 80.00th=[ 835], 90.00th=[ 2937], 95.00th=[ 2937], | 99.00th=[ 2937], 99.50th=[ 2937], 99.90th=[ 2937], 99.95th=[ 2937], | 99.99th=[ 2937] bw ( KiB/s): min= 2027, max= 4055, per=65.65%, avg=2540.00, stdev=1010.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=41.67%, 500=25.00%, 750=8.33%, 1000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.96%, ctx=66, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2764KiB/s (2830kB/s), 280KiB/s-967KiB/s (287kB/s-991kB/s), io=20.0MiB (20.0MB), run=6515-7410msec WRITE: bw=3869KiB/s (3962kB/s), 691KiB/s-1400KiB/s (708kB/s-1433kB/s), io=28.0MiB (29.4MB), run=6515-7410msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145616: Thu Jun 11 23:01:24 2026 read: IOPS=0, BW=3507KiB/s (3591kB/s)(12.0MiB/3504msec) clat (msec): min=272, max=2365, avg=1146.16, stdev=1088.26 lat (msec): min=272, max=2365, avg=1146.16, stdev=1088.27 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 275], 40.00th=[ 802], 50.00th=[ 802], 60.00th=[ 802], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.51%, ctx=73, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145617: Thu Jun 11 23:01:24 2026 read: IOPS=0, BW=1102KiB/s (1128kB/s)(4096KiB/3718msec) clat (nsec): min=2091.9M, max=2091.9M, avg=2091936973.00, stdev= 0.00 lat (nsec): min=2091.9M, max=2091.9M, avg=2091939984.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 2089], 5.00th=[ 2089], 10.00th=[ 2089], 20.00th=[ 2089], | 30.00th=[ 2089], 40.00th=[ 2089], 50.00th=[ 2089], 60.00th=[ 2089], | 70.00th=[ 2089], 80.00th=[ 2089], 90.00th=[ 2089], 95.00th=[ 2089], | 99.00th=[ 2089], 99.50th=[ 2089], 99.90th=[ 2089], 99.95th=[ 2089], | 99.99th=[ 2089] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2203KiB/s (2256kB/s)(8192KiB/3718msec); 0 zone resets clat (msec): min=483, max=1106, avg=794.71, stdev=440.52 lat (msec): min=483, max=1106, avg=795.17, stdev=440.33 clat percentiles (msec): | 1.00th=[ 485], 5.00th=[ 485], 10.00th=[ 485], 20.00th=[ 485], | 30.00th=[ 485], 40.00th=[ 485], 50.00th=[ 485], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.36%, ctx=48, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145618: Thu Jun 11 23:01:24 2026 write: IOPS=0, BW=2735KiB/s (2801kB/s)(12.0MiB/4493msec); 0 zone resets clat (msec): min=338, max=3157, avg=1469.27, stdev=1489.74 lat (msec): min=340, max=3157, avg=1470.37, stdev=1489.03 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.34%, ctx=41, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145619: Thu Jun 11 23:01:24 2026 write: IOPS=0, BW=3361KiB/s (3442kB/s)(12.0MiB/3656msec); 0 zone resets clat (msec): min=716, max=1573, avg=1202.12, stdev=439.56 lat (msec): min=717, max=1579, avg=1204.52, stdev=442.17 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 1318], 50.00th=[ 1318], 60.00th=[ 1318], | 70.00th=[ 1569], 80.00th=[ 1569], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 7968, max= 8015, per=100.00%, avg=7991.50, stdev=33.23, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.64%, ctx=62, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4407KiB/s (4512kB/s), 1102KiB/s-3507KiB/s (1128kB/s-3591kB/s), io=16.0MiB (16.8MB), run=3504-3718msec WRITE: bw=7293KiB/s (7468kB/s), 2203KiB/s-3361KiB/s (2256kB/s-3442kB/s), io=32.0MiB (33.6MB), run=3656-4493msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145612: Thu Jun 11 23:01:24 2026 read: IOPS=0, BW=3683KiB/s (3772kB/s)(12.0MiB/3336msec) clat (msec): min=755, max=1500, avg=1087.15, stdev=379.26 lat (msec): min=755, max=1500, avg=1087.15, stdev=379.26 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1003], 50.00th=[ 1003], 60.00th=[ 1003], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8078, max= 8094, per=100.00%, avg=8086.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=11.21%, ctx=351, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145613: Thu Jun 11 23:01:24 2026 read: IOPS=0, BW=1326KiB/s (1357kB/s)(4096KiB/3090msec) clat (nsec): min=1436.7M, max=1436.7M, avg=1436692698.00, stdev= 0.00 lat (nsec): min=1436.7M, max=1436.7M, avg=1436695310.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1435], 5.00th=[ 1435], 10.00th=[ 1435], 20.00th=[ 1435], | 30.00th=[ 1435], 40.00th=[ 1435], 50.00th=[ 1435], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2651KiB/s (2715kB/s)(8192KiB/3090msec); 0 zone resets clat (msec): min=622, max=875, avg=748.77, stdev=178.63 lat (msec): min=622, max=875, avg=749.19, stdev=178.61 clat percentiles (msec): | 1.00th=[ 625], 5.00th=[ 625], 10.00th=[ 625], 20.00th=[ 625], | 30.00th=[ 625], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 877], | 70.00th=[ 877], 80.00th=[ 877], 90.00th=[ 877], 95.00th=[ 877], | 99.00th=[ 877], 99.50th=[ 877], 99.90th=[ 877], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.28%, ctx=132, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145614: Thu Jun 11 23:01:24 2026 write: IOPS=0, BW=2632KiB/s (2696kB/s)(12.0MiB/4668msec); 0 zone resets clat (msec): min=282, max=3240, avg=1528.11, stdev=1533.25 lat (msec): min=282, max=3244, avg=1529.58, stdev=1535.08 clat percentiles (msec): | 1.00th=[ 284], 5.00th=[ 284], 10.00th=[ 284], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 1062], 50.00th=[ 1062], 60.00th=[ 1062], | 70.00th=[ 3239], 80.00th=[ 3239], 90.00th=[ 3239], 95.00th=[ 3239], | 99.00th=[ 3239], 99.50th=[ 3239], 99.90th=[ 3239], 99.95th=[ 3239], | 99.99th=[ 3239] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.55%, ctx=68, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145615: Thu Jun 11 23:01:24 2026 write: IOPS=0, BW=3053KiB/s (3126kB/s)(12.0MiB/4025msec); 0 zone resets clat (msec): min=745, max=1749, avg=1296.69, stdev=509.09 lat (msec): min=745, max=1752, avg=1297.86, stdev=510.16 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1754], 80.00th=[ 1754], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.57%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4911KiB/s (5029kB/s), 1326KiB/s-3683KiB/s (1357kB/s-3772kB/s), io=16.0MiB (16.8MB), run=3090-3336msec WRITE: bw=7020KiB/s (7188kB/s), 2632KiB/s-3053KiB/s (2696kB/s-3126kB/s), io=32.0MiB (33.6MB), run=3090-4668msec