== sanity test 398b: DIO and buffer IO race ============== 09:24:11 (1788873851) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.88156 s, 8.6 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145627: Tue Sep 8 09:26:30 2026 read: IOPS=12, BW=51.3KiB/s (52.5kB/s)(5992KiB/116798msec) clat (usec): min=37, max=1122.4k, avg=40038.47, stdev=41446.64 lat (usec): min=37, max=1122.4k, avg=40041.09, stdev=41446.40 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 10814], | 20.00th=[ 19006], 30.00th=[ 23987], 40.00th=[ 28443], | 50.00th=[ 33424], 60.00th=[ 39060], 70.00th=[ 47449], | 80.00th=[ 58459], 90.00th=[ 72877], 95.00th=[ 86508], | 99.00th=[ 154141], 99.50th=[ 168821], 99.90th=[ 379585], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 5, max= 111, per=25.49%, avg=51.24, stdev=20.23, samples=228 iops : min= 1, max= 27, avg=12.17, stdev= 5.10, samples=228 write: IOPS=13, BW=53.9KiB/s (55.2kB/s)(6296KiB/116798msec); 0 zone resets clat (usec): min=883, max=288978, avg=35777.92, stdev=35751.45 lat (usec): min=884, max=288979, avg=35782.47, stdev=35749.66 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1926], 20.00th=[ 4424], | 30.00th=[ 8717], 40.00th=[ 17171], 50.00th=[ 26870], 60.00th=[ 35914], | 70.00th=[ 46400], 80.00th=[ 61604], 90.00th=[ 83362], 95.00th=[104334], | 99.00th=[152044], 99.50th=[175113], 99.90th=[254804], 99.95th=[287310], | 99.99th=[287310] bw ( KiB/s): min= 7, max= 127, per=25.65%, avg=53.86, stdev=22.46, samples=228 iops : min= 1, max= 31, avg=12.82, stdev= 5.65, samples=228 lat (usec) : 50=0.16%, 100=3.97%, 250=0.26%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.16% lat (msec) : 2=5.27%, 4=4.20%, 10=7.00%, 20=11.17%, 50=40.53% lat (msec) : 100=22.62%, 250=4.26%, 500=0.20%, 2000=0.03% cpu : usr=0.09%, sys=5.69%, ctx=6570, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145629: Tue Sep 8 09:26:30 2026 read: IOPS=12, BW=50.6KiB/s (51.9kB/s)(5940KiB/117287msec) clat (usec): min=40, max=1124.7k, avg=39609.25, stdev=39711.16 lat (usec): min=40, max=1124.7k, avg=39612.97, stdev=39710.72 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 74], 10.00th=[ 11469], | 20.00th=[ 18744], 30.00th=[ 23987], 40.00th=[ 28705], | 50.00th=[ 34341], 60.00th=[ 39584], 70.00th=[ 47449], | 80.00th=[ 57934], 90.00th=[ 72877], 95.00th=[ 87557], | 99.00th=[ 125305], 99.50th=[ 149947], 99.90th=[ 337642], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 120, per=25.13%, avg=50.51, stdev=19.73, samples=229 iops : min= 1, max= 30, avg=11.99, stdev= 4.96, samples=229 write: IOPS=13, BW=54.1KiB/s (55.4kB/s)(6348KiB/117287msec); 0 zone resets clat (usec): min=971, max=422796, avg=36450.99, stdev=36584.82 lat (usec): min=972, max=422797, avg=36459.07, stdev=36585.99 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1352], 10.00th=[ 1614], 20.00th=[ 4293], | 30.00th=[ 9241], 40.00th=[ 18482], 50.00th=[ 27919], 60.00th=[ 37487], | 70.00th=[ 47973], 80.00th=[ 62653], 90.00th=[ 82314], 95.00th=[102237], | 99.00th=[152044], 99.50th=[193987], 99.90th=[261096], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 15, max= 143, per=25.83%, avg=54.24, stdev=22.80, samples=228 iops : min= 3, max= 35, avg=12.91, stdev= 5.73, samples=228 lat (usec) : 50=0.16%, 100=3.58%, 250=0.36%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.10% lat (msec) : 2=6.02%, 4=3.71%, 10=6.61%, 20=11.69%, 50=39.58% lat (msec) : 100=23.99%, 250=3.91%, 500=0.13%, 2000=0.03% cpu : usr=0.10%, sys=5.54%, ctx=6631, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145632: Tue Sep 8 09:26:30 2026 read: IOPS=12, BW=51.3KiB/s (52.6kB/s)(6028KiB/117451msec) clat (usec): min=24, max=1125.9k, avg=38216.54, stdev=39502.23 lat (usec): min=24, max=1125.9k, avg=38222.10, stdev=39501.84 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 70], 10.00th=[ 1106], | 20.00th=[ 18744], 30.00th=[ 23987], 40.00th=[ 28181], | 50.00th=[ 32113], 60.00th=[ 38011], 70.00th=[ 45351], | 80.00th=[ 54789], 90.00th=[ 70779], 95.00th=[ 86508], | 99.00th=[ 129500], 99.50th=[ 162530], 99.90th=[ 358613], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 103, per=25.56%, avg=51.37, stdev=20.59, samples=228 iops : min= 1, max= 25, avg=12.20, stdev= 5.17, samples=228 write: IOPS=13, BW=53.3KiB/s (54.6kB/s)(6260KiB/117451msec); 0 zone resets clat (usec): min=900, max=475823, avg=37939.02, stdev=37792.30 lat (usec): min=902, max=475825, avg=37947.18, stdev=37792.45 clat percentiles (usec): | 1.00th=[ 1139], 5.00th=[ 1336], 10.00th=[ 1729], 20.00th=[ 4359], | 30.00th=[ 10028], 40.00th=[ 20317], 50.00th=[ 29754], 60.00th=[ 39060], | 70.00th=[ 50070], 80.00th=[ 64750], 90.00th=[ 86508], 95.00th=[106431], | 99.00th=[154141], 99.50th=[181404], 99.90th=[287310], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 7, max= 109, per=25.15%, avg=52.81, stdev=18.93, samples=230 iops : min= 1, max= 27, avg=12.56, stdev= 4.77, samples=230 lat (usec) : 50=0.36%, 100=3.94%, 250=0.46%, 500=0.03%, 750=0.03% lat (usec) : 1000=0.16% lat (msec) : 2=6.02%, 4=3.45%, 10=6.35%, 20=10.09%, 50=41.76% lat (msec) : 100=22.88%, 250=4.33%, 500=0.10%, 2000=0.03% cpu : usr=0.10%, sys=5.57%, ctx=6587, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145634: Tue Sep 8 09:26:30 2026 read: IOPS=12, BW=50.7KiB/s (51.9kB/s)(6052KiB/119432msec) clat (usec): min=35, max=376328, avg=37916.15, stdev=28583.67 lat (usec): min=36, max=376329, avg=37919.47, stdev=28584.54 clat percentiles (usec): | 1.00th=[ 57], 5.00th=[ 69], 10.00th=[ 285], 20.00th=[ 17957], | 30.00th=[ 22152], 40.00th=[ 27132], 50.00th=[ 32375], 60.00th=[ 38536], | 70.00th=[ 46924], 80.00th=[ 57410], 90.00th=[ 71828], 95.00th=[ 85459], | 99.00th=[129500], 99.50th=[170918], 99.90th=[208667], 99.95th=[375391], | 99.99th=[375391] bw ( KiB/s): min= 7, max= 118, per=25.57%, avg=51.40, stdev=21.43, samples=229 iops : min= 1, max= 29, avg=12.20, stdev= 5.39, samples=229 write: IOPS=13, BW=52.2KiB/s (53.5kB/s)(6236KiB/119432msec); 0 zone resets clat (usec): min=853, max=1295.2k, avg=39495.86, stdev=51199.01 lat (usec): min=854, max=1295.2k, avg=39500.89, stdev=51197.84 clat percentiles (usec): | 1.00th=[ 1156], 5.00th=[ 1336], 10.00th=[ 1713], | 20.00th=[ 4817], 30.00th=[ 9896], 40.00th=[ 19006], | 50.00th=[ 28443], 60.00th=[ 38011], 70.00th=[ 49546], | 80.00th=[ 65799], 90.00th=[ 89654], 95.00th=[ 111674], | 99.00th=[ 183501], 99.50th=[ 219153], 99.90th=[ 425722], | 99.95th=[1300235], 99.99th=[1300235] bw ( KiB/s): min= 8, max= 135, per=24.79%, avg=52.06, stdev=23.17, samples=233 iops : min= 2, max= 33, avg=12.37, stdev= 5.82, samples=233 lat (usec) : 50=0.23%, 100=4.39%, 250=0.29%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=5.89%, 4=2.99%, 10=6.67%, 20=11.95%, 50=39.00% lat (msec) : 100=23.27%, 250=4.79%, 500=0.16%, 2000=0.03% cpu : usr=0.11%, sys=5.55%, ctx=6584, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=201KiB/s (206kB/s), 50.6KiB/s-51.3KiB/s (51.9kB/s-52.6kB/s), io=23.4MiB (24.6MB), run=116798-119432msec WRITE: bw=210KiB/s (216kB/s), 52.2KiB/s-54.1KiB/s (53.5kB/s-55.4kB/s), io=24.6MiB (25.7MB), run=116798-119432msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145628: Tue Sep 8 09:28:39 2026 read: IOPS=6, BW=24.1KiB/s (24.7kB/s)(5992KiB/248259msec) clat (msec): min=5, max=1123, avg=34.84, stdev=45.12 lat (msec): min=5, max=1123, avg=34.85, stdev=45.12 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 46], 90.00th=[ 70], 95.00th=[ 94], | 99.00th=[ 182], 99.50th=[ 232], 99.90th=[ 567], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 7, max= 96, per=26.92%, avg=25.85, stdev=17.17, samples=448 iops : min= 1, max= 24, avg= 5.80, stdev= 4.33, samples=448 write: IOPS=6, BW=25.4KiB/s (25.0kB/s)(6296KiB/248259msec); 0 zone resets clat (msec): min=33, max=410, avg=124.27, stdev=54.91 lat (msec): min=33, max=410, avg=124.28, stdev=54.91 clat percentiles (msec): | 1.00th=[ 44], 5.00th=[ 57], 10.00th=[ 66], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 114], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 163], 90.00th=[ 197], 95.00th=[ 226], | 99.00th=[ 305], 99.50th=[ 351], 99.90th=[ 405], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 7, max= 63, per=24.78%, avg=25.02, stdev=11.19, samples=485 iops : min= 1, max= 15, avg= 5.59, stdev= 2.85, samples=485 lat (msec) : 10=4.00%, 20=15.17%, 50=22.49%, 100=25.13%, 250=31.61% lat (msec) : 500=1.53%, 750=0.03%, 2000=0.03% cpu : usr=0.06%, sys=1.36%, ctx=5332, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145630: Tue Sep 8 09:28:39 2026 read: IOPS=5, BW=23.9KiB/s (24.5kB/s)(5940KiB/248393msec) clat (msec): min=5, max=1141, avg=34.58, stdev=44.70 lat (msec): min=5, max=1141, avg=34.59, stdev=44.70 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 19], 50.00th=[ 23], 60.00th=[ 28], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 97], | 99.00th=[ 169], 99.50th=[ 188], 99.90th=[ 567], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 6, max= 103, per=27.32%, avg=26.22, stdev=18.15, samples=437 iops : min= 1, max= 25, avg= 5.90, stdev= 4.56, samples=437 write: IOPS=6, BW=25.6KiB/s (26.2kB/s)(6348KiB/248393msec); 0 zone resets clat (msec): min=35, max=506, avg=123.87, stdev=56.68 lat (msec): min=35, max=506, avg=123.88, stdev=56.68 clat percentiles (msec): | 1.00th=[ 43], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 80], | 30.00th=[ 92], 40.00th=[ 102], 50.00th=[ 114], 60.00th=[ 127], | 70.00th=[ 140], 80.00th=[ 159], 90.00th=[ 197], 95.00th=[ 230], | 99.00th=[ 317], 99.50th=[ 376], 99.90th=[ 498], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 7, max= 56, per=24.89%, avg=25.14, stdev=10.98, samples=486 iops : min= 1, max= 14, avg= 5.62, stdev= 2.80, samples=486 lat (msec) : 10=4.69%, 20=16.37%, 50=19.50%, 100=25.29%, 250=32.29% lat (msec) : 500=1.76%, 750=0.07%, 2000=0.03% cpu : usr=0.05%, sys=1.33%, ctx=5326, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145631: Tue Sep 8 09:28:39 2026 read: IOPS=6, BW=24.4KiB/s (24.0kB/s)(6028KiB/246907msec) clat (msec): min=5, max=424, avg=34.58, stdev=34.00 lat (msec): min=5, max=424, avg=34.58, stdev=34.00 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 70], 95.00th=[ 96], | 99.00th=[ 167], 99.50th=[ 218], 99.90th=[ 330], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 7, max= 112, per=26.98%, avg=25.90, stdev=17.83, samples=449 iops : min= 1, max= 28, avg= 5.81, stdev= 4.51, samples=449 write: IOPS=6, BW=25.4KiB/s (25.0kB/s)(6260KiB/246907msec); 0 zone resets clat (msec): min=35, max=1369, avg=124.18, stdev=63.75 lat (msec): min=35, max=1369, avg=124.19, stdev=63.75 clat percentiles (msec): | 1.00th=[ 45], 5.00th=[ 55], 10.00th=[ 65], 20.00th=[ 77], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 114], 60.00th=[ 128], | 70.00th=[ 142], 80.00th=[ 165], 90.00th=[ 190], 95.00th=[ 230], | 99.00th=[ 313], 99.50th=[ 376], 99.90th=[ 456], 99.95th=[ 1368], | 99.99th=[ 1368] bw ( KiB/s): min= 7, max= 63, per=24.93%, avg=25.18, stdev=11.10, samples=479 iops : min= 1, max= 15, avg= 5.63, stdev= 2.82, samples=479 lat (msec) : 10=3.58%, 20=16.15%, 50=21.58%, 100=25.20%, 250=31.90% lat (msec) : 500=1.56%, 2000=0.03% cpu : usr=0.05%, sys=1.34%, ctx=5101, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145633: Tue Sep 8 09:28:39 2026 read: IOPS=6, BW=24.6KiB/s (25.2kB/s)(6052KiB/245591msec) clat (msec): min=5, max=325, avg=33.94, stdev=31.67 lat (msec): min=5, max=325, avg=33.94, stdev=31.67 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 35], 80.00th=[ 48], 90.00th=[ 71], 95.00th=[ 95], | 99.00th=[ 148], 99.50th=[ 184], 99.90th=[ 309], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 6, max= 95, per=28.38%, avg=27.24, stdev=18.03, samples=430 iops : min= 1, max= 23, avg= 6.15, stdev= 4.54, samples=430 write: IOPS=6, BW=25.4KiB/s (26.0kB/s)(6236KiB/245591msec); 0 zone resets clat (msec): min=27, max=1287, avg=124.32, stdev=63.18 lat (msec): min=27, max=1287, avg=124.32, stdev=63.18 clat percentiles (msec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 78], | 30.00th=[ 89], 40.00th=[ 102], 50.00th=[ 115], 60.00th=[ 129], | 70.00th=[ 144], 80.00th=[ 161], 90.00th=[ 197], 95.00th=[ 226], | 99.00th=[ 305], 99.50th=[ 380], 99.90th=[ 527], 99.95th=[ 1284], | 99.99th=[ 1284] bw ( KiB/s): min= 7, max= 64, per=24.76%, avg=25.01, stdev=11.03, samples=481 iops : min= 1, max= 16, avg= 5.59, stdev= 2.82, samples=481 lat (msec) : 10=3.65%, 20=16.18%, 50=21.71%, 100=25.68%, 250=31.28% lat (msec) : 500=1.43%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.36%, ctx=5414, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=96.7KiB/s (98.0kB/s), 23.9KiB/s-24.6KiB/s (24.5kB/s-25.2kB/s), io=23.4MiB (24.6MB), run=245591-248393msec WRITE: bw=101KiB/s (104kB/s), 25.4KiB/s-25.6KiB/s (25.0kB/s-26.2kB/s), io=24.6MiB (25.7MB), run=245591-248393msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145689: Tue Sep 8 09:29:20 2026 read: IOPS=14, BW=224KiB/s (230kB/s)(5920KiB/26403msec) clat (usec): min=41, max=213260, avg=36605.49, stdev=27936.00 lat (usec): min=41, max=213262, avg=36618.16, stdev=27932.43 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 69], 10.00th=[ 78], 20.00th=[ 14615], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 34341], 60.00th=[ 40633], | 70.00th=[ 45876], 80.00th=[ 52691], 90.00th=[ 68682], 95.00th=[ 87557], | 99.00th=[130548], 99.50th=[137364], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 94, max= 412, per=26.30%, avg=217.80, stdev=73.59, samples=51 iops : min= 5, max= 25, avg=12.84, stdev= 4.64, samples=51 write: IOPS=15, BW=241KiB/s (247kB/s)(6368KiB/26403msec); 0 zone resets clat (usec): min=1314, max=155610, avg=31944.52, stdev=31796.01 lat (usec): min=1318, max=155612, avg=31948.24, stdev=31796.49 clat percentiles (usec): | 1.00th=[ 1713], 5.00th=[ 2089], 10.00th=[ 3359], 20.00th=[ 5997], | 30.00th=[ 8225], 40.00th=[ 12780], 50.00th=[ 20841], 60.00th=[ 30016], | 70.00th=[ 39584], 80.00th=[ 56361], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[130548], 99.50th=[147850], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 31, max= 445, per=27.26%, avg=237.41, stdev=87.70, samples=51 iops : min= 1, max= 27, avg=14.10, stdev= 5.51, samples=51 lat (usec) : 50=0.78%, 100=6.64%, 250=1.17%, 500=0.13% lat (msec) : 2=2.08%, 4=4.56%, 10=11.33%, 20=10.42%, 50=39.32% lat (msec) : 100=19.53%, 250=4.04% cpu : usr=0.11%, sys=6.89%, ctx=1494, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145691: Tue Sep 8 09:29:20 2026 read: IOPS=12, BW=200KiB/s (205kB/s)(5744KiB/28719msec) clat (usec): min=42, max=180784, avg=41118.04, stdev=29036.33 lat (usec): min=43, max=180784, avg=41119.74, stdev=29036.38 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 71], 10.00th=[ 88], 20.00th=[ 19792], | 30.00th=[ 27395], 40.00th=[ 32375], 50.00th=[ 37487], 60.00th=[ 43779], | 70.00th=[ 51119], 80.00th=[ 61604], 90.00th=[ 76022], 95.00th=[ 95945], | 99.00th=[143655], 99.50th=[147850], 99.90th=[181404], 99.95th=[181404], | 99.99th=[181404] bw ( KiB/s): min= 21, max= 436, per=24.63%, avg=203.96, stdev=95.21, samples=55 iops : min= 1, max= 27, avg=11.96, stdev= 6.03, samples=55 write: IOPS=14, BW=228KiB/s (233kB/s)(6544KiB/28719msec); 0 zone resets clat (usec): min=1167, max=222362, avg=33409.98, stdev=37243.37 lat (usec): min=1169, max=222366, avg=33413.07, stdev=37243.51 clat percentiles (usec): | 1.00th=[ 1860], 5.00th=[ 2147], 10.00th=[ 3195], 20.00th=[ 5342], | 30.00th=[ 7963], 40.00th=[ 11863], 50.00th=[ 20579], 60.00th=[ 29754], | 70.00th=[ 40633], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[ 96994], | 99.00th=[173016], 99.50th=[198181], 99.90th=[223347], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 31, max= 447, per=26.74%, avg=232.87, stdev=91.35, samples=55 iops : min= 1, max= 27, avg=13.78, stdev= 5.73, samples=55 lat (usec) : 50=0.26%, 100=5.86%, 250=0.52% lat (msec) : 2=1.56%, 4=5.34%, 10=12.76%, 20=9.38%, 50=37.11% lat (msec) : 100=22.53%, 250=4.69% cpu : usr=0.11%, sys=6.38%, ctx=1593, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145692: Tue Sep 8 09:29:20 2026 read: IOPS=14, BW=236KiB/s (242kB/s)(6256KiB/26488msec) clat (usec): min=39, max=124485, avg=37961.57, stdev=26959.27 lat (usec): min=39, max=124488, avg=37963.28, stdev=26959.34 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 72], 10.00th=[ 79], 20.00th=[ 17171], | 30.00th=[ 24773], 40.00th=[ 30278], 50.00th=[ 35914], 60.00th=[ 41681], | 70.00th=[ 47973], 80.00th=[ 59507], 90.00th=[ 74974], 95.00th=[ 89654], | 99.00th=[123208], 99.50th=[124257], 99.90th=[124257], 99.95th=[124257], | 99.99th=[124257] bw ( KiB/s): min= 31, max= 605, per=28.62%, avg=237.00, stdev=98.61, samples=51 iops : min= 1, max= 37, avg=14.06, stdev= 6.25, samples=51 write: IOPS=14, BW=228KiB/s (233kB/s)(6032KiB/26488msec); 0 zone resets clat (usec): min=1528, max=224526, avg=30151.65, stdev=30950.65 lat (usec): min=1531, max=224530, avg=30160.54, stdev=30948.99 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2278], 10.00th=[ 3425], 20.00th=[ 5800], | 30.00th=[ 7832], 40.00th=[ 12387], 50.00th=[ 18482], 60.00th=[ 29230], | 70.00th=[ 39060], 80.00th=[ 54264], 90.00th=[ 73925], 95.00th=[ 85459], | 99.00th=[139461], 99.50th=[166724], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 571, per=25.84%, avg=225.06, stdev=104.01, samples=51 iops : min= 1, max= 35, avg=13.31, stdev= 6.52, samples=51 lat (usec) : 50=0.65%, 100=7.16%, 250=0.78%, 750=0.13% lat (msec) : 2=1.82%, 4=4.95%, 10=11.46%, 20=10.03%, 50=38.41% lat (msec) : 100=22.27%, 250=2.34% cpu : usr=0.15%, sys=6.70%, ctx=1575, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145694: Tue Sep 8 09:29:20 2026 read: IOPS=13, BW=209KiB/s (214kB/s)(6032KiB/28906msec) clat (usec): min=34, max=249570, avg=41158.45, stdev=32946.86 lat (usec): min=34, max=249572, avg=41160.65, stdev=32947.51 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 67], 10.00th=[ 80], 20.00th=[ 12256], | 30.00th=[ 24511], 40.00th=[ 31589], 50.00th=[ 38011], 60.00th=[ 45876], | 70.00th=[ 53740], 80.00th=[ 62129], 90.00th=[ 79168], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[214959], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 62, max= 439, per=25.42%, avg=210.47, stdev=90.54, samples=55 iops : min= 3, max= 27, avg=12.36, stdev= 5.71, samples=55 write: IOPS=13, BW=216KiB/s (222kB/s)(6256KiB/28906msec); 0 zone resets clat (usec): min=1244, max=212592, avg=33369.34, stdev=37254.02 lat (usec): min=1247, max=212595, avg=33384.46, stdev=37253.21 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 2114], 10.00th=[ 3228], 20.00th=[ 4752], | 30.00th=[ 7767], 40.00th=[ 11469], 50.00th=[ 19530], 60.00th=[ 29230], | 70.00th=[ 40109], 80.00th=[ 56886], 90.00th=[ 80217], 95.00th=[106431], | 99.00th=[168821], 99.50th=[204473], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 538, per=24.66%, avg=214.77, stdev=100.94, samples=56 iops : min= 1, max= 33, avg=12.64, stdev= 6.37, samples=56 lat (usec) : 50=0.91%, 100=7.03%, 250=1.17%, 1000=0.26% lat (msec) : 2=2.21%, 4=5.47%, 10=11.33%, 20=9.77%, 50=32.29% lat (msec) : 100=23.83%, 250=5.73% cpu : usr=0.11%, sys=6.15%, ctx=1534, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=829KiB/s (849kB/s), 200KiB/s-236KiB/s (205kB/s-242kB/s), io=23.4MiB (24.5MB), run=26403-28906msec WRITE: bw=872KiB/s (893kB/s), 216KiB/s-241KiB/s (222kB/s-247kB/s), io=24.6MiB (25.8MB), run=26403-28906msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145687: Tue Sep 8 09:29:58 2026 read: IOPS=5, BW=88.7KiB/s (90.8kB/s)(5920KiB/66765msec) clat (msec): min=6, max=298, avg=38.86, stdev=35.85 lat (msec): min=6, max=298, avg=38.86, stdev=35.85 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 75], 95.00th=[ 106], | 99.00th=[ 228], 99.50th=[ 236], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 315, per=27.11%, avg=97.05, stdev=56.27, samples=118 iops : min= 1, max= 19, avg= 5.25, stdev= 3.58, samples=118 write: IOPS=5, BW=95.4KiB/s (97.7kB/s)(6368KiB/66765msec); 0 zone resets clat (msec): min=36, max=405, avg=130.99, stdev=54.68 lat (msec): min=36, max=405, avg=130.99, stdev=54.68 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 73], 20.00th=[ 88], | 30.00th=[ 101], 40.00th=[ 110], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 150], 80.00th=[ 171], 90.00th=[ 197], 95.00th=[ 232], | 99.00th=[ 321], 99.50th=[ 363], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 31, max= 224, per=25.10%, avg=94.63, stdev=39.05, samples=131 iops : min= 1, max= 14, avg= 5.09, stdev= 2.50, samples=131 lat (msec) : 10=1.30%, 20=13.80%, 50=23.44%, 100=22.01%, 250=37.50% lat (msec) : 500=1.95% cpu : usr=0.07%, sys=1.37%, ctx=1274, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145688: Tue Sep 8 09:29:58 2026 read: IOPS=5, BW=86.4KiB/s (88.5kB/s)(5744KiB/66474msec) clat (msec): min=7, max=315, avg=37.73, stdev=37.92 lat (msec): min=7, max=315, avg=37.73, stdev=37.92 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 32], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 72], 95.00th=[ 112], | 99.00th=[ 203], 99.50th=[ 262], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 22, max= 352, per=26.32%, avg=94.24, stdev=64.96, samples=120 iops : min= 1, max= 22, avg= 5.07, stdev= 4.12, samples=120 write: IOPS=6, BW=98.4KiB/s (101kB/s)(6544KiB/66474msec); 0 zone resets clat (msec): min=42, max=375, avg=129.24, stdev=52.90 lat (msec): min=42, max=375, avg=129.25, stdev=52.89 clat percentiles (msec): | 1.00th=[ 51], 5.00th=[ 62], 10.00th=[ 71], 20.00th=[ 88], | 30.00th=[ 99], 40.00th=[ 108], 50.00th=[ 118], 60.00th=[ 130], | 70.00th=[ 144], 80.00th=[ 171], 90.00th=[ 203], 95.00th=[ 224], | 99.00th=[ 300], 99.50th=[ 334], 99.90th=[ 376], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 29, max= 221, per=25.97%, avg=97.91, stdev=40.56, samples=131 iops : min= 1, max= 13, avg= 5.30, stdev= 2.58, samples=131 lat (msec) : 10=1.30%, 20=14.71%, 50=22.79%, 100=22.53%, 250=36.98% lat (msec) : 500=1.69% cpu : usr=0.06%, sys=1.55%, ctx=1313, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145690: Tue Sep 8 09:29:58 2026 read: IOPS=6, BW=96.3KiB/s (98.7kB/s)(6256KiB/64937msec) clat (msec): min=8, max=331, avg=37.12, stdev=36.29 lat (msec): min=8, max=331, avg=37.12, stdev=36.29 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 12], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 22], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 48], 90.00th=[ 73], 95.00th=[ 100], | 99.00th=[ 228], 99.50th=[ 230], 99.90th=[ 330], 99.95th=[ 330], | 99.99th=[ 330] bw ( KiB/s): min= 29, max= 350, per=29.37%, avg=105.14, stdev=65.37, samples=117 iops : min= 1, max= 21, avg= 5.76, stdev= 4.11, samples=117 write: IOPS=5, BW=92.9KiB/s (95.1kB/s)(6032KiB/64937msec); 0 zone resets clat (msec): min=37, max=415, avg=133.04, stdev=57.41 lat (msec): min=37, max=415, avg=133.04, stdev=57.41 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 58], 10.00th=[ 71], 20.00th=[ 87], | 30.00th=[ 97], 40.00th=[ 111], 50.00th=[ 125], 60.00th=[ 140], | 70.00th=[ 153], 80.00th=[ 171], 90.00th=[ 207], 95.00th=[ 234], | 99.00th=[ 351], 99.50th=[ 376], 99.90th=[ 418], 99.95th=[ 418], | 99.99th=[ 418] bw ( KiB/s): min= 29, max= 224, per=24.82%, avg=93.58, stdev=38.66, samples=125 iops : min= 1, max= 14, avg= 5.03, stdev= 2.48, samples=125 lat (msec) : 10=0.78%, 20=16.28%, 50=25.26%, 100=22.92%, 250=33.07% lat (msec) : 500=1.69% cpu : usr=0.05%, sys=1.43%, ctx=1377, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145693: Tue Sep 8 09:29:58 2026 read: IOPS=5, BW=91.3KiB/s (93.5kB/s)(6032KiB/66035msec) clat (msec): min=7, max=322, avg=36.94, stdev=33.05 lat (msec): min=7, max=322, avg=36.94, stdev=33.05 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 14], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 50], 90.00th=[ 69], 95.00th=[ 101], | 99.00th=[ 178], 99.50th=[ 243], 99.90th=[ 321], 99.95th=[ 321], | 99.99th=[ 321] bw ( KiB/s): min= 29, max= 313, per=27.90%, avg=99.87, stdev=62.99, samples=118 iops : min= 1, max= 19, avg= 5.42, stdev= 3.99, samples=118 write: IOPS=5, BW=94.7KiB/s (97.0kB/s)(6256KiB/66035msec); 0 zone resets clat (msec): min=41, max=346, avg=132.44, stdev=55.58 lat (msec): min=41, max=346, avg=132.45, stdev=55.58 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 74], 20.00th=[ 88], | 30.00th=[ 100], 40.00th=[ 112], 50.00th=[ 122], 60.00th=[ 136], | 70.00th=[ 153], 80.00th=[ 171], 90.00th=[ 201], 95.00th=[ 245], | 99.00th=[ 313], 99.50th=[ 338], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 29, max= 224, per=25.31%, avg=95.42, stdev=38.60, samples=129 iops : min= 1, max= 14, avg= 5.14, stdev= 2.46, samples=129 lat (msec) : 10=1.69%, 20=14.19%, 50=24.87%, 100=21.61%, 250=35.42% lat (msec) : 500=2.21% cpu : usr=0.05%, sys=1.47%, ctx=1345, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=359KiB/s (367kB/s), 86.4KiB/s-96.3KiB/s (88.5kB/s-98.7kB/s), io=23.4MiB (24.5MB), run=64937-66765msec WRITE: bw=377KiB/s (387kB/s), 92.9KiB/s-98.4KiB/s (95.1kB/s-101kB/s), io=24.6MiB (25.8MB), run=64937-66765msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145711: Tue Sep 8 09:30:17 2026 read: IOPS=1, BW=1117KiB/s (1144kB/s)(7168KiB/6418msec) clat (msec): min=2, max=2990, avg=636.79, stdev=1055.36 lat (msec): min=2, max=2990, avg=636.80, stdev=1055.36 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 70], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 271], 60.00th=[ 435], | 70.00th=[ 435], 80.00th=[ 535], 90.00th=[ 3004], 95.00th=[ 3004], | 99.00th=[ 3004], 99.50th=[ 3004], 99.90th=[ 3004], 99.95th=[ 3004], | 99.99th=[ 3004] bw ( KiB/s): min= 1910, max= 4071, per=100.00%, avg=2995.00, stdev=1210.72, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=0, BW=798KiB/s (817kB/s)(5120KiB/6418msec); 0 zone resets clat (msec): min=139, max=515, avg=369.70, stdev=161.00 lat (msec): min=139, max=515, avg=369.80, stdev=161.01 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 140], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 481], 80.00th=[ 481], 90.00th=[ 514], 95.00th=[ 514], | 99.00th=[ 514], 99.50th=[ 514], 99.90th=[ 514], 99.95th=[ 514], | 99.99th=[ 514] bw ( KiB/s): min= 2035, max= 3992, per=68.45%, avg=2690.00, stdev=1127.57, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 4=8.33%, 100=8.33%, 250=16.67%, 500=41.67%, 750=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.21%, ctx=610, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145712: Tue Sep 8 09:30:17 2026 read: IOPS=0, BW=281KiB/s (287kB/s)(2048KiB/7295msec) clat (usec): min=623, max=222216, avg=111420.20, stdev=156689.66 lat (usec): min=624, max=222219, avg=111422.12, stdev=156690.92 clat percentiles (usec): | 1.00th=[ 627], 5.00th=[ 627], 10.00th=[ 627], 20.00th=[ 627], | 30.00th=[ 627], 40.00th=[ 627], 50.00th=[ 627], 60.00th=[221250], | 70.00th=[221250], 80.00th=[221250], 90.00th=[221250], 95.00th=[221250], | 99.00th=[221250], 99.50th=[221250], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 1526, max= 2043, per=63.57%, avg=1784.50, stdev=365.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1404KiB/s (1437kB/s)(10.0MiB/7295msec); 0 zone resets clat (msec): min=143, max=3522, avg=702.49, stdev=1007.12 lat (msec): min=144, max=3522, avg=703.07, stdev=1006.94 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 211], | 30.00th=[ 268], 40.00th=[ 271], 50.00th=[ 363], 60.00th=[ 447], | 70.00th=[ 485], 80.00th=[ 567], 90.00th=[ 743], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1910, max= 4071, per=65.74%, avg=2583.57, stdev=998.06, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.01%, sys=7.31%, ctx=141, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145714: Tue Sep 8 09:30:17 2026 read: IOPS=0, BW=935KiB/s (958kB/s)(6144KiB/6569msec) clat (msec): min=3, max=510, avg=257.94, stdev=209.41 lat (msec): min=3, max=510, avg=257.94, stdev=209.41 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 36], | 30.00th=[ 36], 40.00th=[ 234], 50.00th=[ 234], 60.00th=[ 313], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1910, max= 4087, per=100.00%, avg=3337.33, stdev=1236.63, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=935KiB/s (958kB/s)(6144KiB/6569msec); 0 zone resets clat (msec): min=177, max=3351, avg=786.16, stdev=1258.47 lat (msec): min=177, max=3351, avg=786.31, stdev=1258.46 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 220], | 30.00th=[ 220], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 309], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 3339], 95.00th=[ 3339], | 99.00th=[ 3339], 99.50th=[ 3339], 99.90th=[ 3339], 99.95th=[ 3339], | 99.99th=[ 3339] bw ( KiB/s): min= 1600, max= 2035, per=48.91%, avg=1922.00, stdev=163.18, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 4=8.33%, 50=8.33%, 250=25.00%, 500=41.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=8.33%, ctx=249, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145715: Tue Sep 8 09:30:17 2026 read: IOPS=0, BW=842KiB/s (862kB/s)(5120KiB/6079msec) clat (usec): min=796, max=479198, avg=97633.31, stdev=213306.02 lat (usec): min=798, max=479200, avg=97635.09, stdev=213306.10 clat percentiles (usec): | 1.00th=[ 799], 5.00th=[ 799], 10.00th=[ 799], 20.00th=[ 799], | 30.00th=[ 1029], 40.00th=[ 1029], 50.00th=[ 3195], 60.00th=[ 3195], | 70.00th=[ 3949], 80.00th=[ 3949], 90.00th=[480248], 95.00th=[480248], | 99.00th=[480248], 99.50th=[480248], 99.90th=[480248], 99.95th=[480248], | 99.99th=[480248] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1179KiB/s (1207kB/s)(7168KiB/6079msec); 0 zone resets clat (msec): min=176, max=3179, avg=779.44, stdev=1067.36 lat (msec): min=176, max=3179, avg=779.70, stdev=1067.29 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 279], | 30.00th=[ 359], 40.00th=[ 359], 50.00th=[ 380], 60.00th=[ 468], | 70.00th=[ 468], 80.00th=[ 609], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 1635, max= 4071, per=61.76%, avg=2427.25, stdev=1109.38, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 4=16.67%, 250=8.33%, 500=41.67%, 750=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=6.84%, ctx=85, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2807KiB/s (2875kB/s), 281KiB/s-1117KiB/s (287kB/s-1144kB/s), io=20.0MiB (20.0MB), run=6079-7295msec WRITE: bw=3930KiB/s (4025kB/s), 798KiB/s-1404KiB/s (817kB/s-1437kB/s), io=28.0MiB (29.4MB), run=6079-7295msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145713: Tue Sep 8 09:30:18 2026 read: IOPS=0, BW=996KiB/s (1020kB/s)(7168KiB/7198msec) clat (msec): min=119, max=2955, avg=678.33, stdev=1014.73 lat (msec): min=119, max=2955, avg=678.33, stdev=1014.73 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 182], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 376], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 542], 90.00th=[ 2970], 95.00th=[ 2970], | 99.00th=[ 2970], 99.50th=[ 2970], 99.90th=[ 2970], 99.95th=[ 2970], | 99.99th=[ 2970] bw ( KiB/s): min= 1590, max= 4015, per=93.51%, avg=2340.60, stdev=955.54, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=0, BW=711KiB/s (728kB/s)(5120KiB/7198msec); 0 zone resets clat (msec): min=219, max=782, avg=478.72, stdev=221.39 lat (msec): min=220, max=783, avg=478.84, stdev=221.40 clat percentiles (msec): | 1.00th=[ 220], 5.00th=[ 220], 10.00th=[ 220], 20.00th=[ 220], | 30.00th=[ 326], 40.00th=[ 326], 50.00th=[ 468], 60.00th=[ 468], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 1924, max= 2039, per=57.11%, avg=2001.25, stdev=53.43, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=33.33%, 500=33.33%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.36%, ctx=83, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145716: Tue Sep 8 09:30:18 2026 read: IOPS=0, BW=254KiB/s (260kB/s)(2048KiB/8073msec) clat (msec): min=102, max=505, avg=303.72, stdev=284.91 lat (msec): min=102, max=505, avg=303.73, stdev=284.91 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 506], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 506], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 2039, max= 2048, per=81.64%, avg=2043.50, stdev= 6.36, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1268KiB/s (1299kB/s)(10.0MiB/8073msec); 0 zone resets clat (msec): min=269, max=3508, avg=725.06, stdev=984.42 lat (msec): min=270, max=3508, avg=725.55, stdev=984.29 clat percentiles (msec): | 1.00th=[ 271], 5.00th=[ 271], 10.00th=[ 271], 20.00th=[ 279], | 30.00th=[ 388], 40.00th=[ 388], 50.00th=[ 397], 60.00th=[ 405], | 70.00th=[ 456], 80.00th=[ 489], 90.00th=[ 676], 95.00th=[ 3507], | 99.00th=[ 3507], 99.50th=[ 3507], 99.90th=[ 3507], 99.95th=[ 3507], | 99.99th=[ 3507] bw ( KiB/s): min= 1924, max= 4079, per=65.72%, avg=2302.71, stdev=784.30, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 250=8.33%, 500=66.67%, 750=16.67%, >=2000=8.33% cpu : usr=0.05%, sys=3.08%, ctx=109, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145717: Tue Sep 8 09:30:18 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(6144KiB/8150msec) clat (msec): min=132, max=750, avg=392.08, stdev=224.62 lat (msec): min=132, max=750, avg=392.08, stdev=224.62 clat percentiles (msec): | 1.00th=[ 133], 5.00th=[ 133], 10.00th=[ 133], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 355], 50.00th=[ 355], 60.00th=[ 368], | 70.00th=[ 542], 80.00th=[ 542], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 1924, max= 4063, per=100.00%, avg=2504.50, stdev=1040.02, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=754KiB/s (772kB/s)(6144KiB/8150msec); 0 zone resets clat (msec): min=182, max=3732, avg=922.48, stdev=1383.70 lat (msec): min=182, max=3733, avg=922.79, stdev=1384.14 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 268], | 30.00th=[ 268], 40.00th=[ 351], 50.00th=[ 351], 60.00th=[ 414], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 3742], 95.00th=[ 3742], | 99.00th=[ 3742], 99.50th=[ 3742], 99.90th=[ 3742], 99.95th=[ 3742], | 99.99th=[ 3742] bw ( KiB/s): min= 1924, max= 4096, per=72.02%, avg=2523.50, stdev=1049.70, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 250=25.00%, 500=41.67%, 750=16.67%, 1000=8.33%, >=2000=8.33% cpu : usr=0.02%, sys=2.02%, ctx=100, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145718: Tue Sep 8 09:30:18 2026 read: IOPS=0, BW=626KiB/s (641kB/s)(5120KiB/8182msec) clat (msec): min=133, max=502, avg=241.78, stdev=154.82 lat (msec): min=133, max=502, avg=241.80, stdev=154.82 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 167], 60.00th=[ 167], | 70.00th=[ 266], 80.00th=[ 266], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 3849, max= 4079, per=100.00%, avg=3964.00, stdev=162.63, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=0, BW=876KiB/s (897kB/s)(7168KiB/8182msec); 0 zone resets clat (msec): min=324, max=3594, avg=964.07, stdev=1169.94 lat (msec): min=324, max=3596, avg=965.23, stdev=1169.99 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 426], | 30.00th=[ 460], 40.00th=[ 460], 50.00th=[ 489], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 743], 90.00th=[ 3608], 95.00th=[ 3608], | 99.00th=[ 3608], 99.50th=[ 3608], 99.90th=[ 3608], 99.95th=[ 3608], | 99.99th=[ 3608] bw ( KiB/s): min= 2011, max= 4063, per=69.63%, avg=2440.00, stdev=907.40, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, >=2000=8.33% cpu : usr=0.00%, sys=2.47%, ctx=105, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2503KiB/s (2563kB/s), 254KiB/s-996KiB/s (260kB/s-1020kB/s), io=20.0MiB (20.0MB), run=7198-8182msec WRITE: bw=3504KiB/s (3588kB/s), 711KiB/s-1268KiB/s (728kB/s-1299kB/s), io=28.0MiB (29.4MB), run=7198-8182msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145725: Tue Sep 8 09:30:33 2026 read: IOPS=0, BW=3652KiB/s (3739kB/s)(12.0MiB/3365msec) clat (msec): min=937, max=1196, avg=1059.03, stdev=130.59 lat (msec): min=937, max=1196, avg=1059.04, stdev=130.59 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8047, max= 8175, per=100.00%, avg=8111.00, stdev=90.51, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.03%, sys=10.46%, ctx=194, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145726: Tue Sep 8 09:30:33 2026 read: IOPS=0, BW=1065KiB/s (1091kB/s)(4096KiB/3846msec) clat (nsec): min=1065.7M, max=1065.7M, avg=1065748883.00, stdev= 0.00 lat (nsec): min=1065.8M, max=1065.8M, avg=1065751631.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1070], 80.00th=[ 1070], 90.00th=[ 1070], 95.00th=[ 1070], | 99.00th=[ 1070], 99.50th=[ 1070], 99.90th=[ 1070], 99.95th=[ 1070], | 99.99th=[ 1070] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2130KiB/s (2181kB/s)(8192KiB/3846msec); 0 zone resets clat (msec): min=687, max=2045, avg=1366.56, stdev=960.52 lat (msec): min=687, max=2046, avg=1367.11, stdev=960.54 clat percentiles (msec): | 1.00th=[ 684], 5.00th=[ 684], 10.00th=[ 684], 20.00th=[ 684], | 30.00th=[ 684], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 2039], | 70.00th=[ 2039], 80.00th=[ 2039], 90.00th=[ 2039], 95.00th=[ 2039], | 99.00th=[ 2039], 99.50th=[ 2039], 99.90th=[ 2039], 99.95th=[ 2039], | 99.99th=[ 2039] bw ( KiB/s): min= 8143, max= 8143, per=95.92%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=4.11%, ctx=112, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145727: Tue Sep 8 09:30:33 2026 write: IOPS=0, BW=3183KiB/s (3260kB/s)(12.0MiB/3860msec); 0 zone resets clat (msec): min=1136, max=1297, avg=1215.85, stdev=80.63 lat (msec): min=1137, max=1313, avg=1222.04, stdev=88.17 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1217], 50.00th=[ 1217], 60.00th=[ 1217], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7984, max= 8159, per=95.08%, avg=8071.50, stdev=123.74, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=6.66%, ctx=98, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145728: Tue Sep 8 09:30:33 2026 write: IOPS=1, BW=4534KiB/s (4643kB/s)(12.0MiB/2710msec); 0 zone resets clat (msec): min=412, max=1345, avg=824.96, stdev=475.71 lat (msec): min=412, max=1346, avg=825.42, stdev=475.86 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 718], 50.00th=[ 718], 60.00th=[ 718], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 7984, max= 8175, per=95.18%, avg=8079.50, stdev=135.06, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.76%, ctx=54, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4260KiB/s (4362kB/s), 1065KiB/s-3652KiB/s (1091kB/s-3739kB/s), io=16.0MiB (16.8MB), run=3365-3846msec WRITE: bw=8489KiB/s (8693kB/s), 2130KiB/s-4534KiB/s (2181kB/s-4643kB/s), io=32.0MiB (33.6MB), run=2710-3860msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145730: Tue Sep 8 09:30:34 2026 read: IOPS=0, BW=3218KiB/s (3296kB/s)(12.0MiB/3818msec) clat (msec): min=582, max=1782, avg=1258.75, stdev=614.35 lat (msec): min=582, max=1782, avg=1258.76, stdev=614.35 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 1418], 50.00th=[ 1418], 60.00th=[ 1418], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 8110, max= 8175, per=100.00%, avg=8142.50, stdev=45.96, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.33%, ctx=35, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145731: Tue Sep 8 09:30:34 2026 read: IOPS=0, BW=971KiB/s (994kB/s)(4096KiB/4220msec) clat (nsec): min=1613.9M, max=1613.9M, avg=1613858621.00, stdev= 0.00 lat (nsec): min=1613.9M, max=1613.9M, avg=1613861053.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1620], 5.00th=[ 1620], 10.00th=[ 1620], 20.00th=[ 1620], | 30.00th=[ 1620], 40.00th=[ 1620], 50.00th=[ 1620], 60.00th=[ 1620], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1941KiB/s (1988kB/s)(8192KiB/4220msec); 0 zone resets clat (msec): min=1065, max=1379, avg=1222.39, stdev=221.90 lat (msec): min=1065, max=1381, avg=1223.87, stdev=223.27 clat percentiles (msec): | 1.00th=[ 1070], 5.00th=[ 1070], 10.00th=[ 1070], 20.00th=[ 1070], | 30.00th=[ 1070], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1385], | 70.00th=[ 1385], 80.00th=[ 1385], 90.00th=[ 1385], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 2000=100.00% cpu : usr=0.12%, sys=2.32%, ctx=46, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145732: Tue Sep 8 09:30:34 2026 write: IOPS=0, BW=2929KiB/s (2999kB/s)(12.0MiB/4196msec); 0 zone resets clat (msec): min=411, max=2233, avg=1371.03, stdev=914.98 lat (msec): min=411, max=2235, avg=1372.79, stdev=915.79 clat percentiles (msec): | 1.00th=[ 414], 5.00th=[ 414], 10.00th=[ 414], 20.00th=[ 414], | 30.00th=[ 414], 40.00th=[ 1469], 50.00th=[ 1469], 60.00th=[ 1469], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.67%, ctx=48, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145733: Tue Sep 8 09:30:34 2026 write: IOPS=0, BW=3789KiB/s (3880kB/s)(12.0MiB/3243msec); 0 zone resets clat (msec): min=577, max=1718, avg=1064.37, stdev=588.49 lat (msec): min=577, max=1718, avg=1064.84, stdev=588.51 clat percentiles (msec): | 1.00th=[ 575], 5.00th=[ 575], 10.00th=[ 575], 20.00th=[ 575], | 30.00th=[ 575], 40.00th=[ 902], 50.00th=[ 902], 60.00th=[ 902], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 7922, max= 8143, per=100.00%, avg=8032.50, stdev=156.27, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.42%, ctx=61, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3882KiB/s (3976kB/s), 971KiB/s-3218KiB/s (994kB/s-3296kB/s), io=16.0MiB (16.8MB), run=3818-4220msec WRITE: bw=7765KiB/s (7951kB/s), 1941KiB/s-3789KiB/s (1988kB/s-3880kB/s), io=32.0MiB (33.6MB), run=3243-4220msec