== sanity test 398b: DIO and buffer IO race ============== 14:07:02 (1790100422) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.42826 s, 9.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145186: Tue Sep 22 14:10:04 2026 read: IOPS=9, BW=37.6KiB/s (38.5kB/s)(5992KiB/159403msec) clat (usec): min=31, max=1056.6k, avg=54747.44, stdev=64211.36 lat (usec): min=31, max=1056.6k, avg=54752.09, stdev=64212.31 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 61], 10.00th=[ 88], | 20.00th=[ 20579], 30.00th=[ 27395], 40.00th=[ 33424], | 50.00th=[ 41681], 60.00th=[ 50594], 70.00th=[ 61604], | 80.00th=[ 78119], 90.00th=[ 107480], 95.00th=[ 137364], | 99.00th=[ 308282], 99.50th=[ 429917], 99.90th=[ 826278], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 4, max= 87, per=25.90%, avg=37.81, stdev=18.43, samples=306 iops : min= 1, max= 21, avg= 8.79, stdev= 4.63, samples=306 write: IOPS=9, BW=39.5KiB/s (40.4kB/s)(6296KiB/159403msec); 0 zone resets clat (usec): min=656, max=919281, avg=48662.78, stdev=55125.06 lat (usec): min=656, max=919282, avg=48674.23, stdev=55123.17 clat percentiles (usec): | 1.00th=[ 1057], 5.00th=[ 1237], 10.00th=[ 1500], 20.00th=[ 5211], | 30.00th=[ 10814], 40.00th=[ 21890], 50.00th=[ 33817], 60.00th=[ 46400], | 70.00th=[ 62653], 80.00th=[ 83362], 90.00th=[115868], 95.00th=[145753], | 99.00th=[223347], 99.50th=[263193], 99.90th=[392168], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 4, max= 111, per=26.10%, avg=39.94, stdev=19.75, samples=305 iops : min= 1, max= 27, avg= 9.32, stdev= 4.96, samples=305 lat (usec) : 50=0.59%, 100=4.46%, 250=0.42%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=5.92%, 4=2.96%, 10=6.22%, 20=8.20%, 50=31.87% lat (msec) : 100=26.04%, 250=12.08%, 500=0.78%, 750=0.10%, 1000=0.07% lat (msec) : 2000=0.03% cpu : usr=0.09%, sys=4.73%, ctx=6401, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145187: Tue Sep 22 14:10:04 2026 read: IOPS=9, BW=36.8KiB/s (37.6kB/s)(5940KiB/161584msec) clat (usec): min=22, max=1107.5k, avg=54171.63, stdev=63204.82 lat (usec): min=22, max=1107.5k, avg=54174.05, stdev=63204.51 clat percentiles (usec): | 1.00th=[ 43], 5.00th=[ 61], 10.00th=[ 79], | 20.00th=[ 19792], 30.00th=[ 27132], 40.00th=[ 34341], | 50.00th=[ 42206], 60.00th=[ 53216], 70.00th=[ 65799], | 80.00th=[ 79168], 90.00th=[ 100140], 95.00th=[ 125305], | 99.00th=[ 244319], 99.50th=[ 425722], 99.90th=[ 935330], | 99.95th=[1115685], 99.99th=[1115685] bw ( KiB/s): min= 6, max= 103, per=25.37%, avg=37.05, stdev=17.87, samples=309 iops : min= 1, max= 25, avg= 8.60, stdev= 4.50, samples=309 write: IOPS=9, BW=39.3KiB/s (40.2kB/s)(6348KiB/161584msec); 0 zone resets clat (usec): min=613, max=559767, avg=50714.10, stdev=54975.52 lat (usec): min=614, max=559769, avg=50716.15, stdev=54975.45 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1237], 10.00th=[ 1500], 20.00th=[ 4424], | 30.00th=[ 10683], 40.00th=[ 23200], 50.00th=[ 35914], 60.00th=[ 50594], | 70.00th=[ 65799], 80.00th=[ 87557], 90.00th=[117965], 95.00th=[154141], | 99.00th=[223347], 99.50th=[254804], 99.90th=[541066], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 4, max= 119, per=25.77%, avg=39.42, stdev=19.70, samples=310 iops : min= 1, max= 29, avg= 9.20, stdev= 4.96, samples=310 lat (usec) : 50=0.98%, 100=4.56%, 250=0.26%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.20% lat (msec) : 2=6.45%, 4=3.42%, 10=5.60%, 20=7.39%, 50=29.43% lat (msec) : 100=28.45%, 250=12.37%, 500=0.52%, 750=0.13%, 1000=0.07% lat (msec) : 2000=0.03% cpu : usr=0.08%, sys=4.43%, ctx=6233, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145188: Tue Sep 22 14:10:04 2026 read: IOPS=9, BW=36.9KiB/s (37.8kB/s)(6028KiB/163457msec) clat (usec): min=28, max=1015.9k, avg=52683.42, stdev=60056.45 lat (usec): min=29, max=1015.9k, avg=52697.33, stdev=60056.19 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 59], 10.00th=[ 73], | 20.00th=[ 19792], 30.00th=[ 27657], 40.00th=[ 32900], | 50.00th=[ 40109], 60.00th=[ 50070], 70.00th=[ 61080], | 80.00th=[ 77071], 90.00th=[ 102237], 95.00th=[ 132645], | 99.00th=[ 261096], 99.50th=[ 387974], 99.90th=[ 801113], | 99.95th=[1019216], 99.99th=[1019216] bw ( KiB/s): min= 4, max= 142, per=25.30%, avg=36.94, stdev=20.07, samples=314 iops : min= 1, max= 35, avg= 8.59, stdev= 5.06, samples=314 write: IOPS=9, BW=38.3KiB/s (39.2kB/s)(6260KiB/163457msec); 0 zone resets clat (usec): min=932, max=483997, avg=53248.75, stdev=58145.96 lat (usec): min=934, max=483999, avg=53256.96, stdev=58141.35 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1270], 10.00th=[ 1762], 20.00th=[ 5604], | 30.00th=[ 12649], 40.00th=[ 26084], 50.00th=[ 38011], 60.00th=[ 50594], | 70.00th=[ 67634], 80.00th=[ 88605], 90.00th=[126354], 95.00th=[160433], | 99.00th=[252707], 99.50th=[304088], 99.90th=[471860], 99.95th=[484443], | 99.99th=[484443] bw ( KiB/s): min= 6, max= 134, per=25.16%, avg=38.50, stdev=20.23, samples=313 iops : min= 1, max= 33, avg= 8.97, stdev= 5.11, samples=313 lat (usec) : 50=0.81%, 100=4.92%, 250=0.23%, 500=0.07%, 1000=0.20% lat (msec) : 2=5.53%, 4=2.80%, 10=5.92%, 20=7.68%, 50=31.67% lat (msec) : 100=26.86%, 250=12.21%, 500=0.98%, 750=0.07%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.07%, sys=4.49%, ctx=6294, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145189: Tue Sep 22 14:10:04 2026 read: IOPS=9, BW=37.5KiB/s (38.4kB/s)(6052KiB/161565msec) clat (usec): min=30, max=1566.1k, avg=51210.30, stdev=68352.41 lat (usec): min=30, max=1566.1k, avg=51212.20, stdev=68352.61 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 59], 10.00th=[ 68], | 20.00th=[ 17171], 30.00th=[ 25822], 40.00th=[ 31851], | 50.00th=[ 38536], 60.00th=[ 47449], 70.00th=[ 60031], | 80.00th=[ 76022], 90.00th=[ 98042], 95.00th=[ 124257], | 99.00th=[ 240124], 99.50th=[ 425722], 99.90th=[ 809501], | 99.95th=[1568670], 99.99th=[1568670] bw ( KiB/s): min= 6, max= 111, per=25.93%, avg=37.85, stdev=20.43, samples=308 iops : min= 1, max= 27, avg= 8.81, stdev= 5.16, samples=308 write: IOPS=9, BW=38.6KiB/s (39.5kB/s)(6236KiB/161565msec); 0 zone resets clat (usec): min=937, max=574925, avg=53448.03, stdev=56589.46 lat (usec): min=938, max=574927, avg=53455.49, stdev=56588.36 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1221], 10.00th=[ 1532], 20.00th=[ 4621], | 30.00th=[ 12387], 40.00th=[ 27395], 50.00th=[ 40109], 60.00th=[ 54789], | 70.00th=[ 70779], 80.00th=[ 90702], 90.00th=[123208], 95.00th=[154141], | 99.00th=[274727], 99.50th=[316670], 99.90th=[438305], 99.95th=[574620], | 99.99th=[574620] bw ( KiB/s): min= 7, max= 119, per=25.39%, avg=38.85, stdev=18.50, samples=308 iops : min= 1, max= 29, avg= 9.05, stdev= 4.66, samples=308 lat (usec) : 50=0.78%, 100=5.53%, 250=0.42%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.13% lat (msec) : 2=6.35%, 4=2.96%, 10=5.24%, 20=7.58%, 50=30.47% lat (msec) : 100=27.31%, 250=11.91%, 500=0.88%, 750=0.10%, 1000=0.07% lat (msec) : 2000=0.03% cpu : usr=0.06%, sys=4.28%, ctx=6306, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=147KiB/s (150kB/s), 36.8KiB/s-37.6KiB/s (37.6kB/s-38.5kB/s), io=23.4MiB (24.6MB), run=159403-163457msec WRITE: bw=154KiB/s (157kB/s), 38.3KiB/s-39.5KiB/s (39.2kB/s-40.4kB/s), io=24.6MiB (25.7MB), run=159403-163457msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145191: Tue Sep 22 14:13:18 2026 read: IOPS=4, BW=16.9KiB/s (17.3kB/s)(5992KiB/354760msec) clat (msec): min=6, max=805, avg=49.87, stdev=58.59 lat (msec): min=6, max=805, avg=49.88, stdev=58.59 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 29], 50.00th=[ 35], 60.00th=[ 41], | 70.00th=[ 51], 80.00th=[ 63], 90.00th=[ 97], 95.00th=[ 134], | 99.00th=[ 305], 99.50th=[ 401], 99.90th=[ 776], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 6, max= 104, per=30.83%, avg=20.65, stdev=14.03, samples=556 iops : min= 1, max= 26, avg= 4.53, stdev= 3.55, samples=556 write: IOPS=4, BW=17.7KiB/s (18.2kB/s)(6296KiB/354760msec); 0 zone resets clat (msec): min=45, max=1835, avg=177.79, stdev=102.02 lat (msec): min=45, max=1835, avg=177.79, stdev=102.02 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 78], 10.00th=[ 88], 20.00th=[ 108], | 30.00th=[ 124], 40.00th=[ 138], 50.00th=[ 155], 60.00th=[ 176], | 70.00th=[ 199], 80.00th=[ 230], 90.00th=[ 284], 95.00th=[ 342], | 99.00th=[ 514], 99.50th=[ 651], 99.90th=[ 936], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 4, max= 47, per=25.58%, avg=17.91, stdev= 8.30, samples=670 iops : min= 1, max= 11, avg= 3.84, stdev= 2.14, samples=670 lat (msec) : 10=1.30%, 20=9.54%, 50=23.14%, 100=18.20%, 250=39.13% lat (msec) : 500=7.94%, 750=0.59%, 1000=0.13%, 2000=0.03% cpu : usr=0.03%, sys=1.04%, ctx=5573, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145192: Tue Sep 22 14:13:19 2026 read: IOPS=4, BW=16.7KiB/s (17.1kB/s)(5940KiB/356489msec) clat (msec): min=6, max=973, avg=48.77, stdev=58.39 lat (msec): min=6, max=973, avg=48.77, stdev=58.39 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 49], 80.00th=[ 63], 90.00th=[ 88], 95.00th=[ 127], | 99.00th=[ 284], 99.50th=[ 393], 99.90th=[ 852], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 4, max= 87, per=30.56%, avg=20.47, stdev=13.53, samples=555 iops : min= 1, max= 21, avg= 4.49, stdev= 3.40, samples=555 write: IOPS=4, BW=17.8KiB/s (18.2kB/s)(6348KiB/356489msec); 0 zone resets clat (msec): min=42, max=1046, avg=178.87, stdev=97.55 lat (msec): min=42, max=1046, avg=178.88, stdev=97.55 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 78], 10.00th=[ 91], 20.00th=[ 110], | 30.00th=[ 127], 40.00th=[ 142], 50.00th=[ 157], 60.00th=[ 171], | 70.00th=[ 199], 80.00th=[ 230], 90.00th=[ 292], 95.00th=[ 372], | 99.00th=[ 550], 99.50th=[ 625], 99.90th=[ 978], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 4, max= 63, per=25.64%, avg=17.95, stdev= 8.47, samples=673 iops : min= 1, max= 15, avg= 3.85, stdev= 2.19, samples=673 lat (msec) : 10=1.17%, 20=8.92%, 50=24.51%, 100=17.61%, 250=39.26% lat (msec) : 500=7.68%, 750=0.65%, 1000=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.04%, ctx=5378, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145193: Tue Sep 22 14:13:19 2026 read: IOPS=4, BW=17.0KiB/s (17.4kB/s)(6028KiB/353852msec) clat (msec): min=5, max=883, avg=49.31, stdev=55.60 lat (msec): min=5, max=883, avg=49.31, stdev=55.60 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 36], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 94], 95.00th=[ 131], | 99.00th=[ 257], 99.50th=[ 338], 99.90th=[ 760], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 5, max= 103, per=30.60%, avg=20.50, stdev=14.06, samples=564 iops : min= 1, max= 25, avg= 4.49, stdev= 3.56, samples=564 write: IOPS=4, BW=17.7KiB/s (18.1kB/s)(6260KiB/353852msec); 0 zone resets clat (msec): min=47, max=1494, avg=178.51, stdev=103.97 lat (msec): min=47, max=1494, avg=178.51, stdev=103.97 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 79], 10.00th=[ 92], 20.00th=[ 109], | 30.00th=[ 124], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 194], 80.00th=[ 224], 90.00th=[ 288], 95.00th=[ 363], | 99.00th=[ 625], 99.50th=[ 684], 99.90th=[ 986], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 4, max= 55, per=25.70%, avg=17.99, stdev= 8.43, samples=663 iops : min= 1, max= 13, avg= 3.86, stdev= 2.16, samples=663 lat (msec) : 10=1.17%, 20=9.11%, 50=24.02%, 100=17.68%, 250=39.71% lat (msec) : 500=7.32%, 750=0.78%, 1000=0.16%, 2000=0.03% cpu : usr=0.04%, sys=1.00%, ctx=5431, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145194: Tue Sep 22 14:13:19 2026 read: IOPS=4, BW=16.0KiB/s (17.4kB/s)(6052KiB/356989msec) clat (msec): min=5, max=573, avg=48.16, stdev=47.38 lat (msec): min=5, max=573, avg=48.16, stdev=47.38 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 30], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 96], 95.00th=[ 136], | 99.00th=[ 245], 99.50th=[ 313], 99.90th=[ 485], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 5, max= 119, per=30.96%, avg=20.74, stdev=14.63, samples=559 iops : min= 1, max= 29, avg= 4.56, stdev= 3.69, samples=559 write: IOPS=4, BW=17.5KiB/s (17.9kB/s)(6236KiB/356989msec); 0 zone resets clat (msec): min=27, max=982, avg=182.11, stdev=102.58 lat (msec): min=27, max=982, avg=182.11, stdev=102.58 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 80], 10.00th=[ 93], 20.00th=[ 112], | 30.00th=[ 125], 40.00th=[ 140], 50.00th=[ 159], 60.00th=[ 178], | 70.00th=[ 199], 80.00th=[ 232], 90.00th=[ 292], 95.00th=[ 355], | 99.00th=[ 592], 99.50th=[ 718], 99.90th=[ 953], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 5, max= 40, per=24.98%, avg=17.49, stdev= 8.06, samples=677 iops : min= 1, max= 10, avg= 3.74, stdev= 2.09, samples=677 lat (msec) : 10=1.43%, 20=9.86%, 50=23.24%, 100=17.38%, 250=39.26% lat (msec) : 500=7.85%, 750=0.75%, 1000=0.23% cpu : usr=0.04%, sys=1.00%, ctx=5468, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=67.3KiB/s (68.9kB/s), 16.7KiB/s-17.0KiB/s (17.1kB/s-17.4kB/s), io=23.4MiB (24.6MB), run=353852-356989msec WRITE: bw=70.4KiB/s (72.1kB/s), 17.5KiB/s-17.8KiB/s (17.9kB/s-18.2kB/s), io=24.6MiB (25.7MB), run=353852-356989msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145261: Tue Sep 22 14:14:12 2026 read: IOPS=9, BW=151KiB/s (154kB/s)(5920KiB/39325msec) clat (usec): min=39, max=654165, avg=54648.76, stdev=53064.90 lat (usec): min=39, max=654165, avg=54651.18, stdev=53063.73 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 66], 20.00th=[ 297], | 30.00th=[ 30802], 40.00th=[ 39584], 50.00th=[ 46924], 60.00th=[ 58983], | 70.00th=[ 68682], 80.00th=[ 85459], 90.00th=[109577], 95.00th=[127402], | 99.00th=[231736], 99.50th=[267387], 99.90th=[650118], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 31, max= 349, per=25.77%, avg=154.37, stdev=72.53, samples=75 iops : min= 1, max= 21, avg= 8.92, stdev= 4.57, samples=75 write: IOPS=10, BW=162KiB/s (166kB/s)(6368KiB/39325msec); 0 zone resets clat (usec): min=1379, max=341802, avg=47402.81, stdev=52488.22 lat (usec): min=1379, max=341805, avg=47409.52, stdev=52488.28 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1729], 10.00th=[ 2073], 20.00th=[ 6915], | 30.00th=[ 10552], 40.00th=[ 15533], 50.00th=[ 26346], 60.00th=[ 44303], | 70.00th=[ 61604], 80.00th=[ 83362], 90.00th=[117965], 95.00th=[152044], | 99.00th=[244319], 99.50th=[312476], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 381, per=26.00%, avg=163.79, stdev=74.22, samples=76 iops : min= 1, max= 23, avg= 9.50, stdev= 4.72, samples=76 lat (usec) : 50=0.91%, 100=7.55%, 250=0.91%, 500=0.26%, 1000=0.13% lat (msec) : 2=5.08%, 4=2.08%, 10=7.81%, 20=8.98%, 50=23.96% lat (msec) : 100=27.99%, 250=13.67%, 500=0.52%, 750=0.13% cpu : usr=0.08%, sys=4.52%, ctx=1463, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145262: Tue Sep 22 14:14:12 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(5744KiB/39984msec) clat (usec): min=41, max=450563, avg=57065.05, stdev=47767.90 lat (usec): min=41, max=450564, avg=57066.42, stdev=47767.97 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 24511], | 30.00th=[ 35914], 40.00th=[ 45876], 50.00th=[ 51643], 60.00th=[ 59507], | 70.00th=[ 70779], 80.00th=[ 84411], 90.00th=[106431], 95.00th=[132645], | 99.00th=[252707], 99.50th=[312476], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 31, max= 312, per=24.28%, avg=145.46, stdev=64.72, samples=76 iops : min= 1, max= 19, avg= 8.36, stdev= 4.14, samples=76 write: IOPS=10, BW=164KiB/s (168kB/s)(6544KiB/39984msec); 0 zone resets clat (usec): min=1484, max=632907, avg=46962.11, stdev=58466.47 lat (usec): min=1486, max=632910, avg=46964.62, stdev=58466.44 clat percentiles (usec): | 1.00th=[ 1598], 5.00th=[ 1778], 10.00th=[ 2573], 20.00th=[ 6521], | 30.00th=[ 10421], 40.00th=[ 16712], 50.00th=[ 30540], 60.00th=[ 41157], | 70.00th=[ 59507], 80.00th=[ 83362], 90.00th=[108528], 95.00th=[139461], | 99.00th=[233833], 99.50th=[316670], 99.90th=[633340], 99.95th=[633340], | 99.99th=[633340] bw ( KiB/s): min= 31, max= 477, per=26.43%, avg=166.53, stdev=81.71, samples=76 iops : min= 1, max= 29, avg= 9.68, stdev= 5.13, samples=76 lat (usec) : 50=0.26%, 100=6.64%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=4.17%, 4=2.34%, 10=8.98%, 20=9.11%, 50=25.00% lat (msec) : 100=30.60%, 250=11.20%, 500=0.91%, 750=0.13% cpu : usr=0.10%, sys=4.59%, ctx=1417, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145263: Tue Sep 22 14:14:12 2026 read: IOPS=10, BW=164KiB/s (168kB/s)(6256KiB/38039msec) clat (usec): min=38, max=396911, avg=53923.21, stdev=44285.44 lat (usec): min=38, max=396912, avg=53924.59, stdev=44285.40 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 61], 10.00th=[ 71], 20.00th=[ 5014], | 30.00th=[ 31851], 40.00th=[ 41681], 50.00th=[ 50594], 60.00th=[ 58459], | 70.00th=[ 67634], 80.00th=[ 83362], 90.00th=[108528], 95.00th=[132645], | 99.00th=[185598], 99.50th=[196084], 99.90th=[396362], 99.95th=[396362], | 99.99th=[396362] bw ( KiB/s): min= 31, max= 330, per=27.52%, avg=164.86, stdev=72.44, samples=74 iops : min= 1, max= 20, avg= 9.58, stdev= 4.60, samples=74 write: IOPS=9, BW=159KiB/s (162kB/s)(6032KiB/38039msec); 0 zone resets clat (usec): min=1419, max=645438, avg=44116.61, stdev=57316.01 lat (usec): min=1421, max=645440, avg=44118.86, stdev=57315.99 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1762], 10.00th=[ 1893], 20.00th=[ 6063], | 30.00th=[ 11338], 40.00th=[ 15401], 50.00th=[ 23725], 60.00th=[ 38011], | 70.00th=[ 51119], 80.00th=[ 72877], 90.00th=[108528], 95.00th=[154141], | 99.00th=[225444], 99.50th=[329253], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 31, max= 358, per=25.16%, avg=158.51, stdev=72.65, samples=73 iops : min= 1, max= 22, avg= 9.18, stdev= 4.60, samples=73 lat (usec) : 50=0.91%, 100=8.20%, 250=0.65%, 500=0.26%, 750=0.13% lat (msec) : 2=5.60%, 4=1.69%, 10=7.16%, 20=9.11%, 50=25.52% lat (msec) : 100=27.73%, 250=12.63%, 500=0.26%, 750=0.13% cpu : usr=0.07%, sys=4.79%, ctx=1459, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145264: Tue Sep 22 14:14:12 2026 read: IOPS=10, BW=161KiB/s (165kB/s)(6032KiB/37388msec) clat (usec): min=40, max=280853, avg=55749.05, stdev=46710.91 lat (usec): min=40, max=280854, avg=55750.84, stdev=46710.75 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 61], 10.00th=[ 72], 20.00th=[ 19792], | 30.00th=[ 33424], 40.00th=[ 40633], 50.00th=[ 48497], 60.00th=[ 58459], | 70.00th=[ 68682], 80.00th=[ 86508], 90.00th=[110625], 95.00th=[133694], | 99.00th=[254804], 99.50th=[278922], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 30, max= 313, per=26.75%, avg=160.25, stdev=62.11, samples=73 iops : min= 1, max= 19, avg= 9.29, stdev= 3.96, samples=73 write: IOPS=10, BW=167KiB/s (171kB/s)(6256KiB/37388msec); 0 zone resets clat (usec): min=1174, max=261440, avg=41545.40, stdev=44069.85 lat (usec): min=1176, max=261441, avg=41569.83, stdev=44072.53 clat percentiles (usec): | 1.00th=[ 1500], 5.00th=[ 1795], 10.00th=[ 2900], 20.00th=[ 7046], | 30.00th=[ 9896], 40.00th=[ 15270], 50.00th=[ 23200], 60.00th=[ 37487], | 70.00th=[ 55837], 80.00th=[ 73925], 90.00th=[101188], 95.00th=[130548], | 99.00th=[191890], 99.50th=[202376], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 62, max= 352, per=26.64%, avg=167.84, stdev=68.16, samples=73 iops : min= 3, max= 22, avg= 9.77, stdev= 4.34, samples=73 lat (usec) : 50=0.78%, 100=6.90%, 250=0.78%, 500=0.13% lat (msec) : 2=3.78%, 4=2.86%, 10=9.38%, 20=8.59%, 50=26.69% lat (msec) : 100=28.26%, 250=11.20%, 500=0.65% cpu : usr=0.07%, sys=4.92%, ctx=1443, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=599KiB/s (613kB/s), 144KiB/s-164KiB/s (147kB/s-168kB/s), io=23.4MiB (24.5MB), run=37388-39984msec WRITE: bw=630KiB/s (645kB/s), 159KiB/s-167KiB/s (162kB/s-171kB/s), io=24.6MiB (25.8MB), run=37388-39984msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145266: Tue Sep 22 14:15:08 2026 read: IOPS=3, BW=62.5KiB/s (63.0kB/s)(5920KiB/94778msec) clat (msec): min=8, max=361, avg=53.50, stdev=50.52 lat (msec): min=8, max=361, avg=53.50, stdev=50.52 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 69], 90.00th=[ 106], 95.00th=[ 171], | 99.00th=[ 262], 99.50th=[ 321], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 30, max= 223, per=30.35%, avg=76.49, stdev=43.65, samples=150 iops : min= 1, max= 13, avg= 3.99, stdev= 2.80, samples=150 write: IOPS=4, BW=67.2KiB/s (68.8kB/s)(6368KiB/94778msec); 0 zone resets clat (msec): min=42, max=890, avg=188.07, stdev=101.07 lat (msec): min=42, max=890, avg=188.07, stdev=101.07 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 89], 10.00th=[ 101], 20.00th=[ 117], | 30.00th=[ 132], 40.00th=[ 148], 50.00th=[ 161], 60.00th=[ 178], | 70.00th=[ 201], 80.00th=[ 239], 90.00th=[ 334], 95.00th=[ 372], | 99.00th=[ 502], 99.50th=[ 810], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 29, max= 159, per=26.28%, avg=69.65, stdev=31.67, samples=178 iops : min= 1, max= 9, avg= 3.55, stdev= 2.05, samples=178 lat (msec) : 10=0.26%, 20=6.90%, 50=24.48%, 100=16.41%, 250=42.19% lat (msec) : 500=9.24%, 750=0.26%, 1000=0.26% cpu : usr=0.04%, sys=1.12%, ctx=1387, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145267: Tue Sep 22 14:15:08 2026 read: IOPS=3, BW=60.6KiB/s (62.1kB/s)(5744KiB/94781msec) clat (msec): min=8, max=293, avg=50.14, stdev=43.22 lat (msec): min=8, max=293, avg=50.14, stdev=43.22 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 30], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 55], 80.00th=[ 67], 90.00th=[ 101], 95.00th=[ 136], | 99.00th=[ 245], 99.50th=[ 288], 99.90th=[ 292], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 22, max= 253, per=32.60%, avg=82.14, stdev=53.41, samples=136 iops : min= 1, max= 15, avg= 4.36, stdev= 3.42, samples=136 write: IOPS=4, BW=69.0KiB/s (70.7kB/s)(6544KiB/94781msec); 0 zone resets clat (msec): min=52, max=803, avg=187.52, stdev=99.22 lat (msec): min=52, max=803, avg=187.53, stdev=99.22 clat percentiles (msec): | 1.00th=[ 65], 5.00th=[ 89], 10.00th=[ 99], 20.00th=[ 113], | 30.00th=[ 131], 40.00th=[ 144], 50.00th=[ 159], 60.00th=[ 180], | 70.00th=[ 201], 80.00th=[ 247], 90.00th=[ 326], 95.00th=[ 401], | 99.00th=[ 518], 99.50th=[ 542], 99.90th=[ 802], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 22, max= 159, per=26.94%, avg=71.38, stdev=30.71, samples=178 iops : min= 1, max= 9, avg= 3.67, stdev= 1.98, samples=178 lat (msec) : 10=0.13%, 20=9.24%, 50=21.35%, 100=17.58%, 250=41.41% lat (msec) : 500=9.38%, 750=0.78%, 1000=0.13% cpu : usr=0.04%, sys=1.04%, ctx=1422, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145268: Tue Sep 22 14:15:08 2026 read: IOPS=4, BW=68.4KiB/s (70.1kB/s)(6256KiB/91405msec) clat (msec): min=8, max=419, avg=53.95, stdev=54.69 lat (msec): min=8, max=419, avg=53.95, stdev=54.69 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 22], | 30.00th=[ 28], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 67], 90.00th=[ 104], 95.00th=[ 174], | 99.00th=[ 288], 99.50th=[ 384], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 29, max= 287, per=32.58%, avg=82.11, stdev=56.40, samples=150 iops : min= 1, max= 17, avg= 4.35, stdev= 3.61, samples=150 write: IOPS=4, BW=65.0KiB/s (67.6kB/s)(6032KiB/91405msec); 0 zone resets clat (msec): min=61, max=732, avg=186.41, stdev=94.54 lat (msec): min=61, max=732, avg=186.42, stdev=94.54 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 88], 10.00th=[ 97], 20.00th=[ 113], | 30.00th=[ 129], 40.00th=[ 148], 50.00th=[ 163], 60.00th=[ 182], | 70.00th=[ 203], 80.00th=[ 239], 90.00th=[ 309], 95.00th=[ 376], | 99.00th=[ 489], 99.50th=[ 667], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 23, max= 157, per=25.62%, avg=67.90, stdev=31.95, samples=174 iops : min= 1, max= 9, avg= 3.45, stdev= 2.03, samples=174 lat (msec) : 10=0.65%, 20=8.33%, 50=24.35%, 100=17.84%, 250=38.93% lat (msec) : 500=9.51%, 750=0.39% cpu : usr=0.04%, sys=1.12%, ctx=1508, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145269: Tue Sep 22 14:15:08 2026 read: IOPS=4, BW=64.4KiB/s (65.9kB/s)(6032KiB/93662msec) clat (msec): min=8, max=377, avg=53.20, stdev=49.19 lat (msec): min=8, max=377, avg=53.20, stdev=49.19 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 26], 40.00th=[ 31], 50.00th=[ 36], 60.00th=[ 46], | 70.00th=[ 56], 80.00th=[ 72], 90.00th=[ 111], 95.00th=[ 161], | 99.00th=[ 247], 99.50th=[ 292], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 255, per=31.95%, avg=80.51, stdev=51.58, samples=146 iops : min= 1, max= 15, avg= 4.25, stdev= 3.24, samples=146 write: IOPS=4, BW=66.8KiB/s (68.4kB/s)(6256KiB/93662msec); 0 zone resets clat (msec): min=55, max=660, avg=187.96, stdev=92.83 lat (msec): min=55, max=660, avg=187.96, stdev=92.83 clat percentiles (msec): | 1.00th=[ 70], 5.00th=[ 88], 10.00th=[ 101], 20.00th=[ 118], | 30.00th=[ 133], 40.00th=[ 146], 50.00th=[ 161], 60.00th=[ 182], | 70.00th=[ 203], 80.00th=[ 255], 90.00th=[ 317], 95.00th=[ 384], | 99.00th=[ 514], 99.50th=[ 542], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 22, max= 158, per=25.92%, avg=68.68, stdev=31.03, samples=178 iops : min= 1, max= 9, avg= 3.49, stdev= 2.01, samples=178 lat (msec) : 10=0.26%, 20=9.77%, 50=20.96%, 100=17.58%, 250=40.62% lat (msec) : 500=10.16%, 750=0.65% cpu : usr=0.03%, sys=1.10%, ctx=1467, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=253KiB/s (259kB/s), 60.6KiB/s-68.4KiB/s (62.1kB/s-70.1kB/s), io=23.4MiB (24.5MB), run=91405-94781msec WRITE: bw=266KiB/s (272kB/s), 65.0KiB/s-69.0KiB/s (67.6kB/s-70.7kB/s), io=24.6MiB (25.8MB), run=91405-94781msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145294: Tue Sep 22 14:15:26 2026 read: IOPS=1, BW=1653KiB/s (1693kB/s)(7168KiB/4336msec) clat (usec): min=483, max=536167, avg=218756.52, stdev=220311.86 lat (usec): min=484, max=536168, avg=218757.72, stdev=220312.02 clat percentiles (usec): | 1.00th=[ 486], 5.00th=[ 486], 10.00th=[ 486], 20.00th=[ 490], | 30.00th=[ 1123], 40.00th=[ 1123], 50.00th=[274727], 60.00th=[304088], | 70.00th=[304088], 80.00th=[408945], 90.00th=[534774], 95.00th=[534774], | 99.00th=[534774], 99.50th=[534774], 99.90th=[534774], 99.95th=[534774], | 99.99th=[534774] bw ( KiB/s): min= 1809, max= 4000, per=63.89%, avg=2375.60, stdev=912.87, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1181KiB/s (1209kB/s)(5120KiB/4336msec); 0 zone resets clat (msec): min=301, max=955, avg=473.75, stdev=275.92 lat (msec): min=301, max=955, avg=473.85, stdev=275.92 clat percentiles (msec): | 1.00th=[ 300], 5.00th=[ 300], 10.00th=[ 300], 20.00th=[ 300], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 451], 80.00th=[ 451], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1809, max= 2031, per=37.79%, avg=1967.50, stdev=106.39, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 500=16.67% lat (msec) : 2=8.33%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=7.87%, ctx=115, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145295: Tue Sep 22 14:15:26 2026 read: IOPS=0, BW=372KiB/s (381kB/s)(2048KiB/5507msec) clat (msec): min=229, max=382, avg=306.10, stdev=108.63 lat (msec): min=229, max=382, avg=306.11, stdev=108.64 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 230], 60.00th=[ 384], | 70.00th=[ 384], 80.00th=[ 384], 90.00th=[ 384], 95.00th=[ 384], | 99.00th=[ 384], 99.50th=[ 384], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 2031, max= 2035, per=54.68%, avg=2033.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1859KiB/s (1904kB/s)(10.0MiB/5507msec); 0 zone resets clat (msec): min=141, max=1090, avg=448.74, stdev=297.74 lat (msec): min=141, max=1090, avg=448.84, stdev=297.74 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 209], | 30.00th=[ 243], 40.00th=[ 284], 50.00th=[ 321], 60.00th=[ 388], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 827], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1965, max= 4063, per=49.68%, avg=2586.29, stdev=987.73, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=33.33%, 500=50.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=7.21%, ctx=156, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145296: Tue Sep 22 14:15:26 2026 read: IOPS=1, BW=1726KiB/s (1768kB/s)(6144KiB/3559msec) clat (usec): min=454, max=381295, avg=90659.01, stdev=155677.94 lat (usec): min=455, max=381297, avg=90660.23, stdev=155678.33 clat percentiles (usec): | 1.00th=[ 453], 5.00th=[ 453], 10.00th=[ 453], 20.00th=[ 545], | 30.00th=[ 545], 40.00th=[ 611], 50.00th=[ 611], 60.00th=[ 2638], | 70.00th=[158335], 80.00th=[158335], 90.00th=[379585], 95.00th=[379585], | 99.00th=[379585], 99.50th=[379585], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 2003, max= 3930, per=85.63%, avg=3183.67, stdev=1034.32, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=1, BW=1726KiB/s (1768kB/s)(6144KiB/3559msec); 0 zone resets clat (msec): min=127, max=1057, avg=457.96, stdev=331.28 lat (msec): min=127, max=1059, avg=458.25, stdev=331.78 clat percentiles (msec): | 1.00th=[ 128], 5.00th=[ 128], 10.00th=[ 128], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 363], 50.00th=[ 363], 60.00th=[ 397], | 70.00th=[ 575], 80.00th=[ 575], 90.00th=[ 1062], 95.00th=[ 1062], | 99.00th=[ 1062], 99.50th=[ 1062], 99.90th=[ 1062], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 1492, max= 3618, per=43.75%, avg=2277.50, stdev=925.64, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 4=8.33%, 250=25.00%, 500=25.00%, 750=8.33%, 2000=8.33% cpu : usr=0.00%, sys=8.40%, ctx=126, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145297: Tue Sep 22 14:15:26 2026 read: IOPS=1, BW=1588KiB/s (1626kB/s)(5120KiB/3224msec) clat (usec): min=575, max=347334, avg=158173.06, stdev=155049.63 lat (usec): min=576, max=347334, avg=158174.39, stdev=155049.15 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[ 578], | 30.00th=[ 586], 40.00th=[ 586], 50.00th=[183501], 60.00th=[183501], | 70.00th=[258999], 80.00th=[258999], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 3930, max= 4000, per=100.00%, avg=3965.00, stdev=49.50, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2223KiB/s (2277kB/s)(7168KiB/3224msec); 0 zone resets clat (msec): min=201, max=626, avg=336.53, stdev=181.11 lat (msec): min=201, max=626, avg=336.68, stdev=181.17 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 205], | 30.00th=[ 226], 40.00th=[ 226], 50.00th=[ 239], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 567], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 2000, max= 4162, per=62.62%, avg=3260.00, stdev=1124.58, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 lat (usec) : 750=16.67% lat (msec) : 250=41.67%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=12.75%, ctx=148, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3719KiB/s (3808kB/s), 372KiB/s-1726KiB/s (381kB/s-1768kB/s), io=20.0MiB (20.0MB), run=3224-5507msec WRITE: bw=5206KiB/s (5331kB/s), 1181KiB/s-2223KiB/s (1209kB/s-2277kB/s), io=28.0MiB (29.4MB), run=3224-5507msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145289: Tue Sep 22 14:15:26 2026 read: IOPS=1, BW=1647KiB/s (1687kB/s)(7168KiB/4351msec) clat (msec): min=130, max=584, avg=296.89, stdev=185.44 lat (msec): min=130, max=584, avg=296.89, stdev=185.44 clat percentiles (msec): | 1.00th=[ 131], 5.00th=[ 131], 10.00th=[ 131], 20.00th=[ 155], | 30.00th=[ 171], 40.00th=[ 171], 50.00th=[ 180], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 502], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2043, max= 4023, per=73.86%, avg=2745.25, stdev=937.20, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1177KiB/s (1205kB/s)(5120KiB/4351msec); 0 zone resets clat (msec): min=272, max=783, avg=440.50, stdev=198.22 lat (msec): min=272, max=783, avg=440.62, stdev=198.19 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2011, max= 4087, per=48.87%, avg=2543.00, stdev=1029.42, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 1000=8.33% cpu : usr=0.05%, sys=3.40%, ctx=73, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145290: Tue Sep 22 14:15:26 2026 read: IOPS=0, BW=372KiB/s (381kB/s)(2048KiB/5509msec) clat (msec): min=137, max=185, avg=161.75, stdev=33.67 lat (msec): min=137, max=185, avg=161.75, stdev=33.67 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 186], | 70.00th=[ 186], 80.00th=[ 186], 90.00th=[ 186], 95.00th=[ 186], | 99.00th=[ 186], 99.50th=[ 186], 99.90th=[ 186], 99.95th=[ 186], | 99.99th=[ 186] bw ( KiB/s): min= 1450, max= 2031, per=46.83%, avg=1740.50, stdev=410.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1859KiB/s (1903kB/s)(10.0MiB/5509msec); 0 zone resets clat (msec): min=303, max=1013, avg=501.24, stdev=238.70 lat (msec): min=303, max=1013, avg=501.40, stdev=238.69 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 326], | 30.00th=[ 330], 40.00th=[ 342], 50.00th=[ 363], 60.00th=[ 414], | 70.00th=[ 523], 80.00th=[ 609], 90.00th=[ 802], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 1450, max= 4087, per=56.63%, avg=2946.83, stdev=1240.64, samples=6 iops : min= 1, max= 3, avg= 2.00, stdev= 1.10, samples=6 lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=2.51%, ctx=71, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145291: Tue Sep 22 14:15:26 2026 read: IOPS=1, BW=1118KiB/s (1145kB/s)(6144KiB/5495msec) clat (msec): min=178, max=633, avg=344.43, stdev=164.41 lat (msec): min=178, max=633, avg=344.43, stdev=164.41 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 192], | 30.00th=[ 192], 40.00th=[ 342], 50.00th=[ 342], 60.00th=[ 359], | 70.00th=[ 359], 80.00th=[ 359], 90.00th=[ 634], 95.00th=[ 634], | 99.00th=[ 634], 99.50th=[ 634], 99.90th=[ 634], 99.95th=[ 634], | 99.99th=[ 634] bw ( KiB/s): min= 2007, max= 2043, per=54.43%, avg=2023.00, stdev=18.33, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1118KiB/s (1145kB/s)(6144KiB/5495msec); 0 zone resets clat (msec): min=243, max=1115, avg=531.03, stdev=311.51 lat (msec): min=243, max=1115, avg=531.15, stdev=311.49 clat percentiles (msec): | 1.00th=[ 245], 5.00th=[ 245], 10.00th=[ 245], 20.00th=[ 321], | 30.00th=[ 321], 40.00th=[ 401], 50.00th=[ 401], 60.00th=[ 550], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1432, max= 2043, per=36.73%, avg=1911.20, stdev=268.28, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=25.00%, 2000=8.33% cpu : usr=0.02%, sys=1.89%, ctx=58, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145292: Tue Sep 22 14:15:26 2026 read: IOPS=0, BW=980KiB/s (1004kB/s)(5120KiB/5222msec) clat (msec): min=203, max=406, avg=289.63, stdev=74.74 lat (msec): min=203, max=406, avg=289.63, stdev=74.74 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 257], 40.00th=[ 257], 50.00th=[ 284], 60.00th=[ 284], | 70.00th=[ 300], 80.00th=[ 300], 90.00th=[ 405], 95.00th=[ 405], | 99.00th=[ 405], 99.50th=[ 405], 99.90th=[ 405], 99.95th=[ 405], | 99.99th=[ 405] bw ( KiB/s): min= 2011, max= 4063, per=72.50%, avg=2695.00, stdev=1184.72, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1373KiB/s (1406kB/s)(7168KiB/5222msec); 0 zone resets clat (msec): min=372, max=906, avg=483.31, stdev=190.96 lat (msec): min=372, max=906, avg=483.41, stdev=190.96 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 380], 50.00th=[ 422], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 485], 90.00th=[ 911], 95.00th=[ 911], | 99.00th=[ 911], 99.50th=[ 911], 99.90th=[ 911], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 2011, max= 4087, per=46.99%, avg=2445.40, stdev=917.79, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=8.33%, 500=83.33%, 1000=8.33% cpu : usr=0.00%, sys=2.97%, ctx=79, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3718KiB/s (3807kB/s), 372KiB/s-1647KiB/s (381kB/s-1687kB/s), io=20.0MiB (20.0MB), run=4351-5509msec WRITE: bw=5205KiB/s (5329kB/s), 1118KiB/s-1859KiB/s (1145kB/s-1903kB/s), io=28.0MiB (29.4MB), run=4351-5509msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145307: Tue Sep 22 14:15:43 2026 read: IOPS=0, BW=3762KiB/s (3853kB/s)(12.0MiB/3266msec) clat (msec): min=820, max=1176, avg=989.04, stdev=178.57 lat (msec): min=820, max=1176, avg=989.05, stdev=178.57 clat percentiles (msec): | 1.00th=[ 818], 5.00th=[ 818], 10.00th=[ 818], 20.00th=[ 818], | 30.00th=[ 818], 40.00th=[ 969], 50.00th=[ 969], 60.00th=[ 969], | 70.00th=[ 1183], 80.00th=[ 1183], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=9.40%, ctx=386, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145309: Tue Sep 22 14:15:43 2026 read: IOPS=0, BW=1096KiB/s (1122kB/s)(4096KiB/3737msec) clat (nsec): min=1159.0M, max=1159.0M, avg=1159973115.00, stdev= 0.00 lat (nsec): min=1159.0M, max=1159.0M, avg=1159975573.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1167], 50.00th=[ 1167], 60.00th=[ 1167], | 70.00th=[ 1167], 80.00th=[ 1167], 90.00th=[ 1167], 95.00th=[ 1167], | 99.00th=[ 1167], 99.50th=[ 1167], 99.90th=[ 1167], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2192KiB/s (2245kB/s)(8192KiB/3737msec); 0 zone resets clat (msec): min=557, max=1819, avg=1188.48, stdev=892.54 lat (msec): min=558, max=1820, avg=1189.49, stdev=893.01 clat percentiles (msec): | 1.00th=[ 558], 5.00th=[ 558], 10.00th=[ 558], 20.00th=[ 558], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 558], 60.00th=[ 1821], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.03%, sys=4.79%, ctx=158, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145310: Tue Sep 22 14:15:43 2026 write: IOPS=0, BW=2859KiB/s (2928kB/s)(12.0MiB/4298msec); 0 zone resets clat (msec): min=386, max=2029, avg=1310.88, stdev=840.68 lat (msec): min=386, max=2029, avg=1311.36, stdev=840.66 clat percentiles (msec): | 1.00th=[ 388], 5.00th=[ 388], 10.00th=[ 388], 20.00th=[ 388], | 30.00th=[ 388], 40.00th=[ 1519], 50.00th=[ 1519], 60.00th=[ 1519], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=3.47%, ctx=63, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145311: Tue Sep 22 14:15:43 2026 write: IOPS=0, BW=3982KiB/s (4077kB/s)(12.0MiB/3086msec); 0 zone resets clat (msec): min=401, max=1535, avg=939.15, stdev=569.12 lat (msec): min=410, max=1541, avg=944.40, stdev=568.15 clat percentiles (msec): | 1.00th=[ 401], 5.00th=[ 401], 10.00th=[ 401], 20.00th=[ 401], | 30.00th=[ 401], 40.00th=[ 877], 50.00th=[ 877], 60.00th=[ 877], | 70.00th=[ 1536], 80.00th=[ 1536], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.96%, ctx=88, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4384KiB/s (4489kB/s), 1096KiB/s-3762KiB/s (1122kB/s-3853kB/s), io=16.0MiB (16.8MB), run=3266-3737msec WRITE: bw=7624KiB/s (7807kB/s), 2192KiB/s-3982KiB/s (2245kB/s-4077kB/s), io=32.0MiB (33.6MB), run=3086-4298msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145304: Tue Sep 22 14:15:43 2026 read: IOPS=0, BW=3317KiB/s (3396kB/s)(12.0MiB/3705msec) clat (msec): min=255, max=1782, avg=1148.41, stdev=795.43 lat (msec): min=255, max=1782, avg=1148.41, stdev=795.43 clat percentiles (msec): | 1.00th=[ 255], 5.00th=[ 255], 10.00th=[ 255], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1787], 80.00th=[ 1787], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 7571, max= 7571, per=100.00%, avg=7571.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.03%, sys=3.83%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145305: Tue Sep 22 14:15:43 2026 read: IOPS=0, BW=949KiB/s (971kB/s)(4096KiB/4318msec) clat (nsec): min=1724.3M, max=1724.3M, avg=1724295711.00, stdev= 0.00 lat (nsec): min=1724.3M, max=1724.3M, avg=1724298975.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1720], 5.00th=[ 1720], 10.00th=[ 1720], 20.00th=[ 1720], | 30.00th=[ 1720], 40.00th=[ 1720], 50.00th=[ 1720], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8015, max= 8015, per=100.00%, avg=8015.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1897KiB/s (1943kB/s)(8192KiB/4318msec); 0 zone resets clat (msec): min=454, max=1727, avg=1090.88, stdev=900.08 lat (msec): min=454, max=1727, avg=1091.23, stdev=899.99 clat percentiles (msec): | 1.00th=[ 456], 5.00th=[ 456], 10.00th=[ 456], 20.00th=[ 456], | 30.00th=[ 456], 40.00th=[ 456], 50.00th=[ 456], 60.00th=[ 1720], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.32%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145306: Tue Sep 22 14:15:43 2026 write: IOPS=1, BW=5200KiB/s (5325kB/s)(12.0MiB/2363msec); 0 zone resets clat (msec): min=419, max=1350, avg=742.56, stdev=526.82 lat (msec): min=422, max=1350, avg=743.81, stdev=525.88 clat percentiles (msec): | 1.00th=[ 422], 5.00th=[ 422], 10.00th=[ 422], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 460], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8078, max= 8126, per=100.00%, avg=8102.00, stdev=33.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.33%, ctx=49, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145308: Tue Sep 22 14:15:43 2026 write: IOPS=1, BW=4844KiB/s (4960kB/s)(12.0MiB/2537msec); 0 zone resets clat (msec): min=432, max=1217, avg=809.10, stdev=393.76 lat (msec): min=432, max=1220, avg=810.40, stdev=394.92 clat percentiles (msec): | 1.00th=[ 435], 5.00th=[ 435], 10.00th=[ 435], 20.00th=[ 435], | 30.00th=[ 435], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 1217], 80.00th=[ 1217], 90.00th=[ 1217], 95.00th=[ 1217], | 99.00th=[ 1217], 99.50th=[ 1217], 99.90th=[ 1217], 99.95th=[ 1217], | 99.99th=[ 1217] bw ( KiB/s): min= 7327, max= 7571, per=98.17%, avg=7449.00, stdev=172.53, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.22%, ctx=56, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3794KiB/s (3885kB/s), 949KiB/s-3317KiB/s (971kB/s-3396kB/s), io=16.0MiB (16.8MB), run=3705-4318msec WRITE: bw=7589KiB/s (7771kB/s), 1897KiB/s-5200KiB/s (1943kB/s-5325kB/s), io=32.0MiB (33.6MB), run=2363-4318msec