== sanity test 398b: DIO and buffer IO race ============== 01:13:50 (1786079630) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.05333 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143697: Fri Aug 7 01:17:45 2026 read: IOPS=7, BW=28.5KiB/s (29.2kB/s)(5992KiB/210384msec) clat (usec): min=31, max=1506.8k, avg=68525.68, stdev=63588.94 lat (usec): min=32, max=1506.8k, avg=68535.44, stdev=63585.48 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 96], | 20.00th=[ 32375], 30.00th=[ 42206], 40.00th=[ 50594], | 50.00th=[ 58983], 60.00th=[ 69731], 70.00th=[ 81265], | 80.00th=[ 101188], 90.00th=[ 130548], 95.00th=[ 154141], | 99.00th=[ 208667], 99.50th=[ 244319], 99.90th=[ 608175], | 99.95th=[1501561], 99.99th=[1501561] bw ( KiB/s): min= 7, max= 94, per=25.87%, avg=28.97, stdev=14.86, samples=398 iops : min= 1, max= 23, avg= 6.56, stdev= 3.75, samples=398 write: IOPS=7, BW=29.9KiB/s (30.6kB/s)(6296KiB/210384msec); 0 zone resets clat (usec): min=1108, max=894726, avg=67861.57, stdev=73081.21 lat (usec): min=1110, max=894727, avg=67868.67, stdev=73079.01 clat percentiles (usec): | 1.00th=[ 1287], 5.00th=[ 1631], 10.00th=[ 3654], 20.00th=[ 7504], | 30.00th=[ 13566], 40.00th=[ 28181], 50.00th=[ 51119], 60.00th=[ 68682], | 70.00th=[ 87557], 80.00th=[117965], 90.00th=[158335], 95.00th=[196084], | 99.00th=[304088], 99.50th=[387974], 99.90th=[599786], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 87, per=26.12%, avg=30.56, stdev=14.62, samples=396 iops : min= 1, max= 21, avg= 6.96, stdev= 3.70, samples=396 lat (usec) : 50=0.59%, 100=4.36%, 250=0.29%, 500=0.13%, 750=0.03% lat (msec) : 2=3.19%, 4=2.67%, 10=6.90%, 20=6.67%, 50=19.86% lat (msec) : 100=31.93%, 250=22.04%, 500=1.11%, 750=0.16%, 1000=0.03% lat (msec) : 2000=0.03% cpu : usr=0.05%, sys=2.92%, ctx=6495, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143700: Fri Aug 7 01:17:45 2026 read: IOPS=6, BW=27.9KiB/s (28.5kB/s)(5940KiB/213083msec) clat (usec): min=33, max=494464, avg=67678.31, stdev=51009.99 lat (usec): min=34, max=494465, avg=67687.88, stdev=51013.70 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 59], 10.00th=[ 88], 20.00th=[ 30802], | 30.00th=[ 42206], 40.00th=[ 51119], 50.00th=[ 59507], 60.00th=[ 69731], | 70.00th=[ 82314], 80.00th=[100140], 90.00th=[129500], 95.00th=[154141], | 99.00th=[229639], 99.50th=[299893], 99.90th=[438305], 99.95th=[492831], | 99.99th=[492831] bw ( KiB/s): min= 5, max= 87, per=25.18%, avg=28.20, stdev=15.02, samples=404 iops : min= 1, max= 21, avg= 6.37, stdev= 3.79, samples=404 write: IOPS=7, BW=29.8KiB/s (30.5kB/s)(6348KiB/213083msec); 0 zone resets clat (usec): min=1214, max=1911.7k, avg=70361.66, stdev=82527.13 lat (usec): min=1215, max=1911.7k, avg=70365.14, stdev=82525.95 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2671], 10.00th=[ 5080], | 20.00th=[ 9503], 30.00th=[ 16319], 40.00th=[ 34866], | 50.00th=[ 53740], 60.00th=[ 72877], 70.00th=[ 92799], | 80.00th=[ 117965], 90.00th=[ 158335], 95.00th=[ 198181], | 99.00th=[ 320865], 99.50th=[ 379585], 99.90th=[ 549454], | 99.95th=[1904215], 99.99th=[1904215] bw ( KiB/s): min= 5, max= 99, per=25.70%, avg=30.07, stdev=15.74, samples=406 iops : min= 1, max= 24, avg= 6.83, stdev= 3.96, samples=406 lat (usec) : 50=0.55%, 100=4.39%, 250=0.26%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=2.08%, 4=2.18%, 10=7.23%, 20=6.77%, 50=20.02% lat (msec) : 100=32.98%, 250=21.84%, 500=1.46%, 750=0.03%, 2000=0.03% cpu : usr=0.04%, sys=3.00%, ctx=6556, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143701: Fri Aug 7 01:17:45 2026 read: IOPS=7, BW=28.1KiB/s (28.8kB/s)(6028KiB/214142msec) clat (usec): min=32, max=456761, avg=67096.32, stdev=48942.56 lat (usec): min=33, max=456762, avg=67104.60, stdev=48949.61 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 58], 10.00th=[ 95], 20.00th=[ 30540], | 30.00th=[ 40633], 40.00th=[ 50070], 50.00th=[ 60031], 60.00th=[ 69731], | 70.00th=[ 82314], 80.00th=[101188], 90.00th=[130548], 95.00th=[154141], | 99.00th=[214959], 99.50th=[238027], 99.90th=[413139], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 7, max= 79, per=25.88%, avg=28.99, stdev=14.89, samples=399 iops : min= 1, max= 19, avg= 6.56, stdev= 3.77, samples=399 write: IOPS=7, BW=29.2KiB/s (29.9kB/s)(6260KiB/214142msec); 0 zone resets clat (usec): min=1145, max=2285.4k, avg=71602.87, stdev=92753.85 lat (usec): min=1145, max=2285.4k, avg=71607.18, stdev=92753.97 clat percentiles (usec): | 1.00th=[ 1319], 5.00th=[ 2147], 10.00th=[ 3982], | 20.00th=[ 8356], 30.00th=[ 15008], 40.00th=[ 31589], | 50.00th=[ 50594], 60.00th=[ 69731], 70.00th=[ 88605], | 80.00th=[ 124257], 90.00th=[ 166724], 95.00th=[ 206570], | 99.00th=[ 308282], 99.50th=[ 392168], 99.90th=[ 843056], | 99.95th=[2298479], 99.99th=[2298479] bw ( KiB/s): min= 7, max= 86, per=25.51%, avg=29.85, stdev=15.31, samples=402 iops : min= 1, max= 21, avg= 6.78, stdev= 3.87, samples=402 lat (usec) : 50=0.49%, 100=4.52%, 250=0.26%, 500=0.07%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=2.70%, 4=2.77%, 10=6.97%, 20=5.89%, 50=21.19% lat (msec) : 100=31.67%, 250=21.81%, 500=1.43%, 750=0.03%, 1000=0.03% lat (msec) : >=2000=0.03% cpu : usr=0.05%, sys=2.93%, ctx=6471, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143704: Fri Aug 7 01:17:45 2026 read: IOPS=7, BW=28.7KiB/s (29.4kB/s)(6052KiB/211069msec) clat (usec): min=32, max=638153, avg=68373.43, stdev=53105.97 lat (usec): min=32, max=638154, avg=68377.34, stdev=53103.51 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 58], 10.00th=[ 73], 20.00th=[ 28705], | 30.00th=[ 40633], 40.00th=[ 50594], 50.00th=[ 61080], 60.00th=[ 71828], | 70.00th=[ 85459], 80.00th=[104334], 90.00th=[130548], 95.00th=[152044], | 99.00th=[217056], 99.50th=[299893], 99.90th=[442500], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 88, per=26.28%, avg=29.44, stdev=15.74, samples=395 iops : min= 1, max= 22, avg= 6.68, stdev= 3.98, samples=395 write: IOPS=7, BW=29.5KiB/s (30.3kB/s)(6236KiB/211069msec); 0 zone resets clat (usec): min=1129, max=1940.5k, avg=68485.24, stdev=83942.57 lat (usec): min=1130, max=1940.5k, avg=68494.50, stdev=83937.48 clat percentiles (usec): | 1.00th=[ 1303], 5.00th=[ 1762], 10.00th=[ 4293], | 20.00th=[ 8717], 30.00th=[ 14615], 40.00th=[ 31065], | 50.00th=[ 50070], 60.00th=[ 67634], 70.00th=[ 88605], | 80.00th=[ 114820], 90.00th=[ 160433], 95.00th=[ 202376], | 99.00th=[ 267387], 99.50th=[ 354419], 99.90th=[ 683672], | 99.95th=[1937769], 99.99th=[1937769] bw ( KiB/s): min= 6, max= 111, per=25.60%, avg=29.96, stdev=15.14, samples=400 iops : min= 1, max= 27, avg= 6.81, stdev= 3.81, samples=400 lat (usec) : 50=0.81%, 100=4.88%, 250=0.16%, 500=0.10%, 750=0.07% lat (usec) : 1000=0.03% lat (msec) : 2=2.93%, 4=2.08%, 10=7.03%, 20=6.93%, 50=19.66% lat (msec) : 100=31.58%, 250=22.46%, 500=1.14%, 750=0.10%, 2000=0.03% cpu : usr=0.05%, sys=2.91%, ctx=6498, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=112KiB/s (115kB/s), 27.9KiB/s-28.7KiB/s (28.5kB/s-29.4kB/s), io=23.4MiB (24.6MB), run=210384-214142msec WRITE: bw=117KiB/s (120kB/s), 29.2KiB/s-29.9KiB/s (29.9kB/s-30.6kB/s), io=24.6MiB (25.7MB), run=210384-214142msec fio: pid=143699, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=143698: Fri Aug 7 01:20:59 2026 read: IOPS=3, BW=14.7KiB/s (15.0kB/s)(5992KiB/408118msec) clat (msec): min=7, max=1622, avg=54.19, stdev=72.19 lat (msec): min=7, max=1622, avg=54.19, stdev=72.19 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 30], 60.00th=[ 37], | 70.00th=[ 50], 80.00th=[ 79], 90.00th=[ 129], 95.00th=[ 180], | 99.00th=[ 275], 99.50th=[ 330], 99.90th=[ 776], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7, max= 87, per=38.38%, avg=19.57, stdev=13.79, samples=586 iops : min= 1, max= 21, avg= 4.28, stdev= 3.50, samples=586 write: IOPS=3, BW=15.4KiB/s (15.8kB/s)(6296KiB/408118msec); 0 zone resets clat (msec): min=46, max=970, avg=207.20, stdev=121.64 lat (msec): min=46, max=970, avg=207.21, stdev=121.64 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 82], 10.00th=[ 94], 20.00th=[ 112], | 30.00th=[ 129], 40.00th=[ 146], 50.00th=[ 171], 60.00th=[ 197], | 70.00th=[ 234], 80.00th=[ 292], 90.00th=[ 388], 95.00th=[ 451], | 99.00th=[ 609], 99.50th=[ 684], 99.90th=[ 902], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 6, max= 40, per=29.89%, avg=15.84, stdev= 8.72, samples=753 iops : min= 1, max= 10, avg= 3.34, stdev= 2.28, samples=753 lat (msec) : 10=0.52%, 20=11.43%, 50=22.40%, 100=13.90%, 250=37.30% lat (msec) : 500=12.92%, 750=1.40%, 1000=0.10%, 2000=0.03% cpu : usr=0.03%, sys=0.87%, ctx=5414, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=143699: Fri Aug 7 01:20:59 2026 read: IOPS=2, BW=10.4KiB/s (10.6kB/s)(2964KiB/285189msec) clat (msec): min=11, max=1971, avg=80.45, stdev=96.41 lat (msec): min=11, max=1971, avg=80.46, stdev=96.41 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 28], | 30.00th=[ 35], 40.00th=[ 43], 50.00th=[ 53], 60.00th=[ 69], | 70.00th=[ 88], 80.00th=[ 129], 90.00th=[ 171], 95.00th=[ 209], | 99.00th=[ 321], 99.50th=[ 422], 99.90th=[ 1972], 99.95th=[ 1972], | 99.99th=[ 1972] bw ( KiB/s): min= 7, max= 72, per=30.56%, avg=15.58, stdev=11.29, samples=360 iops : min= 1, max= 18, avg= 3.25, stdev= 2.91, samples=360 write: IOPS=2, BW=11.2KiB/s (11.4kB/s)(3180KiB/285189msec); 0 zone resets clat (msec): min=67, max=1013, avg=282.78, stdev=137.08 lat (msec): min=67, max=1013, avg=282.78, stdev=137.08 clat percentiles (msec): | 1.00th=[ 88], 5.00th=[ 117], 10.00th=[ 136], 20.00th=[ 163], | 30.00th=[ 188], 40.00th=[ 224], 50.00th=[ 253], 60.00th=[ 292], | 70.00th=[ 342], 80.00th=[ 397], 90.00th=[ 472], 95.00th=[ 527], | 99.00th=[ 709], 99.50th=[ 827], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 32, per=22.45%, avg=11.90, stdev= 5.92, samples=495 iops : min= 1, max= 8, avg= 2.31, stdev= 1.55, samples=495 lat (msec) : 20=4.36%, 50=18.67%, 100=13.01%, 250=36.43%, 500=23.81% lat (msec) : 750=3.25%, 1000=0.26%, 2000=0.13% cpu : usr=0.02%, sys=0.65%, ctx=2460, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=742,795,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143702: Fri Aug 7 01:20:59 2026 read: IOPS=3, BW=14.8KiB/s (15.1kB/s)(6028KiB/408527msec) clat (msec): min=6, max=741, avg=54.21, stdev=59.88 lat (msec): min=6, max=741, avg=54.21, stdev=59.88 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 39], | 70.00th=[ 51], 80.00th=[ 80], 90.00th=[ 132], 95.00th=[ 174], | 99.00th=[ 255], 99.50th=[ 347], 99.90th=[ 592], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 7, max= 86, per=37.15%, avg=18.94, stdev=13.58, samples=607 iops : min= 1, max= 21, avg= 4.12, stdev= 3.46, samples=607 write: IOPS=3, BW=15.3KiB/s (15.7kB/s)(6260KiB/408527msec); 0 zone resets clat (msec): min=41, max=2230, avg=208.33, stdev=136.20 lat (msec): min=41, max=2230, avg=208.34, stdev=136.20 clat percentiles (msec): | 1.00th=[ 62], 5.00th=[ 81], 10.00th=[ 92], 20.00th=[ 111], | 30.00th=[ 127], 40.00th=[ 146], 50.00th=[ 167], 60.00th=[ 194], | 70.00th=[ 228], 80.00th=[ 296], 90.00th=[ 397], 95.00th=[ 472], | 99.00th=[ 634], 99.50th=[ 709], 99.90th=[ 1083], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 6, max= 40, per=30.31%, avg=16.07, stdev= 8.90, samples=738 iops : min= 1, max= 10, avg= 3.40, stdev= 2.32, samples=738 lat (msec) : 10=0.49%, 20=11.78%, 50=21.81%, 100=14.78%, 250=37.43% lat (msec) : 500=11.69%, 750=1.92%, 1000=0.03%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=0.88%, ctx=5414, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143703: Fri Aug 7 01:20:59 2026 read: IOPS=3, BW=14.9KiB/s (15.2kB/s)(6052KiB/407486msec) clat (msec): min=6, max=437, avg=51.14, stdev=55.21 lat (msec): min=6, max=437, avg=51.14, stdev=55.21 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 22], 40.00th=[ 25], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 49], 80.00th=[ 74], 90.00th=[ 116], 95.00th=[ 176], | 99.00th=[ 279], 99.50th=[ 330], 99.90th=[ 397], 99.95th=[ 439], | 99.99th=[ 439] bw ( KiB/s): min= 7, max= 120, per=39.02%, avg=19.90, stdev=14.74, samples=583 iops : min= 1, max= 30, avg= 4.37, stdev= 3.75, samples=583 write: IOPS=3, BW=15.3KiB/s (15.7kB/s)(6236KiB/407486msec); 0 zone resets clat (msec): min=41, max=2049, avg=211.20, stdev=132.12 lat (msec): min=41, max=2049, avg=211.21, stdev=132.12 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 80], 10.00th=[ 93], 20.00th=[ 115], | 30.00th=[ 133], 40.00th=[ 148], 50.00th=[ 171], 60.00th=[ 199], | 70.00th=[ 241], 80.00th=[ 300], 90.00th=[ 393], 95.00th=[ 460], | 99.00th=[ 567], 99.50th=[ 693], 99.90th=[ 1083], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 6, max= 55, per=29.97%, avg=15.88, stdev= 8.72, samples=745 iops : min= 1, max= 13, avg= 3.35, stdev= 2.26, samples=745 lat (msec) : 10=0.52%, 20=12.01%, 50=22.33%, 100=14.39%, 250=36.00% lat (msec) : 500=13.02%, 750=1.60%, 1000=0.07%, 2000=0.03%, >=2000=0.03% cpu : usr=0.03%, sys=0.86%, ctx=5482, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=51.5KiB/s (52.7kB/s), 10.4KiB/s-14.9KiB/s (10.6kB/s-15.2kB/s), io=20.5MiB (21.5MB), run=285189-408527msec WRITE: bw=53.8KiB/s (55.1kB/s), 11.2KiB/s-15.4KiB/s (11.4kB/s-15.8kB/s), io=21.5MiB (22.5MB), run=285189-408527msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143779: Fri Aug 7 01:22:02 2026 read: IOPS=7, BW=124KiB/s (127kB/s)(5920KiB/47592msec) clat (usec): min=33, max=365734, avg=63100.90, stdev=48683.75 lat (usec): min=33, max=365736, avg=63102.16, stdev=48683.84 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 60], 10.00th=[ 68], 20.00th=[ 20317], | 30.00th=[ 42730], 40.00th=[ 52691], 50.00th=[ 59507], 60.00th=[ 68682], | 70.00th=[ 82314], 80.00th=[ 94897], 90.00th=[116917], 95.00th=[131597], | 99.00th=[233833], 99.50th=[337642], 99.90th=[367002], 99.95th=[367002], | 99.99th=[367002] bw ( KiB/s): min= 23, max= 345, per=24.99%, avg=125.72, stdev=63.07, samples=92 iops : min= 1, max= 21, avg= 7.07, stdev= 4.01, samples=92 write: IOPS=8, BW=134KiB/s (137kB/s)(6368KiB/47592msec); 0 zone resets clat (usec): min=1546, max=420845, avg=59578.86, stdev=60469.29 lat (usec): min=1548, max=420848, avg=59584.40, stdev=60473.29 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 3163], 10.00th=[ 6063], 20.00th=[ 11469], | 30.00th=[ 17171], 40.00th=[ 27657], 50.00th=[ 40109], 60.00th=[ 54789], | 70.00th=[ 77071], 80.00th=[101188], 90.00th=[139461], 95.00th=[164627], | 99.00th=[299893], 99.50th=[392168], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 31, max= 318, per=26.74%, avg=141.43, stdev=57.87, samples=88 iops : min= 1, max= 19, avg= 8.06, stdev= 3.71, samples=88 lat (usec) : 50=1.17%, 100=6.51%, 250=0.26%, 500=0.26%, 1000=0.13% lat (msec) : 2=1.30%, 4=2.60%, 10=6.12%, 20=7.94%, 50=19.66% lat (msec) : 100=35.29%, 250=17.71%, 500=1.04% cpu : usr=0.04%, sys=3.15%, ctx=1549, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143781: Fri Aug 7 01:22:02 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(5744KiB/46678msec) clat (usec): min=33, max=453424, avg=72993.60, stdev=56897.90 lat (usec): min=33, max=453424, avg=73002.72, stdev=56892.56 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 67], 10.00th=[ 281], 20.00th=[ 35914], | 30.00th=[ 45351], 40.00th=[ 56886], 50.00th=[ 64750], 60.00th=[ 74974], | 70.00th=[ 86508], 80.00th=[105382], 90.00th=[135267], 95.00th=[164627], | 99.00th=[341836], 99.50th=[346031], 99.90th=[455082], 99.95th=[455082], | 99.99th=[455082] bw ( KiB/s): min= 30, max= 224, per=24.64%, avg=123.94, stdev=50.30, samples=90 iops : min= 1, max= 14, avg= 6.94, stdev= 3.20, samples=90 write: IOPS=8, BW=140KiB/s (144kB/s)(6544KiB/46678msec); 0 zone resets clat (usec): min=1666, max=345224, avg=49741.47, stdev=52575.53 lat (usec): min=1668, max=345226, avg=49820.69, stdev=52610.48 clat percentiles (usec): | 1.00th=[ 1876], 5.00th=[ 3228], 10.00th=[ 4752], 20.00th=[ 7504], | 30.00th=[ 11731], 40.00th=[ 20055], 50.00th=[ 30540], 60.00th=[ 46400], | 70.00th=[ 63701], 80.00th=[ 88605], 90.00th=[117965], 95.00th=[147850], | 99.00th=[219153], 99.50th=[248513], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 29, max= 377, per=26.69%, avg=141.21, stdev=81.44, samples=90 iops : min= 1, max= 23, avg= 8.03, stdev= 5.16, samples=90 lat (usec) : 50=0.65%, 100=3.65%, 250=0.26%, 500=0.52%, 750=0.13% lat (msec) : 2=1.69%, 4=3.12%, 10=10.03%, 20=7.16%, 50=22.01% lat (msec) : 100=32.81%, 250=17.06%, 500=0.91% cpu : usr=0.04%, sys=3.13%, ctx=1562, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143783: Fri Aug 7 01:22:02 2026 read: IOPS=8, BW=135KiB/s (139kB/s)(6256KiB/46247msec) clat (usec): min=30, max=348793, avg=64024.39, stdev=51708.76 lat (usec): min=31, max=348794, avg=64033.07, stdev=51706.63 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 61], 10.00th=[ 65], 20.00th=[ 1696], | 30.00th=[ 40109], 40.00th=[ 50594], 50.00th=[ 61604], 60.00th=[ 71828], | 70.00th=[ 81265], 80.00th=[ 94897], 90.00th=[125305], 95.00th=[154141], | 99.00th=[254804], 99.50th=[287310], 99.90th=[350225], 99.95th=[350225], | 99.99th=[350225] bw ( KiB/s): min= 30, max= 448, per=27.98%, avg=140.75, stdev=74.05, samples=87 iops : min= 1, max= 28, avg= 8.01, stdev= 4.70, samples=87 write: IOPS=8, BW=130KiB/s (134kB/s)(6032KiB/46247msec); 0 zone resets clat (usec): min=1656, max=451475, avg=55221.77, stdev=62227.70 lat (usec): min=1658, max=451478, avg=55240.89, stdev=62241.41 clat percentiles (usec): | 1.00th=[ 1811], 5.00th=[ 2966], 10.00th=[ 5997], 20.00th=[ 8979], | 30.00th=[ 13304], 40.00th=[ 21103], 50.00th=[ 33424], 60.00th=[ 49546], | 70.00th=[ 65274], 80.00th=[ 92799], 90.00th=[135267], 95.00th=[170918], | 99.00th=[333448], 99.50th=[341836], 99.90th=[450888], 99.95th=[450888], | 99.99th=[450888] bw ( KiB/s): min= 31, max= 298, per=24.69%, avg=130.58, stdev=65.80, samples=89 iops : min= 1, max= 18, avg= 7.36, stdev= 4.19, samples=89 lat (usec) : 50=1.04%, 100=8.46%, 250=0.39%, 500=0.13%, 750=0.13% lat (msec) : 2=0.78%, 4=2.21%, 10=7.55%, 20=9.24%, 50=19.92% lat (msec) : 100=32.68%, 250=16.15%, 500=1.30% cpu : usr=0.04%, sys=3.17%, ctx=1547, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143784: Fri Aug 7 01:22:02 2026 read: IOPS=8, BW=132KiB/s (135kB/s)(6032KiB/45626msec) clat (usec): min=31, max=378777, avg=64763.92, stdev=54335.96 lat (usec): min=31, max=378778, avg=64767.80, stdev=54336.73 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 60], 10.00th=[ 67], 20.00th=[ 16450], | 30.00th=[ 39584], 40.00th=[ 48497], 50.00th=[ 59507], 60.00th=[ 69731], | 70.00th=[ 81265], 80.00th=[ 98042], 90.00th=[125305], 95.00th=[152044], | 99.00th=[274727], 99.50th=[354419], 99.90th=[379585], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 31, max= 415, per=27.42%, avg=137.92, stdev=65.31, samples=85 iops : min= 1, max= 25, avg= 7.82, stdev= 4.13, samples=85 write: IOPS=8, BW=137KiB/s (140kB/s)(6256KiB/45626msec); 0 zone resets clat (usec): min=1499, max=359777, avg=52100.78, stdev=56621.31 lat (usec): min=1500, max=359779, avg=52109.73, stdev=56617.30 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 3392], 10.00th=[ 4883], 20.00th=[ 8356], | 30.00th=[ 13173], 40.00th=[ 18744], 50.00th=[ 30278], 60.00th=[ 47449], | 70.00th=[ 64750], 80.00th=[ 90702], 90.00th=[129500], 95.00th=[166724], | 99.00th=[248513], 99.50th=[325059], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 31, max= 341, per=26.60%, avg=140.71, stdev=69.02, samples=87 iops : min= 1, max= 21, avg= 8.01, stdev= 4.41, samples=87 lat (usec) : 50=1.04%, 100=7.29%, 250=0.39%, 750=0.13% lat (msec) : 2=1.43%, 4=2.34%, 10=9.38%, 20=9.38%, 50=20.05% lat (msec) : 100=30.34%, 250=17.32%, 500=0.91% cpu : usr=0.04%, sys=3.34%, ctx=1541, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=503KiB/s (515kB/s), 123KiB/s-135KiB/s (126kB/s-139kB/s), io=23.4MiB (24.5MB), run=45626-47592msec WRITE: bw=530KiB/s (542kB/s), 130KiB/s-140KiB/s (134kB/s-144kB/s), io=24.6MiB (25.8MB), run=45626-47592msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143780: Fri Aug 7 01:23:00 2026 read: IOPS=3, BW=55.9KiB/s (57.2kB/s)(5920KiB/105926msec) clat (msec): min=11, max=489, avg=65.53, stdev=67.36 lat (msec): min=11, max=489, avg=65.54, stdev=67.37 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 21], 20.00th=[ 27], | 30.00th=[ 32], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 67], 80.00th=[ 81], 90.00th=[ 142], 95.00th=[ 201], | 99.00th=[ 380], 99.50th=[ 435], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 28, max= 221, per=31.94%, avg=72.18, stdev=44.10, samples=158 iops : min= 1, max= 13, avg= 3.78, stdev= 2.83, samples=158 write: IOPS=3, BW=60.1KiB/s (61.6kB/s)(6368KiB/105926msec); 0 zone resets clat (msec): min=46, max=755, avg=203.60, stdev=94.82 lat (msec): min=46, max=755, avg=203.60, stdev=94.82 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 89], 10.00th=[ 106], 20.00th=[ 134], | 30.00th=[ 148], 40.00th=[ 167], 50.00th=[ 184], 60.00th=[ 201], | 70.00th=[ 228], 80.00th=[ 266], 90.00th=[ 317], 95.00th=[ 393], | 99.00th=[ 584], 99.50th=[ 609], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 28, max= 159, per=26.66%, avg=63.18, stdev=27.17, samples=195 iops : min= 1, max= 9, avg= 3.20, stdev= 1.80, samples=195 lat (msec) : 20=4.69%, 50=22.79%, 100=17.32%, 250=41.28%, 500=13.41% lat (msec) : 750=0.39%, 1000=0.13% cpu : usr=0.03%, sys=0.90%, ctx=1391, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143782: Fri Aug 7 01:23:00 2026 read: IOPS=3, BW=54.5KiB/s (55.8kB/s)(5744KiB/105450msec) clat (msec): min=9, max=455, avg=59.16, stdev=54.60 lat (msec): min=9, max=455, avg=59.16, stdev=54.60 clat percentiles (msec): | 1.00th=[ 13], 5.00th=[ 16], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 29], 40.00th=[ 35], 50.00th=[ 43], 60.00th=[ 50], | 70.00th=[ 64], 80.00th=[ 79], 90.00th=[ 120], 95.00th=[ 161], | 99.00th=[ 305], 99.50th=[ 317], 99.90th=[ 456], 99.95th=[ 456], | 99.99th=[ 456] bw ( KiB/s): min= 25, max= 316, per=32.97%, avg=74.52, stdev=51.51, samples=150 iops : min= 1, max= 19, avg= 3.93, stdev= 3.27, samples=150 write: IOPS=3, BW=62.1KiB/s (63.5kB/s)(6544KiB/105450msec); 0 zone resets clat (msec): min=64, max=689, avg=204.66, stdev=106.93 lat (msec): min=64, max=689, avg=204.67, stdev=106.93 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 85], 10.00th=[ 99], 20.00th=[ 125], | 30.00th=[ 144], 40.00th=[ 161], 50.00th=[ 178], 60.00th=[ 199], | 70.00th=[ 228], 80.00th=[ 264], 90.00th=[ 347], 95.00th=[ 430], | 99.00th=[ 600], 99.50th=[ 625], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 29, max= 159, per=27.49%, avg=65.15, stdev=29.80, samples=196 iops : min= 1, max= 9, avg= 3.32, stdev= 1.96, samples=196 lat (msec) : 10=0.13%, 20=5.60%, 50=22.40%, 100=18.23%, 250=40.23% lat (msec) : 500=12.24%, 750=1.17% cpu : usr=0.03%, sys=0.95%, ctx=1432, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143785: Fri Aug 7 01:23:00 2026 read: IOPS=3, BW=60.5KiB/s (61.0kB/s)(6256KiB/103390msec) clat (msec): min=8, max=458, avg=59.78, stdev=61.89 lat (msec): min=8, max=458, avg=59.79, stdev=61.89 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 26], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 41], 60.00th=[ 48], | 70.00th=[ 55], 80.00th=[ 68], 90.00th=[ 128], 95.00th=[ 186], | 99.00th=[ 359], 99.50th=[ 393], 99.90th=[ 460], 99.95th=[ 460], | 99.99th=[ 460] bw ( KiB/s): min= 28, max= 288, per=34.05%, avg=76.96, stdev=49.82, samples=160 iops : min= 1, max= 18, avg= 4.09, stdev= 3.23, samples=160 write: IOPS=3, BW=58.3KiB/s (59.7kB/s)(6032KiB/103390msec); 0 zone resets clat (msec): min=56, max=621, avg=211.76, stdev=104.15 lat (msec): min=56, max=621, avg=211.78, stdev=104.15 clat percentiles (msec): | 1.00th=[ 64], 5.00th=[ 90], 10.00th=[ 108], 20.00th=[ 131], | 30.00th=[ 150], 40.00th=[ 167], 50.00th=[ 190], 60.00th=[ 205], | 70.00th=[ 234], 80.00th=[ 275], 90.00th=[ 363], 95.00th=[ 426], | 99.00th=[ 575], 99.50th=[ 592], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 29, max= 158, per=26.05%, avg=61.74, stdev=29.91, samples=190 iops : min= 1, max= 9, avg= 3.10, stdev= 1.95, samples=190 lat (msec) : 10=0.26%, 20=4.56%, 50=27.34%, 100=16.28%, 250=37.37% lat (msec) : 500=13.02%, 750=1.17% cpu : usr=0.03%, sys=1.03%, ctx=1417, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143786: Fri Aug 7 01:23:00 2026 read: IOPS=3, BW=57.4KiB/s (58.8kB/s)(6032KiB/105008msec) clat (msec): min=10, max=468, avg=64.02, stdev=63.00 lat (msec): min=10, max=468, avg=64.03, stdev=63.01 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 26], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 43], 60.00th=[ 53], | 70.00th=[ 61], 80.00th=[ 83], 90.00th=[ 146], 95.00th=[ 205], | 99.00th=[ 309], 99.50th=[ 376], 99.90th=[ 468], 99.95th=[ 468], | 99.99th=[ 468] bw ( KiB/s): min= 28, max= 223, per=32.46%, avg=73.37, stdev=45.74, samples=160 iops : min= 1, max= 13, avg= 3.85, stdev= 2.87, samples=160 write: IOPS=3, BW=59.6KiB/s (61.0kB/s)(6256KiB/105008msec); 0 zone resets clat (msec): min=43, max=677, avg=205.49, stdev=100.71 lat (msec): min=43, max=677, avg=205.49, stdev=100.71 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 85], 10.00th=[ 107], 20.00th=[ 127], | 30.00th=[ 144], 40.00th=[ 163], 50.00th=[ 184], 60.00th=[ 205], | 70.00th=[ 228], 80.00th=[ 271], 90.00th=[ 338], 95.00th=[ 422], | 99.00th=[ 584], 99.50th=[ 617], 99.90th=[ 676], 99.95th=[ 676], | 99.99th=[ 676] bw ( KiB/s): min= 29, max= 159, per=26.73%, avg=63.34, stdev=29.51, samples=194 iops : min= 1, max= 9, avg= 3.21, stdev= 1.91, samples=194 lat (msec) : 20=5.86%, 50=22.92%, 100=16.15%, 250=41.15%, 500=13.02% lat (msec) : 750=0.91% cpu : usr=0.02%, sys=0.96%, ctx=1439, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=226KiB/s (232kB/s), 54.5KiB/s-60.5KiB/s (55.8kB/s-61.0kB/s), io=23.4MiB (24.5MB), run=103390-105926msec WRITE: bw=238KiB/s (244kB/s), 58.3KiB/s-62.1KiB/s (59.7kB/s-63.5kB/s), io=24.6MiB (25.8MB), run=103390-105926msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143818: Fri Aug 7 01:23:20 2026 read: IOPS=1, BW=1360KiB/s (1393kB/s)(7168KiB/5271msec) clat (msec): min=10, max=526, avg=350.48, stdev=171.93 lat (msec): min=10, max=526, avg=350.48, stdev=171.93 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 11], 10.00th=[ 11], 20.00th=[ 275], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 409], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 460], 90.00th=[ 527], 95.00th=[ 527], | 99.00th=[ 527], 99.50th=[ 527], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 1363, max= 2048, per=60.11%, avg=1825.50, stdev=254.17, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=971KiB/s (995kB/s)(5120KiB/5271msec); 0 zone resets clat (msec): min=311, max=689, avg=502.85, stdev=145.53 lat (msec): min=311, max=689, avg=502.95, stdev=145.55 clat percentiles (msec): | 1.00th=[ 313], 5.00th=[ 313], 10.00th=[ 313], 20.00th=[ 313], | 30.00th=[ 443], 40.00th=[ 443], 50.00th=[ 472], 60.00th=[ 472], | 70.00th=[ 600], 80.00th=[ 600], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 1906, max= 1950, per=45.22%, avg=1922.75, stdev=19.17, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 20=8.33%, 500=66.67%, 750=25.00% cpu : usr=0.00%, sys=7.65%, ctx=230, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143820: Fri Aug 7 01:23:20 2026 read: IOPS=0, BW=304KiB/s (311kB/s)(2048KiB/6743msec) clat (msec): min=372, max=510, avg=441.14, stdev=97.59 lat (msec): min=372, max=510, avg=441.14, stdev=97.59 clat percentiles (msec): | 1.00th=[ 372], 5.00th=[ 372], 10.00th=[ 372], 20.00th=[ 372], | 30.00th=[ 372], 40.00th=[ 372], 50.00th=[ 372], 60.00th=[ 510], | 70.00th=[ 510], 80.00th=[ 510], 90.00th=[ 510], 95.00th=[ 510], | 99.00th=[ 510], 99.50th=[ 510], 99.90th=[ 510], 99.95th=[ 510], | 99.99th=[ 510] bw ( KiB/s): min= 1899, max= 1903, per=62.59%, avg=1901.00, stdev= 2.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1519KiB/s (1555kB/s)(10.0MiB/6743msec); 0 zone resets clat (msec): min=175, max=1408, avg=570.05, stdev=368.36 lat (msec): min=176, max=1408, avg=570.80, stdev=368.87 clat percentiles (msec): | 1.00th=[ 176], 5.00th=[ 176], 10.00th=[ 176], 20.00th=[ 228], | 30.00th=[ 376], 40.00th=[ 384], 50.00th=[ 397], 60.00th=[ 498], | 70.00th=[ 642], 80.00th=[ 676], 90.00th=[ 919], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 1903, max= 4071, per=59.98%, avg=2550.29, stdev=985.38, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=6.30%, ctx=185, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143822: Fri Aug 7 01:23:20 2026 read: IOPS=0, BW=994KiB/s (1018kB/s)(6144KiB/6181msec) clat (usec): min=518, max=474417, avg=245631.74, stdev=220814.16 lat (usec): min=519, max=474419, avg=245633.00, stdev=220814.02 clat percentiles (usec): | 1.00th=[ 519], 5.00th=[ 519], 10.00th=[ 519], 20.00th=[ 578], | 30.00th=[ 578], 40.00th=[160433], 50.00th=[160433], 60.00th=[371196], | 70.00th=[463471], 80.00th=[463471], 90.00th=[476054], 95.00th=[476054], | 99.00th=[476054], 99.50th=[476054], 99.90th=[476054], 99.95th=[476054], | 99.99th=[476054] bw ( KiB/s): min= 1896, max= 4071, per=81.40%, avg=2472.25, stdev=1067.32, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=0, BW=994KiB/s (1018kB/s)(6144KiB/6181msec); 0 zone resets clat (msec): min=238, max=1609, avg=700.78, stdev=501.69 lat (msec): min=238, max=1612, avg=701.18, stdev=502.44 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 284], | 30.00th=[ 284], 40.00th=[ 527], 50.00th=[ 527], 60.00th=[ 751], | 70.00th=[ 802], 80.00th=[ 802], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1718, max= 4039, per=54.54%, avg=2319.00, stdev=968.39, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 750=16.67% lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.03%, sys=5.87%, ctx=220, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143823: Fri Aug 7 01:23:20 2026 read: IOPS=0, BW=787KiB/s (806kB/s)(5120KiB/6508msec) clat (usec): min=393, max=437125, avg=88209.38, stdev=195051.75 lat (usec): min=393, max=437126, avg=88210.35, stdev=195052.10 clat percentiles (usec): | 1.00th=[ 392], 5.00th=[ 392], 10.00th=[ 392], 20.00th=[ 392], | 30.00th=[ 441], 40.00th=[ 441], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 2409], 80.00th=[ 2409], 90.00th=[438305], 95.00th=[438305], | 99.00th=[438305], 99.50th=[438305], 99.90th=[438305], 99.95th=[438305], | 99.99th=[438305] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1101KiB/s (1128kB/s)(7168KiB/6508msec); 0 zone resets clat (msec): min=224, max=1525, avg=744.82, stdev=471.83 lat (msec): min=224, max=1525, avg=745.66, stdev=472.34 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 296], | 30.00th=[ 477], 40.00th=[ 477], 50.00th=[ 642], 60.00th=[ 936], | 70.00th=[ 936], 80.00th=[ 1116], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1718, max= 3930, per=54.89%, avg=2333.80, stdev=901.89, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (usec) : 500=16.67%, 750=8.33% lat (msec) : 4=8.33%, 250=8.33%, 500=25.00%, 750=8.33%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.00%, sys=4.10%, ctx=122, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3037KiB/s (3110kB/s), 304KiB/s-1360KiB/s (311kB/s-1393kB/s), io=20.0MiB (20.0MB), run=5271-6743msec WRITE: bw=4252KiB/s (4354kB/s), 971KiB/s-1519KiB/s (995kB/s-1555kB/s), io=28.0MiB (29.4MB), run=5271-6743msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143816: Fri Aug 7 01:23:21 2026 read: IOPS=1, BW=1068KiB/s (1093kB/s)(7168KiB/6713msec) clat (msec): min=82, max=665, avg=320.13, stdev=195.67 lat (msec): min=82, max=665, avg=320.13, stdev=195.67 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 129], | 30.00th=[ 234], 40.00th=[ 234], 50.00th=[ 372], 60.00th=[ 380], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 667], 95.00th=[ 667], | 99.00th=[ 667], 99.50th=[ 667], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 1809, max= 2035, per=80.01%, avg=1958.67, stdev=92.45, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 write: IOPS=0, BW=763KiB/s (781kB/s)(5120KiB/6713msec); 0 zone resets clat (msec): min=487, max=995, avg=763.19, stdev=189.12 lat (msec): min=487, max=995, avg=763.29, stdev=189.12 clat percentiles (msec): | 1.00th=[ 489], 5.00th=[ 489], 10.00th=[ 489], 20.00th=[ 489], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 776], 60.00th=[ 776], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 995], 95.00th=[ 995], | 99.00th=[ 995], 99.50th=[ 995], 99.90th=[ 995], 99.95th=[ 995], | 99.99th=[ 995] bw ( KiB/s): min= 1809, max= 2019, per=55.86%, avg=1914.75, stdev=120.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=8.33%, 250=16.67%, 500=33.33%, 750=16.67%, 1000=25.00% cpu : usr=0.00%, sys=1.55%, ctx=80, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143817: Fri Aug 7 01:23:21 2026 read: IOPS=0, BW=245KiB/s (251kB/s)(2048KiB/8363msec) clat (msec): min=72, max=407, avg=240.02, stdev=236.30 lat (msec): min=72, max=407, avg=240.02, stdev=236.30 clat percentiles (msec): | 1.00th=[ 73], 5.00th=[ 73], 10.00th=[ 73], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 73], 50.00th=[ 73], 60.00th=[ 409], | 70.00th=[ 409], 80.00th=[ 409], 90.00th=[ 409], 95.00th=[ 409], | 99.00th=[ 409], 99.50th=[ 409], 99.90th=[ 409], 99.95th=[ 409], | 99.99th=[ 409] bw ( KiB/s): min= 2027, max= 2035, per=82.97%, avg=2031.00, stdev= 5.66, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1224KiB/s (1254kB/s)(10.0MiB/8363msec); 0 zone resets clat (msec): min=149, max=2248, avg=731.20, stdev=794.49 lat (msec): min=149, max=2249, avg=731.36, stdev=794.64 clat percentiles (msec): | 1.00th=[ 150], 5.00th=[ 150], 10.00th=[ 150], 20.00th=[ 190], | 30.00th=[ 215], 40.00th=[ 253], 50.00th=[ 326], 60.00th=[ 347], | 70.00th=[ 388], 80.00th=[ 1200], 90.00th=[ 1989], 95.00th=[ 2265], | 99.00th=[ 2265], 99.50th=[ 2265], 99.90th=[ 2265], 99.95th=[ 2265], | 99.99th=[ 2265] bw ( KiB/s): min= 1809, max= 4071, per=80.93%, avg=2774.40, stdev=1130.82, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 2000=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=2.76%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143819: Fri Aug 7 01:23:21 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(6144KiB/8149msec) clat (msec): min=97, max=1465, avg=680.93, stdev=568.84 lat (msec): min=97, max=1465, avg=680.93, stdev=568.84 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 157], | 30.00th=[ 157], 40.00th=[ 460], 50.00th=[ 460], 60.00th=[ 651], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 1809, max= 2035, per=78.48%, avg=1921.20, stdev=98.75, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=0, BW=754KiB/s (772kB/s)(6144KiB/8149msec); 0 zone resets clat (msec): min=391, max=1186, avg=666.31, stdev=331.05 lat (msec): min=391, max=1186, avg=666.43, stdev=331.08 clat percentiles (msec): | 1.00th=[ 393], 5.00th=[ 393], 10.00th=[ 393], 20.00th=[ 426], | 30.00th=[ 426], 40.00th=[ 451], 50.00th=[ 451], 60.00th=[ 575], | 70.00th=[ 969], 80.00th=[ 969], 90.00th=[ 1183], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1462, max= 2031, per=54.71%, avg=1875.60, stdev=238.60, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=8.33%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=25.00% cpu : usr=0.00%, sys=1.34%, ctx=57, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143821: Fri Aug 7 01:23:21 2026 read: IOPS=0, BW=648KiB/s (663kB/s)(5120KiB/7904msec) clat (msec): min=100, max=739, avg=331.94, stdev=244.61 lat (msec): min=100, max=739, avg=331.94, stdev=244.61 clat percentiles (msec): | 1.00th=[ 102], 5.00th=[ 102], 10.00th=[ 102], 20.00th=[ 102], | 30.00th=[ 220], 40.00th=[ 220], 50.00th=[ 251], 60.00th=[ 251], | 70.00th=[ 351], 80.00th=[ 351], 90.00th=[ 743], 95.00th=[ 743], | 99.00th=[ 743], 99.50th=[ 743], 99.90th=[ 743], 99.95th=[ 743], | 99.99th=[ 743] bw ( KiB/s): min= 1831, max= 2019, per=79.74%, avg=1952.00, stdev=89.05, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 write: IOPS=0, BW=907KiB/s (929kB/s)(7168KiB/7904msec); 0 zone resets clat (msec): min=266, max=1243, avg=836.74, stdev=430.01 lat (msec): min=266, max=1243, avg=836.86, stdev=429.98 clat percentiles (msec): | 1.00th=[ 268], 5.00th=[ 268], 10.00th=[ 268], 20.00th=[ 342], | 30.00th=[ 558], 40.00th=[ 558], 50.00th=[ 1070], 60.00th=[ 1183], | 70.00th=[ 1183], 80.00th=[ 1200], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 1809, max= 2027, per=55.73%, avg=1910.40, stdev=107.24, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=16.67%, 500=33.33%, 750=16.67%, 2000=33.33% cpu : usr=0.00%, sys=1.76%, ctx=81, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2449KiB/s (2508kB/s), 245KiB/s-1068KiB/s (251kB/s-1093kB/s), io=20.0MiB (20.0MB), run=6713-8363msec WRITE: bw=3428KiB/s (3511kB/s), 754KiB/s-1224KiB/s (772kB/s-1254kB/s), io=28.0MiB (29.4MB), run=6713-8363msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=143830: Fri Aug 7 01:23:41 2026 read: IOPS=0, BW=3605KiB/s (3691kB/s)(12.0MiB/3409msec) clat (msec): min=931, max=1292, avg=1062.42, stdev=200.03 lat (msec): min=931, max=1292, avg=1062.42, stdev=200.03 clat percentiles (msec): | 1.00th=[ 936], 5.00th=[ 936], 10.00th=[ 936], 20.00th=[ 936], | 30.00th=[ 936], 40.00th=[ 961], 50.00th=[ 961], 60.00th=[ 961], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7148, max= 8110, per=100.00%, avg=7629.00, stdev=680.24, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.81%, ctx=161, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143831: Fri Aug 7 01:23:41 2026 read: IOPS=0, BW=650KiB/s (665kB/s)(4096KiB/6304msec) clat (nsec): min=4923.2M, max=4923.2M, avg=4923239163.00, stdev= 0.00 lat (nsec): min=4923.2M, max=4923.2M, avg=4923241424.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4933], 5.00th=[ 4933], 10.00th=[ 4933], 20.00th=[ 4933], | 30.00th=[ 4933], 40.00th=[ 4933], 50.00th=[ 4933], 60.00th=[ 4933], | 70.00th=[ 4933], 80.00th=[ 4933], 90.00th=[ 4933], 95.00th=[ 4933], | 99.00th=[ 4933], 99.50th=[ 4933], 99.90th=[ 4933], 99.95th=[ 4933], | 99.99th=[ 4933] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1299KiB/s (1331kB/s)(8192KiB/6304msec); 0 zone resets clat (msec): min=587, max=702, avg=644.84, stdev=81.65 lat (msec): min=587, max=703, avg=645.43, stdev=81.42 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 584], 50.00th=[ 584], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=4.55%, ctx=428, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143832: Fri Aug 7 01:23:41 2026 write: IOPS=0, BW=2941KiB/s (3012kB/s)(12.0MiB/4178msec); 0 zone resets clat (msec): min=565, max=1881, avg=1337.44, stdev=686.86 lat (msec): min=565, max=1886, avg=1340.94, stdev=689.57 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 1569], 50.00th=[ 1569], 60.00th=[ 1569], | 70.00th=[ 1888], 80.00th=[ 1888], 90.00th=[ 1888], 95.00th=[ 1888], | 99.00th=[ 1888], 99.50th=[ 1888], 99.90th=[ 1888], 99.95th=[ 1888], | 99.99th=[ 1888] bw ( KiB/s): min= 8110, max= 8143, per=100.00%, avg=8126.50, stdev=23.33, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.17%, ctx=89, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143833: Fri Aug 7 01:23:41 2026 write: IOPS=0, BW=1719KiB/s (1760kB/s)(12.0MiB/7149msec); 0 zone resets clat (msec): min=598, max=5606, avg=2341.66, stdev=2829.76 lat (msec): min=600, max=5613, avg=2347.23, stdev=2831.23 clat percentiles (msec): | 1.00th=[ 600], 5.00th=[ 600], 10.00th=[ 600], 20.00th=[ 600], | 30.00th=[ 600], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 5604], 80.00th=[ 5604], 90.00th=[ 5604], 95.00th=[ 5604], | 99.00th=[ 5604], 99.50th=[ 5604], 99.90th=[ 5604], 99.95th=[ 5604], | 99.99th=[ 5604] bw ( KiB/s): min= 7148, max= 8078, per=100.00%, avg=7613.00, stdev=657.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=0.98%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2599KiB/s (2661kB/s), 650KiB/s-3605KiB/s (665kB/s-3691kB/s), io=16.0MiB (16.8MB), run=3409-6304msec WRITE: bw=4584KiB/s (4694kB/s), 1299KiB/s-2941KiB/s (1331kB/s-3012kB/s), io=32.0MiB (33.6MB), run=4178-7149msec rand-rw: (groupid=0, jobs=1): err= 0: pid=143835: Fri Aug 7 01:23:42 2026 read: IOPS=0, BW=1721KiB/s (1762kB/s)(12.0MiB/7141msec) clat (msec): min=240, max=5355, avg=2349.28, stdev=2673.03 lat (msec): min=240, max=5355, avg=2349.28, stdev=2673.03 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 1452], 50.00th=[ 1452], 60.00th=[ 1452], | 70.00th=[ 5336], 80.00th=[ 5336], 90.00th=[ 5336], 95.00th=[ 5336], | 99.00th=[ 5336], 99.50th=[ 5336], 99.90th=[ 5336], 99.95th=[ 5336], | 99.99th=[ 5336] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=0.94%, ctx=53, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143836: Fri Aug 7 01:23:42 2026 read: IOPS=0, BW=613KiB/s (627kB/s)(4096KiB/6687msec) clat (nsec): min=4253.7M, max=4253.7M, avg=4253740437.00, stdev= 0.00 lat (nsec): min=4253.7M, max=4253.7M, avg=4253743499.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 4245], 5.00th=[ 4245], 10.00th=[ 4245], 20.00th=[ 4245], | 30.00th=[ 4245], 40.00th=[ 4245], 50.00th=[ 4245], 60.00th=[ 4245], | 70.00th=[ 4245], 80.00th=[ 4245], 90.00th=[ 4245], 95.00th=[ 4245], | 99.00th=[ 4245], 99.50th=[ 4245], 99.90th=[ 4245], 99.95th=[ 4245], | 99.99th=[ 4245] bw ( KiB/s): min= 7922, max= 7922, per=100.00%, avg=7922.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1225KiB/s (1254kB/s)(8192KiB/6687msec); 0 zone resets clat (msec): min=857, max=1499, avg=1178.64, stdev=454.11 lat (msec): min=858, max=1501, avg=1179.88, stdev=454.53 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 1502], | 70.00th=[ 1502], 80.00th=[ 1502], 90.00th=[ 1502], 95.00th=[ 1502], | 99.00th=[ 1502], 99.50th=[ 1502], 99.90th=[ 1502], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 8143, max= 8143, per=100.00%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.69%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143837: Fri Aug 7 01:23:42 2026 write: IOPS=0, BW=1866KiB/s (1911kB/s)(12.0MiB/6586msec); 0 zone resets clat (msec): min=738, max=4814, avg=2182.14, stdev=2283.33 lat (msec): min=742, max=4815, avg=2184.11, stdev=2282.20 clat percentiles (msec): | 1.00th=[ 743], 5.00th=[ 743], 10.00th=[ 743], 20.00th=[ 743], | 30.00th=[ 743], 40.00th=[ 995], 50.00th=[ 995], 60.00th=[ 995], | 70.00th=[ 4799], 80.00th=[ 4799], 90.00th=[ 4799], 95.00th=[ 4799], | 99.00th=[ 4799], 99.50th=[ 4799], 99.90th=[ 4799], 99.95th=[ 4799], | 99.99th=[ 4799] bw ( KiB/s): min= 8126, max= 8143, per=100.00%, avg=8134.50, stdev=12.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=1.20%, ctx=29, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=143838: Fri Aug 7 01:23:42 2026 write: IOPS=0, BW=1890KiB/s (1936kB/s)(12.0MiB/6500msec); 0 zone resets clat (msec): min=766, max=4460, avg=2159.03, stdev=2007.98 lat (msec): min=766, max=4461, avg=2159.52, stdev=2007.91 clat percentiles (msec): | 1.00th=[ 768], 5.00th=[ 768], 10.00th=[ 768], 20.00th=[ 768], | 30.00th=[ 768], 40.00th=[ 1250], 50.00th=[ 1250], 60.00th=[ 1250], | 70.00th=[ 4463], 80.00th=[ 4463], 90.00th=[ 4463], 95.00th=[ 4463], | 99.00th=[ 4463], 99.50th=[ 4463], 99.90th=[ 4463], 99.95th=[ 4463], | 99.99th=[ 4463] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.06%, sys=1.00%, ctx=40, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2294KiB/s (2349kB/s), 613KiB/s-1721KiB/s (627kB/s-1762kB/s), io=16.0MiB (16.8MB), run=6687-7141msec WRITE: bw=4900KiB/s (5018kB/s), 1225KiB/s-1890KiB/s (1254kB/s-1936kB/s), io=32.0MiB (33.6MB), run=6500-6687msec