== sanity test 398b: DIO and buffer IO race ============== 17:34:20 (1775770460) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.03093 s, 8.3 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes fio: pid=181425, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=181430: Thu Apr 9 17:36:42 2026 read: IOPS=12, BW=49.9KiB/s (51.1kB/s)(5992KiB/119976msec) clat (usec): min=45, max=643447, avg=44727.31, stdev=31428.83 lat (usec): min=46, max=643450, avg=44729.80, stdev=31428.77 clat percentiles (usec): | 1.00th=[ 58], 5.00th=[ 12911], 10.00th=[ 17433], 20.00th=[ 23200], | 30.00th=[ 26870], 40.00th=[ 32900], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 61604], 90.00th=[ 79168], 95.00th=[ 93848], | 99.00th=[147850], 99.50th=[164627], 99.90th=[252707], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 15, max= 104, per=25.34%, avg=49.91, stdev=17.88, samples=235 iops : min= 3, max= 26, avg=11.82, stdev= 4.51, samples=235 write: IOPS=13, BW=52.5KiB/s (53.7kB/s)(6296KiB/119976msec); 0 zone resets clat (usec): min=849, max=302553, avg=33409.33, stdev=35893.70 lat (usec): min=849, max=302554, avg=33413.86, stdev=35893.37 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1319], 10.00th=[ 1483], 20.00th=[ 3621], | 30.00th=[ 7242], 40.00th=[ 14222], 50.00th=[ 23725], 60.00th=[ 31851], | 70.00th=[ 43254], 80.00th=[ 58983], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[166724], 99.50th=[198181], 99.90th=[238027], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 147, per=25.43%, avg=52.38, stdev=23.74, samples=235 iops : min= 1, max= 36, avg=12.44, stdev= 5.97, samples=235 lat (usec) : 50=0.10%, 100=1.04%, 250=0.13%, 500=0.03%, 1000=0.29% lat (msec) : 2=6.28%, 4=4.36%, 10=7.13%, 20=11.20%, 50=39.97% lat (msec) : 100=25.07%, 250=4.30%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=4.88%, ctx=6499, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181431: Thu Apr 9 17:36:42 2026 read: IOPS=12, BW=49.1KiB/s (50.3kB/s)(5940KiB/120869msec) clat (usec): min=38, max=222576, avg=45196.83, stdev=29110.47 lat (usec): min=39, max=222577, avg=45198.65, stdev=29110.06 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11863], 10.00th=[ 17433], 20.00th=[ 22938], | 30.00th=[ 28181], 40.00th=[ 33817], 50.00th=[ 39584], 60.00th=[ 45876], | 70.00th=[ 52691], 80.00th=[ 63177], 90.00th=[ 80217], 95.00th=[100140], | 99.00th=[152044], 99.50th=[181404], 99.90th=[214959], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 103, per=24.81%, avg=48.88, stdev=19.62, samples=236 iops : min= 1, max= 25, avg=11.56, stdev= 4.92, samples=236 write: IOPS=13, BW=52.5KiB/s (53.8kB/s)(6348KiB/120869msec); 0 zone resets clat (usec): min=835, max=644891, avg=33682.02, stdev=38015.77 lat (usec): min=836, max=644892, avg=33684.04, stdev=38015.87 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1352], 10.00th=[ 1500], 20.00th=[ 3752], | 30.00th=[ 7701], 40.00th=[ 16319], 50.00th=[ 23987], 60.00th=[ 31851], | 70.00th=[ 42206], 80.00th=[ 56361], 90.00th=[ 80217], 95.00th=[102237], | 99.00th=[152044], 99.50th=[183501], 99.90th=[312476], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 7, max= 135, per=25.29%, avg=52.11, stdev=21.80, samples=236 iops : min= 1, max= 33, avg=12.38, stdev= 5.51, samples=236 lat (usec) : 50=0.16%, 100=1.33%, 250=0.03%, 500=0.03%, 1000=0.29% lat (msec) : 2=6.61%, 4=3.91%, 10=7.13%, 20=10.38%, 50=41.60% lat (msec) : 100=23.11%, 250=5.34%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=4.93%, ctx=6429, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181432: Thu Apr 9 17:36:42 2026 read: IOPS=12, BW=50.5KiB/s (51.7kB/s)(6028KiB/119288msec) clat (usec): min=32, max=363110, avg=43510.18, stdev=29006.60 lat (usec): min=33, max=363111, avg=43515.90, stdev=29006.03 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 11338], 10.00th=[ 16909], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 44303], | 70.00th=[ 51119], 80.00th=[ 60031], 90.00th=[ 78119], 95.00th=[ 93848], | 99.00th=[147850], 99.50th=[160433], 99.90th=[235930], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 103, per=25.66%, avg=50.55, stdev=18.59, samples=233 iops : min= 1, max= 25, avg=11.98, stdev= 4.68, samples=233 write: IOPS=13, BW=52.5KiB/s (53.7kB/s)(6260KiB/119288msec); 0 zone resets clat (usec): min=833, max=894935, avg=34068.18, stdev=41037.80 lat (usec): min=833, max=894937, avg=34071.08, stdev=41037.13 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1319], 10.00th=[ 1467], 20.00th=[ 3392], | 30.00th=[ 6718], 40.00th=[ 15533], 50.00th=[ 23725], 60.00th=[ 31851], | 70.00th=[ 42730], 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[154141], 99.50th=[177210], 99.90th=[258999], 99.95th=[893387], | 99.99th=[893387] bw ( KiB/s): min= 7, max= 134, per=25.46%, avg=52.45, stdev=23.13, samples=233 iops : min= 1, max= 33, avg=12.46, stdev= 5.85, samples=233 lat (usec) : 50=0.42%, 100=1.63%, 250=0.03%, 1000=0.36% lat (msec) : 2=6.84%, 4=4.10%, 10=6.38%, 20=10.81%, 50=40.79% lat (msec) : 100=23.96%, 250=4.56%, 500=0.10%, 1000=0.03% cpu : usr=0.08%, sys=4.80%, ctx=6377, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181433: Thu Apr 9 17:36:42 2026 read: IOPS=12, BW=49.8KiB/s (50.0kB/s)(6052KiB/121543msec) clat (usec): min=31, max=258333, avg=44958.38, stdev=30943.84 lat (usec): min=31, max=258334, avg=44961.02, stdev=30946.95 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 11994], 10.00th=[ 17433], 20.00th=[ 22676], | 30.00th=[ 27395], 40.00th=[ 32900], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 52167], 80.00th=[ 61080], 90.00th=[ 79168], 95.00th=[ 98042], | 99.00th=[175113], 99.50th=[200279], 99.90th=[235930], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 7, max= 96, per=25.23%, avg=49.69, stdev=18.01, samples=238 iops : min= 1, max= 24, avg=11.77, stdev= 4.53, samples=238 write: IOPS=12, BW=51.3KiB/s (52.5kB/s)(6236KiB/121543msec); 0 zone resets clat (usec): min=792, max=898701, avg=34106.87, stdev=41195.15 lat (usec): min=792, max=898703, avg=34111.08, stdev=41194.31 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1352], 10.00th=[ 1582], 20.00th=[ 3916], | 30.00th=[ 7308], 40.00th=[ 15533], 50.00th=[ 23987], 60.00th=[ 31589], | 70.00th=[ 41681], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[100140], | 99.00th=[145753], 99.50th=[170918], 99.90th=[325059], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 152, per=24.82%, avg=51.13, stdev=23.19, samples=238 iops : min= 1, max= 38, avg=12.14, stdev= 5.87, samples=238 lat (usec) : 50=0.42%, 100=1.56%, 1000=0.23% lat (msec) : 2=6.15%, 4=3.81%, 10=7.39%, 20=10.64%, 50=41.50% lat (msec) : 100=23.44%, 250=4.75%, 500=0.07%, 1000=0.03% cpu : usr=0.09%, sys=4.67%, ctx=6377, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=198KiB/s (202kB/s), 49.1KiB/s-50.5KiB/s (50.3kB/s-51.7kB/s), io=23.4MiB (24.6MB), run=119288-121543msec WRITE: bw=207KiB/s (212kB/s), 51.3KiB/s-52.5KiB/s (52.5kB/s-53.8kB/s), io=24.6MiB (25.7MB), run=119288-121543msec rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=181425: Thu Apr 9 17:37:22 2026 read: IOPS=6, BW=26.0KiB/s (27.6kB/s)(2956KiB/109655msec) clat (msec): min=9, max=661, avg=59.67, stdev=49.24 lat (msec): min=9, max=661, avg=59.67, stdev=49.24 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 28], | 30.00th=[ 33], 40.00th=[ 39], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 67], 80.00th=[ 83], 90.00th=[ 116], 95.00th=[ 146], | 99.00th=[ 232], 99.50th=[ 292], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 7, max= 80, per=21.07%, avg=27.19, stdev=14.76, samples=210 iops : min= 1, max= 20, avg= 6.14, stdev= 3.74, samples=210 write: IOPS=7, BW=28.1KiB/s (28.7kB/s)(3076KiB/109655msec); 0 zone resets clat (msec): min=14, max=383, avg=84.69, stdev=45.60 lat (msec): min=14, max=383, avg=84.70, stdev=45.60 clat percentiles (msec): | 1.00th=[ 25], 5.00th=[ 33], 10.00th=[ 37], 20.00th=[ 47], | 30.00th=[ 56], 40.00th=[ 65], 50.00th=[ 75], 60.00th=[ 87], | 70.00th=[ 101], 80.00th=[ 120], 90.00th=[ 144], 95.00th=[ 167], | 99.00th=[ 243], 99.50th=[ 284], 99.90th=[ 384], 99.95th=[ 384], | 99.99th=[ 384] bw ( KiB/s): min= 7, max= 55, per=20.61%, avg=27.83, stdev=11.07, samples=213 iops : min= 1, max= 13, avg= 6.30, stdev= 2.80, samples=213 lat (msec) : 10=0.13%, 20=4.51%, 50=34.59%, 100=38.57%, 250=21.27% lat (msec) : 500=0.80%, 750=0.07% cpu : usr=0.04%, sys=1.45%, ctx=1955, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=740,769,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181426: Thu Apr 9 17:37:22 2026 read: IOPS=9, BW=36.9KiB/s (37.7kB/s)(5940KiB/161151msec) clat (msec): min=5, max=887, avg=40.69, stdev=42.01 lat (msec): min=5, max=887, avg=40.69, stdev=42.01 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 83], 95.00th=[ 112], | 99.00th=[ 184], 99.50th=[ 209], 99.90th=[ 342], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 159, per=29.01%, avg=37.42, stdev=25.24, samples=309 iops : min= 1, max= 39, avg= 8.71, stdev= 6.35, samples=309 write: IOPS=9, BW=39.4KiB/s (40.3kB/s)(6348KiB/161151msec); 0 zone resets clat (msec): min=7, max=367, avg=63.20, stdev=43.72 lat (msec): min=7, max=367, avg=63.20, stdev=43.72 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 36], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 59], | 70.00th=[ 73], 80.00th=[ 92], 90.00th=[ 122], 95.00th=[ 153], | 99.00th=[ 211], 99.50th=[ 245], 99.90th=[ 363], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 112, per=29.17%, avg=39.39, stdev=22.32, samples=314 iops : min= 1, max= 28, avg= 9.20, stdev= 5.64, samples=314 lat (msec) : 10=1.79%, 20=14.91%, 50=46.61%, 100=24.77%, 250=11.56% lat (msec) : 500=0.33%, 1000=0.03% cpu : usr=0.06%, sys=2.09%, ctx=4967, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181427: Thu Apr 9 17:37:22 2026 read: IOPS=9, BW=37.3KiB/s (38.2kB/s)(6028KiB/161631msec) clat (msec): min=6, max=342, avg=43.03, stdev=39.46 lat (msec): min=6, max=342, avg=43.03, stdev=39.46 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 36], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 94], 95.00th=[ 126], | 99.00th=[ 192], 99.50th=[ 232], 99.90th=[ 292], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 7, max= 110, per=29.04%, avg=37.47, stdev=22.99, samples=313 iops : min= 1, max= 27, avg= 8.72, stdev= 5.78, samples=313 write: IOPS=9, BW=38.7KiB/s (39.7kB/s)(6260KiB/161631msec); 0 zone resets clat (msec): min=10, max=882, avg=61.55, stdev=46.71 lat (msec): min=10, max=882, avg=61.55, stdev=46.71 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 22], 10.00th=[ 25], 20.00th=[ 31], | 30.00th=[ 35], 40.00th=[ 41], 50.00th=[ 47], 60.00th=[ 57], | 70.00th=[ 71], 80.00th=[ 87], 90.00th=[ 120], 95.00th=[ 142], | 99.00th=[ 211], 99.50th=[ 247], 99.90th=[ 384], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 127, per=28.73%, avg=38.79, stdev=23.35, samples=314 iops : min= 1, max= 31, avg= 9.06, stdev= 5.89, samples=314 lat (msec) : 10=2.15%, 20=14.26%, 50=47.17%, 100=24.80%, 250=11.20% lat (msec) : 500=0.39%, 1000=0.03% cpu : usr=0.06%, sys=2.03%, ctx=5043, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181428: Thu Apr 9 17:37:22 2026 read: IOPS=9, BW=37.4KiB/s (38.3kB/s)(6052KiB/161844msec) clat (msec): min=5, max=279, avg=41.36, stdev=37.25 lat (msec): min=5, max=279, avg=41.36, stdev=37.25 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 61], 90.00th=[ 92], 95.00th=[ 122], | 99.00th=[ 184], 99.50th=[ 215], 99.90th=[ 264], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 7, max= 126, per=29.39%, avg=37.92, stdev=24.33, samples=310 iops : min= 1, max= 31, avg= 8.83, stdev= 6.14, samples=310 write: IOPS=9, BW=38.5KiB/s (39.5kB/s)(6236KiB/161844msec); 0 zone resets clat (msec): min=11, max=881, avg=63.40, stdev=48.89 lat (msec): min=11, max=881, avg=63.40, stdev=48.89 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 42], 50.00th=[ 50], 60.00th=[ 60], | 70.00th=[ 73], 80.00th=[ 90], 90.00th=[ 121], 95.00th=[ 146], | 99.00th=[ 236], 99.50th=[ 271], 99.90th=[ 359], 99.95th=[ 885], | 99.99th=[ 885] bw ( KiB/s): min= 7, max= 111, per=28.65%, avg=38.68, stdev=22.50, samples=313 iops : min= 1, max= 27, avg= 9.03, stdev= 5.67, samples=313 lat (msec) : 10=2.12%, 20=14.88%, 50=46.13%, 100=25.10%, 250=11.33% lat (msec) : 500=0.42%, 1000=0.03% cpu : usr=0.06%, sys=2.05%, ctx=5002, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=130KiB/s (133kB/s), 26.0KiB/s-37.4KiB/s (27.6kB/s-38.3kB/s), io=20.5MiB (21.5MB), run=109655-161844msec WRITE: bw=135KiB/s (139kB/s), 28.1KiB/s-39.4KiB/s (28.7kB/s-40.3kB/s), io=21.4MiB (22.4MB), run=109655-161844msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181472: Thu Apr 9 17:38:13 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5920KiB/36289msec) clat (usec): min=41, max=297960, avg=51626.13, stdev=36414.70 lat (usec): min=42, max=297961, avg=51628.19, stdev=36414.72 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 69], 10.00th=[ 15008], 20.00th=[ 24249], | 30.00th=[ 30540], 40.00th=[ 36963], 50.00th=[ 44303], 60.00th=[ 52691], | 70.00th=[ 62129], 80.00th=[ 78119], 90.00th=[101188], 95.00th=[116917], | 99.00th=[170918], 99.50th=[200279], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 62, max= 476, per=24.93%, avg=163.56, stdev=73.83, samples=71 iops : min= 3, max= 29, avg= 9.44, stdev= 4.66, samples=71 write: IOPS=10, BW=175KiB/s (180kB/s)(6368KiB/36289msec); 0 zone resets clat (usec): min=1328, max=228002, avg=42291.56, stdev=41293.09 lat (usec): min=1330, max=228005, avg=42297.41, stdev=41290.76 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 2073], 10.00th=[ 3752], 20.00th=[ 6390], | 30.00th=[ 12518], 40.00th=[ 21627], 50.00th=[ 30540], 60.00th=[ 40633], | 70.00th=[ 52691], 80.00th=[ 69731], 90.00th=[100140], 95.00th=[126354], | 99.00th=[193987], 99.50th=[208667], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 25, max= 479, per=25.46%, avg=175.70, stdev=84.84, samples=71 iops : min= 1, max= 29, avg=10.21, stdev= 5.37, samples=71 lat (usec) : 50=0.26%, 100=3.52% lat (msec) : 2=1.82%, 4=3.91%, 10=9.11%, 20=7.68%, 50=36.59% lat (msec) : 100=27.08%, 250=9.90%, 500=0.13% cpu : usr=0.05%, sys=4.64%, ctx=1658, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181474: Thu Apr 9 17:38:13 2026 read: IOPS=9, BW=157KiB/s (161kB/s)(5744KiB/36489msec) clat (usec): min=49, max=232564, avg=56713.42, stdev=39585.70 lat (usec): min=50, max=232565, avg=56715.12, stdev=39585.55 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 66], 10.00th=[ 18220], 20.00th=[ 28967], | 30.00th=[ 35390], 40.00th=[ 43779], 50.00th=[ 51643], 60.00th=[ 58983], | 70.00th=[ 67634], 80.00th=[ 79168], 90.00th=[ 98042], 95.00th=[124257], | 99.00th=[223347], 99.50th=[227541], 99.90th=[231736], 99.95th=[231736], | 99.99th=[231736] bw ( KiB/s): min= 31, max= 284, per=24.18%, avg=158.64, stdev=63.86, samples=70 iops : min= 1, max= 17, avg= 9.11, stdev= 4.06, samples=70 write: IOPS=11, BW=179KiB/s (184kB/s)(6544KiB/36489msec); 0 zone resets clat (usec): min=1339, max=199904, avg=39219.70, stdev=39081.86 lat (usec): min=1340, max=199906, avg=39231.48, stdev=39078.00 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 1991], 10.00th=[ 2999], 20.00th=[ 6128], | 30.00th=[ 9634], 40.00th=[ 19006], 50.00th=[ 26084], 60.00th=[ 36963], | 70.00th=[ 51643], 80.00th=[ 66323], 90.00th=[ 96994], 95.00th=[119014], | 99.00th=[162530], 99.50th=[177210], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 31, max= 445, per=25.70%, avg=177.32, stdev=87.06, samples=71 iops : min= 1, max= 27, avg=10.30, stdev= 5.49, samples=71 lat (usec) : 50=0.13%, 100=3.39% lat (msec) : 2=2.73%, 4=4.69%, 10=8.85%, 20=7.42%, 50=32.42% lat (msec) : 100=31.38%, 250=8.98% cpu : usr=0.05%, sys=4.62%, ctx=1652, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181477: Thu Apr 9 17:38:13 2026 read: IOPS=10, BW=172KiB/s (176kB/s)(6256KiB/36416msec) clat (usec): min=39, max=225157, avg=52798.81, stdev=36839.23 lat (usec): min=40, max=225159, avg=52800.75, stdev=36839.25 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 64], 10.00th=[ 996], 20.00th=[ 25035], | 30.00th=[ 31589], 40.00th=[ 39060], 50.00th=[ 47449], 60.00th=[ 55837], | 70.00th=[ 66847], 80.00th=[ 77071], 90.00th=[ 99091], 95.00th=[120062], | 99.00th=[183501], 99.50th=[191890], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 31, max= 383, per=26.69%, avg=175.11, stdev=68.11, samples=70 iops : min= 1, max= 23, avg=10.17, stdev= 4.32, samples=70 write: IOPS=10, BW=166KiB/s (170kB/s)(6032KiB/36416msec); 0 zone resets clat (usec): min=1404, max=341436, avg=40887.47, stdev=43332.06 lat (usec): min=1408, max=341438, avg=40903.68, stdev=43350.69 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 1958], 10.00th=[ 2638], 20.00th=[ 6128], | 30.00th=[ 12518], 40.00th=[ 20579], 50.00th=[ 29754], 60.00th=[ 41157], | 70.00th=[ 52167], 80.00th=[ 65799], 90.00th=[ 90702], 95.00th=[125305], | 99.00th=[214959], 99.50th=[252707], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 31, max= 447, per=23.81%, avg=164.31, stdev=81.54, samples=71 iops : min= 1, max= 27, avg= 9.48, stdev= 5.13, samples=71 lat (usec) : 50=0.26%, 100=4.30%, 250=0.26%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.12%, 4=4.17%, 10=5.86%, 20=8.20%, 50=33.59% lat (msec) : 100=31.38%, 250=8.20%, 500=0.26% cpu : usr=0.05%, sys=4.80%, ctx=1692, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181479: Thu Apr 9 17:38:13 2026 read: IOPS=10, BW=170KiB/s (174kB/s)(6032KiB/35441msec) clat (usec): min=39, max=210109, avg=51564.07, stdev=37964.48 lat (usec): min=40, max=210111, avg=51565.47, stdev=37964.46 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 63], 10.00th=[ 76], 20.00th=[ 23987], | 30.00th=[ 30278], 40.00th=[ 36963], 50.00th=[ 46924], 60.00th=[ 53740], | 70.00th=[ 63701], 80.00th=[ 77071], 90.00th=[101188], 95.00th=[127402], | 99.00th=[173016], 99.50th=[189793], 99.90th=[210764], 99.95th=[210764], | 99.99th=[210764] bw ( KiB/s): min= 31, max= 299, per=26.13%, avg=171.41, stdev=65.14, samples=68 iops : min= 1, max= 18, avg= 9.93, stdev= 4.15, samples=68 write: IOPS=11, BW=177KiB/s (181kB/s)(6256KiB/35441msec); 0 zone resets clat (usec): min=1248, max=340240, avg=39757.43, stdev=42798.56 lat (usec): min=1251, max=340242, avg=39779.97, stdev=42785.96 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1909], 10.00th=[ 2573], 20.00th=[ 5473], | 30.00th=[ 9110], 40.00th=[ 16057], 50.00th=[ 27132], 60.00th=[ 39060], | 70.00th=[ 51643], 80.00th=[ 68682], 90.00th=[ 91751], 95.00th=[123208], | 99.00th=[168821], 99.50th=[248513], 99.90th=[341836], 99.95th=[341836], | 99.99th=[341836] bw ( KiB/s): min= 25, max= 406, per=25.68%, avg=177.17, stdev=85.41, samples=69 iops : min= 1, max= 25, avg=10.30, stdev= 5.40, samples=69 lat (usec) : 50=0.26%, 100=5.60%, 250=0.39%, 500=0.26%, 1000=0.13% lat (msec) : 2=3.12%, 4=5.08%, 10=8.46%, 20=8.33%, 50=30.08% lat (msec) : 100=28.65%, 250=9.51%, 500=0.13% cpu : usr=0.08%, sys=4.59%, ctx=1552, majf=0, minf=19 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=656KiB/s (672kB/s), 157KiB/s-172KiB/s (161kB/s-176kB/s), io=23.4MiB (24.5MB), run=35441-36489msec WRITE: bw=691KiB/s (707kB/s), 166KiB/s-179KiB/s (170kB/s-184kB/s), io=24.6MiB (25.8MB), run=35441-36489msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181473: Thu Apr 9 17:38:28 2026 read: IOPS=7, BW=117KiB/s (120kB/s)(5920KiB/50392msec) clat (msec): min=8, max=275, avg=55.35, stdev=45.30 lat (msec): min=8, max=275, avg=55.35, stdev=45.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 35], 50.00th=[ 40], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 75], 90.00th=[ 115], 95.00th=[ 159], | 99.00th=[ 253], 99.50th=[ 275], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 320, per=25.31%, avg=118.19, stdev=68.47, samples=98 iops : min= 1, max= 20, avg= 6.61, stdev= 4.33, samples=98 write: IOPS=7, BW=126KiB/s (129kB/s)(6368KiB/50392msec); 0 zone resets clat (msec): min=17, max=295, avg=74.06, stdev=45.99 lat (msec): min=17, max=295, avg=74.06, stdev=45.99 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 28], 10.00th=[ 31], 20.00th=[ 38], | 30.00th=[ 45], 40.00th=[ 51], 50.00th=[ 62], 60.00th=[ 73], | 70.00th=[ 86], 80.00th=[ 106], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 230], 99.50th=[ 275], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 31, max= 320, per=26.52%, avg=130.48, stdev=65.92, samples=96 iops : min= 1, max= 20, avg= 7.39, stdev= 4.17, samples=96 lat (msec) : 10=0.39%, 20=4.95%, 50=46.09%, 100=31.12%, 250=16.54% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.77%, ctx=1232, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181475: Thu Apr 9 17:38:28 2026 read: IOPS=7, BW=114KiB/s (117kB/s)(5744KiB/50435msec) clat (msec): min=7, max=298, avg=50.04, stdev=42.10 lat (msec): min=7, max=298, avg=50.05, stdev=42.10 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 16], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 32], 50.00th=[ 38], 60.00th=[ 43], | 70.00th=[ 51], 80.00th=[ 65], 90.00th=[ 102], 95.00th=[ 144], | 99.00th=[ 226], 99.50th=[ 259], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 23, max= 352, per=26.02%, avg=121.49, stdev=74.99, samples=93 iops : min= 1, max= 22, avg= 6.82, stdev= 4.79, samples=93 write: IOPS=8, BW=130KiB/s (133kB/s)(6544KiB/50435msec); 0 zone resets clat (msec): min=19, max=345, avg=78.26, stdev=48.12 lat (msec): min=19, max=345, avg=78.26, stdev=48.12 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 34], 20.00th=[ 42], | 30.00th=[ 48], 40.00th=[ 57], 50.00th=[ 65], 60.00th=[ 74], | 70.00th=[ 89], 80.00th=[ 107], 90.00th=[ 146], 95.00th=[ 180], | 99.00th=[ 253], 99.50th=[ 268], 99.90th=[ 347], 99.95th=[ 347], | 99.99th=[ 347] bw ( KiB/s): min= 23, max= 352, per=26.62%, avg=130.97, stdev=65.37, samples=98 iops : min= 1, max= 22, avg= 7.42, stdev= 4.13, samples=98 lat (msec) : 10=0.52%, 20=6.51%, 50=42.71%, 100=33.20%, 250=16.15% lat (msec) : 500=0.91% cpu : usr=0.07%, sys=1.70%, ctx=1146, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181476: Thu Apr 9 17:38:28 2026 read: IOPS=7, BW=123KiB/s (126kB/s)(6256KiB/50665msec) clat (msec): min=8, max=301, avg=52.43, stdev=43.84 lat (msec): min=8, max=301, avg=52.44, stdev=43.84 clat percentiles (msec): | 1.00th=[ 12], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 23], | 30.00th=[ 27], 40.00th=[ 33], 50.00th=[ 38], 60.00th=[ 47], | 70.00th=[ 55], 80.00th=[ 74], 90.00th=[ 105], 95.00th=[ 140], | 99.00th=[ 259], 99.50th=[ 284], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 30, max= 352, per=27.76%, avg=129.65, stdev=81.13, samples=95 iops : min= 1, max= 22, avg= 7.32, stdev= 5.16, samples=95 write: IOPS=7, BW=119KiB/s (122kB/s)(6032KiB/50665msec); 0 zone resets clat (msec): min=18, max=307, avg=79.63, stdev=52.44 lat (msec): min=18, max=307, avg=79.64, stdev=52.44 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 27], 10.00th=[ 31], 20.00th=[ 39], | 30.00th=[ 47], 40.00th=[ 53], 50.00th=[ 61], 60.00th=[ 73], | 70.00th=[ 91], 80.00th=[ 116], 90.00th=[ 159], 95.00th=[ 184], | 99.00th=[ 266], 99.50th=[ 288], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 30, max= 319, per=24.18%, avg=118.95, stdev=62.73, samples=98 iops : min= 1, max= 19, avg= 6.64, stdev= 4.00, samples=98 lat (msec) : 10=0.26%, 20=6.51%, 50=44.14%, 100=30.47%, 250=17.45% lat (msec) : 500=1.17% cpu : usr=0.07%, sys=1.68%, ctx=1225, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181478: Thu Apr 9 17:38:28 2026 read: IOPS=7, BW=118KiB/s (121kB/s)(6032KiB/51185msec) clat (msec): min=9, max=267, avg=53.97, stdev=45.01 lat (msec): min=9, max=267, avg=53.97, stdev=45.01 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 18], 20.00th=[ 22], | 30.00th=[ 27], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 46], | 70.00th=[ 59], 80.00th=[ 79], 90.00th=[ 121], 95.00th=[ 161], | 99.00th=[ 209], 99.50th=[ 226], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 30, max= 349, per=25.72%, avg=120.09, stdev=73.98, samples=97 iops : min= 1, max= 21, avg= 6.72, stdev= 4.73, samples=97 write: IOPS=7, BW=122KiB/s (125kB/s)(6256KiB/51185msec); 0 zone resets clat (msec): min=18, max=342, avg=77.71, stdev=51.63 lat (msec): min=18, max=342, avg=77.71, stdev=51.63 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 28], 10.00th=[ 33], 20.00th=[ 39], | 30.00th=[ 45], 40.00th=[ 53], 50.00th=[ 63], 60.00th=[ 72], | 70.00th=[ 88], 80.00th=[ 110], 90.00th=[ 144], 95.00th=[ 178], | 99.00th=[ 296], 99.50th=[ 313], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 24, max= 319, per=25.12%, avg=123.58, stdev=71.23, samples=98 iops : min= 1, max= 19, avg= 6.95, stdev= 4.51, samples=98 lat (msec) : 10=0.26%, 20=8.20%, 50=42.45%, 100=28.91%, 250=19.27% lat (msec) : 500=0.91% cpu : usr=0.05%, sys=1.59%, ctx=1178, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=468KiB/s (479kB/s), 114KiB/s-123KiB/s (117kB/s-126kB/s), io=23.4MiB (24.5MB), run=50392-51185msec WRITE: bw=492KiB/s (504kB/s), 119KiB/s-130KiB/s (122kB/s-133kB/s), io=24.6MiB (25.8MB), run=50392-51185msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181493: Thu Apr 9 17:38:46 2026 read: IOPS=2, BW=2131KiB/s (2182kB/s)(7168KiB/3364msec) clat (usec): min=515, max=302926, avg=185928.47, stdev=130180.92 lat (usec): min=517, max=302928, avg=185929.95, stdev=130181.10 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 7898], | 30.00th=[177210], 40.00th=[177210], 50.00th=[263193], 60.00th=[265290], | 70.00th=[265290], 80.00th=[283116], 90.00th=[304088], 95.00th=[304088], | 99.00th=[304088], 99.50th=[304088], 99.90th=[304088], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 2007, max= 3136, per=51.06%, avg=2252.20, stdev=494.29, samples=5 iops : min= 1, max= 3, avg= 1.60, stdev= 0.89, samples=5 write: IOPS=1, BW=1522KiB/s (1559kB/s)(5120KiB/3364msec); 0 zone resets clat (msec): min=302, max=580, avg=395.44, stdev=106.83 lat (msec): min=302, max=580, avg=395.51, stdev=106.86 clat percentiles (msec): | 1.00th=[ 305], 5.00th=[ 305], 10.00th=[ 305], 20.00th=[ 305], | 30.00th=[ 355], 40.00th=[ 355], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 372], 80.00th=[ 372], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 1892, max= 2048, per=32.31%, avg=1995.50, stdev=71.09, samples=4 iops : min= 1, max= 2, avg= 1.25, stdev= 0.50, samples=4 lat (usec) : 750=8.33% lat (msec) : 10=8.33%, 250=8.33%, 500=66.67%, 750=8.33% cpu : usr=0.00%, sys=13.05%, ctx=185, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181494: Thu Apr 9 17:38:46 2026 read: IOPS=0, BW=441KiB/s (452kB/s)(2048KiB/4642msec) clat (msec): min=206, max=297, avg=251.65, stdev=64.20 lat (msec): min=206, max=297, avg=251.71, stdev=64.29 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 207], 40.00th=[ 207], 50.00th=[ 207], 60.00th=[ 296], | 70.00th=[ 296], 80.00th=[ 296], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 1454, max= 2048, per=39.70%, avg=1751.00, stdev=420.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=2, BW=2206KiB/s (2259kB/s)(10.0MiB/4642msec); 0 zone resets clat (msec): min=115, max=776, avg=397.33, stdev=216.19 lat (msec): min=115, max=776, avg=398.78, stdev=215.54 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 161], | 30.00th=[ 305], 40.00th=[ 317], 50.00th=[ 321], 60.00th=[ 401], | 70.00th=[ 405], 80.00th=[ 430], 90.00th=[ 743], 95.00th=[ 776], | 99.00th=[ 776], 99.50th=[ 776], 99.90th=[ 776], 99.95th=[ 776], | 99.99th=[ 776] bw ( KiB/s): min= 2035, max= 6095, per=58.22%, avg=3595.60, stdev=1679.98, samples=5 iops : min= 1, max= 5, avg= 2.80, stdev= 1.48, samples=5 lat (msec) : 250=25.00%, 500=58.33%, 750=8.33%, 1000=8.33% cpu : usr=0.02%, sys=11.94%, ctx=141, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181495: Thu Apr 9 17:38:46 2026 read: IOPS=1, BW=1909KiB/s (1955kB/s)(6144KiB/3218msec) clat (usec): min=545, max=266811, avg=123604.22, stdev=123954.85 lat (usec): min=545, max=266812, avg=123605.38, stdev=123954.84 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 545], 10.00th=[ 545], 20.00th=[ 586], | 30.00th=[ 586], 40.00th=[ 41681], 50.00th=[ 41681], 60.00th=[183501], | 70.00th=[248513], 80.00th=[248513], 90.00th=[267387], 95.00th=[267387], | 99.00th=[267387], 99.50th=[267387], 99.90th=[267387], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 1892, max= 6107, per=75.92%, avg=3349.00, stdev=2389.77, samples=3 iops : min= 1, max= 5, avg= 2.67, stdev= 2.08, samples=3 write: IOPS=1, BW=1909KiB/s (1955kB/s)(6144KiB/3218msec); 0 zone resets clat (msec): min=156, max=823, avg=393.41, stdev=242.44 lat (msec): min=157, max=824, avg=394.14, stdev=242.37 clat percentiles (msec): | 1.00th=[ 157], 5.00th=[ 157], 10.00th=[ 157], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 372], | 70.00th=[ 485], 80.00th=[ 485], 90.00th=[ 827], 95.00th=[ 827], | 99.00th=[ 827], 99.50th=[ 827], 99.90th=[ 827], 99.95th=[ 827], | 99.99th=[ 827] bw ( KiB/s): min= 2007, max= 4096, per=45.56%, avg=2813.75, stdev=998.90, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (usec) : 750=16.67% lat (msec) : 50=8.33%, 250=33.33%, 500=33.33%, 1000=8.33% cpu : usr=0.06%, sys=12.09%, ctx=128, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181496: Thu Apr 9 17:38:46 2026 read: IOPS=1, BW=1407KiB/s (1441kB/s)(5120KiB/3638msec) clat (usec): min=512, max=301294, avg=146585.85, stdev=146378.92 lat (usec): min=513, max=301296, avg=146587.13, stdev=146378.53 clat percentiles (usec): | 1.00th=[ 515], 5.00th=[ 515], 10.00th=[ 515], 20.00th=[ 515], | 30.00th=[ 1631], 40.00th=[ 1631], 50.00th=[143655], 60.00th=[143655], | 70.00th=[287310], 80.00th=[287310], 90.00th=[299893], 95.00th=[299893], | 99.00th=[299893], 99.50th=[299893], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 2035, max= 5678, per=87.43%, avg=3856.50, stdev=2575.99, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1970KiB/s (2018kB/s)(7168KiB/3638msec); 0 zone resets clat (msec): min=202, max=974, avg=406.89, stdev=257.80 lat (msec): min=202, max=974, avg=407.48, stdev=257.61 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 284], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 355], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 384], 90.00th=[ 978], 95.00th=[ 978], | 99.00th=[ 978], 99.50th=[ 978], 99.90th=[ 978], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 1452, max= 4015, per=38.66%, avg=2387.50, stdev=1120.03, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 250=16.67%, 500=58.33%, 1000=8.33% cpu : usr=0.05%, sys=10.94%, ctx=122, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4412KiB/s (4518kB/s), 441KiB/s-2131KiB/s (452kB/s-2182kB/s), io=20.0MiB (20.0MB), run=3218-4642msec WRITE: bw=6177KiB/s (6325kB/s), 1522KiB/s-2206KiB/s (1559kB/s-2259kB/s), io=28.0MiB (29.4MB), run=3218-4642msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181498: Thu Apr 9 17:38:46 2026 read: IOPS=1, BW=1537KiB/s (1574kB/s)(7168KiB/4663msec) clat (msec): min=98, max=1042, avg=353.57, stdev=362.20 lat (msec): min=98, max=1042, avg=353.57, stdev=362.20 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 134], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 188], 60.00th=[ 203], | 70.00th=[ 203], 80.00th=[ 676], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1376, max= 3930, per=56.16%, avg=2344.00, stdev=1102.03, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1098KiB/s (1124kB/s)(5120KiB/4663msec); 0 zone resets clat (msec): min=95, max=951, avg=406.02, stdev=365.60 lat (msec): min=95, max=952, avg=406.23, stdev=365.54 clat percentiles (msec): | 1.00th=[ 96], 5.00th=[ 96], 10.00th=[ 96], 20.00th=[ 96], | 30.00th=[ 109], 40.00th=[ 109], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 1950, max= 6131, per=69.14%, avg=4040.50, stdev=2956.41, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 lat (msec) : 100=16.67%, 250=41.67%, 500=8.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.09%, sys=4.70%, ctx=91, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181499: Thu Apr 9 17:38:46 2026 read: IOPS=0, BW=433KiB/s (443kB/s)(2048KiB/4731msec) clat (msec): min=101, max=492, avg=297.11, stdev=276.13 lat (msec): min=101, max=492, avg=297.12, stdev=276.13 clat percentiles (msec): | 1.00th=[ 103], 5.00th=[ 103], 10.00th=[ 103], 20.00th=[ 103], | 30.00th=[ 103], 40.00th=[ 103], 50.00th=[ 103], 60.00th=[ 493], | 70.00th=[ 493], 80.00th=[ 493], 90.00th=[ 493], 95.00th=[ 493], | 99.00th=[ 493], 99.50th=[ 493], 99.90th=[ 493], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 1454, max= 2035, per=41.79%, avg=1744.50, stdev=410.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2164KiB/s (2216kB/s)(10.0MiB/4731msec); 0 zone resets clat (msec): min=140, max=821, avg=402.74, stdev=269.46 lat (msec): min=140, max=821, avg=402.85, stdev=269.45 clat percentiles (msec): | 1.00th=[ 140], 5.00th=[ 140], 10.00th=[ 140], 20.00th=[ 155], | 30.00th=[ 188], 40.00th=[ 194], 50.00th=[ 234], 60.00th=[ 300], | 70.00th=[ 592], 80.00th=[ 659], 90.00th=[ 743], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 1965, max= 4087, per=48.57%, avg=2838.60, stdev=1132.70, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (msec) : 250=50.00%, 500=16.67%, 750=25.00%, 1000=8.33% cpu : usr=0.00%, sys=4.14%, ctx=81, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181500: Thu Apr 9 17:38:46 2026 read: IOPS=1, BW=1402KiB/s (1435kB/s)(6144KiB/4383msec) clat (msec): min=73, max=813, avg=265.24, stdev=274.55 lat (msec): min=73, max=813, avg=265.24, stdev=274.55 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 110], | 30.00th=[ 110], 40.00th=[ 184], 50.00th=[ 184], 60.00th=[ 184], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 818], 95.00th=[ 818], | 99.00th=[ 818], 99.50th=[ 818], 99.90th=[ 818], 99.95th=[ 818], | 99.99th=[ 818] bw ( KiB/s): min= 2035, max= 4071, per=61.00%, avg=2546.00, stdev=1016.67, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1402KiB/s (1435kB/s)(6144KiB/4383msec); 0 zone resets clat (msec): min=153, max=1080, avg=462.58, stdev=339.92 lat (msec): min=153, max=1080, avg=462.70, stdev=339.92 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 388], 50.00th=[ 388], 60.00th=[ 439], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1633, max= 2043, per=33.21%, avg=1940.60, stdev=175.50, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.17%, ctx=89, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181501: Thu Apr 9 17:38:46 2026 read: IOPS=1, BW=1044KiB/s (1069kB/s)(5120KiB/4906msec) clat (msec): min=48, max=519, avg=280.15, stdev=186.31 lat (msec): min=48, max=519, avg=280.15, stdev=186.31 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 50], 10.00th=[ 50], 20.00th=[ 50], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 288], 60.00th=[ 288], | 70.00th=[ 393], 80.00th=[ 393], 90.00th=[ 518], 95.00th=[ 518], | 99.00th=[ 518], 99.50th=[ 518], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 2023, max= 4071, per=64.98%, avg=2712.33, stdev=1176.68, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1461KiB/s (1496kB/s)(7168KiB/4906msec); 0 zone resets clat (msec): min=105, max=1080, avg=496.83, stdev=393.79 lat (msec): min=106, max=1080, avg=496.98, stdev=393.87 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 113], | 30.00th=[ 122], 40.00th=[ 122], 50.00th=[ 542], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 835], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 1950, max= 2035, per=33.98%, avg=1986.00, stdev=39.84, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 50=8.33%, 250=33.33%, 500=16.67%, 750=25.00%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=3.55%, ctx=80, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4174KiB/s (4275kB/s), 433KiB/s-1537KiB/s (443kB/s-1574kB/s), io=20.0MiB (20.0MB), run=4383-4906msec WRITE: bw=5844KiB/s (5985kB/s), 1098KiB/s-2164KiB/s (1124kB/s-2216kB/s), io=28.0MiB (29.4MB), run=4383-4906msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=181507: Thu Apr 9 17:39:04 2026 read: IOPS=0, BW=3281KiB/s (3360kB/s)(12.0MiB/3745msec) clat (msec): min=956, max=1343, avg=1168.14, stdev=196.23 lat (msec): min=956, max=1343, avg=1168.14, stdev=196.23 clat percentiles (msec): | 1.00th=[ 961], 5.00th=[ 961], 10.00th=[ 961], 20.00th=[ 961], | 30.00th=[ 961], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.05%, sys=10.23%, ctx=392, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181508: Thu Apr 9 17:39:04 2026 read: IOPS=0, BW=959KiB/s (982kB/s)(4096KiB/4273msec) clat (nsec): min=1136.3M, max=1136.3M, avg=1136310694.00, stdev= 0.00 lat (nsec): min=1136.3M, max=1136.3M, avg=1136314792.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1133], 50.00th=[ 1133], 60.00th=[ 1133], | 70.00th=[ 1133], 80.00th=[ 1133], 90.00th=[ 1133], 95.00th=[ 1133], | 99.00th=[ 1133], 99.50th=[ 1133], 99.90th=[ 1133], 99.95th=[ 1133], | 99.99th=[ 1133] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1917KiB/s (1963kB/s)(8192KiB/4273msec); 0 zone resets clat (msec): min=926, max=1905, avg=1416.15, stdev=692.08 lat (msec): min=927, max=1906, avg=1416.67, stdev=692.31 clat percentiles (msec): | 1.00th=[ 927], 5.00th=[ 927], 10.00th=[ 927], 20.00th=[ 927], | 30.00th=[ 927], 40.00th=[ 927], 50.00th=[ 927], 60.00th=[ 1905], | 70.00th=[ 1905], 80.00th=[ 1905], 90.00th=[ 1905], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 7876, max= 7876, per=100.00%, avg=7876.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.11%, ctx=139, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181509: Thu Apr 9 17:39:04 2026 write: IOPS=0, BW=2668KiB/s (2732kB/s)(12.0MiB/4605msec); 0 zone resets clat (msec): min=593, max=3116, avg=1497.95, stdev=1404.54 lat (msec): min=594, max=3116, avg=1499.56, stdev=1403.60 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 3104], 80.00th=[ 3104], 90.00th=[ 3104], 95.00th=[ 3104], | 99.00th=[ 3104], 99.50th=[ 3104], 99.90th=[ 3104], 99.95th=[ 3104], | 99.99th=[ 3104] bw ( KiB/s): min= 7984, max= 8143, per=100.00%, avg=8063.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.35%, ctx=56, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181510: Thu Apr 9 17:39:04 2026 write: IOPS=0, BW=3764KiB/s (3854kB/s)(12.0MiB/3265msec); 0 zone resets clat (msec): min=883, max=1052, avg=992.92, stdev=94.53 lat (msec): min=893, max=1052, avg=996.20, stdev=89.51 clat percentiles (msec): | 1.00th=[ 885], 5.00th=[ 885], 10.00th=[ 885], 20.00th=[ 885], | 30.00th=[ 885], 40.00th=[ 1045], 50.00th=[ 1045], 60.00th=[ 1045], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min= 8015, max= 8175, per=100.00%, avg=8095.00, stdev=113.14, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.93%, ctx=51, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3834KiB/s (3926kB/s), 959KiB/s-3281KiB/s (982kB/s-3360kB/s), io=16.0MiB (16.8MB), run=3745-4273msec WRITE: bw=7116KiB/s (7287kB/s), 1917KiB/s-3764KiB/s (1963kB/s-3854kB/s), io=32.0MiB (33.6MB), run=3265-4605msec rand-rw: (groupid=0, jobs=1): err= 0: pid=181512: Thu Apr 9 17:39:04 2026 read: IOPS=0, BW=3139KiB/s (3214kB/s)(12.0MiB/3915msec) clat (msec): min=1135, max=1468, avg=1289.61, stdev=168.03 lat (msec): min=1135, max=1468, avg=1289.61, stdev=168.03 clat percentiles (msec): | 1.00th=[ 1133], 5.00th=[ 1133], 10.00th=[ 1133], 20.00th=[ 1133], | 30.00th=[ 1133], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1469], 80.00th=[ 1469], 90.00th=[ 1469], 95.00th=[ 1469], | 99.00th=[ 1469], 99.50th=[ 1469], 99.90th=[ 1469], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 8094, max= 8143, per=100.00%, avg=8118.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.05%, sys=2.61%, ctx=34, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181513: Thu Apr 9 17:39:04 2026 read: IOPS=0, BW=999KiB/s (1023kB/s)(4096KiB/4100msec) clat (nsec): min=1408.6M, max=1408.6M, avg=1408637837.00, stdev= 0.00 lat (nsec): min=1408.6M, max=1408.6M, avg=1408640715.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1401], 5.00th=[ 1401], 10.00th=[ 1401], 20.00th=[ 1401], | 30.00th=[ 1401], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1998KiB/s (2046kB/s)(8192KiB/4100msec); 0 zone resets clat (msec): min=631, max=2013, avg=1322.68, stdev=977.58 lat (msec): min=631, max=2014, avg=1323.26, stdev=977.76 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 2022], | 70.00th=[ 2022], 80.00th=[ 2022], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 8078, max= 8078, per=100.00%, avg=8078.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.59%, ctx=41, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181514: Thu Apr 9 17:39:04 2026 write: IOPS=0, BW=2727KiB/s (2792kB/s)(12.0MiB/4506msec); 0 zone resets clat (msec): min=872, max=2320, avg=1487.48, stdev=748.05 lat (msec): min=873, max=2320, avg=1488.13, stdev=747.97 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 2333], 80.00th=[ 2333], 90.00th=[ 2333], 95.00th=[ 2333], | 99.00th=[ 2333], 99.50th=[ 2333], 99.90th=[ 2333], 99.95th=[ 2333], | 99.99th=[ 2333] bw ( KiB/s): min= 8110, max= 8126, per=100.00%, avg=8118.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.27%, sys=2.35%, ctx=57, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=181515: Thu Apr 9 17:39:04 2026 write: IOPS=0, BW=3726KiB/s (3815kB/s)(12.0MiB/3298msec); 0 zone resets clat (msec): min=340, max=1612, avg=1073.29, stdev=657.95 lat (msec): min=341, max=1612, avg=1074.15, stdev=657.43 clat percentiles (msec): | 1.00th=[ 342], 5.00th=[ 342], 10.00th=[ 342], 20.00th=[ 342], | 30.00th=[ 342], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1267], | 70.00th=[ 1620], 80.00th=[ 1620], 90.00th=[ 1620], 95.00th=[ 1620], | 99.00th=[ 1620], 99.50th=[ 1620], 99.90th=[ 1620], 99.95th=[ 1620], | 99.99th=[ 1620] bw ( KiB/s): min= 7831, max= 8192, per=100.00%, avg=8011.50, stdev=255.27, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.18%, sys=3.22%, ctx=54, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3996KiB/s (4092kB/s), 999KiB/s-3139KiB/s (1023kB/s-3214kB/s), io=16.0MiB (16.8MB), run=3915-4100msec WRITE: bw=7272KiB/s (7447kB/s), 1998KiB/s-3726KiB/s (2046kB/s-3815kB/s), io=32.0MiB (33.6MB), run=3298-4506msec