== sanity test 398b: DIO and buffer IO race ============== 08:28:20 (1787747300) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 6.34069 s, 7.9 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145779: Wed Aug 26 08:31:00 2026 read: IOPS=10, BW=43.3KiB/s (44.4kB/s)(5992KiB/138272msec) clat (usec): min=30, max=954055, avg=44799.33, stdev=41439.57 lat (usec): min=30, max=954057, avg=44805.95, stdev=41436.03 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 57], 10.00th=[ 108], 20.00th=[ 20055], | 30.00th=[ 25560], 40.00th=[ 31589], 50.00th=[ 36963], 60.00th=[ 44303], | 70.00th=[ 53216], 80.00th=[ 67634], 90.00th=[ 87557], 95.00th=[102237], | 99.00th=[168821], 99.50th=[208667], 99.90th=[312476], 99.95th=[952108], | 99.99th=[952108] bw ( KiB/s): min= 7, max= 110, per=25.56%, avg=43.95, stdev=19.85, samples=266 iops : min= 1, max= 27, avg=10.32, stdev= 5.01, samples=266 write: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6296KiB/138272msec); 0 zone resets clat (usec): min=865, max=471642, avg=44914.43, stdev=48295.09 lat (usec): min=866, max=471643, avg=44917.07, stdev=48295.29 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1172], 10.00th=[ 1287], 20.00th=[ 3687], | 30.00th=[ 9634], 40.00th=[ 20579], 50.00th=[ 30540], 60.00th=[ 44827], | 70.00th=[ 58459], 80.00th=[ 78119], 90.00th=[107480], 95.00th=[141558], | 99.00th=[198181], 99.50th=[235930], 99.90th=[354419], 99.95th=[471860], | 99.99th=[471860] bw ( KiB/s): min= 7, max= 111, per=25.03%, avg=45.31, stdev=18.94, samples=271 iops : min= 1, max= 27, avg=10.66, stdev= 4.78, samples=271 lat (usec) : 50=0.72%, 100=4.07%, 250=0.13%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.20% lat (msec) : 2=7.03%, 4=3.45%, 10=5.37%, 20=9.02%, 50=35.09% lat (msec) : 100=26.17%, 250=8.37%, 500=0.26%, 1000=0.03% cpu : usr=0.07%, sys=4.56%, ctx=6172, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145780: Wed Aug 26 08:31:00 2026 read: IOPS=10, BW=42.9KiB/s (43.9kB/s)(5940KiB/138560msec) clat (usec): min=29, max=1034.4k, avg=44347.59, stdev=40557.75 lat (usec): min=29, max=1034.5k, avg=44349.66, stdev=40557.61 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 60], 10.00th=[ 11600], | 20.00th=[ 20055], 30.00th=[ 25560], 40.00th=[ 31065], | 50.00th=[ 37487], 60.00th=[ 44827], 70.00th=[ 54264], | 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[ 102237], | 99.00th=[ 147850], 99.50th=[ 164627], 99.90th=[ 250610], | 99.95th=[1035994], 99.99th=[1035994] bw ( KiB/s): min= 7, max= 110, per=25.03%, avg=43.06, stdev=18.44, samples=268 iops : min= 1, max= 27, avg=10.10, stdev= 4.68, samples=268 write: IOPS=11, BW=45.8KiB/s (46.9kB/s)(6348KiB/138560msec); 0 zone resets clat (usec): min=1027, max=495463, avg=45482.30, stdev=50458.69 lat (usec): min=1028, max=495464, avg=45485.02, stdev=50458.49 clat percentiles (usec): | 1.00th=[ 1074], 5.00th=[ 1172], 10.00th=[ 1270], 20.00th=[ 3621], | 30.00th=[ 8029], 40.00th=[ 19006], 50.00th=[ 30540], 60.00th=[ 44827], | 70.00th=[ 58983], 80.00th=[ 83362], 90.00th=[109577], 95.00th=[137364], | 99.00th=[200279], 99.50th=[270533], 99.90th=[455082], 99.95th=[497026], | 99.99th=[497026] bw ( KiB/s): min= 7, max= 126, per=25.28%, avg=45.77, stdev=20.19, samples=269 iops : min= 1, max= 31, avg=10.78, stdev= 5.12, samples=269 lat (usec) : 50=0.42%, 100=3.55%, 250=0.20%, 500=0.07%, 1000=0.03% lat (msec) : 2=7.78%, 4=3.45%, 10=6.09%, 20=9.15%, 50=33.92% lat (msec) : 100=25.78%, 250=9.24%, 500=0.29%, 2000=0.03% cpu : usr=0.07%, sys=4.79%, ctx=6375, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145781: Wed Aug 26 08:31:00 2026 read: IOPS=10, BW=43.4KiB/s (44.5kB/s)(6028KiB/138811msec) clat (usec): min=32, max=346938, avg=44153.08, stdev=33798.14 lat (usec): min=32, max=346940, avg=44154.44, stdev=33798.12 clat percentiles (usec): | 1.00th=[ 49], 5.00th=[ 59], 10.00th=[ 9634], 20.00th=[ 20841], | 30.00th=[ 26084], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 44827], | 70.00th=[ 54264], 80.00th=[ 66323], 90.00th=[ 83362], 95.00th=[100140], | 99.00th=[143655], 99.50th=[185598], 99.90th=[337642], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 7, max= 119, per=25.22%, avg=43.39, stdev=19.37, samples=269 iops : min= 1, max= 29, avg=10.21, stdev= 4.89, samples=269 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6260KiB/138811msec); 0 zone resets clat (usec): min=949, max=1254.3k, avg=45874.67, stdev=55917.26 lat (usec): min=949, max=1254.3k, avg=45880.46, stdev=55918.93 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1188], 10.00th=[ 1450], | 20.00th=[ 3884], 30.00th=[ 8848], 40.00th=[ 18744], | 50.00th=[ 33162], 60.00th=[ 44827], 70.00th=[ 61080], | 80.00th=[ 79168], 90.00th=[ 107480], 95.00th=[ 139461], | 99.00th=[ 193987], 99.50th=[ 235930], 99.90th=[ 312476], | 99.95th=[1249903], 99.99th=[1249903] bw ( KiB/s): min= 7, max= 118, per=24.80%, avg=44.89, stdev=19.79, samples=270 iops : min= 1, max= 29, avg=10.59, stdev= 4.99, samples=270 lat (usec) : 50=0.65%, 100=3.29%, 250=0.46%, 500=0.07%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=6.97%, 4=3.65%, 10=5.99%, 20=8.53%, 50=34.86% lat (msec) : 100=26.53%, 250=8.43%, 500=0.29%, 2000=0.03% cpu : usr=0.08%, sys=4.59%, ctx=6257, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145782: Wed Aug 26 08:31:00 2026 read: IOPS=10, BW=43.8KiB/s (44.8kB/s)(6052KiB/138305msec) clat (usec): min=29, max=997499, avg=45766.90, stdev=43757.81 lat (usec): min=29, max=997502, avg=45768.33, stdev=43757.79 clat percentiles (usec): | 1.00th=[ 46], 5.00th=[ 59], 10.00th=[ 109], 20.00th=[ 20579], | 30.00th=[ 27132], 40.00th=[ 32637], 50.00th=[ 39584], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 65799], 90.00th=[ 86508], 95.00th=[104334], | 99.00th=[181404], 99.50th=[238027], 99.90th=[434111], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 111, per=25.55%, avg=43.95, stdev=18.34, samples=267 iops : min= 1, max= 27, avg=10.34, stdev= 4.63, samples=267 write: IOPS=11, BW=45.1KiB/s (46.2kB/s)(6236KiB/138305msec); 0 zone resets clat (usec): min=807, max=424166, avg=43961.40, stdev=46761.37 lat (usec): min=808, max=424418, avg=43969.54, stdev=46763.76 clat percentiles (usec): | 1.00th=[ 1045], 5.00th=[ 1156], 10.00th=[ 1287], 20.00th=[ 3425], | 30.00th=[ 8225], 40.00th=[ 19268], 50.00th=[ 31589], 60.00th=[ 44303], | 70.00th=[ 58983], 80.00th=[ 78119], 90.00th=[103285], 95.00th=[131597], | 99.00th=[196084], 99.50th=[214959], 99.90th=[354419], 99.95th=[425722], | 99.99th=[425722] bw ( KiB/s): min= 7, max= 117, per=24.71%, avg=44.73, stdev=19.61, samples=270 iops : min= 1, max= 29, avg=10.55, stdev= 4.99, samples=270 lat (usec) : 50=0.85%, 100=3.91%, 250=0.39%, 500=0.03%, 750=0.07% lat (usec) : 1000=0.26% lat (msec) : 2=7.26%, 4=3.87%, 10=5.27%, 20=8.17%, 50=35.19% lat (msec) : 100=26.46%, 250=7.85%, 500=0.39%, 1000=0.03% cpu : usr=0.08%, sys=4.71%, ctx=6157, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=173KiB/s (177kB/s), 42.9KiB/s-43.8KiB/s (43.9kB/s-44.8kB/s), io=23.4MiB (24.6MB), run=138272-138811msec WRITE: bw=181KiB/s (185kB/s), 45.1KiB/s-45.8KiB/s (46.2kB/s-46.9kB/s), io=24.6MiB (25.7MB), run=138272-138811msec fio: pid=145777, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=145775: Wed Aug 26 08:33:40 2026 read: IOPS=5, BW=20.0KiB/s (20.5kB/s)(5992KiB/299125msec) clat (msec): min=5, max=973, avg=37.45, stdev=44.43 lat (msec): min=5, max=973, avg=37.45, stdev=44.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 25], 60.00th=[ 30], | 70.00th=[ 39], 80.00th=[ 52], 90.00th=[ 84], 95.00th=[ 106], | 99.00th=[ 167], 99.50th=[ 224], 99.90th=[ 506], 99.95th=[ 978], | 99.99th=[ 978] bw ( KiB/s): min= 7, max= 87, per=31.30%, avg=22.85, stdev=15.25, samples=504 iops : min= 1, max= 21, avg= 5.08, stdev= 3.84, samples=504 write: IOPS=5, BW=21.0KiB/s (21.6kB/s)(6296KiB/299125msec); 0 zone resets clat (msec): min=38, max=809, avg=154.09, stdev=75.34 lat (msec): min=38, max=809, avg=154.10, stdev=75.34 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 66], 10.00th=[ 79], 20.00th=[ 95], | 30.00th=[ 108], 40.00th=[ 121], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 176], 80.00th=[ 207], 90.00th=[ 255], 95.00th=[ 300], | 99.00th=[ 397], 99.50th=[ 418], 99.90th=[ 558], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 48, per=26.98%, avg=20.77, stdev= 9.48, samples=580 iops : min= 1, max= 12, avg= 4.55, stdev= 2.43, samples=580 lat (msec) : 10=3.74%, 20=15.14%, 50=20.15%, 100=18.91%, 250=36.39% lat (msec) : 500=5.50%, 750=0.10%, 1000=0.07% cpu : usr=0.04%, sys=0.95%, ctx=5393, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145776: Wed Aug 26 08:33:40 2026 read: IOPS=4, BW=19.9KiB/s (20.4kB/s)(5940KiB/298526msec) clat (msec): min=5, max=1030, avg=36.50, stdev=44.88 lat (msec): min=5, max=1030, avg=36.50, stdev=44.88 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 36], 80.00th=[ 50], 90.00th=[ 80], 95.00th=[ 108], | 99.00th=[ 178], 99.50th=[ 226], 99.90th=[ 489], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 85, per=32.01%, avg=23.37, stdev=15.68, samples=489 iops : min= 1, max= 21, avg= 5.21, stdev= 3.95, samples=489 write: IOPS=5, BW=21.3KiB/s (21.8kB/s)(6348KiB/298526msec); 0 zone resets clat (msec): min=38, max=709, avg=153.64, stdev=76.32 lat (msec): min=38, max=709, avg=153.64, stdev=76.32 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 91], | 30.00th=[ 106], 40.00th=[ 122], 50.00th=[ 136], 60.00th=[ 155], | 70.00th=[ 178], 80.00th=[ 211], 90.00th=[ 257], 95.00th=[ 300], | 99.00th=[ 388], 99.50th=[ 422], 99.90th=[ 567], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 47, per=27.20%, avg=20.95, stdev= 9.92, samples=581 iops : min= 1, max= 11, avg= 4.59, stdev= 2.53, samples=581 lat (msec) : 10=3.81%, 20=16.34%, 50=19.37%, 100=19.82%, 250=34.60% lat (msec) : 500=5.92%, 750=0.10%, 2000=0.03% cpu : usr=0.03%, sys=0.96%, ctx=5229, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=145777: Wed Aug 26 08:33:40 2026 read: IOPS=4, BW=17.7KiB/s (18.1kB/s)(4076KiB/230284msec) clat (msec): min=4, max=492, avg=45.61, stdev=47.06 lat (msec): min=4, max=492, avg=45.61, stdev=47.06 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 19], 40.00th=[ 24], 50.00th=[ 30], 60.00th=[ 39], | 70.00th=[ 52], 80.00th=[ 69], 90.00th=[ 101], 95.00th=[ 127], | 99.00th=[ 215], 99.50th=[ 271], 99.90th=[ 464], 99.95th=[ 493], | 99.99th=[ 493] bw ( KiB/s): min= 7, max= 119, per=27.93%, avg=20.39, stdev=14.49, samples=383 iops : min= 1, max= 29, avg= 4.45, stdev= 3.66, samples=383 write: IOPS=4, BW=18.6KiB/s (19.1kB/s)(4288KiB/230284msec); 0 zone resets clat (msec): min=42, max=1252, avg=171.02, stdev=87.80 lat (msec): min=42, max=1252, avg=171.02, stdev=87.80 clat percentiles (msec): | 1.00th=[ 57], 5.00th=[ 70], 10.00th=[ 82], 20.00th=[ 100], | 30.00th=[ 117], 40.00th=[ 133], 50.00th=[ 155], 60.00th=[ 174], | 70.00th=[ 203], 80.00th=[ 234], 90.00th=[ 284], 95.00th=[ 326], | 99.00th=[ 409], 99.50th=[ 451], 99.90th=[ 584], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 7, max= 47, per=24.08%, avg=18.54, stdev= 9.44, samples=441 iops : min= 1, max= 11, avg= 3.98, stdev= 2.42, samples=441 lat (msec) : 10=3.92%, 20=12.14%, 50=17.93%, 100=20.36%, 250=36.81% lat (msec) : 500=8.60%, 750=0.14%, 2000=0.05% cpu : usr=0.03%, sys=0.88%, ctx=3354, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1020,1072,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145778: Wed Aug 26 08:33:40 2026 read: IOPS=5, BW=20.4KiB/s (20.9kB/s)(6052KiB/296982msec) clat (msec): min=5, max=489, avg=37.55, stdev=41.43 lat (msec): min=5, max=489, avg=37.55, stdev=41.43 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 51], 90.00th=[ 81], 95.00th=[ 114], | 99.00th=[ 186], 99.50th=[ 234], 99.90th=[ 485], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 7, max= 111, per=32.56%, avg=23.77, stdev=16.90, samples=491 iops : min= 1, max= 27, avg= 5.31, stdev= 4.26, samples=491 write: IOPS=5, BW=20.0KiB/s (21.5kB/s)(6236KiB/296982msec); 0 zone resets clat (msec): min=25, max=1156, avg=153.75, stdev=76.17 lat (msec): min=25, max=1156, avg=153.75, stdev=76.17 clat percentiles (msec): | 1.00th=[ 50], 5.00th=[ 66], 10.00th=[ 75], 20.00th=[ 93], | 30.00th=[ 107], 40.00th=[ 122], 50.00th=[ 140], 60.00th=[ 159], | 70.00th=[ 180], 80.00th=[ 209], 90.00th=[ 251], 95.00th=[ 288], | 99.00th=[ 372], 99.50th=[ 414], 99.90th=[ 709], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 55, per=27.04%, avg=20.82, stdev= 9.64, samples=574 iops : min= 1, max= 13, avg= 4.56, stdev= 2.47, samples=574 lat (msec) : 10=3.45%, 20=15.98%, 50=20.21%, 100=19.27%, 250=35.64% lat (msec) : 500=5.34%, 750=0.07%, 2000=0.03% cpu : usr=0.04%, sys=0.99%, ctx=5384, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=73.7KiB/s (75.5kB/s), 17.7KiB/s-20.4KiB/s (18.1kB/s-20.9kB/s), io=21.5MiB (22.6MB), run=230284-299125msec WRITE: bw=77.5KiB/s (79.3kB/s), 18.6KiB/s-21.3KiB/s (19.1kB/s-21.8kB/s), io=22.6MiB (23.7MB), run=230284-299125msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145844: Wed Aug 26 08:34:22 2026 read: IOPS=12, BW=205KiB/s (210kB/s)(5920KiB/28885msec) clat (usec): min=36, max=212192, avg=38775.38, stdev=34761.97 lat (usec): min=36, max=212193, avg=38779.66, stdev=34760.75 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 55], 10.00th=[ 61], 20.00th=[ 75], | 30.00th=[ 17957], 40.00th=[ 28967], 50.00th=[ 36439], 60.00th=[ 44827], | 70.00th=[ 51119], 80.00th=[ 60556], 90.00th=[ 78119], 95.00th=[ 99091], | 99.00th=[162530], 99.50th=[183501], 99.90th=[212861], 99.95th=[212861], | 99.99th=[212861] bw ( KiB/s): min= 31, max= 529, per=25.37%, avg=204.96, stdev=86.41, samples=55 iops : min= 1, max= 33, avg=12.05, stdev= 5.52, samples=55 write: IOPS=13, BW=220KiB/s (226kB/s)(6368KiB/28885msec); 0 zone resets clat (usec): min=1419, max=556962, avg=36312.24, stdev=44762.70 lat (usec): min=1422, max=556965, avg=36321.82, stdev=44758.59 clat percentiles (usec): | 1.00th=[ 1467], 5.00th=[ 1696], 10.00th=[ 1991], 20.00th=[ 4555], | 30.00th=[ 7898], 40.00th=[ 12911], 50.00th=[ 22938], 60.00th=[ 34341], | 70.00th=[ 46400], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[104334], | 99.00th=[164627], 99.50th=[229639], 99.90th=[557843], 99.95th=[557843], | 99.99th=[557843] bw ( KiB/s): min= 31, max= 539, per=25.69%, avg=218.34, stdev=89.75, samples=56 iops : min= 1, max= 33, avg=12.89, stdev= 5.70, samples=56 lat (usec) : 50=1.04%, 100=9.77%, 250=1.30%, 1000=0.13% lat (msec) : 2=5.47%, 4=4.04%, 10=10.16%, 20=7.94%, 50=29.30% lat (msec) : 100=25.65%, 250=5.08%, 750=0.13% cpu : usr=0.10%, sys=5.73%, ctx=1417, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145845: Wed Aug 26 08:34:22 2026 read: IOPS=12, BW=199KiB/s (204kB/s)(5744KiB/28829msec) clat (usec): min=36, max=317760, avg=40884.01, stdev=38914.10 lat (usec): min=37, max=317761, avg=40898.08, stdev=38916.17 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 62], 20.00th=[ 77], | 30.00th=[ 22152], 40.00th=[ 32637], 50.00th=[ 39060], 60.00th=[ 46400], | 70.00th=[ 53216], 80.00th=[ 61080], 90.00th=[ 82314], 95.00th=[ 94897], | 99.00th=[206570], 99.50th=[291505], 99.90th=[316670], 99.95th=[316670], | 99.99th=[316670] bw ( KiB/s): min= 62, max= 401, per=24.66%, avg=199.21, stdev=76.80, samples=56 iops : min= 3, max= 25, avg=11.68, stdev= 4.91, samples=56 write: IOPS=14, BW=227KiB/s (232kB/s)(6544KiB/28829msec); 0 zone resets clat (usec): min=1420, max=230317, avg=34146.35, stdev=35495.15 lat (usec): min=1422, max=230319, avg=34154.90, stdev=35490.80 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1778], 10.00th=[ 2868], 20.00th=[ 5407], | 30.00th=[ 7963], 40.00th=[ 13304], 50.00th=[ 21890], 60.00th=[ 31851], | 70.00th=[ 44303], 80.00th=[ 61604], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[156238], 99.50th=[173016], 99.90th=[229639], 99.95th=[229639], | 99.99th=[229639] bw ( KiB/s): min= 62, max= 603, per=26.73%, avg=227.23, stdev=107.59, samples=56 iops : min= 3, max= 37, avg=13.43, stdev= 6.77, samples=56 lat (usec) : 50=1.17%, 100=9.38%, 250=0.78%, 750=0.13%, 1000=0.13% lat (msec) : 2=4.30%, 4=3.91%, 10=10.42%, 20=8.85%, 50=30.99% lat (msec) : 100=24.74%, 250=4.82%, 500=0.39% cpu : usr=0.06%, sys=5.71%, ctx=1386, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145846: Wed Aug 26 08:34:22 2026 read: IOPS=13, BW=211KiB/s (216kB/s)(6256KiB/29636msec) clat (usec): min=33, max=270555, avg=38507.38, stdev=35979.30 lat (usec): min=33, max=270556, avg=38509.33, stdev=35979.33 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 55], 10.00th=[ 60], 20.00th=[ 76], | 30.00th=[ 21365], 40.00th=[ 29492], 50.00th=[ 35390], 60.00th=[ 41681], | 70.00th=[ 49021], 80.00th=[ 60031], 90.00th=[ 80217], 95.00th=[101188], | 99.00th=[189793], 99.50th=[231736], 99.90th=[270533], 99.95th=[270533], | 99.99th=[270533] bw ( KiB/s): min= 64, max= 380, per=26.21%, avg=211.79, stdev=72.06, samples=58 iops : min= 4, max= 23, avg=12.50, stdev= 4.54, samples=58 write: IOPS=12, BW=204KiB/s (208kB/s)(6032KiB/29636msec); 0 zone resets clat (usec): min=1371, max=279298, avg=38233.11, stdev=38712.66 lat (usec): min=1373, max=279299, avg=38235.34, stdev=38712.62 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1827], 10.00th=[ 2802], 20.00th=[ 5407], | 30.00th=[ 9634], 40.00th=[ 14484], 50.00th=[ 25297], 60.00th=[ 39060], | 70.00th=[ 50594], 80.00th=[ 67634], 90.00th=[ 91751], 95.00th=[116917], | 99.00th=[166724], 99.50th=[185598], 99.90th=[278922], 99.95th=[278922], | 99.99th=[278922] bw ( KiB/s): min= 63, max= 382, per=23.85%, avg=202.76, stdev=77.35, samples=58 iops : min= 3, max= 23, avg=11.91, stdev= 4.88, samples=58 lat (usec) : 50=1.69%, 100=10.16%, 250=0.65%, 500=0.52%, 1000=0.39% lat (msec) : 2=2.86%, 4=4.04%, 10=8.46%, 20=7.68%, 50=33.46% lat (msec) : 100=23.70%, 250=6.12%, 500=0.26% cpu : usr=0.08%, sys=5.50%, ctx=1441, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145847: Wed Aug 26 08:34:22 2026 read: IOPS=13, BW=213KiB/s (218kB/s)(6032KiB/28330msec) clat (usec): min=31, max=260355, avg=39822.13, stdev=34705.52 lat (usec): min=31, max=260355, avg=39823.46, stdev=34705.53 clat percentiles (usec): | 1.00th=[ 39], 5.00th=[ 53], 10.00th=[ 61], 20.00th=[ 74], | 30.00th=[ 22676], 40.00th=[ 30278], 50.00th=[ 37487], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 63177], 90.00th=[ 84411], 95.00th=[102237], | 99.00th=[127402], 99.50th=[206570], 99.90th=[261096], 99.95th=[261096], | 99.99th=[261096] bw ( KiB/s): min= 63, max= 500, per=26.21%, avg=211.76, stdev=89.50, samples=55 iops : min= 3, max= 31, avg=12.47, stdev= 5.66, samples=55 write: IOPS=13, BW=221KiB/s (226kB/s)(6256KiB/28330msec); 0 zone resets clat (usec): min=1360, max=221824, avg=33518.37, stdev=38464.60 lat (usec): min=1363, max=221824, avg=33556.71, stdev=38441.12 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1647], 10.00th=[ 1811], 20.00th=[ 4178], | 30.00th=[ 7635], 40.00th=[ 11863], 50.00th=[ 19006], 60.00th=[ 28967], | 70.00th=[ 42730], 80.00th=[ 60031], 90.00th=[ 81265], 95.00th=[107480], | 99.00th=[187696], 99.50th=[200279], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 62, max= 414, per=26.04%, avg=221.33, stdev=89.56, samples=55 iops : min= 3, max= 25, avg=13.07, stdev= 5.63, samples=55 lat (usec) : 50=1.69%, 100=9.77%, 250=1.17%, 500=0.13% lat (msec) : 2=6.64%, 4=3.39%, 10=8.07%, 20=9.38%, 50=29.43% lat (msec) : 100=24.22%, 250=5.99%, 500=0.13% cpu : usr=0.06%, sys=5.61%, ctx=1342, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=808KiB/s (828kB/s), 199KiB/s-213KiB/s (204kB/s-218kB/s), io=23.4MiB (24.5MB), run=28330-29636msec WRITE: bw=850KiB/s (871kB/s), 204KiB/s-227KiB/s (208kB/s-232kB/s), io=24.6MiB (25.8MB), run=28330-29636msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145850: Wed Aug 26 08:35:03 2026 read: IOPS=5, BW=85.2KiB/s (87.3kB/s)(5920KiB/69450msec) clat (msec): min=6, max=377, avg=39.48, stdev=45.09 lat (msec): min=6, max=377, avg=39.48, stdev=45.09 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 51], 90.00th=[ 82], 95.00th=[ 133], | 99.00th=[ 236], 99.50th=[ 338], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 30, max= 319, per=26.98%, avg=92.00, stdev=63.00, samples=126 iops : min= 1, max= 19, avg= 5.02, stdev= 3.96, samples=126 write: IOPS=5, BW=91.7KiB/s (93.9kB/s)(6368KiB/69450msec); 0 zone resets clat (msec): min=49, max=498, avg=137.58, stdev=59.64 lat (msec): min=49, max=498, avg=137.59, stdev=59.64 clat percentiles (msec): | 1.00th=[ 55], 5.00th=[ 70], 10.00th=[ 79], 20.00th=[ 91], | 30.00th=[ 103], 40.00th=[ 109], 50.00th=[ 124], 60.00th=[ 138], | 70.00th=[ 157], 80.00th=[ 176], 90.00th=[ 222], 95.00th=[ 251], | 99.00th=[ 334], 99.50th=[ 368], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 30, max= 160, per=25.62%, avg=91.99, stdev=40.41, samples=136 iops : min= 1, max= 10, avg= 5.01, stdev= 2.62, samples=136 lat (msec) : 10=2.08%, 20=15.76%, 50=20.83%, 100=20.44%, 250=38.02% lat (msec) : 500=2.86% cpu : usr=0.04%, sys=1.10%, ctx=1271, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145851: Wed Aug 26 08:35:03 2026 read: IOPS=5, BW=82.0KiB/s (83.0kB/s)(5744KiB/70047msec) clat (msec): min=7, max=379, avg=40.08, stdev=45.00 lat (msec): min=7, max=379, avg=40.08, stdev=45.00 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 18], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 28], | 70.00th=[ 35], 80.00th=[ 58], 90.00th=[ 90], 95.00th=[ 122], | 99.00th=[ 213], 99.50th=[ 317], 99.90th=[ 380], 99.95th=[ 380], | 99.99th=[ 380] bw ( KiB/s): min= 23, max= 320, per=28.09%, avg=95.80, stdev=60.74, samples=117 iops : min= 1, max= 20, avg= 5.23, stdev= 3.90, samples=117 write: IOPS=5, BW=93.4KiB/s (95.7kB/s)(6544KiB/70047msec); 0 zone resets clat (msec): min=46, max=619, avg=135.96, stdev=60.93 lat (msec): min=46, max=619, avg=135.96, stdev=60.93 clat percentiles (msec): | 1.00th=[ 52], 5.00th=[ 66], 10.00th=[ 77], 20.00th=[ 92], | 30.00th=[ 101], 40.00th=[ 112], 50.00th=[ 124], 60.00th=[ 133], | 70.00th=[ 148], 80.00th=[ 176], 90.00th=[ 211], 95.00th=[ 259], | 99.00th=[ 342], 99.50th=[ 355], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 23, max= 191, per=26.25%, avg=94.22, stdev=41.28, samples=136 iops : min= 1, max= 11, avg= 5.15, stdev= 2.65, samples=136 lat (msec) : 10=2.34%, 20=15.23%, 50=18.88%, 100=22.79%, 250=37.37% lat (msec) : 500=3.26%, 750=0.13% cpu : usr=0.04%, sys=1.15%, ctx=1303, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145852: Wed Aug 26 08:35:03 2026 read: IOPS=5, BW=92.3KiB/s (94.5kB/s)(6256KiB/67770msec) clat (msec): min=7, max=526, avg=39.19, stdev=49.16 lat (msec): min=7, max=526, avg=39.19, stdev=49.16 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 27], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 78], 95.00th=[ 124], | 99.00th=[ 253], 99.50th=[ 384], 99.90th=[ 527], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 30, max= 318, per=30.21%, avg=103.00, stdev=70.69, samples=120 iops : min= 1, max= 19, avg= 5.71, stdev= 4.50, samples=120 write: IOPS=5, BW=89.0KiB/s (91.1kB/s)(6032KiB/67770msec); 0 zone resets clat (msec): min=44, max=427, avg=138.86, stdev=60.56 lat (msec): min=44, max=427, avg=138.86, stdev=60.56 clat percentiles (msec): | 1.00th=[ 56], 5.00th=[ 73], 10.00th=[ 81], 20.00th=[ 92], | 30.00th=[ 102], 40.00th=[ 112], 50.00th=[ 127], 60.00th=[ 140], | 70.00th=[ 153], 80.00th=[ 174], 90.00th=[ 218], 95.00th=[ 264], | 99.00th=[ 355], 99.50th=[ 405], 99.90th=[ 430], 99.95th=[ 430], | 99.99th=[ 430] bw ( KiB/s): min= 31, max= 192, per=24.62%, avg=88.38, stdev=38.04, samples=133 iops : min= 1, max= 12, avg= 4.79, stdev= 2.48, samples=133 lat (msec) : 10=2.21%, 20=17.45%, 50=21.88%, 100=20.18%, 250=34.64% lat (msec) : 500=3.52%, 750=0.13% cpu : usr=0.04%, sys=1.22%, ctx=1370, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145853: Wed Aug 26 08:35:03 2026 read: IOPS=5, BW=87.6KiB/s (89.7kB/s)(6032KiB/68861msec) clat (msec): min=6, max=422, avg=36.93, stdev=40.68 lat (msec): min=6, max=422, avg=36.94, stdev=40.68 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 24], 60.00th=[ 29], | 70.00th=[ 34], 80.00th=[ 46], 90.00th=[ 72], 95.00th=[ 124], | 99.00th=[ 211], 99.50th=[ 239], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 30, max= 286, per=29.54%, avg=100.73, stdev=65.19, samples=117 iops : min= 1, max= 17, avg= 5.57, stdev= 4.15, samples=117 write: IOPS=5, BW=90.8KiB/s (93.0kB/s)(6256KiB/68861msec); 0 zone resets clat (msec): min=50, max=612, avg=140.35, stdev=65.43 lat (msec): min=50, max=612, avg=140.36, stdev=65.43 clat percentiles (msec): | 1.00th=[ 59], 5.00th=[ 71], 10.00th=[ 80], 20.00th=[ 92], | 30.00th=[ 104], 40.00th=[ 114], 50.00th=[ 125], 60.00th=[ 138], | 70.00th=[ 150], 80.00th=[ 174], 90.00th=[ 226], 95.00th=[ 284], | 99.00th=[ 380], 99.50th=[ 401], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 31, max= 160, per=25.37%, avg=91.07, stdev=38.24, samples=135 iops : min= 1, max= 10, avg= 4.96, stdev= 2.47, samples=135 lat (msec) : 10=2.21%, 20=16.80%, 50=21.35%, 100=19.01%, 250=36.20% lat (msec) : 500=4.30%, 750=0.13% cpu : usr=0.04%, sys=1.12%, ctx=1253, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=342KiB/s (350kB/s), 82.0KiB/s-92.3KiB/s (83.0kB/s-94.5kB/s), io=23.4MiB (24.5MB), run=67770-70047msec WRITE: bw=360KiB/s (368kB/s), 89.0KiB/s-93.4KiB/s (91.1kB/s-95.7kB/s), io=24.6MiB (25.8MB), run=67770-70047msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145886: Wed Aug 26 08:35:19 2026 read: IOPS=1, BW=1679KiB/s (1719kB/s)(7168KiB/4270msec) clat (usec): min=572, max=707629, avg=288745.65, stdev=215895.50 lat (usec): min=573, max=707631, avg=288746.98, stdev=215895.84 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 570], 10.00th=[ 570], 20.00th=[193987], | 30.00th=[219153], 40.00th=[219153], 50.00th=[252707], 60.00th=[283116], | 70.00th=[283116], 80.00th=[367002], 90.00th=[708838], 95.00th=[708838], | 99.00th=[708838], 99.50th=[708838], 99.90th=[708838], 99.95th=[708838], | 99.99th=[708838] bw ( KiB/s): min= 1896, max= 4087, per=62.67%, avg=2512.25, stdev=1051.83, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1199KiB/s (1228kB/s)(5120KiB/4270msec); 0 zone resets clat (msec): min=207, max=603, avg=380.15, stdev=146.06 lat (msec): min=207, max=603, avg=380.26, stdev=146.05 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 305], 40.00th=[ 305], 50.00th=[ 388], 60.00th=[ 388], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 600], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1980, max= 2027, per=35.76%, avg=2007.33, stdev=24.42, samples=3 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=25.00%, 500=50.00%, 750=16.67% cpu : usr=0.00%, sys=12.20%, ctx=248, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145887: Wed Aug 26 08:35:19 2026 read: IOPS=0, BW=401KiB/s (411kB/s)(2048KiB/5108msec) clat (usec): min=935, max=205526, avg=103231.15, stdev=144667.93 lat (usec): min=936, max=205528, avg=103232.74, stdev=144668.16 clat percentiles (usec): | 1.00th=[ 938], 5.00th=[ 938], 10.00th=[ 938], 20.00th=[ 938], | 30.00th=[ 938], 40.00th=[ 938], 50.00th=[ 938], 60.00th=[206570], | 70.00th=[206570], 80.00th=[206570], 90.00th=[206570], 95.00th=[206570], | 99.00th=[206570], 99.50th=[206570], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 1381, max= 1980, per=41.92%, avg=1680.50, stdev=423.56, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2005KiB/s (2053kB/s)(10.0MiB/5108msec); 0 zone resets clat (msec): min=119, max=1180, avg=481.97, stdev=283.09 lat (msec): min=119, max=1180, avg=482.05, stdev=283.09 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 330], | 30.00th=[ 342], 40.00th=[ 372], 50.00th=[ 384], 60.00th=[ 418], | 70.00th=[ 502], 80.00th=[ 531], 90.00th=[ 651], 95.00th=[ 1183], | 99.00th=[ 1183], 99.50th=[ 1183], 99.90th=[ 1183], 99.95th=[ 1183], | 99.99th=[ 1183] bw ( KiB/s): min= 1381, max= 4031, per=38.99%, avg=2188.50, stdev=777.31, samples=8 iops : min= 1, max= 3, avg= 1.25, stdev= 0.71, samples=8 lat (usec) : 1000=8.33% lat (msec) : 250=16.67%, 500=50.00%, 750=16.67%, 2000=8.33% cpu : usr=0.02%, sys=11.47%, ctx=139, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145888: Wed Aug 26 08:35:19 2026 read: IOPS=1, BW=1225KiB/s (1255kB/s)(6144KiB/5014msec) clat (usec): min=684, max=273045, avg=90946.05, stdev=138830.46 lat (usec): min=685, max=273047, avg=90947.43, stdev=138830.57 clat percentiles (usec): | 1.00th=[ 685], 5.00th=[ 685], 10.00th=[ 685], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 1012], 50.00th=[ 1012], 60.00th=[ 2966], | 70.00th=[267387], 80.00th=[267387], 90.00th=[274727], 95.00th=[274727], | 99.00th=[274727], 99.50th=[274727], 99.90th=[274727], 99.95th=[274727], | 99.99th=[274727] bw ( KiB/s): min= 1896, max= 4055, per=65.94%, avg=2643.67, stdev=1222.97, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1225KiB/s (1255kB/s)(6144KiB/5014msec); 0 zone resets clat (msec): min=115, max=1525, avg=695.54, stdev=582.31 lat (msec): min=115, max=1525, avg=695.59, stdev=582.32 clat percentiles (msec): | 1.00th=[ 116], 5.00th=[ 116], 10.00th=[ 116], 20.00th=[ 305], | 30.00th=[ 305], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 592], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1519], 95.00th=[ 1519], | 99.00th=[ 1519], 99.50th=[ 1519], 99.90th=[ 1519], 99.95th=[ 1519], | 99.99th=[ 1519] bw ( KiB/s): min= 1458, max= 2043, per=33.07%, avg=1856.00, stdev=273.38, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=16.67% lat (msec) : 2=8.33%, 4=8.33%, 250=8.33%, 500=33.33%, 750=8.33% lat (msec) : 2000=16.67% cpu : usr=0.06%, sys=9.67%, ctx=165, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145889: Wed Aug 26 08:35:19 2026 read: IOPS=1, BW=1087KiB/s (1113kB/s)(5120KiB/4709msec) clat (usec): min=1084, max=887870, avg=283458.06, stdev=362953.57 lat (usec): min=1085, max=887872, avg=283459.41, stdev=362953.51 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1090], 10.00th=[ 1090], 20.00th=[ 1090], | 30.00th=[ 1270], 40.00th=[ 1270], 50.00th=[235930], 60.00th=[235930], | 70.00th=[291505], 80.00th=[291505], 90.00th=[884999], 95.00th=[884999], | 99.00th=[884999], 99.50th=[884999], 99.90th=[884999], 99.95th=[884999], | 99.99th=[884999] bw ( KiB/s): min= 3961, max= 3961, per=98.80%, avg=3961.00, stdev= 0.00, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1522KiB/s (1559kB/s)(7168KiB/4709msec); 0 zone resets clat (msec): min=152, max=1321, avg=420.67, stdev=401.94 lat (msec): min=152, max=1323, avg=421.02, stdev=402.53 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 236], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 300], 60.00th=[ 309], | 70.00th=[ 309], 80.00th=[ 338], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1514, max= 3792, per=41.48%, avg=2328.25, stdev=1002.93, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 2=16.67%, 250=25.00%, 500=41.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=10.79%, ctx=143, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4009KiB/s (4106kB/s), 401KiB/s-1679KiB/s (411kB/s-1719kB/s), io=20.0MiB (20.0MB), run=4270-5108msec WRITE: bw=5613KiB/s (5748kB/s), 1199KiB/s-2005KiB/s (1228kB/s-2053kB/s), io=28.0MiB (29.4MB), run=4270-5108msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145882: Wed Aug 26 08:35:20 2026 read: IOPS=1, BW=2001KiB/s (2049kB/s)(7168KiB/3582msec) clat (msec): min=111, max=609, avg=208.98, stdev=178.25 lat (msec): min=111, max=609, avg=208.98, stdev=178.25 clat percentiles (msec): | 1.00th=[ 112], 5.00th=[ 112], 10.00th=[ 112], 20.00th=[ 114], | 30.00th=[ 133], 40.00th=[ 133], 50.00th=[ 148], 60.00th=[ 171], | 70.00th=[ 171], 80.00th=[ 178], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1678, max= 4023, per=67.78%, avg=2323.60, stdev=962.40, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 write: IOPS=1, BW=1429KiB/s (1464kB/s)(5120KiB/3582msec); 0 zone resets clat (msec): min=189, max=533, avg=378.74, stdev=143.05 lat (msec): min=190, max=533, avg=379.09, stdev=142.66 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 271], 40.00th=[ 271], 50.00th=[ 435], 60.00th=[ 435], | 70.00th=[ 468], 80.00th=[ 468], 90.00th=[ 535], 95.00th=[ 535], | 99.00th=[ 535], 99.50th=[ 535], 99.90th=[ 535], 99.95th=[ 535], | 99.99th=[ 535] bw ( KiB/s): min= 1831, max= 2043, per=41.44%, avg=1989.00, stdev=105.35, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=3.97%, ctx=61, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145883: Wed Aug 26 08:35:20 2026 read: IOPS=0, BW=343KiB/s (351kB/s)(2048KiB/5973msec) clat (msec): min=237, max=258, avg=248.27, stdev=14.89 lat (msec): min=237, max=258, avg=248.27, stdev=14.89 clat percentiles (msec): | 1.00th=[ 239], 5.00th=[ 239], 10.00th=[ 239], 20.00th=[ 239], | 30.00th=[ 239], 40.00th=[ 239], 50.00th=[ 239], 60.00th=[ 259], | 70.00th=[ 259], 80.00th=[ 259], 90.00th=[ 259], 95.00th=[ 259], | 99.00th=[ 259], 99.50th=[ 259], 99.90th=[ 259], 99.95th=[ 259], | 99.99th=[ 259] bw ( KiB/s): min= 1582, max= 2011, per=52.41%, avg=1796.50, stdev=303.35, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1714KiB/s (1756kB/s)(10.0MiB/5973msec); 0 zone resets clat (msec): min=178, max=1323, avg=529.29, stdev=358.30 lat (msec): min=178, max=1323, avg=529.39, stdev=358.30 clat percentiles (msec): | 1.00th=[ 180], 5.00th=[ 180], 10.00th=[ 180], 20.00th=[ 190], | 30.00th=[ 211], 40.00th=[ 259], 50.00th=[ 422], 60.00th=[ 575], | 70.00th=[ 693], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 1831, max= 6083, per=62.61%, avg=3005.50, stdev=1731.75, samples=6 iops : min= 1, max= 5, avg= 2.00, stdev= 1.67, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=3.77%, ctx=100, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145884: Wed Aug 26 08:35:20 2026 read: IOPS=1, BW=1065KiB/s (1091kB/s)(6144KiB/5767msec) clat (msec): min=75, max=546, avg=248.30, stdev=178.49 lat (msec): min=75, max=546, avg=248.30, stdev=178.49 clat percentiles (msec): | 1.00th=[ 77], 5.00th=[ 77], 10.00th=[ 77], 20.00th=[ 109], | 30.00th=[ 109], 40.00th=[ 136], 50.00th=[ 136], 60.00th=[ 309], | 70.00th=[ 317], 80.00th=[ 317], 90.00th=[ 550], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 1831, max= 4055, per=72.29%, avg=2478.25, stdev=1054.89, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1065KiB/s (1091kB/s)(6144KiB/5767msec); 0 zone resets clat (msec): min=128, max=1596, avg=699.99, stdev=629.55 lat (msec): min=128, max=1596, avg=700.06, stdev=629.55 clat percentiles (msec): | 1.00th=[ 129], 5.00th=[ 129], 10.00th=[ 129], 20.00th=[ 169], | 30.00th=[ 169], 40.00th=[ 321], 50.00th=[ 321], 60.00th=[ 634], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1603], 95.00th=[ 1603], | 99.00th=[ 1603], 99.50th=[ 1603], 99.90th=[ 1603], 99.95th=[ 1603], | 99.99th=[ 1603] bw ( KiB/s): min= 1753, max= 4055, per=49.57%, avg=2379.40, stdev=944.39, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=33.33%, 500=25.00%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=2.55%, ctx=56, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145885: Wed Aug 26 08:35:20 2026 read: IOPS=1, BW=1302KiB/s (1333kB/s)(5120KiB/3933msec) clat (msec): min=121, max=280, avg=185.77, stdev=60.03 lat (msec): min=121, max=280, avg=185.77, stdev=60.03 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 171], 60.00th=[ 171], | 70.00th=[ 203], 80.00th=[ 203], 90.00th=[ 279], 95.00th=[ 279], | 99.00th=[ 279], 99.50th=[ 279], 99.90th=[ 279], 99.95th=[ 279], | 99.99th=[ 279] bw ( KiB/s): min= 1831, max= 4079, per=77.33%, avg=2651.00, stdev=1241.22, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1823KiB/s (1866kB/s)(7168KiB/3933msec); 0 zone resets clat (msec): min=180, max=918, avg=423.62, stdev=286.68 lat (msec): min=180, max=918, avg=423.71, stdev=286.68 clat percentiles (msec): | 1.00th=[ 182], 5.00th=[ 182], 10.00th=[ 182], 20.00th=[ 203], | 30.00th=[ 230], 40.00th=[ 230], 50.00th=[ 355], 60.00th=[ 355], | 70.00th=[ 355], 80.00th=[ 726], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 1607, max= 4087, per=61.01%, avg=2928.25, stdev=1287.10, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=2.67%, ctx=50, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3429KiB/s (3511kB/s), 343KiB/s-2001KiB/s (351kB/s-2049kB/s), io=20.0MiB (20.0MB), run=3582-5973msec WRITE: bw=4800KiB/s (4915kB/s), 1065KiB/s-1823KiB/s (1091kB/s-1866kB/s), io=28.0MiB (29.4MB), run=3582-5973msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=145895: Wed Aug 26 08:35:32 2026 read: IOPS=1, BW=4840KiB/s (4956kB/s)(12.0MiB/2539msec) clat (msec): min=720, max=892, avg=833.57, stdev=97.81 lat (msec): min=720, max=892, avg=833.58, stdev=97.81 clat percentiles (msec): | 1.00th=[ 718], 5.00th=[ 718], 10.00th=[ 718], 20.00th=[ 718], | 30.00th=[ 718], 40.00th=[ 885], 50.00th=[ 885], 60.00th=[ 885], | 70.00th=[ 894], 80.00th=[ 894], 90.00th=[ 894], 95.00th=[ 894], | 99.00th=[ 894], 99.50th=[ 894], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=18.75%, ctx=385, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145896: Wed Aug 26 08:35:32 2026 read: IOPS=0, BW=1402KiB/s (1435kB/s)(4096KiB/2922msec) clat (nsec): min=867075k, max=867075k, avg=867075486.00, stdev= 0.00 lat (nsec): min=867078k, max=867078k, avg=867077769.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 869], 5.00th=[ 869], 10.00th=[ 869], 20.00th=[ 869], | 30.00th=[ 869], 40.00th=[ 869], 50.00th=[ 869], 60.00th=[ 869], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 869], 95.00th=[ 869], | 99.00th=[ 869], 99.50th=[ 869], 99.90th=[ 869], 99.95th=[ 869], | 99.99th=[ 869] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2804KiB/s (2871kB/s)(8192KiB/2922msec); 0 zone resets clat (msec): min=291, max=1675, avg=983.56, stdev=979.09 lat (msec): min=291, max=1676, avg=983.92, stdev=978.99 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 292], 50.00th=[ 292], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8175, max= 8175, per=80.73%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.28%, ctx=191, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145897: Wed Aug 26 08:35:32 2026 write: IOPS=0, BW=3797KiB/s (3888kB/s)(12.0MiB/3236msec); 0 zone resets clat (msec): min=757, max=1316, avg=1052.95, stdev=280.92 lat (msec): min=757, max=1318, avg=1053.70, stdev=281.40 clat percentiles (msec): | 1.00th=[ 760], 5.00th=[ 760], 10.00th=[ 760], 20.00th=[ 760], | 30.00th=[ 760], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1318], 80.00th=[ 1318], 90.00th=[ 1318], 95.00th=[ 1318], | 99.00th=[ 1318], 99.50th=[ 1318], 99.90th=[ 1318], 99.95th=[ 1318], | 99.99th=[ 1318] bw ( KiB/s): min= 8126, max= 8175, per=80.49%, avg=8150.50, stdev=34.65, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.91%, ctx=51, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145898: Wed Aug 26 08:35:32 2026 write: IOPS=1, BW=5611KiB/s (5746kB/s)(12.0MiB/2190msec); 0 zone resets clat (msec): min=378, max=1357, avg=720.24, stdev=552.33 lat (msec): min=378, max=1357, avg=720.68, stdev=552.28 clat percentiles (msec): | 1.00th=[ 380], 5.00th=[ 380], 10.00th=[ 380], 20.00th=[ 380], | 30.00th=[ 380], 40.00th=[ 426], 50.00th=[ 426], 60.00th=[ 426], | 70.00th=[ 1351], 80.00th=[ 1351], 90.00th=[ 1351], 95.00th=[ 1351], | 99.00th=[ 1351], 99.50th=[ 1351], 99.90th=[ 1351], 99.95th=[ 1351], | 99.99th=[ 1351] bw ( KiB/s): min= 6860, max= 8175, per=74.24%, avg=7517.50, stdev=929.85, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.66%, ctx=39, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5607KiB/s (5742kB/s), 1402KiB/s-4840KiB/s (1435kB/s-4956kB/s), io=16.0MiB (16.8MB), run=2539-2922msec WRITE: bw=9.89MiB/s (10.4MB/s), 2804KiB/s-5611KiB/s (2871kB/s-5746kB/s), io=32.0MiB (33.6MB), run=2190-3236msec rand-rw: (groupid=0, jobs=1): err= 0: pid=145900: Wed Aug 26 08:35:33 2026 read: IOPS=1, BW=4161KiB/s (4261kB/s)(12.0MiB/2953msec) clat (msec): min=418, max=1836, avg=983.98, stdev=751.19 lat (msec): min=418, max=1836, avg=983.98, stdev=751.19 clat percentiles (msec): | 1.00th=[ 418], 5.00th=[ 418], 10.00th=[ 418], 20.00th=[ 418], | 30.00th=[ 418], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 1838], 80.00th=[ 1838], 90.00th=[ 1838], 95.00th=[ 1838], | 99.00th=[ 1838], 99.50th=[ 1838], 99.90th=[ 1838], 99.95th=[ 1838], | 99.99th=[ 1838] bw ( KiB/s): min= 7742, max= 8159, per=100.00%, avg=7950.50, stdev=294.86, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.52%, ctx=45, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145901: Wed Aug 26 08:35:33 2026 read: IOPS=0, BW=1313KiB/s (1344kB/s)(4096KiB/3120msec) clat (nsec): min=1098.6M, max=1098.6M, avg=1098593251.00, stdev= 0.00 lat (nsec): min=1098.6M, max=1098.6M, avg=1098596433.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1099], 5.00th=[ 1099], 10.00th=[ 1099], 20.00th=[ 1099], | 30.00th=[ 1099], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8047, max= 8047, per=100.00%, avg=8047.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2626KiB/s (2689kB/s)(8192KiB/3120msec); 0 zone resets clat (msec): min=913, max=1102, avg=1007.85, stdev=134.08 lat (msec): min=914, max=1103, avg=1008.80, stdev=133.35 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 1099], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8159, max= 8159, per=80.75%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=4.42%, ctx=54, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145902: Wed Aug 26 08:35:33 2026 write: IOPS=0, BW=3789KiB/s (3880kB/s)(12.0MiB/3243msec); 0 zone resets clat (msec): min=465, max=1824, avg=1079.96, stdev=688.73 lat (msec): min=465, max=1824, avg=1080.35, stdev=688.75 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 1821], 80.00th=[ 1821], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 7742, max= 8192, per=78.85%, avg=7967.00, stdev=318.20, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=3.55%, ctx=36, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=145903: Wed Aug 26 08:35:33 2026 write: IOPS=1, BW=5988KiB/s (6132kB/s)(12.0MiB/2052msec); 0 zone resets clat (msec): min=336, max=981, avg=683.31, stdev=325.59 lat (msec): min=336, max=982, avg=683.75, stdev=325.68 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 338], 40.00th=[ 735], 50.00th=[ 735], 60.00th=[ 735], | 70.00th=[ 986], 80.00th=[ 986], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 6360, max= 8047, per=71.29%, avg=7203.50, stdev=1192.89, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=7.84%, ctx=52, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5251KiB/s (5377kB/s), 1313KiB/s-4161KiB/s (1344kB/s-4261kB/s), io=16.0MiB (16.8MB), run=2953-3120msec WRITE: bw=9.87MiB/s (10.3MB/s), 2626KiB/s-5988KiB/s (2689kB/s-6132kB/s), io=32.0MiB (33.6MB), run=2052-3243msec