== sanity test 398b: DIO and buffer IO race ============== 12:55:50 (1772474150) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 3.57241 s, 14.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147639: Mon Mar 2 12:57:19 2026 read: IOPS=19, BW=77.8KiB/s (79.7kB/s)(5992KiB/77014msec) clat (usec): min=32, max=651325, avg=25028.68, stdev=25513.85 lat (usec): min=32, max=651325, avg=25030.14, stdev=25514.09 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 72], 10.00th=[ 8160], 20.00th=[ 12256], | 30.00th=[ 15139], 40.00th=[ 17957], 50.00th=[ 20579], 60.00th=[ 24249], | 70.00th=[ 29492], 80.00th=[ 35914], 90.00th=[ 45351], 95.00th=[ 54264], | 99.00th=[ 74974], 99.50th=[115868], 99.90th=[350225], 99.95th=[650118], | 99.99th=[650118] bw ( KiB/s): min= 7, max= 168, per=25.23%, avg=77.22, stdev=26.82, samples=152 iops : min= 1, max= 42, avg=18.77, stdev= 6.75, samples=152 write: IOPS=20, BW=81.8KiB/s (83.7kB/s)(6296KiB/77014msec); 0 zone resets clat (usec): min=808, max=262870, avg=24985.70, stdev=24328.49 lat (usec): min=810, max=262871, avg=24990.67, stdev=24330.05 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1336], 10.00th=[ 1762], 20.00th=[ 3523], | 30.00th=[ 6783], 40.00th=[ 13960], 50.00th=[ 19792], 60.00th=[ 25560], | 70.00th=[ 32900], 80.00th=[ 41681], 90.00th=[ 55313], 95.00th=[ 68682], | 99.00th=[104334], 99.50th=[114820], 99.90th=[217056], 99.95th=[263193], | 99.99th=[263193] bw ( KiB/s): min= 31, max= 183, per=25.54%, avg=81.72, stdev=27.30, samples=151 iops : min= 7, max= 45, avg=19.90, stdev= 6.87, samples=151 lat (usec) : 50=0.81%, 100=2.44%, 250=0.49%, 500=0.20%, 750=0.03% lat (usec) : 1000=0.33% lat (msec) : 2=6.25%, 4=4.82%, 10=9.18%, 20=24.64%, 50=40.40% lat (msec) : 100=9.51%, 250=0.81%, 500=0.07%, 750=0.03% cpu : usr=0.09%, sys=9.26%, ctx=7011, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147640: Mon Mar 2 12:57:19 2026 read: IOPS=19, BW=76.7KiB/s (78.6kB/s)(5940KiB/77398msec) clat (usec): min=15, max=676402, avg=25557.67, stdev=26180.72 lat (usec): min=16, max=676404, avg=25558.93, stdev=26180.76 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 62], 10.00th=[ 8094], 20.00th=[ 12649], | 30.00th=[ 15401], 40.00th=[ 17957], 50.00th=[ 21103], 60.00th=[ 25035], | 70.00th=[ 30016], 80.00th=[ 36439], 90.00th=[ 45351], 95.00th=[ 54789], | 99.00th=[ 99091], 99.50th=[131597], 99.90th=[346031], 99.95th=[675283], | 99.99th=[675283] bw ( KiB/s): min= 8, max= 167, per=25.14%, avg=76.93, stdev=27.72, samples=152 iops : min= 2, max= 41, avg=18.68, stdev= 6.98, samples=152 write: IOPS=20, BW=82.0KiB/s (83.0kB/s)(6348KiB/77398msec); 0 zone resets clat (usec): min=782, max=235524, avg=24692.30, stdev=25179.64 lat (usec): min=784, max=235525, avg=24694.15, stdev=25179.44 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1369], 10.00th=[ 1778], 20.00th=[ 3458], | 30.00th=[ 6259], 40.00th=[ 12387], 50.00th=[ 18482], 60.00th=[ 24511], | 70.00th=[ 31065], 80.00th=[ 41681], 90.00th=[ 55313], 95.00th=[ 71828], | 99.00th=[114820], 99.50th=[137364], 99.90th=[200279], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 16, max= 196, per=25.61%, avg=81.96, stdev=28.31, samples=152 iops : min= 4, max= 49, avg=19.97, stdev= 7.11, samples=152 lat (usec) : 20=0.03%, 50=0.78%, 100=2.70%, 250=0.42%, 500=0.10% lat (usec) : 1000=0.29% lat (msec) : 2=5.79%, 4=5.89%, 10=9.24%, 20=24.61%, 50=39.71% lat (msec) : 100=9.18%, 250=1.17%, 500=0.03%, 750=0.03% cpu : usr=0.09%, sys=9.16%, ctx=7024, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147641: Mon Mar 2 12:57:19 2026 read: IOPS=19, BW=79.9KiB/s (81.8kB/s)(6028KiB/75448msec) clat (usec): min=30, max=204247, avg=23986.72, stdev=17978.31 lat (usec): min=30, max=204248, avg=23988.04, stdev=17977.94 clat percentiles (usec): | 1.00th=[ 41], 5.00th=[ 56], 10.00th=[ 6063], 20.00th=[ 11863], | 30.00th=[ 14877], 40.00th=[ 17171], 50.00th=[ 20055], 60.00th=[ 24511], | 70.00th=[ 28967], 80.00th=[ 35390], 90.00th=[ 45351], 95.00th=[ 54264], | 99.00th=[ 85459], 99.50th=[105382], 99.90th=[191890], 99.95th=[204473], | 99.99th=[204473] bw ( KiB/s): min= 8, max= 160, per=26.25%, avg=80.31, stdev=29.13, samples=148 iops : min= 2, max= 40, avg=19.55, stdev= 7.31, samples=148 write: IOPS=20, BW=82.0KiB/s (84.0kB/s)(6260KiB/75448msec); 0 zone resets clat (usec): min=794, max=702179, avg=24952.05, stdev=29204.71 lat (usec): min=794, max=702182, avg=24953.75, stdev=29204.62 clat percentiles (usec): | 1.00th=[ 1004], 5.00th=[ 1352], 10.00th=[ 1778], 20.00th=[ 3294], | 30.00th=[ 6325], 40.00th=[ 13173], 50.00th=[ 20055], 60.00th=[ 26084], | 70.00th=[ 32113], 80.00th=[ 41157], 90.00th=[ 54264], 95.00th=[ 66847], | 99.00th=[106431], 99.50th=[139461], 99.90th=[193987], 99.95th=[700449], | 99.99th=[700449] bw ( KiB/s): min= 24, max= 152, per=26.04%, avg=83.32, stdev=26.15, samples=148 iops : min= 6, max= 38, avg=20.30, stdev= 6.57, samples=148 lat (usec) : 50=1.30%, 100=2.77%, 250=0.49%, 500=0.13%, 750=0.03% lat (usec) : 1000=0.52% lat (msec) : 2=5.34%, 4=6.09%, 10=8.59%, 20=24.45%, 50=40.23% lat (msec) : 100=9.15%, 250=0.88%, 750=0.03% cpu : usr=0.10%, sys=9.20%, ctx=6884, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147642: Mon Mar 2 12:57:19 2026 read: IOPS=19, BW=77.2KiB/s (79.1kB/s)(6052KiB/78365msec) clat (usec): min=33, max=199355, avg=25069.50, stdev=19229.20 lat (usec): min=33, max=199356, avg=25073.81, stdev=19229.46 clat percentiles (usec): | 1.00th=[ 48], 5.00th=[ 61], 10.00th=[ 7046], 20.00th=[ 12125], | 30.00th=[ 15008], 40.00th=[ 17957], 50.00th=[ 21365], 60.00th=[ 25822], | 70.00th=[ 30802], 80.00th=[ 36963], 90.00th=[ 46400], 95.00th=[ 55837], | 99.00th=[ 83362], 99.50th=[124257], 99.90th=[196084], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 7, max= 183, per=25.42%, avg=77.79, stdev=27.15, samples=153 iops : min= 1, max= 45, avg=18.91, stdev= 6.79, samples=153 write: IOPS=19, BW=79.6KiB/s (81.5kB/s)(6236KiB/78365msec); 0 zone resets clat (usec): min=822, max=760239, avg=25729.55, stdev=31298.62 lat (usec): min=823, max=760242, avg=25733.74, stdev=31296.91 clat percentiles (usec): | 1.00th=[ 1012], 5.00th=[ 1385], 10.00th=[ 1942], 20.00th=[ 3949], | 30.00th=[ 7504], 40.00th=[ 13960], 50.00th=[ 19268], 60.00th=[ 25035], | 70.00th=[ 32113], 80.00th=[ 42206], 90.00th=[ 57410], 95.00th=[ 69731], | 99.00th=[102237], 99.50th=[139461], 99.90th=[337642], 99.95th=[759170], | 99.99th=[759170] bw ( KiB/s): min= 8, max= 160, per=24.83%, avg=79.44, stdev=27.62, samples=154 iops : min= 2, max= 40, avg=19.32, stdev= 6.93, samples=154 lat (usec) : 50=0.78%, 100=3.22%, 250=0.39%, 500=0.13%, 1000=0.46% lat (msec) : 2=4.92%, 4=4.95%, 10=9.02%, 20=24.97%, 50=40.43% lat (msec) : 100=9.80%, 250=0.88%, 500=0.03%, 1000=0.03% cpu : usr=0.10%, sys=9.21%, ctx=7097, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=306KiB/s (314kB/s), 76.7KiB/s-79.9KiB/s (78.6kB/s-81.8kB/s), io=23.4MiB (24.6MB), run=75448-78365msec WRITE: bw=321KiB/s (329kB/s), 79.6KiB/s-82.0KiB/s (81.5kB/s-84.0kB/s), io=24.6MiB (25.7MB), run=75448-78365msec fio: pid=147636, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=147634: Mon Mar 2 12:58:34 2026 read: IOPS=9, BW=39.4KiB/s (40.4kB/s)(5992KiB/151953msec) clat (msec): min=4, max=653, avg=22.23, stdev=27.83 lat (msec): min=4, max=653, avg=22.23, stdev=27.83 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 19], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 44], 95.00th=[ 58], | 99.00th=[ 105], 99.50th=[ 131], 99.90th=[ 372], 99.95th=[ 651], | 99.99th=[ 651] bw ( KiB/s): min= 7, max= 135, per=26.78%, avg=39.91, stdev=26.15, samples=295 iops : min= 1, max= 33, avg= 9.46, stdev= 6.58, samples=295 write: IOPS=10, BW=41.4KiB/s (42.4kB/s)(6296KiB/151953msec); 0 zone resets clat (msec): min=21, max=247, avg=75.20, stdev=36.67 lat (msec): min=21, max=247, avg=75.21, stdev=36.67 clat percentiles (msec): | 1.00th=[ 29], 5.00th=[ 34], 10.00th=[ 40], 20.00th=[ 46], | 30.00th=[ 53], 40.00th=[ 59], 50.00th=[ 66], 60.00th=[ 74], | 70.00th=[ 85], 80.00th=[ 101], 90.00th=[ 128], 95.00th=[ 150], | 99.00th=[ 186], 99.50th=[ 228], 99.90th=[ 245], 99.95th=[ 247], | 99.99th=[ 247] bw ( KiB/s): min= 7, max= 88, per=26.33%, avg=41.08, stdev=18.30, samples=301 iops : min= 1, max= 22, avg= 9.75, stdev= 4.65, samples=301 lat (msec) : 10=12.37%, 20=19.40%, 50=27.21%, 100=30.18%, 250=10.74% lat (msec) : 500=0.07%, 750=0.03% cpu : usr=0.05%, sys=2.44%, ctx=5773, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147635: Mon Mar 2 12:58:34 2026 read: IOPS=9, BW=38.0KiB/s (39.9kB/s)(5940KiB/152422msec) clat (msec): min=4, max=708, avg=21.49, stdev=26.30 lat (msec): min=4, max=708, avg=21.50, stdev=26.30 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 9], | 30.00th=[ 11], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 44], 95.00th=[ 58], | 99.00th=[ 110], 99.50th=[ 128], 99.90th=[ 182], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 7, max= 119, per=26.91%, avg=40.10, stdev=25.78, samples=291 iops : min= 1, max= 29, avg= 9.51, stdev= 6.49, samples=291 write: IOPS=10, BW=41.6KiB/s (42.6kB/s)(6348KiB/152422msec); 0 zone resets clat (msec): min=20, max=365, avg=75.75, stdev=39.63 lat (msec): min=20, max=365, avg=75.75, stdev=39.63 clat percentiles (msec): | 1.00th=[ 28], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 45], | 30.00th=[ 52], 40.00th=[ 57], 50.00th=[ 65], 60.00th=[ 73], | 70.00th=[ 86], 80.00th=[ 104], 90.00th=[ 129], 95.00th=[ 155], | 99.00th=[ 211], 99.50th=[ 224], 99.90th=[ 305], 99.95th=[ 368], | 99.99th=[ 368] bw ( KiB/s): min= 7, max= 88, per=26.46%, avg=41.27, stdev=18.81, samples=302 iops : min= 1, max= 22, avg= 9.80, stdev= 4.78, samples=302 lat (msec) : 10=13.38%, 20=18.52%, 50=27.41%, 100=28.52%, 250=12.01% lat (msec) : 500=0.13%, 750=0.03% cpu : usr=0.06%, sys=2.43%, ctx=5801, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=147636: Mon Mar 2 12:58:34 2026 read: IOPS=9, BW=36.3KiB/s (37.2kB/s)(4740KiB/130411msec) clat (msec): min=3, max=220, avg=24.23, stdev=22.76 lat (msec): min=3, max=220, avg=24.23, stdev=22.76 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 12], 40.00th=[ 14], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 26], 80.00th=[ 35], 90.00th=[ 51], 95.00th=[ 67], | 99.00th=[ 110], 99.50th=[ 163], 99.90th=[ 207], 99.95th=[ 222], | 99.99th=[ 222] bw ( KiB/s): min= 7, max= 127, per=25.02%, avg=37.27, stdev=22.97, samples=249 iops : min= 1, max= 31, avg= 8.78, stdev= 5.77, samples=249 write: IOPS=9, BW=37.0KiB/s (38.9kB/s)(4952KiB/130411msec); 0 zone resets clat (msec): min=23, max=749, avg=81.91, stdev=44.44 lat (msec): min=23, max=749, avg=81.92, stdev=44.44 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 37], 10.00th=[ 42], 20.00th=[ 50], | 30.00th=[ 55], 40.00th=[ 64], 50.00th=[ 72], 60.00th=[ 82], | 70.00th=[ 94], 80.00th=[ 110], 90.00th=[ 136], 95.00th=[ 157], | 99.00th=[ 226], 99.50th=[ 264], 99.90th=[ 330], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 7, max= 95, per=24.10%, avg=37.60, stdev=17.82, samples=258 iops : min= 1, max= 23, avg= 8.86, stdev= 4.53, samples=258 lat (msec) : 4=0.04%, 10=10.64%, 20=18.61%, 50=25.50%, 100=31.48% lat (msec) : 250=13.33%, 500=0.33%, 750=0.04% cpu : usr=0.05%, sys=2.31%, ctx=4113, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1186,1238,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147637: Mon Mar 2 12:58:34 2026 read: IOPS=9, BW=39.8KiB/s (40.8kB/s)(6052KiB/151996msec) clat (msec): min=4, max=375, avg=22.24, stdev=23.06 lat (msec): min=4, max=375, avg=22.25, stdev=23.06 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 11], 40.00th=[ 14], 50.00th=[ 16], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 29], 90.00th=[ 47], 95.00th=[ 64], | 99.00th=[ 111], 99.50th=[ 132], 99.90th=[ 251], 99.95th=[ 376], | 99.99th=[ 376] bw ( KiB/s): min= 7, max= 136, per=27.61%, avg=41.15, stdev=25.81, samples=289 iops : min= 1, max= 34, avg= 9.77, stdev= 6.51, samples=289 write: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6236KiB/151996msec); 0 zone resets clat (msec): min=22, max=803, avg=75.72, stdev=41.82 lat (msec): min=22, max=803, avg=75.73, stdev=41.82 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 35], 10.00th=[ 39], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 58], 50.00th=[ 66], 60.00th=[ 74], | 70.00th=[ 88], 80.00th=[ 102], 90.00th=[ 126], 95.00th=[ 146], | 99.00th=[ 205], 99.50th=[ 224], 99.90th=[ 355], 99.95th=[ 802], | 99.99th=[ 802] bw ( KiB/s): min= 7, max= 88, per=26.07%, avg=40.67, stdev=18.54, samples=301 iops : min= 1, max= 22, avg= 9.65, stdev= 4.71, samples=301 lat (msec) : 10=12.53%, 20=19.95%, 50=26.46%, 100=29.88%, 250=10.90% lat (msec) : 500=0.23%, 1000=0.03% cpu : usr=0.05%, sys=2.50%, ctx=5764, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=149KiB/s (153kB/s), 36.3KiB/s-39.8KiB/s (37.2kB/s-40.8kB/s), io=22.2MiB (23.3MB), run=130411-152422msec WRITE: bw=156KiB/s (160kB/s), 37.0KiB/s-41.6KiB/s (38.9kB/s-42.6kB/s), io=23.3MiB (24.4MB), run=130411-152422msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147678: Mon Mar 2 12:58:58 2026 read: IOPS=20, BW=323KiB/s (331kB/s)(5920KiB/18318msec) clat (usec): min=23, max=236351, avg=24942.18, stdev=22495.01 lat (usec): min=24, max=236353, avg=24943.87, stdev=22494.80 clat percentiles (usec): | 1.00th=[ 40], 5.00th=[ 55], 10.00th=[ 59], 20.00th=[ 2245], | 30.00th=[ 15401], 40.00th=[ 20055], 50.00th=[ 23200], 60.00th=[ 26346], | 70.00th=[ 30278], 80.00th=[ 36963], 90.00th=[ 47449], 95.00th=[ 53740], | 99.00th=[ 92799], 99.50th=[160433], 99.90th=[235930], 99.95th=[235930], | 99.99th=[235930] bw ( KiB/s): min= 128, max= 542, per=24.56%, avg=321.00, stdev=102.36, samples=36 iops : min= 8, max= 33, avg=19.31, stdev= 6.32, samples=36 write: IOPS=21, BW=348KiB/s (356kB/s)(6368KiB/18318msec); 0 zone resets clat (usec): min=1092, max=111063, avg=22373.96, stdev=20993.46 lat (usec): min=1093, max=111066, avg=22379.99, stdev=20994.05 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1926], 10.00th=[ 2540], 20.00th=[ 3916], | 30.00th=[ 6259], 40.00th=[ 10159], 50.00th=[ 15795], 60.00th=[ 22938], | 70.00th=[ 28967], 80.00th=[ 39060], 90.00th=[ 53740], 95.00th=[ 66323], | 99.00th=[ 87557], 99.50th=[107480], 99.90th=[110625], 99.95th=[110625], | 99.99th=[110625] bw ( KiB/s): min= 95, max= 571, per=25.28%, avg=347.64, stdev=121.70, samples=36 iops : min= 5, max= 35, avg=20.97, stdev= 7.60, samples=36 lat (usec) : 50=1.30%, 100=6.38%, 250=1.69%, 1000=0.13% lat (msec) : 2=2.99%, 4=7.81%, 10=10.68%, 20=17.45%, 50=41.02% lat (msec) : 100=9.90%, 250=0.65% cpu : usr=0.09%, sys=10.62%, ctx=1635, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147679: Mon Mar 2 12:58:58 2026 read: IOPS=19, BW=319KiB/s (326kB/s)(5744KiB/18026msec) clat (usec): min=39, max=151974, avg=25896.62, stdev=19611.41 lat (usec): min=40, max=151975, avg=25897.98, stdev=19611.77 clat percentiles (usec): | 1.00th=[ 42], 5.00th=[ 56], 10.00th=[ 71], 20.00th=[ 10421], | 30.00th=[ 17695], 40.00th=[ 20841], 50.00th=[ 24249], 60.00th=[ 28705], | 70.00th=[ 32900], 80.00th=[ 39584], 90.00th=[ 47973], 95.00th=[ 63177], | 99.00th=[ 88605], 99.50th=[ 92799], 99.90th=[152044], 99.95th=[152044], | 99.99th=[152044] bw ( KiB/s): min= 32, max= 528, per=24.33%, avg=317.94, stdev=95.12, samples=35 iops : min= 2, max= 33, avg=19.11, stdev= 5.92, samples=35 write: IOPS=22, BW=363KiB/s (372kB/s)(6544KiB/18026msec); 0 zone resets clat (usec): min=1353, max=432606, avg=21146.01, stdev=29070.59 lat (usec): min=1355, max=432608, avg=21157.16, stdev=29069.20 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1860], 10.00th=[ 2606], 20.00th=[ 4146], | 30.00th=[ 5932], 40.00th=[ 8160], 50.00th=[ 12387], 60.00th=[ 18744], | 70.00th=[ 25297], 80.00th=[ 34866], 90.00th=[ 46924], 95.00th=[ 64226], | 99.00th=[ 95945], 99.50th=[106431], 99.90th=[434111], 99.95th=[434111], | 99.99th=[434111] bw ( KiB/s): min= 128, max= 699, per=26.39%, avg=362.80, stdev=116.20, samples=35 iops : min= 8, max= 43, avg=21.94, stdev= 7.23, samples=35 lat (usec) : 50=1.04%, 100=5.60%, 250=1.30%, 500=0.52%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=3.52%, 4=6.51%, 10=14.19%, 20=17.06%, 50=41.15% lat (msec) : 100=8.20%, 250=0.52%, 500=0.13% cpu : usr=0.12%, sys=10.82%, ctx=1628, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147680: Mon Mar 2 12:58:58 2026 read: IOPS=21, BW=345KiB/s (353kB/s)(6256KiB/18155msec) clat (usec): min=33, max=420027, avg=26235.72, stdev=27804.19 lat (usec): min=33, max=420028, avg=26240.11, stdev=27803.52 clat percentiles (usec): | 1.00th=[ 36], 5.00th=[ 56], 10.00th=[ 65], 20.00th=[ 9765], | 30.00th=[ 16581], 40.00th=[ 20317], 50.00th=[ 23462], 60.00th=[ 27919], | 70.00th=[ 32375], 80.00th=[ 38536], 90.00th=[ 48497], 95.00th=[ 57410], | 99.00th=[ 94897], 99.50th=[149947], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 54, max= 539, per=26.61%, avg=347.86, stdev=111.08, samples=35 iops : min= 3, max= 33, avg=21.00, stdev= 6.88, samples=35 write: IOPS=20, BW=332KiB/s (340kB/s)(6032KiB/18155msec); 0 zone resets clat (usec): min=1360, max=137131, avg=20230.62, stdev=21529.75 lat (usec): min=1362, max=137133, avg=20232.95, stdev=21529.73 clat percentiles (usec): | 1.00th=[ 1680], 5.00th=[ 1975], 10.00th=[ 2540], 20.00th=[ 3884], | 30.00th=[ 5407], 40.00th=[ 7373], 50.00th=[ 11469], 60.00th=[ 17957], | 70.00th=[ 25297], 80.00th=[ 34341], 90.00th=[ 50070], 95.00th=[ 67634], | 99.00th=[ 87557], 99.50th=[119014], 99.90th=[137364], 99.95th=[137364], | 99.99th=[137364] bw ( KiB/s): min= 32, max= 542, per=24.02%, avg=330.31, stdev=128.92, samples=35 iops : min= 2, max= 33, avg=19.89, stdev= 8.05, samples=35 lat (usec) : 50=1.69%, 100=6.51%, 250=1.30%, 500=0.13%, 1000=0.13% lat (msec) : 2=2.99%, 4=7.81%, 10=13.02%, 20=17.19%, 50=40.36% lat (msec) : 100=8.20%, 250=0.52%, 500=0.13% cpu : usr=0.08%, sys=10.22%, ctx=1609, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147681: Mon Mar 2 12:58:58 2026 read: IOPS=21, BW=341KiB/s (349kB/s)(6032KiB/17690msec) clat (usec): min=32, max=250474, avg=24012.88, stdev=21761.75 lat (usec): min=32, max=250475, avg=24017.88, stdev=21758.06 clat percentiles (usec): | 1.00th=[ 38], 5.00th=[ 56], 10.00th=[ 64], 20.00th=[ 159], | 30.00th=[ 15139], 40.00th=[ 19006], 50.00th=[ 22676], 60.00th=[ 26870], | 70.00th=[ 31851], 80.00th=[ 36963], 90.00th=[ 45876], 95.00th=[ 52167], | 99.00th=[ 76022], 99.50th=[168821], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 158, max= 574, per=25.69%, avg=335.71, stdev=106.22, samples=34 iops : min= 9, max= 35, avg=20.24, stdev= 6.64, samples=34 write: IOPS=22, BW=354KiB/s (362kB/s)(6256KiB/17690msec); 0 zone resets clat (usec): min=1130, max=156079, avg=21702.79, stdev=21506.96 lat (usec): min=1131, max=156080, avg=21705.79, stdev=21506.82 clat percentiles (usec): | 1.00th=[ 1532], 5.00th=[ 1926], 10.00th=[ 2507], 20.00th=[ 4080], | 30.00th=[ 5800], 40.00th=[ 8586], 50.00th=[ 14091], 60.00th=[ 20055], | 70.00th=[ 28705], 80.00th=[ 38536], 90.00th=[ 49021], 95.00th=[ 63177], | 99.00th=[ 89654], 99.50th=[104334], 99.90th=[156238], 99.95th=[156238], | 99.99th=[156238] bw ( KiB/s): min= 223, max= 561, per=25.75%, avg=354.09, stdev=85.46, samples=34 iops : min= 13, max= 35, avg=21.41, stdev= 5.43, samples=34 lat (usec) : 50=1.30%, 100=7.29%, 250=1.69%, 1000=0.13% lat (msec) : 2=3.52%, 4=6.64%, 10=13.15%, 20=17.32%, 50=41.02% lat (msec) : 100=7.42%, 250=0.39%, 500=0.13% cpu : usr=0.08%, sys=11.02%, ctx=1532, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1308KiB/s (1339kB/s), 319KiB/s-345KiB/s (326kB/s-353kB/s), io=23.4MiB (24.5MB), run=17690-18318msec WRITE: bw=1376KiB/s (1409kB/s), 332KiB/s-363KiB/s (340kB/s-372kB/s), io=24.6MiB (25.8MB), run=17690-18318msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147682: Mon Mar 2 12:59:24 2026 read: IOPS=8, BW=136KiB/s (139kB/s)(5920KiB/43622msec) clat (msec): min=5, max=165, avg=28.63, stdev=21.50 lat (msec): min=5, max=165, avg=28.63, stdev=21.50 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 23], 60.00th=[ 27], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 54], 95.00th=[ 77], | 99.00th=[ 111], 99.50th=[ 128], 99.90th=[ 165], 99.95th=[ 165], | 99.99th=[ 165] bw ( KiB/s): min= 31, max= 383, per=25.35%, avg=136.14, stdev=73.40, samples=85 iops : min= 1, max= 23, avg= 7.82, stdev= 4.57, samples=85 write: IOPS=9, BW=146KiB/s (149kB/s)(6368KiB/43622msec); 0 zone resets clat (msec): min=29, max=445, avg=82.76, stdev=37.87 lat (msec): min=29, max=445, avg=82.76, stdev=37.87 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 43], 10.00th=[ 48], 20.00th=[ 56], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 74], 60.00th=[ 82], | 70.00th=[ 92], 80.00th=[ 109], 90.00th=[ 130], 95.00th=[ 146], | 99.00th=[ 201], 99.50th=[ 262], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 256, per=25.75%, avg=145.50, stdev=54.48, samples=86 iops : min= 1, max= 16, avg= 8.41, stdev= 3.51, samples=86 lat (msec) : 10=2.99%, 20=16.54%, 50=28.91%, 100=38.93%, 250=12.37% lat (msec) : 500=0.26% cpu : usr=0.05%, sys=2.52%, ctx=1586, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147683: Mon Mar 2 12:59:24 2026 read: IOPS=8, BW=129KiB/s (132kB/s)(5744KiB/44588msec) clat (msec): min=5, max=169, avg=29.39, stdev=24.73 lat (msec): min=5, max=169, avg=29.39, stdev=24.73 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 18], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 26], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 52], 95.00th=[ 88], | 99.00th=[ 133], 99.50th=[ 153], 99.90th=[ 169], 99.95th=[ 169], | 99.99th=[ 169] bw ( KiB/s): min= 27, max= 351, per=24.92%, avg=133.83, stdev=76.83, samples=84 iops : min= 1, max= 21, avg= 7.68, stdev= 4.82, samples=84 write: IOPS=9, BW=147KiB/s (150kB/s)(6544KiB/44588msec); 0 zone resets clat (msec): min=26, max=338, avg=82.76, stdev=42.21 lat (msec): min=26, max=338, avg=82.76, stdev=42.21 clat percentiles (msec): | 1.00th=[ 30], 5.00th=[ 40], 10.00th=[ 46], 20.00th=[ 54], | 30.00th=[ 61], 40.00th=[ 65], 50.00th=[ 71], 60.00th=[ 81], | 70.00th=[ 89], 80.00th=[ 105], 90.00th=[ 133], 95.00th=[ 165], | 99.00th=[ 234], 99.50th=[ 275], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 352, per=25.73%, avg=145.35, stdev=60.86, samples=88 iops : min= 1, max= 22, avg= 8.40, stdev= 3.92, samples=88 lat (msec) : 10=1.95%, 20=18.49%, 50=29.17%, 100=37.11%, 250=12.89% lat (msec) : 500=0.39% cpu : usr=0.05%, sys=2.46%, ctx=1525, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147684: Mon Mar 2 12:59:24 2026 read: IOPS=8, BW=144KiB/s (147kB/s)(6256KiB/43498msec) clat (msec): min=5, max=150, avg=27.73, stdev=21.49 lat (msec): min=5, max=150, avg=27.73, stdev=21.49 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 22], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 38], 90.00th=[ 52], 95.00th=[ 69], | 99.00th=[ 124], 99.50th=[ 136], 99.90th=[ 150], 99.95th=[ 150], | 99.99th=[ 150] bw ( KiB/s): min= 31, max= 384, per=27.20%, avg=146.08, stdev=94.06, samples=85 iops : min= 1, max= 24, avg= 8.45, stdev= 5.90, samples=85 write: IOPS=8, BW=139KiB/s (142kB/s)(6032KiB/43498msec); 0 zone resets clat (msec): min=25, max=339, avg=86.11, stdev=39.70 lat (msec): min=25, max=339, avg=86.12, stdev=39.70 clat percentiles (msec): | 1.00th=[ 39], 5.00th=[ 44], 10.00th=[ 48], 20.00th=[ 57], | 30.00th=[ 63], 40.00th=[ 69], 50.00th=[ 75], 60.00th=[ 85], | 70.00th=[ 96], 80.00th=[ 108], 90.00th=[ 138], 95.00th=[ 167], | 99.00th=[ 213], 99.50th=[ 309], 99.90th=[ 338], 99.95th=[ 338], | 99.99th=[ 338] bw ( KiB/s): min= 31, max= 255, per=24.43%, avg=138.01, stdev=53.32, samples=86 iops : min= 1, max= 15, avg= 7.94, stdev= 3.42, samples=86 lat (msec) : 10=4.56%, 20=17.71%, 50=29.82%, 100=33.72%, 250=13.93% lat (msec) : 500=0.26% cpu : usr=0.06%, sys=2.59%, ctx=1616, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147685: Mon Mar 2 12:59:24 2026 read: IOPS=8, BW=139KiB/s (142kB/s)(6032KiB/43422msec) clat (msec): min=5, max=143, avg=26.04, stdev=18.71 lat (msec): min=5, max=143, avg=26.04, stdev=18.71 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 19], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 47], 95.00th=[ 61], | 99.00th=[ 107], 99.50th=[ 122], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 31, max= 384, per=26.28%, avg=141.11, stdev=78.49, samples=84 iops : min= 1, max= 24, avg= 8.13, stdev= 4.99, samples=84 write: IOPS=9, BW=144KiB/s (148kB/s)(6256KiB/43422msec); 0 zone resets clat (msec): min=29, max=445, avg=85.32, stdev=42.45 lat (msec): min=29, max=445, avg=85.32, stdev=42.45 clat percentiles (msec): | 1.00th=[ 34], 5.00th=[ 45], 10.00th=[ 51], 20.00th=[ 56], | 30.00th=[ 62], 40.00th=[ 68], 50.00th=[ 74], 60.00th=[ 83], | 70.00th=[ 93], 80.00th=[ 109], 90.00th=[ 136], 95.00th=[ 163], | 99.00th=[ 239], 99.50th=[ 359], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 31, max= 256, per=25.47%, avg=143.93, stdev=55.15, samples=86 iops : min= 1, max= 16, avg= 8.31, stdev= 3.55, samples=86 lat (msec) : 10=3.39%, 20=19.40%, 50=27.08%, 100=36.72%, 250=13.15% lat (msec) : 500=0.26% cpu : usr=0.04%, sys=2.57%, ctx=1576, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=537KiB/s (550kB/s), 129KiB/s-144KiB/s (132kB/s-147kB/s), io=23.4MiB (24.5MB), run=43422-44588msec WRITE: bw=565KiB/s (579kB/s), 139KiB/s-147KiB/s (142kB/s-150kB/s), io=24.6MiB (25.8MB), run=43422-44588msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147698: Mon Mar 2 12:59:33 2026 read: IOPS=2, BW=2441KiB/s (2500kB/s)(7168KiB/2936msec) clat (usec): min=349, max=422409, avg=148343.28, stdev=145864.96 lat (usec): min=350, max=422410, avg=148344.70, stdev=145864.92 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 351], 10.00th=[ 351], 20.00th=[ 586], | 30.00th=[ 98042], 40.00th=[ 98042], 50.00th=[139461], 60.00th=[149947], | 70.00th=[149947], 80.00th=[227541], 90.00th=[421528], 95.00th=[421528], | 99.00th=[421528], 99.50th=[421528], 99.90th=[421528], 99.95th=[421528], | 99.99th=[421528] bw ( KiB/s): min= 2043, max= 4491, per=49.05%, avg=3367.00, stdev=1236.19, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1744KiB/s (1786kB/s)(5120KiB/2936msec); 0 zone resets clat (msec): min=213, max=619, avg=373.00, stdev=156.48 lat (msec): min=213, max=619, avg=373.06, stdev=156.46 clat percentiles (msec): | 1.00th=[ 213], 5.00th=[ 213], 10.00th=[ 213], 20.00th=[ 213], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 368], 60.00th=[ 368], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 617], 95.00th=[ 617], | 99.00th=[ 617], 99.50th=[ 617], 99.90th=[ 617], 99.95th=[ 617], | 99.99th=[ 617] bw ( KiB/s): min= 1783, max= 4087, per=25.86%, avg=2485.00, stdev=1074.61, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=8.33%, 750=8.33% lat (msec) : 100=8.33%, 250=33.33%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=18.30%, ctx=279, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147699: Mon Mar 2 12:59:33 2026 read: IOPS=0, BW=687KiB/s (703kB/s)(2048KiB/2983msec) clat (usec): min=522, max=160753, avg=80638.33, stdev=113300.63 lat (usec): min=523, max=160756, avg=80640.10, stdev=113301.42 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[160433], | 70.00th=[160433], 80.00th=[160433], 90.00th=[160433], 95.00th=[160433], | 99.00th=[160433], 99.50th=[160433], 99.90th=[160433], 99.95th=[160433], | 99.99th=[160433] bw ( KiB/s): min= 2011, max= 2043, per=29.53%, avg=2027.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3433KiB/s (3515kB/s)(10.0MiB/2983msec); 0 zone resets clat (msec): min=125, max=505, avg=267.57, stdev=134.13 lat (msec): min=125, max=505, avg=267.77, stdev=134.27 clat percentiles (msec): | 1.00th=[ 126], 5.00th=[ 126], 10.00th=[ 126], 20.00th=[ 130], | 30.00th=[ 142], 40.00th=[ 153], 50.00th=[ 218], 60.00th=[ 296], | 70.00th=[ 338], 80.00th=[ 363], 90.00th=[ 409], 95.00th=[ 506], | 99.00th=[ 506], 99.50th=[ 506], 99.90th=[ 506], 99.95th=[ 506], | 99.99th=[ 506] bw ( KiB/s): min= 1861, max= 5851, per=41.24%, avg=3963.50, stdev=1633.69, samples=4 iops : min= 1, max= 5, avg= 3.00, stdev= 1.63, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=50.00%, 500=33.33%, 750=8.33% cpu : usr=0.00%, sys=21.16%, ctx=200, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147700: Mon Mar 2 12:59:33 2026 read: IOPS=2, BW=2476KiB/s (2536kB/s)(6144KiB/2481msec) clat (usec): min=1036, max=258319, avg=152787.44, stdev=93487.02 lat (usec): min=1037, max=258321, avg=152788.80, stdev=93487.12 clat percentiles (usec): | 1.00th=[ 1037], 5.00th=[ 1037], 10.00th=[ 1037], 20.00th=[127402], | 30.00th=[127402], 40.00th=[137364], 50.00th=[137364], 60.00th=[145753], | 70.00th=[246416], 80.00th=[246416], 90.00th=[258999], 95.00th=[258999], | 99.00th=[258999], 99.50th=[258999], 99.90th=[258999], 99.95th=[258999], | 99.99th=[258999] bw ( KiB/s): min= 4087, max= 5851, per=72.38%, avg=4969.00, stdev=1247.34, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=2, BW=2476KiB/s (2536kB/s)(6144KiB/2481msec); 0 zone resets clat (msec): min=106, max=476, avg=239.01, stdev=156.50 lat (msec): min=106, max=476, avg=239.10, stdev=156.49 clat percentiles (msec): | 1.00th=[ 107], 5.00th=[ 107], 10.00th=[ 107], 20.00th=[ 136], | 30.00th=[ 136], 40.00th=[ 150], 50.00th=[ 150], 60.00th=[ 169], | 70.00th=[ 397], 80.00th=[ 397], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1861, max= 3968, per=25.55%, avg=2455.50, stdev=1011.07, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 2=8.33%, 250=66.67%, 500=25.00% cpu : usr=0.04%, sys=19.59%, ctx=348, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147701: Mon Mar 2 12:59:33 2026 read: IOPS=2, BW=2086KiB/s (2136kB/s)(5120KiB/2454msec) clat (usec): min=337, max=193335, avg=60054.04, stdev=87310.04 lat (usec): min=338, max=193337, avg=60054.91, stdev=87310.51 clat percentiles (usec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 338], | 30.00th=[ 506], 40.00th=[ 506], 50.00th=[ 523], 60.00th=[ 523], | 70.00th=[105382], 80.00th=[105382], 90.00th=[193987], 95.00th=[193987], | 99.00th=[193987], 99.50th=[193987], 99.90th=[193987], 99.95th=[193987], | 99.99th=[193987] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2921KiB/s (2991kB/s)(7168KiB/2454msec); 0 zone resets clat (msec): min=158, max=474, avg=302.73, stdev=113.46 lat (msec): min=158, max=475, avg=302.82, stdev=113.45 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 197], | 30.00th=[ 264], 40.00th=[ 264], 50.00th=[ 275], 60.00th=[ 338], | 70.00th=[ 338], 80.00th=[ 414], 90.00th=[ 477], 95.00th=[ 477], | 99.00th=[ 477], 99.50th=[ 477], 99.90th=[ 477], 99.95th=[ 477], | 99.99th=[ 477] bw ( KiB/s): min= 1783, max= 4055, per=27.65%, avg=2657.25, stdev=1017.11, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (usec) : 500=8.33%, 750=16.67% lat (msec) : 250=33.33%, 500=41.67% cpu : usr=0.04%, sys=19.08%, ctx=158, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6866KiB/s (7030kB/s), 687KiB/s-2476KiB/s (703kB/s-2536kB/s), io=20.0MiB (20.0MB), run=2454-2983msec WRITE: bw=9612KiB/s (9842kB/s), 1744KiB/s-3433KiB/s (1786kB/s-3515kB/s), io=28.0MiB (29.4MB), run=2454-2983msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147702: Mon Mar 2 12:59:33 2026 read: IOPS=2, BW=2739KiB/s (2805kB/s)(7168KiB/2617msec) clat (msec): min=99, max=449, avg=164.16, stdev=126.71 lat (msec): min=99, max=449, avg=164.16, stdev=126.71 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 125], 60.00th=[ 128], | 70.00th=[ 128], 80.00th=[ 142], 90.00th=[ 451], 95.00th=[ 451], | 99.00th=[ 451], 99.50th=[ 451], 99.90th=[ 451], 99.95th=[ 451], | 99.99th=[ 451] bw ( KiB/s): min= 2039, max= 4290, per=51.35%, avg=3333.00, stdev=1162.72, samples=3 iops : min= 1, max= 4, avg= 2.67, stdev= 1.53, samples=3 write: IOPS=1, BW=1956KiB/s (2003kB/s)(5120KiB/2617msec); 0 zone resets clat (msec): min=144, max=537, avg=282.69, stdev=171.06 lat (msec): min=144, max=537, avg=282.76, stdev=171.06 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 155], 40.00th=[ 155], 50.00th=[ 199], 60.00th=[ 199], | 70.00th=[ 380], 80.00th=[ 380], 90.00th=[ 542], 95.00th=[ 542], | 99.00th=[ 542], 99.50th=[ 542], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 1430, max= 4079, per=27.70%, avg=2517.33, stdev=1386.74, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=8.33%, 250=66.67%, 500=16.67%, 750=8.33% cpu : usr=0.00%, sys=8.14%, ctx=77, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147703: Mon Mar 2 12:59:33 2026 read: IOPS=0, BW=649KiB/s (665kB/s)(2048KiB/3155msec) clat (msec): min=133, max=158, avg=145.92, stdev=17.83 lat (msec): min=133, max=158, avg=145.93, stdev=17.83 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 134], | 30.00th=[ 134], 40.00th=[ 134], 50.00th=[ 134], 60.00th=[ 159], | 70.00th=[ 159], 80.00th=[ 159], 90.00th=[ 159], 95.00th=[ 159], | 99.00th=[ 159], 99.50th=[ 159], 99.90th=[ 159], 99.95th=[ 159], | 99.99th=[ 159] bw ( KiB/s): min= 1517, max= 2043, per=27.42%, avg=1780.00, stdev=371.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=3, BW=3246KiB/s (3324kB/s)(10.0MiB/3155msec); 0 zone resets clat (msec): min=128, max=600, avg=256.65, stdev=157.18 lat (msec): min=129, max=600, avg=256.75, stdev=157.16 clat percentiles (msec): | 1.00th=[ 130], 5.00th=[ 130], 10.00th=[ 130], 20.00th=[ 132], | 30.00th=[ 136], 40.00th=[ 159], 50.00th=[ 201], 60.00th=[ 232], | 70.00th=[ 257], 80.00th=[ 259], 90.00th=[ 464], 95.00th=[ 600], | 99.00th=[ 600], 99.50th=[ 600], 99.90th=[ 600], 99.95th=[ 600], | 99.99th=[ 600] bw ( KiB/s): min= 1835, max= 4087, per=38.76%, avg=3522.00, stdev=1124.67, samples=4 iops : min= 1, max= 3, avg= 2.50, stdev= 1.00, samples=4 lat (msec) : 250=66.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=9.29%, ctx=338, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147704: Mon Mar 2 12:59:33 2026 read: IOPS=1, BW=1960KiB/s (2007kB/s)(6144KiB/3135msec) clat (msec): min=97, max=351, avg=160.25, stdev=96.76 lat (msec): min=97, max=351, avg=160.25, stdev=96.76 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 99], | 30.00th=[ 99], 40.00th=[ 126], 50.00th=[ 126], 60.00th=[ 126], | 70.00th=[ 165], 80.00th=[ 165], 90.00th=[ 351], 95.00th=[ 351], | 99.00th=[ 351], 99.50th=[ 351], 99.90th=[ 351], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 2039, max= 4087, per=41.95%, avg=2723.00, stdev=1181.26, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1960KiB/s (2007kB/s)(6144KiB/3135msec); 0 zone resets clat (msec): min=104, max=490, avg=310.88, stdev=145.31 lat (msec): min=104, max=490, avg=310.97, stdev=145.31 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 232], | 30.00th=[ 232], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 347], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 489], 95.00th=[ 489], | 99.00th=[ 489], 99.50th=[ 489], 99.90th=[ 489], 99.95th=[ 489], | 99.99th=[ 489] bw ( KiB/s): min= 1490, max= 2043, per=20.38%, avg=1851.75, stdev=259.99, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (msec) : 100=16.67%, 250=50.00%, 500=33.33% cpu : usr=0.00%, sys=7.31%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147705: Mon Mar 2 12:59:33 2026 read: IOPS=1, BW=1698KiB/s (1738kB/s)(5120KiB/3016msec) clat (msec): min=53, max=115, avg=79.16, stdev=22.51 lat (msec): min=53, max=115, avg=79.17, stdev=22.51 clat percentiles (msec): | 1.00th=[ 54], 5.00th=[ 54], 10.00th=[ 54], 20.00th=[ 54], | 30.00th=[ 72], 40.00th=[ 72], 50.00th=[ 77], 60.00th=[ 77], | 70.00th=[ 81], 80.00th=[ 81], 90.00th=[ 115], 95.00th=[ 115], | 99.00th=[ 115], 99.50th=[ 115], 99.90th=[ 115], 99.95th=[ 115], | 99.99th=[ 115] bw ( KiB/s): min= 2043, max= 6119, per=62.87%, avg=4081.00, stdev=2882.17, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2377KiB/s (2434kB/s)(7168KiB/3016msec); 0 zone resets clat (msec): min=145, max=702, avg=358.97, stdev=208.25 lat (msec): min=145, max=702, avg=359.07, stdev=208.24 clat percentiles (msec): | 1.00th=[ 146], 5.00th=[ 146], 10.00th=[ 146], 20.00th=[ 178], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 300], 60.00th=[ 376], | 70.00th=[ 376], 80.00th=[ 575], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 1556, max= 2043, per=20.94%, avg=1903.20, stdev=213.73, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 100=33.33%, 250=33.33%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=8.23%, ctx=107, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6491KiB/s (6647kB/s), 649KiB/s-2739KiB/s (665kB/s-2805kB/s), io=20.0MiB (20.0MB), run=2617-3155msec WRITE: bw=9088KiB/s (9306kB/s), 1956KiB/s-3246KiB/s (2003kB/s-3324kB/s), io=28.0MiB (29.4MB), run=2617-3155msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=147711: Mon Mar 2 12:59:42 2026 read: IOPS=1, BW=4941KiB/s (5059kB/s)(12.0MiB/2487msec) clat (msec): min=629, max=1092, avg=801.02, stdev=253.53 lat (msec): min=629, max=1092, avg=801.02, stdev=253.53 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1099], 95.00th=[ 1099], | 99.00th=[ 1099], 99.50th=[ 1099], 99.90th=[ 1099], 99.95th=[ 1099], | 99.99th=[ 1099] bw ( KiB/s): min= 8094, max= 8192, per=100.00%, avg=8143.00, stdev=69.30, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=6.11%, ctx=51, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147712: Mon Mar 2 12:59:42 2026 read: IOPS=0, BW=1609KiB/s (1647kB/s)(4096KiB/2546msec) clat (nsec): min=152922k, max=152922k, avg=152921742.00, stdev= 0.00 lat (nsec): min=152924k, max=152924k, avg=152924351.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 153], 5.00th=[ 153], 10.00th=[ 153], 20.00th=[ 153], | 30.00th=[ 153], 40.00th=[ 153], 50.00th=[ 153], 60.00th=[ 153], | 70.00th=[ 153], 80.00th=[ 153], 90.00th=[ 153], 95.00th=[ 153], | 99.00th=[ 153], 99.50th=[ 153], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 6430, max= 6430, per=99.92%, avg=6430.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3218KiB/s (3295kB/s)(8192KiB/2546msec); 0 zone resets clat (msec): min=666, max=1667, avg=1167.27, stdev=707.93 lat (msec): min=667, max=1668, avg=1167.61, stdev=707.95 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 1670], | 70.00th=[ 1670], 80.00th=[ 1670], 90.00th=[ 1670], 95.00th=[ 1670], | 99.00th=[ 1670], 99.50th=[ 1670], 99.90th=[ 1670], 99.95th=[ 1670], | 99.99th=[ 1670] bw ( KiB/s): min= 8110, max= 8110, per=63.01%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.01%, ctx=67, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147713: Mon Mar 2 12:59:42 2026 write: IOPS=1, BW=5503KiB/s (5635kB/s)(12.0MiB/2233msec); 0 zone resets clat (msec): min=325, max=1054, avg=709.51, stdev=366.37 lat (msec): min=325, max=1055, avg=710.16, stdev=366.48 clat percentiles (msec): | 1.00th=[ 326], 5.00th=[ 326], 10.00th=[ 326], 20.00th=[ 326], | 30.00th=[ 326], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1053], 95.00th=[ 1053], | 99.00th=[ 1053], 99.50th=[ 1053], 99.90th=[ 1053], 99.95th=[ 1053], | 99.99th=[ 1053] bw ( KiB/s): min=16221, max=16221, per=100.00%, avg=16221.00, stdev= 0.00, samples=1 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=7.30%, ctx=59, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147714: Mon Mar 2 12:59:42 2026 write: IOPS=1, BW=5493KiB/s (5625kB/s)(12.0MiB/2237msec); 0 zone resets clat (msec): min=239, max=1440, avg=731.32, stdev=629.14 lat (msec): min=239, max=1440, avg=731.75, stdev=629.05 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 514], 50.00th=[ 514], 60.00th=[ 514], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 6759, max= 8110, per=57.77%, avg=7434.50, stdev=955.30, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=5.68%, ctx=49, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6435KiB/s (6590kB/s), 1609KiB/s-4941KiB/s (1647kB/s-5059kB/s), io=16.0MiB (16.8MB), run=2487-2546msec WRITE: bw=12.6MiB/s (13.2MB/s), 3218KiB/s-5503KiB/s (3295kB/s-5635kB/s), io=32.0MiB (33.6MB), run=2233-2546msec rand-rw: (groupid=0, jobs=1): err= 0: pid=147716: Mon Mar 2 12:59:42 2026 read: IOPS=1, BW=6585KiB/s (6743kB/s)(12.0MiB/1866msec) clat (msec): min=548, max=657, avg=611.48, stdev=56.05 lat (msec): min=548, max=657, avg=611.48, stdev=56.05 clat percentiles (msec): | 1.00th=[ 550], 5.00th=[ 550], 10.00th=[ 550], 20.00th=[ 550], | 30.00th=[ 550], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 6918, max= 8143, per=100.00%, avg=7530.50, stdev=866.21, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=19.57%, ctx=427, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147717: Mon Mar 2 12:59:42 2026 read: IOPS=0, BW=1725KiB/s (1766kB/s)(4096KiB/2375msec) clat (nsec): min=787035k, max=787035k, avg=787035135.00, stdev= 0.00 lat (nsec): min=787037k, max=787037k, avg=787036715.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 785], 5.00th=[ 785], 10.00th=[ 785], 20.00th=[ 785], | 30.00th=[ 785], 40.00th=[ 785], 50.00th=[ 785], 60.00th=[ 785], | 70.00th=[ 785], 80.00th=[ 785], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 8062, max= 8062, per=100.00%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3449KiB/s (3532kB/s)(8192KiB/2375msec); 0 zone resets clat (msec): min=565, max=1019, avg=792.72, stdev=321.00 lat (msec): min=566, max=1020, avg=793.21, stdev=321.05 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 1020], | 70.00th=[ 1020], 80.00th=[ 1020], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 8126, max= 8126, per=66.49%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.04%, sys=9.56%, ctx=212, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147718: Mon Mar 2 12:59:42 2026 write: IOPS=1, BW=4583KiB/s (4693kB/s)(12.0MiB/2681msec); 0 zone resets clat (msec): min=211, max=1262, avg=891.95, stdev=590.04 lat (msec): min=211, max=1266, avg=893.42, stdev=591.11 clat percentiles (msec): | 1.00th=[ 211], 5.00th=[ 211], 10.00th=[ 211], 20.00th=[ 211], | 30.00th=[ 211], 40.00th=[ 1200], 50.00th=[ 1200], 60.00th=[ 1200], | 70.00th=[ 1267], 80.00th=[ 1267], 90.00th=[ 1267], 95.00th=[ 1267], | 99.00th=[ 1267], 99.50th=[ 1267], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 8143, max= 8143, per=66.63%, avg=8143.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=7.39%, ctx=47, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=147719: Mon Mar 2 12:59:42 2026 write: IOPS=1, BW=6276KiB/s (6426kB/s)(12.0MiB/1958msec); 0 zone resets clat (msec): min=226, max=1089, avg=643.68, stdev=432.19 lat (msec): min=226, max=1089, avg=644.09, stdev=432.27 clat percentiles (msec): | 1.00th=[ 226], 5.00th=[ 226], 10.00th=[ 226], 20.00th=[ 226], | 30.00th=[ 226], 40.00th=[ 617], 50.00th=[ 617], 60.00th=[ 617], | 70.00th=[ 1083], 80.00th=[ 1083], 90.00th=[ 1083], 95.00th=[ 1083], | 99.00th=[ 1083], 99.50th=[ 1083], 99.90th=[ 1083], 99.95th=[ 1083], | 99.99th=[ 1083] bw ( KiB/s): min= 8159, max= 8159, per=66.76%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=9.61%, ctx=84, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6899KiB/s (7064kB/s), 1725KiB/s-6585KiB/s (1766kB/s-6743kB/s), io=16.0MiB (16.8MB), run=1866-2375msec WRITE: bw=11.9MiB/s (12.5MB/s), 3449KiB/s-6276KiB/s (3532kB/s-6426kB/s), io=32.0MiB (33.6MB), run=1958-2681msec