== sanity test 398b: DIO and buffer IO race ============== 12:37:15 (1782232635) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 8.28939 s, 6.1 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144853: Tue Jun 23 12:39:55 2026 read: IOPS=11, BW=45.7KiB/s (46.8kB/s)(5992KiB/131244msec) clat (usec): min=37, max=1098.9k, avg=43834.46, stdev=40575.85 lat (usec): min=37, max=1098.9k, avg=43836.83, stdev=40575.66 clat percentiles (usec): | 1.00th=[ 61], 5.00th=[ 82], 10.00th=[ 14353], | 20.00th=[ 22938], 30.00th=[ 27395], 40.00th=[ 32375], | 50.00th=[ 38011], 60.00th=[ 43779], 70.00th=[ 50594], | 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 95945], | 99.00th=[ 147850], 99.50th=[ 179307], 99.90th=[ 350225], | 99.95th=[1098908], 99.99th=[1098908] bw ( KiB/s): min= 7, max= 101, per=25.35%, avg=45.88, stdev=18.62, samples=255 iops : min= 1, max= 25, avg=10.83, stdev= 4.69, samples=255 write: IOPS=11, BW=47.0KiB/s (49.1kB/s)(6296KiB/131244msec); 0 zone resets clat (usec): min=1249, max=363809, avg=41526.24, stdev=38596.11 lat (usec): min=1250, max=363811, avg=41533.52, stdev=38604.20 clat percentiles (usec): | 1.00th=[ 1450], 5.00th=[ 1762], 10.00th=[ 3097], 20.00th=[ 6783], | 30.00th=[ 12649], 40.00th=[ 23725], 50.00th=[ 33162], 60.00th=[ 43254], | 70.00th=[ 55313], 80.00th=[ 68682], 90.00th=[ 92799], 95.00th=[114820], | 99.00th=[158335], 99.50th=[179307], 99.90th=[316670], 99.95th=[362808], | 99.99th=[362808] bw ( KiB/s): min= 7, max= 119, per=25.25%, avg=47.73, stdev=19.65, samples=257 iops : min= 1, max= 29, avg=11.31, stdev= 4.95, samples=257 lat (usec) : 50=0.20%, 100=2.67%, 250=0.49%, 500=0.10%, 750=0.03% lat (usec) : 1000=0.07% lat (msec) : 2=3.39%, 4=3.16%, 10=6.77%, 20=9.28%, 50=41.31% lat (msec) : 100=26.50%, 250=5.86%, 500=0.16%, 2000=0.03% cpu : usr=0.09%, sys=5.62%, ctx=7225, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144854: Tue Jun 23 12:39:55 2026 read: IOPS=11, BW=46.1KiB/s (47.2kB/s)(5940KiB/128744msec) clat (usec): min=38, max=993411, avg=42405.29, stdev=38510.31 lat (usec): min=39, max=993413, avg=42409.56, stdev=38510.87 clat percentiles (usec): | 1.00th=[ 62], 5.00th=[ 76], 10.00th=[ 11600], 20.00th=[ 20841], | 30.00th=[ 25822], 40.00th=[ 30540], 50.00th=[ 36963], 60.00th=[ 42730], | 70.00th=[ 51119], 80.00th=[ 62653], 90.00th=[ 77071], 95.00th=[ 92799], | 99.00th=[143655], 99.50th=[185598], 99.90th=[325059], 99.95th=[994051], | 99.99th=[994051] bw ( KiB/s): min= 7, max= 119, per=25.52%, avg=46.20, stdev=19.60, samples=251 iops : min= 1, max= 29, avg=10.92, stdev= 4.94, samples=251 write: IOPS=12, BW=49.3KiB/s (50.5kB/s)(6348KiB/128744msec); 0 zone resets clat (usec): min=1042, max=408494, avg=41310.64, stdev=39822.39 lat (usec): min=1045, max=408496, avg=41317.14, stdev=39827.16 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1762], 10.00th=[ 2900], 20.00th=[ 5997], | 30.00th=[ 12387], 40.00th=[ 22676], 50.00th=[ 33162], 60.00th=[ 42730], | 70.00th=[ 53216], 80.00th=[ 67634], 90.00th=[ 92799], 95.00th=[116917], | 99.00th=[168821], 99.50th=[198181], 99.90th=[291505], 99.95th=[408945], | 99.99th=[408945] bw ( KiB/s): min= 7, max= 119, per=26.05%, avg=49.23, stdev=20.18, samples=252 iops : min= 1, max= 29, avg=11.68, stdev= 5.08, samples=252 lat (usec) : 50=0.16%, 100=3.19%, 250=0.68%, 500=0.07%, 750=0.03% lat (usec) : 1000=0.03% lat (msec) : 2=3.52%, 4=3.94%, 10=6.74%, 20=10.03%, 50=39.45% lat (msec) : 100=26.43%, 250=5.50%, 500=0.20%, 1000=0.03% cpu : usr=0.08%, sys=5.68%, ctx=7095, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144855: Tue Jun 23 12:39:55 2026 read: IOPS=11, BW=45.5KiB/s (46.6kB/s)(6028KiB/132390msec) clat (usec): min=30, max=334609, avg=42470.64, stdev=29685.23 lat (usec): min=30, max=334611, avg=42475.27, stdev=29683.83 clat percentiles (usec): | 1.00th=[ 60], 5.00th=[ 77], 10.00th=[ 13173], 20.00th=[ 21890], | 30.00th=[ 26870], 40.00th=[ 31327], 50.00th=[ 36963], 60.00th=[ 43779], | 70.00th=[ 51643], 80.00th=[ 60556], 90.00th=[ 77071], 95.00th=[ 91751], | 99.00th=[143655], 99.50th=[181404], 99.90th=[204473], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 7, max= 103, per=25.12%, avg=45.47, stdev=20.77, samples=258 iops : min= 1, max= 25, avg=10.74, stdev= 5.23, samples=258 write: IOPS=11, BW=47.3KiB/s (48.4kB/s)(6260KiB/132390msec); 0 zone resets clat (usec): min=1000, max=1127.3k, avg=43557.12, stdev=49269.79 lat (usec): min=1001, max=1127.3k, avg=43566.80, stdev=49266.35 clat percentiles (usec): | 1.00th=[ 1483], 5.00th=[ 1762], 10.00th=[ 3097], | 20.00th=[ 6390], 30.00th=[ 13042], 40.00th=[ 24773], | 50.00th=[ 32637], 60.00th=[ 43254], 70.00th=[ 57410], | 80.00th=[ 73925], 90.00th=[ 94897], 95.00th=[ 116917], | 99.00th=[ 181404], 99.50th=[ 235930], 99.90th=[ 379585], | 99.95th=[1132463], 99.99th=[1132463] bw ( KiB/s): min= 7, max= 111, per=24.75%, avg=46.77, stdev=19.46, samples=260 iops : min= 1, max= 27, avg=11.05, stdev= 4.91, samples=260 lat (usec) : 50=0.23%, 100=2.93%, 250=0.49%, 500=0.20%, 750=0.07% lat (msec) : 2=3.29%, 4=3.65%, 10=6.54%, 20=9.60%, 50=40.07% lat (msec) : 100=26.50%, 250=6.25%, 500=0.16%, 2000=0.03% cpu : usr=0.09%, sys=5.34%, ctx=6977, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144856: Tue Jun 23 12:39:55 2026 read: IOPS=11, BW=46.5KiB/s (47.7kB/s)(6052KiB/130042msec) clat (usec): min=29, max=380551, avg=43624.79, stdev=32540.31 lat (usec): min=29, max=380553, avg=43629.59, stdev=32539.64 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 74], 10.00th=[ 12780], 20.00th=[ 21365], | 30.00th=[ 26870], 40.00th=[ 31851], 50.00th=[ 38011], 60.00th=[ 44827], | 70.00th=[ 52691], 80.00th=[ 61604], 90.00th=[ 78119], 95.00th=[ 96994], | 99.00th=[162530], 99.50th=[191890], 99.90th=[295699], 99.95th=[379585], | 99.99th=[379585] bw ( KiB/s): min= 7, max= 120, per=25.77%, avg=46.64, stdev=18.82, samples=254 iops : min= 1, max= 30, avg=11.03, stdev= 4.74, samples=254 write: IOPS=11, BW=47.0KiB/s (49.1kB/s)(6236KiB/130042msec); 0 zone resets clat (usec): min=887, max=1055.6k, avg=40923.39, stdev=47013.81 lat (usec): min=888, max=1055.6k, avg=40926.04, stdev=47014.01 clat percentiles (usec): | 1.00th=[ 1434], 5.00th=[ 1713], 10.00th=[ 2474], | 20.00th=[ 5538], 30.00th=[ 10028], 40.00th=[ 20841], | 50.00th=[ 31327], 60.00th=[ 40109], 70.00th=[ 53216], | 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[ 113771], | 99.00th=[ 177210], 99.50th=[ 200279], 99.90th=[ 346031], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 119, per=25.32%, avg=47.86, stdev=20.20, samples=255 iops : min= 1, max= 29, avg=11.33, stdev= 5.08, samples=255 lat (usec) : 50=0.42%, 100=2.96%, 250=0.55%, 500=0.13%, 750=0.07% lat (usec) : 1000=0.07% lat (msec) : 2=3.65%, 4=3.91%, 10=7.81%, 20=8.98%, 50=38.44% lat (msec) : 100=26.89%, 250=5.89%, 500=0.20%, 2000=0.03% cpu : usr=0.09%, sys=5.53%, ctx=7015, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=181KiB/s (186kB/s), 45.5KiB/s-46.5KiB/s (46.6kB/s-47.7kB/s), io=23.4MiB (24.6MB), run=128744-132390msec WRITE: bw=190KiB/s (194kB/s), 47.3KiB/s-49.3KiB/s (48.4kB/s-50.5kB/s), io=24.6MiB (25.7MB), run=128744-132390msec fio: pid=144851, err=5/file:backend.c:481, func=full resid, error=Input/output error rand-rw: (groupid=0, jobs=1): err= 0: pid=144848: Tue Jun 23 12:41:59 2026 read: IOPS=5, BW=23.5KiB/s (24.0kB/s)(5992KiB/255282msec) clat (msec): min=6, max=1169, avg=39.99, stdev=46.29 lat (msec): min=6, max=1169, avg=39.99, stdev=46.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 43], 80.00th=[ 54], 90.00th=[ 74], 95.00th=[ 108], | 99.00th=[ 188], 99.50th=[ 257], 99.90th=[ 393], 99.95th=[ 1167], | 99.99th=[ 1167] bw ( KiB/s): min= 7, max= 126, per=30.59%, avg=25.08, stdev=16.95, samples=461 iops : min= 1, max= 31, avg= 5.62, stdev= 4.24, samples=461 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6296KiB/255282msec); 0 zone resets clat (msec): min=35, max=524, avg=123.79, stdev=55.68 lat (msec): min=35, max=524, avg=123.80, stdev=55.68 clat percentiles (msec): | 1.00th=[ 48], 5.00th=[ 59], 10.00th=[ 67], 20.00th=[ 81], | 30.00th=[ 91], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 124], | 70.00th=[ 140], 80.00th=[ 159], 90.00th=[ 199], 95.00th=[ 234], | 99.00th=[ 300], 99.50th=[ 351], 99.90th=[ 468], 99.95th=[ 527], | 99.99th=[ 527] bw ( KiB/s): min= 7, max= 55, per=28.28%, avg=24.32, stdev=10.39, samples=499 iops : min= 1, max= 13, avg= 5.42, stdev= 2.65, samples=499 lat (msec) : 10=1.79%, 20=12.99%, 50=23.76%, 100=27.47%, 250=32.03% lat (msec) : 500=1.89%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.64%, ctx=5647, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144849: Tue Jun 23 12:41:59 2026 read: IOPS=5, BW=23.1KiB/s (23.7kB/s)(5940KiB/256957msec) clat (msec): min=5, max=1060, avg=39.08, stdev=42.84 lat (msec): min=5, max=1060, avg=39.09, stdev=42.84 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 35], | 70.00th=[ 42], 80.00th=[ 52], 90.00th=[ 77], 95.00th=[ 102], | 99.00th=[ 167], 99.50th=[ 218], 99.90th=[ 409], 99.95th=[ 1062], | 99.99th=[ 1062] bw ( KiB/s): min= 7, max= 95, per=31.03%, avg=25.45, stdev=16.24, samples=450 iops : min= 1, max= 23, avg= 5.71, stdev= 4.11, samples=450 write: IOPS=6, BW=24.7KiB/s (25.3kB/s)(6348KiB/256957msec); 0 zone resets clat (msec): min=33, max=503, avg=125.00, stdev=57.83 lat (msec): min=33, max=503, avg=125.00, stdev=57.83 clat percentiles (msec): | 1.00th=[ 47], 5.00th=[ 61], 10.00th=[ 69], 20.00th=[ 80], | 30.00th=[ 90], 40.00th=[ 101], 50.00th=[ 111], 60.00th=[ 126], | 70.00th=[ 140], 80.00th=[ 163], 90.00th=[ 201], 95.00th=[ 241], | 99.00th=[ 313], 99.50th=[ 401], 99.90th=[ 493], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 7, max= 56, per=28.25%, avg=24.30, stdev=10.74, samples=503 iops : min= 1, max= 14, avg= 5.42, stdev= 2.72, samples=503 lat (msec) : 10=2.12%, 20=12.37%, 50=24.25%, 100=27.83%, 250=31.45% lat (msec) : 500=1.92%, 750=0.03%, 2000=0.03% cpu : usr=0.05%, sys=1.68%, ctx=5783, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144850: Tue Jun 23 12:41:59 2026 read: IOPS=5, BW=23.6KiB/s (24.2kB/s)(6028KiB/255330msec) clat (msec): min=6, max=471, avg=40.13, stdev=37.44 lat (msec): min=6, max=471, avg=40.13, stdev=37.44 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 26], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 56], 90.00th=[ 79], 95.00th=[ 108], | 99.00th=[ 182], 99.50th=[ 236], 99.90th=[ 388], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 104, per=30.44%, avg=24.96, stdev=16.43, samples=466 iops : min= 1, max= 26, avg= 5.59, stdev= 4.14, samples=466 write: IOPS=6, BW=24.5KiB/s (25.1kB/s)(6260KiB/255330msec); 0 zone resets clat (msec): min=33, max=1197, avg=124.16, stdev=61.31 lat (msec): min=33, max=1197, avg=124.17, stdev=61.31 clat percentiles (msec): | 1.00th=[ 46], 5.00th=[ 57], 10.00th=[ 67], 20.00th=[ 79], | 30.00th=[ 89], 40.00th=[ 101], 50.00th=[ 112], 60.00th=[ 127], | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 197], 95.00th=[ 228], | 99.00th=[ 313], 99.50th=[ 347], 99.90th=[ 489], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 7, max= 55, per=28.23%, avg=24.28, stdev=10.65, samples=497 iops : min= 1, max= 13, avg= 5.41, stdev= 2.70, samples=497 lat (msec) : 10=1.20%, 20=12.79%, 50=24.97%, 100=27.73%, 250=31.51% lat (msec) : 500=1.76%, 2000=0.03% cpu : usr=0.05%, sys=1.61%, ctx=5589, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 5 (file:backend.c:481, func=full resid, error=Input/output error): pid=144851: Tue Jun 23 12:41:59 2026 read: IOPS=4, BW=19.8KiB/s (20.3kB/s)(3264KiB/164897msec) clat (msec): min=6, max=473, avg=49.17, stdev=42.11 lat (msec): min=6, max=473, avg=49.18, stdev=42.11 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 12], 10.00th=[ 14], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 31], 50.00th=[ 37], 60.00th=[ 45], | 70.00th=[ 58], 80.00th=[ 71], 90.00th=[ 99], 95.00th=[ 126], | 99.00th=[ 205], 99.50th=[ 213], 99.90th=[ 472], 99.95th=[ 472], | 99.99th=[ 472] bw ( KiB/s): min= 7, max= 119, per=26.47%, avg=21.70, stdev=15.44, samples=288 iops : min= 1, max= 29, avg= 4.76, stdev= 3.88, samples=288 write: IOPS=5, BW=20.4KiB/s (20.9kB/s)(3368KiB/164897msec); 0 zone resets clat (msec): min=45, max=1143, avg=147.61, stdev=70.61 lat (msec): min=45, max=1143, avg=147.63, stdev=70.60 clat percentiles (msec): | 1.00th=[ 53], 5.00th=[ 69], 10.00th=[ 80], 20.00th=[ 97], | 30.00th=[ 111], 40.00th=[ 125], 50.00th=[ 136], 60.00th=[ 148], | 70.00th=[ 167], 80.00th=[ 188], 90.00th=[ 224], 95.00th=[ 262], | 99.00th=[ 380], 99.50th=[ 422], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 7, max= 55, per=23.32%, avg=20.06, stdev= 9.16, samples=320 iops : min= 1, max= 13, avg= 4.34, stdev= 2.30, samples=320 lat (msec) : 10=1.15%, 20=9.22%, 50=21.82%, 100=23.63%, 250=40.75% lat (msec) : 500=3.32%, 2000=0.06% cpu : usr=0.05%, sys=1.43%, ctx=2590, majf=0, minf=21 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=817,842,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=82.6KiB/s (84.6kB/s), 19.8KiB/s-23.6KiB/s (20.3kB/s-24.2kB/s), io=20.7MiB (21.7MB), run=164897-256957msec WRITE: bw=86.7KiB/s (88.8kB/s), 20.4KiB/s-24.7KiB/s (20.9kB/s-25.3kB/s), io=21.8MiB (22.8MB), run=164897-256957msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144912: Tue Jun 23 12:42:51 2026 read: IOPS=10, BW=167KiB/s (171kB/s)(5920KiB/35357msec) clat (usec): min=38, max=590317, avg=54332.60, stdev=52929.24 lat (usec): min=39, max=590319, avg=54334.14, stdev=52929.27 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 62], 10.00th=[ 79], 20.00th=[ 21890], | 30.00th=[ 33817], 40.00th=[ 40109], 50.00th=[ 48497], 60.00th=[ 57410], | 70.00th=[ 67634], 80.00th=[ 78119], 90.00th=[102237], 95.00th=[124257], | 99.00th=[168821], 99.50th=[530580], 99.90th=[591397], 99.95th=[591397], | 99.99th=[591397] bw ( KiB/s): min= 31, max= 381, per=26.65%, avg=168.46, stdev=73.96, samples=68 iops : min= 1, max= 23, avg= 9.75, stdev= 4.65, samples=68 write: IOPS=11, BW=180KiB/s (184kB/s)(6368KiB/35357msec); 0 zone resets clat (usec): min=1447, max=215638, avg=37578.84, stdev=38698.32 lat (usec): min=1447, max=215641, avg=37587.75, stdev=38701.78 clat percentiles (usec): | 1.00th=[ 1795], 5.00th=[ 2073], 10.00th=[ 3163], 20.00th=[ 5866], | 30.00th=[ 9634], 40.00th=[ 14877], 50.00th=[ 23200], 60.00th=[ 33817], | 70.00th=[ 50594], 80.00th=[ 66847], 90.00th=[ 96994], 95.00th=[113771], | 99.00th=[179307], 99.50th=[183501], 99.90th=[214959], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 31, max= 411, per=27.47%, avg=182.66, stdev=78.22, samples=68 iops : min= 1, max= 25, avg=10.63, stdev= 4.95, samples=68 lat (usec) : 50=0.39%, 100=6.77%, 250=0.78% lat (msec) : 2=2.21%, 4=4.95%, 10=9.38%, 20=9.11%, 50=27.21% lat (msec) : 100=29.95%, 250=8.85%, 500=0.13%, 750=0.26% cpu : usr=0.04%, sys=4.75%, ctx=1455, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144913: Tue Jun 23 12:42:51 2026 read: IOPS=9, BW=152KiB/s (155kB/s)(5744KiB/37827msec) clat (usec): min=39, max=320610, avg=58706.58, stdev=44362.13 lat (usec): min=39, max=320611, avg=58714.31, stdev=44362.68 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 69], 10.00th=[ 83], 20.00th=[ 24511], | 30.00th=[ 38011], 40.00th=[ 45876], 50.00th=[ 52167], 60.00th=[ 63701], | 70.00th=[ 76022], 80.00th=[ 89654], 90.00th=[106431], 95.00th=[135267], | 99.00th=[206570], 99.50th=[287310], 99.90th=[320865], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 31, max= 318, per=23.78%, avg=150.31, stdev=59.61, samples=74 iops : min= 1, max= 19, avg= 8.64, stdev= 3.77, samples=74 write: IOPS=10, BW=173KiB/s (177kB/s)(6544KiB/37827msec); 0 zone resets clat (usec): min=1664, max=391895, avg=40719.92, stdev=44088.07 lat (usec): min=1666, max=391898, avg=40722.77, stdev=44088.17 clat percentiles (usec): | 1.00th=[ 1844], 5.00th=[ 2180], 10.00th=[ 3425], 20.00th=[ 6718], | 30.00th=[ 10683], 40.00th=[ 16188], 50.00th=[ 24511], 60.00th=[ 35390], | 70.00th=[ 54264], 80.00th=[ 70779], 90.00th=[100140], 95.00th=[127402], | 99.00th=[170918], 99.50th=[210764], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 31, max= 441, per=26.21%, avg=174.29, stdev=86.20, samples=73 iops : min= 1, max= 27, avg=10.14, stdev= 5.44, samples=73 lat (usec) : 50=0.39%, 100=5.47%, 250=0.52%, 500=0.13%, 1000=0.13% lat (msec) : 2=1.43%, 4=5.34%, 10=8.72%, 20=10.42%, 50=25.78% lat (msec) : 100=30.21%, 250=10.94%, 500=0.52% cpu : usr=0.08%, sys=4.68%, ctx=1478, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144914: Tue Jun 23 12:42:51 2026 read: IOPS=10, BW=165KiB/s (169kB/s)(6256KiB/37875msec) clat (usec): min=39, max=221246, avg=49913.56, stdev=38293.58 lat (usec): min=39, max=221248, avg=49916.12, stdev=38293.66 clat percentiles (usec): | 1.00th=[ 44], 5.00th=[ 65], 10.00th=[ 75], 20.00th=[ 18744], | 30.00th=[ 31851], 40.00th=[ 39584], 50.00th=[ 46400], 60.00th=[ 55313], | 70.00th=[ 63701], 80.00th=[ 72877], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[181404], 99.50th=[204473], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 410, per=27.35%, avg=172.86, stdev=82.35, samples=71 iops : min= 1, max= 25, avg=10.06, stdev= 5.19, samples=71 write: IOPS=9, BW=159KiB/s (163kB/s)(6032KiB/37875msec); 0 zone resets clat (usec): min=1534, max=550754, avg=47669.61, stdev=56526.03 lat (usec): min=1534, max=550755, avg=47689.79, stdev=56514.54 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2409], 10.00th=[ 3949], 20.00th=[ 7767], | 30.00th=[ 11994], 40.00th=[ 20579], 50.00th=[ 32375], 60.00th=[ 41157], | 70.00th=[ 56361], 80.00th=[ 76022], 90.00th=[109577], 95.00th=[152044], | 99.00th=[238027], 99.50th=[329253], 99.90th=[549454], 99.95th=[549454], | 99.99th=[549454] bw ( KiB/s): min= 31, max= 341, per=23.97%, avg=159.38, stdev=68.79, samples=73 iops : min= 1, max= 21, avg= 9.19, stdev= 4.34, samples=73 lat (usec) : 50=0.65%, 100=7.16%, 250=0.78%, 750=0.13% lat (msec) : 2=1.69%, 4=3.78%, 10=8.07%, 20=7.94%, 50=30.21% lat (msec) : 100=28.91%, 250=10.29%, 500=0.26%, 750=0.13% cpu : usr=0.06%, sys=4.67%, ctx=1538, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144915: Tue Jun 23 12:42:51 2026 read: IOPS=10, BW=169KiB/s (173kB/s)(6032KiB/35673msec) clat (usec): min=43, max=241300, avg=53295.86, stdev=39491.59 lat (usec): min=44, max=241301, avg=53297.39, stdev=39491.61 clat percentiles (usec): | 1.00th=[ 47], 5.00th=[ 64], 10.00th=[ 74], 20.00th=[ 18482], | 30.00th=[ 34866], 40.00th=[ 42730], 50.00th=[ 49021], 60.00th=[ 59507], | 70.00th=[ 67634], 80.00th=[ 83362], 90.00th=[102237], 95.00th=[127402], | 99.00th=[162530], 99.50th=[183501], 99.90th=[242222], 99.95th=[242222], | 99.99th=[242222] bw ( KiB/s): min= 31, max= 350, per=27.26%, avg=172.28, stdev=74.17, samples=68 iops : min= 1, max= 21, avg= 9.99, stdev= 4.67, samples=68 write: IOPS=10, BW=175KiB/s (180kB/s)(6256KiB/35673msec); 0 zone resets clat (usec): min=1505, max=585955, avg=38626.40, stdev=49707.01 lat (usec): min=1506, max=585957, avg=38629.72, stdev=49707.75 clat percentiles (usec): | 1.00th=[ 1729], 5.00th=[ 2114], 10.00th=[ 3556], 20.00th=[ 6194], | 30.00th=[ 8586], 40.00th=[ 13960], 50.00th=[ 20579], 60.00th=[ 30278], | 70.00th=[ 46400], 80.00th=[ 68682], 90.00th=[ 98042], 95.00th=[117965], | 99.00th=[164627], 99.50th=[358613], 99.90th=[583009], 99.95th=[583009], | 99.99th=[583009] bw ( KiB/s): min= 31, max= 380, per=26.63%, avg=177.07, stdev=79.96, samples=69 iops : min= 1, max= 23, avg=10.29, stdev= 5.08, samples=69 lat (usec) : 50=0.78%, 100=6.77%, 250=1.17%, 500=0.26% lat (msec) : 2=2.34%, 4=4.17%, 10=10.42%, 20=9.11%, 50=26.95% lat (msec) : 100=27.08%, 250=10.68%, 500=0.13%, 750=0.13% cpu : usr=0.04%, sys=4.86%, ctx=1511, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=632KiB/s (648kB/s), 152KiB/s-169KiB/s (155kB/s-173kB/s), io=23.4MiB (24.5MB), run=35357-37875msec WRITE: bw=665KiB/s (681kB/s), 159KiB/s-180KiB/s (163kB/s-184kB/s), io=24.6MiB (25.8MB), run=35357-37875msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144916: Tue Jun 23 12:43:39 2026 read: IOPS=4, BW=68.6KiB/s (70.2kB/s)(5920KiB/86330msec) clat (msec): min=7, max=315, avg=48.77, stdev=48.95 lat (msec): min=7, max=315, avg=48.78, stdev=48.95 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 27], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 45], 80.00th=[ 62], 90.00th=[ 108], 95.00th=[ 159], | 99.00th=[ 245], 99.50th=[ 300], 99.90th=[ 317], 99.95th=[ 317], | 99.99th=[ 317] bw ( KiB/s): min= 30, max= 223, per=30.18%, avg=83.30, stdev=51.14, samples=139 iops : min= 1, max= 13, avg= 4.42, stdev= 3.23, samples=139 write: IOPS=4, BW=73.8KiB/s (75.5kB/s)(6368KiB/86330msec); 0 zone resets clat (msec): min=45, max=669, avg=170.54, stdev=85.56 lat (msec): min=45, max=669, avg=170.54, stdev=85.56 clat percentiles (msec): | 1.00th=[ 60], 5.00th=[ 73], 10.00th=[ 88], 20.00th=[ 105], | 30.00th=[ 120], 40.00th=[ 134], 50.00th=[ 153], 60.00th=[ 171], | 70.00th=[ 197], 80.00th=[ 224], 90.00th=[ 275], 95.00th=[ 338], | 99.00th=[ 472], 99.50th=[ 600], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 30, max= 159, per=25.96%, avg=75.53, stdev=33.84, samples=165 iops : min= 1, max= 9, avg= 3.91, stdev= 2.17, samples=165 lat (msec) : 10=0.39%, 20=10.16%, 50=25.65%, 100=15.10%, 250=41.54% lat (msec) : 500=6.77%, 750=0.39% cpu : usr=0.03%, sys=1.26%, ctx=1370, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144917: Tue Jun 23 12:43:39 2026 read: IOPS=4, BW=66.3KiB/s (67.9kB/s)(5744KiB/86577msec) clat (msec): min=10, max=419, avg=48.65, stdev=52.88 lat (msec): min=10, max=419, avg=48.65, stdev=52.88 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 16], 20.00th=[ 20], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 45], 80.00th=[ 57], 90.00th=[ 103], 95.00th=[ 155], | 99.00th=[ 279], 99.50th=[ 409], 99.90th=[ 422], 99.95th=[ 422], | 99.99th=[ 422] bw ( KiB/s): min= 21, max= 377, per=29.73%, avg=82.04, stdev=55.99, samples=136 iops : min= 1, max= 23, avg= 4.35, stdev= 3.56, samples=136 write: IOPS=4, BW=75.6KiB/s (77.4kB/s)(6544KiB/86577msec); 0 zone resets clat (msec): min=42, max=658, avg=167.66, stdev=77.35 lat (msec): min=42, max=658, avg=167.67, stdev=77.35 clat percentiles (msec): | 1.00th=[ 61], 5.00th=[ 77], 10.00th=[ 89], 20.00th=[ 108], | 30.00th=[ 127], 40.00th=[ 140], 50.00th=[ 155], 60.00th=[ 167], | 70.00th=[ 190], 80.00th=[ 211], 90.00th=[ 259], 95.00th=[ 296], | 99.00th=[ 418], 99.50th=[ 523], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 21, max= 160, per=26.83%, avg=78.06, stdev=31.06, samples=164 iops : min= 1, max= 10, avg= 4.08, stdev= 2.01, samples=164 lat (msec) : 20=9.51%, 50=26.30%, 100=14.71%, 250=42.45%, 500=6.64% lat (msec) : 750=0.39% cpu : usr=0.04%, sys=1.22%, ctx=1356, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144918: Tue Jun 23 12:43:39 2026 read: IOPS=4, BW=75.8KiB/s (77.6kB/s)(6256KiB/82520msec) clat (msec): min=8, max=426, avg=49.83, stdev=49.02 lat (msec): min=8, max=426, avg=49.84, stdev=49.02 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 48], 80.00th=[ 66], 90.00th=[ 110], 95.00th=[ 144], | 99.00th=[ 241], 99.50th=[ 393], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 30, max= 319, per=31.23%, avg=86.18, stdev=57.94, samples=143 iops : min= 1, max= 19, avg= 4.58, stdev= 3.67, samples=143 write: IOPS=4, BW=73.1KiB/s (74.9kB/s)(6032KiB/82520msec); 0 zone resets clat (msec): min=45, max=793, avg=166.66, stdev=78.42 lat (msec): min=45, max=793, avg=166.67, stdev=78.42 clat percentiles (msec): | 1.00th=[ 63], 5.00th=[ 82], 10.00th=[ 90], 20.00th=[ 107], | 30.00th=[ 123], 40.00th=[ 140], 50.00th=[ 150], 60.00th=[ 165], | 70.00th=[ 182], 80.00th=[ 213], 90.00th=[ 271], 95.00th=[ 313], | 99.00th=[ 405], 99.50th=[ 435], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 30, max= 159, per=26.07%, avg=75.88, stdev=33.34, samples=156 iops : min= 1, max= 9, avg= 3.93, stdev= 2.16, samples=156 lat (msec) : 10=0.39%, 20=9.24%, 50=27.34%, 100=15.76%, 250=40.49% lat (msec) : 500=6.64%, 1000=0.13% cpu : usr=0.04%, sys=1.29%, ctx=1355, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144919: Tue Jun 23 12:43:39 2026 read: IOPS=4, BW=71.1KiB/s (72.8kB/s)(6032KiB/84808msec) clat (msec): min=9, max=517, avg=49.60, stdev=52.30 lat (msec): min=9, max=517, avg=49.60, stdev=52.30 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 15], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 26], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 63], 90.00th=[ 102], 95.00th=[ 155], | 99.00th=[ 253], 99.50th=[ 393], 99.90th=[ 518], 99.95th=[ 518], | 99.99th=[ 518] bw ( KiB/s): min= 30, max= 254, per=30.63%, avg=84.53, stdev=53.87, samples=139 iops : min= 1, max= 15, avg= 4.48, stdev= 3.41, samples=139 write: IOPS=4, BW=73.8KiB/s (75.5kB/s)(6256KiB/84808msec); 0 zone resets clat (msec): min=49, max=540, avg=167.63, stdev=76.10 lat (msec): min=49, max=540, avg=167.63, stdev=76.10 clat percentiles (msec): | 1.00th=[ 69], 5.00th=[ 81], 10.00th=[ 92], 20.00th=[ 108], | 30.00th=[ 122], 40.00th=[ 142], 50.00th=[ 153], 60.00th=[ 169], | 70.00th=[ 184], 80.00th=[ 213], 90.00th=[ 255], 95.00th=[ 330], | 99.00th=[ 439], 99.50th=[ 460], 99.90th=[ 542], 99.95th=[ 542], | 99.99th=[ 542] bw ( KiB/s): min= 30, max= 158, per=26.18%, avg=76.19, stdev=32.89, samples=161 iops : min= 1, max= 9, avg= 3.94, stdev= 2.13, samples=161 lat (msec) : 10=0.13%, 20=9.38%, 50=26.30%, 100=16.15%, 250=41.80% lat (msec) : 500=5.99%, 750=0.26% cpu : usr=0.04%, sys=1.41%, ctx=1363, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=277KiB/s (283kB/s), 66.3KiB/s-75.8KiB/s (67.9kB/s-77.6kB/s), io=23.4MiB (24.5MB), run=82520-86577msec WRITE: bw=291KiB/s (298kB/s), 73.1KiB/s-75.6KiB/s (74.9kB/s-77.4kB/s), io=24.6MiB (25.8MB), run=82520-86577msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144941: Tue Jun 23 12:43:58 2026 read: IOPS=1, BW=1714KiB/s (1755kB/s)(7168KiB/4182msec) clat (usec): min=699, max=291378, avg=187898.66, stdev=90051.59 lat (usec): min=701, max=291379, avg=187900.51, stdev=90051.56 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[177210], | 30.00th=[196084], 40.00th=[196084], 50.00th=[204473], 60.00th=[217056], | 70.00th=[217056], 80.00th=[227541], 90.00th=[291505], 95.00th=[291505], | 99.00th=[291505], 99.50th=[291505], 99.90th=[291505], 99.95th=[291505], | 99.99th=[291505] bw ( KiB/s): min= 4031, max= 6144, per=100.00%, avg=5087.50, stdev=1494.12, samples=2 iops : min= 3, max= 6, avg= 4.50, stdev= 2.12, samples=2 write: IOPS=1, BW=1224KiB/s (1254kB/s)(5120KiB/4182msec); 0 zone resets clat (msec): min=117, max=1529, avg=481.78, stdev=596.77 lat (msec): min=118, max=1529, avg=482.24, stdev=596.48 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 118], | 30.00th=[ 142], 40.00th=[ 142], 50.00th=[ 209], 60.00th=[ 209], | 70.00th=[ 414], 80.00th=[ 414], 90.00th=[ 1536], 95.00th=[ 1536], | 99.00th=[ 1536], 99.50th=[ 1536], 99.90th=[ 1536], 99.95th=[ 1536], | 99.99th=[ 1536] bw ( KiB/s): min= 2015, max= 3670, per=60.85%, avg=2573.33, stdev=949.79, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (usec) : 750=8.33% lat (msec) : 250=66.67%, 500=16.67%, 2000=8.33% cpu : usr=0.00%, sys=9.61%, ctx=246, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144942: Tue Jun 23 12:43:58 2026 read: IOPS=0, BW=302KiB/s (309kB/s)(2048KiB/6779msec) clat (msec): min=2, max=2233, avg=1117.78, stdev=1577.71 lat (msec): min=2, max=2233, avg=1117.79, stdev=1577.72 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 3], 10.00th=[ 3], 20.00th=[ 3], | 30.00th=[ 3], 40.00th=[ 3], 50.00th=[ 3], 60.00th=[ 2232], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 1896, max= 2043, per=65.19%, avg=1969.50, stdev=103.94, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1511KiB/s (1547kB/s)(10.0MiB/6779msec); 0 zone resets clat (msec): min=160, max=898, avg=437.91, stdev=275.69 lat (msec): min=160, max=898, avg=438.48, stdev=275.80 clat percentiles (msec): | 1.00th=[ 161], 5.00th=[ 161], 10.00th=[ 161], 20.00th=[ 188], | 30.00th=[ 239], 40.00th=[ 247], 50.00th=[ 317], 60.00th=[ 334], | 70.00th=[ 514], 80.00th=[ 600], 90.00th=[ 885], 95.00th=[ 902], | 99.00th=[ 902], 99.50th=[ 902], 99.90th=[ 902], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 1835, max= 3992, per=53.10%, avg=2245.43, stdev=773.28, samples=7 iops : min= 1, max= 3, avg= 1.29, stdev= 0.76, samples=7 lat (msec) : 4=8.33%, 250=33.33%, 500=16.67%, 750=16.67%, 1000=16.67% lat (msec) : >=2000=8.33% cpu : usr=0.01%, sys=7.54%, ctx=290, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144944: Tue Jun 23 12:43:58 2026 read: IOPS=1, BW=1906KiB/s (1952kB/s)(6144KiB/3223msec) clat (msec): min=17, max=609, avg=205.73, stdev=217.12 lat (msec): min=17, max=609, avg=205.73, stdev=217.12 clat percentiles (msec): | 1.00th=[ 18], 5.00th=[ 18], 10.00th=[ 18], 20.00th=[ 19], | 30.00th=[ 19], 40.00th=[ 157], 50.00th=[ 157], 60.00th=[ 207], | 70.00th=[ 226], 80.00th=[ 226], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1896, max= 4031, per=82.56%, avg=2494.25, stdev=1026.34, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1906KiB/s (1952kB/s)(6144KiB/3223msec); 0 zone resets clat (msec): min=188, max=658, avg=323.70, stdev=176.76 lat (msec): min=188, max=658, avg=323.82, stdev=176.77 clat percentiles (msec): | 1.00th=[ 188], 5.00th=[ 188], 10.00th=[ 188], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 245], 50.00th=[ 245], 60.00th=[ 292], | 70.00th=[ 368], 80.00th=[ 368], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 2015, max= 3225, per=55.11%, avg=2330.75, stdev=596.32, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 lat (msec) : 20=16.67%, 250=50.00%, 500=16.67%, 750=16.67% cpu : usr=0.00%, sys=12.07%, ctx=231, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144946: Tue Jun 23 12:43:58 2026 read: IOPS=0, BW=765KiB/s (783kB/s)(5120KiB/6695msec) clat (usec): min=699, max=442732, avg=208732.93, stdev=199354.20 lat (usec): min=700, max=442734, avg=208734.31, stdev=199354.23 clat percentiles (usec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 1156], 40.00th=[ 1156], 50.00th=[274727], 60.00th=[274727], | 70.00th=[325059], 80.00th=[325059], 90.00th=[442500], 95.00th=[442500], | 99.00th=[442500], 99.50th=[442500], 99.90th=[442500], 99.95th=[442500], | 99.99th=[442500] bw ( KiB/s): min= 1984, max= 6131, per=100.00%, avg=4057.50, stdev=2932.37, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1071KiB/s (1096kB/s)(7168KiB/6695msec); 0 zone resets clat (msec): min=250, max=2767, avg=739.84, stdev=903.61 lat (msec): min=250, max=2768, avg=740.13, stdev=903.89 clat percentiles (msec): | 1.00th=[ 251], 5.00th=[ 251], 10.00th=[ 251], 20.00th=[ 284], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 498], 60.00th=[ 535], | 70.00th=[ 535], 80.00th=[ 558], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1835, max= 4007, per=65.13%, avg=2754.20, stdev=1127.55, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 1.10, samples=5 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 500=58.33%, 750=16.67%, >=2000=8.33% cpu : usr=0.00%, sys=8.35%, ctx=210, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3021KiB/s (3094kB/s), 302KiB/s-1906KiB/s (309kB/s-1952kB/s), io=20.0MiB (20.0MB), run=3223-6779msec WRITE: bw=4230KiB/s (4331kB/s), 1071KiB/s-1906KiB/s (1096kB/s-1952kB/s), io=28.0MiB (29.4MB), run=3223-6779msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144943: Tue Jun 23 12:43:59 2026 read: IOPS=1, BW=1352KiB/s (1384kB/s)(7168KiB/5303msec) clat (msec): min=99, max=985, avg=286.22, stdev=315.10 lat (msec): min=99, max=985, avg=286.22, stdev=315.10 clat percentiles (msec): | 1.00th=[ 101], 5.00th=[ 101], 10.00th=[ 101], 20.00th=[ 121], | 30.00th=[ 123], 40.00th=[ 123], 50.00th=[ 180], 60.00th=[ 211], | 70.00th=[ 211], 80.00th=[ 288], 90.00th=[ 986], 95.00th=[ 986], | 99.00th=[ 986], 99.50th=[ 986], 99.90th=[ 986], 99.95th=[ 986], | 99.99th=[ 986] bw ( KiB/s): min= 1858, max= 4047, per=85.48%, avg=2408.00, stdev=919.81, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 write: IOPS=0, BW=965KiB/s (989kB/s)(5120KiB/5303msec); 0 zone resets clat (msec): min=223, max=1225, avg=629.07, stdev=490.90 lat (msec): min=223, max=1225, avg=629.28, stdev=490.83 clat percentiles (msec): | 1.00th=[ 224], 5.00th=[ 224], 10.00th=[ 224], 20.00th=[ 224], | 30.00th=[ 247], 40.00th=[ 247], 50.00th=[ 351], 60.00th=[ 351], | 70.00th=[ 1099], 80.00th=[ 1099], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 2048, max= 4079, per=69.11%, avg=2725.00, stdev=1172.60, samples=3 iops : min= 2, max= 3, avg= 2.33, stdev= 0.58, samples=3 lat (msec) : 100=8.33%, 250=50.00%, 500=16.67%, 1000=8.33%, 2000=16.67% cpu : usr=0.00%, sys=2.47%, ctx=70, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144945: Tue Jun 23 12:43:59 2026 read: IOPS=0, BW=282KiB/s (288kB/s)(2048KiB/7270msec) clat (msec): min=205, max=2202, avg=1204.06, stdev=1412.41 lat (msec): min=205, max=2202, avg=1204.06, stdev=1412.41 clat percentiles (msec): | 1.00th=[ 205], 5.00th=[ 205], 10.00th=[ 205], 20.00th=[ 205], | 30.00th=[ 205], 40.00th=[ 205], 50.00th=[ 205], 60.00th=[ 2198], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 1868, max= 2048, per=69.51%, avg=1958.00, stdev=127.28, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1409KiB/s (1442kB/s)(10.0MiB/7270msec); 0 zone resets clat (msec): min=217, max=762, avg=447.96, stdev=199.02 lat (msec): min=217, max=762, avg=448.15, stdev=199.05 clat percentiles (msec): | 1.00th=[ 218], 5.00th=[ 218], 10.00th=[ 218], 20.00th=[ 264], | 30.00th=[ 300], 40.00th=[ 300], 50.00th=[ 313], 60.00th=[ 481], | 70.00th=[ 535], 80.00th=[ 567], 90.00th=[ 743], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1868, max= 4087, per=57.18%, avg=2254.62, stdev=742.58, samples=8 iops : min= 1, max= 3, avg= 1.38, stdev= 0.74, samples=8 lat (msec) : 250=16.67%, 500=41.67%, 750=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.03%, sys=3.54%, ctx=165, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144947: Tue Jun 23 12:43:59 2026 read: IOPS=0, BW=895KiB/s (916kB/s)(6144KiB/6866msec) clat (msec): min=85, max=497, avg=217.06, stdev=152.36 lat (msec): min=85, max=497, avg=217.06, stdev=152.36 clat percentiles (msec): | 1.00th=[ 86], 5.00th=[ 86], 10.00th=[ 86], 20.00th=[ 107], | 30.00th=[ 107], 40.00th=[ 148], 50.00th=[ 148], 60.00th=[ 197], | 70.00th=[ 268], 80.00th=[ 268], 90.00th=[ 498], 95.00th=[ 498], | 99.00th=[ 498], 99.50th=[ 498], 99.90th=[ 498], 99.95th=[ 498], | 99.99th=[ 498] bw ( KiB/s): min= 2031, max= 3946, per=100.00%, avg=3238.00, stdev=1050.50, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=895KiB/s (916kB/s)(6144KiB/6866msec); 0 zone resets clat (msec): min=338, max=2591, avg=892.79, stdev=857.35 lat (msec): min=338, max=2591, avg=892.92, stdev=857.43 clat percentiles (msec): | 1.00th=[ 338], 5.00th=[ 338], 10.00th=[ 338], 20.00th=[ 422], | 30.00th=[ 422], 40.00th=[ 435], 50.00th=[ 435], 60.00th=[ 667], | 70.00th=[ 902], 80.00th=[ 902], 90.00th=[ 2601], 95.00th=[ 2601], | 99.00th=[ 2601], 99.50th=[ 2601], 99.90th=[ 2601], 99.95th=[ 2601], | 99.99th=[ 2601] bw ( KiB/s): min= 1973, max= 2048, per=51.26%, avg=2021.17, stdev=32.48, samples=6 iops : min= 1, max= 2, avg= 1.33, stdev= 0.52, samples=6 lat (msec) : 100=8.33%, 250=25.00%, 500=41.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.03%, sys=2.68%, ctx=146, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144948: Tue Jun 23 12:43:59 2026 read: IOPS=0, BW=861KiB/s (882kB/s)(5120KiB/5945msec) clat (msec): min=120, max=312, avg=190.75, stdev=73.14 lat (msec): min=120, max=312, avg=190.75, stdev=73.14 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 121], | 30.00th=[ 157], 40.00th=[ 157], 50.00th=[ 169], 60.00th=[ 169], | 70.00th=[ 197], 80.00th=[ 197], 90.00th=[ 313], 95.00th=[ 313], | 99.00th=[ 313], 99.50th=[ 313], 99.90th=[ 313], 99.95th=[ 313], | 99.99th=[ 313] bw ( KiB/s): min= 1973, max= 6119, per=100.00%, avg=4046.00, stdev=2931.66, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=1, BW=1206KiB/s (1235kB/s)(7168KiB/5945msec); 0 zone resets clat (msec): min=200, max=2766, avg=699.84, stdev=921.45 lat (msec): min=200, max=2766, avg=699.94, stdev=921.46 clat percentiles (msec): | 1.00th=[ 201], 5.00th=[ 201], 10.00th=[ 201], 20.00th=[ 224], | 30.00th=[ 288], 40.00th=[ 288], 50.00th=[ 384], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 600], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1973, max= 3737, per=59.90%, avg=2361.80, stdev=769.42, samples=5 iops : min= 1, max= 3, avg= 1.80, stdev= 0.84, samples=5 lat (msec) : 250=50.00%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=2.34%, ctx=88, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2817KiB/s (2885kB/s), 282KiB/s-1352KiB/s (288kB/s-1384kB/s), io=20.0MiB (20.0MB), run=5303-7270msec WRITE: bw=3944KiB/s (4039kB/s), 895KiB/s-1409KiB/s (916kB/s-1442kB/s), io=28.0MiB (29.4MB), run=5303-7270msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=144956: Tue Jun 23 12:44:19 2026 read: IOPS=1, BW=5673KiB/s (5809kB/s)(12.0MiB/2166msec) clat (msec): min=306, max=1295, avg=669.97, stdev=544.48 lat (msec): min=306, max=1295, avg=669.97, stdev=544.48 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 309], | 30.00th=[ 309], 40.00th=[ 409], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7529, max= 7787, per=100.00%, avg=7658.00, stdev=182.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.00%, sys=4.25%, ctx=58, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144957: Tue Jun 23 12:44:19 2026 read: IOPS=0, BW=826KiB/s (846kB/s)(4096KiB/4956msec) clat (nsec): min=1234.1M, max=1234.1M, avg=1234130548.00, stdev= 0.00 lat (nsec): min=1234.1M, max=1234.1M, avg=1234133288.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1234], 5.00th=[ 1234], 10.00th=[ 1234], 20.00th=[ 1234], | 30.00th=[ 1234], 40.00th=[ 1234], 50.00th=[ 1234], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=1653KiB/s (1693kB/s)(8192KiB/4956msec); 0 zone resets clat (msec): min=461, max=3157, avg=1809.62, stdev=1906.20 lat (msec): min=462, max=3157, avg=1810.06, stdev=1906.21 clat percentiles (msec): | 1.00th=[ 464], 5.00th=[ 464], 10.00th=[ 464], 20.00th=[ 464], | 30.00th=[ 464], 40.00th=[ 464], 50.00th=[ 464], 60.00th=[ 3171], | 70.00th=[ 3171], 80.00th=[ 3171], 90.00th=[ 3171], 95.00th=[ 3171], | 99.00th=[ 3171], 99.50th=[ 3171], 99.90th=[ 3171], 99.95th=[ 3171], | 99.99th=[ 3171] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.02%, sys=2.42%, ctx=52, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144958: Tue Jun 23 12:44:19 2026 write: IOPS=0, BW=2535KiB/s (2595kB/s)(12.0MiB/4848msec); 0 zone resets clat (msec): min=1173, max=2126, avg=1569.27, stdev=496.48 lat (msec): min=1176, max=2127, avg=1570.86, stdev=495.72 clat percentiles (msec): | 1.00th=[ 1167], 5.00th=[ 1167], 10.00th=[ 1167], 20.00th=[ 1167], | 30.00th=[ 1167], 40.00th=[ 1401], 50.00th=[ 1401], 60.00th=[ 1401], | 70.00th=[ 2123], 80.00th=[ 2123], 90.00th=[ 2123], 95.00th=[ 2123], | 99.00th=[ 2123], 99.50th=[ 2123], 99.90th=[ 2123], 99.95th=[ 2123], | 99.99th=[ 2123] bw ( KiB/s): min= 8159, max= 8175, per=100.00%, avg=8167.00, stdev=11.31, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.28%, ctx=72, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144959: Tue Jun 23 12:44:19 2026 write: IOPS=0, BW=3389KiB/s (3470kB/s)(12.0MiB/3626msec); 0 zone resets clat (msec): min=630, max=2056, avg=1124.82, stdev=807.22 lat (msec): min=633, max=2057, avg=1126.12, stdev=806.81 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 684], 50.00th=[ 684], 60.00th=[ 684], | 70.00th=[ 2056], 80.00th=[ 2056], 90.00th=[ 2056], 95.00th=[ 2056], | 99.00th=[ 2056], 99.50th=[ 2056], 99.90th=[ 2056], 99.95th=[ 2056], | 99.99th=[ 2056] bw ( KiB/s): min= 7529, max= 8175, per=100.00%, avg=7852.00, stdev=456.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, >=2000=33.33% cpu : usr=0.00%, sys=3.03%, ctx=82, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3306KiB/s (3385kB/s), 826KiB/s-5673KiB/s (846kB/s-5809kB/s), io=16.0MiB (16.8MB), run=2166-4956msec WRITE: bw=6612KiB/s (6770kB/s), 1653KiB/s-3389KiB/s (1693kB/s-3470kB/s), io=32.0MiB (33.6MB), run=3626-4956msec rand-rw: (groupid=0, jobs=1): err= 0: pid=144960: Tue Jun 23 12:44:19 2026 read: IOPS=0, BW=3454KiB/s (3537kB/s)(12.0MiB/3558msec) clat (msec): min=1016, max=1326, avg=1119.58, stdev=178.85 lat (msec): min=1016, max=1326, avg=1119.58, stdev=178.85 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1020], | 70.00th=[ 1334], 80.00th=[ 1334], 90.00th=[ 1334], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 8094, max= 8175, per=100.00%, avg=8134.50, stdev=57.28, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 2000=100.00% cpu : usr=0.00%, sys=8.63%, ctx=232, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144962: Tue Jun 23 12:44:19 2026 read: IOPS=0, BW=1072KiB/s (1098kB/s)(4096KiB/3820msec) clat (nsec): min=863051k, max=863051k, avg=863050863.00, stdev= 0.00 lat (nsec): min=863053k, max=863053k, avg=863053484.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 860], 5.00th=[ 860], 10.00th=[ 860], 20.00th=[ 860], | 30.00th=[ 860], 40.00th=[ 860], 50.00th=[ 860], 60.00th=[ 860], | 70.00th=[ 860], 80.00th=[ 860], 90.00th=[ 860], 95.00th=[ 860], | 99.00th=[ 860], 99.50th=[ 860], 99.90th=[ 860], 99.95th=[ 860], | 99.99th=[ 860] bw ( KiB/s): min= 8094, max= 8094, per=100.00%, avg=8094.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2145KiB/s (2196kB/s)(8192KiB/3820msec); 0 zone resets clat (msec): min=1274, max=1429, avg=1352.33, stdev=109.65 lat (msec): min=1280, max=1430, avg=1355.54, stdev=106.25 clat percentiles (msec): | 1.00th=[ 1267], 5.00th=[ 1267], 10.00th=[ 1267], 20.00th=[ 1267], | 30.00th=[ 1267], 40.00th=[ 1267], 50.00th=[ 1267], 60.00th=[ 1435], | 70.00th=[ 1435], 80.00th=[ 1435], 90.00th=[ 1435], 95.00th=[ 1435], | 99.00th=[ 1435], 99.50th=[ 1435], 99.90th=[ 1435], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 8031, max= 8031, per=100.00%, avg=8031.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=1.70%, ctx=60, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144963: Tue Jun 23 12:44:19 2026 write: IOPS=0, BW=2397KiB/s (2455kB/s)(12.0MiB/5126msec); 0 zone resets clat (msec): min=911, max=2244, avg=1566.45, stdev=666.70 lat (msec): min=912, max=2244, avg=1567.07, stdev=666.38 clat percentiles (msec): | 1.00th=[ 911], 5.00th=[ 911], 10.00th=[ 911], 20.00th=[ 911], | 30.00th=[ 911], 40.00th=[ 1536], 50.00th=[ 1536], 60.00th=[ 1536], | 70.00th=[ 2232], 80.00th=[ 2232], 90.00th=[ 2232], 95.00th=[ 2232], | 99.00th=[ 2232], 99.50th=[ 2232], 99.90th=[ 2232], 99.95th=[ 2232], | 99.99th=[ 2232] bw ( KiB/s): min= 8143, max= 8175, per=100.00%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=2.83%, ctx=66, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=144964: Tue Jun 23 12:44:19 2026 write: IOPS=0, BW=3346KiB/s (3427kB/s)(12.0MiB/3672msec); 0 zone resets clat (msec): min=877, max=1403, avg=1141.08, stdev=262.92 lat (msec): min=878, max=1404, avg=1142.64, stdev=262.91 clat percentiles (msec): | 1.00th=[ 877], 5.00th=[ 877], 10.00th=[ 877], 20.00th=[ 877], | 30.00th=[ 877], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 1150], | 70.00th=[ 1401], 80.00th=[ 1401], 90.00th=[ 1401], 95.00th=[ 1401], | 99.00th=[ 1401], 99.50th=[ 1401], 99.90th=[ 1401], 99.95th=[ 1401], | 99.99th=[ 1401] bw ( KiB/s): min= 8031, max= 8094, per=100.00%, avg=8062.50, stdev=44.55, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 1000=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.41%, ctx=58, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4289KiB/s (4392kB/s), 1072KiB/s-3454KiB/s (1098kB/s-3537kB/s), io=16.0MiB (16.8MB), run=3558-3820msec WRITE: bw=6393KiB/s (6546kB/s), 2145KiB/s-3346KiB/s (2196kB/s-3427kB/s), io=32.0MiB (33.6MB), run=3672-5126msec