== sanity test 398b: DIO and buffer IO race ============== 07:57:41 (1782734261) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 7.88107 s, 6.4 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178503: Mon Jun 29 07:59:51 2026 read: IOPS=14, BW=57.6KiB/s (59.0kB/s)(5992KiB/103940msec) clat (usec): min=41, max=817584, avg=38632.86, stdev=30691.78 lat (usec): min=41, max=817585, avg=38636.40, stdev=30692.41 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 11207], 10.00th=[ 15664], 20.00th=[ 20579], | 30.00th=[ 24773], 40.00th=[ 29230], 50.00th=[ 34341], 60.00th=[ 39584], | 70.00th=[ 45351], 80.00th=[ 53216], 90.00th=[ 65274], 95.00th=[ 79168], | 99.00th=[124257], 99.50th=[129500], 99.90th=[248513], 99.95th=[817890], | 99.99th=[817890] bw ( KiB/s): min= 6, max= 111, per=25.27%, avg=57.10, stdev=19.36, samples=205 iops : min= 1, max= 27, avg=13.63, stdev= 4.88, samples=205 write: IOPS=15, BW=60.6KiB/s (62.0kB/s)(6296KiB/103940msec); 0 zone resets clat (usec): min=935, max=321064, avg=29008.37, stdev=29889.77 lat (usec): min=936, max=321066, avg=29013.17, stdev=29891.72 clat percentiles (usec): | 1.00th=[ 1188], 5.00th=[ 1336], 10.00th=[ 1565], 20.00th=[ 3556], | 30.00th=[ 6587], 40.00th=[ 13435], 50.00th=[ 20317], 60.00th=[ 28443], | 70.00th=[ 37487], 80.00th=[ 50070], 90.00th=[ 69731], 95.00th=[ 85459], | 99.00th=[121111], 99.50th=[156238], 99.90th=[214959], 99.95th=[320865], | 99.99th=[320865] bw ( KiB/s): min= 7, max= 159, per=25.56%, avg=60.59, stdev=22.87, samples=203 iops : min= 1, max= 39, avg=14.50, stdev= 5.75, samples=203 lat (usec) : 50=0.23%, 100=1.50%, 250=0.10%, 1000=0.07% lat (msec) : 2=7.00%, 4=4.00%, 10=7.45%, 20=14.16%, 50=43.88% lat (msec) : 100=19.27%, 250=2.28%, 500=0.03%, 1000=0.03% cpu : usr=0.11%, sys=6.12%, ctx=6563, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178504: Mon Jun 29 07:59:51 2026 read: IOPS=14, BW=56.0KiB/s (57.4kB/s)(5940KiB/106015msec) clat (usec): min=34, max=203281, avg=38419.74, stdev=23740.87 lat (usec): min=35, max=203282, avg=38426.43, stdev=23743.06 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 11469], 10.00th=[ 15401], 20.00th=[ 19792], | 30.00th=[ 24511], 40.00th=[ 28967], 50.00th=[ 33817], 60.00th=[ 39060], | 70.00th=[ 45351], 80.00th=[ 53740], 90.00th=[ 67634], 95.00th=[ 79168], | 99.00th=[117965], 99.50th=[154141], 99.90th=[200279], 99.95th=[202376], | 99.99th=[202376] bw ( KiB/s): min= 6, max= 118, per=24.60%, avg=55.60, stdev=20.81, samples=208 iops : min= 1, max= 29, avg=13.25, stdev= 5.23, samples=208 write: IOPS=14, BW=59.9KiB/s (61.3kB/s)(6348KiB/106015msec); 0 zone resets clat (usec): min=1004, max=769297, avg=30579.26, stdev=34848.57 lat (usec): min=1006, max=769300, avg=30580.78, stdev=34848.57 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1729], 20.00th=[ 4047], | 30.00th=[ 7898], 40.00th=[ 16581], 50.00th=[ 22676], 60.00th=[ 29230], | 70.00th=[ 39060], 80.00th=[ 51119], 90.00th=[ 70779], 95.00th=[ 85459], | 99.00th=[127402], 99.50th=[139461], 99.90th=[250610], 99.95th=[767558], | 99.99th=[767558] bw ( KiB/s): min= 7, max= 158, per=25.04%, avg=59.34, stdev=23.86, samples=208 iops : min= 1, max= 39, avg=14.19, stdev= 5.98, samples=208 lat (usec) : 50=0.16%, 100=1.14%, 250=0.07%, 500=0.03% lat (msec) : 2=5.70%, 4=4.62%, 10=7.19%, 20=14.29%, 50=44.37% lat (msec) : 100=19.95%, 250=2.41%, 500=0.03%, 1000=0.03% cpu : usr=0.07%, sys=5.90%, ctx=6633, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178505: Mon Jun 29 07:59:51 2026 read: IOPS=14, BW=57.7KiB/s (59.1kB/s)(6028KiB/104413msec) clat (usec): min=38, max=245768, avg=37871.30, stdev=24992.10 lat (usec): min=39, max=245769, avg=37874.97, stdev=24991.88 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 8291], 10.00th=[ 15008], 20.00th=[ 19792], | 30.00th=[ 23725], 40.00th=[ 27919], 50.00th=[ 32900], 60.00th=[ 38536], | 70.00th=[ 44303], 80.00th=[ 53740], 90.00th=[ 66323], 95.00th=[ 81265], | 99.00th=[124257], 99.50th=[143655], 99.90th=[206570], 99.95th=[246416], | 99.99th=[246416] bw ( KiB/s): min= 15, max= 111, per=25.57%, avg=57.79, stdev=19.17, samples=204 iops : min= 3, max= 27, avg=13.80, stdev= 4.82, samples=204 write: IOPS=14, BW=59.0KiB/s (61.4kB/s)(6260KiB/104413msec); 0 zone resets clat (usec): min=965, max=1051.4k, avg=29967.22, stdev=38000.79 lat (usec): min=966, max=1051.4k, avg=29968.97, stdev=38000.85 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1336], 10.00th=[ 1549], | 20.00th=[ 3851], 30.00th=[ 7373], 40.00th=[ 16319], | 50.00th=[ 22938], 60.00th=[ 30016], 70.00th=[ 38536], | 80.00th=[ 49546], 90.00th=[ 68682], 95.00th=[ 84411], | 99.00th=[ 120062], 99.50th=[ 131597], 99.90th=[ 179307], | 99.95th=[1052771], 99.99th=[1052771] bw ( KiB/s): min= 7, max= 142, per=25.31%, avg=59.98, stdev=24.55, samples=204 iops : min= 1, max= 35, avg=14.35, stdev= 6.18, samples=204 lat (usec) : 50=0.46%, 100=1.56%, 250=0.07%, 500=0.07%, 1000=0.07% lat (msec) : 2=6.48%, 4=3.94%, 10=7.03%, 20=13.74%, 50=44.99% lat (msec) : 100=19.04%, 250=2.54%, 2000=0.03% cpu : usr=0.10%, sys=5.97%, ctx=6607, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178506: Mon Jun 29 07:59:51 2026 read: IOPS=14, BW=58.3KiB/s (59.7kB/s)(6052KiB/103834msec) clat (usec): min=39, max=899690, avg=37790.87, stdev=32503.51 lat (usec): min=40, max=899691, avg=37800.24, stdev=32498.81 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 2278], 10.00th=[ 14615], 20.00th=[ 19530], | 30.00th=[ 23987], 40.00th=[ 28443], 50.00th=[ 32900], 60.00th=[ 38011], | 70.00th=[ 44827], 80.00th=[ 52691], 90.00th=[ 66323], 95.00th=[ 77071], | 99.00th=[116917], 99.50th=[122160], 99.90th=[329253], 99.95th=[901776], | 99.99th=[901776] bw ( KiB/s): min= 7, max= 100, per=25.67%, avg=58.00, stdev=18.94, samples=204 iops : min= 1, max= 25, avg=13.86, stdev= 4.74, samples=204 write: IOPS=15, BW=60.1KiB/s (61.5kB/s)(6236KiB/103834msec); 0 zone resets clat (usec): min=884, max=223759, avg=29679.44, stdev=29587.69 lat (usec): min=886, max=223760, avg=29684.50, stdev=29587.04 clat percentiles (usec): | 1.00th=[ 1205], 5.00th=[ 1352], 10.00th=[ 1647], 20.00th=[ 3785], | 30.00th=[ 7242], 40.00th=[ 15401], 50.00th=[ 21627], 60.00th=[ 29492], | 70.00th=[ 38536], 80.00th=[ 50070], 90.00th=[ 69731], 95.00th=[ 89654], | 99.00th=[125305], 99.50th=[154141], 99.90th=[173016], 99.95th=[223347], | 99.99th=[223347] bw ( KiB/s): min= 7, max= 149, per=25.21%, avg=59.75, stdev=24.17, samples=204 iops : min= 1, max= 37, avg=14.29, stdev= 6.07, samples=204 lat (usec) : 50=0.23%, 100=2.02%, 250=0.10%, 500=0.03%, 1000=0.07% lat (msec) : 2=6.28%, 4=4.20%, 10=7.10%, 20=14.39%, 50=44.08% lat (msec) : 100=19.01%, 250=2.44%, 500=0.03%, 1000=0.03% cpu : usr=0.09%, sys=6.06%, ctx=6654, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=226KiB/s (232kB/s), 56.0KiB/s-58.3KiB/s (57.4kB/s-59.7kB/s), io=23.4MiB (24.6MB), run=103834-106015msec WRITE: bw=237KiB/s (243kB/s), 59.9KiB/s-60.6KiB/s (61.3kB/s-62.0kB/s), io=24.6MiB (25.7MB), run=103834-106015msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178507: Mon Jun 29 08:00:32 2026 read: IOPS=10, BW=41.3KiB/s (42.2kB/s)(5992KiB/145257msec) clat (msec): min=6, max=807, avg=37.53, stdev=36.43 lat (msec): min=6, max=807, avg=37.53, stdev=36.43 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 39], 80.00th=[ 53], 90.00th=[ 75], 95.00th=[ 100], | 99.00th=[ 148], 99.50th=[ 171], 99.90th=[ 401], 99.95th=[ 810], | 99.99th=[ 810] bw ( KiB/s): min= 7, max= 135, per=25.18%, avg=41.05, stdev=24.38, samples=285 iops : min= 1, max= 33, avg= 9.61, stdev= 6.11, samples=285 write: IOPS=10, BW=43.3KiB/s (44.4kB/s)(6296KiB/145257msec); 0 zone resets clat (msec): min=11, max=351, avg=56.34, stdev=35.33 lat (msec): min=11, max=351, avg=56.35, stdev=35.33 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 24], 20.00th=[ 30], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 81], 90.00th=[ 103], 95.00th=[ 127], | 99.00th=[ 174], 99.50th=[ 207], 99.90th=[ 288], 99.95th=[ 351], | 99.99th=[ 351] bw ( KiB/s): min= 7, max= 136, per=25.38%, avg=43.15, stdev=22.21, samples=285 iops : min= 1, max= 34, avg=10.14, stdev= 5.62, samples=285 lat (msec) : 10=1.82%, 20=15.89%, 50=48.96%, 100=25.10%, 250=8.07% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.29%, ctx=4792, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178508: Mon Jun 29 08:00:32 2026 read: IOPS=10, BW=40.8KiB/s (41.8kB/s)(5940KiB/145629msec) clat (msec): min=5, max=955, avg=38.75, stdev=39.75 lat (msec): min=5, max=955, avg=38.76, stdev=39.75 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 41], 80.00th=[ 53], 90.00th=[ 80], 95.00th=[ 107], | 99.00th=[ 157], 99.50th=[ 176], 99.90th=[ 347], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 7, max= 136, per=25.15%, avg=41.00, stdev=24.90, samples=283 iops : min= 1, max= 34, avg= 9.60, stdev= 6.29, samples=283 write: IOPS=10, BW=43.6KiB/s (44.6kB/s)(6348KiB/145629msec); 0 zone resets clat (msec): min=8, max=372, avg=55.30, stdev=35.94 lat (msec): min=8, max=372, avg=55.30, stdev=35.93 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 24], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 77], 90.00th=[ 101], 95.00th=[ 123], | 99.00th=[ 176], 99.50th=[ 241], 99.90th=[ 363], 99.95th=[ 372], | 99.99th=[ 372] bw ( KiB/s): min= 7, max= 111, per=25.52%, avg=43.38, stdev=21.84, samples=286 iops : min= 1, max= 27, avg=10.19, stdev= 5.48, samples=286 lat (msec) : 10=2.28%, 20=14.62%, 50=50.46%, 100=24.51%, 250=7.98% lat (msec) : 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=2.34%, ctx=4882, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178509: Mon Jun 29 08:00:32 2026 read: IOPS=10, BW=41.0KiB/s (42.0kB/s)(6028KiB/146869msec) clat (msec): min=5, max=354, avg=39.17, stdev=32.98 lat (msec): min=5, max=354, avg=39.17, stdev=32.98 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 21], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 43], 80.00th=[ 57], 90.00th=[ 82], 95.00th=[ 108], | 99.00th=[ 155], 99.50th=[ 182], 99.90th=[ 262], 99.95th=[ 355], | 99.99th=[ 355] bw ( KiB/s): min= 7, max= 135, per=25.36%, avg=41.33, stdev=23.14, samples=284 iops : min= 1, max= 33, avg= 9.68, stdev= 5.82, samples=284 write: IOPS=10, BW=42.6KiB/s (43.6kB/s)(6260KiB/146869msec); 0 zone resets clat (msec): min=10, max=1011, avg=55.94, stdev=42.29 lat (msec): min=10, max=1011, avg=55.94, stdev=42.29 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 21], 10.00th=[ 25], 20.00th=[ 30], | 30.00th=[ 35], 40.00th=[ 39], 50.00th=[ 45], 60.00th=[ 53], | 70.00th=[ 63], 80.00th=[ 78], 90.00th=[ 101], 95.00th=[ 123], | 99.00th=[ 194], 99.50th=[ 234], 99.90th=[ 292], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 128, per=25.16%, avg=42.77, stdev=22.09, samples=285 iops : min= 1, max= 32, avg=10.04, stdev= 5.56, samples=285 lat (msec) : 10=2.34%, 20=14.10%, 50=49.32%, 100=26.33%, 250=7.68% lat (msec) : 500=0.20%, 2000=0.03% cpu : usr=0.06%, sys=2.32%, ctx=4807, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178510: Mon Jun 29 08:00:32 2026 read: IOPS=10, BW=41.1KiB/s (42.1kB/s)(6052KiB/147205msec) clat (msec): min=6, max=290, avg=38.81, stdev=32.76 lat (msec): min=6, max=290, avg=38.82, stdev=32.76 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 34], | 70.00th=[ 42], 80.00th=[ 55], 90.00th=[ 81], 95.00th=[ 108], | 99.00th=[ 167], 99.50th=[ 186], 99.90th=[ 213], 99.95th=[ 292], | 99.99th=[ 292] bw ( KiB/s): min= 7, max= 127, per=25.44%, avg=41.47, stdev=23.61, samples=285 iops : min= 1, max= 31, avg= 9.72, stdev= 5.93, samples=285 write: IOPS=10, BW=42.4KiB/s (43.4kB/s)(6236KiB/147205msec); 0 zone resets clat (msec): min=11, max=903, avg=56.47, stdev=41.62 lat (msec): min=11, max=903, avg=56.47, stdev=41.62 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 21], 10.00th=[ 23], 20.00th=[ 29], | 30.00th=[ 34], 40.00th=[ 40], 50.00th=[ 46], 60.00th=[ 55], | 70.00th=[ 66], 80.00th=[ 81], 90.00th=[ 102], 95.00th=[ 123], | 99.00th=[ 178], 99.50th=[ 234], 99.90th=[ 363], 99.95th=[ 902], | 99.99th=[ 902] bw ( KiB/s): min= 7, max= 117, per=24.93%, avg=42.37, stdev=21.83, samples=287 iops : min= 1, max= 29, avg= 9.94, stdev= 5.50, samples=287 lat (msec) : 10=1.79%, 20=15.82%, 50=49.02%, 100=25.16%, 250=7.98% lat (msec) : 500=0.20%, 1000=0.03% cpu : usr=0.07%, sys=2.21%, ctx=4728, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=163KiB/s (167kB/s), 40.8KiB/s-41.3KiB/s (41.8kB/s-42.2kB/s), io=23.4MiB (24.6MB), run=145257-147205msec WRITE: bw=171KiB/s (175kB/s), 42.4KiB/s-43.6KiB/s (43.4kB/s-44.6kB/s), io=24.6MiB (25.7MB), run=145257-147205msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178548: Mon Jun 29 08:01:18 2026 read: IOPS=10, BW=176KiB/s (180kB/s)(5920KiB/33707msec) clat (usec): min=38, max=222108, avg=47870.23, stdev=32990.23 lat (usec): min=39, max=222110, avg=47871.50, stdev=32990.33 clat percentiles (usec): | 1.00th=[ 50], 5.00th=[ 60], 10.00th=[ 94], 20.00th=[ 22938], | 30.00th=[ 29754], 40.00th=[ 35390], 50.00th=[ 43254], 60.00th=[ 49546], | 70.00th=[ 61604], 80.00th=[ 69731], 90.00th=[ 91751], 95.00th=[108528], | 99.00th=[141558], 99.50th=[179307], 99.90th=[221250], 99.95th=[221250], | 99.99th=[221250] bw ( KiB/s): min= 31, max= 345, per=25.84%, avg=175.73, stdev=66.65, samples=66 iops : min= 1, max= 21, avg=10.15, stdev= 4.20, samples=66 write: IOPS=11, BW=189KiB/s (193kB/s)(6368KiB/33707msec); 0 zone resets clat (usec): min=1616, max=300613, avg=39466.79, stdev=39899.40 lat (usec): min=1617, max=300615, avg=39468.99, stdev=39899.26 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 1909], 10.00th=[ 2802], 20.00th=[ 7177], | 30.00th=[ 12256], 40.00th=[ 19530], 50.00th=[ 27132], 60.00th=[ 37487], | 70.00th=[ 51119], 80.00th=[ 64750], 90.00th=[ 95945], 95.00th=[119014], | 99.00th=[166724], 99.50th=[191890], 99.90th=[299893], 99.95th=[299893], | 99.99th=[299893] bw ( KiB/s): min= 30, max= 441, per=26.45%, avg=189.35, stdev=78.66, samples=66 iops : min= 1, max= 27, avg=11.02, stdev= 4.93, samples=66 lat (usec) : 50=0.52%, 100=4.30%, 250=0.13%, 750=0.13% lat (msec) : 2=2.86%, 4=4.95%, 10=6.12%, 20=10.03%, 50=36.33% lat (msec) : 100=26.30%, 250=8.20%, 500=0.13% cpu : usr=0.08%, sys=5.98%, ctx=1724, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178549: Mon Jun 29 08:01:18 2026 read: IOPS=10, BW=163KiB/s (167kB/s)(5744KiB/35172msec) clat (usec): min=37, max=207954, avg=51574.74, stdev=35004.10 lat (usec): min=37, max=207955, avg=51586.32, stdev=34989.24 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 64], 10.00th=[ 13435], 20.00th=[ 26608], | 30.00th=[ 33162], 40.00th=[ 40109], 50.00th=[ 46400], 60.00th=[ 53216], | 70.00th=[ 62129], 80.00th=[ 74974], 90.00th=[ 93848], 95.00th=[121111], | 99.00th=[170918], 99.50th=[196084], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 28, max= 415, per=24.71%, avg=168.06, stdev=73.63, samples=67 iops : min= 1, max= 25, avg= 9.67, stdev= 4.63, samples=67 write: IOPS=11, BW=186KiB/s (191kB/s)(6544KiB/35172msec); 0 zone resets clat (usec): min=1450, max=339543, avg=40182.47, stdev=40205.33 lat (usec): min=1452, max=339546, avg=40184.53, stdev=40205.36 clat percentiles (usec): | 1.00th=[ 1778], 5.00th=[ 2245], 10.00th=[ 3851], 20.00th=[ 8225], | 30.00th=[ 13960], 40.00th=[ 19530], 50.00th=[ 28181], 60.00th=[ 37487], | 70.00th=[ 51643], 80.00th=[ 66323], 90.00th=[ 89654], 95.00th=[121111], | 99.00th=[168821], 99.50th=[185598], 99.90th=[337642], 99.95th=[337642], | 99.99th=[337642] bw ( KiB/s): min= 31, max= 414, per=25.98%, avg=186.03, stdev=76.11, samples=69 iops : min= 1, max= 25, avg=10.80, stdev= 4.78, samples=69 lat (usec) : 50=0.26%, 100=3.78%, 250=0.13% lat (msec) : 2=1.82%, 4=3.52%, 10=7.55%, 20=11.33%, 50=34.64% lat (msec) : 100=29.17%, 250=7.68%, 500=0.13% cpu : usr=0.05%, sys=5.50%, ctx=1723, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178550: Mon Jun 29 08:01:18 2026 read: IOPS=11, BW=185KiB/s (189kB/s)(6256KiB/33861msec) clat (usec): min=41, max=228285, avg=50919.16, stdev=33619.96 lat (usec): min=41, max=228286, avg=50920.33, stdev=33619.95 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 73], 10.00th=[ 16319], 20.00th=[ 24773], | 30.00th=[ 31589], 40.00th=[ 39060], 50.00th=[ 44827], 60.00th=[ 53216], | 70.00th=[ 63177], 80.00th=[ 74974], 90.00th=[ 92799], 95.00th=[107480], | 99.00th=[170918], 99.50th=[219153], 99.90th=[227541], 99.95th=[227541], | 99.99th=[227541] bw ( KiB/s): min= 63, max= 351, per=27.19%, avg=184.86, stdev=72.11, samples=66 iops : min= 3, max= 21, avg=10.74, stdev= 4.52, samples=66 write: IOPS=11, BW=178KiB/s (182kB/s)(6032KiB/33861msec); 0 zone resets clat (usec): min=1285, max=234281, avg=36408.98, stdev=39341.82 lat (usec): min=1287, max=234283, avg=36414.16, stdev=39343.89 clat percentiles (usec): | 1.00th=[ 1647], 5.00th=[ 1958], 10.00th=[ 2638], 20.00th=[ 5669], | 30.00th=[ 10159], 40.00th=[ 16057], 50.00th=[ 23462], 60.00th=[ 32113], | 70.00th=[ 44303], 80.00th=[ 60556], 90.00th=[ 86508], 95.00th=[116917], | 99.00th=[196084], 99.50th=[217056], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 62, max= 381, per=24.89%, avg=178.20, stdev=85.68, samples=65 iops : min= 3, max= 23, avg=10.31, stdev= 5.37, samples=65 lat (usec) : 50=0.13%, 100=3.26%, 250=0.13%, 500=0.13% lat (msec) : 2=3.26%, 4=3.91%, 10=7.55%, 20=10.03%, 50=36.20% lat (msec) : 100=28.13%, 250=7.29% cpu : usr=0.06%, sys=5.47%, ctx=1623, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178551: Mon Jun 29 08:01:18 2026 read: IOPS=11, BW=187KiB/s (191kB/s)(6032KiB/32317msec) clat (usec): min=36, max=233928, avg=47561.02, stdev=36061.64 lat (usec): min=37, max=233929, avg=47562.11, stdev=36061.67 clat percentiles (usec): | 1.00th=[ 45], 5.00th=[ 60], 10.00th=[ 72], 20.00th=[ 20841], | 30.00th=[ 27395], 40.00th=[ 33817], 50.00th=[ 42206], 60.00th=[ 50070], | 70.00th=[ 61080], 80.00th=[ 71828], 90.00th=[ 98042], 95.00th=[117965], | 99.00th=[147850], 99.50th=[166724], 99.90th=[233833], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 63, max= 474, per=27.19%, avg=184.92, stdev=78.95, samples=63 iops : min= 3, max= 29, avg=10.76, stdev= 5.00, samples=63 write: IOPS=12, BW=194KiB/s (198kB/s)(6256KiB/32317msec); 0 zone resets clat (usec): min=1663, max=199912, avg=36550.37, stdev=38254.95 lat (usec): min=1665, max=199913, avg=36552.32, stdev=38254.98 clat percentiles (usec): | 1.00th=[ 1696], 5.00th=[ 1942], 10.00th=[ 2343], 20.00th=[ 4817], | 30.00th=[ 7832], 40.00th=[ 14746], 50.00th=[ 23462], 60.00th=[ 32375], | 70.00th=[ 48497], 80.00th=[ 67634], 90.00th=[ 88605], 95.00th=[116917], | 99.00th=[168821], 99.50th=[185598], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 63, max= 383, per=27.05%, avg=193.65, stdev=84.36, samples=63 iops : min= 3, max= 23, avg=11.29, stdev= 5.29, samples=63 lat (usec) : 50=1.04%, 100=5.08%, 250=0.52%, 500=0.13%, 750=0.13% lat (usec) : 1000=0.13% lat (msec) : 2=4.04%, 4=4.56%, 10=8.85%, 20=7.81%, 50=33.85% lat (msec) : 100=25.52%, 250=8.33% cpu : usr=0.05%, sys=5.42%, ctx=1550, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=681KiB/s (697kB/s), 163KiB/s-187KiB/s (167kB/s-191kB/s), io=23.4MiB (24.5MB), run=32317-35172msec WRITE: bw=716KiB/s (734kB/s), 178KiB/s-194KiB/s (182kB/s-198kB/s), io=24.6MiB (25.8MB), run=32317-35172msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178552: Mon Jun 29 08:01:40 2026 read: IOPS=6, BW=105KiB/s (107kB/s)(5920KiB/56645msec) clat (msec): min=8, max=1261, avg=57.67, stdev=75.72 lat (msec): min=8, max=1261, avg=57.68, stdev=75.72 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 19], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 35], 50.00th=[ 42], 60.00th=[ 47], | 70.00th=[ 61], 80.00th=[ 77], 90.00th=[ 113], 95.00th=[ 142], | 99.00th=[ 245], 99.50th=[ 292], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 29, max= 412, per=25.27%, avg=106.65, stdev=61.82, samples=107 iops : min= 1, max= 25, avg= 5.88, stdev= 3.89, samples=107 write: IOPS=7, BW=112KiB/s (115kB/s)(6368KiB/56645msec); 0 zone resets clat (msec): min=13, max=588, avg=87.71, stdev=62.17 lat (msec): min=13, max=588, avg=87.71, stdev=62.17 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 32], 10.00th=[ 37], 20.00th=[ 47], | 30.00th=[ 56], 40.00th=[ 64], 50.00th=[ 73], 60.00th=[ 84], | 70.00th=[ 97], 80.00th=[ 115], 90.00th=[ 148], 95.00th=[ 178], | 99.00th=[ 372], 99.50th=[ 535], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 30, max= 306, per=26.21%, avg=116.38, stdev=55.85, samples=106 iops : min= 1, max= 19, avg= 6.49, stdev= 3.61, samples=106 lat (msec) : 10=0.52%, 20=5.86%, 50=36.07%, 100=36.59%, 250=19.66% lat (msec) : 500=0.91%, 750=0.26%, 2000=0.13% cpu : usr=0.06%, sys=1.99%, ctx=1229, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178553: Mon Jun 29 08:01:40 2026 read: IOPS=6, BW=101KiB/s (104kB/s)(5744KiB/56610msec) clat (msec): min=8, max=424, avg=57.03, stdev=45.82 lat (msec): min=8, max=424, avg=57.03, stdev=45.82 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 18], 10.00th=[ 22], 20.00th=[ 27], | 30.00th=[ 33], 40.00th=[ 37], 50.00th=[ 45], 60.00th=[ 52], | 70.00th=[ 62], 80.00th=[ 78], 90.00th=[ 108], 95.00th=[ 150], | 99.00th=[ 247], 99.50th=[ 268], 99.90th=[ 426], 99.95th=[ 426], | 99.99th=[ 426] bw ( KiB/s): min= 16, max= 283, per=25.12%, avg=106.01, stdev=60.67, samples=105 iops : min= 1, max= 17, avg= 5.85, stdev= 3.84, samples=105 write: IOPS=7, BW=116KiB/s (118kB/s)(6544KiB/56610msec); 0 zone resets clat (msec): min=15, max=897, avg=87.78, stdev=76.46 lat (msec): min=15, max=897, avg=87.79, stdev=76.46 clat percentiles (msec): | 1.00th=[ 23], 5.00th=[ 31], 10.00th=[ 37], 20.00th=[ 46], | 30.00th=[ 52], 40.00th=[ 61], 50.00th=[ 71], 60.00th=[ 81], | 70.00th=[ 96], 80.00th=[ 112], 90.00th=[ 144], 95.00th=[ 199], | 99.00th=[ 338], 99.50th=[ 514], 99.90th=[ 894], 99.95th=[ 894], | 99.99th=[ 894] bw ( KiB/s): min= 16, max= 286, per=26.46%, avg=117.48, stdev=57.26, samples=108 iops : min= 1, max= 17, avg= 6.57, stdev= 3.64, samples=108 lat (msec) : 10=0.26%, 20=3.52%, 50=38.02%, 100=37.89%, 250=18.75% lat (msec) : 500=1.17%, 750=0.13%, 1000=0.26% cpu : usr=0.04%, sys=1.62%, ctx=1179, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178554: Mon Jun 29 08:01:40 2026 read: IOPS=6, BW=111KiB/s (113kB/s)(6256KiB/56456msec) clat (msec): min=8, max=1257, avg=58.50, stdev=75.36 lat (msec): min=8, max=1257, avg=58.50, stdev=75.36 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 15], 10.00th=[ 20], 20.00th=[ 25], | 30.00th=[ 30], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 50], | 70.00th=[ 60], 80.00th=[ 78], 90.00th=[ 109], 95.00th=[ 153], | 99.00th=[ 266], 99.50th=[ 313], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 30, max= 445, per=26.89%, avg=113.49, stdev=68.98, samples=108 iops : min= 1, max= 27, avg= 6.31, stdev= 4.39, samples=108 write: IOPS=6, BW=107KiB/s (109kB/s)(6032KiB/56456msec); 0 zone resets clat (msec): min=19, max=663, avg=88.78, stdev=62.21 lat (msec): min=19, max=663, avg=88.79, stdev=62.22 clat percentiles (msec): | 1.00th=[ 27], 5.00th=[ 34], 10.00th=[ 39], 20.00th=[ 49], | 30.00th=[ 57], 40.00th=[ 65], 50.00th=[ 72], 60.00th=[ 84], | 70.00th=[ 100], 80.00th=[ 121], 90.00th=[ 150], 95.00th=[ 174], | 99.00th=[ 326], 99.50th=[ 584], 99.90th=[ 667], 99.95th=[ 667], | 99.99th=[ 667] bw ( KiB/s): min= 30, max= 245, per=24.75%, avg=109.89, stdev=48.69, samples=107 iops : min= 1, max= 15, avg= 6.08, stdev= 3.11, samples=107 lat (msec) : 10=0.52%, 20=5.08%, 50=35.81%, 100=38.28%, 250=18.75% lat (msec) : 500=1.17%, 750=0.26%, 2000=0.13% cpu : usr=0.05%, sys=1.63%, ctx=1131, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178555: Mon Jun 29 08:01:40 2026 read: IOPS=6, BW=107KiB/s (110kB/s)(6032KiB/56199msec) clat (msec): min=8, max=575, avg=55.01, stdev=48.99 lat (msec): min=8, max=575, avg=55.02, stdev=48.99 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 18], 10.00th=[ 21], 20.00th=[ 28], | 30.00th=[ 31], 40.00th=[ 36], 50.00th=[ 42], 60.00th=[ 49], | 70.00th=[ 57], 80.00th=[ 74], 90.00th=[ 109], 95.00th=[ 134], | 99.00th=[ 224], 99.50th=[ 342], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 30, max= 304, per=26.85%, avg=113.32, stdev=59.05, samples=104 iops : min= 1, max= 19, avg= 6.31, stdev= 3.75, samples=104 write: IOPS=6, BW=111KiB/s (114kB/s)(6256KiB/56199msec); 0 zone resets clat (msec): min=17, max=1258, avg=89.96, stdev=77.51 lat (msec): min=17, max=1258, avg=89.96, stdev=77.51 clat percentiles (msec): | 1.00th=[ 24], 5.00th=[ 33], 10.00th=[ 39], 20.00th=[ 51], | 30.00th=[ 58], 40.00th=[ 66], 50.00th=[ 74], 60.00th=[ 86], | 70.00th=[ 101], 80.00th=[ 117], 90.00th=[ 153], 95.00th=[ 178], | 99.00th=[ 309], 99.50th=[ 443], 99.90th=[ 1267], 99.95th=[ 1267], | 99.99th=[ 1267] bw ( KiB/s): min= 29, max= 254, per=26.05%, avg=115.68, stdev=50.15, samples=106 iops : min= 1, max= 15, avg= 6.45, stdev= 3.23, samples=106 lat (msec) : 10=0.52%, 20=4.56%, 50=35.55%, 100=38.02%, 250=20.31% lat (msec) : 500=0.78%, 750=0.13%, 2000=0.13% cpu : usr=0.06%, sys=1.69%, ctx=1203, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=423KiB/s (433kB/s), 101KiB/s-111KiB/s (104kB/s-113kB/s), io=23.4MiB (24.5MB), run=56199-56645msec WRITE: bw=445KiB/s (456kB/s), 107KiB/s-116KiB/s (109kB/s-118kB/s), io=24.6MiB (25.8MB), run=56199-56645msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178586: Mon Jun 29 08:02:02 2026 read: IOPS=1, BW=1594KiB/s (1633kB/s)(7168KiB/4496msec) clat (usec): min=580, max=345990, avg=245221.64, stdev=121319.85 lat (usec): min=581, max=345992, avg=245223.22, stdev=121319.82 clat percentiles (usec): | 1.00th=[ 578], 5.00th=[ 578], 10.00th=[ 578], 20.00th=[189793], | 30.00th=[246416], 40.00th=[246416], 50.00th=[270533], 60.00th=[329253], | 70.00th=[329253], 80.00th=[333448], 90.00th=[346031], 95.00th=[346031], | 99.00th=[346031], 99.50th=[346031], 99.90th=[346031], 99.95th=[346031], | 99.99th=[346031] bw ( KiB/s): min= 1787, max= 4071, per=82.09%, avg=2942.25, stdev=1217.96, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 write: IOPS=1, BW=1139KiB/s (1166kB/s)(5120KiB/4496msec); 0 zone resets clat (msec): min=274, max=761, avg=504.45, stdev=238.33 lat (msec): min=274, max=761, avg=504.53, stdev=238.31 clat percentiles (msec): | 1.00th=[ 275], 5.00th=[ 275], 10.00th=[ 275], 20.00th=[ 275], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 409], 60.00th=[ 409], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1976, max= 2031, per=40.11%, avg=2012.25, stdev=24.68, samples=4 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=4 lat (usec) : 750=8.33% lat (msec) : 250=16.67%, 500=58.33%, 1000=16.67% cpu : usr=0.02%, sys=9.54%, ctx=206, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178587: Mon Jun 29 08:02:02 2026 read: IOPS=0, BW=406KiB/s (416kB/s)(2048KiB/5046msec) clat (msec): min=5, max=228, avg=116.90, stdev=157.51 lat (msec): min=5, max=228, avg=116.91, stdev=157.51 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 6], 10.00th=[ 6], 20.00th=[ 6], | 30.00th=[ 6], 40.00th=[ 6], 50.00th=[ 6], 60.00th=[ 228], | 70.00th=[ 228], 80.00th=[ 228], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 1777, max= 2031, per=53.12%, avg=1904.00, stdev=179.61, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=2029KiB/s (2078kB/s)(10.0MiB/5046msec); 0 zone resets clat (msec): min=124, max=1392, avg=472.99, stdev=396.85 lat (msec): min=124, max=1392, avg=473.73, stdev=396.40 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 157], | 30.00th=[ 213], 40.00th=[ 228], 50.00th=[ 279], 60.00th=[ 296], | 70.00th=[ 558], 80.00th=[ 718], 90.00th=[ 768], 95.00th=[ 1385], | 99.00th=[ 1385], 99.50th=[ 1385], 99.90th=[ 1385], 99.95th=[ 1385], | 99.99th=[ 1385] bw ( KiB/s): min= 1976, max= 6071, per=63.19%, avg=3170.00, stdev=1785.25, samples=5 iops : min= 1, max= 5, avg= 2.20, stdev= 1.79, samples=5 lat (msec) : 10=8.33%, 250=41.67%, 500=16.67%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.00%, sys=10.13%, ctx=149, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178588: Mon Jun 29 08:02:02 2026 read: IOPS=1, BW=1114KiB/s (1141kB/s)(6144KiB/5516msec) clat (usec): min=507, max=644127, avg=233959.38, stdev=251409.72 lat (usec): min=508, max=644128, avg=233960.27, stdev=251409.59 clat percentiles (usec): | 1.00th=[ 506], 5.00th=[ 506], 10.00th=[ 506], 20.00th=[ 519], | 30.00th=[ 519], 40.00th=[ 99091], 50.00th=[ 99091], 60.00th=[299893], | 70.00th=[362808], 80.00th=[362808], 90.00th=[641729], 95.00th=[641729], | 99.00th=[641729], 99.50th=[641729], 99.90th=[641729], 99.95th=[641729], | 99.99th=[641729] bw ( KiB/s): min= 1868, max= 2031, per=55.19%, avg=1978.00, stdev=65.03, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1114KiB/s (1141kB/s)(6144KiB/5516msec); 0 zone resets clat (msec): min=208, max=1576, avg=631.39, stdev=514.06 lat (msec): min=208, max=1576, avg=631.47, stdev=514.08 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 300], | 30.00th=[ 300], 40.00th=[ 313], 50.00th=[ 313], 60.00th=[ 575], | 70.00th=[ 818], 80.00th=[ 818], 90.00th=[ 1569], 95.00th=[ 1569], | 99.00th=[ 1569], 99.50th=[ 1569], 99.90th=[ 1569], 99.95th=[ 1569], | 99.99th=[ 1569] bw ( KiB/s): min= 1868, max= 2035, per=38.96%, avg=1954.60, stdev=78.91, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=8.33%, 500=33.33%, 750=16.67%, 1000=8.33% lat (msec) : 2000=8.33% cpu : usr=0.02%, sys=7.91%, ctx=99, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178589: Mon Jun 29 08:02:02 2026 read: IOPS=0, BW=896KiB/s (918kB/s)(5120KiB/5714msec) clat (usec): min=749, max=307932, avg=167013.84, stdev=152712.60 lat (usec): min=751, max=307934, avg=167015.09, stdev=152712.65 clat percentiles (usec): | 1.00th=[ 750], 5.00th=[ 750], 10.00th=[ 750], 20.00th=[ 750], | 30.00th=[ 1483], 40.00th=[ 1483], 50.00th=[252707], 60.00th=[252707], | 70.00th=[270533], 80.00th=[270533], 90.00th=[308282], 95.00th=[308282], | 99.00th=[308282], 99.50th=[308282], 99.90th=[308282], 99.95th=[308282], | 99.99th=[308282] bw ( KiB/s): min= 7474, max= 7474, per=100.00%, avg=7474.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1254KiB/s (1285kB/s)(7168KiB/5714msec); 0 zone resets clat (msec): min=266, max=1755, avg=640.00, stdev=523.19 lat (msec): min=266, max=1755, avg=640.08, stdev=523.20 clat percentiles (msec): | 1.00th=[ 266], 5.00th=[ 266], 10.00th=[ 266], 20.00th=[ 317], | 30.00th=[ 397], 40.00th=[ 397], 50.00th=[ 439], 60.00th=[ 498], | 70.00th=[ 498], 80.00th=[ 818], 90.00th=[ 1754], 95.00th=[ 1754], | 99.00th=[ 1754], 99.50th=[ 1754], 99.90th=[ 1754], 99.95th=[ 1754], | 99.99th=[ 1754] bw ( KiB/s): min= 1976, max= 2035, per=40.03%, avg=2008.17, stdev=22.36, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (usec) : 750=8.33% lat (msec) : 2=8.33%, 500=66.67%, 1000=8.33%, 2000=8.33% cpu : usr=0.02%, sys=7.07%, ctx=124, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3584KiB/s (3670kB/s), 406KiB/s-1594KiB/s (416kB/s-1633kB/s), io=20.0MiB (20.0MB), run=4496-5714msec WRITE: bw=5018KiB/s (5138kB/s), 1114KiB/s-2029KiB/s (1141kB/s-2078kB/s), io=28.0MiB (29.4MB), run=4496-5714msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178582: Mon Jun 29 08:02:03 2026 read: IOPS=1, BW=1579KiB/s (1617kB/s)(7168KiB/4539msec) clat (msec): min=118, max=500, avg=249.87, stdev=141.52 lat (msec): min=118, max=500, avg=249.88, stdev=141.52 clat percentiles (msec): | 1.00th=[ 120], 5.00th=[ 120], 10.00th=[ 120], 20.00th=[ 122], | 30.00th=[ 127], 40.00th=[ 127], 50.00th=[ 271], 60.00th=[ 279], | 70.00th=[ 279], 80.00th=[ 334], 90.00th=[ 502], 95.00th=[ 502], | 99.00th=[ 502], 99.50th=[ 502], 99.90th=[ 502], 99.95th=[ 502], | 99.99th=[ 502] bw ( KiB/s): min= 1976, max= 3953, per=84.73%, avg=2684.25, stdev=925.75, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1128KiB/s (1155kB/s)(5120KiB/4539msec); 0 zone resets clat (msec): min=205, max=1044, avg=515.07, stdev=322.73 lat (msec): min=206, max=1044, avg=515.26, stdev=322.74 clat percentiles (msec): | 1.00th=[ 207], 5.00th=[ 207], 10.00th=[ 207], 20.00th=[ 207], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 443], 60.00th=[ 443], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1935, max= 2015, per=44.76%, avg=1985.00, stdev=31.68, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=33.33%, 500=41.67%, 750=16.67%, 2000=8.33% cpu : usr=0.00%, sys=3.15%, ctx=68, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178583: Mon Jun 29 08:02:03 2026 read: IOPS=0, BW=321KiB/s (329kB/s)(2048KiB/6382msec) clat (msec): min=239, max=341, avg=290.09, stdev=72.09 lat (msec): min=239, max=341, avg=290.09, stdev=72.09 clat percentiles (msec): | 1.00th=[ 241], 5.00th=[ 241], 10.00th=[ 241], 20.00th=[ 241], | 30.00th=[ 241], 40.00th=[ 241], 50.00th=[ 241], 60.00th=[ 342], | 70.00th=[ 342], 80.00th=[ 342], 90.00th=[ 342], 95.00th=[ 342], | 99.00th=[ 342], 99.50th=[ 342], 99.90th=[ 342], 99.95th=[ 342], | 99.99th=[ 342] bw ( KiB/s): min= 1389, max= 1935, per=52.46%, avg=1662.00, stdev=386.08, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1605KiB/s (1643kB/s)(10.0MiB/6382msec); 0 zone resets clat (msec): min=117, max=1335, avg=551.45, stdev=415.87 lat (msec): min=117, max=1335, avg=551.53, stdev=415.85 clat percentiles (msec): | 1.00th=[ 118], 5.00th=[ 118], 10.00th=[ 118], 20.00th=[ 132], | 30.00th=[ 268], 40.00th=[ 275], 50.00th=[ 447], 60.00th=[ 527], | 70.00th=[ 542], 80.00th=[ 701], 90.00th=[ 1167], 95.00th=[ 1334], | 99.00th=[ 1334], 99.50th=[ 1334], 99.90th=[ 1334], 99.95th=[ 1334], | 99.99th=[ 1334] bw ( KiB/s): min= 1976, max= 4071, per=58.24%, avg=2582.86, stdev=997.80, samples=7 iops : min= 1, max= 3, avg= 1.57, stdev= 0.98, samples=7 lat (msec) : 250=25.00%, 500=33.33%, 750=25.00%, 2000=16.67% cpu : usr=0.05%, sys=3.71%, ctx=93, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178584: Mon Jun 29 08:02:03 2026 read: IOPS=1, BW=1166KiB/s (1194kB/s)(6144KiB/5271msec) clat (msec): min=173, max=411, avg=288.42, stdev=86.21 lat (msec): min=173, max=411, avg=288.42, stdev=86.21 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 279], 50.00th=[ 279], 60.00th=[ 321], | 70.00th=[ 334], 80.00th=[ 334], 90.00th=[ 414], 95.00th=[ 414], | 99.00th=[ 414], 99.50th=[ 414], 99.90th=[ 414], 99.95th=[ 414], | 99.99th=[ 414] bw ( KiB/s): min= 1965, max= 3984, per=78.81%, avg=2496.75, stdev=991.85, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1166KiB/s (1194kB/s)(6144KiB/5271msec); 0 zone resets clat (msec): min=133, max=1116, avg=582.82, stdev=393.82 lat (msec): min=133, max=1116, avg=582.92, stdev=393.83 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 215], | 30.00th=[ 215], 40.00th=[ 393], 50.00th=[ 393], 60.00th=[ 776], | 70.00th=[ 869], 80.00th=[ 869], 90.00th=[ 1116], 95.00th=[ 1116], | 99.00th=[ 1116], 99.50th=[ 1116], 99.90th=[ 1116], 99.95th=[ 1116], | 99.99th=[ 1116] bw ( KiB/s): min= 1980, max= 2031, per=45.20%, avg=2004.83, stdev=19.99, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 250=33.33%, 500=41.67%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=1.80%, ctx=54, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178585: Mon Jun 29 08:02:03 2026 read: IOPS=0, BW=792KiB/s (811kB/s)(5120KiB/6464msec) clat (msec): min=117, max=747, avg=405.45, stdev=289.75 lat (msec): min=117, max=747, avg=405.45, stdev=289.75 clat percentiles (msec): | 1.00th=[ 117], 5.00th=[ 117], 10.00th=[ 117], 20.00th=[ 117], | 30.00th=[ 120], 40.00th=[ 120], 50.00th=[ 405], 60.00th=[ 405], | 70.00th=[ 634], 80.00th=[ 634], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 2027, max= 4047, per=85.46%, avg=2707.33, stdev=1160.23, samples=3 iops : min= 1, max= 3, avg= 2.00, stdev= 1.00, samples=3 write: IOPS=1, BW=1109KiB/s (1136kB/s)(7168KiB/6464msec); 0 zone resets clat (msec): min=147, max=1688, avg=619.70, stdev=518.26 lat (msec): min=147, max=1689, avg=619.78, stdev=518.25 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 228], | 30.00th=[ 393], 40.00th=[ 393], 50.00th=[ 472], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 751], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 1414, max= 4071, per=50.63%, avg=2245.33, stdev=924.42, samples=6 iops : min= 1, max= 3, avg= 1.33, stdev= 0.82, samples=6 lat (msec) : 250=33.33%, 500=25.00%, 750=33.33%, 2000=8.33% cpu : usr=0.00%, sys=3.34%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3168KiB/s (3244kB/s), 321KiB/s-1579KiB/s (329kB/s-1617kB/s), io=20.0MiB (20.0MB), run=4539-6464msec WRITE: bw=4436KiB/s (4542kB/s), 1109KiB/s-1605KiB/s (1136kB/s-1643kB/s), io=28.0MiB (29.4MB), run=4539-6464msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=178596: Mon Jun 29 08:02:15 2026 read: IOPS=1, BW=4587KiB/s (4697kB/s)(12.0MiB/2679msec) clat (msec): min=293, max=1199, avg=853.80, stdev=489.86 lat (msec): min=293, max=1199, avg=853.80, stdev=489.86 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 1070], 50.00th=[ 1070], 60.00th=[ 1070], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.62%, ctx=51, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178599: Mon Jun 29 08:02:15 2026 read: IOPS=0, BW=1346KiB/s (1378kB/s)(4096KiB/3044msec) clat (nsec): min=749223k, max=749223k, avg=749223232.00, stdev= 0.00 lat (nsec): min=749227k, max=749227k, avg=749227125.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 751], 5.00th=[ 751], 10.00th=[ 751], 20.00th=[ 751], | 30.00th=[ 751], 40.00th=[ 751], 50.00th=[ 751], 60.00th=[ 751], | 70.00th=[ 751], 80.00th=[ 751], 90.00th=[ 751], 95.00th=[ 751], | 99.00th=[ 751], 99.50th=[ 751], 99.90th=[ 751], 99.95th=[ 751], | 99.99th=[ 751] bw ( KiB/s): min= 8110, max= 8110, per=100.00%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2691KiB/s (2756kB/s)(8192KiB/3044msec); 0 zone resets clat (msec): min=1022, max=1195, avg=1109.13, stdev=122.25 lat (msec): min=1023, max=1195, avg=1109.55, stdev=122.01 clat percentiles (msec): | 1.00th=[ 1020], 5.00th=[ 1020], 10.00th=[ 1020], 20.00th=[ 1020], | 30.00th=[ 1020], 40.00th=[ 1020], 50.00th=[ 1020], 60.00th=[ 1200], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8175, max= 8175, per=85.13%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=2.73%, ctx=37, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178600: Mon Jun 29 08:02:15 2026 write: IOPS=0, BW=3601KiB/s (3688kB/s)(12.0MiB/3412msec); 0 zone resets clat (msec): min=201, max=1704, avg=1098.46, stdev=792.27 lat (msec): min=202, max=1705, avg=1099.21, stdev=792.53 clat percentiles (msec): | 1.00th=[ 203], 5.00th=[ 203], 10.00th=[ 203], 20.00th=[ 203], | 30.00th=[ 203], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1385], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8143, max= 8175, per=84.96%, avg=8159.00, stdev=22.63, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 250=33.33%, 2000=66.67% cpu : usr=0.00%, sys=3.11%, ctx=43, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178602: Mon Jun 29 08:02:15 2026 write: IOPS=1, BW=4420KiB/s (4526kB/s)(12.0MiB/2780msec); 0 zone resets clat (msec): min=481, max=1678, avg=908.59, stdev=667.74 lat (msec): min=482, max=1678, avg=909.13, stdev=667.56 clat percentiles (msec): | 1.00th=[ 481], 5.00th=[ 481], 10.00th=[ 481], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 567], 50.00th=[ 567], 60.00th=[ 567], | 70.00th=[ 1687], 80.00th=[ 1687], 90.00th=[ 1687], 95.00th=[ 1687], | 99.00th=[ 1687], 99.50th=[ 1687], 99.90th=[ 1687], 99.95th=[ 1687], | 99.99th=[ 1687] bw ( KiB/s): min= 8000, max= 8159, per=84.14%, avg=8079.50, stdev=112.43, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.71%, ctx=70, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5382KiB/s (5512kB/s), 1346KiB/s-4587KiB/s (1378kB/s-4697kB/s), io=16.0MiB (16.8MB), run=2679-3044msec WRITE: bw=9604KiB/s (9834kB/s), 2691KiB/s-4420KiB/s (2756kB/s-4526kB/s), io=32.0MiB (33.6MB), run=2780-3412msec rand-rw: (groupid=0, jobs=1): err= 0: pid=178597: Mon Jun 29 08:02:15 2026 read: IOPS=1, BW=5373KiB/s (5502kB/s)(12.0MiB/2287msec) clat (msec): min=607, max=914, avg=740.32, stdev=157.72 lat (msec): min=607, max=914, avg=740.33, stdev=157.72 clat percentiles (msec): | 1.00th=[ 609], 5.00th=[ 609], 10.00th=[ 609], 20.00th=[ 609], | 30.00th=[ 609], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 919], 80.00th=[ 919], 90.00th=[ 919], 95.00th=[ 919], | 99.00th=[ 919], 99.50th=[ 919], 99.90th=[ 919], 99.95th=[ 919], | 99.99th=[ 919] bw ( KiB/s): min= 5962, max= 8175, per=100.00%, avg=7068.50, stdev=1564.83, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=14.52%, ctx=214, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178598: Mon Jun 29 08:02:15 2026 read: IOPS=0, BW=1424KiB/s (1458kB/s)(4096KiB/2876msec) clat (nsec): min=694268k, max=694268k, avg=694267950.00, stdev= 0.00 lat (nsec): min=694270k, max=694270k, avg=694270033.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 693], 5.00th=[ 693], 10.00th=[ 693], 20.00th=[ 693], | 30.00th=[ 693], 40.00th=[ 693], 50.00th=[ 693], 60.00th=[ 693], | 70.00th=[ 693], 80.00th=[ 693], 90.00th=[ 693], 95.00th=[ 693], | 99.00th=[ 693], 99.50th=[ 693], 99.90th=[ 693], 99.95th=[ 693], | 99.99th=[ 693] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2848KiB/s (2917kB/s)(8192KiB/2876msec); 0 zone resets clat (msec): min=707, max=1233, avg=970.66, stdev=371.51 lat (msec): min=709, max=1233, avg=971.55, stdev=370.80 clat percentiles (msec): | 1.00th=[ 709], 5.00th=[ 709], 10.00th=[ 709], 20.00th=[ 709], | 30.00th=[ 709], 40.00th=[ 709], 50.00th=[ 709], 60.00th=[ 1234], | 70.00th=[ 1234], 80.00th=[ 1234], 90.00th=[ 1234], 95.00th=[ 1234], | 99.00th=[ 1234], 99.50th=[ 1234], 99.90th=[ 1234], 99.95th=[ 1234], | 99.99th=[ 1234] bw ( KiB/s): min= 8175, max= 8175, per=88.32%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=5.11%, ctx=114, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178601: Mon Jun 29 08:02:15 2026 write: IOPS=0, BW=3471KiB/s (3554kB/s)(12.0MiB/3540msec); 0 zone resets clat (msec): min=121, max=2382, avg=1136.83, stdev=1147.64 lat (msec): min=122, max=2382, avg=1138.08, stdev=1147.12 clat percentiles (msec): | 1.00th=[ 123], 5.00th=[ 123], 10.00th=[ 123], 20.00th=[ 123], | 30.00th=[ 123], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8192, max= 8192, per=88.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=3.33%, ctx=48, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=178603: Mon Jun 29 08:02:15 2026 write: IOPS=1, BW=4122KiB/s (4221kB/s)(12.0MiB/2981msec); 0 zone resets clat (msec): min=296, max=1721, avg=977.28, stdev=714.53 lat (msec): min=300, max=1722, avg=978.85, stdev=713.20 clat percentiles (msec): | 1.00th=[ 296], 5.00th=[ 296], 10.00th=[ 296], 20.00th=[ 296], | 30.00th=[ 296], 40.00th=[ 911], 50.00th=[ 911], 60.00th=[ 911], | 70.00th=[ 1720], 80.00th=[ 1720], 90.00th=[ 1720], 95.00th=[ 1720], | 99.00th=[ 1720], 99.50th=[ 1720], 99.90th=[ 1720], 99.95th=[ 1720], | 99.99th=[ 1720] bw ( KiB/s): min= 8192, max= 8192, per=88.50%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.53%, ctx=80, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5697KiB/s (5834kB/s), 1424KiB/s-5373KiB/s (1458kB/s-5502kB/s), io=16.0MiB (16.8MB), run=2287-2876msec WRITE: bw=9256KiB/s (9479kB/s), 2848KiB/s-4122KiB/s (2917kB/s-4221kB/s), io=32.0MiB (33.6MB), run=2876-3540msec