== sanity test 398b: DIO and buffer IO race ============== 03:49:23 (1782632963) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.84318 s, 17.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193224: Sun Jun 28 03:50:49 2026 read: IOPS=19, BW=77.7KiB/s (79.6kB/s)(5992KiB/77101msec) clat (usec): min=90, max=1409.3k, avg=28284.04, stdev=37982.28 lat (usec): min=90, max=1409.3k, avg=28284.61, stdev=37982.29 clat percentiles (usec): | 1.00th=[ 184], 5.00th=[ 11338], 10.00th=[ 13829], | 20.00th=[ 17433], 30.00th=[ 19792], 40.00th=[ 22676], | 50.00th=[ 25035], 60.00th=[ 28443], 70.00th=[ 32113], | 80.00th=[ 36439], 90.00th=[ 43254], 95.00th=[ 50070], | 99.00th=[ 68682], 99.50th=[ 74974], 99.90th=[ 123208], | 99.95th=[1417675], 99.99th=[1417675] bw ( KiB/s): min= 7, max= 184, per=25.05%, avg=77.91, stdev=25.27, samples=152 iops : min= 1, max= 46, avg=18.94, stdev= 6.32, samples=152 write: IOPS=20, BW=81.7KiB/s (83.6kB/s)(6296KiB/77101msec); 0 zone resets clat (usec): min=791, max=86758, avg=21919.53, stdev=14016.68 lat (usec): min=791, max=86759, avg=21920.27, stdev=14016.67 clat percentiles (usec): | 1.00th=[ 2343], 5.00th=[ 4555], 10.00th=[ 5932], 20.00th=[ 8848], | 30.00th=[12911], 40.00th=[16188], 50.00th=[19268], 60.00th=[23200], | 70.00th=[27395], 80.00th=[33424], 90.00th=[40633], 95.00th=[48497], | 99.00th=[62653], 99.50th=[69731], 99.90th=[85459], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 23, max= 198, per=25.43%, avg=82.91, stdev=26.88, samples=150 iops : min= 5, max= 49, avg=20.19, stdev= 6.76, samples=150 lat (usec) : 100=0.07%, 250=0.75%, 500=0.10%, 1000=0.23% lat (msec) : 2=0.10%, 4=1.69%, 10=10.64%, 20=28.06%, 50=53.81% lat (msec) : 100=4.46%, 250=0.07%, 2000=0.03% cpu : usr=0.05%, sys=26.97%, ctx=11731, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193225: Sun Jun 28 03:50:49 2026 read: IOPS=19, BW=77.0KiB/s (78.9kB/s)(5940KiB/77094msec) clat (usec): min=61, max=92035, avg=27188.90, stdev=12275.33 lat (usec): min=61, max=92035, avg=27189.69, stdev=12275.12 clat percentiles (usec): | 1.00th=[ 192], 5.00th=[11469], 10.00th=[13960], 20.00th=[17433], | 30.00th=[19792], 40.00th=[22676], 50.00th=[25560], 60.00th=[28443], | 70.00th=[31851], 80.00th=[35914], 90.00th=[42730], 95.00th=[49546], | 99.00th=[64750], 99.50th=[72877], 99.90th=[91751], 99.95th=[91751], | 99.99th=[91751] bw ( KiB/s): min= 6, max= 167, per=24.99%, avg=77.71, stdev=23.25, samples=151 iops : min= 1, max= 41, avg=18.89, stdev= 5.84, samples=151 write: IOPS=20, BW=82.3KiB/s (84.3kB/s)(6348KiB/77094msec); 0 zone resets clat (usec): min=823, max=1456.5k, avg=22993.20, stdev=38732.31 lat (usec): min=824, max=1456.5k, avg=22993.88, stdev=38732.30 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 43], 95.00th=[ 50], | 99.00th=[ 66], 99.50th=[ 72], 99.90th=[ 111], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 6, max= 160, per=25.41%, avg=82.83, stdev=26.52, samples=151 iops : min= 1, max= 40, avg=20.17, stdev= 6.64, samples=151 lat (usec) : 100=0.03%, 250=0.59%, 500=0.13%, 1000=0.07% lat (msec) : 2=0.33%, 4=1.46%, 10=10.77%, 20=28.39%, 50=53.39% lat (msec) : 100=4.79%, 250=0.03%, 2000=0.03% cpu : usr=0.05%, sys=27.06%, ctx=11572, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193226: Sun Jun 28 03:50:49 2026 read: IOPS=19, BW=78.7KiB/s (80.6kB/s)(6028KiB/76614msec) clat (usec): min=94, max=116345, avg=27010.63, stdev=13141.48 lat (usec): min=94, max=116346, avg=27011.24, stdev=13141.49 clat percentiles (usec): | 1.00th=[ 169], 5.00th=[ 10945], 10.00th=[ 13173], 20.00th=[ 16712], | 30.00th=[ 19530], 40.00th=[ 22152], 50.00th=[ 24773], 60.00th=[ 27919], | 70.00th=[ 31589], 80.00th=[ 35914], 90.00th=[ 43254], 95.00th=[ 50594], | 99.00th=[ 68682], 99.50th=[ 77071], 99.90th=[101188], 99.95th=[115868], | 99.99th=[115868] bw ( KiB/s): min= 31, max= 160, per=25.72%, avg=80.00, stdev=23.08, samples=149 iops : min= 7, max= 40, avg=19.46, stdev= 5.84, samples=149 write: IOPS=20, BW=81.7KiB/s (83.7kB/s)(6260KiB/76614msec); 0 zone resets clat (usec): min=756, max=1458.7k, avg=22808.20, stdev=38983.35 lat (usec): min=757, max=1458.7k, avg=22808.93, stdev=38983.40 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 6], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 23], | 70.00th=[ 28], 80.00th=[ 34], 90.00th=[ 42], 95.00th=[ 50], | 99.00th=[ 66], 99.50th=[ 71], 99.90th=[ 80], 99.95th=[ 1452], | 99.99th=[ 1452] bw ( KiB/s): min= 24, max= 191, per=25.46%, avg=83.01, stdev=27.87, samples=149 iops : min= 6, max= 47, avg=20.21, stdev= 6.96, samples=149 lat (usec) : 100=0.03%, 250=0.85%, 500=0.10%, 1000=0.16% lat (msec) : 2=0.29%, 4=1.56%, 10=11.23%, 20=27.99%, 50=52.99% lat (msec) : 100=4.69%, 250=0.07%, 2000=0.03% cpu : usr=0.06%, sys=26.71%, ctx=11582, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193227: Sun Jun 28 03:50:49 2026 read: IOPS=19, BW=78.5KiB/s (80.4kB/s)(6052KiB/77079msec) clat (usec): min=50, max=102896, avg=27352.25, stdev=12267.26 lat (usec): min=50, max=102897, avg=27352.83, stdev=12267.28 clat percentiles (usec): | 1.00th=[ 233], 5.00th=[ 11731], 10.00th=[ 14222], 20.00th=[ 17433], | 30.00th=[ 20317], 40.00th=[ 22938], 50.00th=[ 25560], 60.00th=[ 28443], | 70.00th=[ 31851], 80.00th=[ 35914], 90.00th=[ 43254], 95.00th=[ 49546], | 99.00th=[ 68682], 99.50th=[ 73925], 99.90th=[ 85459], 99.95th=[103285], | 99.99th=[103285] bw ( KiB/s): min= 31, max= 144, per=25.65%, avg=79.79, stdev=22.09, samples=150 iops : min= 7, max= 36, avg=19.41, stdev= 5.54, samples=150 write: IOPS=20, BW=80.9KiB/s (82.8kB/s)(6236KiB/77079msec); 0 zone resets clat (usec): min=921, max=1479.6k, avg=22767.88, stdev=39398.46 lat (usec): min=922, max=1479.6k, avg=22768.62, stdev=39398.46 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 6], 10.00th=[ 7], 20.00th=[ 9], | 30.00th=[ 13], 40.00th=[ 17], 50.00th=[ 20], 60.00th=[ 24], | 70.00th=[ 28], 80.00th=[ 33], 90.00th=[ 42], 95.00th=[ 48], | 99.00th=[ 60], 99.50th=[ 71], 99.90th=[ 94], 99.95th=[ 1485], | 99.99th=[ 1485] bw ( KiB/s): min= 31, max= 183, per=25.19%, avg=82.12, stdev=26.33, samples=150 iops : min= 7, max= 45, avg=19.99, stdev= 6.63, samples=150 lat (usec) : 100=0.07%, 250=0.52%, 500=0.07%, 1000=0.03% lat (msec) : 2=0.23%, 4=1.30%, 10=11.07%, 20=26.79%, 50=55.50% lat (msec) : 100=4.36%, 250=0.03%, 2000=0.03% cpu : usr=0.04%, sys=27.10%, ctx=11922, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=311KiB/s (319kB/s), 77.0KiB/s-78.7KiB/s (78.9kB/s-80.6kB/s), io=23.4MiB (24.6MB), run=76614-77101msec WRITE: bw=326KiB/s (334kB/s), 80.9KiB/s-82.3KiB/s (82.8kB/s-84.3kB/s), io=24.6MiB (25.7MB), run=76614-77101msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193219: Sun Jun 28 03:50:56 2026 read: IOPS=17, BW=71.5KiB/s (73.2kB/s)(5992KiB/83781msec) clat (msec): min=2, max=1426, avg=25.32, stdev=39.43 lat (msec): min=2, max=1426, avg=25.32, stdev=39.43 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 37], 90.00th=[ 47], 95.00th=[ 56], | 99.00th=[ 75], 99.50th=[ 84], 99.90th=[ 114], 99.95th=[ 1435], | 99.99th=[ 1435] bw ( KiB/s): min= 15, max= 248, per=25.17%, avg=72.00, stdev=42.26, samples=163 iops : min= 3, max= 62, avg=17.52, stdev=10.65, samples=163 write: IOPS=18, BW=75.1KiB/s (76.0kB/s)(6296KiB/83781msec); 0 zone resets clat (msec): min=5, max=120, avg=28.93, stdev=17.74 lat (msec): min=5, max=120, avg=28.93, stdev=17.74 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 54], 95.00th=[ 62], | 99.00th=[ 85], 99.50th=[ 100], 99.90th=[ 114], 99.95th=[ 122], | 99.99th=[ 122] bw ( KiB/s): min= 31, max= 288, per=25.19%, avg=75.33, stdev=44.34, samples=163 iops : min= 7, max= 72, avg=18.36, stdev=11.19, samples=163 lat (msec) : 4=0.07%, 10=15.14%, 20=27.99%, 50=46.68%, 100=9.80% lat (msec) : 250=0.29%, 2000=0.03% cpu : usr=0.05%, sys=16.72%, ctx=8097, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193220: Sun Jun 28 03:50:56 2026 read: IOPS=17, BW=71.2KiB/s (72.9kB/s)(5940KiB/83472msec) clat (msec): min=3, max=1463, avg=25.57, stdev=40.83 lat (msec): min=3, max=1463, avg=25.57, stdev=40.83 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 9], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 35], 90.00th=[ 48], 95.00th=[ 58], | 99.00th=[ 82], 99.50th=[ 88], 99.90th=[ 114], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 15, max= 280, per=25.21%, avg=72.09, stdev=43.85, samples=163 iops : min= 3, max= 70, avg=17.55, stdev=11.07, samples=163 write: IOPS=19, BW=76.0KiB/s (77.9kB/s)(6348KiB/83472msec); 0 zone resets clat (msec): min=4, max=127, avg=28.48, stdev=17.19 lat (msec): min=4, max=127, avg=28.48, stdev=17.19 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 13], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 42], 90.00th=[ 52], 95.00th=[ 62], | 99.00th=[ 82], 99.50th=[ 106], 99.90th=[ 125], 99.95th=[ 128], | 99.99th=[ 128] bw ( KiB/s): min= 23, max= 280, per=25.78%, avg=77.09, stdev=45.16, samples=163 iops : min= 5, max= 70, avg=18.80, stdev=11.37, samples=163 lat (msec) : 4=0.07%, 10=15.46%, 20=27.25%, 50=47.88%, 100=8.95% lat (msec) : 250=0.36%, 2000=0.03% cpu : usr=0.05%, sys=16.93%, ctx=8146, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193221: Sun Jun 28 03:50:56 2026 read: IOPS=18, BW=72.3KiB/s (74.0kB/s)(6028KiB/83409msec) clat (msec): min=3, max=131, avg=24.09, stdev=15.60 lat (msec): min=3, max=131, avg=24.09, stdev=15.60 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 11], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 24], | 70.00th=[ 29], 80.00th=[ 36], 90.00th=[ 45], 95.00th=[ 56], | 99.00th=[ 71], 99.50th=[ 83], 99.90th=[ 110], 99.95th=[ 132], | 99.99th=[ 132] bw ( KiB/s): min= 23, max= 264, per=25.48%, avg=72.88, stdev=43.52, samples=162 iops : min= 5, max= 66, avg=17.74, stdev=10.98, samples=162 write: IOPS=18, BW=75.1KiB/s (76.9kB/s)(6260KiB/83409msec); 0 zone resets clat (msec): min=5, max=1498, avg=29.89, stdev=41.02 lat (msec): min=5, max=1498, avg=29.89, stdev=41.02 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 14], | 30.00th=[ 18], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 35], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 62], | 99.00th=[ 81], 99.50th=[ 103], 99.90th=[ 138], 99.95th=[ 1502], | 99.99th=[ 1502] bw ( KiB/s): min= 24, max= 240, per=25.23%, avg=75.44, stdev=42.02, samples=162 iops : min= 6, max= 60, avg=18.38, stdev=10.59, samples=162 lat (msec) : 4=0.16%, 10=14.71%, 20=27.21%, 50=48.34%, 100=9.18% lat (msec) : 250=0.36%, 2000=0.03% cpu : usr=0.06%, sys=16.97%, ctx=8192, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193222: Sun Jun 28 03:50:56 2026 read: IOPS=18, BW=72.2KiB/s (73.9kB/s)(6052KiB/83841msec) clat (msec): min=3, max=111, avg=24.88, stdev=16.59 lat (msec): min=3, max=111, avg=24.88, stdev=16.59 clat percentiles (msec): | 1.00th=[ 5], 5.00th=[ 7], 10.00th=[ 8], 20.00th=[ 10], | 30.00th=[ 15], 40.00th=[ 18], 50.00th=[ 21], 60.00th=[ 25], | 70.00th=[ 30], 80.00th=[ 37], 90.00th=[ 51], 95.00th=[ 58], | 99.00th=[ 75], 99.50th=[ 85], 99.90th=[ 93], 99.95th=[ 112], | 99.99th=[ 112] bw ( KiB/s): min= 16, max= 287, per=25.26%, avg=72.24, stdev=43.74, samples=163 iops : min= 4, max= 71, avg=17.58, stdev=11.01, samples=163 write: IOPS=18, BW=74.4KiB/s (76.2kB/s)(6236KiB/83841msec); 0 zone resets clat (msec): min=4, max=1473, avg=29.44, stdev=40.59 lat (msec): min=4, max=1473, avg=29.44, stdev=40.59 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 10], 20.00th=[ 12], | 30.00th=[ 17], 40.00th=[ 21], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 36], 80.00th=[ 43], 90.00th=[ 53], 95.00th=[ 62], | 99.00th=[ 84], 99.50th=[ 93], 99.90th=[ 125], 99.95th=[ 1469], | 99.99th=[ 1469] bw ( KiB/s): min= 31, max= 279, per=24.92%, avg=74.50, stdev=45.96, samples=163 iops : min= 7, max= 69, avg=18.15, stdev=11.58, samples=163 lat (msec) : 4=0.23%, 10=16.50%, 20=26.73%, 50=45.51%, 100=10.81% lat (msec) : 250=0.20%, 2000=0.03% cpu : usr=0.06%, sys=16.61%, ctx=8114, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=286KiB/s (293kB/s), 71.2KiB/s-72.3KiB/s (72.9kB/s-74.0kB/s), io=23.4MiB (24.6MB), run=83409-83841msec WRITE: bw=300KiB/s (307kB/s), 74.4KiB/s-76.0KiB/s (76.2kB/s-77.9kB/s), io=24.6MiB (25.7MB), run=83409-83841msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193255: Sun Jun 28 03:51:27 2026 read: IOPS=14, BW=235KiB/s (241kB/s)(5920KiB/25200msec) clat (usec): min=133, max=122771, avg=33946.81, stdev=17345.53 lat (usec): min=133, max=122771, avg=33947.56, stdev=17345.53 clat percentiles (usec): | 1.00th=[ 151], 5.00th=[ 260], 10.00th=[ 16319], 20.00th=[ 21627], | 30.00th=[ 25035], 40.00th=[ 28967], 50.00th=[ 32113], 60.00th=[ 35914], | 70.00th=[ 41157], 80.00th=[ 45876], 90.00th=[ 55313], 95.00th=[ 61604], | 99.00th=[ 93848], 99.50th=[108528], 99.90th=[123208], 99.95th=[123208], | 99.99th=[123208] bw ( KiB/s): min= 128, max= 384, per=24.87%, avg=234.74, stdev=72.92, samples=50 iops : min= 8, max= 24, avg=14.10, stdev= 4.56, samples=50 write: IOPS=15, BW=253KiB/s (259kB/s)(6368KiB/25200msec); 0 zone resets clat (usec): min=3423, max=95940, avg=31589.86, stdev=18627.63 lat (usec): min=3425, max=95942, avg=31591.15, stdev=18627.75 clat percentiles (usec): | 1.00th=[ 6849], 5.00th=[ 8586], 10.00th=[10683], 20.00th=[14484], | 30.00th=[19530], 40.00th=[23987], 50.00th=[27657], 60.00th=[32637], | 70.00th=[38536], 80.00th=[45876], 90.00th=[56886], 95.00th=[69731], | 99.00th=[87557], 99.50th=[92799], 99.90th=[95945], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 95, max= 476, per=25.39%, avg=252.38, stdev=66.51, samples=50 iops : min= 5, max= 29, avg=15.20, stdev= 4.24, samples=50 lat (usec) : 250=2.08%, 500=0.78% lat (msec) : 2=0.13%, 4=0.26%, 10=4.17%, 20=17.32%, 50=60.55% lat (msec) : 100=14.45%, 250=0.26% cpu : usr=0.08%, sys=29.44%, ctx=3552, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193256: Sun Jun 28 03:51:27 2026 read: IOPS=14, BW=227KiB/s (232kB/s)(5744KiB/25350msec) clat (usec): min=173, max=97101, avg=35073.27, stdev=15237.51 lat (usec): min=174, max=97101, avg=35074.06, stdev=15237.56 clat percentiles (usec): | 1.00th=[ 204], 5.00th=[14091], 10.00th=[18482], 20.00th=[23462], | 30.00th=[26608], 40.00th=[29492], 50.00th=[32900], 60.00th=[37487], | 70.00th=[42206], 80.00th=[46400], 90.00th=[54264], 95.00th=[63177], | 99.00th=[79168], 99.50th=[90702], 99.90th=[96994], 99.95th=[96994], | 99.99th=[96994] bw ( KiB/s): min= 95, max= 412, per=23.87%, avg=225.32, stdev=70.95, samples=50 iops : min= 5, max= 25, avg=13.50, stdev= 4.60, samples=50 write: IOPS=16, BW=258KiB/s (264kB/s)(6544KiB/25350msec); 0 zone resets clat (msec): min=2, max=100, avg=31.05, stdev=17.76 lat (msec): min=2, max=100, avg=31.08, stdev=17.76 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 28], 60.00th=[ 33], | 70.00th=[ 38], 80.00th=[ 45], 90.00th=[ 57], 95.00th=[ 65], | 99.00th=[ 81], 99.50th=[ 85], 99.90th=[ 101], 99.95th=[ 101], | 99.99th=[ 101] bw ( KiB/s): min= 95, max= 446, per=25.80%, avg=256.46, stdev=86.63, samples=50 iops : min= 5, max= 27, avg=15.46, stdev= 5.35, samples=50 lat (usec) : 250=0.52%, 500=0.91% lat (msec) : 4=0.39%, 10=2.99%, 20=17.19%, 50=63.67%, 100=14.19% lat (msec) : 250=0.13% cpu : usr=0.07%, sys=29.51%, ctx=3553, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193257: Sun Jun 28 03:51:27 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(6256KiB/25267msec) clat (usec): min=173, max=89396, avg=33780.16, stdev=15676.02 lat (usec): min=174, max=89398, avg=33780.99, stdev=15676.05 clat percentiles (usec): | 1.00th=[ 221], 5.00th=[14091], 10.00th=[17695], 20.00th=[22414], | 30.00th=[25035], 40.00th=[29230], 50.00th=[32375], 60.00th=[35390], | 70.00th=[39584], 80.00th=[44303], 90.00th=[54789], 95.00th=[63701], | 99.00th=[86508], 99.50th=[89654], 99.90th=[89654], 99.95th=[89654], | 99.99th=[89654] bw ( KiB/s): min= 126, max= 413, per=26.25%, avg=247.78, stdev=68.56, samples=50 iops : min= 7, max= 25, avg=14.92, stdev= 4.37, samples=50 write: IOPS=14, BW=239KiB/s (244kB/s)(6032KiB/25267msec); 0 zone resets clat (msec): min=5, max=116, avg=31.70, stdev=18.71 lat (msec): min=5, max=116, avg=31.70, stdev=18.71 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 11], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 24], 50.00th=[ 29], 60.00th=[ 34], | 70.00th=[ 40], 80.00th=[ 47], 90.00th=[ 59], 95.00th=[ 66], | 99.00th=[ 93], 99.50th=[ 101], 99.90th=[ 117], 99.95th=[ 117], | 99.99th=[ 117] bw ( KiB/s): min= 95, max= 444, per=23.80%, avg=236.60, stdev=86.47, samples=50 iops : min= 5, max= 27, avg=14.22, stdev= 5.38, samples=50 lat (usec) : 250=0.91%, 500=1.04% lat (msec) : 4=0.13%, 10=3.65%, 20=17.84%, 50=62.11%, 100=14.19% lat (msec) : 250=0.13% cpu : usr=0.06%, sys=29.21%, ctx=3674, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193258: Sun Jun 28 03:51:27 2026 read: IOPS=15, BW=248KiB/s (254kB/s)(6032KiB/24301msec) clat (usec): min=165, max=80354, avg=33343.41, stdev=15283.95 lat (usec): min=166, max=80355, avg=33344.16, stdev=15283.95 clat percentiles (usec): | 1.00th=[ 196], 5.00th=[ 265], 10.00th=[17171], 20.00th=[21890], | 30.00th=[25560], 40.00th=[28705], 50.00th=[33162], 60.00th=[36439], | 70.00th=[40109], 80.00th=[44303], 90.00th=[51643], 95.00th=[60556], | 99.00th=[77071], 99.50th=[79168], 99.90th=[80217], 99.95th=[80217], | 99.99th=[80217] bw ( KiB/s): min= 63, max= 382, per=26.12%, avg=246.58, stdev=68.40, samples=48 iops : min= 3, max= 23, avg=14.85, stdev= 4.39, samples=48 write: IOPS=16, BW=257KiB/s (264kB/s)(6256KiB/24301msec); 0 zone resets clat (usec): min=1326, max=86034, avg=29893.26, stdev=16838.20 lat (usec): min=1327, max=86035, avg=29894.63, stdev=16838.23 clat percentiles (usec): | 1.00th=[ 2507], 5.00th=[ 9110], 10.00th=[10683], 20.00th=[14091], | 30.00th=[18220], 40.00th=[23200], 50.00th=[27132], 60.00th=[31065], | 70.00th=[36439], 80.00th=[43779], 90.00th=[52691], 95.00th=[63177], | 99.00th=[77071], 99.50th=[85459], 99.90th=[86508], 99.95th=[86508], | 99.99th=[86508] bw ( KiB/s): min= 127, max= 384, per=25.93%, avg=257.79, stdev=63.97, samples=48 iops : min= 7, max= 24, avg=15.54, stdev= 4.03, samples=48 lat (usec) : 250=1.95%, 500=0.78%, 750=0.13% lat (msec) : 2=0.39%, 4=0.13%, 10=3.52%, 20=17.58%, 50=62.63% lat (msec) : 100=12.89% cpu : usr=0.05%, sys=30.10%, ctx=3552, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=945KiB/s (968kB/s), 227KiB/s-248KiB/s (232kB/s-254kB/s), io=23.4MiB (24.5MB), run=24301-25350msec WRITE: bw=994KiB/s (1018kB/s), 239KiB/s-258KiB/s (244kB/s-264kB/s), io=24.6MiB (25.8MB), run=24301-25350msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193260: Sun Jun 28 03:51:29 2026 read: IOPS=13, BW=219KiB/s (224kB/s)(5920KiB/27015msec) clat (msec): min=4, max=151, avg=31.60, stdev=20.69 lat (msec): min=4, max=151, avg=31.60, stdev=20.69 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 10], 10.00th=[ 12], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 30], | 70.00th=[ 37], 80.00th=[ 47], 90.00th=[ 64], 95.00th=[ 71], | 99.00th=[ 93], 99.50th=[ 107], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 94, max= 606, per=23.83%, avg=210.87, stdev=102.90, samples=53 iops : min= 5, max= 37, avg=12.42, stdev= 6.54, samples=53 write: IOPS=14, BW=236KiB/s (241kB/s)(6368KiB/27015msec); 0 zone resets clat (msec): min=5, max=143, avg=38.31, stdev=22.56 lat (msec): min=5, max=143, avg=38.31, stdev=22.56 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 15], 20.00th=[ 19], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 35], 60.00th=[ 42], | 70.00th=[ 47], 80.00th=[ 55], 90.00th=[ 69], 95.00th=[ 81], | 99.00th=[ 106], 99.50th=[ 134], 99.90th=[ 144], 99.95th=[ 144], | 99.99th=[ 144] bw ( KiB/s): min= 63, max= 702, per=24.81%, avg=230.94, stdev=106.60, samples=53 iops : min= 3, max= 43, avg=13.68, stdev= 6.75, samples=53 lat (msec) : 10=4.04%, 20=25.52%, 50=48.05%, 100=21.09%, 250=1.30% cpu : usr=0.05%, sys=16.48%, ctx=2420, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193261: Sun Jun 28 03:51:29 2026 read: IOPS=13, BW=212KiB/s (217kB/s)(5744KiB/27054msec) clat (msec): min=3, max=108, avg=32.82, stdev=21.18 lat (msec): min=3, max=108, avg=32.82, stdev=21.18 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 9], 10.00th=[ 12], 20.00th=[ 15], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 32], | 70.00th=[ 40], 80.00th=[ 51], 90.00th=[ 67], 95.00th=[ 75], | 99.00th=[ 94], 99.50th=[ 107], 99.90th=[ 109], 99.95th=[ 109], | 99.99th=[ 109] bw ( KiB/s): min= 51, max= 670, per=23.29%, avg=206.13, stdev=105.94, samples=53 iops : min= 3, max= 41, avg=12.13, stdev= 6.67, samples=53 write: IOPS=15, BW=242KiB/s (248kB/s)(6544KiB/27054msec); 0 zone resets clat (msec): min=4, max=137, avg=37.02, stdev=22.67 lat (msec): min=4, max=137, avg=37.02, stdev=22.67 clat percentiles (msec): | 1.00th=[ 6], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 17], | 30.00th=[ 22], 40.00th=[ 27], 50.00th=[ 32], 60.00th=[ 39], | 70.00th=[ 48], 80.00th=[ 57], 90.00th=[ 69], 95.00th=[ 78], | 99.00th=[ 102], 99.50th=[ 110], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 94, max= 704, per=24.70%, avg=229.94, stdev=128.19, samples=53 iops : min= 5, max= 44, avg=13.62, stdev= 8.16, samples=53 lat (msec) : 4=0.65%, 10=5.34%, 20=24.09%, 50=45.70%, 100=23.31% lat (msec) : 250=0.91% cpu : usr=0.05%, sys=16.21%, ctx=2306, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193262: Sun Jun 28 03:51:29 2026 read: IOPS=14, BW=232KiB/s (238kB/s)(6256KiB/26943msec) clat (msec): min=6, max=119, avg=32.67, stdev=21.06 lat (msec): min=6, max=119, avg=32.67, stdev=21.06 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 20], 40.00th=[ 23], 50.00th=[ 27], 60.00th=[ 31], | 70.00th=[ 37], 80.00th=[ 49], 90.00th=[ 63], 95.00th=[ 75], | 99.00th=[ 103], 99.50th=[ 109], 99.90th=[ 120], 99.95th=[ 120], | 99.99th=[ 120] bw ( KiB/s): min= 63, max= 768, per=26.03%, avg=230.34, stdev=124.34, samples=53 iops : min= 3, max= 48, avg=13.64, stdev= 7.90, samples=53 write: IOPS=13, BW=224KiB/s (229kB/s)(6032KiB/26943msec); 0 zone resets clat (msec): min=6, max=122, avg=37.14, stdev=20.95 lat (msec): min=6, max=122, avg=37.14, stdev=20.95 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 55], 90.00th=[ 66], 95.00th=[ 81], | 99.00th=[ 100], 99.50th=[ 101], 99.90th=[ 123], 99.95th=[ 123], | 99.99th=[ 123] bw ( KiB/s): min= 63, max= 638, per=23.41%, avg=217.96, stdev=92.57, samples=53 iops : min= 3, max= 39, avg=12.87, stdev= 5.88, samples=53 lat (msec) : 10=2.34%, 20=25.65%, 50=50.91%, 100=20.44%, 250=0.65% cpu : usr=0.06%, sys=16.79%, ctx=2417, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193263: Sun Jun 28 03:51:29 2026 read: IOPS=14, BW=225KiB/s (230kB/s)(6032KiB/26863msec) clat (msec): min=8, max=105, avg=31.21, stdev=19.31 lat (msec): min=8, max=105, avg=31.21, stdev=19.31 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 11], 10.00th=[ 13], 20.00th=[ 16], | 30.00th=[ 19], 40.00th=[ 22], 50.00th=[ 26], 60.00th=[ 31], | 70.00th=[ 36], 80.00th=[ 47], 90.00th=[ 61], 95.00th=[ 75], | 99.00th=[ 91], 99.50th=[ 106], 99.90th=[ 106], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 63, max= 670, per=25.07%, avg=221.87, stdev=112.58, samples=53 iops : min= 3, max= 41, avg=13.11, stdev= 7.15, samples=53 write: IOPS=14, BW=233KiB/s (238kB/s)(6256KiB/26863msec); 0 zone resets clat (msec): min=9, max=153, avg=38.23, stdev=23.00 lat (msec): min=9, max=153, avg=38.24, stdev=23.00 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 13], 10.00th=[ 15], 20.00th=[ 20], | 30.00th=[ 23], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 54], 90.00th=[ 69], 95.00th=[ 85], | 99.00th=[ 125], 99.50th=[ 146], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 95, max= 670, per=24.92%, avg=232.00, stdev=111.03, samples=53 iops : min= 5, max= 41, avg=13.75, stdev= 7.02, samples=53 lat (msec) : 10=1.56%, 20=27.86%, 50=49.87%, 100=19.53%, 250=1.17% cpu : usr=0.06%, sys=16.42%, ctx=2318, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=885KiB/s (907kB/s), 212KiB/s-232KiB/s (217kB/s-238kB/s), io=23.4MiB (24.5MB), run=26863-27054msec WRITE: bw=931KiB/s (954kB/s), 224KiB/s-242KiB/s (229kB/s-248kB/s), io=24.6MiB (25.8MB), run=26863-27054msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193273: Sun Jun 28 03:51:44 2026 read: IOPS=1, BW=1147KiB/s (1174kB/s)(7168KiB/6252msec) clat (msec): min=148, max=968, avg=427.03, stdev=318.20 lat (msec): min=148, max=968, avg=427.03, stdev=318.20 clat percentiles (msec): | 1.00th=[ 148], 5.00th=[ 148], 10.00th=[ 148], 20.00th=[ 184], | 30.00th=[ 268], 40.00th=[ 268], 50.00th=[ 279], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 785], 90.00th=[ 969], 95.00th=[ 969], | 99.00th=[ 969], 99.50th=[ 969], 99.90th=[ 969], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 1848, max= 4063, per=89.45%, avg=2663.00, stdev=1043.51, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=0, BW=819KiB/s (839kB/s)(5120KiB/6252msec); 0 zone resets clat (msec): min=184, max=1793, avg=648.74, stdev=656.20 lat (msec): min=184, max=1794, avg=648.82, stdev=656.21 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 334], 40.00th=[ 334], 50.00th=[ 347], 60.00th=[ 347], | 70.00th=[ 584], 80.00th=[ 584], 90.00th=[ 1787], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1848, max= 2043, per=47.02%, avg=1959.80, stdev=89.93, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (msec) : 250=25.00%, 500=41.67%, 750=8.33%, 1000=16.67%, 2000=8.33% cpu : usr=0.00%, sys=19.58%, ctx=239, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193275: Sun Jun 28 03:51:44 2026 read: IOPS=0, BW=298KiB/s (305kB/s)(2048KiB/6879msec) clat (msec): min=103, max=679, avg=391.61, stdev=407.50 lat (msec): min=103, max=679, avg=391.61, stdev=407.50 clat percentiles (msec): | 1.00th=[ 104], 5.00th=[ 104], 10.00th=[ 104], 20.00th=[ 104], | 30.00th=[ 104], 40.00th=[ 104], 50.00th=[ 104], 60.00th=[ 684], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 1410, max= 1957, per=56.55%, avg=1683.50, stdev=386.79, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1489KiB/s (1524kB/s)(10.0MiB/6879msec); 0 zone resets clat (msec): min=70, max=1739, avg=608.48, stdev=554.68 lat (msec): min=71, max=1739, avg=608.55, stdev=554.67 clat percentiles (msec): | 1.00th=[ 71], 5.00th=[ 71], 10.00th=[ 71], 20.00th=[ 136], | 30.00th=[ 140], 40.00th=[ 180], 50.00th=[ 418], 60.00th=[ 502], | 70.00th=[ 718], 80.00th=[ 936], 90.00th=[ 1250], 95.00th=[ 1737], | 99.00th=[ 1737], 99.50th=[ 1737], 99.90th=[ 1737], 99.95th=[ 1737], | 99.99th=[ 1737] bw ( KiB/s): min= 1848, max= 2043, per=46.77%, avg=1949.50, stdev=71.25, samples=6 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=6 lat (msec) : 100=8.33%, 250=33.33%, 500=8.33%, 750=25.00%, 1000=8.33% lat (msec) : 2000=16.67% cpu : usr=0.03%, sys=14.39%, ctx=176, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193277: Sun Jun 28 03:51:44 2026 read: IOPS=1, BW=1041KiB/s (1066kB/s)(6144KiB/5901msec) clat (msec): min=120, max=575, avg=269.48, stdev=164.28 lat (msec): min=120, max=575, avg=269.48, stdev=164.28 clat percentiles (msec): | 1.00th=[ 121], 5.00th=[ 121], 10.00th=[ 121], 20.00th=[ 138], | 30.00th=[ 138], 40.00th=[ 236], 50.00th=[ 236], 60.00th=[ 259], | 70.00th=[ 292], 80.00th=[ 292], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 1980, max= 2043, per=67.73%, avg=2016.20, stdev=31.63, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 write: IOPS=1, BW=1041KiB/s (1066kB/s)(6144KiB/5901msec); 0 zone resets clat (msec): min=140, max=1646, avg=696.92, stdev=563.29 lat (msec): min=141, max=1646, avg=697.01, stdev=563.30 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 255], | 30.00th=[ 255], 40.00th=[ 510], 50.00th=[ 510], 60.00th=[ 575], | 70.00th=[ 1053], 80.00th=[ 1053], 90.00th=[ 1653], 95.00th=[ 1653], | 99.00th=[ 1653], 99.50th=[ 1653], 99.90th=[ 1653], 99.95th=[ 1653], | 99.99th=[ 1653] bw ( KiB/s): min= 1469, max= 4087, per=55.08%, avg=2295.60, stdev=1027.93, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 250=33.33%, 500=25.00%, 750=25.00%, 2000=16.67% cpu : usr=0.00%, sys=12.61%, ctx=154, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193279: Sun Jun 28 03:51:44 2026 read: IOPS=0, BW=754KiB/s (772kB/s)(5120KiB/6790msec) clat (msec): min=93, max=626, avg=324.18, stdev=219.28 lat (msec): min=93, max=627, avg=324.41, stdev=219.67 clat percentiles (msec): | 1.00th=[ 94], 5.00th=[ 94], 10.00th=[ 94], 20.00th=[ 94], | 30.00th=[ 136], 40.00th=[ 136], 50.00th=[ 330], 60.00th=[ 330], | 70.00th=[ 435], 80.00th=[ 435], 90.00th=[ 625], 95.00th=[ 625], | 99.00th=[ 625], 99.50th=[ 625], 99.90th=[ 625], 99.95th=[ 625], | 99.99th=[ 625] bw ( KiB/s): min= 1885, max= 4087, per=89.04%, avg=2650.67, stdev=1244.81, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 write: IOPS=1, BW=1056KiB/s (1081kB/s)(7168KiB/6790msec); 0 zone resets clat (msec): min=134, max=1775, avg=733.21, stdev=649.96 lat (msec): min=134, max=1775, avg=733.30, stdev=649.97 clat percentiles (msec): | 1.00th=[ 136], 5.00th=[ 136], 10.00th=[ 136], 20.00th=[ 146], | 30.00th=[ 430], 40.00th=[ 430], 50.00th=[ 443], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 1485], 90.00th=[ 1770], 95.00th=[ 1770], | 99.00th=[ 1770], 99.50th=[ 1770], 99.90th=[ 1770], 99.95th=[ 1770], | 99.99th=[ 1770] bw ( KiB/s): min= 1424, max= 2048, per=45.37%, avg=1891.20, stdev=264.03, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (msec) : 100=8.33%, 250=25.00%, 500=33.33%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=15.80%, ctx=261, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2977KiB/s (3049kB/s), 298KiB/s-1147KiB/s (305kB/s-1174kB/s), io=20.0MiB (20.0MB), run=5901-6879msec WRITE: bw=4168KiB/s (4268kB/s), 819KiB/s-1489KiB/s (839kB/s-1524kB/s), io=28.0MiB (29.4MB), run=5901-6879msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193274: Sun Jun 28 03:51:44 2026 read: IOPS=2, BW=2213KiB/s (2266kB/s)(7168KiB/3239msec) clat (usec): min=776, max=332088, avg=226759.82, stdev=126875.97 lat (usec): min=778, max=332089, avg=226761.40, stdev=126876.03 clat percentiles (usec): | 1.00th=[ 775], 5.00th=[ 775], 10.00th=[ 775], 20.00th=[ 94897], | 30.00th=[263193], 40.00th=[263193], 50.00th=[291505], 60.00th=[299893], | 70.00th=[299893], 80.00th=[304088], 90.00th=[333448], 95.00th=[333448], | 99.00th=[333448], 99.50th=[333448], 99.90th=[333448], 99.95th=[333448], | 99.99th=[333448] bw ( KiB/s): min= 1872, max= 2880, per=74.61%, avg=2207.75, stdev=455.12, samples=4 iops : min= 1, max= 2, avg= 1.50, stdev= 0.58, samples=4 write: IOPS=1, BW=1581KiB/s (1619kB/s)(5120KiB/3239msec); 0 zone resets clat (msec): min=80, max=610, avg=323.83, stdev=218.67 lat (msec): min=81, max=610, avg=323.90, stdev=218.66 clat percentiles (msec): | 1.00th=[ 82], 5.00th=[ 82], 10.00th=[ 82], 20.00th=[ 82], | 30.00th=[ 131], 40.00th=[ 131], 50.00th=[ 372], 60.00th=[ 372], | 70.00th=[ 426], 80.00th=[ 426], 90.00th=[ 609], 95.00th=[ 609], | 99.00th=[ 609], 99.50th=[ 609], 99.90th=[ 609], 99.95th=[ 609], | 99.99th=[ 609] bw ( KiB/s): min= 1984, max= 2048, per=48.66%, avg=2016.00, stdev=45.25, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (usec) : 1000=8.33% lat (msec) : 100=16.67%, 250=8.33%, 500=58.33%, 750=8.33% cpu : usr=0.00%, sys=59.51%, ctx=1523, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193276: Sun Jun 28 03:51:44 2026 read: IOPS=0, BW=296KiB/s (303kB/s)(2048KiB/6920msec) clat (msec): min=329, max=364, avg=347.18, stdev=24.70 lat (msec): min=329, max=364, avg=347.18, stdev=24.71 clat percentiles (msec): | 1.00th=[ 330], 5.00th=[ 330], 10.00th=[ 330], 20.00th=[ 330], | 30.00th=[ 330], 40.00th=[ 330], 50.00th=[ 330], 60.00th=[ 363], | 70.00th=[ 363], 80.00th=[ 363], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 1452, max= 2048, per=59.14%, avg=1750.00, stdev=421.44, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1480KiB/s (1515kB/s)(10.0MiB/6920msec); 0 zone resets clat (msec): min=34, max=1791, avg=604.28, stdev=602.57 lat (msec): min=35, max=1791, avg=604.37, stdev=602.57 clat percentiles (msec): | 1.00th=[ 35], 5.00th=[ 35], 10.00th=[ 35], 20.00th=[ 48], | 30.00th=[ 169], 40.00th=[ 230], 50.00th=[ 313], 60.00th=[ 321], | 70.00th=[ 810], 80.00th=[ 995], 90.00th=[ 1334], 95.00th=[ 1787], | 99.00th=[ 1787], 99.50th=[ 1787], 99.90th=[ 1787], 99.95th=[ 1787], | 99.99th=[ 1787] bw ( KiB/s): min= 1984, max= 8192, per=85.94%, avg=3560.60, stdev=2669.85, samples=5 iops : min= 1, max= 8, avg= 3.20, stdev= 2.77, samples=5 lat (msec) : 50=16.67%, 250=16.67%, 500=33.33%, 1000=16.67%, 2000=16.67% cpu : usr=0.01%, sys=37.14%, ctx=436, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193278: Sun Jun 28 03:51:44 2026 read: IOPS=0, BW=976KiB/s (999kB/s)(6144KiB/6297msec) clat (usec): min=661, max=465677, avg=219425.32, stdev=184963.88 lat (usec): min=662, max=465678, avg=219426.65, stdev=184963.80 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 660], 10.00th=[ 660], 20.00th=[ 889], | 30.00th=[ 889], 40.00th=[242222], 50.00th=[242222], 60.00th=[299893], | 70.00th=[308282], 80.00th=[308282], 90.00th=[467665], 95.00th=[467665], | 99.00th=[467665], 99.50th=[467665], 99.90th=[467665], 99.95th=[467665], | 99.99th=[467665] bw ( KiB/s): min= 1765, max= 3968, per=100.00%, avg=3168.00, stdev=1219.02, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=0, BW=976KiB/s (999kB/s)(6144KiB/6297msec); 0 zone resets clat (msec): min=307, max=1823, avg=802.20, stdev=550.73 lat (msec): min=308, max=1823, avg=802.25, stdev=550.72 clat percentiles (msec): | 1.00th=[ 309], 5.00th=[ 309], 10.00th=[ 309], 20.00th=[ 481], | 30.00th=[ 481], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1821], 95.00th=[ 1821], | 99.00th=[ 1821], 99.50th=[ 1821], 99.90th=[ 1821], 99.95th=[ 1821], | 99.99th=[ 1821] bw ( KiB/s): min= 1473, max= 2048, per=44.13%, avg=1828.40, stdev=226.20, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 lat (usec) : 750=8.33%, 1000=8.33% lat (msec) : 250=8.33%, 500=41.67%, 750=16.67%, 2000=16.67% cpu : usr=0.00%, sys=39.53%, ctx=665, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193280: Sun Jun 28 03:51:44 2026 read: IOPS=0, BW=960KiB/s (983kB/s)(5120KiB/5336msec) clat (usec): min=613, max=1165.8k, avg=356731.35, stdev=477732.50 lat (usec): min=614, max=1165.8k, avg=356732.25, stdev=477732.36 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 611], 10.00th=[ 611], | 20.00th=[ 611], 30.00th=[ 668], 40.00th=[ 668], | 50.00th=[ 308282], 60.00th=[ 308282], 70.00th=[ 308282], | 80.00th=[ 308282], 90.00th=[1166017], 95.00th=[1166017], | 99.00th=[1166017], 99.50th=[1166017], 99.90th=[1166017], | 99.95th=[1166017], 99.99th=[1166017] bw ( KiB/s): min= 3968, max= 4096, per=100.00%, avg=4032.00, stdev=90.51, samples=2 iops : min= 3, max= 4, avg= 3.50, stdev= 0.71, samples=2 write: IOPS=1, BW=1343KiB/s (1376kB/s)(7168KiB/5336msec); 0 zone resets clat (msec): min=165, max=848, avg=487.31, stdev=215.20 lat (msec): min=165, max=848, avg=487.39, stdev=215.22 clat percentiles (msec): | 1.00th=[ 165], 5.00th=[ 165], 10.00th=[ 165], 20.00th=[ 321], | 30.00th=[ 422], 40.00th=[ 422], 50.00th=[ 542], 60.00th=[ 550], | 70.00th=[ 550], 80.00th=[ 567], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1448, max= 2048, per=46.52%, avg=1927.43, stdev=219.54, samples=7 iops : min= 1, max= 2, avg= 1.43, stdev= 0.53, samples=7 lat (usec) : 750=16.67% lat (msec) : 250=8.33%, 500=33.33%, 750=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=47.97%, ctx=658, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=2960KiB/s (3031kB/s), 296KiB/s-2213KiB/s (303kB/s-2266kB/s), io=20.0MiB (20.0MB), run=3239-6920msec WRITE: bw=4143KiB/s (4243kB/s), 976KiB/s-1581KiB/s (999kB/s-1619kB/s), io=28.0MiB (29.4MB), run=3239-6920msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=193287: Sun Jun 28 03:51:55 2026 read: IOPS=1, BW=5263KiB/s (5389kB/s)(12.0MiB/2335msec) clat (msec): min=656, max=755, avg=704.52, stdev=49.41 lat (msec): min=656, max=755, avg=704.52, stdev=49.41 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 760], 80.00th=[ 760], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=59.85%, ctx=2921, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193288: Sun Jun 28 03:51:55 2026 read: IOPS=0, BW=1523KiB/s (1560kB/s)(4096KiB/2689msec) clat (nsec): min=703329k, max=703329k, avg=703328581.00, stdev= 0.00 lat (nsec): min=703331k, max=703331k, avg=703330849.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 701], 5.00th=[ 701], 10.00th=[ 701], 20.00th=[ 701], | 30.00th=[ 701], 40.00th=[ 701], 50.00th=[ 701], 60.00th=[ 701], | 70.00th=[ 701], 80.00th=[ 701], 90.00th=[ 701], 95.00th=[ 701], | 99.00th=[ 701], 99.50th=[ 701], 99.90th=[ 701], 99.95th=[ 701], | 99.99th=[ 701] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3046KiB/s (3120kB/s)(8192KiB/2689msec); 0 zone resets clat (msec): min=633, max=1141, avg=887.62, stdev=359.30 lat (msec): min=633, max=1141, avg=887.93, stdev=359.27 clat percentiles (msec): | 1.00th=[ 634], 5.00th=[ 634], 10.00th=[ 634], 20.00th=[ 634], | 30.00th=[ 634], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 1150], | 70.00th=[ 1150], 80.00th=[ 1150], 90.00th=[ 1150], 95.00th=[ 1150], | 99.00th=[ 1150], 99.50th=[ 1150], 99.90th=[ 1150], 99.95th=[ 1150], | 99.99th=[ 1150] bw ( KiB/s): min= 8110, max= 8110, per=81.83%, avg=8110.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.00%, sys=20.61%, ctx=976, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193289: Sun Jun 28 03:51:55 2026 write: IOPS=0, BW=3717KiB/s (3806kB/s)(12.0MiB/3306msec); 0 zone resets clat (msec): min=290, max=1627, avg=1007.60, stdev=673.81 lat (msec): min=290, max=1627, avg=1007.88, stdev=673.71 clat percentiles (msec): | 1.00th=[ 292], 5.00th=[ 292], 10.00th=[ 292], 20.00th=[ 292], | 30.00th=[ 292], 40.00th=[ 1099], 50.00th=[ 1099], 60.00th=[ 1099], | 70.00th=[ 1636], 80.00th=[ 1636], 90.00th=[ 1636], 95.00th=[ 1636], | 99.00th=[ 1636], 99.50th=[ 1636], 99.90th=[ 1636], 99.95th=[ 1636], | 99.99th=[ 1636] bw ( KiB/s): min= 8000, max= 8192, per=81.69%, avg=8096.00, stdev=135.76, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.06%, sys=21.30%, ctx=117, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193291: Sun Jun 28 03:51:55 2026 write: IOPS=1, BW=4099KiB/s (4197kB/s)(12.0MiB/2998msec); 0 zone resets clat (msec): min=184, max=2203, avg=927.50, stdev=1110.13 lat (msec): min=184, max=2204, avg=927.88, stdev=1110.19 clat percentiles (msec): | 1.00th=[ 184], 5.00th=[ 184], 10.00th=[ 184], 20.00th=[ 184], | 30.00th=[ 184], 40.00th=[ 397], 50.00th=[ 397], 60.00th=[ 397], | 70.00th=[ 2198], 80.00th=[ 2198], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 6262, max= 8192, per=72.92%, avg=7227.00, stdev=1364.72, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 500=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=17.85%, ctx=133, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6093KiB/s (6239kB/s), 1523KiB/s-5263KiB/s (1560kB/s-5389kB/s), io=16.0MiB (16.8MB), run=2335-2689msec WRITE: bw=9912KiB/s (10.1MB/s), 3046KiB/s-4099KiB/s (3120kB/s-4197kB/s), io=32.0MiB (33.6MB), run=2689-3306msec rand-rw: (groupid=0, jobs=1): err= 0: pid=193290: Sun Jun 28 03:51:55 2026 read: IOPS=1, BW=4791KiB/s (4906kB/s)(12.0MiB/2565msec) clat (msec): min=518, max=1035, avg=790.53, stdev=259.56 lat (msec): min=518, max=1035, avg=790.53, stdev=259.56 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 818], 50.00th=[ 818], 60.00th=[ 818], | 70.00th=[ 1036], 80.00th=[ 1036], 90.00th=[ 1036], 95.00th=[ 1036], | 99.00th=[ 1036], 99.50th=[ 1036], 99.90th=[ 1036], 99.95th=[ 1036], | 99.99th=[ 1036] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=18.64%, ctx=102, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193292: Sun Jun 28 03:51:55 2026 read: IOPS=0, BW=1175KiB/s (1203kB/s)(4096KiB/3486msec) clat (nsec): min=1919.6M, max=1919.6M, avg=1919637761.00, stdev= 0.00 lat (nsec): min=1919.6M, max=1919.6M, avg=1919639956.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 1921], 5.00th=[ 1921], 10.00th=[ 1921], 20.00th=[ 1921], | 30.00th=[ 1921], 40.00th=[ 1921], 50.00th=[ 1921], 60.00th=[ 1921], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8175, max= 8175, per=100.00%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2350KiB/s (2406kB/s)(8192KiB/3486msec); 0 zone resets clat (msec): min=646, max=707, avg=677.16, stdev=43.04 lat (msec): min=647, max=707, avg=677.48, stdev=43.05 clat percentiles (msec): | 1.00th=[ 651], 5.00th=[ 651], 10.00th=[ 651], 20.00th=[ 651], | 30.00th=[ 651], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 709], | 70.00th=[ 709], 80.00th=[ 709], 90.00th=[ 709], 95.00th=[ 709], | 99.00th=[ 709], 99.50th=[ 709], 99.90th=[ 709], 99.95th=[ 709], | 99.99th=[ 709] bw ( KiB/s): min= 8062, max= 8062, per=85.78%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.09%, sys=12.63%, ctx=100, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193293: Sun Jun 28 03:51:55 2026 write: IOPS=0, BW=3535KiB/s (3620kB/s)(12.0MiB/3476msec); 0 zone resets clat (msec): min=197, max=2478, avg=1089.00, stdev=1219.34 lat (msec): min=197, max=2478, avg=1089.35, stdev=1219.33 clat percentiles (msec): | 1.00th=[ 197], 5.00th=[ 197], 10.00th=[ 197], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 592], 50.00th=[ 592], 60.00th=[ 592], | 70.00th=[ 2467], 80.00th=[ 2467], 90.00th=[ 2467], 95.00th=[ 2467], | 99.00th=[ 2467], 99.50th=[ 2467], 99.90th=[ 2467], 99.95th=[ 2467], | 99.99th=[ 2467] bw ( KiB/s): min= 8062, max= 8062, per=85.78%, avg=8062.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 750=33.33%, >=2000=33.33% cpu : usr=0.00%, sys=14.50%, ctx=129, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=193294: Sun Jun 28 03:51:55 2026 write: IOPS=0, BW=3729KiB/s (3819kB/s)(12.0MiB/3295msec); 0 zone resets clat (msec): min=592, max=1708, avg=1022.97, stdev=600.19 lat (msec): min=593, max=1708, avg=1023.28, stdev=600.15 clat percentiles (msec): | 1.00th=[ 592], 5.00th=[ 592], 10.00th=[ 592], 20.00th=[ 592], | 30.00th=[ 592], 40.00th=[ 768], 50.00th=[ 768], 60.00th=[ 768], | 70.00th=[ 1703], 80.00th=[ 1703], 90.00th=[ 1703], 95.00th=[ 1703], | 99.00th=[ 1703], 99.50th=[ 1703], 99.90th=[ 1703], 99.95th=[ 1703], | 99.99th=[ 1703] bw ( KiB/s): min= 8175, max= 8192, per=87.07%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=17.24%, ctx=119, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4700KiB/s (4813kB/s), 1175KiB/s-4791KiB/s (1203kB/s-4906kB/s), io=16.0MiB (16.8MB), run=2565-3486msec WRITE: bw=9400KiB/s (9625kB/s), 2350KiB/s-3729KiB/s (2406kB/s-3819kB/s), io=32.0MiB (33.6MB), run=3295-3486msec