== sanity test 398b: DIO and buffer IO race ============== 11:08:32 (1755097712) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 2.83575 s, 17.7 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=152973: Wed Aug 13 11:09:51 2025 read: IOPS=21, BW=87.0KiB/s (90.1kB/s)(5992KiB/68096msec) clat (usec): min=306, max=860077, avg=24792.94, stdev=24733.67 lat (usec): min=307, max=860079, avg=24793.89, stdev=24733.75 clat percentiles (usec): | 1.00th=[ 660], 5.00th=[ 8455], 10.00th=[ 11469], 20.00th=[ 14746], | 30.00th=[ 17433], 40.00th=[ 20317], 50.00th=[ 22938], 60.00th=[ 25560], | 70.00th=[ 28443], 80.00th=[ 32900], 90.00th=[ 38536], 95.00th=[ 45351], | 99.00th=[ 64226], 99.50th=[ 67634], 99.90th=[109577], 99.95th=[859833], | 99.99th=[859833] bw ( KiB/s): min= 15, max= 160, per=25.00%, avg=88.00, stdev=26.70, samples=134 iops : min= 3, max= 40, avg=21.51, stdev= 6.72, samples=134 write: IOPS=23, BW=92.5KiB/s (94.7kB/s)(6296KiB/68096msec); 0 zone resets clat (usec): min=748, max=137597, avg=19456.80, stdev=14380.36 lat (usec): min=749, max=137598, avg=19457.90, stdev=14380.48 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 6], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 13], 50.00th=[ 17], 60.00th=[ 21], | 70.00th=[ 25], 80.00th=[ 31], 90.00th=[ 40], 95.00th=[ 47], | 99.00th=[ 64], 99.50th=[ 77], 99.90th=[ 103], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 31, max= 199, per=25.28%, avg=93.05, stdev=27.97, samples=133 iops : min= 7, max= 49, avg=22.77, stdev= 7.05, samples=133 lat (usec) : 500=0.20%, 750=0.72%, 1000=0.52% lat (msec) : 2=0.52%, 4=2.83%, 10=15.04%, 20=30.21%, 50=46.61% lat (msec) : 100=3.19%, 250=0.13%, 1000=0.03% cpu : usr=0.11%, sys=30.69%, ctx=10008, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152974: Wed Aug 13 11:09:51 2025 read: IOPS=21, BW=87.7KiB/s (89.8kB/s)(5940KiB/67733msec) clat (usec): min=97, max=130190, avg=24811.47, stdev=13081.75 lat (usec): min=97, max=130190, avg=24812.44, stdev=13081.70 clat percentiles (usec): | 1.00th=[ 545], 5.00th=[ 8455], 10.00th=[ 11338], 20.00th=[ 14877], | 30.00th=[ 17433], 40.00th=[ 19792], 50.00th=[ 23200], 60.00th=[ 26084], | 70.00th=[ 29492], 80.00th=[ 33817], 90.00th=[ 39584], 95.00th=[ 47973], | 99.00th=[ 67634], 99.50th=[ 73925], 99.90th=[ 88605], 99.95th=[130548], | 99.99th=[130548] bw ( KiB/s): min= 7, max= 176, per=24.93%, avg=87.74, stdev=25.81, samples=133 iops : min= 1, max= 44, avg=21.44, stdev= 6.54, samples=133 write: IOPS=23, BW=93.7KiB/s (95.0kB/s)(6348KiB/67733msec); 0 zone resets clat (usec): min=723, max=910751, avg=19245.10, stdev=26230.04 lat (usec): min=723, max=910752, avg=19246.17, stdev=26230.02 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 9], 40.00th=[ 13], 50.00th=[ 16], 60.00th=[ 20], | 70.00th=[ 24], 80.00th=[ 30], 90.00th=[ 37], 95.00th=[ 43], | 99.00th=[ 62], 99.50th=[ 73], 99.90th=[ 117], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 263, per=25.38%, avg=93.41, stdev=33.79, samples=133 iops : min= 1, max= 65, avg=22.86, stdev= 8.47, samples=133 lat (usec) : 100=0.03%, 250=0.07%, 500=0.29%, 750=0.62%, 1000=0.65% lat (msec) : 2=0.39%, 4=3.06%, 10=15.56%, 20=30.89%, 50=44.92% lat (msec) : 100=3.39%, 250=0.10%, 1000=0.03% cpu : usr=0.09%, sys=30.67%, ctx=10013, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152977: Wed Aug 13 11:09:51 2025 read: IOPS=22, BW=89.7KiB/s (91.9kB/s)(6028KiB/67182msec) clat (usec): min=207, max=915882, avg=24272.55, stdev=25942.68 lat (usec): min=208, max=915882, avg=24279.89, stdev=25950.25 clat percentiles (usec): | 1.00th=[ 570], 5.00th=[ 7373], 10.00th=[ 10290], 20.00th=[ 14484], | 30.00th=[ 17171], 40.00th=[ 19792], 50.00th=[ 22152], 60.00th=[ 25297], | 70.00th=[ 28705], 80.00th=[ 32375], 90.00th=[ 38536], 95.00th=[ 43779], | 99.00th=[ 61080], 99.50th=[ 70779], 99.90th=[113771], 99.95th=[918553], | 99.99th=[918553] bw ( KiB/s): min= 31, max= 206, per=25.74%, avg=90.62, stdev=27.79, samples=131 iops : min= 7, max= 51, avg=22.17, stdev= 7.00, samples=131 write: IOPS=23, BW=93.2KiB/s (95.4kB/s)(6260KiB/67182msec); 0 zone resets clat (usec): min=749, max=95701, avg=19328.20, stdev=13826.10 lat (usec): min=750, max=95702, avg=19329.38, stdev=13826.12 clat percentiles (usec): | 1.00th=[ 1401], 5.00th=[ 3752], 10.00th=[ 5145], 20.00th=[ 6915], | 30.00th=[ 8979], 40.00th=[12780], 50.00th=[17171], 60.00th=[20317], | 70.00th=[24249], 80.00th=[29754], 90.00th=[38536], 95.00th=[45351], | 99.00th=[60556], 99.50th=[64226], 99.90th=[93848], 99.95th=[95945], | 99.99th=[95945] bw ( KiB/s): min= 22, max= 192, per=25.34%, avg=93.25, stdev=29.12, samples=132 iops : min= 5, max= 48, avg=22.83, stdev= 7.36, samples=132 lat (usec) : 250=0.03%, 500=0.23%, 750=0.81%, 1000=0.68% lat (msec) : 2=0.75%, 4=2.25%, 10=16.67%, 20=28.78%, 50=46.58% lat (msec) : 100=3.16%, 250=0.03%, 1000=0.03% cpu : usr=0.11%, sys=30.63%, ctx=9776, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152978: Wed Aug 13 11:09:51 2025 read: IOPS=22, BW=88.8KiB/s (90.9kB/s)(6052KiB/68159msec) clat (usec): min=96, max=100426, avg=23904.33, stdev=12111.35 lat (usec): min=97, max=100426, avg=23905.23, stdev=12111.35 clat percentiles (usec): | 1.00th=[ 611], 5.00th=[ 7635], 10.00th=[ 10683], 20.00th=[ 14484], | 30.00th=[ 16909], 40.00th=[ 19792], 50.00th=[ 22414], 60.00th=[ 25560], | 70.00th=[ 28967], 80.00th=[ 33162], 90.00th=[ 39060], 95.00th=[ 44827], | 99.00th=[ 58459], 99.50th=[ 63701], 99.90th=[ 85459], 99.95th=[100140], | 99.99th=[100140] bw ( KiB/s): min= 32, max= 207, per=25.31%, avg=89.08, stdev=27.65, samples=133 iops : min= 8, max= 51, avg=21.78, stdev= 6.98, samples=133 write: IOPS=22, BW=91.5KiB/s (93.7kB/s)(6236KiB/68159msec); 0 zone resets clat (usec): min=671, max=946607, avg=20301.27, stdev=27664.38 lat (usec): min=672, max=946609, avg=20302.78, stdev=27664.32 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 3687], 10.00th=[ 5014], 20.00th=[ 6849], | 30.00th=[ 9503], 40.00th=[ 13829], 50.00th=[ 16909], 60.00th=[ 20055], | 70.00th=[ 24249], 80.00th=[ 30540], 90.00th=[ 38536], 95.00th=[ 45876], | 99.00th=[ 70779], 99.50th=[ 79168], 99.90th=[115868], 99.95th=[943719], | 99.99th=[943719] bw ( KiB/s): min= 39, max= 200, per=24.97%, avg=91.90, stdev=28.96, samples=133 iops : min= 9, max= 50, avg=22.49, stdev= 7.30, samples=133 lat (usec) : 100=0.03%, 250=0.07%, 500=0.26%, 750=0.75%, 1000=0.88% lat (msec) : 2=0.36%, 4=2.64%, 10=15.30%, 20=30.44%, 50=46.16% lat (msec) : 100=2.93%, 250=0.16%, 1000=0.03% cpu : usr=0.10%, sys=30.45%, ctx=10091, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=352KiB/s (361kB/s), 87.7KiB/s-89.7KiB/s (89.8kB/s-91.9kB/s), io=23.4MiB (24.6MB), run=67182-68159msec WRITE: bw=369KiB/s (378kB/s), 91.5KiB/s-93.7KiB/s (93.7kB/s-95.0kB/s), io=24.6MiB (25.7MB), run=67182-68159msec rand-rw: (groupid=0, jobs=1): err= 0: pid=152972: Wed Aug 13 11:10:10 2025 read: IOPS=17, BW=68.8KiB/s (70.4kB/s)(5992KiB/87141msec) clat (msec): min=2, max=878, avg=19.54, stdev=28.97 lat (msec): min=2, max=878, avg=19.54, stdev=28.97 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 58], | 99.00th=[ 90], 99.50th=[ 110], 99.90th=[ 130], 99.95th=[ 877], | 99.99th=[ 877] bw ( KiB/s): min= 15, max= 224, per=25.20%, avg=69.05, stdev=44.24, samples=171 iops : min= 3, max= 56, avg=16.87, stdev=11.22, samples=171 write: IOPS=18, BW=72.2KiB/s (73.0kB/s)(6296KiB/87141msec); 0 zone resets clat (msec): min=13, max=162, avg=36.55, stdev=19.60 lat (msec): min=13, max=162, avg=36.55, stdev=19.60 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 50], 90.00th=[ 60], 95.00th=[ 72], | 99.00th=[ 110], 99.50th=[ 129], 99.90th=[ 161], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 16, max= 176, per=25.28%, avg=72.55, stdev=40.34, samples=171 iops : min= 4, max= 44, avg=17.75, stdev=10.29, samples=171 lat (msec) : 4=6.22%, 10=15.30%, 20=17.61%, 50=47.79%, 100=11.78% lat (msec) : 250=1.27%, 1000=0.03% cpu : usr=0.08%, sys=11.73%, ctx=4557, majf=0, minf=1511 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152975: Wed Aug 13 11:10:10 2025 read: IOPS=16, BW=67.9KiB/s (69.5kB/s)(5940KiB/87512msec) clat (msec): min=2, max=925, avg=19.26, stdev=29.91 lat (msec): min=2, max=925, avg=19.26, stdev=29.91 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 42], 95.00th=[ 56], | 99.00th=[ 88], 99.50th=[ 104], 99.90th=[ 150], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 7, max= 272, per=24.88%, avg=68.18, stdev=46.57, samples=172 iops : min= 1, max= 68, avg=16.66, stdev=11.80, samples=172 write: IOPS=18, BW=72.5KiB/s (74.3kB/s)(6348KiB/87512msec); 0 zone resets clat (msec): min=12, max=180, avg=36.92, stdev=20.22 lat (msec): min=12, max=180, avg=36.92, stdev=20.22 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 74], | 99.00th=[ 108], 99.50th=[ 127], 99.90th=[ 157], 99.95th=[ 182], | 99.99th=[ 182] bw ( KiB/s): min= 23, max= 176, per=25.34%, avg=72.73, stdev=39.82, samples=172 iops : min= 5, max= 44, avg=17.80, stdev=10.16, samples=172 lat (msec) : 4=6.12%, 10=15.30%, 20=18.75%, 50=46.16%, 100=12.43% lat (msec) : 250=1.20%, 1000=0.03% cpu : usr=0.08%, sys=11.84%, ctx=4641, majf=0, minf=1498 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152976: Wed Aug 13 11:10:10 2025 read: IOPS=17, BW=69.4KiB/s (71.1kB/s)(6028KiB/86828msec) clat (msec): min=2, max=105, avg=18.49, stdev=16.81 lat (msec): min=2, max=105, avg=18.50, stdev=16.81 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 9], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 56], | 99.00th=[ 73], 99.50th=[ 84], 99.90th=[ 105], 99.95th=[ 106], | 99.99th=[ 106] bw ( KiB/s): min= 15, max= 248, per=25.54%, avg=69.98, stdev=43.42, samples=171 iops : min= 3, max= 62, avg=17.11, stdev=11.00, samples=171 write: IOPS=18, BW=72.1KiB/s (73.8kB/s)(6260KiB/86828msec); 0 zone resets clat (msec): min=13, max=957, avg=37.47, stdev=30.90 lat (msec): min=13, max=957, avg=37.47, stdev=30.90 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 18], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 42], 80.00th=[ 50], 90.00th=[ 64], 95.00th=[ 77], | 99.00th=[ 120], 99.50th=[ 140], 99.90th=[ 171], 99.95th=[ 961], | 99.99th=[ 961] bw ( KiB/s): min= 15, max= 168, per=25.31%, avg=72.65, stdev=40.14, samples=171 iops : min= 3, max= 42, avg=17.77, stdev=10.24, samples=171 lat (msec) : 4=5.27%, 10=15.76%, 20=19.21%, 50=46.78%, 100=12.08% lat (msec) : 250=0.88%, 1000=0.03% cpu : usr=0.10%, sys=12.11%, ctx=4618, majf=0, minf=1520 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=152979: Wed Aug 13 11:10:10 2025 read: IOPS=17, BW=69.2KiB/s (70.9kB/s)(6052KiB/87401msec) clat (msec): min=2, max=139, avg=18.81, stdev=18.70 lat (msec): min=2, max=139, avg=18.81, stdev=18.70 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 4], 10.00th=[ 4], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 8], 50.00th=[ 14], 60.00th=[ 18], | 70.00th=[ 23], 80.00th=[ 30], 90.00th=[ 43], 95.00th=[ 57], | 99.00th=[ 85], 99.50th=[ 109], 99.90th=[ 134], 99.95th=[ 140], | 99.99th=[ 140] bw ( KiB/s): min= 7, max= 216, per=25.46%, avg=69.76, stdev=44.78, samples=172 iops : min= 1, max= 54, avg=17.05, stdev=11.38, samples=172 write: IOPS=17, BW=71.3KiB/s (73.1kB/s)(6236KiB/87401msec); 0 zone resets clat (msec): min=12, max=939, avg=37.61, stdev=30.68 lat (msec): min=12, max=939, avg=37.61, stdev=30.68 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 17], 10.00th=[ 19], 20.00th=[ 22], | 30.00th=[ 24], 40.00th=[ 27], 50.00th=[ 31], 60.00th=[ 36], | 70.00th=[ 43], 80.00th=[ 51], 90.00th=[ 64], 95.00th=[ 77], | 99.00th=[ 110], 99.50th=[ 133], 99.90th=[ 180], 99.95th=[ 944], | 99.99th=[ 944] bw ( KiB/s): min= 23, max= 176, per=25.00%, avg=71.76, stdev=40.88, samples=172 iops : min= 5, max= 44, avg=17.55, stdev=10.42, samples=172 lat (msec) : 4=6.09%, 10=15.76%, 20=17.90%, 50=46.48%, 100=12.60% lat (msec) : 250=1.14%, 1000=0.03% cpu : usr=0.07%, sys=11.68%, ctx=4642, majf=0, minf=1527 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=274KiB/s (281kB/s), 67.9KiB/s-69.4KiB/s (69.5kB/s-71.1kB/s), io=23.4MiB (24.6MB), run=86828-87512msec WRITE: bw=287KiB/s (294kB/s), 71.3KiB/s-72.5KiB/s (73.1kB/s-74.3kB/s), io=24.6MiB (25.7MB), run=86828-87512msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153008: Wed Aug 13 11:10:31 2025 read: IOPS=24, BW=391KiB/s (401kB/s)(5920KiB/15124msec) clat (usec): min=325, max=81112, avg=20994.80, stdev=12871.79 lat (usec): min=326, max=81112, avg=20995.61, stdev=12871.69 clat percentiles (usec): | 1.00th=[ 351], 5.00th=[ 553], 10.00th=[ 1045], 20.00th=[10814], | 30.00th=[14353], 40.00th=[16581], 50.00th=[19530], 60.00th=[23200], | 70.00th=[26346], 80.00th=[30278], 90.00th=[36439], 95.00th=[44827], | 99.00th=[59507], 99.50th=[67634], 99.90th=[81265], 99.95th=[81265], | 99.99th=[81265] bw ( KiB/s): min= 192, max= 798, per=23.95%, avg=379.21, stdev=149.18, samples=29 iops : min= 12, max= 49, avg=23.14, stdev= 9.38, samples=29 write: IOPS=26, BW=421KiB/s (431kB/s)(6368KiB/15124msec); 0 zone resets clat (usec): min=989, max=76098, avg=18399.94, stdev=14273.45 lat (usec): min=990, max=76101, avg=18401.21, stdev=14273.56 clat percentiles (usec): | 1.00th=[ 2212], 5.00th=[ 4359], 10.00th=[ 4883], 20.00th=[ 6456], | 30.00th=[ 8455], 40.00th=[11469], 50.00th=[13960], 60.00th=[18220], | 70.00th=[22152], 80.00th=[27657], 90.00th=[39060], 95.00th=[49021], | 99.00th=[66847], 99.50th=[74974], 99.90th=[76022], 99.95th=[76022], | 99.99th=[76022] bw ( KiB/s): min= 159, max= 734, per=24.85%, avg=414.03, stdev=149.19, samples=29 iops : min= 9, max= 45, avg=25.31, stdev= 9.34, samples=29 lat (usec) : 500=2.08%, 750=0.78%, 1000=1.95% lat (msec) : 2=0.26%, 4=1.82%, 10=20.05%, 20=31.51%, 50=38.15% lat (msec) : 100=3.39% cpu : usr=0.14%, sys=32.86%, ctx=2725, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153009: Wed Aug 13 11:10:31 2025 read: IOPS=23, BW=381KiB/s (390kB/s)(5744KiB/15084msec) clat (usec): min=163, max=77233, avg=21067.53, stdev=13615.18 lat (usec): min=164, max=77235, avg=21068.25, stdev=13615.25 clat percentiles (usec): | 1.00th=[ 293], 5.00th=[ 570], 10.00th=[ 6063], 20.00th=[11338], | 30.00th=[13960], 40.00th=[16581], 50.00th=[18482], 60.00th=[21365], | 70.00th=[24773], 80.00th=[30540], 90.00th=[40109], 95.00th=[47449], | 99.00th=[69731], 99.50th=[70779], 99.90th=[77071], 99.95th=[77071], | 99.99th=[77071] bw ( KiB/s): min= 159, max= 640, per=23.79%, avg=376.55, stdev=117.84, samples=29 iops : min= 9, max= 40, avg=22.97, stdev= 7.49, samples=29 write: IOPS=27, BW=434KiB/s (444kB/s)(6544KiB/15084msec); 0 zone resets clat (usec): min=1086, max=138358, avg=18248.67, stdev=14642.79 lat (usec): min=1087, max=138360, avg=18251.66, stdev=14641.52 clat percentiles (msec): | 1.00th=[ 3], 5.00th=[ 5], 10.00th=[ 5], 20.00th=[ 7], | 30.00th=[ 10], 40.00th=[ 12], 50.00th=[ 15], 60.00th=[ 18], | 70.00th=[ 22], 80.00th=[ 28], 90.00th=[ 38], 95.00th=[ 44], | 99.00th=[ 69], 99.50th=[ 73], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 190, max= 702, per=25.48%, avg=424.41, stdev=165.25, samples=29 iops : min= 11, max= 43, avg=25.97, stdev=10.38, samples=29 lat (usec) : 250=0.26%, 500=1.69%, 750=1.17%, 1000=0.78% lat (msec) : 2=0.65%, 4=2.21%, 10=18.88%, 20=35.03%, 50=35.81% lat (msec) : 100=3.39%, 250=0.13% cpu : usr=0.12%, sys=33.24%, ctx=2717, majf=0, minf=18 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153010: Wed Aug 13 11:10:31 2025 read: IOPS=25, BW=415KiB/s (425kB/s)(6256KiB/15077msec) clat (usec): min=158, max=139970, avg=20914.85, stdev=14565.75 lat (usec): min=158, max=139971, avg=20915.64, stdev=14565.81 clat percentiles (usec): | 1.00th=[ 285], 5.00th=[ 586], 10.00th=[ 5800], 20.00th=[ 10945], | 30.00th=[ 13960], 40.00th=[ 16909], 50.00th=[ 18744], 60.00th=[ 21627], | 70.00th=[ 24249], 80.00th=[ 29230], 90.00th=[ 36439], 95.00th=[ 44827], | 99.00th=[ 61604], 99.50th=[111674], 99.90th=[139461], 99.95th=[139461], | 99.99th=[139461] bw ( KiB/s): min= 127, max= 766, per=26.14%, avg=413.76, stdev=156.92, samples=29 iops : min= 7, max= 47, avg=25.31, stdev= 9.83, samples=29 write: IOPS=25, BW=400KiB/s (410kB/s)(6032KiB/15077msec); 0 zone resets clat (usec): min=1068, max=70650, avg=18165.48, stdev=14403.08 lat (usec): min=1069, max=70651, avg=18166.91, stdev=14403.42 clat percentiles (usec): | 1.00th=[ 2180], 5.00th=[ 4113], 10.00th=[ 4752], 20.00th=[ 6194], | 30.00th=[ 8717], 40.00th=[10683], 50.00th=[13435], 60.00th=[17171], | 70.00th=[21627], 80.00th=[29230], 90.00th=[39060], 95.00th=[48497], | 99.00th=[68682], 99.50th=[70779], 99.90th=[70779], 99.95th=[70779], | 99.99th=[70779] bw ( KiB/s): min= 159, max= 640, per=23.41%, avg=389.97, stdev=155.72, samples=29 iops : min= 9, max= 40, avg=23.83, stdev= 9.82, samples=29 lat (usec) : 250=0.26%, 500=1.56%, 750=1.82%, 1000=0.91% lat (msec) : 2=0.78%, 4=1.82%, 10=18.75%, 20=35.03%, 50=35.68% lat (msec) : 100=3.12%, 250=0.26% cpu : usr=0.11%, sys=33.20%, ctx=2683, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153011: Wed Aug 13 11:10:31 2025 read: IOPS=25, BW=400KiB/s (410kB/s)(6032KiB/15079msec) clat (usec): min=91, max=150438, avg=20616.39, stdev=15463.93 lat (usec): min=91, max=150439, avg=20617.11, stdev=15463.98 clat percentiles (usec): | 1.00th=[ 202], 5.00th=[ 449], 10.00th=[ 906], 20.00th=[ 10552], | 30.00th=[ 12518], 40.00th=[ 15401], 50.00th=[ 18482], 60.00th=[ 21103], | 70.00th=[ 25035], 80.00th=[ 28967], 90.00th=[ 38536], 95.00th=[ 47973], | 99.00th=[ 70779], 99.50th=[ 86508], 99.90th=[149947], 99.95th=[149947], | 99.99th=[149947] bw ( KiB/s): min= 159, max= 702, per=24.55%, avg=388.66, stdev=136.99, samples=29 iops : min= 9, max= 43, avg=23.72, stdev= 8.67, samples=29 write: IOPS=25, BW=415KiB/s (425kB/s)(6256KiB/15079msec); 0 zone resets clat (usec): min=1091, max=93816, avg=18586.94, stdev=13962.98 lat (usec): min=1092, max=93818, avg=18588.51, stdev=13962.99 clat percentiles (usec): | 1.00th=[ 1614], 5.00th=[ 4146], 10.00th=[ 4948], 20.00th=[ 6849], | 30.00th=[ 9634], 40.00th=[11863], 50.00th=[15008], 60.00th=[18482], | 70.00th=[21890], 80.00th=[28443], 90.00th=[36439], 95.00th=[47449], | 99.00th=[71828], 99.50th=[81265], 99.90th=[93848], 99.95th=[93848], | 99.99th=[93848] bw ( KiB/s): min= 191, max= 704, per=24.33%, avg=405.34, stdev=136.67, samples=29 iops : min= 11, max= 44, avg=24.79, stdev= 8.57, samples=29 lat (usec) : 100=0.26%, 250=0.52%, 500=1.82%, 750=1.17%, 1000=1.43% lat (msec) : 2=1.56%, 4=1.69%, 10=16.80%, 20=34.90%, 50=36.33% lat (msec) : 100=3.39%, 250=0.13% cpu : usr=0.13%, sys=32.88%, ctx=2621, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1584KiB/s (1622kB/s), 381KiB/s-415KiB/s (390kB/s-425kB/s), io=23.4MiB (24.5MB), run=15077-15124msec WRITE: bw=1666KiB/s (1706kB/s), 400KiB/s-434KiB/s (410kB/s-444kB/s), io=24.6MiB (25.8MB), run=15077-15124msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153013: Wed Aug 13 11:10:38 2025 read: IOPS=16, BW=271KiB/s (278kB/s)(5920KiB/21829msec) clat (msec): min=2, max=110, avg=18.54, stdev=19.18 lat (msec): min=2, max=110, avg=18.54, stdev=19.18 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 16], | 70.00th=[ 22], 80.00th=[ 31], 90.00th=[ 43], 95.00th=[ 65], | 99.00th=[ 92], 99.50th=[ 109], 99.90th=[ 111], 99.95th=[ 111], | 99.99th=[ 111] bw ( KiB/s): min= 63, max= 640, per=24.61%, avg=268.79, stdev=144.59, samples=43 iops : min= 3, max= 40, avg=16.28, stdev= 9.30, samples=43 write: IOPS=18, BW=292KiB/s (299kB/s)(6368KiB/21829msec); 0 zone resets clat (msec): min=13, max=141, avg=37.44, stdev=18.50 lat (msec): min=13, max=141, avg=37.44, stdev=18.50 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 32], 60.00th=[ 35], | 70.00th=[ 40], 80.00th=[ 48], 90.00th=[ 64], 95.00th=[ 80], | 99.00th=[ 104], 99.50th=[ 125], 99.90th=[ 142], 99.95th=[ 142], | 99.99th=[ 142] bw ( KiB/s): min= 95, max= 608, per=25.31%, avg=290.86, stdev=147.09, samples=43 iops : min= 5, max= 38, avg=17.65, stdev= 9.55, samples=43 lat (msec) : 4=4.17%, 10=20.31%, 20=11.07%, 50=51.82%, 100=11.72% lat (msec) : 250=0.91% cpu : usr=0.08%, sys=11.14%, ctx=1178, majf=0, minf=1492 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153014: Wed Aug 13 11:10:38 2025 read: IOPS=16, BW=262KiB/s (268kB/s)(5744KiB/21921msec) clat (msec): min=3, max=106, avg=17.82, stdev=18.35 lat (msec): min=3, max=106, avg=17.82, stdev=18.35 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 6], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 10], 60.00th=[ 14], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 44], 95.00th=[ 63], | 99.00th=[ 84], 99.50th=[ 96], 99.90th=[ 107], 99.95th=[ 107], | 99.99th=[ 107] bw ( KiB/s): min= 63, max= 672, per=23.85%, avg=260.47, stdev=161.42, samples=43 iops : min= 3, max= 42, avg=15.77, stdev=10.37, samples=43 write: IOPS=18, BW=299KiB/s (306kB/s)(6544KiB/21921msec); 0 zone resets clat (msec): min=14, max=137, avg=37.80, stdev=18.36 lat (msec): min=14, max=137, avg=37.80, stdev=18.36 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 25], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 32], 60.00th=[ 37], | 70.00th=[ 41], 80.00th=[ 51], 90.00th=[ 62], 95.00th=[ 78], | 99.00th=[ 102], 99.50th=[ 113], 99.90th=[ 138], 99.95th=[ 138], | 99.99th=[ 138] bw ( KiB/s): min= 95, max= 672, per=25.62%, avg=294.35, stdev=137.94, samples=43 iops : min= 5, max= 42, avg=17.88, stdev= 8.95, samples=43 lat (msec) : 4=4.17%, 10=20.70%, 20=10.42%, 50=50.78%, 100=13.15% lat (msec) : 250=0.78% cpu : usr=0.08%, sys=11.11%, ctx=1213, majf=0, minf=1446 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153015: Wed Aug 13 11:10:38 2025 read: IOPS=18, BW=293KiB/s (300kB/s)(6256KiB/21335msec) clat (msec): min=2, max=120, avg=18.05, stdev=20.13 lat (msec): min=2, max=120, avg=18.05, stdev=20.13 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 6], 40.00th=[ 7], 50.00th=[ 11], 60.00th=[ 14], | 70.00th=[ 20], 80.00th=[ 28], 90.00th=[ 43], 95.00th=[ 61], | 99.00th=[ 106], 99.50th=[ 116], 99.90th=[ 121], 99.95th=[ 121], | 99.99th=[ 121] bw ( KiB/s): min= 95, max= 1056, per=27.02%, avg=295.10, stdev=195.60, samples=42 iops : min= 5, max= 66, avg=17.90, stdev=12.49, samples=42 write: IOPS=17, BW=283KiB/s (290kB/s)(6032KiB/21335msec); 0 zone resets clat (msec): min=14, max=154, avg=37.61, stdev=17.86 lat (msec): min=14, max=154, avg=37.61, stdev=17.86 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 19], 10.00th=[ 21], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 37], | 70.00th=[ 42], 80.00th=[ 48], 90.00th=[ 61], 95.00th=[ 71], | 99.00th=[ 104], 99.50th=[ 115], 99.90th=[ 155], 99.95th=[ 155], | 99.99th=[ 155] bw ( KiB/s): min= 95, max= 608, per=24.40%, avg=280.40, stdev=139.56, samples=42 iops : min= 5, max= 38, avg=17.00, stdev= 9.06, samples=42 lat (msec) : 4=4.17%, 10=21.22%, 20=15.23%, 50=47.01%, 100=11.07% lat (msec) : 250=1.30% cpu : usr=0.09%, sys=11.15%, ctx=1219, majf=0, minf=1577 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153016: Wed Aug 13 11:10:38 2025 read: IOPS=17, BW=275KiB/s (282kB/s)(6032KiB/21909msec) clat (msec): min=2, max=117, avg=18.12, stdev=19.02 lat (msec): min=2, max=117, avg=18.12, stdev=19.02 clat percentiles (msec): | 1.00th=[ 4], 5.00th=[ 4], 10.00th=[ 5], 20.00th=[ 5], | 30.00th=[ 7], 40.00th=[ 8], 50.00th=[ 11], 60.00th=[ 15], | 70.00th=[ 21], 80.00th=[ 29], 90.00th=[ 40], 95.00th=[ 61], | 99.00th=[ 99], 99.50th=[ 105], 99.90th=[ 118], 99.95th=[ 118], | 99.99th=[ 118] bw ( KiB/s): min= 95, max= 768, per=24.99%, avg=272.86, stdev=152.61, samples=43 iops : min= 5, max= 48, avg=16.53, stdev= 9.82, samples=43 write: IOPS=17, BW=286KiB/s (292kB/s)(6256KiB/21909msec); 0 zone resets clat (msec): min=13, max=151, avg=38.36, stdev=19.26 lat (msec): min=13, max=151, avg=38.36, stdev=19.26 clat percentiles (msec): | 1.00th=[ 16], 5.00th=[ 20], 10.00th=[ 22], 20.00th=[ 24], | 30.00th=[ 27], 40.00th=[ 30], 50.00th=[ 34], 60.00th=[ 37], | 70.00th=[ 42], 80.00th=[ 49], 90.00th=[ 61], 95.00th=[ 77], | 99.00th=[ 103], 99.50th=[ 138], 99.90th=[ 153], 99.95th=[ 153], | 99.99th=[ 153] bw ( KiB/s): min= 95, max= 544, per=24.59%, avg=282.51, stdev=139.14, samples=43 iops : min= 5, max= 34, avg=17.14, stdev= 9.03, samples=43 lat (msec) : 4=4.69%, 10=19.27%, 20=13.41%, 50=49.87%, 100=11.85% lat (msec) : 250=0.91% cpu : usr=0.06%, sys=11.37%, ctx=1212, majf=0, minf=1520 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=1093KiB/s (1119kB/s), 262KiB/s-293KiB/s (268kB/s-300kB/s), io=23.4MiB (24.5MB), run=21335-21921msec WRITE: bw=1150KiB/s (1177kB/s), 283KiB/s-299KiB/s (290kB/s-306kB/s), io=24.6MiB (25.8MB), run=21335-21921msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153026: Wed Aug 13 11:10:47 2025 read: IOPS=2, BW=2771KiB/s (2837kB/s)(7168KiB/2587msec) clat (msec): min=141, max=195, avg=165.14, stdev=22.77 lat (msec): min=141, max=195, avg=165.14, stdev=22.77 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 144], | 30.00th=[ 144], 40.00th=[ 144], 50.00th=[ 171], 60.00th=[ 176], | 70.00th=[ 176], 80.00th=[ 188], 90.00th=[ 197], 95.00th=[ 197], | 99.00th=[ 197], 99.50th=[ 197], 99.90th=[ 197], 99.95th=[ 197], | 99.99th=[ 197] bw ( KiB/s): min= 2023, max= 5667, per=65.56%, avg=3925.67, stdev=1827.35, samples=3 iops : min= 1, max= 5, avg= 3.00, stdev= 2.00, samples=3 write: IOPS=1, BW=1979KiB/s (2027kB/s)(5120KiB/2587msec); 0 zone resets clat (msec): min=104, max=578, avg=280.17, stdev=178.70 lat (msec): min=104, max=578, avg=280.23, stdev=178.67 clat percentiles (msec): | 1.00th=[ 105], 5.00th=[ 105], 10.00th=[ 105], 20.00th=[ 105], | 30.00th=[ 201], 40.00th=[ 201], 50.00th=[ 243], 60.00th=[ 243], | 70.00th=[ 275], 80.00th=[ 275], 90.00th=[ 575], 95.00th=[ 575], | 99.00th=[ 575], 99.50th=[ 575], 99.90th=[ 575], 99.95th=[ 575], | 99.99th=[ 575] bw ( KiB/s): min= 2023, max= 3976, per=30.03%, avg=2517.25, stdev=972.54, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 250=83.33%, 500=8.33%, 750=8.33% cpu : usr=0.00%, sys=52.59%, ctx=919, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153027: Wed Aug 13 11:10:47 2025 read: IOPS=0, BW=599KiB/s (613kB/s)(2048KiB/3420msec) clat (msec): min=157, max=173, avg=165.57, stdev=10.76 lat (msec): min=157, max=173, avg=165.57, stdev=10.76 clat percentiles (msec): | 1.00th=[ 159], 5.00th=[ 159], 10.00th=[ 159], 20.00th=[ 159], | 30.00th=[ 159], 40.00th=[ 159], 50.00th=[ 159], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 174], 90.00th=[ 174], 95.00th=[ 174], | 99.00th=[ 174], 99.50th=[ 174], 99.90th=[ 174], 99.95th=[ 174], | 99.99th=[ 174] bw ( KiB/s): min= 1921, max= 1988, per=32.64%, avg=1954.50, stdev=47.38, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2994KiB/s (3066kB/s)(10.0MiB/3420msec); 0 zone resets clat (msec): min=124, max=547, avg=306.04, stdev=184.41 lat (msec): min=124, max=547, avg=306.10, stdev=184.42 clat percentiles (msec): | 1.00th=[ 125], 5.00th=[ 125], 10.00th=[ 125], 20.00th=[ 138], | 30.00th=[ 148], 40.00th=[ 148], 50.00th=[ 157], 60.00th=[ 300], | 70.00th=[ 477], 80.00th=[ 485], 90.00th=[ 542], 95.00th=[ 550], | 99.00th=[ 550], 99.50th=[ 550], 99.90th=[ 550], 99.95th=[ 550], | 99.99th=[ 550] bw ( KiB/s): min= 2027, max= 6131, per=43.46%, avg=3643.20, stdev=1707.44, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (msec) : 250=58.33%, 500=25.00%, 750=16.67% cpu : usr=0.00%, sys=48.82%, ctx=148, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153028: Wed Aug 13 11:10:47 2025 read: IOPS=2, BW=2293KiB/s (2348kB/s)(6144KiB/2679msec) clat (usec): min=730, max=357418, avg=130763.40, s rand-rw: (groupid=0, jobs=1): err= 0: pid=153029: Wed Aug 13 11:10:47 2025 read: IOPS=1, BW=2037KiB/s (2086kB/s)(7168KiB/3519msec) clat (msec): min=109, max=446, avg=253.52, stdev=130.62 lat (msec): min=109, max=446, avg=253.52, stdev=130.62 clat percentiles (msec): | 1.00th=[ 109], 5.00th=[ 109], 10.00th=[ 109], 20.00th=[ 123], | 30.00th=[ 178], 40.00th=[ 178], 50.00th=[ 257], 60.00th=[ 266], | 70.00th=[ 266], 80.00th=[ 397], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 1969, max= 3923, per=43.24%, avg=2495.75, stdev=952.19, samples=4 iops : min= 1, max= 3, avg= 1.75, stdev= 0.96, samples=4 write: IOPS=1, BW=1455KiB/s (1490kB/s)(5120KiB/3519msec); 0 zone resets clat (msec): min=194, max=530, avg=338.64, stdev=141.14 lat (msec): min=194, max=530, avg=338.71, stdev=141.14 clat percentiles (msec): | 1.00th=[ 194], 5.00th=[ 194], 10.00th=[ 194], 20.00th=[ 194], | 30.00th=[ 249], 40.00th=[ 249], 50.00th=[ 279], 60.00th=[ 279], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 531], 95.00th=[ 531], | 99.00th=[ 531], 99.50th=[ 531], 99.90th=[ 531], 99.95th=[ 531], | 99.99th=[ 531] bw ( KiB/s): min= 2035, max= 4047, per=33.51%, avg=2708.33, stdev=1159.33, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=41.67%, 500=50.00%, 750=8.33% cpu : usr=0.00%, sys=20.04%, ctx=126, majf=0, minf=1804 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153031: Wed Aug 13 11:10:47 2025 read: IOPS=0, BW=577KiB/s (591kB/s)(2048KiB/3548msec) clat (msec): min=82, max=325, avg=204.04, stdev=172.17 lat (msec): min=82, max=325, avg=204.04, stdev=172.17 clat percentiles (msec): | 1.00th=[ 83], 5.00th=[ 83], 10.00th=[ 83], 20.00th=[ 83], | 30.00th=[ 83], 40.00th=[ 83], 50.00th=[ 83], 60.00th=[ 326], | 70.00th=[ 326], 80.00th=[ 326], 90.00th=[ 326], 95.00th=[ 326], | 99.00th=[ 326], 99.50th=[ 326], 99.90th=[ 326], 99.95th=[ 326], | 99.99th=[ 326] bw ( KiB/s): min= 1996, max= 2023, per=34.81%, avg=2009.50, stdev=19.09, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2886KiB/s (2955kB/s)(10.0MiB/3548msec); 0 zone resets clat (msec): min=74, max=848, avg=307.49, stdev=241.62 lat (msec): min=74, max=848, avg=307.56, stdev=241.62 clat percentiles (msec): | 1.00th=[ 74], 5.00th=[ 74], 10.00th=[ 74], 20.00th=[ 82], | 30.00th=[ 165], 40.00th=[ 194], 50.00th=[ 197], 60.00th=[ 213], | 70.00th=[ 317], 80.00th=[ 451], 90.00th=[ 535], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1961, max= 6131, per=43.85%, avg=3543.50, stdev=1977.25, samples=4 iops : min= 1, max= 5, avg= 2.50, stdev= 1.91, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=25.00%, 750=8.33%, 1000=8.33% cpu : usr=0.00%, sys=21.12%, ctx=507, majf=0, minf=524 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153032: Wed Aug 13 11:10:47 2025 read: IOPS=2, BW=2065KiB/s (2114kB/s)(6144KiB/2976msec) clat (msec): min=67, matdev=136754.51 lat (usec): min=731, max=357419, avg=130764.12, stdev=136754.70 clat percentiles (usec): | 1.00th=[ 734], 5.00th=[ 734], 10.00th=[ 734], 20.00th=[ 734], | 30.00th=[ 734], 40.00th=[ 78119], 50.00th=[ 78119], 60.00th=[143655], | 70.00th=[204473], 80.00th=[204473], 90.00th=[358613], 95.00th=[358613], | 99.00th=[358613], 99.50th=[358613], 99.90th=[358613], 99.95th=[358613], | 99.99th=[358613] bw ( KiB/s): min= 2023, max= 4087, per=56.15%, avg=3362.00, stdev=1160.94, samples=3 iops : min= 1, max= 3, avg= 2.33, stdev= 1.15, samples=3 write: IOPS=2, BW=2293KiB/s (2348kB/s)(6144KiB/2679msec); 0 zone resets clat (msec): min=133, max=586, avg=313.56, stdev=167.95 lat (msec): min=133, max=586, avg=313.61, stdev=167.93 clat percentiles (msec): | 1.00th=[ 134], 5.00th=[ 134], 10.00th=[ 134], 20.00th=[ 197], | 30.00th=[ 197], 40.00th=[ 211], 50.00th=[ 211], 60.00th=[ 351], | 70.00th=[ 405], 80.00th=[ 405], 90.00th=[ 584], 95.00th=[ 584], | 99.00th=[ 584], 99.50th=[ 584], 99.90th=[ 584], 99.95th=[ 584], | 99.99th=[ 584] bw ( KiB/s): min= 2027, max= 4047, per=35.45%, avg=2972.00, stdev=1087.83, samples=4 iops : min= 1, max= 3, avg= 2.00, stdev= 1.15, samples=4 lat (usec) : 750=16.67% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.00%, sys=36.22%, ctx=450, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153030: Wed Aug 13 11:10:47 2025 read: IOPS=1, BW=1775KiB/s (1818kB/s)(5120KiB/2884msec) clat (usec): min=791, max=108335, avg=39107.55, stdev=43982.23 lat (usec): min=792, max=108336, avg=39108.50, stdev=43982.31 clat percentiles (usec): | 1.00th=[ 791], 5.00th=[ 791], 10.00th=[ 791], 20.00th=[ 791], | 30.00th=[ 1303], 40.00th=[ 1303], 50.00th=[ 39060], 60.00th=[ 39060], | 70.00th=[ 45876], 80.00th=[ 45876], 90.00th=[108528], 95.00th=[108528], | 99.00th=[108528], 99.50th=[108528], 99.90th=[108528], 99.95th=[108528], | 99.99th=[108528] bw ( KiB/s): min= 7953, max= 7953, per=100.00%, avg=7953.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=2, BW=2485KiB/s (2545kB/s)(7168KiB/2884msec); 0 zone resets clat (msec): min=213, max=759, avg=375.49, stdev=181.52 lat (msec): min=214, max=759, avg=375.56, stdev=181.52 clat percentiles (msec): | 1.00th=[ 215], 5.00th=[ 215], 10.00th=[ 215], 20.00th=[ 257], | 30.00th=[ 284], 40.00th=[ 284], 50.00th=[ 351], 60.00th=[ 372], | 70.00th=[ 372], 80.00th=[ 393], 90.00th=[ 760], 95.00th=[ 760], | 99.00th=[ 760], 99.50th=[ 760], 99.90th=[ 760], 99.95th=[ 760], | 99.99th=[ 760] bw ( KiB/s): min= 1957, max= 3976, per=29.77%, avg=2495.75, stdev=987.36, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 1000=8.33% lat (msec) : 2=8.33%, 50=16.67%, 250=16.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=33.58%, ctx=163, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5988KiB/s (6132kB/s), 599KiB/s-2771KiB/s (613kB/s-2837kB/s), io=20.0MiB (20.0MB), run=2587-3420msec WRITE: bw=8384KiB/s (8585kB/s), 1979KiB/s-2994KiB/s (2027kB/s-3066kB/x=226, avg=107.94, stdev=60.83 s), io=28.0MiB (29.4MB), run=2587-3420msec lat (msec): min=67, max=226, avg=107.95, stdev=60.83 clat percentiles (msec): | 1.00th=[ 67], 5.00th=[ 67], 10.00th=[ 67], 20.00th=[ 73], | 30.00th=[ 73], 40.00th=[ 74], 50.00th=[ 74], 60.00th=[ 91], | 70.00th=[ 116], 80.00th=[ 116], 90.00th=[ 228], 95.00th=[ 228], | 99.00th=[ 228], 99.50th=[ 228], 99.90th=[ 228], 99.95th=[ 228], | 99.99th=[ 228] bw ( KiB/s): min= 2023, max= 5885, per=68.50%, avg=3954.00, stdev=2730.85, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2065KiB/s (2114kB/s)(6144KiB/2976msec); 0 zone resets clat (msec): min=121, max=930, avg=378.88, stdev=303.39 lat (msec): min=121, max=930, avg=378.96, stdev=303.39 clat percentiles (msec): | 1.00th=[ 122], 5.00th=[ 122], 10.00th=[ 122], 20.00th=[ 186], | 30.00th=[ 186], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 334], | 70.00th=[ 506], 80.00th=[ 506], 90.00th=[ 927], 95.00th=[ 927], | 99.00th=[ 927], 99.50th=[ 927], 99.90th=[ 927], 99.95th=[ 927], | 99.99th=[ 927] bw ( KiB/s): min= 1961, max= 4015, per=33.08%, avg=2673.00, stdev=1162.93, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 100=33.33%, 250=41.67%, 500=8.33%, 750=8.33%, 1000=8.33% cpu : usr=0.03%, sys=19.66%, ctx=235, majf=0, minf=1547 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153033: Wed Aug 13 11:10:47 2025 read: IOPS=1, BW=1481KiB/s (1517kB/s)(5120KiB/3457msec) clat (msec): min=74, max=295, avg=169.37, stdev=94.56 lat (msec): min=74, max=295, avg=169.37, stdev=94.56 clat percentiles (msec): | 1.00th=[ 75], 5.00th=[ 75], 10.00th=[ 75], 20.00th=[ 75], | 30.00th=[ 111], 40.00th=[ 111], 50.00th=[ 124], 60.00th=[ 124], | 70.00th=[ 243], 80.00th=[ 243], 90.00th=[ 296], 95.00th=[ 296], | 99.00th=[ 296], 99.50th=[ 296], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 3923, max= 4087, per=69.39%, avg=4005.00, stdev=115.97, samples=2 iops : min= 3, max= 3, avg= 3.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2073KiB/s (2123kB/s)(7168KiB/3457msec); 0 zone resets clat (msec): min=173, max=786, avg=370.46, stdev=208.30 lat (msec): min=173, max=786, avg=370.54, stdev=208.30 clat percentiles (msec): | 1.00th=[ 174], 5.00th=[ 174], 10.00th=[ 174], 20.00th=[ 190], | 30.00th=[ 296], 40.00th=[ 296], 50.00th=[ 305], 60.00th=[ 405], | 70.00th=[ 405], 80.00th=[ 439], 90.00th=[ 785], 95.00th=[ 785], | 99.00th=[ 785], 99.50th=[ 785], 99.90th=[ 785], 99.95th=[ 785], | 99.99th=[ 785] bw ( KiB/s): min= 2011, max= 4096, per=31.51%, avg=2546.25, stdev=1033.26, samples=4 iops : min= 1, max= 4, avg= 1.75, stdev= 1.50, samples=4 lat (msec) : 100=8.33%, 250=41.67%, 500=41.67%, 1000=8.33% cpu : usr=0.00%, sys=18.46%, ctx=236, majf=0, minf=1293 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=5772KiB/s (5911kB/s), 577KiB/s-2065KiB/s (591kB/s-2114kB/s), io=20.0MiB (20.0MB), run=2976-3548msec WRITE: bw=8081KiB/s (8275kB/s), 1455KiB/s-2886KiB/s (1490kB/s-2955kB/s), io=28.0MiB (29.4MB), run=2976-3548msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=153043: Wed Aug 13 11:10:58 2025 read: IOPS=1, BW=7548KiB/s (7729kB/s)(12.0MiB/1628msec) clat (msec): min=365, max=592, avg=511.05, stdev=126.65 lat (msec): min=365, max=592, avg=511.06, stdev=126.65 clat percentiles (msec): | 1.00th=[ 368], 5.00th=[ 368], 10.00th=[ 368], 20.00th=[ 368], | 30.00th=[ 368], 40.00th=[ 575], 50.00th=[ 575], 60.00th=[ 575], | 70.00th=[ 592], 80.00th=[ 592], 90.00th=[ 592], 95.00th=[ 592], | 99.00th=[ 592], 99.50th=[ 592], 99.90th=[ 592], 99.95th=[ 592], | 99.99th=[ 592] bw ( KiB/s): min= 7627, max= 7742, per=100.00%, avg=7684.50, stdev=81.32, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=66.67% cpu : usr=0.00%, sys=55.19%, ctx=1252, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153044: Wed Aug 13 11:10:58 2025 read: IOPS=0, BW=1186KiB/s (1215kB/s)(4096KiB/3453msec) clat (nsec): min=445613k, max=445613k, avg=445612650.00, stdev= 0.00 lat (nsec): min=445615k, max=445615k, avg=445615259.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 447], 5.00th=[ 447], 10.00th=[ 447], 20.00th=[ 447], | 30.00th=[ 447], 40.00th=[ 447], 50.00th=[ 447], 60.00th=[ 447], | 70.00th=[ 447], 80.00th=[ 447], 90.00th=[ 447], 95.00th=[ 447], | 99.00th=[ 447], 99.50th=[ 447], 99.90th=[ 447], 99.95th=[ 447], | 99.99th=[ 447] bw ( KiB/s): min= 7288, max= 7288, per=100.00%, avg=7288.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2372KiB/s (2429kB/s)(8192KiB/3453msec); 0 zone resets clat (msec): min=1388, max=1579, avg=1484.05, stdev=134.72 lat (msec): min=1389, max=1579, avg=1484.35, stdev=134.73 clat percentiles (msec): | 1.00th=[ 1385], 5.00th=[ 1385], 10.00th=[ 1385], 20.00th=[ 1385], | 30.00th=[ 1385], 40.00th=[ 1385], 50.00th=[ 1385], 60.00th=[ 1586], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 8192, max= 8192, per=86.33%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=31.87%, ctx=930, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153045: Wed Aug 13 11:10:58 2025 write: IOPS=0, BW=3974KiB/s (4070kB/s)(12.0MiB/3092msec); 0 zone resets clat (msec): min=514, max=1307, avg=1000.06, stdev=425.69 lat (msec): min=514, max=1307, avg=1000.31, stdev=425.63 clat percentiles (msec): | 1.00th=[ 514], 5.00th=[ 514], 10.00th=[ 514], 20.00th=[ 514], | 30.00th=[ 514], 40.00th=[ 1183], 50.00th=[ 1183], 60.00th=[ 1183], | 70.00th=[ 1301], 80.00th=[ 1301], 90.00th=[ 1301], 95.00th=[ 1301], | 99.00th=[ 1301], 99.50th=[ 1301], 99.90th=[ 1301], 99.95th=[ 1301], | 99.99th=[ 1301] bw ( KiB/s): min= 7742, max= 8192, per=83.96%, avg=7967.00, stdev=318.20, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 2000=66.67% cpu : usr=0.00%, sys=44.78%, ctx=301, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153046: Wed Aug 13 11:10:58 2025 write: IOPS=1, BW=4382KiB/s (4487kB/s)(12.0MiB/2804msec); 0 zone resets clat (msec): min=723, max=1199, avg=909.56, stdev=254.25 lat (msec): min=723, max=1199, avg=909.81, stdev=254.28 clat percentiles (msec): | 1.00th=[ 726], 5.00th=[ 726], 10.00th=[ 726], 20.00th=[ 726], | 30.00th=[ 726], 40.00th=[ 810], 50.00th=[ 810], 60.00th=[ 810], | 70.00th=[ 1200], 80.00th=[ 1200], 90.00th=[ 1200], 95.00th=[ 1200], | 99.00th=[ 1200], 99.50th=[ 1200], 99.90th=[ 1200], 99.95th=[ 1200], | 99.99th=[ 1200] bw ( KiB/s): min= 8078, max= 8192, per=85.73%, avg=8135.00, stdev=80.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=56.72%, ctx=179, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4745KiB/s (4859kB/s), 1186KiB/s-7548KiB/s (1215kB/s-7729kB/s), io=16.0MiB (16.8MB), run=1628-3453msec WRITE: bw=9490KiB/s (9717kB/s), 2372KiB/s-4382KiB/s (2429kB/s-4487kB/s), io=32.0MiB (33.6MB), run=2804-3453msec rand-rw: (groupid=0, jobs=1): err= 0: pid=153038: Wed Aug 13 11:10:59 2025 read: IOPS=1, BW=5034KiB/s (5155kB/s)(12.0MiB/2441msec) clat (msec): min=563, max=1247, avg=802.92, stdev=385.35 lat (msec): min=563, max=1247, avg=802.92, stdev=385.35 clat percentiles (msec): | 1.00th=[ 567], 5.00th=[ 567], 10.00th=[ 567], 20.00th=[ 567], | 30.00th=[ 567], 40.00th=[ 600], 50.00th=[ 600], 60.00th=[ 600], | 70.00th=[ 1250], 80.00th=[ 1250], 90.00th=[ 1250], 95.00th=[ 1250], | 99.00th=[ 1250], 99.50th=[ 1250], 99.90th=[ 1250], 99.95th=[ 1250], | 99.99th=[ 1250] bw ( KiB/s): min= 8192, max= 8192, per=100.00%, avg=8192.00, stdev= 0.00, samples=2 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.04%, sys=15.25%, ctx=135, majf=0, minf=3079 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153039: Wed Aug 13 11:10:59 2025 read: IOPS=0, BW=1102KiB/s (1128kB/s)(4096KiB/3717msec) clat (nsec): min=162396k, max=162396k, avg=162396453.00, stdev= 0.00 lat (nsec): min=162400k, max=162400k, avg=162399588.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 163], 5.00th=[ 163], 10.00th=[ 163], 20.00th=[ 163], | 30.00th=[ 163], 40.00th=[ 163], 50.00th=[ 163], 60.00th=[ 163], | 70.00th=[ 163], 80.00th=[ 163], 90.00th=[ 163], 95.00th=[ 163], | 99.00th=[ 163], 99.50th=[ 163], 99.90th=[ 163], 99.95th=[ 163], | 99.99th=[ 163] bw ( KiB/s): min= 7160, max= 7160, per=100.00%, avg=7160.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=2204KiB/s (2257kB/s)(8192KiB/3717msec); 0 zone resets clat (msec): min=1147, max=2367, avg=1757.48, stdev=863.10 lat (msec): min=1147, max=2368, avg=1757.75, stdev=863.11 clat percentiles (msec): | 1.00th=[ 1150], 5.00th=[ 1150], 10.00th=[ 1150], 20.00th=[ 1150], | 30.00th=[ 1150], 40.00th=[ 1150], 50.00th=[ 1150], 60.00th=[ 2366], | 70.00th=[ 2366], 80.00th=[ 2366], 90.00th=[ 2366], 95.00th=[ 2366], | 99.00th=[ 2366], 99.50th=[ 2366], 99.90th=[ 2366], 99.95th=[ 2366], | 99.99th=[ 2366] bw ( KiB/s): min= 8192, max= 8192, per=92.93%, avg=8192.00, stdev= 0.00, samples=1 iops : min= 2, max= 2, avg= 2.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 2000=33.33%, >=2000=33.33% cpu : usr=0.03%, sys=11.38%, ctx=105, majf=0, minf=1033 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153040: Wed Aug 13 11:10:59 2025 write: IOPS=0, BW=3496KiB/s (3580kB/s)(12.0MiB/3515msec); 0 zone resets clat (msec): min=470, max=1916, avg=1157.77, stdev=726.05 lat (msec): min=470, max=1917, avg=1158.01, stdev=726.02 clat percentiles (msec): | 1.00th=[ 472], 5.00th=[ 472], 10.00th=[ 472], 20.00th=[ 472], | 30.00th=[ 472], 40.00th=[ 1083], 50.00th=[ 1083], 60.00th=[ 1083], | 70.00th=[ 1921], 80.00th=[ 1921], 90.00th=[ 1921], 95.00th=[ 1921], | 99.00th=[ 1921], 99.50th=[ 1921], 99.90th=[ 1921], 99.95th=[ 1921], | 99.99th=[ 1921] bw ( KiB/s): min= 8175, max= 8192, per=92.84%, avg=8183.50, stdev=12.02, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=33.33%, 2000=66.67% cpu : usr=0.00%, sys=22.51%, ctx=112, majf=0, minf=7 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=153041: Wed Aug 13 11:10:59 2025 write: IOPS=1, BW=5608KiB/s (5743kB/s)(12.0MiB/2191msec); 0 zone resets clat (msec): min=252, max=1589, avg=725.31, stdev=749.29 lat (msec): min=252, max=1589, avg=725.61, stdev=749.25 clat percentiles (msec): | 1.00th=[ 253], 5.00th=[ 253], 10.00th=[ 253], 20.00th=[ 253], | 30.00th=[ 253], 40.00th=[ 334], 50.00th=[ 334], 60.00th=[ 334], | 70.00th=[ 1586], 80.00th=[ 1586], 90.00th=[ 1586], 95.00th=[ 1586], | 99.00th=[ 1586], 99.50th=[ 1586], 99.90th=[ 1586], 99.95th=[ 1586], | 99.99th=[ 1586] bw ( KiB/s): min= 7571, max= 8192, per=89.41%, avg=7881.50, stdev=439.11, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 500=66.67%, 2000=33.33% cpu : usr=0.05%, sys=14.75%, ctx=236, majf=0, minf=8 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=4408KiB/s (4514kB/s), 1102KiB/s-5034KiB/s (1128kB/s-5155kB/s), io=16.0MiB (16.8MB), run=2441-3717msec WRITE: bw=8816KiB/s (9027kB/s), 2204KiB/s-5608KiB/s (2257kB/s-5743kB/s), io=32.0MiB (33.6MB), run=2191-3717msec