== sanity test 398b: DIO and buffer IO race ============== 21:22:16 (1789608136) /usr/bin/fio 48+0 records in 48+0 records out 50331648 bytes (50 MB, 48 MiB) copied, 5.90925 s, 8.5 MB/s mix direct rw 4096 by fio with 4 jobs... mix buffer rw 4096 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180099: Wed Sep 16 21:24:42 2026 read: IOPS=11, BW=47.0KiB/s (49.1kB/s)(5992KiB/124876msec) clat (usec): min=38, max=266931, avg=45074.53, stdev=28365.49 lat (usec): min=38, max=266932, avg=45078.55, stdev=28366.40 clat percentiles (usec): | 1.00th=[ 53], 5.00th=[ 12387], 10.00th=[ 17695], 20.00th=[ 23462], | 30.00th=[ 28705], 40.00th=[ 33817], 50.00th=[ 38536], 60.00th=[ 45351], | 70.00th=[ 53216], 80.00th=[ 64750], 90.00th=[ 80217], 95.00th=[ 99091], | 99.00th=[145753], 99.50th=[164627], 99.90th=[206570], 99.95th=[267387], | 99.99th=[267387] bw ( KiB/s): min= 7, max= 103, per=25.23%, avg=47.68, stdev=17.32, samples=245 iops : min= 1, max= 25, avg=11.28, stdev= 4.36, samples=245 write: IOPS=12, BW=50.4KiB/s (51.6kB/s)(6296KiB/124876msec); 0 zone resets clat (usec): min=957, max=927455, avg=36100.57, stdev=44478.73 lat (usec): min=957, max=927458, avg=36103.61, stdev=44478.21 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1352], 10.00th=[ 2024], 20.00th=[ 4015], | 30.00th=[ 7963], 40.00th=[ 16188], 50.00th=[ 26084], 60.00th=[ 34341], | 70.00th=[ 45351], 80.00th=[ 60031], 90.00th=[ 83362], 95.00th=[105382], | 99.00th=[173016], 99.50th=[212861], 99.90th=[337642], 99.95th=[926942], | 99.99th=[926942] bw ( KiB/s): min= 7, max= 125, per=25.48%, avg=50.45, stdev=21.73, samples=243 iops : min= 1, max= 31, avg=11.98, stdev= 5.50, samples=243 lat (usec) : 50=0.29%, 100=1.20%, 250=0.16%, 500=0.03%, 1000=0.03% lat (msec) : 2=5.01%, 4=5.21%, 10=7.00%, 20=9.93%, 50=41.18% lat (msec) : 100=24.64%, 250=5.14%, 500=0.13%, 1000=0.03% cpu : usr=0.07%, sys=5.10%, ctx=6791, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180100: Wed Sep 16 21:24:42 2026 read: IOPS=11, BW=47.9KiB/s (49.0kB/s)(5940KiB/124131msec) clat (usec): min=39, max=215907, avg=44812.94, stdev=27751.59 lat (usec): min=39, max=215909, avg=44825.71, stdev=27760.00 clat percentiles (usec): | 1.00th=[ 55], 5.00th=[ 14091], 10.00th=[ 18220], 20.00th=[ 23200], | 30.00th=[ 27919], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 45876], | 70.00th=[ 53216], 80.00th=[ 64226], 90.00th=[ 80217], 95.00th=[ 95945], | 99.00th=[139461], 99.50th=[158335], 99.90th=[200279], 99.95th=[214959], | 99.99th=[214959] bw ( KiB/s): min= 6, max= 110, per=25.28%, avg=47.78, stdev=18.42, samples=243 iops : min= 1, max= 27, avg=11.30, stdev= 4.61, samples=243 write: IOPS=12, BW=51.1KiB/s (52.4kB/s)(6348KiB/124131msec); 0 zone resets clat (usec): min=991, max=958862, avg=35935.98, stdev=43289.62 lat (usec): min=992, max=958864, avg=35940.46, stdev=43289.89 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1287], 10.00th=[ 1844], 20.00th=[ 3916], | 30.00th=[ 7242], 40.00th=[ 16188], 50.00th=[ 25560], 60.00th=[ 34866], | 70.00th=[ 46400], 80.00th=[ 62653], 90.00th=[ 85459], 95.00th=[104334], | 99.00th=[164627], 99.50th=[183501], 99.90th=[299893], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 6, max= 111, per=25.70%, avg=50.89, stdev=20.82, samples=244 iops : min= 1, max= 27, avg=12.09, stdev= 5.23, samples=244 lat (usec) : 50=0.20%, 100=1.17%, 250=0.20%, 500=0.13%, 1000=0.03% lat (msec) : 2=5.79%, 4=4.82%, 10=7.13%, 20=9.96%, 50=39.78% lat (msec) : 100=25.72%, 250=4.95%, 500=0.10%, 1000=0.03% cpu : usr=0.07%, sys=4.98%, ctx=6584, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180102: Wed Sep 16 21:24:42 2026 read: IOPS=12, BW=48.4KiB/s (49.5kB/s)(6028KiB/124588msec) clat (usec): min=44, max=960712, avg=44737.72, stdev=37536.11 lat (usec): min=44, max=960713, avg=44741.01, stdev=37536.43 clat percentiles (usec): | 1.00th=[ 54], 5.00th=[ 12518], 10.00th=[ 17433], 20.00th=[ 22676], | 30.00th=[ 27395], 40.00th=[ 32900], 50.00th=[ 38011], 60.00th=[ 43779], | 70.00th=[ 52691], 80.00th=[ 62129], 90.00th=[ 77071], 95.00th=[ 96994], | 99.00th=[147850], 99.50th=[164627], 99.90th=[325059], 99.95th=[960496], | 99.99th=[960496] bw ( KiB/s): min= 8, max= 103, per=25.53%, avg=48.25, stdev=19.84, samples=244 iops : min= 2, max= 25, avg=11.42, stdev= 4.99, samples=244 write: IOPS=12, BW=50.2KiB/s (51.5kB/s)(6260KiB/124588msec); 0 zone resets clat (usec): min=1004, max=302347, avg=36231.48, stdev=39417.88 lat (usec): min=1006, max=302349, avg=36235.65, stdev=39416.14 clat percentiles (usec): | 1.00th=[ 1106], 5.00th=[ 1254], 10.00th=[ 1745], 20.00th=[ 3752], | 30.00th=[ 7570], 40.00th=[ 16712], 50.00th=[ 25822], 60.00th=[ 33817], | 70.00th=[ 45876], 80.00th=[ 62129], 90.00th=[ 87557], 95.00th=[111674], | 99.00th=[183501], 99.50th=[217056], 99.90th=[278922], 99.95th=[304088], | 99.99th=[304088] bw ( KiB/s): min= 7, max= 119, per=25.17%, avg=49.84, stdev=20.32, samples=245 iops : min= 1, max= 29, avg=11.82, stdev= 5.11, samples=245 lat (usec) : 50=0.26%, 100=1.30%, 250=0.23% lat (msec) : 2=5.99%, 4=4.62%, 10=7.26%, 20=9.11%, 50=41.57% lat (msec) : 100=23.73%, 250=5.70%, 500=0.20%, 1000=0.03% cpu : usr=0.10%, sys=4.93%, ctx=6716, majf=0, minf=16 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180105: Wed Sep 16 21:24:42 2026 read: IOPS=11, BW=47.7KiB/s (48.9kB/s)(6052KiB/126831msec) clat (usec): min=36, max=233546, avg=45830.99, stdev=30505.66 lat (usec): min=36, max=233548, avg=45832.93, stdev=30506.91 clat percentiles (usec): | 1.00th=[ 56], 5.00th=[ 10290], 10.00th=[ 17171], 20.00th=[ 22676], | 30.00th=[ 27919], 40.00th=[ 33424], 50.00th=[ 39060], 60.00th=[ 45876], | 70.00th=[ 54789], 80.00th=[ 64750], 90.00th=[ 83362], 95.00th=[102237], | 99.00th=[152044], 99.50th=[175113], 99.90th=[231736], 99.95th=[233833], | 99.99th=[233833] bw ( KiB/s): min= 7, max= 103, per=25.19%, avg=47.61, stdev=18.81, samples=248 iops : min= 1, max= 25, avg=11.25, stdev= 4.71, samples=248 write: IOPS=12, BW=49.2KiB/s (50.3kB/s)(6236KiB/126831msec); 0 zone resets clat (usec): min=985, max=984522, avg=36566.18, stdev=44792.26 lat (usec): min=986, max=984523, avg=36568.47, stdev=44792.07 clat percentiles (usec): | 1.00th=[ 1090], 5.00th=[ 1287], 10.00th=[ 2024], 20.00th=[ 3818], | 30.00th=[ 7308], 40.00th=[ 16581], 50.00th=[ 26346], 60.00th=[ 34341], | 70.00th=[ 45876], 80.00th=[ 60556], 90.00th=[ 86508], 95.00th=[111674], | 99.00th=[170918], 99.50th=[187696], 99.90th=[354419], 99.95th=[985662], | 99.99th=[985662] bw ( KiB/s): min= 7, max= 119, per=24.67%, avg=48.85, stdev=21.83, samples=248 iops : min= 1, max= 29, avg=11.58, stdev= 5.49, samples=248 lat (usec) : 50=0.20%, 100=1.30%, 250=0.36%, 500=0.07%, 1000=0.03% lat (msec) : 2=4.95%, 4=5.60%, 10=7.19%, 20=9.24%, 50=39.71% lat (msec) : 100=25.03%, 250=6.25%, 500=0.03%, 1000=0.03% cpu : usr=0.08%, sys=4.87%, ctx=6793, majf=0, minf=17 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=189KiB/s (194kB/s), 47.7KiB/s-48.4KiB/s (48.9kB/s-49.5kB/s), io=23.4MiB (24.6MB), run=124131-126831msec WRITE: bw=198KiB/s (203kB/s), 49.2KiB/s-51.1KiB/s (50.3kB/s-52.4kB/s), io=24.6MiB (25.7MB), run=124131-126831msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180098: Wed Sep 16 21:25:12 2026 read: IOPS=9, BW=38.4KiB/s (39.3kB/s)(5992KiB/155954msec) clat (msec): min=4, max=910, avg=40.90, stdev=47.45 lat (msec): min=4, max=910, avg=40.91, stdev=47.45 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 33], | 70.00th=[ 43], 80.00th=[ 59], 90.00th=[ 92], 95.00th=[ 128], | 99.00th=[ 199], 99.50th=[ 262], 99.90th=[ 380], 99.95th=[ 911], | 99.99th=[ 911] bw ( KiB/s): min= 7, max= 199, per=25.39%, avg=38.84, stdev=31.31, samples=299 iops : min= 1, max= 49, avg= 9.05, stdev= 7.88, samples=299 write: IOPS=10, BW=40.4KiB/s (41.3kB/s)(6296KiB/155954msec); 0 zone resets clat (msec): min=9, max=440, avg=59.86, stdev=48.48 lat (msec): min=9, max=440, avg=59.86, stdev=48.48 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 18], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 34], 50.00th=[ 42], 60.00th=[ 54], | 70.00th=[ 71], 80.00th=[ 94], 90.00th=[ 124], 95.00th=[ 157], | 99.00th=[ 215], 99.50th=[ 271], 99.90th=[ 338], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 167, per=24.97%, avg=39.95, stdev=31.04, samples=306 iops : min= 1, max= 41, avg= 9.33, stdev= 7.84, samples=306 lat (msec) : 10=4.69%, 20=21.00%, 50=40.23%, 100=20.93%, 250=12.47% lat (msec) : 500=0.65%, 1000=0.03% cpu : usr=0.06%, sys=1.87%, ctx=4969, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1498,1574,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180101: Wed Sep 16 21:25:12 2026 read: IOPS=9, BW=38.0KiB/s (38.0kB/s)(5940KiB/156146msec) clat (msec): min=4, max=1014, avg=40.47, stdev=47.69 lat (msec): min=4, max=1014, avg=40.47, stdev=47.69 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 13], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 31], | 70.00th=[ 41], 80.00th=[ 58], 90.00th=[ 95], 95.00th=[ 131], | 99.00th=[ 194], 99.50th=[ 215], 99.90th=[ 368], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7, max= 175, per=25.74%, avg=39.38, stdev=32.13, samples=294 iops : min= 1, max= 43, avg= 9.19, stdev= 8.11, samples=294 write: IOPS=10, BW=40.7KiB/s (41.6kB/s)(6348KiB/156146msec); 0 zone resets clat (msec): min=8, max=443, avg=60.25, stdev=48.60 lat (msec): min=8, max=443, avg=60.26, stdev=48.60 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 42], 60.00th=[ 55], | 70.00th=[ 73], 80.00th=[ 95], 90.00th=[ 128], 95.00th=[ 155], | 99.00th=[ 222], 99.50th=[ 275], 99.90th=[ 409], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 7, max= 152, per=25.34%, avg=40.54, stdev=31.08, samples=305 iops : min= 1, max= 38, avg= 9.49, stdev= 7.84, samples=305 lat (msec) : 10=4.20%, 20=21.61%, 50=40.40%, 100=20.05%, 250=13.25% lat (msec) : 500=0.46%, 2000=0.03% cpu : usr=0.05%, sys=1.82%, ctx=4885, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1485,1587,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180103: Wed Sep 16 21:25:12 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6028KiB/155937msec) clat (msec): min=5, max=392, avg=41.36, stdev=42.27 lat (msec): min=5, max=392, avg=41.37, stdev=42.27 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 17], 40.00th=[ 20], 50.00th=[ 26], 60.00th=[ 33], | 70.00th=[ 44], 80.00th=[ 64], 90.00th=[ 92], 95.00th=[ 128], | 99.00th=[ 184], 99.50th=[ 215], 99.90th=[ 388], 99.95th=[ 393], | 99.99th=[ 393] bw ( KiB/s): min= 7, max= 157, per=25.60%, avg=39.17, stdev=30.85, samples=299 iops : min= 1, max= 39, avg= 9.14, stdev= 7.78, samples=299 write: IOPS=10, BW=40.1KiB/s (41.1kB/s)(6260KiB/155937msec); 0 zone resets clat (msec): min=11, max=1030, avg=59.51, stdev=53.86 lat (msec): min=11, max=1030, avg=59.52, stdev=53.86 clat percentiles (msec): | 1.00th=[ 14], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 42], 60.00th=[ 54], | 70.00th=[ 71], 80.00th=[ 91], 90.00th=[ 121], 95.00th=[ 155], | 99.00th=[ 234], 99.50th=[ 305], 99.90th=[ 422], 99.95th=[ 1028], | 99.99th=[ 1028] bw ( KiB/s): min= 7, max= 151, per=25.20%, avg=40.32, stdev=30.79, samples=301 iops : min= 1, max= 37, avg= 9.43, stdev= 7.77, samples=301 lat (msec) : 10=4.26%, 20=21.19%, 50=39.91%, 100=22.33%, 250=11.72% lat (msec) : 500=0.55%, 2000=0.03% cpu : usr=0.07%, sys=1.98%, ctx=5010, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1507,1565,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180104: Wed Sep 16 21:25:12 2026 read: IOPS=9, BW=38.7KiB/s (39.6kB/s)(6052KiB/156324msec) clat (msec): min=5, max=293, avg=40.16, stdev=40.42 lat (msec): min=5, max=293, avg=40.16, stdev=40.42 clat percentiles (msec): | 1.00th=[ 7], 5.00th=[ 9], 10.00th=[ 11], 20.00th=[ 14], | 30.00th=[ 16], 40.00th=[ 20], 50.00th=[ 25], 60.00th=[ 32], | 70.00th=[ 41], 80.00th=[ 61], 90.00th=[ 101], 95.00th=[ 128], | 99.00th=[ 190], 99.50th=[ 226], 99.90th=[ 271], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 7, max= 158, per=25.78%, avg=39.45, stdev=31.99, samples=298 iops : min= 1, max= 39, avg= 9.21, stdev= 8.08, samples=298 write: IOPS=9, BW=39.9KiB/s (40.8kB/s)(6236KiB/156324msec); 0 zone resets clat (msec): min=10, max=970, avg=60.99, stdev=54.48 lat (msec): min=10, max=970, avg=61.00, stdev=54.48 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 17], 10.00th=[ 20], 20.00th=[ 24], | 30.00th=[ 28], 40.00th=[ 33], 50.00th=[ 42], 60.00th=[ 55], | 70.00th=[ 72], 80.00th=[ 94], 90.00th=[ 127], 95.00th=[ 153], | 99.00th=[ 253], 99.50th=[ 300], 99.90th=[ 355], 99.95th=[ 969], | 99.99th=[ 969] bw ( KiB/s): min= 7, max= 144, per=24.81%, avg=39.69, stdev=30.90, samples=305 iops : min= 1, max= 36, avg= 9.27, stdev= 7.80, samples=305 lat (msec) : 10=4.46%, 20=21.29%, 50=40.33%, 100=20.08%, 250=13.22% lat (msec) : 500=0.59%, 1000=0.03% cpu : usr=0.05%, sys=1.85%, ctx=4937, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1513,1559,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=154KiB/s (157kB/s), 38.0KiB/s-38.7KiB/s (38.0kB/s-39.6kB/s), io=23.4MiB (24.6MB), run=155937-156324msec WRITE: bw=161KiB/s (165kB/s), 39.9KiB/s-40.7KiB/s (40.8kB/s-41.6kB/s), io=24.6MiB (25.7MB), run=155937-156324msec mix direct rw 16384 by fio with 4 jobs... mix buffer rw 16384 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180147: Wed Sep 16 21:25:52 2026 read: IOPS=11, BW=190KiB/s (195kB/s)(5920KiB/31088msec) clat (usec): min=49, max=209139, avg=44005.14, stdev=32170.05 lat (usec): min=49, max=209139, avg=44006.38, stdev=32170.40 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 70], 10.00th=[ 13173], 20.00th=[ 21103], | 30.00th=[ 25035], 40.00th=[ 30016], 50.00th=[ 39060], 60.00th=[ 43779], | 70.00th=[ 52167], 80.00th=[ 62653], 90.00th=[ 80217], 95.00th=[104334], | 99.00th=[160433], 99.50th=[202376], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 60, max= 379, per=24.57%, avg=189.20, stdev=78.21, samples=61 iops : min= 3, max= 23, avg=11.05, stdev= 4.97, samples=61 write: IOPS=12, BW=205KiB/s (210kB/s)(6368KiB/31088msec); 0 zone resets clat (usec): min=1595, max=207107, avg=36999.32, stdev=34840.49 lat (usec): min=1597, max=207109, avg=37010.77, stdev=34858.29 clat percentiles (usec): | 1.00th=[ 1663], 5.00th=[ 2212], 10.00th=[ 2900], 20.00th=[ 6587], | 30.00th=[ 10945], 40.00th=[ 18482], 50.00th=[ 27132], 60.00th=[ 35914], | 70.00th=[ 49546], 80.00th=[ 64226], 90.00th=[ 88605], 95.00th=[108528], | 99.00th=[147850], 99.50th=[177210], 99.90th=[206570], 99.95th=[206570], | 99.99th=[206570] bw ( KiB/s): min= 31, max= 445, per=25.21%, avg=204.23, stdev=82.61, samples=61 iops : min= 1, max= 27, avg=12.00, stdev= 5.22, samples=61 lat (usec) : 50=0.26%, 100=3.26%, 250=0.26%, 1000=0.13% lat (msec) : 2=2.34%, 4=4.43%, 10=7.94%, 20=11.46%, 50=38.54% lat (msec) : 100=25.13%, 250=6.25% cpu : usr=0.07%, sys=5.38%, ctx=1741, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180148: Wed Sep 16 21:25:52 2026 read: IOPS=12, BW=192KiB/s (197kB/s)(5744KiB/29856msec) clat (usec): min=42, max=157650, avg=43535.08, stdev=28051.65 lat (usec): min=42, max=157651, avg=43536.12, stdev=28051.69 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 65], 10.00th=[ 15401], 20.00th=[ 22676], | 30.00th=[ 28443], 40.00th=[ 32637], 50.00th=[ 38536], 60.00th=[ 44303], | 70.00th=[ 53740], 80.00th=[ 64226], 90.00th=[ 82314], 95.00th=[ 94897], | 99.00th=[132645], 99.50th=[156238], 99.90th=[158335], 99.95th=[158335], | 99.99th=[158335] bw ( KiB/s): min= 31, max= 414, per=24.97%, avg=192.24, stdev=80.82, samples=59 iops : min= 1, max= 25, avg=11.24, stdev= 5.09, samples=59 write: IOPS=13, BW=219KiB/s (224kB/s)(6544KiB/29856msec); 0 zone resets clat (usec): min=1440, max=201029, avg=34227.34, stdev=33236.72 lat (usec): min=1442, max=201031, avg=34229.24, stdev=33236.69 clat percentiles (usec): | 1.00th=[ 1565], 5.00th=[ 1926], 10.00th=[ 2900], 20.00th=[ 5473], | 30.00th=[ 8848], 40.00th=[ 16450], 50.00th=[ 24773], 60.00th=[ 32900], | 70.00th=[ 45876], 80.00th=[ 59507], 90.00th=[ 81265], 95.00th=[ 96994], | 99.00th=[137364], 99.50th=[154141], 99.90th=[200279], 99.95th=[200279], | 99.99th=[200279] bw ( KiB/s): min= 63, max= 439, per=26.94%, avg=218.22, stdev=86.28, samples=59 iops : min= 3, max= 27, avg=12.88, stdev= 5.48, samples=59 lat (usec) : 50=0.13%, 100=3.26%, 250=0.26%, 750=0.13% lat (msec) : 2=2.86%, 4=4.69%, 10=9.38%, 20=10.29%, 50=40.76% lat (msec) : 100=24.09%, 250=4.17% cpu : usr=0.06%, sys=5.77%, ctx=1707, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180149: Wed Sep 16 21:25:52 2026 read: IOPS=13, BW=214KiB/s (219kB/s)(6256KiB/29276msec) clat (usec): min=45, max=175962, avg=43219.39, stdev=27040.23 lat (usec): min=45, max=175964, avg=43223.27, stdev=27043.72 clat percentiles (usec): | 1.00th=[ 52], 5.00th=[ 61], 10.00th=[ 11994], 20.00th=[ 21890], | 30.00th=[ 28443], 40.00th=[ 33424], 50.00th=[ 40633], 60.00th=[ 48497], | 70.00th=[ 54264], 80.00th=[ 63177], 90.00th=[ 79168], 95.00th=[ 91751], | 99.00th=[117965], 99.50th=[135267], 99.90th=[175113], 99.95th=[175113], | 99.99th=[175113] bw ( KiB/s): min= 31, max= 350, per=27.65%, avg=212.91, stdev=69.42, samples=57 iops : min= 1, max= 21, avg=12.54, stdev= 4.38, samples=57 write: IOPS=12, BW=206KiB/s (211kB/s)(6032KiB/29276msec); 0 zone resets clat (usec): min=1424, max=176703, avg=32297.83, stdev=32055.72 lat (usec): min=1426, max=176704, avg=32301.33, stdev=32054.28 clat percentiles (usec): | 1.00th=[ 1745], 5.00th=[ 2442], 10.00th=[ 3359], 20.00th=[ 5735], | 30.00th=[ 9372], 40.00th=[ 14091], 50.00th=[ 21365], 60.00th=[ 30016], | 70.00th=[ 40109], 80.00th=[ 54789], 90.00th=[ 79168], 95.00th=[101188], | 99.00th=[133694], 99.50th=[141558], 99.90th=[177210], 99.95th=[177210], | 99.99th=[177210] bw ( KiB/s): min= 31, max= 542, per=24.99%, avg=202.40, stdev=94.66, samples=57 iops : min= 1, max= 33, avg=11.88, stdev= 5.98, samples=57 lat (usec) : 50=0.13%, 100=4.04%, 250=0.26%, 500=0.13% lat (msec) : 2=1.43%, 4=5.21%, 10=9.24%, 20=12.50%, 50=36.46% lat (msec) : 100=26.56%, 250=4.04% cpu : usr=0.04%, sys=5.05%, ctx=1758, majf=0, minf=14 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180151: Wed Sep 16 21:25:52 2026 read: IOPS=12, BW=196KiB/s (201kB/s)(6032KiB/30700msec) clat (usec): min=49, max=207912, avg=44127.24, stdev=31481.70 lat (usec): min=49, max=207912, avg=44131.58, stdev=31479.79 clat percentiles (usec): | 1.00th=[ 51], 5.00th=[ 57], 10.00th=[ 69], 20.00th=[ 21365], | 30.00th=[ 29492], 40.00th=[ 35390], 50.00th=[ 40109], 60.00th=[ 45351], | 70.00th=[ 52691], 80.00th=[ 63701], 90.00th=[ 81265], 95.00th=[104334], | 99.00th=[152044], 99.50th=[173016], 99.90th=[208667], 99.95th=[208667], | 99.99th=[208667] bw ( KiB/s): min= 63, max= 413, per=25.89%, avg=199.39, stdev=87.04, samples=59 iops : min= 3, max= 25, avg=11.68, stdev= 5.51, samples=59 write: IOPS=12, BW=204KiB/s (209kB/s)(6256KiB/30700msec); 0 zone resets clat (usec): min=1349, max=225983, avg=35236.55, stdev=35866.22 lat (usec): min=1350, max=225985, avg=35239.05, stdev=35865.85 clat percentiles (usec): | 1.00th=[ 1516], 5.00th=[ 1942], 10.00th=[ 2900], 20.00th=[ 5276], | 30.00th=[ 8979], 40.00th=[ 15795], 50.00th=[ 24773], 60.00th=[ 34341], | 70.00th=[ 44827], 80.00th=[ 56886], 90.00th=[ 84411], 95.00th=[101188], | 99.00th=[168821], 99.50th=[193987], 99.90th=[225444], 99.95th=[225444], | 99.99th=[225444] bw ( KiB/s): min= 63, max= 477, per=25.29%, avg=204.85, stdev=95.50, samples=60 iops : min= 3, max= 29, avg=12.03, stdev= 5.99, samples=60 lat (usec) : 50=0.26%, 100=5.21%, 250=0.52%, 500=0.26% lat (msec) : 2=2.86%, 4=4.95%, 10=8.85%, 20=7.68%, 50=39.58% lat (msec) : 100=24.22%, 250=5.60% cpu : usr=0.07%, sys=5.63%, ctx=1697, majf=0, minf=15 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=770KiB/s (789kB/s), 190KiB/s-214KiB/s (195kB/s-219kB/s), io=23.4MiB (24.5MB), run=29276-31088msec WRITE: bw=811KiB/s (830kB/s), 204KiB/s-219KiB/s (209kB/s-224kB/s), io=24.6MiB (25.8MB), run=29276-31088msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180150: Wed Sep 16 21:26:04 2026 read: IOPS=8, BW=136KiB/s (140kB/s)(5920KiB/43385msec) clat (msec): min=6, max=273, avg=46.26, stdev=42.29 lat (msec): min=6, max=273, avg=46.27, stdev=42.29 clat percentiles (msec): | 1.00th=[ 8], 5.00th=[ 12], 10.00th=[ 16], 20.00th=[ 19], | 30.00th=[ 24], 40.00th=[ 28], 50.00th=[ 33], 60.00th=[ 39], | 70.00th=[ 46], 80.00th=[ 61], 90.00th=[ 101], 95.00th=[ 136], | 99.00th=[ 230], 99.50th=[ 257], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 31, max= 380, per=24.11%, avg=133.11, stdev=80.47, samples=84 iops : min= 1, max= 23, avg= 7.50, stdev= 5.06, samples=84 write: IOPS=9, BW=147KiB/s (150kB/s)(6368KiB/43385msec); 0 zone resets clat (msec): min=12, max=294, avg=65.34, stdev=44.68 lat (msec): min=12, max=294, avg=65.34, stdev=44.68 clat percentiles (msec): | 1.00th=[ 15], 5.00th=[ 23], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 39], 40.00th=[ 43], 50.00th=[ 50], 60.00th=[ 62], | 70.00th=[ 77], 80.00th=[ 94], 90.00th=[ 120], 95.00th=[ 165], | 99.00th=[ 222], 99.50th=[ 284], 99.90th=[ 296], 99.95th=[ 296], | 99.99th=[ 296] bw ( KiB/s): min= 30, max= 412, per=25.03%, avg=145.20, stdev=79.43, samples=84 iops : min= 1, max= 25, avg= 8.26, stdev= 5.03, samples=84 lat (msec) : 10=1.82%, 20=11.07%, 50=48.18%, 100=25.91%, 250=12.24% lat (msec) : 500=0.78% cpu : usr=0.04%, sys=1.64%, ctx=1102, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=370,398,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180152: Wed Sep 16 21:26:04 2026 read: IOPS=8, BW=133KiB/s (136kB/s)(5744KiB/43125msec) clat (msec): min=8, max=273, avg=46.65, stdev=40.65 lat (msec): min=8, max=273, avg=46.65, stdev=40.65 clat percentiles (msec): | 1.00th=[ 11], 5.00th=[ 14], 10.00th=[ 17], 20.00th=[ 20], | 30.00th=[ 25], 40.00th=[ 28], 50.00th=[ 32], 60.00th=[ 38], | 70.00th=[ 48], 80.00th=[ 68], 90.00th=[ 97], 95.00th=[ 127], | 99.00th=[ 232], 99.50th=[ 255], 99.90th=[ 275], 99.95th=[ 275], | 99.99th=[ 275] bw ( KiB/s): min= 30, max= 348, per=24.77%, avg=136.72, stdev=78.75, samples=82 iops : min= 1, max= 21, avg= 7.73, stdev= 4.97, samples=82 write: IOPS=9, BW=152KiB/s (155kB/s)(6544KiB/43125msec); 0 zone resets clat (msec): min=15, max=266, avg=63.94, stdev=41.05 lat (msec): min=15, max=266, avg=63.94, stdev=41.05 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 27], 20.00th=[ 33], | 30.00th=[ 40], 40.00th=[ 45], 50.00th=[ 53], 60.00th=[ 61], | 70.00th=[ 73], 80.00th=[ 87], 90.00th=[ 117], 95.00th=[ 157], | 99.00th=[ 205], 99.50th=[ 243], 99.90th=[ 266], 99.95th=[ 266], | 99.99th=[ 266] bw ( KiB/s): min= 31, max= 412, per=26.85%, avg=155.73, stdev=74.10, samples=82 iops : min= 1, max= 25, avg= 8.93, stdev= 4.69, samples=82 lat (msec) : 10=0.39%, 20=10.55%, 50=47.14%, 100=30.08%, 250=11.33% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.60%, ctx=1066, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=359,409,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180153: Wed Sep 16 21:26:04 2026 read: IOPS=9, BW=145KiB/s (149kB/s)(6256KiB/43002msec) clat (msec): min=7, max=304, avg=45.57, stdev=39.16 lat (msec): min=7, max=304, avg=45.57, stdev=39.16 clat percentiles (msec): | 1.00th=[ 9], 5.00th=[ 13], 10.00th=[ 17], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 33], 60.00th=[ 41], | 70.00th=[ 47], 80.00th=[ 59], 90.00th=[ 88], 95.00th=[ 120], | 99.00th=[ 224], 99.50th=[ 255], 99.90th=[ 305], 99.95th=[ 305], | 99.99th=[ 305] bw ( KiB/s): min= 31, max= 445, per=26.32%, avg=145.27, stdev=83.34, samples=85 iops : min= 1, max= 27, avg= 8.27, stdev= 5.29, samples=85 write: IOPS=8, BW=140KiB/s (144kB/s)(6032KiB/43002msec); 0 zone resets clat (msec): min=17, max=309, avg=66.68, stdev=42.65 lat (msec): min=17, max=309, avg=66.68, stdev=42.65 clat percentiles (msec): | 1.00th=[ 20], 5.00th=[ 25], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 40], 40.00th=[ 46], 50.00th=[ 55], 60.00th=[ 65], | 70.00th=[ 77], 80.00th=[ 93], 90.00th=[ 125], 95.00th=[ 157], | 99.00th=[ 215], 99.50th=[ 228], 99.90th=[ 309], 99.95th=[ 309], | 99.99th=[ 309] bw ( KiB/s): min= 31, max= 380, per=24.32%, avg=141.05, stdev=71.19, samples=84 iops : min= 1, max= 23, avg= 8.00, stdev= 4.47, samples=84 lat (msec) : 10=0.91%, 20=9.77%, 50=48.96%, 100=28.78%, 250=11.07% lat (msec) : 500=0.52% cpu : usr=0.05%, sys=1.67%, ctx=1119, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=391,377,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180154: Wed Sep 16 21:26:04 2026 read: IOPS=8, BW=140KiB/s (143kB/s)(6032KiB/43147msec) clat (msec): min=7, max=267, avg=45.03, stdev=36.95 lat (msec): min=7, max=267, avg=45.04, stdev=36.95 clat percentiles (msec): | 1.00th=[ 10], 5.00th=[ 13], 10.00th=[ 16], 20.00th=[ 21], | 30.00th=[ 25], 40.00th=[ 29], 50.00th=[ 34], 60.00th=[ 40], | 70.00th=[ 50], 80.00th=[ 61], 90.00th=[ 90], 95.00th=[ 118], | 99.00th=[ 220], 99.50th=[ 253], 99.90th=[ 268], 99.95th=[ 268], | 99.99th=[ 268] bw ( KiB/s): min= 31, max= 383, per=25.60%, avg=141.34, stdev=82.57, samples=83 iops : min= 1, max= 23, avg= 8.01, stdev= 5.21, samples=83 write: IOPS=9, BW=145KiB/s (148kB/s)(6256KiB/43147msec); 0 zone resets clat (msec): min=14, max=298, avg=66.30, stdev=43.01 lat (msec): min=14, max=298, avg=66.31, stdev=43.01 clat percentiles (msec): | 1.00th=[ 17], 5.00th=[ 23], 10.00th=[ 28], 20.00th=[ 34], | 30.00th=[ 42], 40.00th=[ 47], 50.00th=[ 54], 60.00th=[ 63], | 70.00th=[ 74], 80.00th=[ 91], 90.00th=[ 122], 95.00th=[ 157], | 99.00th=[ 213], 99.50th=[ 275], 99.90th=[ 300], 99.95th=[ 300], | 99.99th=[ 300] bw ( KiB/s): min= 31, max= 317, per=24.80%, avg=143.81, stdev=71.85, samples=85 iops : min= 1, max= 19, avg= 8.18, stdev= 4.54, samples=85 lat (msec) : 10=0.91%, 20=9.77%, 50=47.53%, 100=30.47%, 250=10.81% lat (msec) : 500=0.52% cpu : usr=0.06%, sys=1.69%, ctx=1175, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=377,391,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=552KiB/s (565kB/s), 133KiB/s-145KiB/s (136kB/s-149kB/s), io=23.4MiB (24.5MB), run=43002-43385msec WRITE: bw=581KiB/s (595kB/s), 140KiB/s-152KiB/s (144kB/s-155kB/s), io=24.6MiB (25.8MB), run=43002-43385msec mix direct rw 1048576 by fio with 4 jobs... mix buffer rw 1048576 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 1024KiB-1024KiB, (W) 1024KiB-1024KiB, (T) 1024KiB-1024KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180165: Wed Sep 16 21:26:17 2026 read: IOPS=1, BW=1450KiB/s (1485kB/s)(7168KiB/4943msec) clat (msec): min=140, max=362, avg=221.65, stdev=83.12 lat (msec): min=141, max=362, avg=221.65, stdev=83.12 clat percentiles (msec): | 1.00th=[ 142], 5.00th=[ 142], 10.00th=[ 142], 20.00th=[ 142], | 30.00th=[ 176], 40.00th=[ 176], 50.00th=[ 194], 60.00th=[ 243], | 70.00th=[ 243], 80.00th=[ 296], 90.00th=[ 363], 95.00th=[ 363], | 99.00th=[ 363], 99.50th=[ 363], 99.90th=[ 363], 99.95th=[ 363], | 99.99th=[ 363] bw ( KiB/s): min= 2007, max= 2900, per=59.72%, avg=2200.00, stdev=391.58, samples=5 iops : min= 1, max= 2, avg= 1.20, stdev= 0.45, samples=5 write: IOPS=1, BW=1036KiB/s (1061kB/s)(5120KiB/4943msec); 0 zone resets clat (msec): min=191, max=2021, avg=670.59, stdev=768.88 lat (msec): min=191, max=2021, avg=670.64, stdev=768.88 clat percentiles (msec): | 1.00th=[ 192], 5.00th=[ 192], 10.00th=[ 192], 20.00th=[ 192], | 30.00th=[ 197], 40.00th=[ 197], 50.00th=[ 414], 60.00th=[ 414], | 70.00th=[ 531], 80.00th=[ 531], 90.00th=[ 2022], 95.00th=[ 2022], | 99.00th=[ 2022], 99.50th=[ 2022], 99.90th=[ 2022], 99.95th=[ 2022], | 99.99th=[ 2022] bw ( KiB/s): min= 2007, max= 4063, per=52.25%, avg=2695.00, stdev=1184.73, samples=3 iops : min= 1, max= 3, avg= 1.67, stdev= 1.15, samples=3 lat (msec) : 250=58.33%, 500=25.00%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=10.91%, ctx=216, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180166: Wed Sep 16 21:26:17 2026 read: IOPS=0, BW=412KiB/s (422kB/s)(2048KiB/4974msec) clat (usec): min=523, max=249761, avg=125142.30, stdev=176237.77 lat (usec): min=524, max=249763, avg=125144.31, stdev=176238.53 clat percentiles (usec): | 1.00th=[ 523], 5.00th=[ 523], 10.00th=[ 523], 20.00th=[ 523], | 30.00th=[ 523], 40.00th=[ 523], 50.00th=[ 523], 60.00th=[250610], | 70.00th=[250610], 80.00th=[250610], 90.00th=[250610], 95.00th=[250610], | 99.00th=[250610], 99.50th=[250610], 99.90th=[250610], 99.95th=[250610], | 99.99th=[250610] bw ( KiB/s): min= 1372, max= 2031, per=46.19%, avg=1701.50, stdev=465.98, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=2, BW=2059KiB/s (2108kB/s)(10.0MiB/4974msec); 0 zone resets clat (msec): min=91, max=1909, avg=464.80, stdev=544.86 lat (msec): min=91, max=1909, avg=464.94, stdev=544.82 clat percentiles (msec): | 1.00th=[ 91], 5.00th=[ 91], 10.00th=[ 91], 20.00th=[ 116], | 30.00th=[ 188], 40.00th=[ 218], 50.00th=[ 241], 60.00th=[ 300], | 70.00th=[ 384], 80.00th=[ 422], 90.00th=[ 785], 95.00th=[ 1905], | 99.00th=[ 1905], 99.50th=[ 1905], 99.90th=[ 1905], 99.95th=[ 1905], | 99.99th=[ 1905] bw ( KiB/s): min= 2015, max= 6095, per=70.75%, avg=3649.40, stdev=1701.74, samples=5 iops : min= 1, max= 5, avg= 2.60, stdev= 1.67, samples=5 lat (usec) : 750=8.33% lat (msec) : 100=8.33%, 250=41.67%, 500=25.00%, 1000=8.33%, 2000=8.33% cpu : usr=0.00%, sys=12.69%, ctx=132, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180167: Wed Sep 16 21:26:17 2026 read: IOPS=1, BW=1105KiB/s (1132kB/s)(6144KiB/5558msec) clat (usec): min=432, max=2486.3k, avg=519701.59, stdev=977770.71 lat (usec): min=433, max=2486.3k, avg=519702.86, stdev=977770.71 clat percentiles (usec): | 1.00th=[ 433], 5.00th=[ 433], 10.00th=[ 433], | 20.00th=[ 469], 30.00th=[ 469], 40.00th=[ 1057], | 50.00th=[ 1057], 60.00th=[ 212861], 70.00th=[ 417334], | 80.00th=[ 417334], 90.00th=[2499806], 95.00th=[2499806], | 99.00th=[2499806], 99.50th=[2499806], 99.90th=[2499806], | 99.95th=[2499806], 99.99th=[2499806] bw ( KiB/s): min= 3976, max= 6071, per=100.00%, avg=5023.50, stdev=1481.39, samples=2 iops : min= 3, max= 5, avg= 4.00, stdev= 1.41, samples=2 write: IOPS=1, BW=1105KiB/s (1132kB/s)(6144KiB/5558msec); 0 zone resets clat (msec): min=137, max=1022, avg=400.73, stdev=339.13 lat (msec): min=137, max=1022, avg=400.78, stdev=339.12 clat percentiles (msec): | 1.00th=[ 138], 5.00th=[ 138], 10.00th=[ 138], 20.00th=[ 194], | 30.00th=[ 194], 40.00th=[ 199], 50.00th=[ 199], 60.00th=[ 296], | 70.00th=[ 558], 80.00th=[ 558], 90.00th=[ 1020], 95.00th=[ 1020], | 99.00th=[ 1020], 99.50th=[ 1020], 99.90th=[ 1020], 99.95th=[ 1020], | 99.99th=[ 1020] bw ( KiB/s): min= 2023, max= 3961, per=48.71%, avg=2512.50, stdev=965.68, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (usec) : 500=16.67% lat (msec) : 2=8.33%, 250=33.33%, 500=16.67%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=10.35%, ctx=516, majf=0, minf=13 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180168: Wed Sep 16 21:26:17 2026 read: IOPS=1, BW=1691KiB/s (1731kB/s)(5120KiB/3028msec) clat (usec): min=443, max=391472, avg=123171.56, stdev=178274.32 lat (usec): min=444, max=391474, avg=123172.92, stdev=178274.50 clat percentiles (usec): | 1.00th=[ 445], 5.00th=[ 445], 10.00th=[ 445], 20.00th=[ 445], | 30.00th=[ 457], 40.00th=[ 457], 50.00th=[ 482], 60.00th=[ 482], | 70.00th=[223347], 80.00th=[223347], 90.00th=[392168], 95.00th=[392168], | 99.00th=[392168], 99.50th=[392168], 99.90th=[392168], 99.95th=[392168], | 99.99th=[392168] bw ( KiB/s): min= 2007, max= 6095, per=100.00%, avg=4051.00, stdev=2890.65, samples=2 iops : min= 1, max= 5, avg= 3.00, stdev= 2.83, samples=2 write: IOPS=2, BW=2367KiB/s (2424kB/s)(7168KiB/3028msec); 0 zone resets clat (msec): min=169, max=734, avg=334.03, stdev=202.90 lat (msec): min=169, max=734, avg=334.09, stdev=202.91 clat percentiles (msec): | 1.00th=[ 169], 5.00th=[ 169], 10.00th=[ 169], 20.00th=[ 203], | 30.00th=[ 222], 40.00th=[ 222], 50.00th=[ 226], 60.00th=[ 321], | 70.00th=[ 321], 80.00th=[ 464], 90.00th=[ 735], 95.00th=[ 735], | 99.00th=[ 735], 99.50th=[ 735], 99.90th=[ 735], 99.95th=[ 735], | 99.99th=[ 735] bw ( KiB/s): min= 1391, max= 2035, per=36.75%, avg=1895.80, stdev=282.42, samples=5 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=5 lat (usec) : 500=25.00% lat (msec) : 250=41.67%, 500=25.00%, 750=8.33% cpu : usr=0.07%, sys=18.70%, ctx=166, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3685KiB/s (3773kB/s), 412KiB/s-1691KiB/s (422kB/s-1731kB/s), io=20.0MiB (20.0MB), run=3028-5558msec WRITE: bw=5159KiB/s (5282kB/s), 1036KiB/s-2367KiB/s (1061kB/s-2424kB/s), io=28.0MiB (29.4MB), run=3028-5558msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180170: Wed Sep 16 21:26:18 2026 read: IOPS=1, BW=1222KiB/s (1252kB/s)(7168KiB/5864msec) clat (msec): min=79, max=1041, avg=282.68, stdev=349.74 lat (msec): min=79, max=1041, avg=282.68, stdev=349.74 clat percentiles (msec): | 1.00th=[ 80], 5.00th=[ 80], 10.00th=[ 80], 20.00th=[ 89], | 30.00th=[ 93], 40.00th=[ 93], 50.00th=[ 131], 60.00th=[ 174], | 70.00th=[ 174], 80.00th=[ 376], 90.00th=[ 1045], 95.00th=[ 1045], | 99.00th=[ 1045], 99.50th=[ 1045], 99.90th=[ 1045], 99.95th=[ 1045], | 99.99th=[ 1045] bw ( KiB/s): min= 1430, max= 2048, per=54.93%, avg=1918.00, stdev=244.14, samples=6 iops : min= 1, max= 2, avg= 1.17, stdev= 0.41, samples=6 write: IOPS=0, BW=873KiB/s (894kB/s)(5120KiB/5864msec); 0 zone resets clat (msec): min=143, max=2782, avg=765.59, stdev=1140.05 lat (msec): min=143, max=2782, avg=765.67, stdev=1140.05 clat percentiles (msec): | 1.00th=[ 144], 5.00th=[ 144], 10.00th=[ 144], 20.00th=[ 144], | 30.00th=[ 146], 40.00th=[ 146], 50.00th=[ 205], 60.00th=[ 205], | 70.00th=[ 550], 80.00th=[ 550], 90.00th=[ 2769], 95.00th=[ 2769], | 99.00th=[ 2769], 99.50th=[ 2769], 99.90th=[ 2769], 99.95th=[ 2769], | 99.99th=[ 2769] bw ( KiB/s): min= 1996, max= 6144, per=69.37%, avg=3391.67, stdev=2383.67, samples=3 iops : min= 1, max= 6, avg= 2.67, stdev= 2.89, samples=3 lat (msec) : 100=25.00%, 250=41.67%, 500=8.33%, 750=8.33%, 2000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=4.01%, ctx=97, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=7,5,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180171: Wed Sep 16 21:26:18 2026 read: IOPS=0, BW=367KiB/s (376kB/s)(2048KiB/5581msec) clat (msec): min=189, max=441, avg=315.65, stdev=178.65 lat (msec): min=189, max=441, avg=315.65, stdev=178.65 clat percentiles (msec): | 1.00th=[ 190], 5.00th=[ 190], 10.00th=[ 190], 20.00th=[ 190], | 30.00th=[ 190], 40.00th=[ 190], 50.00th=[ 190], 60.00th=[ 443], | 70.00th=[ 443], 80.00th=[ 443], 90.00th=[ 443], 95.00th=[ 443], | 99.00th=[ 443], 99.50th=[ 443], 99.90th=[ 443], 99.95th=[ 443], | 99.99th=[ 443] bw ( KiB/s): min= 1501, max= 1996, per=50.07%, avg=1748.50, stdev=350.02, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 write: IOPS=1, BW=1835KiB/s (1879kB/s)(10.0MiB/5581msec); 0 zone resets clat (msec): min=96, max=2550, avg=489.06, stdev=741.48 lat (msec): min=96, max=2550, avg=489.14, stdev=741.48 clat percentiles (msec): | 1.00th=[ 97], 5.00th=[ 97], 10.00th=[ 97], 20.00th=[ 102], | 30.00th=[ 118], 40.00th=[ 144], 50.00th=[ 190], 60.00th=[ 334], | 70.00th=[ 355], 80.00th=[ 447], 90.00th=[ 558], 95.00th=[ 2534], | 99.00th=[ 2534], 99.50th=[ 2534], 99.90th=[ 2534], 99.95th=[ 2534], | 99.99th=[ 2534] bw ( KiB/s): min= 1917, max= 4079, per=49.31%, avg=2410.80, stdev=933.73, samples=5 iops : min= 1, max= 3, avg= 1.40, stdev= 0.89, samples=5 lat (msec) : 100=8.33%, 250=41.67%, 500=33.33%, 750=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=4.68%, ctx=104, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=2,10,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180172: Wed Sep 16 21:26:18 2026 read: IOPS=1, BW=1121KiB/s (1148kB/s)(6144KiB/5482msec) clat (msec): min=98, max=2198, avg=517.54, stdev=828.31 lat (msec): min=98, max=2198, avg=517.54, stdev=828.31 clat percentiles (msec): | 1.00th=[ 100], 5.00th=[ 100], 10.00th=[ 100], 20.00th=[ 102], | 30.00th=[ 102], 40.00th=[ 138], 50.00th=[ 138], 60.00th=[ 243], | 70.00th=[ 330], 80.00th=[ 330], 90.00th=[ 2198], 95.00th=[ 2198], | 99.00th=[ 2198], 99.50th=[ 2198], 99.90th=[ 2198], 99.95th=[ 2198], | 99.99th=[ 2198] bw ( KiB/s): min= 2023, max= 3992, per=72.26%, avg=2523.25, stdev=979.20, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 write: IOPS=1, BW=1121KiB/s (1148kB/s)(6144KiB/5482msec); 0 zone resets clat (msec): min=177, max=850, avg=375.71, stdev=256.86 lat (msec): min=177, max=850, avg=375.79, stdev=256.86 clat percentiles (msec): | 1.00th=[ 178], 5.00th=[ 178], 10.00th=[ 178], 20.00th=[ 180], | 30.00th=[ 180], 40.00th=[ 226], 50.00th=[ 226], 60.00th=[ 384], | 70.00th=[ 439], 80.00th=[ 439], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 1426, max= 4079, per=48.80%, avg=2386.00, stdev=1162.98, samples=4 iops : min= 1, max= 3, avg= 1.50, stdev= 1.00, samples=4 lat (msec) : 100=8.33%, 250=50.00%, 500=25.00%, 1000=8.33%, >=2000=8.33% cpu : usr=0.00%, sys=5.24%, ctx=150, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=6,6,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180173: Wed Sep 16 21:26:18 2026 read: IOPS=0, BW=881KiB/s (902kB/s)(5120KiB/5814msec) clat (msec): min=78, max=161, avg=104.61, stdev=33.85 lat (msec): min=78, max=161, avg=104.61, stdev=33.85 clat percentiles (msec): | 1.00th=[ 79], 5.00th=[ 79], 10.00th=[ 79], 20.00th=[ 79], | 30.00th=[ 85], 40.00th=[ 85], 50.00th=[ 89], 60.00th=[ 89], | 70.00th=[ 111], 80.00th=[ 111], 90.00th=[ 161], 95.00th=[ 161], | 99.00th=[ 161], 99.50th=[ 161], 99.90th=[ 161], 99.95th=[ 161], | 99.99th=[ 161] bw ( KiB/s): min= 7984, max= 7984, per=100.00%, avg=7984.00, stdev= 0.00, samples=1 iops : min= 7, max= 7, avg= 7.00, stdev= 0.00, samples=1 write: IOPS=1, BW=1233KiB/s (1262kB/s)(7168KiB/5814msec); 0 zone resets clat (msec): min=131, max=2869, avg=754.86, stdev=963.15 lat (msec): min=131, max=2869, avg=754.93, stdev=963.15 clat percentiles (msec): | 1.00th=[ 132], 5.00th=[ 132], 10.00th=[ 132], 20.00th=[ 146], | 30.00th=[ 321], 40.00th=[ 321], 50.00th=[ 460], 60.00th=[ 527], | 70.00th=[ 527], 80.00th=[ 835], 90.00th=[ 2869], 95.00th=[ 2869], | 99.00th=[ 2869], 99.50th=[ 2869], 99.90th=[ 2869], 99.95th=[ 2869], | 99.99th=[ 2869] bw ( KiB/s): min= 1612, max= 4096, per=60.47%, avg=2956.50, stdev=1317.57, samples=4 iops : min= 1, max= 4, avg= 2.25, stdev= 1.50, samples=4 lat (msec) : 100=25.00%, 250=33.33%, 500=16.67%, 750=8.33%, 1000=8.33% lat (msec) : >=2000=8.33% cpu : usr=0.00%, sys=3.18%, ctx=87, majf=0, minf=12 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=5,7,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=3492KiB/s (3576kB/s), 367KiB/s-1222KiB/s (376kB/s-1252kB/s), io=20.0MiB (20.0MB), run=5482-5864msec WRITE: bw=4889KiB/s (5007kB/s), 873KiB/s-1835KiB/s (894kB/s-1879kB/s), io=28.0MiB (29.4MB), run=5482-5864msec mix direct rw 4194304 by fio with 4 jobs... mix buffer rw 4194304 by fio with 4 jobs... rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (g=0): rw=randrw, bs=(R) 4096KiB-4096KiB, (W) 4096KiB-4096KiB, (T) 4096KiB-4096KiB, ioengine=psync, iodepth=16 ... fio-3.19 Starting 4 processes rand-rw: (groupid=0, jobs=1): err= 0: pid=180184: Wed Sep 16 21:26:29 2026 read: IOPS=1, BW=5729KiB/s (5866kB/s)(12.0MiB/2145msec) clat (msec): min=516, max=1006, avg=714.68, stdev=258.40 lat (msec): min=516, max=1006, avg=714.68, stdev=258.40 clat percentiles (msec): | 1.00th=[ 518], 5.00th=[ 518], 10.00th=[ 518], 20.00th=[ 518], | 30.00th=[ 518], 40.00th=[ 625], 50.00th=[ 625], 60.00th=[ 625], | 70.00th=[ 1011], 80.00th=[ 1011], 90.00th=[ 1011], 95.00th=[ 1011], | 99.00th=[ 1011], 99.50th=[ 1011], 99.90th=[ 1011], 99.95th=[ 1011], | 99.99th=[ 1011] bw ( KiB/s): min= 7501, max= 8192, per=100.00%, avg=7846.50, stdev=488.61, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 750=66.67%, 2000=33.33% cpu : usr=0.37%, sys=4.85%, ctx=33, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180185: Wed Sep 16 21:26:29 2026 read: IOPS=0, BW=1724KiB/s (1765kB/s)(4096KiB/2376msec) clat (nsec): min=953073k, max=953073k, avg=953073331.00, stdev= 0.00 lat (nsec): min=953076k, max=953076k, avg=953075694.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 953], 5.00th=[ 953], 10.00th=[ 953], 20.00th=[ 953], | 30.00th=[ 953], 40.00th=[ 953], 50.00th=[ 953], 60.00th=[ 953], | 70.00th=[ 953], 80.00th=[ 953], 90.00th=[ 953], 95.00th=[ 953], | 99.00th=[ 953], 99.50th=[ 953], 99.90th=[ 953], 99.95th=[ 953], | 99.99th=[ 953] bw ( KiB/s): min= 8159, max= 8159, per=100.00%, avg=8159.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3448KiB/s (3531kB/s)(8192KiB/2376msec); 0 zone resets clat (msec): min=666, max=715, avg=691.17, stdev=34.73 lat (msec): min=667, max=716, avg=691.70, stdev=34.90 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 667], 50.00th=[ 667], 60.00th=[ 718], | 70.00th=[ 718], 80.00th=[ 718], 90.00th=[ 718], 95.00th=[ 718], | 99.00th=[ 718], 99.50th=[ 718], 99.90th=[ 718], 99.95th=[ 718], | 99.99th=[ 718] bw ( KiB/s): min= 8175, max= 8175, per=59.28%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.07%, ctx=65, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180186: Wed Sep 16 21:26:29 2026 write: IOPS=1, BW=5994KiB/s (6138kB/s)(12.0MiB/2050msec); 0 zone resets clat (msec): min=581, max=794, avg=669.21, stdev=111.28 lat (msec): min=581, max=795, avg=669.71, stdev=111.67 clat percentiles (msec): | 1.00th=[ 584], 5.00th=[ 584], 10.00th=[ 584], 20.00th=[ 584], | 30.00th=[ 584], 40.00th=[ 634], 50.00th=[ 634], 60.00th=[ 634], | 70.00th=[ 793], 80.00th=[ 793], 90.00th=[ 793], 95.00th=[ 793], | 99.00th=[ 793], 99.50th=[ 793], 99.90th=[ 793], 99.95th=[ 793], | 99.99th=[ 793] bw ( KiB/s): min= 7501, max= 8175, per=56.83%, avg=7838.00, stdev=476.59, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=66.67%, 1000=33.33% cpu : usr=0.00%, sys=7.13%, ctx=35, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180187: Wed Sep 16 21:26:29 2026 write: IOPS=1, BW=5306KiB/s (5433kB/s)(12.0MiB/2316msec); 0 zone resets clat (msec): min=230, max=1547, avg=769.39, stdev=690.44 lat (msec): min=233, max=1548, avg=771.13, stdev=689.22 clat percentiles (msec): | 1.00th=[ 230], 5.00th=[ 230], 10.00th=[ 230], 20.00th=[ 230], | 30.00th=[ 230], 40.00th=[ 531], 50.00th=[ 531], 60.00th=[ 531], | 70.00th=[ 1552], 80.00th=[ 1552], 90.00th=[ 1552], 95.00th=[ 1552], | 99.00th=[ 1552], 99.50th=[ 1552], 99.90th=[ 1552], 99.95th=[ 1552], | 99.99th=[ 1552] bw ( KiB/s): min= 7474, max= 8192, per=56.80%, avg=7833.00, stdev=507.70, samples=2 iops : min= 1, max= 2, avg= 1.50, stdev= 0.71, samples=2 lat (msec) : 250=33.33%, 750=33.33%, 2000=33.33% cpu : usr=0.00%, sys=6.00%, ctx=37, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6896KiB/s (7061kB/s), 1724KiB/s-5729KiB/s (1765kB/s-5866kB/s), io=16.0MiB (16.8MB), run=2145-2376msec WRITE: bw=13.5MiB/s (14.1MB/s), 3448KiB/s-5994KiB/s (3531kB/s-6138kB/s), io=32.0MiB (33.6MB), run=2050-2376msec rand-rw: (groupid=0, jobs=1): err= 0: pid=180179: Wed Sep 16 21:26:30 2026 read: IOPS=1, BW=6000KiB/s (6144kB/s)(12.0MiB/2048msec) clat (msec): min=663, max=680, avg=672.90, stdev= 8.73 lat (msec): min=663, max=680, avg=672.90, stdev= 8.73 clat percentiles (msec): | 1.00th=[ 667], 5.00th=[ 667], 10.00th=[ 667], 20.00th=[ 667], | 30.00th=[ 667], 40.00th=[ 676], 50.00th=[ 676], 60.00th=[ 676], | 70.00th=[ 684], 80.00th=[ 684], 90.00th=[ 684], 95.00th=[ 684], | 99.00th=[ 684], 99.50th=[ 684], 99.90th=[ 684], 99.95th=[ 684], | 99.99th=[ 684] bw ( KiB/s): min= 5688, max= 8175, per=99.98%, avg=6931.50, stdev=1758.57, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 750=100.00% cpu : usr=0.00%, sys=20.66%, ctx=393, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=3,0,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180180: Wed Sep 16 21:26:30 2026 read: IOPS=0, BW=1733KiB/s (1775kB/s)(4096KiB/2363msec) clat (nsec): min=658013k, max=658013k, avg=658013018.00, stdev= 0.00 lat (nsec): min=658015k, max=658015k, avg=658014693.00, stdev= 0.00 clat percentiles (msec): | 1.00th=[ 659], 5.00th=[ 659], 10.00th=[ 659], 20.00th=[ 659], | 30.00th=[ 659], 40.00th=[ 659], 50.00th=[ 659], 60.00th=[ 659], | 70.00th=[ 659], 80.00th=[ 659], 90.00th=[ 659], 95.00th=[ 659], | 99.00th=[ 659], 99.50th=[ 659], 99.90th=[ 659], 99.95th=[ 659], | 99.99th=[ 659] bw ( KiB/s): min= 8126, max= 8126, per=100.00%, avg=8126.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 write: IOPS=0, BW=3467KiB/s (3550kB/s)(8192KiB/2363msec); 0 zone resets clat (msec): min=772, max=851, avg=811.88, stdev=55.43 lat (msec): min=773, max=851, avg=812.19, stdev=55.40 clat percentiles (msec): | 1.00th=[ 776], 5.00th=[ 776], 10.00th=[ 776], 20.00th=[ 776], | 30.00th=[ 776], 40.00th=[ 776], 50.00th=[ 776], 60.00th=[ 852], | 70.00th=[ 852], 80.00th=[ 852], 90.00th=[ 852], 95.00th=[ 852], | 99.00th=[ 852], 99.50th=[ 852], 99.90th=[ 852], 99.95th=[ 852], | 99.99th=[ 852] bw ( KiB/s): min= 8175, max= 8175, per=73.95%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 750=33.33%, 1000=66.67% cpu : usr=0.00%, sys=5.84%, ctx=99, majf=0, minf=11 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=1,2,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180181: Wed Sep 16 21:26:30 2026 write: IOPS=1, BW=4146KiB/s (4245kB/s)(12.0MiB/2964msec); 0 zone resets clat (msec): min=208, max=1870, avg=974.55, stdev=838.91 lat (msec): min=208, max=1871, avg=975.00, stdev=839.00 clat percentiles (msec): | 1.00th=[ 209], 5.00th=[ 209], 10.00th=[ 209], 20.00th=[ 209], | 30.00th=[ 209], 40.00th=[ 844], 50.00th=[ 844], 60.00th=[ 844], | 70.00th=[ 1871], 80.00th=[ 1871], 90.00th=[ 1871], 95.00th=[ 1871], | 99.00th=[ 1871], 99.50th=[ 1871], 99.90th=[ 1871], 99.95th=[ 1871], | 99.99th=[ 1871] bw ( KiB/s): min= 8175, max= 8175, per=73.95%, avg=8175.00, stdev= 0.00, samples=1 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=1 lat (msec) : 250=33.33%, 1000=33.33%, 2000=33.33% cpu : usr=0.00%, sys=4.96%, ctx=88, majf=0, minf=9 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 rand-rw: (groupid=0, jobs=1): err= 0: pid=180182: Wed Sep 16 21:26:30 2026 write: IOPS=1, BW=5896KiB/s (6038kB/s)(12.0MiB/2084msec); 0 zone resets clat (msec): min=495, max=933, avg=692.94, stdev=222.23 lat (msec): min=496, max=934, avg=693.78, stdev=221.78 clat percentiles (msec): | 1.00th=[ 498], 5.00th=[ 498], 10.00th=[ 498], 20.00th=[ 498], | 30.00th=[ 498], 40.00th=[ 651], 50.00th=[ 651], 60.00th=[ 651], | 70.00th=[ 936], 80.00th=[ 936], 90.00th=[ 936], 95.00th=[ 936], | 99.00th=[ 936], 99.50th=[ 936], 99.90th=[ 936], 99.95th=[ 936], | 99.99th=[ 936] bw ( KiB/s): min= 6068, max= 8175, per=64.42%, avg=7121.50, stdev=1489.87, samples=2 iops : min= 1, max= 1, avg= 1.00, stdev= 0.00, samples=2 lat (msec) : 500=33.33%, 750=33.33%, 1000=33.33% cpu : usr=0.00%, sys=5.14%, ctx=50, majf=0, minf=10 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% issued rwts: total=0,3,0,0 short=0,0,0,0 dropped=0,0,0,0 latency : target=0, window=0, percentile=100.00%, depth=16 Run status group 0 (all jobs): READ: bw=6934KiB/s (7100kB/s), 1733KiB/s-6000KiB/s (1775kB/s-6144kB/s), io=16.0MiB (16.8MB), run=2048-2363msec WRITE: bw=10.8MiB/s (11.3MB/s), 3467KiB/s-5896KiB/s (3550kB/s-6038kB/s), io=32.0MiB (33.6MB), run=2084-2964msec